Today we are excited to announce a fresh update on the Lambda Model Cards! Understanding how serving models requires more than knowing the raw tokens/s, and se

Today we are excited to announce a fresh update on the Lambda Model Cards! Understanding how serving models requires more than knowing the raw tokens/s, and serving real users means caring about more than just concurrency at 1. As of today, our model cards now showcase benchmarks off of @​NVIDIAAI…