Benchmarks

Updated on 12 March, 2026

Benchmark methodology and performance results for LLM inference workloads on NVIDIA HGX B200 GPUs.


How we measure LLM inference performance on NVIDIA HGX B200 GPUs.
Consolidated benchmark results for all five models on NVIDIA HGX B200 GPUs.