Side-by-side, with the numbers that matter.
Two rigs, one table. Higher numbers win in cobalt; TDP and price flip.
Rig A
NVIDIA H100
NVIDIA · accelerator
Change
- 1X Neo
- Agility Robotics Digit
- Alibaba Qwen2.5-72B-Instruct (Q4 quant)
- AMD Instinct MI300X
- AMD Instinct MI325X
- AMD Instinct MI355X
- Anthropic Claude Opus 4.7
- Apple Mac Pro (M2 Ultra, 2023)
- Apple Mac Studio (M3 Ultra)
- Apple MacBook Pro 16-inch, M4 Max (2024)
- Apptronik Apollo
- Aurora
- AWS Trainium2
- Boston Dynamics Atlas
- Boston Dynamics Spot
- Cerebras Wafer-Scale Engine 3
- El Capitan
- Figure 02
- Frontier (OLCF-5)
- Google Cloud TPU v5p
- Groq Language Processing Unit
- Intel Gaudi 3 HL-325L
- MSI GeForce RTX 5090 Suprim Liquid
- NVIDIA B100
- NVIDIA B200
- NVIDIA DGX B200
- NVIDIA DGX H200
- NVIDIA DGX Spark
- NVIDIA Eos DGX SuperPOD
- NVIDIA GB200
- NVIDIA GB200 NVL72
- NVIDIA GeForce RTX 4090 Founders Edition
- NVIDIA GeForce RTX 5070 Ti
- NVIDIA GeForce RTX 5080 Founders Edition
- NVIDIA GeForce RTX 5090 Founders Edition
- NVIDIA GH200 Grace Hopper
- NVIDIA H100
- NVIDIA H200
- NVIDIA HGX B200
- NVIDIA Jetson AGX Thor
- NVIDIA RTX PRO 4500 Blackwell
- NVIDIA RTX PRO 5000 Blackwell
- NVIDIA RTX PRO 6000 Blackwell
- OpenAI GPT-5
- SambaNova SN40L Reconfigurable Dataflow Unit
- Sanctuary AI Phoenix
- Tesla Optimus
- The Stargate Project
- Unitree B2
- Unitree G1
- Unitree H1
Rig B
AMD Instinct MI325X
AMD · accelerator
Change
- 1X Neo
- Agility Robotics Digit
- Alibaba Qwen2.5-72B-Instruct (Q4 quant)
- AMD Instinct MI300X
- AMD Instinct MI325X
- AMD Instinct MI355X
- Anthropic Claude Opus 4.7
- Apple Mac Pro (M2 Ultra, 2023)
- Apple Mac Studio (M3 Ultra)
- Apple MacBook Pro 16-inch, M4 Max (2024)
- Apptronik Apollo
- Aurora
- AWS Trainium2
- Boston Dynamics Atlas
- Boston Dynamics Spot
- Cerebras Wafer-Scale Engine 3
- El Capitan
- Figure 02
- Frontier (OLCF-5)
- Google Cloud TPU v5p
- Groq Language Processing Unit
- Intel Gaudi 3 HL-325L
- MSI GeForce RTX 5090 Suprim Liquid
- NVIDIA B100
- NVIDIA B200
- NVIDIA DGX B200
- NVIDIA DGX H200
- NVIDIA DGX Spark
- NVIDIA Eos DGX SuperPOD
- NVIDIA GB200
- NVIDIA GB200 NVL72
- NVIDIA GeForce RTX 4090 Founders Edition
- NVIDIA GeForce RTX 5070 Ti
- NVIDIA GeForce RTX 5080 Founders Edition
- NVIDIA GeForce RTX 5090 Founders Edition
- NVIDIA GH200 Grace Hopper
- NVIDIA H100
- NVIDIA H200
- NVIDIA HGX B200
- NVIDIA Jetson AGX Thor
- NVIDIA RTX PRO 4500 Blackwell
- NVIDIA RTX PRO 5000 Blackwell
- NVIDIA RTX PRO 6000 Blackwell
- OpenAI GPT-5
- SambaNova SN40L Reconfigurable Dataflow Unit
- Sanctuary AI Phoenix
- Tesla Optimus
- The Stargate Project
- Unitree B2
- Unitree G1
- Unitree H1
2 of 28 fields comparable
⇄ swap sidesNVIDIA H100AMD Instinct MI325X
HBM (GB)
80
256
Memory bandwidth (TB/s)
3.35
6
| Spec | NVIDIA H100 | AMD Instinct MI325X |
|---|---|---|
| HBM (GB) | 80 | 256 |
| Memory bandwidth (TB/s) | 3.35 | 6 |
| Bf16 Matrix Tflops Dense | — | 1,307.4 |
| BF16 TFLOPS (sparse) | 1,979 | — |
| Compute Units | — | 304 |
| Form factor | SXM | OAM |
| Fp16 Matrix Tflops Dense | — | 1,307.4 |
| FP16 TFLOPS (dense) | 989.5 | — |
| FP16 TFLOPS (sparse) | 1,979 | — |
| FP32 TFLOPS | 67 | — |
| Fp32 Vector Tflops | — | 163.4 |
| Fp64 Matrix Tflops | — | 163.4 |
| FP64 Tensor TFLOPS | 67 | — |
| FP64 TFLOPS | 34 | — |
| FP8 Matrix Tflops Dense | — | 2,614.9 |
| FP8 Matrix Tflops Sparse | — | 5,229.8 |
| FP8 TFLOPS (dense) | 1,979 | — |
| FP8 TFLOPS (sparse) | 3,958 | — |
| HBM Type | — | HBM3E |
| INT8 TOPS (dense) | — | 2,614.9 |
| INT8 TOPS (sparse) | 3,958 | — |
| Memory type | HBM3 | — |
| NVLink bandwidth (GB/s) | 900 | — |
| Pcie GEN | — | 5 |
| TBP Watts | — | 1,000 |
| TDP max (W)↓ better | 700 | — |
| Tf32 Matrix Tflops Dense | — | 653.7 |
| TF32 TFLOPS (sparse) | 989 | — |