Side-by-side, with the numbers that matter.
Two rigs, one table. Higher numbers win in cobalt; TDP and price flip.
Rig A
AMD Instinct MI325X
AMD · accelerator
Change
- 1X Neo
- Agility Robotics Digit
- Alibaba Qwen2.5-72B-Instruct (Q4 quant)
- AMD Instinct MI300X
- AMD Instinct MI325X
- AMD Instinct MI355X
- Anthropic Claude Opus 4.7
- Apple Mac Pro (M2 Ultra, 2023)
- Apple Mac Studio (M3 Ultra)
- Apple MacBook Pro 16-inch, M4 Max (2024)
- Apptronik Apollo
- Aurora
- AWS Trainium2
- Boston Dynamics Atlas
- Boston Dynamics Spot
- Cerebras Wafer-Scale Engine 3
- El Capitan
- Figure 02
- Frontier (OLCF-5)
- Google Cloud TPU v5p
- Groq Language Processing Unit
- Intel Gaudi 3 HL-325L
- MSI GeForce RTX 5090 Suprim Liquid
- NVIDIA B100
- NVIDIA B200
- NVIDIA DGX B200
- NVIDIA DGX H200
- NVIDIA DGX Spark
- NVIDIA Eos DGX SuperPOD
- NVIDIA GB200
- NVIDIA GB200 NVL72
- NVIDIA GeForce RTX 4090 Founders Edition
- NVIDIA GeForce RTX 5070 Ti
- NVIDIA GeForce RTX 5080 Founders Edition
- NVIDIA GeForce RTX 5090 Founders Edition
- NVIDIA GH200 Grace Hopper
- NVIDIA H100
- NVIDIA H200
- NVIDIA HGX B200
- NVIDIA Jetson AGX Thor
- NVIDIA RTX PRO 4500 Blackwell
- NVIDIA RTX PRO 5000 Blackwell
- NVIDIA RTX PRO 6000 Blackwell
- OpenAI GPT-5
- SambaNova SN40L Reconfigurable Dataflow Unit
- Sanctuary AI Phoenix
- Tesla Optimus
- The Stargate Project
- Unitree B2
- Unitree G1
- Unitree H1
Rig B
NVIDIA H200
NVIDIA · accelerator
Change
- 1X Neo
- Agility Robotics Digit
- Alibaba Qwen2.5-72B-Instruct (Q4 quant)
- AMD Instinct MI300X
- AMD Instinct MI325X
- AMD Instinct MI355X
- Anthropic Claude Opus 4.7
- Apple Mac Pro (M2 Ultra, 2023)
- Apple Mac Studio (M3 Ultra)
- Apple MacBook Pro 16-inch, M4 Max (2024)
- Apptronik Apollo
- Aurora
- AWS Trainium2
- Boston Dynamics Atlas
- Boston Dynamics Spot
- Cerebras Wafer-Scale Engine 3
- El Capitan
- Figure 02
- Frontier (OLCF-5)
- Google Cloud TPU v5p
- Groq Language Processing Unit
- Intel Gaudi 3 HL-325L
- MSI GeForce RTX 5090 Suprim Liquid
- NVIDIA B100
- NVIDIA B200
- NVIDIA DGX B200
- NVIDIA DGX H200
- NVIDIA DGX Spark
- NVIDIA Eos DGX SuperPOD
- NVIDIA GB200
- NVIDIA GB200 NVL72
- NVIDIA GeForce RTX 4090 Founders Edition
- NVIDIA GeForce RTX 5070 Ti
- NVIDIA GeForce RTX 5080 Founders Edition
- NVIDIA GeForce RTX 5090 Founders Edition
- NVIDIA GH200 Grace Hopper
- NVIDIA H100
- NVIDIA H200
- NVIDIA HGX B200
- NVIDIA Jetson AGX Thor
- NVIDIA RTX PRO 4500 Blackwell
- NVIDIA RTX PRO 5000 Blackwell
- NVIDIA RTX PRO 6000 Blackwell
- OpenAI GPT-5
- SambaNova SN40L Reconfigurable Dataflow Unit
- Sanctuary AI Phoenix
- Tesla Optimus
- The Stargate Project
- Unitree B2
- Unitree G1
- Unitree H1
2 of 27 fields comparable
⇄ swap sidesAMD Instinct MI325XNVIDIA H200
HBM (GB)
256
141
Memory bandwidth (TB/s)
6
4.8
| Spec | AMD Instinct MI325X | NVIDIA H200 |
|---|---|---|
| HBM (GB) | 256 | 141 |
| Memory bandwidth (TB/s) | 6 | 4.8 |
| Bf16 Matrix Tflops Dense | 1,307.4 | — |
| BF16 TFLOPS (sparse) | — | 1,979 |
| Compute Units | 304 | — |
| Form factor | OAM | SXM |
| Fp16 Matrix Tflops Dense | 1,307.4 | — |
| FP16 TFLOPS (sparse) | — | 1,979 |
| FP32 TFLOPS | — | 67 |
| Fp32 Vector Tflops | 163.4 | — |
| Fp64 Matrix Tflops | 163.4 | — |
| FP64 TFLOPS | — | 34 |
| FP8 Matrix Tflops Dense | 2,614.9 | — |
| FP8 Matrix Tflops Sparse | 5,229.8 | — |
| FP8 TFLOPS (sparse) | — | 3,958 |
| HBM Type | HBM3E | — |
| INT8 TOPS (dense) | 2,614.9 | — |
| INT8 TOPS (sparse) | — | 3,958 |
| Memory type | — | HBM3e |
| MIG Instances | — | 7 |
| MIG PER Instance GB | — | 18 |
| NVLink bandwidth (GB/s) | — | 900 |
| Pcie GEN | 5 | — |
| Pcie Gen5 Bandwidth GB S | — | 128 |
| TBP Watts | 1,000 | — |
| TDP max (W)↓ better | — | 700 |
| Tf32 Matrix Tflops Dense | 653.7 | — |