Skip to content
MCS · Rigs · Compare

Side-by-side, with the numbers that matter.

Two rigs, one table. Higher numbers win in cobalt; TDP and price flip.

2 of 27 fields comparable

⇄ swap sides
SpecNVIDIA H200AMD Instinct MI325X
HBM (GB)141256
Memory bandwidth (TB/s)4.86
Bf16 Matrix Tflops Dense1,307.4
BF16 TFLOPS (sparse)1,979
Compute Units304
Form factorSXMOAM
Fp16 Matrix Tflops Dense1,307.4
FP16 TFLOPS (sparse)1,979
FP32 TFLOPS67
Fp32 Vector Tflops163.4
Fp64 Matrix Tflops163.4
FP64 TFLOPS34
FP8 Matrix Tflops Dense2,614.9
FP8 Matrix Tflops Sparse5,229.8
FP8 TFLOPS (sparse)3,958
HBM TypeHBM3E
INT8 TOPS (dense)2,614.9
INT8 TOPS (sparse)3,958
Memory typeHBM3e
MIG Instances7
MIG PER Instance GB18
NVLink bandwidth (GB/s)900
Pcie GEN5
Pcie Gen5 Bandwidth GB S128
TBP Watts1,000
TDP max (W)↓ better700
Tf32 Matrix Tflops Dense653.7
Compare · NVIDIA H200 vs AMD Instinct MI325X · MadCoolStuff