Skip to content
MCS · Rigs · Compare

Side-by-side, with the numbers that matter.

Two rigs, one table. Higher numbers win in cobalt; TDP and price flip.

0 of 27 fields comparable

⇄ swap sides
SpecAWS Trainium2NVIDIA H200
BF16 TFLOPS (sparse)1,979
Bf16 Tflops PER Chip667
Chips PER Trn2 Instance16
Chips PER Ultraserver64
Form factorSXM
FP16 TFLOPS (sparse)1,979
FP32 TFLOPS67
FP64 TFLOPS34
FP8 Dense Petaflops PER Chip1.3
FP8 Sparse Petaflops PER Chip5.2
FP8 TFLOPS (sparse)3,958
HBM (GB)141
HBM Bandwidth TB S PER Chip2.9
Hbm3e Capacity GB PER Chip96
INT8 TOPS (sparse)3,958
Memory bandwidth (TB/s)4.8
Memory typeHBM3e
MIG Instances7
MIG PER Instance GB18
Neuroncores PER Chip8
NVLink bandwidth (GB/s)900
Pcie Gen5 Bandwidth GB S128
TDP max (W)↓ better700
Trn2 Instance FP8 Petaflops20.8
Ultraserver FP8 Petaflops83.2
Ultraserver Total HBM Bandwidth TB S185
Ultraserver Total HBM TB6
Compare · AWS Trainium2 vs NVIDIA H200 · MadCoolStuff