Skip to content
MCS · Rigs · Compare

Side-by-side, with the numbers that matter.

Two rigs, one table. Higher numbers win in cobalt; TDP and price flip.

0 of 28 fields comparable

⇄ swap sides
SpecNVIDIA H100AWS Trainium2
BF16 TFLOPS (sparse)1,979
Bf16 Tflops PER Chip667
Chips PER Trn2 Instance16
Chips PER Ultraserver64
Form factorSXM
FP16 TFLOPS (dense)989.5
FP16 TFLOPS (sparse)1,979
FP32 TFLOPS67
FP64 Tensor TFLOPS67
FP64 TFLOPS34
FP8 Dense Petaflops PER Chip1.3
FP8 Sparse Petaflops PER Chip5.2
FP8 TFLOPS (dense)1,979
FP8 TFLOPS (sparse)3,958
HBM (GB)80
HBM Bandwidth TB S PER Chip2.9
Hbm3e Capacity GB PER Chip96
INT8 TOPS (sparse)3,958
Memory bandwidth (TB/s)3.35
Memory typeHBM3
Neuroncores PER Chip8
NVLink bandwidth (GB/s)900
TDP max (W)↓ better700
TF32 TFLOPS (sparse)989
Trn2 Instance FP8 Petaflops20.8
Ultraserver FP8 Petaflops83.2
Ultraserver Total HBM Bandwidth TB S185
Ultraserver Total HBM TB6
Compare · NVIDIA H100 vs AWS Trainium2 · MadCoolStuff