Skip to content
MCS · Rigs · Compare

Side-by-side, with the numbers that matter.

Two rigs, one table. Higher numbers win in cobalt; TDP and price flip.

Rig A

Groq Language Processing Unit

Groq · accelerator

Change

Rig B

AWS Trainium2

AWS · cloud-model

Change

0 of 19 fields comparable

⇄ swap sides
SpecGroq Language Processing UnitAWS Trainium2
Bf16 Tflops PER Chip—667
Chip TO Chip Links11—
Chips PER Trn2 Instance—16
Chips PER Ultraserver—64
Form factorPCIe Gen4 x16—
FP8 Dense Petaflops PER Chip—1.3
FP8 Sparse Petaflops PER Chip—5.2
HBM Bandwidth TB S PER Chip—2.9
Hbm3e Capacity GB PER Chip—96
Neuroncores PER Chip—8
ON Chip Sram MB230—
ON DIE Memory Bandwidth TB S80—
Peak Fp16 Tflops188—
Peak Int8 Tops750—
Process Node14nm—
Trn2 Instance FP8 Petaflops—20.8
Ultraserver FP8 Petaflops—83.2
Ultraserver Total HBM Bandwidth TB S—185
Ultraserver Total HBM TB—6
Compare · Groq Language Processing Unit vs AWS Trainium2 · MadCoolStuff