Model Ratings.
The tracked cohort, scored and tiered.
62 models ranked against the coding muscle recipe · every axis sourced.
Scores are relative to the tracked cohort — swap the recipe or the field and the ranks move. The weights are an editorial call; the axis values underneath are sourced, cell by cell.
Snapshot · verified 1w ago · 2026-10-05
Recipe
Ship-real-PRs ability — agentic + competitive coding weighted hardest.
The board · ranked · Coding muscle
Each cell brightens toward the cohort leader and is ringed when it holds it; dimmed rows are sparse (low coverage) — read their composite with care.
- 1Claude Opus 5.5Anthropic25% · lowS100
- SWE-bench—
- LiveCode—
- AA Index58
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 2Claude Sonnet 5.5Anthropic25% · lowS94
- SWE-bench—
- LiveCode—
- AA Index56
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 3Claude Opus 5Anthropic75% · highS93
- SWE-bench96%
- LiveCode—
- AA Index51
- GPQA93.2%
Strongest: swebench · Weakest: aa_index
- 4GPT-6 AstraOpenAI50% · mediumS92
- SWE-bench—
- LiveCode—
- AA Index53
- GPQA96.1%
Strongest: aa_index · Weakest: aa_index
- 5Claude Fable 5.1Anthropic50% · mediumS90
- SWE-bench—
- LiveCode—
- AA Index53
- GPQA93.7%
Strongest: aa_index · Weakest: aa_index
- 6Claude Fable 5Anthropic75% · highS90
- SWE-bench95%
- LiveCode—
- AA Index50
- GPQA92.6%
Strongest: swebench · Weakest: aa_index
- 7Gemini 4 ArgonGoogle DeepMind25% · lowS86
- SWE-bench—
- LiveCode—
- AA Index53
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 8GPT-6.1 SolOpenAI25% · lowA83
- SWE-bench—
- LiveCode—
- AA Index52
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 9Muse Spark 1.3Meta50% · mediumA82
- SWE-bench—
- LiveCode—
- AA Index48
- GPQA93.5%
Strongest: gpqa · Weakest: aa_index
- 10GPT-5.6 SolOpenAI50% · mediumA81
- SWE-bench—
- LiveCode—
- AA Index47
- GPQA94.1%
Strongest: gpqa · Weakest: aa_index
- 11Qwen3.8-Flash-NextAlibaba (Qwen)75% · highA78
- SWE-bench—
- LiveCode91.9%
- AA Index40
- GPQA91.7%
Strongest: livecodebench · Weakest: aa_index
- 12Grok 4.6xAI50% · mediumA77
- SWE-bench—
- LiveCode—
- AA Index44
- GPQA94.9%
Strongest: gpqa · Weakest: aa_index
- 13Qwen3.8 Max (0902)Alibaba (Qwen)50% · mediumA77
- SWE-bench—
- LiveCode—
- AA Index45
- GPQA92.8%
Strongest: gpqa · Weakest: aa_index
- 14GLM-5.3Z.AI (Zhipu)50% · mediumA76
- SWE-bench—
- LiveCode—
- AA Index45
- GPQA91.7%
Strongest: gpqa · Weakest: aa_index
- 15Kimi K3Moonshot AI50% · mediumA76
- SWE-bench—
- LiveCode—
- AA Index44
- GPQA93.5%
Strongest: gpqa · Weakest: aa_index
- 16Step 5 PreviewStepFun50% · mediumA76
- SWE-bench—
- LiveCode—
- AA Index44
- GPQA93.5%
Strongest: gpqa · Weakest: aa_index
- 17Gemini 3.8 FlashGoogle DeepMind50% · mediumA73
- SWE-bench—
- LiveCode—
- AA Index41
- GPQA95.3%
Strongest: gpqa · Weakest: aa_index
- 18GPT-5.6 TerraOpenAI50% · mediumA72
- SWE-bench—
- LiveCode—
- AA Index42
- GPQA92.5%
Strongest: gpqa · Weakest: aa_index
- 19GPT-6 SolOpenAI25% · lowA72
- SWE-bench—
- LiveCode—
- AA Index48
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 20GLM-5.3-FlashZ.AI (Zhipu)50% · mediumA71
- SWE-bench—
- LiveCode—
- AA Index42
- GPQA91.2%
Strongest: gpqa · Weakest: aa_index
- 21Claude Opus 4.8Anthropic75% · highA71
- SWE-bench88.6%
- LiveCode—
- AA Index42
- GPQA93.6%
Strongest: swebench · Weakest: aa_index
- 22gpt-oss-120bOpenAI25% · lowA71
- SWE-bench—
- LiveCode—
- AA Index—
- GPQA80.1%
Strongest: gpqa · Weakest: gpqa
- 23Gemini 3.7 FlashGoogle DeepMind50% · mediumB69
- SWE-bench—
- LiveCode—
- AA Index39
- GPQA94.5%
Strongest: gpqa · Weakest: aa_index
- 24Qwen3.8 MaxAlibaba (Qwen)50% · mediumB69
- SWE-bench—
- LiveCode—
- AA Index40
- GPQA92.6%
Strongest: gpqa · Weakest: aa_index
- 25Claude Opus 4.7Anthropic75% · highB68
- SWE-bench87.6%
- LiveCode—
- AA Index41
- GPQA94.2%
Strongest: swebench · Weakest: aa_index
- 26GPT-5.5OpenAI75% · highB68
- SWE-bench88.7%
- LiveCode—
- AA Index38
- GPQA93.5%
Strongest: swebench · Weakest: aa_index
- 27Qwen3.8-27BAlibaba (Qwen)75% · highB68
- SWE-bench—
- LiveCode90.3%
- AA Index34
- GPQA90.5%
Strongest: livecodebench · Weakest: aa_index
- 28Grok 4.7xAI25% · lowB67
- SWE-bench—
- LiveCode—
- AA Index46
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 29MiMo-V2.6-ProXiaomi25% · lowB67
- SWE-bench—
- LiveCode—
- AA Index46
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 30DeepSeek V4.1 FlashDeepSeek50% · mediumB66
- SWE-bench—
- LiveCode—
- AA Index39
- GPQA90.9%
Strongest: gpqa · Weakest: aa_index
- 31GPT-5.6 LunaOpenAI50% · mediumB64
- SWE-bench—
- LiveCode—
- AA Index37
- GPQA91.1%
Strongest: gpqa · Weakest: aa_index
- 32DeepSeek V4 Pro 0813DeepSeek50% · mediumB63
- SWE-bench—
- LiveCode—
- AA Index36
- GPQA92.8%
Strongest: gpqa · Weakest: aa_index
- 33DeepSeek V4 ProDeepSeek100% · highB60
Strongest: livecodebench · Weakest: aa_index
- 34DeepSeek V4 Flash 0731DeepSeek50% · mediumB59
- SWE-bench—
- LiveCode—
- AA Index34
- GPQA91%
Strongest: gpqa · Weakest: aa_index
- 35gpt-oss-20bOpenAI25% · lowB55
- SWE-bench—
- LiveCode—
- AA Index—
- GPQA71.5%
Strongest: gpqa · Weakest: gpqa
- 36MiniMax-M3MiniMax50% · mediumC53
- SWE-bench—
- LiveCode—
- AA Index29
- GPQA92.9%
Strongest: gpqa · Weakest: aa_index
- 37Kimi K2.6Moonshot AI100% · highC50
Strongest: livecodebench · Weakest: aa_index
- 38DeepSeek V4 Flash (Preview)DeepSeek100% · highC50
Strongest: livecodebench · Weakest: aa_index
- 39Grok 4.5xAI25% · lowC47
- SWE-bench—
- LiveCode—
- AA Index39
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 40Gemini 3.1 ProGoogle DeepMind75% · highC45
- SWE-bench80.6%
- LiveCode—
- AA Index30
- GPQA94.1%
Strongest: gpqa · Weakest: aa_index
- 41GPT-6 LunaOpenAI25% · lowC44
- SWE-bench—
- LiveCode—
- AA Index38
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 42MiMo-V2.6-FlashXiaomi25% · lowC44
- SWE-bench—
- LiveCode—
- AA Index38
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 43GLM-5.1Z.AI (Zhipu)50% · mediumC43
- SWE-bench—
- LiveCode—
- AA Index26
- GPQA86.2%
Strongest: gpqa · Weakest: aa_index
- 44DeepSeek V4 Flash Vision ExpDeepSeek25% · lowD36
- SWE-bench—
- LiveCode—
- AA Index35
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 45Gemini 3.6 FlashGoogle DeepMind25% · lowD33
- SWE-bench—
- LiveCode—
- AA Index34
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 46GLM-5.2Z.AI (Zhipu)25% · lowD33
- SWE-bench—
- LiveCode—
- AA Index34
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 47Gemini 3.5 FlashGoogle DeepMind25% · lowD31
- SWE-bench—
- LiveCode—
- AA Index33
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 48GPT-5.3 CodexOpenAI25% · lowD31
- SWE-bench—
- LiveCode—
- AA Index33
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 49Claude Sonnet 4.6Anthropic50% · mediumD28
- SWE-bench80.2%
- LiveCode—
- AA Index30
- GPQA—
Strongest: swebench · Weakest: aa_index
- 50Qwen3.7 MaxAlibaba (Qwen)75% · highD28
- SWE-bench—
- LiveCode78.2%
- AA Index29
- GPQA92.4%
Strongest: gpqa · Weakest: livecodebench
- 51Phi-4Microsoft25% · lowD27
- SWE-bench—
- LiveCode—
- AA Index—
- GPQA56.1%
Strongest: gpqa · Weakest: gpqa
- 52Muse SparkMeta25% · lowD25
- SWE-bench—
- LiveCode—
- AA Index31
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 53Claude Sonnet 5Anthropic50% · mediumD16
- SWE-bench72.7%
- LiveCode—
- AA Index38
- GPQA—
Strongest: aa_index · Weakest: swebench
- 54Kimi K2.7 CodeMoonshot AI25% · lowD11
- SWE-bench—
- LiveCode—
- AA Index26
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 55MiMo-V2.5-ProXiaomi25% · lowD11
- SWE-bench—
- LiveCode—
- AA Index26
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 56Mistral Small 3.2 24BMistral AI25% · lowD9
- SWE-bench—
- LiveCode—
- AA Index—
- GPQA46.1%
Strongest: gpqa · Weakest: gpqa
- 57Grok 4.3xAI25% · lowD8
- SWE-bench—
- LiveCode—
- AA Index25
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 58Qwen3.7 PlusAlibaba (Qwen)25% · lowD8
- SWE-bench—
- LiveCode—
- AA Index25
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 59GPT-5.4 miniOpenAI25% · lowD6
- SWE-bench—
- LiveCode—
- AA Index24
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 60Gemini 3.5 Flash-LiteGoogle DeepMind25% · lowD0
- SWE-bench—
- LiveCode—
- AA Index22
- GPQA—
Strongest: aa_index · Weakest: aa_index
- 61Gemma 3 27BGoogle25% · lowD0
- SWE-bench—
- LiveCode—
- AA Index—
- GPQA41.4%
Strongest: gpqa · Weakest: gpqa
- 62Qwen3-32BAlibaba (Qwen)0% · lowD0
- SWE-bench—
- LiveCode—
- AA Index—
- GPQA—
Strongest: — · Weakest: —