Model Ratings.
The tracked cohort, scored and tiered.
62 models ranked against the runs local recipe · every axis sourced.
Scores are relative to the tracked cohort — swap the recipe or the field and the ranks move. The weights are an editorial call; the axis values underneath are sourced, cell by cell.
Snapshot · verified 1w ago · 2026-10-05
Recipe
Open-weight, fits your GPU — VRAM and context weighted alongside smarts.
The board · ranked · Runs local
Each cell brightens toward the cohort leader and is ringed when it holds it; dimmed rows are sparse (low coverage) — read their composite with care.
- 1Claude Opus 5.5Anthropic40% · mediumS98
- VRAM—
- AA Index58
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: context
- 2Claude Sonnet 5.5Anthropic40% · mediumS95
- VRAM—
- AA Index56
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 3Claude Opus 5Anthropic60% · mediumS91
- VRAM—
- AA Index51
- SWE-bench96%
- LiveCode—
- Context1M
Strongest: swebench · Weakest: aa_index
- 4Claude Fable 5.1Anthropic40% · mediumS89
- VRAM—
- AA Index53
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 5Gemini 4 ArgonGoogle DeepMind40% · mediumS89
- VRAM—
- AA Index53
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 6GPT-6 AstraOpenAI40% · mediumS89
- VRAM—
- AA Index53
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 7Claude Fable 5Anthropic60% · mediumS88
- VRAM—
- AA Index50
- SWE-bench95%
- LiveCode—
- Context1M
Strongest: swebench · Weakest: aa_index
- 8GPT-6.1 SolOpenAI40% · mediumS87
- VRAM—
- AA Index52
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 9GPT-6 SolOpenAI40% · mediumA81
- VRAM—
- AA Index48
- SWE-bench—
- LiveCode—
- Context1.1M
Strongest: aa_index · Weakest: aa_index
- 10Muse Spark 1.3Meta40% · mediumA80
- VRAM—
- AA Index48
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 11GPT-5.6 SolOpenAI40% · mediumA78
- VRAM—
- AA Index47
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 12GLM-5.3-FlashZ.AI (Zhipu)60% · mediumA78
- VRAM177 GB
- AA Index42
- SWE-bench—
- LiveCode—
- Context1M
Strongest: vram_q4 · Weakest: aa_index
- 13gpt-oss-20bOpenAI40% · mediumA74
- VRAM13 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context131K
Strongest: vram_q4 · Weakest: context
- 14Mistral Small 3.2 24BMistral AI40% · mediumA74
- VRAM14 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context131K
Strongest: vram_q4 · Weakest: context
- 15Qwen3.8 Max (0902)Alibaba (Qwen)40% · mediumA74
- VRAM—
- AA Index45
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 16Gemma 3 27BGoogle40% · mediumA74
- VRAM16 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context131K
Strongest: vram_q4 · Weakest: context
- 17MiMo-V2.6-FlashXiaomi60% · mediumA74
- VRAM171 GB
- AA Index38
- SWE-bench—
- LiveCode—
- Context1M
Strongest: vram_q4 · Weakest: aa_index
- 18GLM-5.3Z.AI (Zhipu)60% · mediumA74
- VRAM414 GB
- AA Index45
- SWE-bench—
- LiveCode—
- Context1M
Strongest: vram_q4 · Weakest: aa_index
- 19Step 5 PreviewStepFun40% · mediumA72
- VRAM—
- AA Index44
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 20gpt-oss-120bOpenAI40% · mediumA72
- VRAM63 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context131K
Strongest: vram_q4 · Weakest: context
- 21Qwen3-32BAlibaba (Qwen)40% · mediumA72
- VRAM20 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context41K
Strongest: vram_q4 · Weakest: context
- 22Phi-4Microsoft40% · mediumA71
- VRAM9 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context16K
Strongest: vram_q4 · Weakest: context
- 23DeepSeek V4 Flash Vision ExpDeepSeek60% · mediumA71
- VRAM167 GB
- AA Index35
- SWE-bench—
- LiveCode—
- Context1M
Strongest: vram_q4 · Weakest: aa_index
- 24MiMo-V2.6-ProXiaomi60% · mediumA70
- VRAM563 GB
- AA Index46
- SWE-bench—
- LiveCode—
- Context1M
Strongest: vram_q4 · Weakest: vram_q4
- 25DeepSeek V4 Flash 0731DeepSeek60% · mediumA70
- VRAM167 GB
- AA Index34
- SWE-bench—
- LiveCode—
- Context1M
Strongest: vram_q4 · Weakest: aa_index
- 26Qwen3.8-Flash-NextAlibaba (Qwen)80% · highB70
Strongest: vram_q4 · Weakest: context
- 27GPT-5.6 TerraOpenAI40% · mediumB69
- VRAM—
- AA Index42
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 28Claude Opus 4.8Anthropic60% · mediumB69
- VRAM—
- AA Index42
- SWE-bench88.6%
- LiveCode—
- Context1M
Strongest: swebench · Weakest: aa_index
- 29Gemini 3.8 FlashGoogle DeepMind40% · mediumB67
- VRAM—
- AA Index41
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 30Claude Opus 4.7Anthropic60% · mediumB66
- VRAM—
- AA Index41
- SWE-bench87.6%
- LiveCode—
- Context1M
Strongest: swebench · Weakest: aa_index
- 31DeepSeek V4.1 FlashDeepSeek60% · mediumB65
- VRAM510 GB
- AA Index39
- SWE-bench—
- LiveCode—
- Context1M
Strongest: vram_q4 · Weakest: aa_index
- 32Qwen3.8-27BAlibaba (Qwen)80% · highB65
Strongest: vram_q4 · Weakest: context
- 33Gemini 3.7 FlashGoogle DeepMind40% · mediumB63
- VRAM—
- AA Index39
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 34GPT-5.5OpenAI60% · mediumB62
- VRAM—
- AA Index38
- SWE-bench88.7%
- LiveCode—
- Context922K
Strongest: swebench · Weakest: aa_index
- 35GPT-6 LunaOpenAI40% · mediumB61
- VRAM—
- AA Index38
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 36Grok 4.7xAI40% · mediumB60
- VRAM—
- AA Index46
- SWE-bench—
- LiveCode—
- Context500K
Strongest: aa_index · Weakest: context
- 37GPT-5.6 LunaOpenAI40% · mediumB59
- VRAM—
- AA Index37
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 38DeepSeek V4 Flash (Preview)DeepSeek100% · highB59
Strongest: vram_q4 · Weakest: aa_index
- 39DeepSeek V4 ProDeepSeek100% · highB58
Strongest: vram_q4 · Weakest: aa_index
- 40Grok 4.6xAI40% · mediumB56
- VRAM—
- AA Index44
- SWE-bench—
- LiveCode—
- Context500K
Strongest: aa_index · Weakest: context
- 41Gemini 3.6 FlashGoogle DeepMind40% · mediumC54
- VRAM—
- AA Index34
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 42GLM-5.2Z.AI (Zhipu)40% · mediumC54
- VRAM—
- AA Index34
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 43Gemini 3.5 FlashGoogle DeepMind40% · mediumC52
- VRAM—
- AA Index33
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 44DeepSeek V4 Pro 0813DeepSeek60% · mediumC50
- VRAM908 GB
- AA Index36
- SWE-bench—
- LiveCode—
- Context1M
Strongest: vram_q4 · Weakest: aa_index
- 45Grok 4.5xAI40% · mediumC47
- VRAM—
- AA Index39
- SWE-bench—
- LiveCode—
- Context500K
Strongest: aa_index · Weakest: context
- 46MiniMax-M3MiniMax40% · mediumC45
- VRAM—
- AA Index29
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 47Gemini 3.1 ProGoogle DeepMind60% · mediumC42
- VRAM—
- AA Index30
- SWE-bench80.6%
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 48Claude Sonnet 4.6Anthropic60% · mediumC41
- VRAM—
- AA Index30
- SWE-bench80.2%
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 49Qwen3.8 MaxAlibaba (Qwen)60% · mediumC41
- VRAM1345 GB
- AA Index40
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: vram_q4
- 50Kimi K3Moonshot AI60% · mediumD40
- VRAM1529 GB
- AA Index44
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: vram_q4
- 51Claude Sonnet 5Anthropic60% · mediumD39
- VRAM—
- AA Index38
- SWE-bench72.7%
- LiveCode—
- Context1M
Strongest: context · Weakest: swebench
- 52MiMo-V2.5-ProXiaomi40% · mediumD39
- VRAM—
- AA Index26
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 53Grok 4.3xAI40% · mediumD37
- VRAM—
- AA Index25
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 54Qwen3.7 PlusAlibaba (Qwen)40% · mediumD37
- VRAM—
- AA Index25
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 55Kimi K2.6Moonshot AI80% · highD33
Strongest: livecodebench · Weakest: aa_index
- 56GPT-5.3 CodexOpenAI40% · mediumD33
- VRAM—
- AA Index33
- SWE-bench—
- LiveCode—
- Context400K
Strongest: aa_index · Weakest: aa_index
- 57Qwen3.7 MaxAlibaba (Qwen)60% · mediumD32
- VRAM—
- AA Index29
- SWE-bench—
- LiveCode78.2%
- Context1M
Strongest: context · Weakest: livecodebench
- 58Gemini 3.5 Flash-LiteGoogle DeepMind40% · mediumD32
- VRAM—
- AA Index22
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 59Muse SparkMeta40% · mediumD25
- VRAM—
- AA Index31
- SWE-bench—
- LiveCode—
- Context262K
Strongest: aa_index · Weakest: context
- 60GPT-5.4 miniOpenAI40% · mediumD16
- VRAM—
- AA Index24
- SWE-bench—
- LiveCode—
- Context400K
Strongest: context · Weakest: aa_index
- 61Kimi K2.7 CodeMoonshot AI40% · mediumD15
- VRAM—
- AA Index26
- SWE-bench—
- LiveCode—
- Context256K
Strongest: context · Weakest: aa_index
- 62GLM-5.1Z.AI (Zhipu)40% · mediumD13
- VRAM—
- AA Index26
- SWE-bench—
- LiveCode—
- Context200K
Strongest: aa_index · Weakest: aa_index