Model Ratings.
The tracked cohort, scored and tiered.
42 models ranked against the runs local recipe · every axis sourced.
Scores are relative to the tracked cohort — swap the recipe or the field and the ranks move. The weights are an editorial call; the axis values underneath are sourced, cell by cell.
Snapshot · verified 1w ago · 2026-08-17
Recipe
Open-weight, fits your GPU — VRAM and context weighted alongside smarts.
The board · ranked · Runs local
Each cell brightens toward the cohort leader and is ringed when it holds it; dimmed rows are sparse (low coverage) — read their composite with care.
- 1Claude Opus 5Anthropic60% · mediumS100
- VRAM—
- AA Index63
- SWE-bench96%
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 2Claude Fable 5Anthropic60% · mediumS97
- VRAM—
- AA Index62
- SWE-bench95%
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: swebench
- 3GPT-5.6 SolOpenAI40% · mediumS95
- VRAM—
- AA Index61
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 4GPT-5.6 TerraOpenAI40% · mediumA85
- VRAM—
- AA Index57
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 5Gemini 3.7 FlashGoogle DeepMind40% · mediumA82
- VRAM—
- AA Index56
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 6DeepSeek V4 Flash 0731DeepSeek60% · mediumA80
- VRAM167 GB
- AA Index52
- SWE-bench—
- LiveCode—
- Context1M
Strongest: vram_q4 · Weakest: aa_index
- 7Claude Opus 4.8Anthropic60% · mediumA79
- VRAM—
- AA Index57
- SWE-bench88.6%
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: swebench
- 8Grok 4.6xAI40% · mediumA78
- VRAM—
- AA Index61
- SWE-bench—
- LiveCode—
- Context500K
Strongest: aa_index · Weakest: context
- 9GPT-5.5OpenAI60% · mediumA76
- VRAM—
- AA Index56
- SWE-bench88.7%
- LiveCode—
- Context922K
Strongest: aa_index · Weakest: swebench
- 10gpt-oss-20bOpenAI40% · mediumA75
- VRAM13 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context131K
Strongest: vram_q4 · Weakest: context
- 11Mistral Small 3.2 24BMistral AI40% · mediumA75
- VRAM14 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context131K
Strongest: vram_q4 · Weakest: context
- 12Gemma 3 27BGoogle40% · mediumA74
- VRAM16 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context131K
Strongest: vram_q4 · Weakest: context
- 13GLM-5.2Z.AI (Zhipu)40% · mediumA74
- VRAM—
- AA Index53
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 14Claude Opus 4.7Anthropic60% · mediumA74
- VRAM—
- AA Index55
- SWE-bench87.6%
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: swebench
- 15Qwen3.8-27BAlibaba (Qwen)80% · highA72
Strongest: vram_q4 · Weakest: context
- 16gpt-oss-120bOpenAI40% · mediumA72
- VRAM63 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context131K
Strongest: vram_q4 · Weakest: context
- 17Gemini 3.5 FlashGoogle DeepMind40% · mediumA72
- VRAM—
- AA Index52
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 18Gemini 3.6 FlashGoogle DeepMind40% · mediumA72
- VRAM—
- AA Index52
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 19GPT-5.6 LunaOpenAI40% · mediumA72
- VRAM—
- AA Index52
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: aa_index
- 20Qwen3-32BAlibaba (Qwen)40% · mediumA72
- VRAM20 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context41K
Strongest: vram_q4 · Weakest: context
- 21Phi-4Microsoft40% · mediumA71
- VRAM9 GB
- AA Index—
- SWE-bench—
- LiveCode—
- Context16K
Strongest: vram_q4 · Weakest: context
- 22Grok 4.5xAI40% · mediumB65
- VRAM—
- AA Index56
- SWE-bench—
- LiveCode—
- Context500K
Strongest: aa_index · Weakest: context
- 23DeepSeek V4 Flash (Preview)DeepSeek100% · highB61
Strongest: vram_q4 · Weakest: aa_index
- 24DeepSeek V4 ProDeepSeek100% · highB60
Strongest: vram_q4 · Weakest: aa_index
- 25DeepSeek V4 Pro 0813DeepSeek60% · mediumB59
- VRAM908 GB
- AA Index53
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: vram_q4
- 26MiniMax-M3MiniMax40% · mediumC54
- VRAM—
- AA Index45
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 27Qwen3.8 MaxAlibaba (Qwen)60% · mediumC53
- VRAM1345 GB
- AA Index58
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: vram_q4
- 28Gemini 3.1 ProGoogle DeepMind60% · mediumC52
- VRAM—
- AA Index48
- SWE-bench80.6%
- LiveCode—
- Context1M
Strongest: context · Weakest: swebench
- 29Claude Sonnet 5Anthropic60% · mediumC51
- VRAM—
- AA Index55
- SWE-bench72.7%
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: swebench
- 30Claude Sonnet 4.6Anthropic60% · mediumC51
- VRAM—
- AA Index48
- SWE-bench80.2%
- LiveCode—
- Context1M
Strongest: context · Weakest: swebench
- 31Kimi K3Moonshot AI60% · mediumC50
- VRAM1529 GB
- AA Index60
- SWE-bench—
- LiveCode—
- Context1M
Strongest: aa_index · Weakest: vram_q4
- 32MiMo-V2.5-ProXiaomi40% · mediumC49
- VRAM—
- AA Index43
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 33Qwen3.7 MaxAlibaba (Qwen)60% · mediumC42
- VRAM—
- AA Index47
- SWE-bench—
- LiveCode78.2%
- Context1M
Strongest: context · Weakest: livecodebench
- 34Kimi K2.6Moonshot AI80% · highD39
Strongest: livecodebench · Weakest: context
- 35Qwen3.7 PlusAlibaba (Qwen)40% · mediumD38
- VRAM—
- AA Index39
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 36GPT-5.3 CodexOpenAI40% · mediumD36
- VRAM—
- AA Index46
- SWE-bench—
- LiveCode—
- Context400K
Strongest: aa_index · Weakest: aa_index
- 37Grok 4.3xAI40% · mediumD36
- VRAM—
- AA Index38
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 38Gemini 3.5 Flash-LiteGoogle DeepMind40% · mediumD33
- VRAM—
- AA Index37
- SWE-bench—
- LiveCode—
- Context1M
Strongest: context · Weakest: aa_index
- 39Muse SparkMeta40% · mediumD26
- VRAM—
- AA Index44
- SWE-bench—
- LiveCode—
- Context262K
Strongest: aa_index · Weakest: context
- 40Kimi K2.7 CodeMoonshot AI40% · mediumD24
- VRAM—
- AA Index43
- SWE-bench—
- LiveCode—
- Context256K
Strongest: aa_index · Weakest: aa_index
- 41GPT-5.4 miniOpenAI40% · mediumD23
- VRAM—
- AA Index41
- SWE-bench—
- LiveCode—
- Context400K
Strongest: context · Weakest: aa_index
- 42GLM-5.1Z.AI (Zhipu)40% · mediumD16
- VRAM—
- AA Index41
- SWE-bench—
- LiveCode—
- Context200K
Strongest: aa_index · Weakest: aa_index