Local LLMs
47 current open-weight models from 22 labs. Latest version of each family only.
against memory
OpenRouter evals, GPQA Diamond · data from 2026-10-10
Not beaten on both memory and score● memory stated by the publisher◇ memory estimated
| # | Model | Configuration | Min memory | GPQA Diamond | Frontier |
|---|---|---|---|---|---|
| 1 | Qwen3.8 27B | 27B Original weights | 54.3 GB ◇ | 81.9% | On frontier |
| 2 | Nemotron 3.5 Lightning | 30B-A3B Original weights BF16 | 62.3 GB ◇ | 69.8% | — |
| 3 | DeepSeek V4 Flash Vision Exp | Original weights | 158 GB ◇ | 88.0% | On frontier |
| 4 | Ling 3.0 Flash VL | Original weights | 238 GB ◇ | 84.8% | — |
| 5 | GLM 5.3 Flash | Original weights | 306 GB ◇ | 85.0% | — |
| 6 | Qwen3.8 Flash-Next | Original weights | 337 GB ◇ | 88.6% | On frontier |
| 7 | Step 3.7 Flash | Original weights | 387 GB ◇ | 76.6% | — |
| 8 | DeepSeek V4.1 Flash | Original weights | 476 GB ◇ | 88.8% | On frontier |
| 9 | GLM 5.3 | Original weights | 734 GB ◇ | 85.2% | — |
| 10 | MiniMax M3 | Original weights | 797 GB ◇ | 90.5% | On frontier |
| 11 | DeepSeek V4 Pro | Original weights | 807 GB ◇ | 90.1% | — |
| 12 | Nemotron 3 Ultra | 550B-A55B Original weights BF16 | 1045 GB ◇ | 81.2% | — |
| 13 | Hy4 preview | Original weights | 1455 GB ◇ | 89.7% | — |
| 14 | Kimi K3 | Original weights | 1475 GB ◇ | 92.0% | On frontier |
| 15 | Qwen3.8 2.4T-A95B | 2.4T-A95B Original weights | 4560 GB ◇ | 86.9% | — |
Scores were measured on hosted endpoints, so each model is plotted once, at the memory need of its original weights. A quantized file needs less memory and may score differently. Lines connect the frontier points and do not predict results in between. Source: OpenRouter evals (openrouter.ai) via OpenRouter (openrouter.ai/rankings). openrouter.ai
Models
Models with a GPQA Diamond score come first, highest score first. The rest are newest first.
Min memory is the smallest listed option. ● stated by the publisher · ◇ estimate from file size, an 8K-token context and 0.5 GB for the runtime. — means no figure is available.