Local models. Real tasks.
Find a model for your work. Compare the results. Inspect the answers.
Find information in a small project, edit files and fix bugs. 16 fixed questions · Questions and scoring →
Size, architecture & more filters
Memory requirements have not yet been verified for these setups. A budget filter shows only supported fits; browse by parameters or download size in the meantime.
Cloud-labeled entries use the same tasks and grading, with hosted model precision and reasoning settings shown in their setup. They participate in quality results only: all speed and desktop-memory comparisons exclude cloud runs. A hosted model is not a test of its local quantization.
54 matching models
Dense · Small · under 5B
Total parameters; active MoE parameters shown separately when known. · 10 shown
| Tested model | Task pass rate | Task time | Download | Compare |
|---|---|---|---|---|
Qwen3.5 2B Q4_K_MQ4_K_M · Thinking offLocalAll quants & setups →dense · 1.9B totalSetup and weight sourcesrocm · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Qwen3.5-2B-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 4.3smedian · 16 measured | 1.28 GBweights, not required RAM | |
Qwen3.5 4BQ4_K_M · Thinking offLocalAll quants & setups →dense · 4.2B totalSetup and weight sourcesrocm · context 32768 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Qwen3.5-4B-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 4.8smedian · 16 measured | 2.71 GBweights, not required RAM | |
Qwen3.5 0.8B Q4_0Q4_0 · Thinking offLocalAll quants & setups →dense · 0.8B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: inconclusive Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Qwen3.5-0.8B-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 5.7smedian · 16 measured | 0.56 GBweights, not required RAM | |
Gemma 4 E2B Q4_0Q4_0 · Thinking offLocalAll quants & setups →dense · 4.6B totalSetup and weight sourcesrocm · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source gemma-4-E2B-it-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 2.2smedian · 16 measured | 2.84 GBweights, not required RAM | |
Granite 4.0 Micro 3.4B Q4_0Q4_0 · Thinking offLocalAll quants & setups →dense · 3.4B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: ignored switch Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source granite-4.0-micro-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 5.6smedian · 16 measured | 1.98 GBweights, not required RAM | |
SmolLM3 3B Q4_K_MQ4_K_M · Thinking offLocalAll quants & setups →dense · 3.1B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source SmolLM3-3B-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 4.5smedian · 16 measured | 1.92 GBweights, not required RAM | |
LFM2.5 1.2B Thinking Q4_K_MQ4_K_M · Thinking / Reasoning versionLocalAll quants & setups →dense · 1.2B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: native reasoning Control check scope: Profile-bound diagnostic confirms native reasoning; separate checkpoint, no verified off condition.. Requested off does not prove an absence of reasoning. Weight identity: recorded source LFM2.5-1.2B-Thinking-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 11.0smedian · 16 measured | 0.73 GBweights, not required RAM | |
LFM2.5 1.2B Q4_0Q4_0 · Thinking offLocalAll quants & setups →dense · 1.2B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: ignored switch Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source LFM2.5-1.2B-Instruct-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 1.4smedian · 16 measured | 0.7 GBweights, not required RAM | |
Phi-4 Mini Instruct 3.8B Q4_K_MQ4_K_M · Thinking offLocalAll quants & setups →dense · 3.8B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: ignored switch Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Phi-4-mini-instruct-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 3.9smedian · 16 measured | 2.49 GBweights, not required RAM | |
Phi-4 Mini Reasoning 3.8B Q4_K_MQ4_K_M · Thinking onLocalAll quants & setups →dense · 3.8B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: inconclusive Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Phi-4-mini-reasoning-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. | Not scored0/16 scored16 held · thinking control unverified | —median · 0 measured | 2.49 GBweights, not required RAM |
Dense · Medium · 5–under 20B
Total parameters; active MoE parameters shown separately when known. · 13 shown
| Tested model | Task pass rate | Task time | Download | Compare |
|---|---|---|---|---|
Granite 4.2 8B Q4_0Q4_0 · Thinking onLocalAll quants & setups →dense · 8.8B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source granite-4.2-8b-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 36.7smedian · 16 measured | 5.06 GBweights, not required RAM | |
Ornith 1.5 9B Q4_K_MQ4_K_M · Thinking onLocalAll quants & setups →dense · 9.2B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Ornith-1.5-9B-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 13.3smedian · 16 measured | 5.78 GBweights, not required RAM | |
Qwen3.5 9BQ4_0 · Thinking onLocalAll quants & setups →dense · 9.0B totalSetup and weight sourcesrocm · context 32768 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Qwen3.5-9B-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 12.3smedian · 16 measured | 5.38 GBweights, not required RAM | |
Gemma 4 12BQ6_K · Thinking offLocalAll quants & setups →dense · 11.9B totalSetup and weight sourcesrocm · context 32768 · GPU layers 46 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source 53336de05c4af36dcb61daf0d984be076ddf0245e3ce7f61aa10b72cb4044e97 · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 19.6smedian · 16 measured | 10.24 GBweights, not required RAM | |
Gemma 4 12B QAT Q4_0QAT-Q4_0 · Thinking offLocalAll quants & setups →dense · 11.9B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source gemma-4-12b-it-qat-q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 13.3smedian · 16 measured | 6.98 GBweights, not required RAM | |
Ministral 3 14BQ4_K_M · Thinking offLocalAll quants & setups →dense · 13.5B totalSetup and weight sourcesrocm · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: ignored switch Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source 76ce697c065f2e40f1e8e958118b02cab38e2c10a6015f7d7908036a292dc8c8 · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 9.7smedian · 16 measured | 8.24 GBweights, not required RAM | |
Ministral 3 8B Reasoning 2512 Q4_K_MQ4_K_M · Thinking / Reasoning versionLocalAll quants & setups →dense · 8.5B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: native reasoning Control check scope: Profile-bound diagnostic confirms native reasoning; separate checkpoint, no verified off condition.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Ministral-3-8B-Reasoning-2512-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 19.0smedian · 16 measured | 5.2 GBweights, not required RAM | |
Ministral 3 8B Instruct Q4_K_MQ4_K_M · Thinking offLocalAll quants & setups →dense · 8.5B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: ignored switch Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Ministral-3-8B-Instruct-2512-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 8.6smedian · 16 measured | 5.2 GBweights, not required RAM | |
Gemma 4 E4BQ4_0 · Thinking offLocalAll quants & setups →dense · 7.5B totalSetup and weight sourcesrocm · context 32768 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source gemma-4-E4B-it-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 5.4smedian · 16 measured | 4.59 GBweights, not required RAM | |
Falcon-H1R 7B Q4_K_MQ4_K_M · Reasoning enabled (observed; requested off)LocalAll quants & setups →dense · 7.6B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: ignored switch Control check scope: Observed reasoning despite an off request; toggle is not verified.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Falcon-H1R-7B-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 92.8smedian · 16 measured | 4.6 GBweights, not required RAM | |
Ministral 3 14B Reasoning 2512 Q4_K_MQ4_K_M · Thinking / Reasoning versionLocalAll quants & setups →dense · 13.5B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: native reasoning Control check scope: Profile-bound diagnostic confirms native reasoning; separate checkpoint, no verified off condition.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Ministral-3-14B-Reasoning-2512-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 32.7smedian · 16 measured | 8.24 GBweights, not required RAM | |
Nemotron Nano 9B v2 Q4_0Q4_0 · Thinking offLocalAll quants & setups →dense · 8.9B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 8.9smedian · 16 measured | 5.34 GBweights, not required RAM | |
Qwen2.5 Coder 7B Instruct Q4_K_MQ4_K_M · Thinking offLocalAll quants & setups →dense · 7.6B totalSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: ignored switch Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source qwen2.5-coder-7b-instruct-q4_k_m.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 6.8smedian · 16 measured | 4.68 GBweights, not required RAM |
Dense · Large · 20B and above
Total parameters; active MoE parameters shown separately when known. · 6 shown
| Tested model | Task pass rate | Task time | Download | Compare |
|---|---|---|---|---|
Ternary Bonsai 2 27B PTQ1_0Unknown · Thinking / Reasoning versionLocalAll quants & setups →dense · 26.9B totalSetup and weight sourcesprism_vulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: native reasoning Control check scope: Profile-bound diagnostic confirms native reasoning; separate checkpoint, no verified off condition.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Ternary-Bonsai-2-27B-PTQ1_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 52.9smedian · 16 measured | 5.95 GBweights, not required RAM | |
Gemma 4 31B · CoreWeave (cloud)Hosted FP4 (provider-reported) · Thinking / Reasoning versionCloud · CoreWeaveAll quants & setups →dense · 30.7B totalSetup and weight sourcesopenrouter · context 16384 · GPU layers unrecorded Temperature 0 · sample index 42 · output limit 4096 Thinking control: native reasoning Control check scope: Native reasoning condition; no verified off/on comparison. Provider-reported usage audited against 16K context. Sample indices are not provider seeds. Requested temperature recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source |
| ExcludedCloud · quality only | HostedCoreWeave | |
Qwen3.8 27B (cloud)Hosted FP8 (provider-reported) · Reasoning · mediumCloud · ChutesAll quants & setups →dense · 27.0B totalSetup and weight sourcesopenrouter · context 16384 · GPU layers unrecorded Temperature 0 · sample index 42 · output limit 4096 Thinking control: native reasoning Control check scope: Native reasoning condition; no verified off/on comparison. Provider-reported usage audited against 16K context. Sample indices are not provider seeds. Requested temperature recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source |
| ExcludedCloud · quality only | HostedChutes | |
Qwen3.8 27B GSQ-RCOIQ2_S · Thinking onLocalAll quants & setups →dense · 26.9B totalSetup and weight sourcesrocm · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: legacy partial Qwen3.8-27B-GSQ-RCO-IQ2_S.ggufExact download source unresolved.Historical first-MiB hash only; not a full-file identity. |
| 30.1smedian · 16 measured | 9.26 GBweights, not required RAM | |
Gemma 4 31B Q4_K_MQ4_K_M · Thinking onLocalAll quants & setups →dense · 30.7B totalSetup and weight sourcesvulkan · context 16384 · GPU layers unrecorded Temperature 0 · seed 42 · output limit 4096 Thinking control: unknown Control check scope: unrecorded. Requested off does not prove an absence of reasoning. Weight identity: recorded source gemma-4-31B-it-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. | Not scored0/16 scored16 not yet recorded · setup comparability unverified · thinking control unverified | —median · 0 measured | 18.32 GBweights, not required RAM | |
Qwen3.8 27B Q4_K_MQ4_K_M · Thinking offLocalAll quants & setups →dense · 26.9B totalSetup and weight sourcesvulkan · context 16384 · GPU layers unrecorded Temperature 0 · seed 42 · output limit 4096 Thinking control: unknown Control check scope: unrecorded. Requested off does not prove an absence of reasoning. Weight identity: recorded source Qwen3.8-27B-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. | Not scored0/16 scored16 not yet recorded · setup comparability unverified | —median · 0 measured | 18.97 GBweights, not required RAM |
MoE · Medium · 5–under 20B
Total parameters; active MoE parameters shown separately when known. · 4 shown
| Tested model | Task pass rate | Task time | Download | Compare |
|---|---|---|---|---|
Ling 3.0 Tiny Q4_0Q4_0 · Thinking onLocalAll quants & setups →MoE · 7.9B total · Active parameter count not recordedSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Ling-3.0-tiny-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 8.4smedian · 16 measured | 4.62 GBweights, not required RAM | |
Gemma 4 19B-A4B REAPQ4_K_S · Thinking offLocalAll quants & setups →MoE · 18.4B total · Active parameter count not recordedSetup and weight sourcesrocm · context 32768 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: inconclusive Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source gemma-4-19b-a4b-it-REAP.i1-Q4_K_S.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 8.8smedian · 16 measured | 11.34 GBweights, not required RAM | |
Mellum 2.1 12B-A2.5B ThinkingQ4_K_M · Thinking offLocalAll quants & setups →MoE · 12.1B total · Active parameter count not recordedSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Mellum2.1-12B-A2.5B-Thinking-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 7.5smedian · 16 measured | 8.07 GBweights, not required RAM | |
LFM2.5 8B-A1B Q4_0Q4_0 · Reasoning enabled (observed; requested off)LocalAll quants & setups →MoE · 8.5B total · Active parameter count not recordedSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: ignored switch Control check scope: Observed reasoning despite an off request; toggle is not verified.. Requested off does not prove an absence of reasoning. Weight identity: recorded source LFM2.5-8B-A1B-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 5.9smedian · 16 measured | 4.84 GBweights, not required RAM |
MoE · Large · 20B and above
Total parameters; active MoE parameters shown separately when known. · 19 shown
| Tested model | Task pass rate | Task time | Download | Compare |
|---|---|---|---|---|
Qwen3-Coder-Next 80B-A3B (cloud)Hosted BF16 (provider-reported) · Thinking offCloud · ParasailAll quants & setups →MoE · 80.0B total · 3.0B activeSetup and weight sourcesopenrouter · context 16384 · GPU layers unrecorded Temperature 0 · sample index 42 · output limit 4096 Thinking control: unknown Control check scope: Native reasoning condition; no verified off/on comparison. Provider-reported usage audited against 16K context. Sample indices are not provider seeds. Requested temperature recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source |
| ExcludedCloud · quality only | HostedParasail | |
Ling 3.0 Flash (cloud)Hosted BF16 (provider-reported) · Thinking / Reasoning versionCloud · DeepInfraAll quants & setups →MoE · 124.0B total · 5.1B activeSetup and weight sourcesopenrouter · context 16384 · GPU layers unrecorded Temperature 0 · sample index 42 · output limit 4096 Thinking control: native reasoning Control check scope: Native reasoning condition; no verified off/on comparison. Provider-reported usage audited against 16K context. Sample indices are not provider seeds. Requested temperature recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source |
| ExcludedCloud · quality only | HostedDeepInfra | |
Qwen3-Coder-NextIQ3_M · Thinking offLocalAll quants & setups →MoE · 79.7B total · Active parameter count not recordedSetup and weight sourcesrocm · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: ignored switch Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: legacy partial Qwen_Qwen3-Coder-Next-IQ3_M.ggufExact download source unresolved.Historical first-MiB hash only; not a full-file identity. |
| 39.1smedian · 16 measured | 36.64 GBweights, not required RAM | |
Qwen3.8 Flash-Next (IQ3_XXS)IQ3_XXS · Thinking offLocalAll quants & setups →MoE · 176.9B total · Active parameter count not recordedSetup and weight sourcesvulkan11260 · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Qwen3.8-Flash-Next-GSQ-RCO-IQ3_XXS-00001-of-00002.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. Qwen3.8-Flash-Next-GSQ-RCO-IQ3_XXS-00002-of-00002.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 171.8smedian · 16 measured | 75.84 GBweights, not required RAM | |
Gemma 4 26B-A4BUD-Q4_K_M · Thinking offLocalAll quants & setups →MoE · 25.2B total · Active parameter count not recordedSetup and weight sourcesrocm · context 32768 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 10.6smedian · 16 measured | 16.95 GBweights, not required RAM | |
Gemma 4 26B-A4B QAT Q4_K_XLQAT-UD-Q4_K_XL · Thinking offLocalAll quants & setups →MoE · 25.2B total · Active parameter count not recordedSetup and weight sourcesvulkan · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source gemma-4-26B-A4B-it-qat-UD-Q4_K_XL.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 15.8smedian · 16 measured | 14.25 GBweights, not required RAM | |
Ornith 1.5 35B-A3BQ5_K_M · Thinking offLocalAll quants & setups →MoE · 35.5B total · Active parameter count not recordedSetup and weight sourcesrocm · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Ornith-1.5-35B-Q5_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 19.0smedian · 16 measured | 25.35 GBweights, not required RAM | |
Qwen3.6 35B-A3BQ4_K_M · Thinking onLocalAll quants & setups →MoE · 34.7B total · Active parameter count not recordedSetup and weight sourcesrocm · context 32768 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source 671e47e0ec53c665d048b98c3ecbfd5236b5ca9c3e02ed19fc8f81f7b85140c7 · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 17.9smedian · 16 measured | 20.42 GBweights, not required RAM | |
Qwen3.6 29B REAP Opus distillQ4_K_M · Thinking onLocalAll quants & setups →MoE · 28.9B total · Active parameter count not recordedSetup and weight sourcesrocm · context 32768 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source Qwen3.6-29B-REAP-Opus-Reasoning-Distill-MTP-Q4_K_M.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 13.8smedian · 16 measured | 17.71 GBweights, not required RAM | |
Qwen3.6 28B-REAP20-A3BQ4_K_M · Thinking onLocalAll quants & setups →MoE · 28.2B total · Active parameter count not recordedSetup and weight sourcesrocm · context 32768 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source dcd137ca7984ebdaa041ef80281322773bc1a9911ef639b7e698a20979953a00 · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 22.7smedian · 16 measured | 17.26 GBweights, not required RAM | |
Nemotron 3.5 Lightning 30B-A3B (cloud)Hosted BF16 (provider-reported) · Thinking / Reasoning versionCloud · DeepInfraAll quants & setups →MoE · 30.0B total · 3.0B activeSetup and weight sourcesopenrouter · context 16384 · GPU layers unrecorded Temperature 0 · sample index 42 · output limit 4096 Thinking control: native reasoning Control check scope: Native reasoning condition; no verified off/on comparison. Provider-reported usage audited against 16K context. Sample indices are not provider seeds. Requested temperature recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source |
| ExcludedCloud · quality only | HostedDeepInfra | |
GLM-4.7-Flash REAP 23B-A3BUD-Q4_K_XL · Thinking offLocalAll quants & setups →MoE · 23.0B total · Active parameter count not recordedSetup and weight sourcesrocm · context 32768 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source GLM-4.7-Flash-REAP-23B-A3B-UD-Q4_K_XL.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 12.5smedian · 16 measured | 14.24 GBweights, not required RAM | |
GPT-OSS 120B (stock)Q4_K_M · Reasoning · mediumLocalAll quants & setups →MoE · 116.8B total · Active parameter count not recordedSetup and weight sourcesrocm · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: native reasoning Control check scope: Profile-bound diagnostic confirms native reasoning; separate checkpoint, no verified off condition.. Requested off does not prove an absence of reasoning. Weight identity: legacy partial gpt-oss-120b-Q4_K_M-00001-of-00002.ggufExact download source unresolved.Historical first-MiB hash only; not a full-file identity. gpt-oss-120b-Q4_K_M-00002-of-00002.ggufExact download source unresolved.Historical first-MiB hash only; not a full-file identity. |
| 49.4smedian · 16 measured | 62.77 GBweights, not required RAM | |
GPT-OSS 120B (cloud)Hosted BF16 (provider-reported) · Reasoning · mediumCloud · DeepInfraAll quants & setups →MoE · 117.0B total · 5.1B activeSetup and weight sourcesopenrouter · context 16384 · GPU layers unrecorded Temperature 0 · sample index 42 · output limit 4096 Thinking control: native reasoning Control check scope: Native reasoning condition; no verified off/on comparison. Provider-reported usage audited against 16K context. Sample indices are not provider seeds. Requested temperature recorded.. Requested off does not prove an absence of reasoning. Weight identity: recorded source |
| ExcludedCloud · quality only | HostedDeepInfra | |
Qwen3.8 Flash-Next Coder (IQ1_M)IQ1_M · Thinking onLocalAll quants & setups →MoE · 116.5B total · Active parameter count not recordedSetup and weight sourcesvulkan11260 · context unrecorded · GPU layers unrecorded Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: legacy partial Qwen3.8-Flash-Next-GSQ-RCO-IQ1_M-00001-of-00002.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. Qwen3.8-Flash-Next-GSQ-RCO-IQ1_M-00002-of-00002.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| 126.5smedian · 16 measured | 58.41 GBweights, not required RAM | |
Mistral Small 4 119BUD-Q4_K_XL · Thinking onLocalAll quants & setups →MoE · 119.0B total · Active parameter count not recordedSetup and weight sourcesrocm · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: legacy partial Mistral-Small-4-119B-2603-UD-Q4_K_XL-00001-of-00003.ggufExact download source unresolved.Historical first-MiB hash only; not a full-file identity. Mistral-Small-4-119B-2603-UD-Q4_K_XL-00002-of-00003.ggufExact download source unresolved.Historical first-MiB hash only; not a full-file identity. Mistral-Small-4-119B-2603-UD-Q4_K_XL-00003-of-00003.ggufExact download source unresolved.Historical first-MiB hash only; not a full-file identity. |
| 84.3smedian · 15 measured | 74.16 GBweights, not required RAM | |
Maple Preview 20B-A1B TQ2_0-head-Q4_KUnknown · Thinking / Reasoning versionLocalAll quants & setups →MoE · 20.2B total · Active parameter count not recordedSetup and weight sourcesmaple_cpu · context 16384 · GPU layers unrecorded Temperature 0 · seed 42 · output limit 4096 Thinking control: native reasoning Control check scope: Profile-bound diagnostic confirms native reasoning; separate checkpoint, no verified off condition.. Requested off does not prove an absence of reasoning. Weight identity: recorded source maple-preview-TQ2_0-head-Q4_K.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. | Not scored0/16 scored16 not yet recorded · setup comparability unverified | —median · 0 measured | 5.9 GBweights, not required RAM | |
Nemotron 3.5 Lightning 30B-A3BQ4_0 · Thinking offLocalAll quants & setups →MoE · 31.6B total · Active parameter count not recordedSetup and weight sourcesvulkan · context 16384 · GPU layers unrecorded Temperature 0 · seed 42 · output limit 4096 Thinking control: unknown Control check scope: unrecorded. Requested off does not prove an absence of reasoning. Weight identity: recorded source NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Q4_0.gguf · Exact GGUF file →Historical first-MiB hash only; not a full-file identity. |
| —median · 0 measured | 18.9 GBweights, not required RAM | |
Qwen3.5 122B-A10B abliterated v2Q4_K_M · Thinking offLocalAll quants & setups →MoE · 122.1B total · Active parameter count not recordedSetup and weight sourcesvulkan · context 16384 · GPU layers unrecorded Temperature 0 · seed 42 · output limit 4096 Thinking control: unknown Control check scope: unrecorded. Requested off does not prove an absence of reasoning. Weight identity: legacy partial Qwen3.5-122B-A10B-abliterated-v2-Q4_K_M.ggufExact download source unresolved.Historical first-MiB hash only; not a full-file identity. | Not scored0/16 scored16 not yet recorded · setup comparability unverified | —median · 0 measured | 74.21 GBweights, not required RAM |
Parameter size unverified
Parameter metadata is not yet sourced for these entries. · 2 shown
| Tested model | Task pass rate | Task time | Download | Compare |
|---|---|---|---|---|
Ling 3.0 Flash Q2_KIQ2_XXS · Thinking offLocalAll quants & setups →unknown · Parameters unverifiedSetup and weight sourcesrocm · context 16384 · GPU layers 99 Temperature 0 · seed 42 · output limit 4096 Thinking control: verified Control check scope: Saved profile-level probe; exact historical template/build scope is not fully recorded.. Requested off does not prove an absence of reasoning. Weight identity: legacy partial Ling-3.0-flash-IQ2_XXS.ggufExact download source unresolved.Historical first-MiB hash only; not a full-file identity. |
| 37.4smedian · 16 measured | 35.24 GBweights, not required RAM | |
GPT-6 Luna (cloud)Hosted UNDISCLOSED (provider-reported) · Reasoning · lowCloud · OpenAI via OpenRouterAll quants & setups →unknown · Parameters unverifiedSetup and weight sourcesopenrouter · context 16384 · GPU layers unrecorded Temperature provider default (not set) · sample index 42 · output limit 4096 Thinking control: native reasoning Control check scope: Native reasoning condition; no verified off/on comparison. Provider-reported usage audited against 16K context. Sample indices are not provider seeds. Temperature omitted; independent provider-default samples.. Requested off does not prove an absence of reasoning. Weight identity: recorded source |
| ExcludedCloud · quality only | HostedOpenAI via OpenRouter |
One setup per model: eligible results first, then greatest scored coverage, then the declared baseline; score and speed never select the setup. Other quants and hardware runs remain on the model page. Ordered by recorded score within each group; ties use a stable setup order, not speed. Coverage is shown beside every score. This table ranks the selected task; the heatmap also shows a balanced overall index. Weight download size is not required RAM.
What counts as completed, and why can a model fail to finish?
Completed means an assessable answer or saved task output was produced; it can still be wrong or earn partial credit. Pass rate counts full-credit outcomes across assessed tasks, including confirmed failures to finish. Correct / completed looks only at completed, assessed outputs. Technical failures, untested tasks and unresolved reviews are excluded from these rates, and shown separately.
“Failed to finish” means the run stopped at a recorded token, step, time or context limit, or in a repeated tool loop, without an accepted result. It does not prove the model could never solve the task. More time, a larger reasoning budget or another attempt may help, but these results do not measure that recovery.
For interactive work, a slow or unfinished attempt may be recoverable. For unattended work, needing another attempt matters. Read completion and correctness together: neither a high score on a few completed answers nor a low completion rate tells the whole story. Limits and retry policy →
How much quality for your time?
Local measurements onlyHigher is more credit; further left is less time. Select a point to identify the model, then open its results. These are whole-task times, including tools and grading.
21 setups · 16 questions, all scored and timed · matching hardware and requested test controls. Runtime and placement can differ; see the table. 33 other setups are outside this timing group. Time uses a logarithmic scale.
Test machine: AMD Ryzen 5 5600X (6 cores / 12 threads) · AMD Radeon RX 6700 XT (12 GB VRAM) · 32 GB system RAM (this timing group). Full test machine details
Qwen3.5 4B15/16 passed · 4.8s median task timeOpen results →
Model key and exact values (21 setups)
Recorded hardware profile: Local · test machine with 32 GB RAM. All points have complete quality and timing coverage.
| Model | Task pass rate | Median time | Recorded setup |
|---|---|---|---|
| 1. Qwen3.5 4B | 15/16 passed | 4.8s | rocm · 99 GPU layers · 32768 context |
| 2. Nemotron Nano 9B v2 Q4_0 | 6/16 passed | 8.9s | vulkan · 99 GPU layers · 16384 context |
| 3. Gemma 4 E4B | 11/16 passed | 5.4s | rocm · 99 GPU layers · 32768 context |
| 4. LFM2.5 1.2B Q4_0 | 2/16 passed | 1.4s | vulkan · 99 GPU layers · 16384 context |
| 5. Qwen3.5 2B Q4_K_M | 16/16 passed | 4.3s | rocm · 99 GPU layers · 16384 context |
| 6. Gemma 4 E2B Q4_0 | 5/16 passed | 2.2s | rocm · 99 GPU layers · 16384 context |
| 7. Gemma 4 26B-A4B | 16/16 passed | 10.6s | rocm · 99 GPU layers · 32768 context |
| 8. Gemma 4 12B | 15/16 passed | 19.6s | rocm · 46 GPU layers · 32768 context |
| 9. Gemma 4 12B QAT Q4_0 | 13/16 passed | 13.3s | vulkan · 99 GPU layers · 16384 context |
| 10. Gemma 4 26B-A4B QAT Q4_K_XL | 16/16 passed | 15.8s | vulkan · 99 GPU layers · 16384 context |
| 11. Gemma 4 19B-A4B REAP | 14/16 passed | 8.8s | rocm · 99 GPU layers · 32768 context |
| 12. Ministral 3 14B | 12/16 passed | 9.7s | rocm · 99 GPU layers · 16384 context |
| 13. GLM-4.7-Flash REAP 23B-A3B | 15/16 passed | 12.5s | rocm · 99 GPU layers · 32768 context |
| 14. Qwen3.8 Flash-Next (IQ3_XXS) | 16/16 passed | 171.8s | vulkan11260 · 99 GPU layers · 16384 context |
| 15. Qwen3.5 0.8B Q4_0 | 6/16 passed | 5.7s | vulkan · 99 GPU layers · 16384 context |
| 16. Granite 4.0 Micro 3.4B Q4_0 | 4/16 passed | 5.6s | vulkan · 99 GPU layers · 16384 context |
| 17. Qwen2.5 Coder 7B Instruct Q4_K_M | 0/16 passed | 6.8s | vulkan · 99 GPU layers · 16384 context |
| 18. Ministral 3 8B Instruct Q4_K_M | 12/16 passed | 8.6s | vulkan · 99 GPU layers · 16384 context |
| 19. SmolLM3 3B Q4_K_M | 3/16 passed | 4.5s | vulkan · 99 GPU layers · 16384 context |
| 20. Phi-4 Mini Instruct 3.8B Q4_K_M | 0/16 passed | 3.9s | vulkan · 99 GPU layers · 16384 context |
| 21. Mellum 2.1 12B-A2.5B Thinking | 14/16 passed | 7.5s | vulkan · 99 GPU layers · 16384 context |
138 primary questions across 9 categories. Scoring revisions remain separate. Local timings describe the benchmark machine; scores describe these tested setups. Campaign started 2026-10-04.