For small coding tasks, Q5_K_M is a sensible starting choice with the smallest download. Q5_K_M, Q6_K and Q8_0 passed every tested everyday coding task with reasoning requested on; separately, each passed every task with it requested off. This supports choosing the smaller download for that use, without establishing a universal quality ranking.
Evidence for this judgment
Everyday coding tasks · Thinking requested on
Matching task controls and 16,384 context. These quality results describe the recorded setups; they do not isolate the effect of bit depth. Task times are not comparable for this group.
| Weight format | Task pass rate | Task time | Download | Inspect |
|---|---|---|---|---|
Q5_K_MSelected formatornith-airocm · 128 GB test machineCPU MoE layers: 34Recorded execution settings
| 16/16 passed16/16 scored | Not compared16/16 timed | 25.35 GBWeights, not required RAM | Answers and code |
Q6_Kornith-airocm · 128 GB test machineCPU MoE layers: 35Recorded execution settings
| 16/16 passed16/16 scored | Not compared16/16 timed | 29.21 GBWeights, not required RAM | Answers and code |
Q8_0ornith-airocm · 128 GB test machineCPU MoE layers: 37Recorded execution settings
| 16/16 passed16/16 scored | Not compared16/16 timed | 37.8 GBWeights, not required RAM | Answers and code |
Everyday coding tasks · Thinking requested off
Matching task controls and 16,384 context. These quality results describe the recorded setups; they do not isolate the effect of bit depth. Task times are not comparable for this group.
| Weight format | Task pass rate | Task time | Download | Inspect |
|---|---|---|---|---|
Q5_K_MSelected formatornith-airocm · 128 GB test machineCPU MoE layers: 34Recorded execution settings
| 16/16 passed16/16 scored | Not compared16/16 timed | 25.35 GBWeights, not required RAM | Answers and code |
Q6_Kornith-airocm · 128 GB test machineCPU MoE layers: 35Recorded execution settings
| 16/16 passed16/16 scored | Not compared16/16 timed | 29.21 GBWeights, not required RAM | Answers and code |
Q8_0ornith-airocm · 128 GB test machineCPU MoE layers: 37Recorded execution settings
| 16/16 passed16/16 scored | Not compared16/16 timed | 37.8 GBWeights, not required RAM | Answers and code |