For these requested-off setups, choose by task rather than bit depth. Q4_K_S and Q5_K_M are reasonable options for small coding jobs; IQ4_XS offers a smaller-download starting point for supervised larger tool-driven work. The larger Q5_K_M download is more compelling for the selected hard math and reasoning problems, where it clearly led, than for larger practical tasks. Reasoning suppression was not verified; the thinking comparison remains untested.
Evidence for this judgment
Everyday coding tasks · Thinking requested off
Matching task controls and 32,768 context. These quality results describe the recorded setups; they do not isolate the effect of bit depth. Task times are not comparable for this group.
| Weight format | Task pass rate | Task time | Download | Inspect |
|---|---|---|---|---|
Q4_K_SSelected formatmradermacherrocm · 32 GB test machineCPU MoE layers: 4Recorded execution settings
| 14/16 passed16/16 scored | Not compared16/16 timed | 11.34 GBWeights, not required RAM | Answers and code |
Q5_K_Mmradermacherrocm · 32 GB test machineCPU MoE layers: 11Recorded execution settings
| 15/16 passed16/16 scored | Not compared16/16 timed | 13.99 GBWeights, not required RAM | Answers and code |
Larger practical tasks · Thinking requested off
Matching task controls and 32,768 context. These quality results describe the recorded setups; they do not isolate the effect of bit depth. Task times are not comparable for this group.
| Weight format | Mean task credit | Task time | Download | Inspect |
|---|---|---|---|---|
IQ4_XSmradermacherrocm · 32 GB test machineCPU MoE layers: 1Recorded execution settings
| 45.5/10011/11 scored | Not compared11/11 timed | 10.23 GBWeights, not required RAM | Answers and code |
Q4_K_SSelected formatmradermacherrocm · 32 GB test machineCPU MoE layers: 4Recorded execution settings
| 45.5/10011/11 scored | Not compared11/11 timed | 11.34 GBWeights, not required RAM | Answers and code |
Q5_K_Mmradermacherrocm · 32 GB test machineCPU MoE layers: 11Recorded execution settings
| 36.4/10011/11 scored | Not compared11/11 timed | 13.99 GBWeights, not required RAM | Answers and code |
Published hard problems · Thinking requested off
Matching task controls and 32,768 context. These quality results describe the recorded setups; they do not isolate the effect of bit depth. Task times are not comparable for this group.
| Weight format | Mean answer credit | Task time | Download | Inspect |
|---|---|---|---|---|
IQ4_XSmradermacherrocm · 32 GB test machineCPU MoE layers: 1Recorded execution settings
| 30.7/10011/11 scored | Not compared11/11 timed | 10.23 GBWeights, not required RAM | Answers and code |
Q4_K_SSelected formatmradermacherrocm · 32 GB test machineCPU MoE layers: 4Recorded execution settings
| 0.3/10011/11 scored | Not compared11/11 timed | 11.34 GBWeights, not required RAM | Answers and code |
Q5_K_Mmradermacherrocm · 32 GB test machineCPU MoE layers: 11Recorded execution settings
| 54.5/10011/11 scored | Not compared11/11 timed | 13.99 GBWeights, not required RAM | Answers and code |