In the main small-coding tests, both MTP-file setups passed every task in each thinking mode. The IQ2_S MTP file offers the smaller download of those two. The non-MTP IQ2_S setup scored lower in this main run, especially with thinking off; treat that as a result to investigate, not a settled judgment of its coding ability. These are quality-only comparisons of recorded setups, not evidence that MTP or quantization caused the differences. MTP drafting was disabled, and execution settings changed during recovery of the MTP-file runs.
Evidence for this judgment
Everyday coding tasks · Thinking requested on
Matching task controls and 16,384 context. These quality results describe the recorded setups; they do not isolate the effect of bit depth. Task times are not comparable for this group.
| Weight format | Task pass rate | Task time | Download | Inspect |
|---|---|---|---|---|
IQ2_S · MTP weights; drafting disabledPublisher unresolvedrocm · 128 GB test machineCPU MoE layers: Not recordedRecorded execution settings
| 16/16 passed16/16 scored | Not compared0/16 timed | 9.61 GBWeights, not required RAM | Answers and code |
IQ2_SSelected formatPublisher unresolvedrocm · 128 GB test machineCPU MoE layers: Not recordedRecorded execution settings
| 13/16 passed16/16 scored | Not compared16/16 timed | 9.26 GBWeights, not required RAM | Answers and code |
IQ3_XXS · MTP weights; drafting disabledPublisher unresolvedrocm · 128 GB test machineCPU MoE layers: Not recordedRecorded execution settings
| 16/16 passed16/16 scored | Not compared0/16 timed | 10.44 GBWeights, not required RAM | Answers and code |
Everyday coding tasks · Thinking requested off
Matching task controls and 16,384 context. These quality results describe the recorded setups; they do not isolate the effect of bit depth. Task times are not comparable for this group.
| Weight format | Task pass rate | Task time | Download | Inspect |
|---|---|---|---|---|
IQ2_S · MTP weights; drafting disabledPublisher unresolvedrocm · 128 GB test machineCPU MoE layers: Not recordedRecorded execution settings
| 16/16 passed16/16 scored | Not compared0/16 timed | 9.61 GBWeights, not required RAM | Answers and code |
IQ2_SSelected formatPublisher unresolvedrocm · 128 GB test machineCPU MoE layers: Not recordedRecorded execution settings
| 0/16 passed16/16 scored | Not compared16/16 timed | 9.26 GBWeights, not required RAM | Answers and code |
IQ3_XXS · MTP weights; drafting disabledPublisher unresolvedrocm · 128 GB test machineCPU MoE layers: Not recordedRecorded execution settings
| 16/16 passed16/16 scored | Not compared0/16 timed | 10.44 GBWeights, not required RAM | Answers and code |