AgentBench / results

← Published hard problems

Completing a Divisibility Proof

Fill 29 formula gaps in a supplied proof about when two integer expressions have a greatest common divisor that eventually stays constant. This exercises following divisibility arguments and matching formulas to their roles, ending with an ordered, comma-separated list of formula numbers.

olympiad

About this descriptionGenerated by GPT Astra (gpt-6-astra) · 2026-10-12. Shared across models for this version of the test. The original question and checks remain the source of truth.

Opening the requested recorded answer… This page needs JavaScript to select and verify evidence. If this message remains, no other model’s answer is shown in its place.

All recorded answers to this question

Each row is one recorded test trial: a model, weight format, thinking setting and seed. Open a row to read that answer above. Filtering this list never changes the open answer.

Showing recorded answers 1–25 of 134 · sorted by model name

  1. Falcon-H1R 7B Q4_K_M Q4_K_M · Reasoning enabled (observed; requested off) · Local · baseline seed 42Failed to finish
  2. Falcon-H1R 7B Q4_K_M Q4_K_M · Thinking on · Local · baseline seed 42Untested / blocked
  3. Gemma 4 12B Q6_K · Thinking off · Local · baseline seed 42Partial credit
  4. Gemma 4 12B Q6_K · Thinking on · Local · baseline seed 42Partial credit
  5. Gemma 4 12B QAT Q4_0 QAT-Q4_0 · Thinking off · Local · baseline seed 42Partial credit
  6. Gemma 4 12B QAT Q4_0 QAT-Q4_0 · Thinking on · Local · baseline seed 42Partial credit
  7. Gemma 4 19B-A4B REAP IQ4_XS · Thinking off · Local · baseline seed 42Failed to finish
  8. Gemma 4 19B-A4B REAP IQ4_XS · Thinking on · Local · baseline seed 42Untested / blocked
  9. Gemma 4 19B-A4B REAP Q4_K_S · Thinking off · Local · baseline seed 42Partial credit
  10. Gemma 4 19B-A4B REAP Q4_K_S · Thinking on · Local · baseline seed 42Untested / blocked
  11. Gemma 4 19B-A4B REAP Q5_K_M · Thinking off · Local · baseline seed 42Failed to finish
  12. Gemma 4 19B-A4B REAP Q5_K_M · Thinking on · Local · baseline seed 42Untested / blocked
  13. Gemma 4 26B-A4B UD-Q4_K_M · Thinking off · Local · baseline seed 42Incorrect
  14. Gemma 4 26B-A4B UD-Q4_K_M · Thinking on · Local · baseline seed 42Partial credit
  15. Gemma 4 26B-A4B QAT Q4_K_XL QAT-UD-Q4_K_XL · Thinking off · Local · baseline seed 42Partial credit
  16. Gemma 4 26B-A4B QAT Q4_K_XL QAT-UD-Q4_K_XL · Thinking on · Local · baseline seed 42Partial credit
  17. Gemma 4 31B · CoreWeave (cloud) Hosted FP4 (provider-reported) · Thinking / Reasoning version · Cloud · CoreWeave · baseline seed 42Failed to finish
  18. Gemma 4 E2B Q4_0 Q4_0 · Thinking off · Local · baseline seed 42Partial credit
  19. Gemma 4 E2B Q4_0 Q4_0 · Thinking on · Local · baseline seed 42Partial credit
  20. Gemma 4 E4B Q4_0 · Thinking off · Local · baseline seed 42Partial credit
  21. Gemma 4 E4B Q4_0 · Thinking on · Local · baseline seed 42Partial credit
  22. GLM-4.7-Flash REAP 23B-A3B UD-Q4_K_XL · Thinking off · Local · baseline seed 42Partial credit
  23. GLM-4.7-Flash REAP 23B-A3B UD-Q4_K_XL · Thinking on · Local · baseline seed 42Partial credit
  24. GPT-6 Luna (cloud) Hosted UNDISCLOSED (provider-reported) · Reasoning · high · Cloud · OpenAI via OpenRouter · baseline seed 42Failed to finish
  25. GPT-6 Luna (cloud) Hosted UNDISCLOSED (provider-reported) · Reasoning · low · Cloud · OpenAI via OpenRouter · baseline seed 42Partial credit

Source item lb-6d9bd0806e27f34f. LiveBench contributors; Apache-2.0 benchmark distribution; selected historical subset, not an official score. Source