AgentBench / results

← Following exact instructions

Team Comparison With Paragraph Rules

The model is asked to compare Tottenham Hotspur and Stockton in a specified season using exactly three paragraphs separated by blank lines. Required keywords, a prescribed opening word for the third paragraph and a specially marked postscript exercise detailed placement and structure control.

length constraints:nth paragraph first word, keywords:existence, detectable content:postscript

About this descriptionGenerated by GPT Astra (gpt-6-astra) · 2026-10-12. Shared across models for this version of the test. The original question and checks remain the source of truth.

Opening the requested recorded answer… This page needs JavaScript to select and verify evidence. If this message remains, no other model’s answer is shown in its place.

All recorded answers to this question

Each row is one recorded test trial: a model, weight format, thinking setting and seed. Open a row to read that answer above. Filtering this list never changes the open answer.

Showing recorded answers 1–21 of 21 · sorted by model name

  1. GPT-OSS 120B (stock) Q4_K_M · Reasoning · medium · Local · baseline seed 42Incorrect
  2. Ling 3.0 Flash Q2_K IQ2_XXS · Thinking off · Local · baseline seed 42Full credit
  3. Ling 3.0 Flash Q2_K IQ2_XXS · Thinking on · Local · baseline seed 42Full credit
  4. Ling 3.0 Flash Q2_K IQ3_XXS · Thinking off · Local · baseline seed 42Incorrect
  5. Ling 3.0 Flash Q2_K IQ3_XXS · Thinking on · Local · baseline seed 42Incorrect
  6. Mistral Small 4 119B UD-Q4_K_XL · Thinking off · Local · baseline seed 42Incorrect
  7. Mistral Small 4 119B UD-Q4_K_XL · Thinking on · Local · baseline seed 42Incorrect
  8. Ornith 1.5 35B-A3B Q5_K_M · Thinking off · Local · baseline seed 42Incorrect
  9. Ornith 1.5 35B-A3B Q5_K_M · Thinking on · Local · baseline seed 42Incorrect
  10. Ornith 1.5 35B-A3B Q6_K · Thinking off · Local · baseline seed 42Incorrect
  11. Ornith 1.5 35B-A3B Q6_K · Thinking on · Local · baseline seed 42Incorrect
  12. Ornith 1.5 35B-A3B Q8_0 · Thinking off · Local · baseline seed 42Incorrect
  13. Ornith 1.5 35B-A3B Q8_0 · Thinking on · Local · baseline seed 42Incorrect
  14. Qwen3-Coder-Next IQ3_M · Thinking off · Local · baseline seed 42Incorrect
  15. Qwen3-Coder-Next Q4_K_M · Thinking off · Local · baseline seed 42Incorrect
  16. Qwen3.8 27B GSQ-RCO IQ2_S · MTP weights; drafting disabled · Thinking off · Local · baseline seed 42Incorrect
  17. Qwen3.8 27B GSQ-RCO IQ2_S · MTP weights; drafting disabled · Thinking on · Local · baseline seed 42Full credit
  18. Qwen3.8 27B GSQ-RCO IQ2_S · Thinking off · Local · baseline seed 42Incorrect
  19. Qwen3.8 27B GSQ-RCO IQ2_S · Thinking on · Local · baseline seed 42Failed to finish
  20. Qwen3.8 27B GSQ-RCO IQ3_XXS · MTP weights; drafting disabled · Thinking off · Local · baseline seed 42Incorrect
  21. Qwen3.8 27B GSQ-RCO IQ3_XXS · MTP weights; drafting disabled · Thinking on · Local · baseline seed 42Full credit

Source item if-2549. Google Research IFEval; Apache-2.0. Source