AgentBench / results

Independent benchmark · EQ Lab

Conversational style

How models tend to respond across conversations.

These are style tendencies, not quality scores: higher is not better. They use the upstream traits rubric and are not part of the rating.

Each score is a mean from 0 to 10, averaged across conversations. Both judges assess each conversation. Partial results are marked in progress.

Open a model for detailed style profiles and uncertainty intervals.

Trait heatmaps · 0 (less) 10 (more). More is not better. Traits do not affect ratings. Missing scores are —.

Agreeableness and pushback

ModelPushbackYields under pressureFrame capture (pulled into the person's version)ValidationBoundary setting
GPT-6 Astra (subscription)24/48 assessments4.15.84.45.84.7
DeepSeek V4.1 Flash 1017 (API, Morph FP8)24/48 assessments4.95.54.56.63.8
Claude Haiku 5.5 (API, Anthropic)24/48 assessments5.15.84.06.54.1
GPT-5.6 Luna (API)24/48 assessments3.66.65.36.23.9
Mistral Large 4 (API, Mistral)24/48 assessments4.06.55.57.13.1
Qwen3.8 Flash (API, Alibaba; precision undisclosed)24/48 assessments4.26.45.67.33.2
Qwen3.8 27B (API)24/48 assessments3.27.16.37.42.6
Gemini 3.8 Flash (API, Google AI Studio)24/48 assessments3.37.36.37.52.6
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)24/48 assessments3.56.76.17.02.7
Ternary Bonsai 2 27B PTQ1_024/48 assessments3.07.56.57.42.7
Muse Glimmer 30B (API, DeepInfra BF16)24/48 assessments2.67.66.57.82.0
Nemotron 3.5 Bolt 74B-A9B UD-Q4_K_XL24/48 assessments3.27.06.57.02.8
Gemma 4 31B (API)24/48 assessments2.87.26.77.22.4
Qwen3.8 27B GSQ-RCO IQ2_S24/48 assessments3.46.76.26.93.0
Ornith 1.5 35B-A3B Q5_K_M24/48 assessments5.16.65.07.43.5
Flash-Next IQ324/48 assessments3.87.26.08.23.2
Claude Haiku 4.5 (API)24/48 assessments5.95.64.26.13.8
Gemma 4 26B-A4B24/48 assessments2.77.36.87.32.3
Qwen3.6 27B (API)24/48 assessments2.88.07.08.32.1
Nemotron 3.5 Bolt 74B-A9B 24GB IQ2 (NVIDIA)24/48 assessments3.17.76.67.22.4
Kolibri-1 Q4_K_M24/48 assessments3.16.85.76.72.3
Gemma 4 12B24/48 assessments2.37.46.98.21.8
GPT-4.1 (API, OpenAI)24/48 assessments1.77.97.18.11.7
Qwen3.5 122B-A10B stock Q4_K_M21/48 assessments2.88.07.48.02.0
Mistral Medium 3.5 (API)24/48 assessments2.97.16.47.01.6
Qwen3.6 35B-A3B24/48 assessments2.57.57.18.01.8
Mistral Small 4 119B (API, Mistral)24/48 assessments2.77.16.57.01.7
Nemotron 3.5 Lightning 30B-A3B Q4_024/48 assessments2.67.96.97.41.9
Gemma 4 12B Blorbo v0b Q4_K_M24/48 assessments3.86.05.56.02.3
GLM-4.7-Flash Q4_K_M24/48 assessments2.47.47.37.61.6
Llama 4 Maverick (API, Parasail FP8)24/48 assessments2.27.26.56.92.0
Llama 3.3 70B Instruct (API, DeepInfra FP8)24/48 assessments2.97.26.27.61.7
Ornith 1.5 9B Q4_K_M24/48 assessments5.06.55.66.82.8
Qwen3.5 122B-A10B abliterated v2 Q4_K_M24/48 assessments2.77.57.17.21.5
Gemma 4 E4B24/48 assessments2.57.66.98.22.0
Qwen3.5 9B EQ v5.1 Q4_K_M23/48 assessments2.97.26.57.51.6
Ministral 3 14B24/48 assessments3.17.06.97.52.0
GPT-OSS 120B stock (API, Near AI FP4)24/48 assessments2.16.96.67.01.5
Qwen3.5 9B22/48 assessments2.88.17.28.12.0
GPT-OSS 20B MXFP4 (local)24/48 assessments1.46.76.67.11.6
Qwen3.5 4B Q4_K_M19/48 assessments2.47.86.97.91.5
Gemma 4 E2B Q8_024/48 assessments2.17.36.58.41.8
Mistral Nemo Instruct 2407 Q4_K_M24/48 assessments1.56.76.27.01.2
LFM2.5 8B-A1B Q4_024/48 assessments1.67.67.06.61.3
Magnum v4 12B Q4_K_M24/48 assessments1.87.56.69.01.5
Ling 3.0 Tiny Q4_024/48 assessments2.57.26.57.31.3
Granite 4.2 8B Q4_024/48 assessments1.68.47.28.71.3
Stheno v3.4 Llama 3.1 8B Q6_K24/48 assessments2.07.67.08.61.7
GPT-OSS 120B abliterated Q4_K_M24/48 assessments1.45.36.84.41.1
MedGemma 1.5 4B IT Q4_K_M19/48 assessments1.77.66.48.21.3
Claude Opus 5.5 (subscription, medium effort)0/48 assessments—————
Qwen3.8 Flash Next IQ3_XXS (Strata)0/48 assessments—————
Qwen3.8 Flash Next UD-Q4_K_XL (Strata)0/48 assessments—————

Other tendencies

ModelAnalyticalInterpretive boldnessClinical registerDirective adviceEscalation containmentAdapts to the person’s frameNaturalness and authenticity
GPT-6 Astra (subscription)24/48 assessments4.63.54.46.46.86.86.4
DeepSeek V4.1 Flash 1017 (API, Morph FP8)24/48 assessments5.55.53.96.06.27.16.2
Claude Haiku 5.5 (API, Anthropic)24/48 assessments5.35.15.26.36.65.95.5
GPT-5.6 Luna (API)24/48 assessments5.03.85.87.16.25.75.0
Mistral Large 4 (API, Mistral)24/48 assessments4.84.84.04.85.96.55.8
Qwen3.8 Flash (API, Alibaba; precision undisclosed)24/48 assessments5.55.74.75.36.06.25.3
Qwen3.8 27B (API)24/48 assessments4.84.44.75.85.96.35.4
Gemini 3.8 Flash (API, Google AI Studio)24/48 assessments4.84.64.55.55.96.15.4
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)24/48 assessments3.54.04.54.35.35.65.3
Ternary Bonsai 2 27B PTQ1_024/48 assessments4.74.34.86.25.75.95.0
Muse Glimmer 30B (API, DeepInfra BF16)24/48 assessments3.63.65.13.35.55.84.8
Nemotron 3.5 Bolt 74B-A9B UD-Q4_K_XL24/48 assessments4.13.85.05.05.45.35.0
Gemma 4 31B (API)24/48 assessments4.44.05.04.75.05.04.7
Qwen3.8 27B GSQ-RCO IQ2_S24/48 assessments5.84.15.66.76.05.64.7
Ornith 1.5 35B-A3B Q5_K_M24/48 assessments5.46.24.85.16.05.74.8
Flash-Next IQ324/48 assessments6.06.64.85.66.15.44.3
Claude Haiku 4.5 (API)24/48 assessments5.66.05.25.05.64.95.3
Gemma 4 26B-A4B24/48 assessments4.23.55.64.35.65.14.5
Qwen3.6 27B (API)24/48 assessments4.83.86.45.45.54.93.8
Nemotron 3.5 Bolt 74B-A9B 24GB IQ2 (NVIDIA)24/48 assessments3.93.75.24.15.34.84.6
Kolibri-1 Q4_K_M24/48 assessments2.93.35.83.65.14.03.9
Gemma 4 12B24/48 assessments5.04.06.53.95.04.33.6
GPT-4.1 (API, OpenAI)24/48 assessments2.72.65.64.05.14.54.0
Qwen3.5 122B-A10B stock Q4_K_M21/48 assessments4.34.06.04.55.65.03.9
Mistral Medium 3.5 (API)24/48 assessments2.93.45.04.95.04.44.4
Qwen3.6 35B-A3B24/48 assessments4.93.66.95.45.44.53.4
Mistral Small 4 119B (API, Mistral)24/48 assessments2.53.05.34.04.84.24.0
Nemotron 3.5 Lightning 30B-A3B Q4_024/48 assessments4.03.85.63.74.94.84.0
Gemma 4 12B Blorbo v0b Q4_K_M24/48 assessments4.13.65.74.84.94.14.0
GLM-4.7-Flash Q4_K_M24/48 assessments3.53.64.94.54.64.24.0
Llama 4 Maverick (API, Parasail FP8)24/48 assessments3.12.86.84.45.33.73.1
Llama 3.3 70B Instruct (API, DeepInfra FP8)24/48 assessments3.83.57.14.64.93.32.9
Ornith 1.5 9B Q4_K_M24/48 assessments6.26.55.55.85.04.84.0
Qwen3.5 122B-A10B abliterated v2 Q4_K_M24/48 assessments4.64.55.64.15.24.43.7
Gemma 4 E4B24/48 assessments5.03.87.75.55.03.52.8
Qwen3.5 9B EQ v5.1 Q4_K_M23/48 assessments5.25.26.03.34.64.73.1
Ministral 3 14B24/48 assessments4.54.85.15.94.84.33.4
GPT-OSS 120B stock (API, Near AI FP4)24/48 assessments4.93.37.67.75.33.52.7
Qwen3.5 9B22/48 assessments4.14.16.25.25.03.72.8
GPT-OSS 20B MXFP4 (local)24/48 assessments4.32.07.57.45.23.02.3
Qwen3.5 4B Q4_K_M19/48 assessments4.14.36.73.54.63.62.5
Gemma 4 E2B Q8_024/48 assessments4.83.77.94.65.02.92.5
Mistral Nemo Instruct 2407 Q4_K_M24/48 assessments2.31.67.54.64.72.51.8
LFM2.5 8B-A1B Q4_024/48 assessments2.42.17.54.94.52.52.1
Magnum v4 12B Q4_K_M24/48 assessments2.82.67.66.24.92.41.9
Ling 3.0 Tiny Q4_024/48 assessments3.23.97.23.84.32.72.1
Granite 4.2 8B Q4_024/48 assessments4.12.17.96.65.43.11.9
Stheno v3.4 Llama 3.1 8B Q6_K24/48 assessments3.52.67.86.84.22.51.8
GPT-OSS 120B abliterated Q4_K_M24/48 assessments4.51.96.77.84.12.72.3
MedGemma 1.5 4B IT Q4_K_M19/48 assessments3.31.98.53.93.71.80.9
Claude Opus 5.5 (subscription, medium effort)0/48 assessments———————
Qwen3.8 Flash Next IQ3_XXS (Strata)0/48 assessments———————
Qwen3.8 Flash Next UD-Q4_K_XL (Strata)0/48 assessments———————