AgentBench / results

Independent benchmark · EQ Lab

EQ Lab

How local and cloud models handle emotionally complex conversations.

53 models24 personas1187/1272 conversations3721/4149 comparisonsUpdated 8 Nov, 05:20 UTC

Independent experiment, not official EQ-Bench scores. Partner: anthropic/claude-haiku-5.5 via OpenRouter. Method & limitations

Results completeProvisional ratingAwaiting judgments

Ability heatmap · 1–10, lower higher relative performance. Missing scores are —. Select a column to sort.

Model ratings and six ability scores
#ModelRatingRapportAuthenticityAttunementNeedsSensemakingManagement
1frontier · subscription1298.6
95% interval: 1282.6–1312.4
Opus 1264.2 · Sol 1281.4
10.010.010.010.010.010.0
2cloud1229.2
95% interval: 1209.9–1247.5
Opus 1273.0 · Sol 1165.9
9.49.38.78.110.08.6
3cloud1168.8
95% interval: 1148.2–1191.7
Opus 1184.5 · Sol 1135.5
8.18.37.87.69.28.0
4cloud1168.6
95% interval: 1152.5–1185.8
EQ-Bench: 1156.3
Opus 1143.0 · Sol 1167.1
8.28.27.97.98.38.3
5cloud1155.3
95% interval: 1132.4–1176.2
Opus 1174.8 · Sol 1123.1
8.48.37.77.38.07.9
6cloud1154.6
95% interval: 1134.1–1179.7
Opus 1199.8 · Sol 1106.4
8.58.07.76.99.27.7
7cloud1138.4
95% interval: 1119.5–1154.5
Opus 1163.3 · Sol 1106.7
8.27.97.66.98.17.6
8cloud1135.9
95% interval: 1117.3–1154.4
Opus 1171.9 · Sol 1097.5
8.37.87.66.98.27.4
9cloud1117.1
95% interval: 1096.6–1137.5
Opus 1130.9 · Sol 1097.5
8.08.27.36.37.37.0
10local · thinking on1110.6
95% interval: 1092.0–1130.8
Opus 1127.3 · Sol 1090.4
7.87.77.26.57.47.1
11cloud1107.9
95% interval: 1089.1–1123.7
Opus 1116.0 · Sol 1094.8
8.07.67.26.37.27.4
12local · thinking on1084.6
95% interval: 1059.2–1103.0
Opus 1094.8 · Sol 1074.4
7.47.86.76.36.46.9
13cloud1082.0
95% interval: 1064.1–1097.8
EQ-Bench: 1120.3
Opus 1082.5 · Sol 1078.7
7.47.66.76.17.06.5
14local · thinking on1078.0
95% interval: 1056.9–1095.2
Opus 1098.0 · Sol 1061.8
7.37.26.66.07.56.6
15local · thinking on1074.7
95% interval: 1056.3–1094.1
Opus 1136.5 · Sol 1033.6
7.27.16.45.98.06.5
16local · thinking on1069.5
95% interval: 1050.6–1089.5
Opus 1131.9 · Sol 1028.7
7.26.56.35.98.56.6
17cloud1056.4
95% interval: 1034.8–1073.8
EQ-Bench: 1063.9
Opus 1096.9 · Sol 1032.5
6.47.66.15.67.75.6
18local · thinking on1056.0
95% interval: 1039.3–1075.8
Opus 1053.0 · Sol 1060.9
7.07.16.45.86.06.6
19cloud1053.5
95% interval: 1039.3–1069.0
EQ-Bench: 1025.5
Opus 1054.8 · Sol 1055.9
7.16.66.35.96.66.6
20local · thinking on1036.9
95% interval: 1014.7–1063.2
Opus 1040.3 · Sol 1041.6
6.77.36.15.35.96.0
21local · thinking on1017.9
95% interval: 996.8–1036.4
Opus 997.6 · Sol 1042.8
6.16.95.85.36.15.6
22local · thinking on1013.7
95% interval: 996.9–1030.0
Opus 1015.8 · Sol 1024.1
6.36.45.75.26.55.5
23cloud1008.3
95% interval: 982.7–1028.2
Opus 972.2 · Sol 1050.5
6.86.65.75.34.56.0
24local · thinking on1000.0
95% interval: 971.1–1020.0
Opus 1007.0 · Sol 1008.5
6.36.35.64.95.95.5
25cloud998.6
95% interval: 978.1–1014.4
EQ-Bench: 993.0
Opus 981.7 · Sol 1024.9
6.27.05.44.85.05.4
26local · thinking on989.6
95% interval: 973.9–1004.3
Opus 979.7 · Sol 1013.2
6.26.05.34.95.65.5
27cloud988.4
95% interval: 973.8–1004.1
Opus 973.2 · Sol 1016.1
6.26.75.34.84.65.3
28local · thinking on983.6
95% interval: 956.1–1006.0
Opus 989.4 · Sol 997.9
6.26.45.34.65.15.2
29local · thinking on981.5
95% interval: 955.9–1002.9
Opus 981.9 · Sol 1000.8
5.76.85.24.65.35.0
30local · thinking on962.9
95% interval: 935.4–986.1
Opus 970.0 · Sol 981.8
5.76.54.94.54.64.6
31cloud960.6
95% interval: 943.0–980.0
Opus 921.8 · Sol 1008.5
5.56.15.04.84.45.1
32cloud937.9
95% interval: 919.1–955.8
Opus 918.2 · Sol 979.0
5.25.54.84.34.74.5
33local · thinking on936.5
95% interval: 917.8–956.6
Opus 988.0 · Sol 929.7
5.26.14.33.95.44.0
34local · thinking on936.2
95% interval: 913.5–953.2
Opus 962.8 · Sol 946.6
5.25.94.64.04.74.4
35local · thinking on931.1
95% interval: 910.5–947.0
Opus 913.5 · Sol 972.4
5.15.24.64.25.14.6
36local · thinking on929.6
95% interval: 913.8–947.9
Opus 970.8 · Sol 931.4
5.25.24.83.95.24.2
37local · thinking off909.2
95% interval: 894.5–923.0
Opus 938.9 · Sol 923.1
5.05.34.13.74.64.0
38cloud892.7
95% interval: 870.8–910.9
Opus 865.8 · Sol 948.2
4.55.13.93.34.34.1
39local · thinking on891.9
95% interval: 875.3–909.5
Opus 896.2 · Sol 927.1
4.84.94.13.53.74.1
40local · thinking on871.6
95% interval: 850.7–893.2
Opus 838.1 · Sol 935.9
4.34.73.63.53.24.0
41local · thinking on871.4
95% interval: 851.4–893.3
Opus 877.6 · Sol 909.9
4.64.83.83.13.13.8
42local · thinking on858.0
95% interval: 841.6–878.3
Opus 837.9 · Sol 916.7
4.04.53.42.84.03.7
43local · thinking off817.8
95% interval: 795.6–839.7
Opus 773.6 · Sol 900.1
3.54.22.82.72.43.1
44local · thinking off796.2
95% interval: 769.1–816.8
Opus 759.2 · Sol 879.1
3.24.22.42.31.82.8
45local · thinking off793.8
95% interval: 767.0–817.6
Opus 782.6 · Sol 860.8
3.33.32.52.62.52.6
46local · thinking on783.8
95% interval: 762.7–804.5
Opus 786.6 · Sol 842.3
2.94.02.22.12.12.4
47local · thinking off768.7
95% interval: 744.7–788.2
Opus 765.2 · Sol 835.5
3.02.82.31.82.12.8
48local · thinking off755.6
95% interval: 731.0–775.2
Opus 744.4 · Sol 830.7
2.73.32.01.42.31.8
49local · thinking on742.6
95% interval: 718.9–766.4
Opus 732.2 · Sol 819.4
2.43.91.41.51.01.8
50local · thinking off671.0
95% interval: 637.0–704.1
Opus 656.0 · Sol 767.0
1.01.01.01.01.11.0
—frontier · subscriptionPendingAwaiting evidenceOpus — · Sol ———————
—local · thinking onPendingAwaiting evidenceOpus — · Sol ———————
—local · thinking onPendingAwaiting evidenceOpus — · Sol ———————

Rating 95% interval Recorded EQ-Bench score (anchor models)Shared scale: 600–1350. Select an interval for exact values.

The anchor markers show how the fitted ratings align with their EQ-Bench reference scores. These models also set the normalization, so alignment is a calibration check, not independent validation.

What do the abilities mean?
Rapport
Establishes a trusting bond and good rapport so the user feels emotionally safe to engage and disclose.
Authenticity
Reads as *real* and *genuine*. Avoids coming across as fake, performative, scripted, superficial, or "cringe".
Attunement
Reading the room; perceiving the user's presenting and inner state.
Needs
Effectively meeting both the user's preferences and needs (stated or otherwise). Balancing preference fulfilment with needs fulfilment. Considers the whole picture of user wellbeing without being moralising or paternalistic.
Sensemaking
Helps the user make coherent sense of their emotional experience. Provides insight in a way that the user can understand.
Management
Effectively helps the user regulate/tolerate emotion in the moment when needed (e.g., de-escalating overwhelm, reducing spirals, grounding, containment). Or -- skilfully facilitates *engagement* with emotions to enable processing.

Abilities are rescaled within this field; 10 does not mean perfect. Rows with fewer than four comparisons are pending. Ratings and intervals remain provisional as judgments arrive; missing judgments are not losses. Ratings are approximately mapped to the EQ-Bench scale using anchors. Open a model for the full evidence.

Conversational traits

Trait heatmaps · 0 (less) 10 (more). More is not better. Traits do not affect ratings. Missing scores are —.

Agreeableness and pushback

ModelPushbackYields under pressureFrame capture (pulled into the person's version)ValidationBoundary setting
GPT-6 Astra (subscription)24/48 assessments4.15.84.45.84.7
DeepSeek V4.1 Flash 1017 (API, Morph FP8)24/48 assessments4.95.54.56.63.8
Claude Haiku 5.5 (API, Anthropic)24/48 assessments5.15.84.06.54.1
GPT-5.6 Luna (API)24/48 assessments3.66.65.36.23.9
Mistral Large 4 (API, Mistral)24/48 assessments4.06.55.57.13.1
Qwen3.8 Flash (API, Alibaba; precision undisclosed)24/48 assessments4.26.45.67.33.2
Qwen3.8 27B (API)24/48 assessments3.27.16.37.42.6
Gemini 3.8 Flash (API, Google AI Studio)24/48 assessments3.37.36.37.52.6
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)24/48 assessments3.56.76.17.02.7
Ternary Bonsai 2 27B PTQ1_024/48 assessments3.07.56.57.42.7
Muse Glimmer 30B (API, DeepInfra BF16)24/48 assessments2.67.66.57.82.0
Nemotron 3.5 Bolt 74B-A9B UD-Q4_K_XL24/48 assessments3.27.06.57.02.8
Gemma 4 31B (API)24/48 assessments2.87.26.77.22.4
Qwen3.8 27B GSQ-RCO IQ2_S24/48 assessments3.46.76.26.93.0
Ornith 1.5 35B-A3B Q5_K_M24/48 assessments5.16.65.07.43.5
Flash-Next IQ324/48 assessments3.87.26.08.23.2
Claude Haiku 4.5 (API)24/48 assessments5.95.64.26.13.8
Gemma 4 26B-A4B24/48 assessments2.77.36.87.32.3
Qwen3.6 27B (API)24/48 assessments2.88.07.08.32.1
Nemotron 3.5 Bolt 74B-A9B 24GB IQ2 (NVIDIA)24/48 assessments3.17.76.67.22.4
Kolibri-1 Q4_K_M24/48 assessments3.16.85.76.72.3
Gemma 4 12B24/48 assessments2.37.46.98.21.8
GPT-4.1 (API, OpenAI)24/48 assessments1.77.97.18.11.7
Qwen3.5 122B-A10B stock Q4_K_M21/48 assessments2.88.07.48.02.0
Mistral Medium 3.5 (API)24/48 assessments2.97.16.47.01.6
Qwen3.6 35B-A3B24/48 assessments2.57.57.18.01.8
Mistral Small 4 119B (API, Mistral)24/48 assessments2.77.16.57.01.7
Nemotron 3.5 Lightning 30B-A3B Q4_024/48 assessments2.67.96.97.41.9
Gemma 4 12B Blorbo v0b Q4_K_M24/48 assessments3.86.05.56.02.3
GLM-4.7-Flash Q4_K_M24/48 assessments2.47.47.37.61.6
Llama 4 Maverick (API, Parasail FP8)24/48 assessments2.27.26.56.92.0
Llama 3.3 70B Instruct (API, DeepInfra FP8)24/48 assessments2.97.26.27.61.7
Ornith 1.5 9B Q4_K_M24/48 assessments5.06.55.66.82.8
Qwen3.5 122B-A10B abliterated v2 Q4_K_M24/48 assessments2.77.57.17.21.5
Gemma 4 E4B24/48 assessments2.57.66.98.22.0
Qwen3.5 9B EQ v5.1 Q4_K_M23/48 assessments2.97.26.57.51.6
Ministral 3 14B24/48 assessments3.17.06.97.52.0
GPT-OSS 120B stock (API, Near AI FP4)24/48 assessments2.16.96.67.01.5
Qwen3.5 9B22/48 assessments2.88.17.28.12.0
GPT-OSS 20B MXFP4 (local)24/48 assessments1.46.76.67.11.6
Qwen3.5 4B Q4_K_M19/48 assessments2.47.86.97.91.5
Gemma 4 E2B Q8_024/48 assessments2.17.36.58.41.8
Mistral Nemo Instruct 2407 Q4_K_M24/48 assessments1.56.76.27.01.2
LFM2.5 8B-A1B Q4_024/48 assessments1.67.67.06.61.3
Magnum v4 12B Q4_K_M24/48 assessments1.87.56.69.01.5
Ling 3.0 Tiny Q4_024/48 assessments2.57.26.57.31.3
Granite 4.2 8B Q4_024/48 assessments1.68.47.28.71.3
Stheno v3.4 Llama 3.1 8B Q6_K24/48 assessments2.07.67.08.61.7
GPT-OSS 120B abliterated Q4_K_M24/48 assessments1.45.36.84.41.1
MedGemma 1.5 4B IT Q4_K_M19/48 assessments1.77.66.48.21.3
Claude Opus 5.5 (subscription, medium effort)0/48 assessments—————
Qwen3.8 Flash Next IQ3_XXS (Strata)0/48 assessments—————
Qwen3.8 Flash Next UD-Q4_K_XL (Strata)0/48 assessments—————

Other tendencies

ModelAnalyticalInterpretive boldnessClinical registerDirective adviceEscalation containmentAdapts to the person’s frameNaturalness and authenticity
GPT-6 Astra (subscription)24/48 assessments4.63.54.46.46.86.86.4
DeepSeek V4.1 Flash 1017 (API, Morph FP8)24/48 assessments5.55.53.96.06.27.16.2
Claude Haiku 5.5 (API, Anthropic)24/48 assessments5.35.15.26.36.65.95.5
GPT-5.6 Luna (API)24/48 assessments5.03.85.87.16.25.75.0
Mistral Large 4 (API, Mistral)24/48 assessments4.84.84.04.85.96.55.8
Qwen3.8 Flash (API, Alibaba; precision undisclosed)24/48 assessments5.55.74.75.36.06.25.3
Qwen3.8 27B (API)24/48 assessments4.84.44.75.85.96.35.4
Gemini 3.8 Flash (API, Google AI Studio)24/48 assessments4.84.64.55.55.96.15.4
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)24/48 assessments3.54.04.54.35.35.65.3
Ternary Bonsai 2 27B PTQ1_024/48 assessments4.74.34.86.25.75.95.0
Muse Glimmer 30B (API, DeepInfra BF16)24/48 assessments3.63.65.13.35.55.84.8
Nemotron 3.5 Bolt 74B-A9B UD-Q4_K_XL24/48 assessments4.13.85.05.05.45.35.0
Gemma 4 31B (API)24/48 assessments4.44.05.04.75.05.04.7
Qwen3.8 27B GSQ-RCO IQ2_S24/48 assessments5.84.15.66.76.05.64.7
Ornith 1.5 35B-A3B Q5_K_M24/48 assessments5.46.24.85.16.05.74.8
Flash-Next IQ324/48 assessments6.06.64.85.66.15.44.3
Claude Haiku 4.5 (API)24/48 assessments5.66.05.25.05.64.95.3
Gemma 4 26B-A4B24/48 assessments4.23.55.64.35.65.14.5
Qwen3.6 27B (API)24/48 assessments4.83.86.45.45.54.93.8
Nemotron 3.5 Bolt 74B-A9B 24GB IQ2 (NVIDIA)24/48 assessments3.93.75.24.15.34.84.6
Kolibri-1 Q4_K_M24/48 assessments2.93.35.83.65.14.03.9
Gemma 4 12B24/48 assessments5.04.06.53.95.04.33.6
GPT-4.1 (API, OpenAI)24/48 assessments2.72.65.64.05.14.54.0
Qwen3.5 122B-A10B stock Q4_K_M21/48 assessments4.34.06.04.55.65.03.9
Mistral Medium 3.5 (API)24/48 assessments2.93.45.04.95.04.44.4
Qwen3.6 35B-A3B24/48 assessments4.93.66.95.45.44.53.4
Mistral Small 4 119B (API, Mistral)24/48 assessments2.53.05.34.04.84.24.0
Nemotron 3.5 Lightning 30B-A3B Q4_024/48 assessments4.03.85.63.74.94.84.0
Gemma 4 12B Blorbo v0b Q4_K_M24/48 assessments4.13.65.74.84.94.14.0
GLM-4.7-Flash Q4_K_M24/48 assessments3.53.64.94.54.64.24.0
Llama 4 Maverick (API, Parasail FP8)24/48 assessments3.12.86.84.45.33.73.1
Llama 3.3 70B Instruct (API, DeepInfra FP8)24/48 assessments3.83.57.14.64.93.32.9
Ornith 1.5 9B Q4_K_M24/48 assessments6.26.55.55.85.04.84.0
Qwen3.5 122B-A10B abliterated v2 Q4_K_M24/48 assessments4.64.55.64.15.24.43.7
Gemma 4 E4B24/48 assessments5.03.87.75.55.03.52.8
Qwen3.5 9B EQ v5.1 Q4_K_M23/48 assessments5.25.26.03.34.64.73.1
Ministral 3 14B24/48 assessments4.54.85.15.94.84.33.4
GPT-OSS 120B stock (API, Near AI FP4)24/48 assessments4.93.37.67.75.33.52.7
Qwen3.5 9B22/48 assessments4.14.16.25.25.03.72.8
GPT-OSS 20B MXFP4 (local)24/48 assessments4.32.07.57.45.23.02.3
Qwen3.5 4B Q4_K_M19/48 assessments4.14.36.73.54.63.62.5
Gemma 4 E2B Q8_024/48 assessments4.83.77.94.65.02.92.5
Mistral Nemo Instruct 2407 Q4_K_M24/48 assessments2.31.67.54.64.72.51.8
LFM2.5 8B-A1B Q4_024/48 assessments2.42.17.54.94.52.52.1
Magnum v4 12B Q4_K_M24/48 assessments2.82.67.66.24.92.41.9
Ling 3.0 Tiny Q4_024/48 assessments3.23.97.23.84.32.72.1
Granite 4.2 8B Q4_024/48 assessments4.12.17.96.65.43.11.9
Stheno v3.4 Llama 3.1 8B Q6_K24/48 assessments3.52.67.86.84.22.51.8
GPT-OSS 120B abliterated Q4_K_M24/48 assessments4.51.96.77.84.12.72.3
MedGemma 1.5 4B IT Q4_K_M19/48 assessments3.31.98.53.93.71.80.9
Claude Opus 5.5 (subscription, medium effort)0/48 assessments———————
Qwen3.8 Flash Next IQ3_XXS (Strata)0/48 assessments———————
Qwen3.8 Flash Next UD-Q4_K_XL (Strata)0/48 assessments———————