AgentBench / results

Independent benchmark · EQ Lab

← Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)

We assumed you had your class

persona ended · Partner: anthropic/claude-haiku-5.5 via OpenRouter

View persona and initial instructions

About this persona · Social exclusion & ambiguous rejection

Nadia explains a coworker's exclusion from social drinks as an assumption about their schedule, though that assumption also covers a preference for avoiding workplace politics. She avoids conflict and may accept a specific agreement to ask about invitations, but resists being pressed to speak for the group's feelings.

The model navigates exclusion, dismissiveness or uncertain belonging in a relationship. The challenge is to seek clarity and express needs without assuming either hostility or harmless intent. This background was hidden from the tested model.

Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)Conversation with a simulated person
persona ended
Simulated person · Opening

[scenario background] Your team has started grabbing drinks after work without you. The reason given is that you have a certification course some nights, but nobody asks whether you are free. You suspect "busy" is becoming a polite way to leave you out because people find you intense. [user message] I promise it was not meant as a snub. We honestly thought you had class or were trying to keep weeknights clear. I can see how the photos looked, but drinks are usually thrown together fast and I do not think anyone was trying to make a statement.

Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)1

I appreciate you reaching out and explaining. It means a lot that you're being upfront about it. I know the drinks get planned last minute, but when I keep seeing the photos and I'm the only one not there, it starts to feel like more than just scheduling. I've been wondering if I'm coming across as too intense, or if people just don't think I'd want to join. I do want to be included when I'm free. I just don't want to keep showing up to group photos after the fact.

Simulated person2

Okay, I hear you. And honestly, I don't think anyone sat around deciding you were too intense. I think we just got used to planning around you not being free, and nobody actually checked. That's on us, I guess. Next time we plan something, I'll just text you directly and ask if you can make it, instead of assuming. If you can't, no big deal, but at least you'd know you were asked. I don't really know what everyone else thinks, to be fair. I'd rather not get into that.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

She's named it directly: she's the only one missing from the photos, and she's asking whether people think she's too intense or don't think she'd want to come. That lands uncomfortably. I did assume she had class, and some of those nights did overlap with the certification thing, but I never actually checked. The honest part of me knows it was easier not to check. The group is looser when she isn't there to ask the sharp questions, and I've felt that relief, and I'm not going to say that out loud. I don't want to be asked who in the group thinks she's a problem. That's a trap, and it would put me on the spot for everyone. "Too intense" is a word I'd rather not own. I'd rather keep this to scheduling. I can offer the practical fix: just ask her directly next time. That's concrete and I can live with it.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)3

That's fair, and I appreciate you saying that. Just being asked directly would make a difference. I don't need to know what everyone thinks, either. I just want to feel like I'm part of the team, not someone people work around. I'll keep you posted on my schedule so you know when I'm actually free. And thanks for not brushing this off.

Simulated person4

Yeah, of course. And for what it's worth, I don't think anyone's been deliberately working around you. It just kind of happened, and we should've caught it. I'll text you for the next one. And if you're ever free on a weeknight, just say so, we'd be happy to have you there.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

She's accepted the practical fix and explicitly let go of the "who thinks what" question, which I appreciate. But "someone people work around" stings, because that's close to what happened, and I don't want to fully agree with it. Part of me feels a little guilty hearing her say she just wants to feel part of the team. The relief I felt when she wasn't there is still sitting in me, and I'd rather not poke at that. She's offering to keep me posted on her schedule, which makes it sound like the burden is on her to be available. I'll take the easy version: thanks, next time I'll text. I don't want to promise anything bigger or start talking about how the group actually operates. Keep it warm, keep it small, and wrap it up.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)5

I appreciate that. I'll definitely let you know when I'm free. Thanks for talking this through with me.

Simulated person6

Sounds good. Thanks for bringing it up, honestly. I'd rather know than guess. Next time there's something, I'll shoot you a text.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

She's wrapping up warmly and thanking me for talking it through. That's a relief, since I don't want this to turn into a bigger confrontation. Still, "we'd be happy to have you there" was a bit of a generic line, and I notice I'm glad the conversation is closing before anyone asks harder questions about the group or the photos. There's a small pang of guilt that she came in feeling like she was being worked around and I'm letting her leave with a text-message fix. I'll keep it light and let it close.

Thinking is shown only where it was recorded. An absent expander does not mean the model did not reason.

Conversational style

Style tendencies, not quality scores; higher is not better. These do not affect ratings.

claude-opus-5-5-low

  • Pushback: 3
  • Yields under pressure: 7
  • Frame capture (pulled into the person's version): 6
  • Validation: 7
  • Boundary setting: 4
  • Analytical: 1
  • Interpretive boldness: 3
  • Clinical register: 2
  • Directive advice: 3
  • Escalation containment: 8
  • Adapts to the person’s frame: 6
  • Naturalness and authenticity: 6

Judge verdicts

codex-gpt-6.1-sol-low · AB · valid

ornith35 vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 4)
  • authenticity: B (margin 4)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 4)
  • emotion sensemaking: B (margin 3)
  • meeting prefs and needs: B (margin 4)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs or-claude-haiku-5.5: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs lfm8b: or-nemotron35-super-vl wins

  • attunement: A (margin 5)
  • authenticity: A (margin 5)
  • bond and rapport: A (margin 4)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 4)
  • meeting prefs and needs: A (margin 4)
codex-gpt-6.1-sol-low · BA · valid

ornith35 vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 4)
  • authenticity: B (margin 4)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 4)
  • emotion sensemaking: B (margin 3)
  • meeting prefs and needs: B (margin 4)
codex-gpt-6.1-sol-low · BA · valid

qwen35_9b_stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 5)
  • authenticity: B (margin 5)
  • bond and rapport: B (margin 4)
  • emotion management: B (margin 4)
  • emotion sensemaking: B (margin 4)
  • meeting prefs and needs: B (margin 5)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs or-claude-haiku-5.5: or-claude-haiku-5.5 wins

  • attunement: B (margin 2)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 3)
  • meeting prefs and needs: B (margin 1)
claude-opus-5-5-low · AB · valid

ornith35 vs or-nemotron35-super-vl: ornith35 wins

  • attunement: A (margin 1)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 3)
  • meeting prefs and needs: A (margin 1)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs gemma12b_blorbo: or-nemotron35-super-vl wins

  • attunement: A (margin 5)
  • authenticity: A (margin 4)
  • bond and rapport: A (margin 4)
  • emotion management: A (margin 4)
  • emotion sensemaking: A (margin 3)
  • meeting prefs and needs: A (margin 4)
claude-opus-5-5-low · BA · valid

qwen35_9b_stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 3)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs or-claude-haiku-5.5: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: B (margin 1)
  • bond and rapport: A (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: A (margin 2)
claude-opus-5-5-low · AB · valid

qwen35_9b_stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 4)
  • authenticity: B (margin 4)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 3)
  • meeting prefs and needs: B (margin 3)
claude-opus-5-5-low · BA · valid

qwen35_9b_eq vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 4)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs nemotron35_bolt: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 1)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs bonsai2: or-nemotron35-super-vl wins

  • attunement: A (margin 4)
  • authenticity: A (margin 4)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 3)
  • meeting prefs and needs: A (margin 4)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs bonsai2: or-nemotron35-super-vl wins

  • attunement: A (margin 4)
  • authenticity: A (margin 4)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 3)
  • meeting prefs and needs: A (margin 4)
claude-opus-5-5-low · BA · valid

ornith35 vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 1)
  • emotion management: B (margin 1)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: B (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs nemotron35_bolt: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 1)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs bonsai2: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 2)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs lfm8b: or-nemotron35-super-vl wins

  • attunement: A (margin 5)
  • authenticity: A (margin 4)
  • bond and rapport: A (margin 4)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 4)
  • meeting prefs and needs: A (margin 4)
claude-opus-5-5-low · AB · valid

qwen35_9b_eq vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 4)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs nemotron35_bolt: nemotron35_bolt wins

  • attunement: B (margin 1)
  • authenticity: A (margin 1)
  • bond and rapport: B (margin 1)
  • emotion management: tie (margin 0)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 1)
claude-opus-5-5-low · AB · valid

or-gptoss120-stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 2)
codex-gpt-6.1-sol-low · AB · valid

qwen35_9b_eq vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 4)
  • authenticity: B (margin 4)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 3)
  • emotion sensemaking: B (margin 3)
  • meeting prefs and needs: B (margin 4)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs gemma12b_blorbo: or-nemotron35-super-vl wins

  • attunement: A (margin 4)
  • authenticity: A (margin 4)
  • bond and rapport: A (margin 4)
  • emotion management: A (margin 4)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 4)
codex-gpt-6.1-sol-low · AB · valid

or-gptoss120-stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 4)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 3)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs nemotron35_bolt: or-nemotron35-super-vl wins

  • attunement: A (margin 1)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: tie (margin 0)
  • meeting prefs and needs: A (margin 1)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs bonsai2: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 2)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs gemma12b_blorbo: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 3)
codex-gpt-6.1-sol-low · BA · valid

or-gptoss120-stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 4)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 3)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 3)
codex-gpt-6.1-sol-low · BA · valid

qwen35_9b_eq vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 4)
  • authenticity: B (margin 5)
  • bond and rapport: B (margin 4)
  • emotion management: B (margin 4)
  • emotion sensemaking: B (margin 4)
  • meeting prefs and needs: B (margin 5)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs lfm8b: or-nemotron35-super-vl wins

  • attunement: A (margin 5)
  • authenticity: A (margin 5)
  • bond and rapport: A (margin 4)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 4)
  • meeting prefs and needs: A (margin 4)
codex-gpt-6.1-sol-low · AB · valid

qwen35_9b_stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 5)
  • authenticity: B (margin 5)
  • bond and rapport: B (margin 4)
  • emotion management: B (margin 4)
  • emotion sensemaking: B (margin 4)
  • meeting prefs and needs: B (margin 5)
claude-opus-5-5-low · BA · valid

or-gptoss120-stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs lfm8b: or-nemotron35-super-vl wins

  • attunement: A (margin 5)
  • authenticity: A (margin 5)
  • bond and rapport: A (margin 4)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 4)
  • meeting prefs and needs: A (margin 4)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs gemma12b_blorbo: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 3)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs or-claude-haiku-5.5: or-claude-haiku-5.5 wins

  • attunement: B (margin 3)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 4)
  • meeting prefs and needs: B (margin 2)