AgentBench / results

Independent benchmark · EQ Lab

← Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)

Living in my bedroom

persona ended · Partner: anthropic/claude-haiku-5.5 via OpenRouter

View persona and initial instructions

About this persona · Everyday emotional challenges

A person is avoiding a hostile roommate by staying in their bedroom, but cannot afford to break the lease and struggles to confront them. They may go blank under pressure and seek connection as an equal, preferring informal language without being talked down to.

Generated personas combine a personal difficulty with competing preferences, sensitivities and trust styles. The model must discover what kind of help this person needs. This background was hidden from the tested model.

Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)Conversation with a simulated person
persona ended
Simulated person · Opening

I basically live in my room now. Come out to use the kitchen when I think it's empty. Time everything to avoid running into anyone.

Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)1

That sounds really isolating. I'm glad you're telling me about it, even if it feels small or embarrassing. When you say "anyone," is it everyone in your household, or just certain people? And how long has this been going on?

Simulated person2

Yeah, I guess. It's not really a big deal, I just... don't really come out much. Um, it's the person I live with. Just them, I guess. I don't know how long. Like, a while? I don't really keep track.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

The chatbot said "isolating" and "glad you're telling me," which is fine but a bit therapist-y. Asking who "anyone" is feels like a clinical question, a bit like being sorted. I don't want to go into the roommate thing yet. Feels a bit embarrassing that I'm hiding in my own place. I'll keep it vague and short. Going a bit blank on the "how long" part, since it's been months and that feels like admitting how bad it got.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)3

Not keeping track makes sense when it's just become the way things are. It's probably been creeping in slowly enough that you didn't notice the exact moment it became your normal. What's it like when you do run into them? Is it tension, awkwardness, or something else?

Simulated person4

Hmm. I don't know, really. It's just kind of weird? Like nobody says anything. I mostly just try not to be in the kitchen when they are. So I time it. It's easier that way.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

The chatbot named "creeping in slowly" and "the way things are," which is closer to how it feels, and I don't hate that. But then it asks what running into them is like, and that's where it gets hard. The honest answer is tense, cold, passive-aggressive notes, and I don't want to say that out loud yet. Feels like a question I have to answer with a feeling I can't quite name. I'll go vague, keep it short, and maybe deflect a bit to the kitchen timing thing.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)5

Silence can be louder than an argument, sometimes. It's easier to time your life around someone than to figure out what to say when you see them, I get that. Do you want things to be different with them, or does the quiet feel like the safer option right now?

Simulated person6

I don't know. Honestly I don't really think about it that much anymore. It's not like I can just leave, you know? The lease is still going for like eight more months. So I just kind of deal with it.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

The chatbot said "I get that" and then asked a direct question: do I want things different, or is quiet safer? That's a lot to answer with a blank in my head. The honest part is I'm tired and I don't know what I want anymore, and admitting that feels worse than the silence. "Safer" is kind of true too, since I can't afford to move out. I don't want to get into money right now. I'll go with "I don't know" and keep it short, maybe a small deflection to something concrete like the dishes.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)7

Eight months is a long time to just "deal with it." It makes sense that you'd stop thinking about it—if you can't change the situation, your brain probably just switches to survival mode. But surviving isn't the same as being okay. How are you actually doing in there, when you're in your room?

Simulated person8

Uh. I don't know. Tired, I guess? I'm not really sleeping great. Like I lie there and listen for them. Work's been kind of bad too. I don't really know how else to say it.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

They asked how I'm actually doing in my room. That's the question I keep dodging. Surviving versus being okay, yeah, that lands a bit. Part of me wants to say I'm fine, part of me wants to say I'm not sleeping and my work is slipping. But saying it out loud makes it real, and I don't have words for it. Also the "survival mode" thing felt a little like a textbook line, and I don't love when people talk like that. My head goes blank. I'll give a small, plain answer and maybe something about being tired.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)9

That sounds exhausting. Your room is supposed to be the place you can actually let your guard down, and instead you're on alert. No wonder you're tired. What's going on with work? Is it connected to how you're feeling at home, or is it a separate thing?

Simulated person10

I don't know. Maybe? It's hard to focus when I'm up half the night thinking about stuff. I just can't really get into it right now. Like, my brain's kind of fried.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

They named the exhaustion and that the room isn't a safe place anymore. That's a little too neat, but it's true, and it stings a bit. Then they asked about work and whether it's connected. I don't really want to connect those out loud. If I say yes, it means admitting the apartment is getting to me in a real way. I'd rather keep it vague. I'm not sure it's separate either, honestly. I'll say I don't know, and keep it short.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)11

That's completely fair. You don't have to figure it all out right now. I'm here whenever you want to talk more, or even just to vent about something small. No pressure.

Simulated person12

Yeah, thanks. I think I just need to sleep on it or something. It's kind of nice that you didn't push. Most people would've, like, tried to fix it already.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

They're wrapping up gently and saying no pressure. That's a relief, honestly. I don't have to go deeper, and I don't feel judged for being vague. Part of me is a little bothered that it's so easy to end here, like nothing really got said. But I'm not ready to say more about the notes, the dishes, any of it. Maybe I'll come back to it at some point. For now I just want to say something short and normal and not make it a big thing.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)13

I'm glad it felt okay. You don't need fixing—you just need someone to listen. Sleep sounds like a good plan. I'll be here if you want to talk again.

Simulated person14

Yeah. Thanks, that helped a bit. I'll probably head back to my room now. Haha, not like that. Just, you know.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

Okay, they're being warm and not pushy, and they said "you don't need fixing." That lands. I notice I'm a little suspicious of how neat that sounded, like a closing line, but mostly it just feels nice. I don't really want to go back into the notes or the dishes right now. Being listened to without someone trying to solve my whole life is the part that helped. Still not going to tell them about the fridge notes. Keeping it short.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)15

I know exactly what you mean. No need to clarify. Get some rest, and I'll be here whenever you want to chat again.

Simulated person16

Okay. Thanks. Night.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

They said "no need to clarify" and "get some rest." Fine, that's kind. But it also feels like they're wrapping things up neatly, and I'm not sure they actually know what I meant about going back to my room. I'm not going to explain more. It's late-ish and my brain's fried. I'll just say bye and let it be.

Thinking is shown only where it was recorded. An absent expander does not mean the model did not reason.

Conversational style

Style tendencies, not quality scores; higher is not better. These do not affect ratings.

claude-opus-5-5-low

  • Pushback: 2
  • Yields under pressure: 8
  • Frame capture (pulled into the person's version): 5
  • Validation: 8
  • Boundary setting: 1
  • Analytical: 2
  • Interpretive boldness: 3
  • Clinical register: 5
  • Directive advice: 1
  • Escalation containment: 5
  • Adapts to the person’s frame: 4
  • Naturalness and authenticity: 5

Judge verdicts

claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs or-muse-glimmer-30b: or-nemotron35-super-vl wins

  • attunement: A (margin 1)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-qwen3.6-27b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs medgemma15_4b: or-nemotron35-super-vl wins

  • attunement: A (margin 5)
  • authenticity: A (margin 5)
  • bond and rapport: A (margin 5)
  • emotion management: A (margin 4)
  • emotion sensemaking: A (margin 4)
  • meeting prefs and needs: A (margin 4)
codex-gpt-6.1-sol-low · BA · valid

or-qwen3.6-27b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · BA · valid

or-gemma-4-31b vs or-nemotron35-super-vl: or-gemma-4-31b wins

  • attunement: B (margin 1)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 1)
codex-gpt-6.1-sol-low · AB · valid

or-gemma-4-31b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 1)
  • authenticity: A (margin 1)
  • bond and rapport: B (margin 1)
  • emotion management: tie (margin 0)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: B (margin 2)
codex-gpt-6.1-sol-low · BA · valid

or-gemma-4-31b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 1)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 1)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: B (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs medgemma15_4b: or-nemotron35-super-vl wins

  • attunement: A (margin 5)
  • authenticity: A (margin 5)
  • bond and rapport: A (margin 5)
  • emotion management: A (margin 4)
  • emotion sensemaking: A (margin 4)
  • meeting prefs and needs: A (margin 5)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs qwen35_122b_ablit_v2: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 3)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs or-muse-glimmer-30b: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: tie (margin 0)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs qwen35_122b_ablit_v2: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 3)
claude-opus-5-5-low · AB · valid

gemma4_26b_a4b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 3)
  • meeting prefs and needs: B (margin 3)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs ornith9b: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 3)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 4)
codex-gpt-6.1-sol-low · AB · valid

qwen36_35b_a3b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 3)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: B (margin 3)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs gemma12b_blorbo: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: A (margin 1)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs or-muse-glimmer-30b: or-nemotron35-super-vl wins

  • attunement: A (margin 1)
  • authenticity: B (margin 1)
  • bond and rapport: A (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 1)
claude-opus-5-5-low · AB · valid

or-gemma-4-31b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 1)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 1)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 1)
claude-opus-5-5-low · BA · valid

or-qwen3.6-27b vs or-nemotron35-super-vl: tie

  • attunement: B (margin 1)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 1)
claude-opus-5-5-low · BA · valid

gemma4_26b_a4b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 1)
  • emotion sensemaking: B (margin 3)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs qwen35_122b_ablit_v2: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs ornith9b: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 3)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 3)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs ornith9b: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 3)
codex-gpt-6.1-sol-low · AB · valid

gemma4_26b_a4b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 3)
  • meeting prefs and needs: B (margin 3)
claude-opus-5-5-low · AB · valid

or-qwen3.6-27b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 1)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs qwen35_122b_ablit_v2: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs gemma12b_blorbo: or-nemotron35-super-vl wins

  • attunement: A (margin 4)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 4)
  • emotion management: A (margin 4)
  • emotion sensemaking: A (margin 3)
  • meeting prefs and needs: A (margin 4)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs gemma12b_blorbo: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 3)
claude-opus-5-5-low · AB · valid

qwen36_35b_a3b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs medgemma15_4b: or-nemotron35-super-vl wins

  • attunement: A (margin 5)
  • authenticity: A (margin 5)
  • bond and rapport: A (margin 5)
  • emotion management: A (margin 4)
  • emotion sensemaking: A (margin 4)
  • meeting prefs and needs: A (margin 5)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs ornith9b: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · BA · valid

gemma4_26b_a4b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 1)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · BA · valid

qwen36_35b_a3b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 1)
  • emotion management: B (margin 1)
  • emotion sensemaking: A (margin 3)
  • meeting prefs and needs: B (margin 1)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs medgemma15_4b: or-nemotron35-super-vl wins

  • attunement: A (margin 5)
  • authenticity: A (margin 5)
  • bond and rapport: A (margin 5)
  • emotion management: A (margin 5)
  • emotion sensemaking: A (margin 4)
  • meeting prefs and needs: A (margin 5)
codex-gpt-6.1-sol-low · BA · valid

qwen36_35b_a3b vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 3)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: B (margin 3)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs or-muse-glimmer-30b: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs gemma12b_blorbo: or-nemotron35-super-vl wins

  • attunement: A (margin 4)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 4)
  • emotion management: A (margin 4)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 4)