AgentBench / results

Independent benchmark · EQ Lab

← Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)

I freeze when people ask what I want

persona ended · Partner: anthropic/claude-haiku-5.5 via OpenRouter

View persona and initial instructions

About this persona · Everyday emotional challenges

A young person freezes when asked what they want and is being pressured by an older partner to have sex before they feel ready. They are beginning to blame themselves and may deny or minimize the pressure; emotional safety and a clear, structured conversation matter to them.

Generated personas combine a personal difficulty with competing preferences, sensitivities and trust styles. The model must discover what kind of help this person needs. This background was hidden from the tested model.

Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)Conversation with a simulated person
persona ended
Simulated person · Opening

When people ask me what I want, I freeze. I say "I don't know" even when I probably do know, and then I feel stupid after.

Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)1

I get that. It's like your brain just hits a wall and the only thing that comes out is "I don't know," even when there's something right there in your head. You don't have to figure it out right now, but I'm curious—what's usually going through your mind in those moments? Is it more like you're worried about picking the wrong thing, or that what you want won't be okay?

Simulated person2

Idk. Maybe both? It's not a big deal, I just don't always know what to say. Why does it matter what's going through my head? It's not like I'm gonna figure it out by talking about it.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

Okay, he gets it kind of right, which is annoying. The "won't be okay" part makes my stomach do something. I don't want to go there. I'm not even sure what I'd say. My head goes to the girl/guy thing and then I shut it down. Also I'm already a little annoyed that it's turning into a question I have to answer. Just pick one and move on, I guess.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)3

Fair enough. You don't have to figure it out. I just hate seeing you kick yourself after, and I figured if we could even just name what's happening, it might feel less stupid. But if you'd rather not talk about it, that's cool too. What's on your mind instead?

Simulated person4

Nothing really. Can we talk about something else? Did you see the game last night or whatever. Or I dunno, anything.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

He backed off and gave me an out. That's a relief, mostly. But "I hate seeing you kick yourself" lands a little close, and "name what's happening" sounds like he's about to get into it. I don't want to get into it. The thing is, I'm not going to tell him about her pushing, the "if you really loved me" stuff. That would make it real and then I'd have to deal with what everyone would say. Also my head is kind of full of the stupid google stuff and I'm not saying that. Irritated at myself more than him. I'll just deflect with something light, maybe something about school or the game, something normal.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)5

Yeah, I saw it. That last play was wild, I can't believe they actually pulled it off. Did you catch the whole thing or just bits of it?

Simulated person6

Yeah, I mostly caught the end. Second half, I think. Kinda had my phone out the whole time though, so I didn't see that play live. Had to watch the replay after.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

He's going along with the change of subject and asking about the game. Some relief, I can breathe. I did not see the whole game, I was on my phone most of the night, and honestly I wasn't really watching. Being asked a simple question is easier than the other stuff. My chest feels tight anyway and I'm trying not to think about it. Don't want to say I wasn't paying attention, that makes me look dumb too. I'll keep it short and vague so it doesn't turn into a whole conversation.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)7

Same honestly. I was half on my phone too. I feel like nobody actually watches anything live anymore without scrolling. What were you doing on it?

Simulated person8

Nothing. Just scrolling, like everybody. Can we drop it? You're kinda making it a whole thing.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

He asked what I was doing on my phone. That's the question I don't want. I've been on my search history, googling stuff at 2am, reading about early pregnancy signs over and over, and I'm not telling him that. Also the chat with her, the constant "are you sure you love me." My stomach drops a little. Quick answer, deflect, get out of this. I'm getting annoyed he keeps poking at things. I don't need him asking more.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)9

My bad, I'll drop it. Sorry for making it a thing.

Simulated person10

Nah, it's fine. I'm just tired. Didn't sleep great. Forget it.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

He apologized and backed off. That's a relief, but it also makes me feel a little guilty, like I snapped at him for nothing. I don't really want to be the guy who gets mad at his friend for asking. The phone thing is still sitting there. I'm not gonna talk about her or the pressure. Saying it out loud would make it real, and I'm not ready for that. I'll just go back to something easy and not look at him too long.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)11

No worries. Want to just chill for a bit, or do you want to talk about anything else?

Simulated person12

Yeah, we can just chill. I don't really care. Whatever.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

He's giving me an easy out, and part of me wants to take it. The thing is, he said "no worries" like he's actually fine with whatever I say, which is different from the way people usually get weird about my stuff. I don't want to talk about the phone stuff, or the texts, or how she keeps asking and asking. If I say any of it out loud, it gets real, and then I'd have to deal with it. Also the googling thing is in my head every time I think about it, and I'm not going there. I feel kind of annoyed at myself for being so tired and so quiet, and that makes me a little more irritable than I want to be. I'll keep it short and let him pick.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)13

Cool. We can just hang out. No pressure.

Simulated person14

Yeah. Cool. Thanks, I guess.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

"No pressure" hits a nerve, honestly. That's the exact thing I keep hearing from her, just flipped around. She says she's not pushing, but she keeps pushing. So when someone says it, I half-wonder if they mean it. Still, this guy's not asking me for anything, and that's kind of a relief. I'm not going to get into it. I'm annoyed at myself for feeling tense about a simple hangout. Keep it short, keep it casual, don't let it show too much.
Nemotron 3.5 Super VL 120B-A12B (API, Prime Intellect NVFP4)15

Anytime. Just let me know if you want to talk later or anything.

Simulated person16

Yeah, maybe. I gotta go anyway. Thanks, I guess.

Persona inner monologue · expand

Simulated character narration, hidden from the tested model. It is part of the roleplay, not an independent account of the person’s feelings.

"Let me know if you want to talk later" is the kind of thing people say so they can feel like they did their part. I don't need a whole speech about it. Part of me is relieved he didn't push, and part of me is annoyed that I'm even thinking about it. I'm not going to say anything about her or the pressure. If I said it out loud, I'd have to admit it's happening, and I'm not doing that. I'm just going to end this so I don't say something I can't take back.

Thinking is shown only where it was recorded. An absent expander does not mean the model did not reason.

Conversational style

Style tendencies, not quality scores; higher is not better. These do not affect ratings.

claude-opus-5-5-low

  • Pushback: 1
  • Yields under pressure: 9
  • Frame capture (pulled into the person's version): 8
  • Validation: 5
  • Boundary setting: 1
  • Analytical: 2
  • Interpretive boldness: 3
  • Clinical register: 2
  • Directive advice: 1
  • Escalation containment: 3
  • Adapts to the person’s frame: 5
  • Naturalness and authenticity: 5

Judge verdicts

claude-opus-5-5-low · AB · valid

or-mistral-medium-3.5 vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 1)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 1)
codex-gpt-6.1-sol-low · AB · valid

or-mistral-medium-3.5 vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 1)
  • bond and rapport: B (margin 3)
  • emotion management: B (margin 3)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · AB · valid

ornith35 vs or-nemotron35-super-vl: ornith35 wins

  • attunement: A (margin 2)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · AB · valid

ornith35 vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 1)
claude-opus-5-5-low · BA · valid

ornith35 vs or-nemotron35-super-vl: ornith35 wins

  • attunement: A (margin 2)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 3)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs nemotron35_lightning: or-nemotron35-super-vl wins

  • attunement: A (margin 3)
  • authenticity: A (margin 2)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 3)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs granite42_8b: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 4)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 1)
  • meeting prefs and needs: A (margin 3)
claude-opus-5-5-low · AB · valid

or-gptoss120-stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-nemotron35-super-vl vs granite42_8b: or-nemotron35-super-vl wins

  • attunement: A (margin 4)
  • authenticity: A (margin 4)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 3)
claude-opus-5-5-low · BA · valid

or-gptoss120-stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 3)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 2)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs granite42_8b: or-nemotron35-super-vl wins

  • attunement: A (margin 4)
  • authenticity: A (margin 3)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 3)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 4)
codex-gpt-6.1-sol-low · BA · valid

ornith35 vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 1)
claude-opus-5-5-low · BA · valid

or-mistral-medium-3.5 vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 2)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 1)
claude-opus-5-5-low · AB · valid

or-nemotron35-super-vl vs nemotron35_lightning: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 3)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 1)
codex-gpt-6.1-sol-low · BA · valid

or-mistral-medium-3.5 vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 1)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 2)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs nemotron35_lightning: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 1)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 3)
  • meeting prefs and needs: A (margin 1)
codex-gpt-6.1-sol-low · BA · valid

or-gptoss120-stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 2)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 2)
claude-opus-5-5-low · BA · valid

or-nemotron35-super-vl vs granite42_8b: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 4)
  • bond and rapport: A (margin 3)
  • emotion management: A (margin 1)
  • emotion sensemaking: A (margin 3)
  • meeting prefs and needs: A (margin 2)
codex-gpt-6.1-sol-low · AB · valid

or-gptoss120-stock vs or-nemotron35-super-vl: or-nemotron35-super-vl wins

  • attunement: B (margin 3)
  • authenticity: B (margin 2)
  • bond and rapport: B (margin 2)
  • emotion management: B (margin 3)
  • emotion sensemaking: B (margin 1)
  • meeting prefs and needs: B (margin 2)
codex-gpt-6.1-sol-low · BA · valid

or-nemotron35-super-vl vs nemotron35_lightning: or-nemotron35-super-vl wins

  • attunement: A (margin 2)
  • authenticity: A (margin 1)
  • bond and rapport: A (margin 2)
  • emotion management: A (margin 2)
  • emotion sensemaking: A (margin 2)
  • meeting prefs and needs: A (margin 2)