INQUIRING LINE

Can an AI character whose personality drifts during a chat still sound real if it isn't reacting to anything specific?

Can dynamic personality modeling without event-specificity produce plausible dialogue?

This explores whether a personality that shifts over a conversation, but isn't tied to particular events or situations, is enough to make generated dialogue feel believable.


This explores whether a personality that shifts over a conversation, but isn't tied to particular events or situations, is enough to make generated dialogue feel believable. The corpus suggests it gets you dialogue that sounds like a person but not one who is responding to anything. The setups that measure realism keep adding event-like ingredients (topic, context, intent, memory) on top of personality. No note tests "personality with no events" head-to-head, so this is inferred from what the best-performing setups include.

The clearest evidence is on synthetic dialogue. Can synthetic dialogues become realistic through layered diversity? finds that realistic conversations need three layers working multiplicatively: subtopic specificity, Big Five persona variation, and 11 contextual characteristics. Personality is one of three ingredients there. User simulators point the same way. Can controlled latent variables make LLM user simulators realistic? conditions on a session-level user profile and also on a turn-level intent. That per-turn intent is what makes each line answer what is happening right now, and it is the closest thing in the corpus to event-specificity. Realism was checked by asking crowdworkers and trained discriminator models to tell the simulated conversations from real ones.

Memory does similar work for predicting behavior. In Can LLMs predict character choices from narrative context?, models predicted characters' choices best when an expert-written persona profile was paired with retrieved memories relevant to that character's psychology, beating automated summaries by 5%. A trait description says who someone is, but the specific past moments say how that trait plays out. Without them, the model has to guess.

The "dynamic" half of the question is harder for LLMs than it sounds. Alignment training tends to lock in one communicative identity, so models struggle to shift register with context (Can language models adapt communication style to different contexts?). When personality does move, it is often by accident. How stable is the trained Assistant personality in language models? shows emotional conversations pulling models away from their default persona in predictable ways. Can training user simulators reduce persona drift in dialogue? cut persona drift by 55% and found it comes in three forms: within a turn, across a conversation, and as factual contradictions. So the current problem is more often keeping a personality steady than modeling one that evolves on purpose.

There is a conceptual reason event-free personality falls short. Do large language models actually commit to a single character? argues that an LLM never commits to one character. It holds a spread of consistent characters and samples from it, so regenerating gives different answers that each fit the context so far. A personality alone leaves that spread wide. Context, intent and memory are what narrow it to a line that sounds like this person, right now. Getting the personality in is not guaranteed either. Can open language models adopt different personalities through prompting? finds most open models resist prompted personalities. Can we control personality in language models without prompting? shows one workaround, adapters that shape traits without prompting.


Sources 9 notes

Can synthetic dialogues become realistic through layered diversity?

Research shows that realistic synthetic dialogues require three multiplicative layers: subtopic specificity, Big Five persona variation, and 11 contextual characteristics via Chain of Thought reasoning. This structured approach captures 90.48% of in-domain dialogue performance.

Can controlled latent variables make LLM user simulators realistic?

RecLLM demonstrates that conditioning an LLM simulator on session-level (user profile) and turn-level (user intent) latent variables produces synthetic conversations measurable as realistic via crowdsource discrimination, discriminator models, and classifier-ensemble distribution matching.

Can LLMs predict character choices from narrative context?

The LIFECHOICE benchmark (1,462 decisions across 388 novels) shows LLMs predict character choices better when given expert-written persona profiles paired with retrieved memories relevant to the character's psychology. This persona-based approach outperforms automated summarization by 5%.

Can language models adapt communication style to different contexts?

System prompts and RLHF training lock models into one communicative identity across all interactions, preventing the contextual register-switching and value trade-offs that characterize human pragmatics. Users cannot reshape model behavior through dialogue negotiation.

How stable is the trained Assistant personality in language models?

Research mapping hundreds of character archetypes reveals a low-dimensional persona space where the leading component measures distance from the default Assistant. Emotional and meta-reflective conversations cause predictable drift, but activation capping along this axis mitigates harmful shifts without degrading capabilities.

Show all 9 sources
Can training user simulators reduce persona drift in dialogue?

By inverting standard RL setups to train user simulators for consistency using three complementary metrics (prompt-to-line, line-to-line, Q&A consistency) as reward signals, persona drift decreases by over 55%. This approach captures distinct failure types: local drift within turns, global drift across conversations, and factual contradictions.

Do large language models actually commit to a single character?

Shanahan's 20-questions test shows LLMs maintain a superposition of consistent objects or characters and sample from that distribution at generation time. Regenerating the same response yields different outputs, each consistent with prior context, proving no fixed commitment exists.

Can open language models adopt different personalities through prompting?

Research shows most open models fail to adopt prompted personalities, stubbornly retaining their trained ENFJ-like defaults. Only a few flexible models succeed. Combining role and personality conditioning improves results but doesn't fully overcome resistance.

Can we control personality in language models without prompting?

PsychAdapter modifies every transformer layer with <0.1% additional parameters to achieve 87.3% Big Five accuracy and 96.7% depression/life satisfaction accuracy across GPT-2, Gemma, and Llama 3. This architecture-level approach bypasses prompt resistance entirely.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.