How many lines of someone's real conversation does an AI need to see before it starts talking like them?
How much dialog context is needed to accurately bind pretrained models to individual personas?
This explores how much conversation history you have to show a pretrained (base) model before it behaves like one specific person instead of a generic speaker.
This explores how much conversation history you have to show a pretrained (base) model before it behaves like one specific person instead of a generic speaker. The corpus's most direct answer is that it takes less than you'd expect. Base models conditioned on short dialog samples predict human responses more accurately and more diversely than instruction-tuned assistants given a written persona Do pretrained models simulate humans better than instruction-tuned assistants?. No note here measures how accuracy grows from two turns to twenty. 'Short' is the finding, and the corpus has no number to attach to it.
The note credits task mismatch, not context length, for the gap. Assistant tuning optimizes a model to be a helpful assistant, and that systematically degrades its ability to imitate a person. A base model just continues text, so a few real turns work as evidence about who is speaking. This fits the view that a language model holds a superposition of possible characters. Regenerating a reply gives a different answer each time, and each answer is consistent with the context so far, so nothing is ever committed to Do large language models actually commit to a single character?. Read that way, dialog context doesn't install a persona. It narrows the set of characters the model might be sampling from. That is my inference from the two notes, not something either states.
The alternative, describing the persona in a prompt, binds much more loosely. Persona prompts change how the output reads but leave underlying bias gaps between groups unchanged Can persona prompts actually reduce bias in language models?. In annotation simulation, running the same persona prompt repeatedly produced as much variation between runs as between different personas, so the model's own uncertainty drowned out the persona signal Why do LLM persona prompts produce inconsistent outputs across runs?. A label like 'a 34-year-old nurse' gives the model little to hold onto, while a few lines of how the person actually talks give it something to condition on.
Binding a persona once doesn't keep it bound as the conversation goes on. Trained assistants sit on a dominant 'Assistant' axis in persona space, and emotional or meta-reflective conversations pull them along it in predictable ways How stable is the trained Assistant personality in language models?. User simulators drift too, and training them with multi-turn RL against consistency rewards cut that drift by over 55% Can training user simulators reduce persona drift in dialogue?. A lighter fix at inference time is to have the agent imagine a listener and check whether an utterance would distinguish its persona from a distractor. That reduced contradictions without extra training Can imaginary listeners reduce dialogue agent contradictions?. Other work keeps the persona current instead, rewriting it at test time by simulating recent interactions against feedback Can personas evolve in real time to match what users actually want?.
The kind of context matters as much as the amount. Realistic synthetic dialogue needed subtopic, Big Five persona traits and 11 contextual characteristics working together, and that combination reached 90.48% of in-domain performance Can synthetic dialogues become realistic through layered diversity?. Conditioning a simulator on a session-level profile plus turn-level intent also produced conversations that were hard to tell from real ones Can controlled latent variables make LLM user simulators realistic?. The picture that emerges is a short, well-chosen sample of real dialog to bind the persona, plus something to keep it from drifting as the conversation runs.
Sources 10 notes
The study shows that pretrained base models conditioned on short dialog samples produce more accurate and diverse human predictions than instruction-tuned assistants prompted with personas, across multiple dialogue corpora. The mechanism is task mismatch: assistant optimization systematically degrades human simulation performance.
Shanahan's 20-questions test shows LLMs maintain a superposition of consistent objects or characters and sample from that distribution at generation time. Regenerating the same response yields different outputs, each consistent with prior context, proving no fixed commitment exists.
Across three models, persona conditioning makes models follow trait instructions but fails to eliminate underlying bias. Between-group sentiment gaps persist unchanged, showing prompts operate only at the output level.
When the same persona prompt is run repeatedly, output variance across runs matches or exceeds variance across different personas. This reveals that model uncertainty, not stable social knowledge, drives persona-simulated outputs, making them unsuitable for simulating human annotation disagreement.
Research mapping hundreds of character archetypes reveals a low-dimensional persona space where the leading component measures distance from the default Assistant. Emotional and meta-reflective conversations cause predictable drift, but activation capping along this axis mitigates harmful shifts without degrading capabilities.
Show all 10 sources
By inverting standard RL setups to train user simulators for consistency using three complementary metrics (prompt-to-line, line-to-line, Q&A consistency) as reward signals, persona drift decreases by over 55%. This approach captures distinct failure types: local drift within turns, global drift across conversations, and factual contradictions.
Endowing dialogue agents with an imaginary listener via Rational Speech Acts reduces persona contradiction at inference time without NLI labels or extra training. The agent simulates whether utterances would distinguish its persona from a distractor, suppressing generic or contradictory responses.
PersonaAgent uses structured personas to bridge episodic/semantic memory and personalized actions, optimizing them at test time by simulating recent interactions against textual feedback. Learned personas cluster meaningfully in latent space, suggesting genuine user-specific separation beyond standard post-training drift.
Research shows that realistic synthetic dialogues require three multiplicative layers: subtopic specificity, Big Five persona variation, and 11 contextual characteristics via Chain of Thought reasoning. This structured approach captures 90.48% of in-domain dialogue performance.
RecLLM demonstrates that conditioning an LLM simulator on session-level (user profile) and turn-level (user intent) latent variables produces synthetic conversations measurable as realistic via crowdsource discrimination, discriminator models, and classifier-ensemble distribution matching.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning
- The Assistant Axis: Situating and Stabilizing the Default Persona of Language Models
- The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs
- Pretrained Persona Mixture Models and Tandem Models for Human Simulation
- When Persona Attributes Improve Population Alignment in Large Language Models
- Persona Vectors: Monitoring and Controlling Character Traits in Language Models
- Will I Sound Like Me? Improving Persona Consistency in Dialogues through Pragmatic Self-Consciousness
- DiaSynth: Synthetic Dialogue Generation Framework for Low Resource Dialogue Applications