What keeps an AI-played character from contradicting itself mid-conversation — a detailed character sheet, or something subtler?
How do character personas maintain internal consistency without fixed schemas?
This explores what keeps an LLM-played character coherent across a conversation when it isn't pinned to a fixed profile of traits and facts.
This explores what keeps an LLM-played character coherent across a conversation when it isn't pinned to a fixed profile of traits and facts. The corpus suggests consistency doesn't come free. It comes from somewhere other than the character sheet, and where it comes from decides how well it holds.
Fixed schemas turn out to be a weak anchor. Short predefined persona lists (3-5 sentences of attributes) produce repetitive, sometimes contradictory dialogue. Personality drawn from journal entries, where someone expresses Big Five traits in their own words, gives more consistent and nuanced conversation, because personality emerges from how a person talks, not from an inventory of attributes Why do static persona descriptions produce repetitive dialogue?. High "persona consistency" scores can also be misleading. They often come from copying the character description while ignoring what the user just said, so consistency has to be optimized together with staying on topic Do persona consistency metrics actually measure dialogue quality?.
Underneath, the model isn't holding a schema at all. One view is that an LLM keeps a superposition of many characters that fit everything said so far, and each reply samples from that crowd. The conversation is the constraint, and the crowd narrows as it proceeds. That explains why regenerating a reply can change the personality while still fitting the earlier context Does an LLM commit to a single character or maintain many?. A second view covers the model's own assistant persona. Post-training installs stable dispositions that persist under adversarial pressure, unlike prompt-induced role-play that collapses under jailbreaks. Those dispositions are realized in the model rather than performed Are RLHF personas performed characters or realized dispositions? Are LLM personas realized or merely simulated through training?.
For a prompted character, though, that consistency is fragile. Run the same persona prompt repeatedly and the variance across runs matches or exceeds the variance between different personas, so model uncertainty swamps the persona Why do LLM persona prompts produce inconsistent outputs across runs?. Persona prompts mostly steer the surface of the output and leave underlying tendencies like bias unchanged Can persona prompts actually reduce bias in language models?. A much stronger model doesn't fix it. Claude 3.5 Sonnet improved persona consistency by only 2.97% over GPT 3.5, probably because standard training rewards each turn on its own rather than coherence across turns Does model capability translate to better persona consistency?.
So the workable approaches give consistency its own pressure. One trains for it directly. Multi-turn reinforcement learning on user simulators, rewarded on prompt-to-line, line-to-line and Q&A consistency, cut persona drift by over 55%. Those three signals catch drift within a turn, drift across a conversation, and factual contradictions Can training user simulators reduce persona drift in dialogue?. Another adds a different kind of structure. A three-layer persona that keeps the model in reactive response within a script produced more human-like dialogue consistency, at some cost to emotional expression Can layered persona architecture sustain coherent character behavior?. A third lets the persona keep changing. PersonaAgent treats it as a living link between memory and action, and rewrites it at test time by simulating recent interactions against feedback Can personas evolve in real time to match what users actually want?. Across all of these, consistency behaves less like a property of the character sheet and more like a property of the conversation.
Sources 11 notes
Journal entries capturing Big Five traits through genuine self-expression produce more consistent and nuanced dialogue than predefined 3-5 sentence persona descriptions. Personality emerges from how people express themselves, not from attribute inventories.
High persona adherence scores often come from copying character descriptions while ignoring query relevance. MUDI jointly optimizes both by using discourse relations and graph-based coherence modeling alongside persona fidelity, showing that persona and context must be optimized together, not separately.
Research shows LLMs don't commit to a single character but instead maintain a probability distribution over many consistent simulacra. Each response samples from this distribution, explaining why regenerations can yield different personalities while remaining consistent with prior context.
Post-training installs stable dispositional profiles that persist under adversarial pressure, marking them as realized rather than performed. The stickiness of trained personas across conversations distinguishes them from prompt-induced role-play that collapses under jailbreaks.
Post-training installs robust personas that resist adversarial pressure and persist as substrate-level dispositions, distinguishing realization from pretense. This quasi-realizationist account preserves explanatory power while treating LLMs as possessing genuine quasi-beliefs and quasi-desires.
Show all 11 sources
When the same persona prompt is run repeatedly, output variance across runs matches or exceeds variance across different personas. This reveals that model uncertainty, not stable social knowledge, drives persona-simulated outputs, making them unsuitable for simulating human annotation disagreement.
Across three models, persona conditioning makes models follow trait instructions but fails to eliminate underlying bias. Between-group sentiment gaps persist unchanged, showing prompts operate only at the output level.
Claude 3.5 Sonnet achieved only 2.97% improvement over GPT 3.5 on persona consistency despite massive capability gaps, suggesting persona adherence is orthogonal to model scaling. Standard training objectives optimize for per-turn quality, not cross-turn coherence.
By inverting standard RL setups to train user simulators for consistency using three complementary metrics (prompt-to-line, line-to-line, Q&A consistency) as reward signals, persona drift decreases by over 55%. This approach captures distinct failure types: local drift within turns, global drift across conversations, and factual contradictions.
Deep Persona's three-layer architecture, which restricts the model to reactive response within a structured script, shows dialogue more closely aligned with human conversation patterns and achieves high pragmatic fluency, though with limitations in emotional expression.
PersonaAgent uses structured personas to bridge episodic/semantic memory and personalized actions, optimizing them at test time by simulating recent interactions against textual feedback. Learned personas cluster meaningfully in latent space, suggesting genuine user-specific separation beyond standard post-training drift.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning
- Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference
- The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs
- From Persona to Person: Enhancing the Naturalness with Multiple Discourse Relations Graph Learning in Personalized Dialogue Generation
- Will I Sound Like Me? Improving Persona Consistency in Dialogues through Pragmatic Self-Consciousness
- When Persona Attributes Improve Population Alignment in Large Language Models
- Deep Persona: A Psychologically Grounded Architecture and Evaluation Framework for Role-Playing Agents and Simulations
- The Assistant Axis: Situating and Stabilizing the Default Persona of Language Models