Is an AI character 'staying in character' one problem, or two: matching its own profile, and holding steady over time?
How does persona consistency differ from persona stability in interactive systems?
This explores whether 'staying in character' is one problem or two: consistency (does the persona's output match its profile and its own earlier lines) versus stability (does the persona hold its shape over time, across repeated runs, and under pressure).
This explores whether 'staying in character' is one problem or two: consistency (does the persona's output match its profile and its own earlier lines) versus stability (does the persona hold its shape over time, across repeated runs, and under pressure). The corpus never draws this line in so many words. The distinction emerges from how the notes measure each one, and the two fail in different ways.
Consistency is a match property, checked against a reference. The user-simulator work scores it three ways: does a line fit the persona prompt, does it fit the previous lines, and does it survive a factual Q&A about the persona. Those checks catch three separate failures: local slips, drift across a whole conversation, and contradicted facts Can training user simulators reduce persona drift in dialogue?. Consistency is also easy to game. High scores often come from parroting the character description while ignoring what the other person just said, so consistency and dialogue coherence can pull against each other Do persona consistency metrics actually measure dialogue quality?. It doesn't come free with scale either. Claude 3.5 Sonnet beat GPT 3.5 by under 3% on persona consistency, apparently because training rewards per-turn quality rather than cross-turn coherence Does model capability translate to better persona consistency?.
Stability is a resistance property: what happens to the persona when something pushes on it. The notes show three kinds of push. The first is conversational pressure over time. The trained Assistant persona sits on one dominant axis of 'persona space', and emotional or meta-reflective conversations move the model off it in predictable ways. Capping activations along that axis limits harmful shifts without hurting capabilities How stable is the trained Assistant personality in language models?. The second is repetition. Run the same persona prompt many times, and the variation between runs matches or exceeds the variation between different personas. That means the model's own uncertainty, not stable knowledge of the persona, is steering the output Why do LLM persona prompts produce inconsistent outputs across runs?. The third is adversarial attack. Trained Assistant personas persist under jailbreak pressure where prompt-induced role-play collapses, which one philosophical account reads as evidence they are realized dispositions rather than performances Are RLHF personas performed characters or realized dispositions?. That sits awkwardly beside the drift finding above. A persona can be sturdy against attacks and still slide under gentle emotional conversation, and the notes don't reconcile the two.
The two properties can come apart. A layered, scripted persona that only reacts within a structured script produces human-like dialogue consistency, but at the cost of emotional expression Can layered persona architecture sustain coherent character behavior?. That is consistency bought by constraining the model. Going the other way, the sticky trained Assistant looks very stable, but stable at being itself. That is my inference from the notes, not something they state. Its stability doesn't guarantee it stays consistent with the character you asked it to play. The two also feed each other. The 55% drop in persona drift comes from using consistency scores as the training reward, so consistency is a lever for fixing one kind of stability failure.
Stability shouldn't be confused with being frozen. PersonaAgent rewrites its persona at test time to fit what a user wants, and the learned personas cluster distinctly by user Can personas evolve in real time to match what users actually want?. So there are really three things to tell apart. Consistency is not contradicting the intended persona. Stability is not changing when you didn't mean it to. Intended evolution is changing on purpose. The word 'drift' gets used for all three, and separating them shows which fix applies: better training signals, activation-level guardrails, or a different persona design.
Sources 8 notes
By inverting standard RL setups to train user simulators for consistency using three complementary metrics (prompt-to-line, line-to-line, Q&A consistency) as reward signals, persona drift decreases by over 55%. This approach captures distinct failure types: local drift within turns, global drift across conversations, and factual contradictions.
High persona adherence scores often come from copying character descriptions while ignoring query relevance. MUDI jointly optimizes both by using discourse relations and graph-based coherence modeling alongside persona fidelity, showing that persona and context must be optimized together, not separately.
Claude 3.5 Sonnet achieved only 2.97% improvement over GPT 3.5 on persona consistency despite massive capability gaps, suggesting persona adherence is orthogonal to model scaling. Standard training objectives optimize for per-turn quality, not cross-turn coherence.
Research mapping hundreds of character archetypes reveals a low-dimensional persona space where the leading component measures distance from the default Assistant. Emotional and meta-reflective conversations cause predictable drift, but activation capping along this axis mitigates harmful shifts without degrading capabilities.
When the same persona prompt is run repeatedly, output variance across runs matches or exceeds variance across different personas. This reveals that model uncertainty, not stable social knowledge, drives persona-simulated outputs, making them unsuitable for simulating human annotation disagreement.
Show all 8 sources
Post-training installs stable dispositional profiles that persist under adversarial pressure, marking them as realized rather than performed. The stickiness of trained personas across conversations distinguishes them from prompt-induced role-play that collapses under jailbreaks.
Deep Persona's three-layer architecture, which restricts the model to reactive response within a structured script, shows dialogue more closely aligned with human conversation patterns and achieves high pragmatic fluency, though with limitations in emotional expression.
PersonaAgent uses structured personas to bridge episodic/semantic memory and personalized actions, optimizing them at test time by simulating recent interactions against textual feedback. Learned personas cluster meaningfully in latent space, suggesting genuine user-specific separation beyond standard post-training drift.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning
- Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference
- From Persona to Person: Enhancing the Naturalness with Multiple Discourse Relations Graph Learning in Personalized Dialogue Generation
- Will I Sound Like Me? Improving Persona Consistency in Dialogues through Pragmatic Self-Consciousness
- The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs
- PersonaGym: Evaluating Persona Agents and LLMs
- The Assistant Axis: Situating and Stabilizing the Default Persona of Language Models
- Deep Persona: A Psychologically Grounded Architecture and Evaluation Framework for Role-Playing Agents and Simulations