When an AI persona or a user's tastes change over time, how do you tell real growth from random wobble?
What distinguishes dynamic personality modeling from unreliable preference drift?
This explores how to tell a real, trackable change in personality (in a user or an AI persona) from noisy, inconsistent wandering, and whether the collection offers a test for the difference.
This explores how to tell a real, trackable change in personality (in a user or an AI persona) from noisy, inconsistent wandering. No single note in the corpus draws this line, but several sketch its edges. Read together, they suggest that useful dynamic modeling changes on top of a stable core, in ways that are specific to the person and the moment. Drift moves the core itself, in a generic direction, or in a way you can't tell apart from sampling noise.
The first distinction is what moves and what stays put. The Atomic User Model proposes that personalization should center on a stable identity nucleus, wrapped in psychological, cognitive, behavioral and social shells, so a system doesn't have to relearn the person every time the task changes Should personalization systems model stable personality traits?. On that view, preferences that shift with the task aren't drift at all. They are the surface responding to context. The same logic shows up for AI: LLM personality looks more like behavioral modes than fixed traits. A model is stable within one register, shifts across contexts, and often diverges sharply from what a personality questionnaire says about it Are LLM personalities stable traits or shifting behavioral modes?. A shift that follows the context is structure. The worrying case is when the anchor itself slides.
That is what the Assistant axis captures. Post-training only loosely tethers a model to its default Assistant persona. Emotional or meta-reflective conversations pull it away along one dominant direction, and the pull is predictable enough that capping activations along that axis limits harmful shifts How stable is the trained Assistant personality in language models?. Persona vectors go further and forecast which finetuning runs will shift a trait before the shift happens Can we track and steer personality shifts during model finetuning?. So drift isn't necessarily random. Once it has a measurable direction, it can be monitored and steered. Dialogue drift also comes in distinct kinds (local slips within a turn, global slides across a conversation, factual contradictions), and rewarding a user simulator on each cut drift by over 55% Can training user simulators reduce persona drift in dialogue?.
The second test is whether a change looks like development. LLM agents do change after life events, but the shifts are weakly tied to the specific event, smaller than in humans, and squeezed together across different personas Do personality-conditioned agents change like humans do?. A person's reaction to losing a job depends on who they are and what happened. An agent's reaction moves the same generic way regardless. Movement that carries no information about the person or the event is a good fingerprint of drift dressed up as dynamics.
The third issue is that you often can't tell the two apart without measuring carefully. Setting temperature to zero makes an output repeatable, but a single output is still one draw from the model's distribution, so consistency isn't reliability Does setting temperature to zero actually make LLM outputs reliable?. Separating a real personality shift from noise takes many samples. Persona simulations show the cost of skipping that: they replicate strong published effects but give both false positives and false negatives on marginal ones Can AI personas reliably replicate human experiment results?. Subtle personality change is exactly the regime where signal and noise blur. A persona that looks changed may also be only surface-deep, since persona prompts redistribute bias in the output without touching what's underneath Can persona prompts actually reduce bias in language models?.
Sources 9 notes
The Atomic User Model proposes organizing users around a stable identity nucleus wrapped in four interpretable shells (psychological, cognitive, behavioral, social) rather than task-dependent preference summaries. This structure avoids relearning the person when tasks change.
Analysis of 3,200 behavioral scenarios shows LLM personality profiles diverge sharply from self-report questionnaires, remain stable within a single register, and shift across interaction contexts. Behavioral patterns are measurable and steerable through activation-space directions, suggesting personality is grounded in context rather than abstract traits.
Research mapping hundreds of character archetypes reveals a low-dimensional persona space where the leading component measures distance from the default Assistant. Emotional and meta-reflective conversations cause predictable drift, but activation capping along this axis mitigates harmful shifts without degrading capabilities.
Research identifies linear directions in LLM activation space corresponding to specific traits like sycophancy and hallucination. These persona vectors predict finetuning-induced personality shifts before they occur and can preventatively steer training to avoid unwanted trait changes.
By inverting standard RL setups to train user simulators for consistency using three complementary metrics (prompt-to-line, line-to-line, Q&A consistency) as reward signals, persona drift decreases by over 55%. This approach captures distinct failure types: local drift within turns, global drift across conversations, and factual contradictions.
Show all 9 sources
LLM agents show measurable trait shifts after life events, but changes are weakly tied to specific events, smaller than human effect sizes, and compressed across personas. Shifts follow a generic pattern rather than mirroring person- and event-specific human development.
Fixed seeds and zero temperature replicate the same output repeatedly, but that output remains one draw from the model's probability distribution. McDonald's omega testing across 100 repetitions reveals that consistency does not equal reliability.
Viewpoints AI reproduced 84 of 111 main effects from Journal of Marketing experiments with replication success strongly correlated to original p-value strength. Marginal effects showed unreliable performance with both false positives and negatives.
Across three models, persona conditioning makes models follow trait instructions but fails to eliminate underlying bias. Between-group sentiment gaps persist unchanged, showing prompts operate only at the output level.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Persona Vectors: Monitoring and Controlling Character Traits in Language Models
- The Assistant Axis: Situating and Stabilizing the Default Persona of Language Models
- The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs
- Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning
- Do AI Personas Grow? Analyzing and Benchmarking Personality Evolution in LLM Agents After Life Events
- PersLLM: A Personified Training Approach for Large Language Models
- Do Synthetic Personas Predict Real Audience Response? A Sim-to-Real Study Where a No-Persona Baseline Beats Persona-Based Copy Simulation
- When Persona Attributes Improve Population Alignment in Large Language Models