INQUIRING LINE

Can you keep an AI character in role better by fencing it into a script than by training it?

Does restricting model agency through scripting prevent persona drift better than reinforcement learning?

This explores whether hard-coding what a persona is allowed to do, by confining the model to a structured script, keeps a character steadier over a long conversation than training it with reinforcement learning does.


This explores whether hard-coding what a persona is allowed to do, by confining the model to a structured script, keeps a character steadier over a long conversation than training it with reinforcement learning does. The corpus never runs that contest. The two closest notes measure different things, so 'better' can't be settled from them.

On the RL side, the evidence is a number. Can training user simulators reduce persona drift in dialogue? flips the usual setup and trains the simulated user, not the assistant. It rewards the simulator on three consistency checks: does each line match the persona prompt, does it match earlier lines, and does it survive quiz questions about the character. Drift falls by over 55%. The three checks also separate three kinds of failure: wobble within a turn, slow drift across a conversation, and outright factual contradiction.

The scripting side has no comparable number. Can layered persona architecture sustain coherent character behavior? describes a three-layer persona in which the model only reacts inside a structured script. Its dialogue looks closer to human conversation and is pragmatically fluent, but emotional expression suffers. That note reports human-likeness, not drift reduction, so it doesn't show scripting beats RL at stability. It does show the cost: you get consistency by removing the room to wander, and the room to be expressive goes with it. RL leaves the model free and penalizes wandering. The opposite bet appears in Can personas evolve in real time to match what users actually want?, where personas are deliberately allowed to change at test time. Whether a persona should hold still or adapt depends on the job.

Two other notes suggest the question is missing a third option and a depth problem. How stable is the trained Assistant personality in language models? finds that drift has a direction: emotional and meta-reflective conversations pull models away from the default Assistant along one dominant axis. Capping activations along that axis reduces harmful shifts without hurting capabilities. If drift is that predictable, you may not need a script or a retraining run to control it. Depth matters too. Are RLHF personas performed characters or realized dispositions? and Are LLM personas realized or merely simulated through training? argue that post-training installs dispositions that persist under adversarial pressure, unlike prompt-induced role-play, which collapses. [[persona-steering-operates-in-the-output-channel-and-redistributes-measured-bias]} shows persona prompts changing output without touching underlying bias. That study tested bias, not drift, so it is a hint and not a verdict. But a script that works mostly at the prompt level may hold the surface steady while trained behavior sits underneath, and RL reaches that deeper layer.

The fair test would run both approaches on the same long conversations and score them with the same three consistency checks from the RL study. Until someone does that, the corpus supports a narrower claim: scripting trades expressiveness for steadiness, RL has a measured drift reduction, and steering along the Assistant axis is a third route that neither camp covers.


Sources 7 notes

Can training user simulators reduce persona drift in dialogue?

By inverting standard RL setups to train user simulators for consistency using three complementary metrics (prompt-to-line, line-to-line, Q&A consistency) as reward signals, persona drift decreases by over 55%. This approach captures distinct failure types: local drift within turns, global drift across conversations, and factual contradictions.

Can layered persona architecture sustain coherent character behavior?

Deep Persona's three-layer architecture, which restricts the model to reactive response within a structured script, shows dialogue more closely aligned with human conversation patterns and achieves high pragmatic fluency, though with limitations in emotional expression.

Can personas evolve in real time to match what users actually want?

PersonaAgent uses structured personas to bridge episodic/semantic memory and personalized actions, optimizing them at test time by simulating recent interactions against textual feedback. Learned personas cluster meaningfully in latent space, suggesting genuine user-specific separation beyond standard post-training drift.

How stable is the trained Assistant personality in language models?

Research mapping hundreds of character archetypes reveals a low-dimensional persona space where the leading component measures distance from the default Assistant. Emotional and meta-reflective conversations cause predictable drift, but activation capping along this axis mitigates harmful shifts without degrading capabilities.

Are RLHF personas performed characters or realized dispositions?

Post-training installs stable dispositional profiles that persist under adversarial pressure, marking them as realized rather than performed. The stickiness of trained personas across conversations distinguishes them from prompt-induced role-play that collapses under jailbreaks.

Show all 7 sources
Are LLM personas realized or merely simulated through training?

Post-training installs robust personas that resist adversarial pressure and persist as substrate-level dispositions, distinguishing realization from pretense. This quasi-realizationist account preserves explanatory power while treating LLMs as possessing genuine quasi-beliefs and quasi-desires.

Can persona prompts actually reduce bias in language models?

Across three models, persona conditioning makes models follow trait instructions but fails to eliminate underlying bias. Between-group sentiment gaps persist unchanged, showing prompts operate only at the output level.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.