SYNTHESIS NOTE
TopicsPersonas Personalitythis note

Can imaginary listeners reduce dialogue agent contradictions?

Does simulating how an imaginary listener would interpret an utterance help dialogue agents maintain persona consistency without extra training? This explores whether pragmatic self-monitoring at generation time can replace costly supervised approaches.

Synthesis note · 2026-04-18 · sourced from Personas Personality
How accurately can language models simulate human personalities? Why do AI conversations reliably break down after multiple turns?

Persona-based dialogue agents routinely contradict their own stated attributes. Previous solutions either require Natural Language Inference (NLI) labels for training or attach extra trained modules. The "Will I Sound Like Me?" approach (2020) takes a different path: it endows existing agents with public self-consciousness at inference time through an imaginary listener, inspired by social cognition and pragmatics.

The mechanism uses the Rational Speech Acts (RSA) framework. Before generating an utterance, the agent simulates how a listener would interpret it — specifically, whether the listener could distinguish this speaker's persona from a distractor persona based on the utterance. Utterances that would not help identify the speaker (because they are generic or contradictory) are suppressed. The agent learns to ask: "Would I sound like me if I said this?"

The framework extends beyond persona to context consistency in general dialogue. The distractor selection — which alternative persona to contrast against — can be learned rather than manual or random.

This connects to Why does supervised learning fail to enforce persona consistency? as a complementary approach: offline RL punishes contradiction during training while RSA prevents it during inference. The RSA approach requires no additional training data but operates at generation time, adding computational cost per utterance. The trade-off is training-time correction vs. inference-time self-monitoring — both address the same root cause that generative models are never explicitly rewarded for consistency.

The deeper insight is that persona consistency is fundamentally a pragmatic property, not a semantic one. It is about how utterances function in identifying a speaker, not just about logical compatibility of facts.

Inquiring lines that read this note 31

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How can conversational AI maintain consistent personas across conversations? Why do language models reinforce false assumptions instead of correcting them? Can LLM personas constitute genuine psychology or remain linguistic role-play? Why do persona-level simulations fail to predict individual preferences accurately? How can LLM user simulators model realistic goal-driven conversation? What makes dialogue-based explanation more successful than monologue? How should dialogue systems represent uncertainty from noisy speech input? How should dialogue recommender systems manage conversation history and state? How do formal dialogue structures reveal conversation coherence mechanisms? Does conversational format create illusions of genuine AI communication? How can language models sustain linguistic synchrony and intersubjectivity during dialogue? Can next-token prediction alone produce genuine language understanding? How can persona representations reduce language model variance and improve task accuracy?

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

pragmatic self-consciousness through an imaginary listener reduces persona contradiction without additional training — Rational Speech Acts framework enforces consistency by simulating how utterances would be interpreted