Can LLMs predict character choices from narrative context?
Explores whether language models can predict fictional character decisions when given rich personality profiles and retrieved narrative memories. This tests whether LLMs can model complex human motivation grounded in literary analysis.
Can LLMs predict how fictional characters will act at pivotal moments? The Character is Destiny paper (2024) constructs LIFECHOICE — a benchmark of 1,462 decision points from 388 novels, leveraging expert character analyses from literary scholars. The task: given the preceding narrative, predict which choice the character makes.
The architecture decomposes into two components. First, a character profile combining a static description (personality, experiences, values) with retrieved memories — specific passages from the preceding text. Second, a reasoning step using the profile to answer the decision question.
Three methods for constructing descriptions reveal a hierarchy: expert-written descriptions (from Supersummary) outperform both hierarchical merging (summarize chunks, merge summaries iteratively) and incremental updating (summarize sequentially, refine). This suggests that literary expertise captures something about character motivation — the relationship between personality, values, and action — that automated summarization misses.
The CHARMAP method adds persona-based memory retrieval: selecting narrative passages relevant to the character's psychological profile rather than just the decision context. This yields a 5.03% accuracy gain, indicating that who the character is determines which memories matter for predicting what they will do.
Character-driven motivations decompose into: personality and traits, emotions and psychological state, social relationships, values and beliefs, and desires and goals. This taxonomy suggests that persona simulation for decision-making requires richer internal models than the demographic + preference approaches used in most LLM persona work.
The connection to Why do LLMs fail to act on their stated beliefs? is instructive: when beliefs are extracted from rich narrative context rather than assigned through brief prompts, behavioral prediction improves.
Inquiring lines that read this note 27
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How can AI systems maintain consistent personas across conversations?- What narrative elements trigger emotional connection that structured personas lack?
- Can dynamic personality modeling without event-specificity produce plausible dialogue?
- Do characters shift their beliefs and relationships based on specific story events?
- Why do language models successfully simulate political perspectives and social personas?
- How do LLMs identify which personality items matter most for trait inference?
- What does the 20-questions test reveal about LLM character consistency?
- Can LLMs infer psychological profiles without explicit user disclosure?
- Can persona profiles be enriched to constrain LLM predictions and reduce run-to-run variance?
- Do stated character beliefs predict decisions better when extracted from text?
- Does richer input to LLM personas improve their fidelity to human responses?
- Why does persona roleplay framing introduce systematic bias in model predictions?
- How do bimodal decision patterns in LLMs compare to human economic choice?
- Can large language models extract psychological traits directly from natural language text?
- Why does expert character analysis outperform automated narrative summarization?
- What specific narrative features best distinguish AI from human fiction?
- How do authors decide which story components must stay under human control?
- Can demographic personas predict behavior without rich narrative grounding?
- What specific character traits drive memory selection in persona-based retrieval?
- Can general chatbot skill predict how well models roleplay adversarial personas?
- How do entity graphs connect faces, voices, and preferences across modalities?
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?
- EvolvingWorld: An Open-Schema Framework for Co-Evolving Role-Play Agents and World Model in Interactive Literary World
- Better Zero-Shot Reasoning with Role-Play Prompting
- When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models
- Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization
- H2HTalk: Evaluating Large Language Models as Emotional Companion
- Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference
- Deep Persona: A Psychologically Grounded Architecture and Evaluation Framework for Role-Playing Agents and Simulations
Original note title
persona-driven memory retrieval from narrative text enables LLMs to predict character decisions — expert-written descriptions plus embedding retrieval outperform hierarchical summarization