Can LLMs predict character choices from narrative context?
Explores whether language models can predict fictional character decisions when given rich personality profiles and retrieved narrative memories. This tests whether LLMs can model complex human motivation grounded in literary analysis.
Can LLMs predict how fictional characters will act at pivotal moments? The Character is Destiny paper (2024) constructs LIFECHOICE — a benchmark of 1,462 decision points from 388 novels, leveraging expert character analyses from literary scholars. The task: given the preceding narrative, predict which choice the character makes.
The architecture decomposes into two components. First, a character profile combining a static description (personality, experiences, values) with retrieved memories — specific passages from the preceding text. Second, a reasoning step using the profile to answer the decision question.
Three methods for constructing descriptions reveal a hierarchy: expert-written descriptions (from Supersummary) outperform both hierarchical merging (summarize chunks, merge summaries iteratively) and incremental updating (summarize sequentially, refine). This suggests that literary expertise captures something about character motivation — the relationship between personality, values, and action — that automated summarization misses.
The CHARMAP method adds persona-based memory retrieval: selecting narrative passages relevant to the character's psychological profile rather than just the decision context. This yields a 5.03% accuracy gain, indicating that who the character is determines which memories matter for predicting what they will do.
Character-driven motivations decompose into: personality and traits, emotions and psychological state, social relationships, values and beliefs, and desires and goals. This taxonomy suggests that persona simulation for decision-making requires richer internal models than the demographic + preference approaches used in most LLM persona work.
The connection to Why don't LLM role-playing agents act on their stated beliefs? is instructive: when beliefs are extracted from rich narrative context rather than assigned through brief prompts, behavioral prediction improves.
Inquiring lines that read this note 20
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How can conversational AI maintain consistent personas across conversations?- What narrative elements trigger emotional connection that structured personas lack?
- What specific character traits drive memory selection in persona-based retrieval?
- Why do language models successfully simulate political perspectives and social personas?
- Can LLMs infer psychological profiles without explicit user disclosure?
- Can persona profiles be enriched to constrain LLM predictions and reduce run-to-run variance?
- Do stated character beliefs predict decisions better when extracted from text?
- Does richer input to LLM personas improve their fidelity to human responses?
- How do LLMs identify which personality items matter most for trait inference?
- Why do different language models converge on similar narrative defaults?
- Why does expert character analysis outperform automated narrative summarization?
- What specific narrative features best distinguish AI from human fiction?
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?
- Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization
- H2HTalk: Evaluating Large Language Models as Emotional Companion
- From Five Dimensions to Many: Large Language Models as Precise and Interpretable Psychological Profilers
- Too Good to be Bad: On the Failure of LLMs to Role-Play Villains
- PersLLM: A Personified Training Approach for Large Language Models
- Thinking in Character: Advancing Role-Playing Agents with Role-Aware Reasoning
- PersonaGym: Evaluating Persona Agents and LLMs
Original note title
persona-driven memory retrieval from narrative text enables LLMs to predict character decisions — expert-written descriptions plus embedding retrieval outperform hierarchical summarization