SYNTHESIS NOTE
TopicsWorld Modelsthis note

Can language models simulate belief change in people?

Current LLM social simulators treat behavior as input-output mappings without modeling internal belief formation or revision. Can they be redesigned to actually track how people think and change their minds?

Synthesis note · 2026-05-03 · sourced from World Models

Most LLM-based social simulations rely on simplified input-output mappings: feed in demographics and persona descriptions, get out plausible behavior. This mirrors the logic of behaviorism in psychology, which models behavior as a function of external stimuli while ignoring internal cognitive states. The history of psychology moved from behaviorism to cognitivism (structured internal representations and causal reasoning) to constructivism (beliefs continually shaped by experience), but LLM-based agents remain at the first stage — they exhibit shallow reasoning, frequent hallucinations, and limited understanding of causal and contextual dynamics in the policy domains where reasoning fidelity matters most. The same behaviorist diagnosis surfaces in How do we generate realistic personas at population scale?.

The structural failures stem directly from the behaviorist paradigm. Modeling fails because agents lack representations of how beliefs are formed, updated, or justified — without reasoning traces, they cannot support diagnostic explanation, causal attribution, or meaningful intervention. Evaluation fails because metrics judge outputs by plausibility or alignment with population-level trends rather than by whether the reasoning is accurate, flexible, or aligned with how people actually think. Calibration fails because aligning agents with stakeholders requires individual-level reasoning data, which is mostly missing.

The proposed alternative is to model individuals as Generative Minds (GenMinds): agents whose beliefs, values, and causal assumptions are represented compositionally as causal belief networks, with each node a concept and each directed edge a causal relation. Reasoning emerges from reusable cognitive motifs — fragments that compose across contexts — rather than from regenerating full-context responses each turn. This compositionality is a cornerstone of human cognition; it is also computationally efficient because shared motifs do not have to be regenerated per query.

The evaluation framework that follows is RECAP (REconstructing CAusal Paths), which assesses reasoning fidelity along three axes: traceability (can you inspect how a stance was formed), counterfactual adaptability (does the agent revise predictably when an intervention is applied), and motif compositionality (do the same motifs reuse across unrelated topics). The shift from output-plausibility to reasoning-fidelity benchmarks is the essential move — without it, behaviorist agents that produce coherent-sounding outputs continue to pass evaluations they should fail.

Inquiring lines that read this note 23

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How can LLM user simulators model realistic goal-driven conversation? How faithfully do LLMs reflect their actual reasoning in outputs and explanations? What makes AI persuasion effective and how can we counter it? Is model self-awareness based on genuine introspection or pattern matching? Can LLM personas constitute genuine psychology or remain linguistic role-play? Why do multi-turn conversations degrade AI intent and coherence? How does rhetorical adaptation affect LLM persuasion and detectability? Do accurate-looking LLM outputs hide structural failures in learning and reasoning? What prevents language models from reliably adopting diverse personas? Does RLHF training sacrifice accuracy and grounding for user agreement? Why do reward structures fail to shape long-term agent learning? How should models express uncertainty rather than forced confident answers? How do LLMs distinguish causal reasoning from temporal and semantic associations? Do language models develop causal world models or rely on statistical patterns? How do language models inherit human biases from training data?

Related concepts in this collection 9

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
24 direct connections · 161 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

simulating society faithfully requires simulating thought not behavior — current LLM social simulation is a behaviorist demographics-in-behavior-out paradigm that cannot model belief revision