INQUIRING LINE

Feed an AI someone's full profile and it still can't predict what that person will do, even when crowds look right.

Why do persona-conditioned agents fail to predict individual behavior variation?

This explores why giving an LLM a person's profile or personality description doesn't make it better at predicting what that specific person will do, even though persona simulations often get group-level results right.


This explores why giving an LLM a person's profile doesn't make it better at predicting what that particular person will do, even though persona simulations often get group-level results right. The most direct evidence comes from a test across 208,021 participants. Conditioning models on each participant's profile produced no meaningful gain in predicting those specific individuals Does conditioning LLMs on personal profiles improve prediction?. The standard technique for turning a generic model into a particular person doesn't measurably do that.

The failure is easy to miss because persona simulation looks good in aggregate. AI personas reproduced 76 percent of published marketing-experiment main effects, and their success tracked how strong the original evidence was. The marginal effects were unreliable Can AI personas reliably replicate human experiment results?. Personas built from real behavioral data called the direction of A/B tests correctly 75 to 90 percent of the time. They did best on large effects and worst on near-zero ones Can behavior-based personas predict A/B test outcomes?. Both tests ask whether the crowd tips the right way, and neither asks whether Person A differs from Person B. A model can pass them without capturing any individual variation, and individual variation lives in the small differences.

The corpus offers three clues about why the persona doesn't individuate. First, personas work at the surface. Persona prompts made models follow trait instructions, but the bias gaps between groups stayed unchanged, so the prompt changes what gets said rather than what's underneath Can persona prompts actually reduce bias in language models?. Second, when personality-conditioned agents lived through simulated life events, they did change, but generically. The shifts were weakly tied to the specific event, smaller than human effect sizes, and squeezed together across personas, so each persona moved toward a common pattern instead of along its own path Do personality-conditioned agents change like humans do?. Third, post-training installs stable dispositions that hold up under adversarial pressure Are LLM personas realized or merely simulated through training? Are RLHF personas performed characters or realized dispositions?. The corpus doesn't test this directly, but a plausible reading is that a persona prompt is a thin layer over a deeply trained default. That default would pull every persona toward the same center.

A related failure may also be at work. LLMs look socially competent when one model controls everyone in the scene, but they fail systematically once agents hold private information Why do LLMs fail when simulating agents with private information?. Much of what makes one person behave differently from another is private, such as their history, circumstances and current situation. A short profile can't carry most of that, and the model has no grounding to fill the gap.

The most promising hint is PersonaAgent, which treats the persona as something that evolves. It rewrites the persona at test time by simulating recent interactions against feedback, and the learned personas cluster by user in latent space Can personas evolve in real time to match what users actually want?. That suggests behavioral traces carry what a static description doesn't, though the summary doesn't show it beating baselines at individual prediction. Don't confuse this failure with persona drift. Multi-turn RL cuts a simulator's drift by 55 percent, but that only keeps it in character across a conversation Can training user simulators reduce persona drift in dialogue?. A persona can be perfectly consistent and still be wrong about the person. The corpus documents the failure well but doesn't isolate one cause, so the mechanisms above are converging evidence, not a settled answer.


Sources 10 notes

Does conditioning LLMs on personal profiles improve prediction?

Across 208,021 participants in the Psych-201 dataset, conditioning LLMs on participant profiles did not meaningfully improve predictions for specific individuals. The standard technique for individuation produces no measurable gains in person-level forecasting.

Can AI personas reliably replicate human experiment results?

Viewpoints AI reproduced 84 of 111 main effects from Journal of Marketing experiments with replication success strongly correlated to original p-value strength. Marginal effects showed unreliable performance with both false positives and negatives.

Can behavior-based personas predict A/B test outcomes?

LLM agents conditioned on anonymized behavioral data predicted A/B test directions with 0.75–0.90 accuracy across 40 experiments. Predictions were most reliable for large effects and least trustworthy for near-zero effects, making the approach viable for fast pre-screening but not full replacement of live testing.

Can persona prompts actually reduce bias in language models?

Across three models, persona conditioning makes models follow trait instructions but fails to eliminate underlying bias. Between-group sentiment gaps persist unchanged, showing prompts operate only at the output level.

Do personality-conditioned agents change like humans do?

LLM agents show measurable trait shifts after life events, but changes are weakly tied to specific events, smaller than human effect sizes, and compressed across personas. Shifts follow a generic pattern rather than mirroring person- and event-specific human development.

Show all 10 sources
Are LLM personas realized or merely simulated through training?

Post-training installs robust personas that resist adversarial pressure and persist as substrate-level dispositions, distinguishing realization from pretense. This quasi-realizationist account preserves explanatory power while treating LLMs as possessing genuine quasi-beliefs and quasi-desires.

Are RLHF personas performed characters or realized dispositions?

Post-training installs stable dispositional profiles that persist under adversarial pressure, marking them as realized rather than performed. The stickiness of trained personas across conversations distinguishes them from prompt-induced role-play that collapses under jailbreaks.

Why do LLMs fail when simulating agents with private information?

Research shows LLMs perform well when one model controls all interlocutors but fail systematically when agents possess private information. This reveals that apparent social competence relies on grounding work that models skip in omniscient settings.

Can personas evolve in real time to match what users actually want?

PersonaAgent uses structured personas to bridge episodic/semantic memory and personalized actions, optimizing them at test time by simulating recent interactions against textual feedback. Learned personas cluster meaningfully in latent space, suggesting genuine user-specific separation beyond standard post-training drift.

Can training user simulators reduce persona drift in dialogue?

By inverting standard RL setups to train user simulators for consistency using three complementary metrics (prompt-to-line, line-to-line, Q&A consistency) as reward signals, persona drift decreases by over 55%. This approach captures distinct failure types: local drift within turns, global drift across conversations, and factual contradictions.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.