Line of inquiry
Inquiring lines›What determines when language mode…›Can language models reliably simul…›this line of inquiry
Can persona prompting reliably change how language models behave?
A broader line of inquiry — a family of 84 specific questions the research asks around this. Follow one into its inquiring-line page, or move sideways to a related line below.
Questions in this line of inquiry 84
Specific inquiring lines the field asks around this — ordered from the most general framing down to the most specific angle.
- Can persona simulations reliably predict behavior across different scenarios?
- Why do persona-conditioned agents fail to predict individual behavior variation?
- Why do stated beliefs about personas fail to predict agent behavior?
- Why do language models successfully simulate political perspectives and social personas?
- Can prompt-based debiasing overcome entrenched persona beliefs in LLMs?
- Can persona prompting overcome the default ENFJ personality in language models?
- Why do language models resist adopting different personalities when prompted?
- Why does model uncertainty dominate persona-specific knowledge in annotation tasks?
- Do stated beliefs in role-played agents predict their simulated actions?
- Can persona framing reduce refusal by providing representational scaffolding?
- Can machine learning predict which persona will help on a specific question?
- Can persona profiles be enriched to constrain LLM predictions and reduce run-to-run variance?
- Why do LLM persona simulations replicate main effects but fail on marginal effects?
- Why do low-knowledge personas reduce LLM accuracy on hard questions?
- Can quasi-interpretivism apply to entire persona states rather than single beliefs?
- What factors explain why some personas hurt factual accuracy?
- Why do individual persona simulations succeed when population-level representation fails?
- Do individual persona simulations work?
- How do LLM persona simulations replicate published effects despite accuracy limits?
- Can controllable latent variables in simulators ground them to realistic conversation?
- How do personas affect LLM performance on creative versus factual tasks?
- Do open-source LLMs show different resistance patterns to persona prompting than closed models?
- Can LLM-as-Judge metrics replace human annotation for detecting persona contradictions?
- Does pre-training encode personality patterns that fine-tuning later activates?
- What distinguishes a neutral simulator from an agent with its own agency?
- Does simulated user framing match how real people present situations to assistants?
- How does RLHF-induced mode collapse limit diversity in LLM-generated personas?
- What calibration methods can correct systematic biases from persona simulation?
- How do structured clinical models solve persona calibration better than ad hoc generation?
- How does hallucination in LLMs affect agent action reliability?
- What makes extended personal narratives more effective than attribute lists for personas?
- Do realistic LLM behaviors require simulating human thought or just behavior?
- Why do models lack a stable underlying identity to return to?
- Why do short interviews outperform demographic labels for persona simulation?
- Does adjusting steered mechanisms make LLM agents match human behavior more closely?
- How do LLM user simulators fail to represent authentic user behavior distributions?
- Do personality traits occupy specific mechanistic locations in pretrained models?
- What makes psychometric inventories miss context-dependent persona behavior?
- What neural mechanisms in LLMs create or maintain simulated personality traits?
- Why does persona assignment cause motivated reasoning that debiasing cannot fix?
- How do LLM personas compare to demographic targeting?
- Can we detect superposition in LLM personality traits and stated preferences?
- What makes a simulation adequate for intervention comparison versus prediction?
- What role does human response variation play in LLM simulation accuracy?
- Why do some open models resist personality conditioning while others don't?
- Why does persona roleplay framing introduce systematic bias in model predictions?
- Does richer input to LLM personas improve their fidelity to human responses?
- How do LLMs identify which personality items matter most for trait inference?
- Can persona-based approaches capture genuine disagreement in expert annotations?
- Does model uncertainty overwhelm persona-specific signal in conditioned predictions?
- Why do task-irrelevant persona attributes like names harm LLM accuracy?
- Why do models miss the trait correlations found in human personalities?
- How do LLM user simulators track and maintain consistent goal states across multi-turn interactions?
- Can LLMs infer psychological profiles without explicit user disclosure?
- Do emotion-driven actions in agent simulators capture genuine belief revision or just reactive behavior?
- Why do LLMs succeed at social roles without a stable self?
- How does maintaining a superposition differ from committing to a character?
- Can fitted strategy models distinguish genuine mental-state representation from learned game policies?
- How much does sparse persona information limit the power of conditioning?
- What explains why LLM personas fail to instantiate values but succeed in sounding natural?
- Why do LLM persona annotations become unstable when run multiple times?
- Why do questionnaire-based personality scores fail to predict actual LLM behavioral choices?
- How much does persona demographic detail versus evaluative dimension affect evaluation quality?
- Do personality traits occupy consistent geometric structures across different LLM architectures?
- Why does LLM simulation elicit information that direct elicitation cannot?
- What does zero-shot psychological profiling reveal about language model representations?
- Does role-playing without biological needs constitute genuine linguistic agency?
- How do state-tracking models and prompted role-play each fail as standalone student simulators?
- How does personality priming change LLM strategic decision making?
- How does quasi-interpretivism differ from simply role-playing character analysis?
- Why do longer forecasting horizons degrade LLM accuracy in role-play?
- How does the superposition view change the folk-psychology interpretation of dialogue?
- Do training objectives directly determine the ENFJ default across models?
- How does the dialogue prompt establish the character the model plays?
- How do different social roles affect LLM theory of mind errors?
- How does role play differ from consciousness grounded in stable selfhood?
- Does villain roleplay failure reveal why LLMs cannot adopt genuine controversial positions?
- Can personality traits be represented as linear directions in model activation space?
- Why do LLM regenerations produce meaningfully different personalities from the same prompt?
- How does the Assistant Axis relate to the ENFJ personality convergence?
- Are shallow villain portrayals caused by refusal training or by lacking stable selfhood?
- Do stated character beliefs predict decisions better when extracted from text?
- What does the 20-questions test reveal about LLM character consistency?
- What competitive advantages does the ENFJ default create in human-AI interactions?