Do audience-framed prompts work better than speaker-framed prompts?
Explores whether telling a language model whom it's addressing (versus assigning it a role) produces more accurate factual answers. Matters because prompt structure might matter more than persona content.
Beyond which persona is named, the paper tests how the persona is framed. It defines two prompt types: a "Speaker-Specific Prompt" that assigns the role to the model itself ("You are a lawyer"), and an "Audience-Specific Prompt" that assigns the role to whoever the model is addressing ("You are talking to a fireman"), alongside a no-persona control and an "Imagine"-prefixed paraphrase of each as a robustness check. Running a mixed-effects model on accuracy by prompt type, with a random effect per model, the authors report that "audience-specific prompts perform better than speaker-specific prompts, and the difference is statistically significant," while cautioning that "the effect size is relatively small, suggesting that different framings of the prompt have limited impacts on model performance."
The paper does not offer a causal account of why addressing the model's imagined audience outperforms assigning the model an identity; it reports the regression result (Figure 3) without further decomposition. The framing is measured inside the same experimental pipeline as the paper's broader persona analysis — 162 roles, 2,410 factual questions, nine models from four families — so the effect holds under the same conditions as the paper's headline null result on persona identity.
The finding is a secondary result inside Do personas in prompts actually improve LLM factual accuracy?, which establishes that no persona identity reliably beats the no-persona control and that persona effects are largely unpredictable; this result instead concerns prompt structure (who is addressed) rather than persona content (who is named), and is one of the few effects in the paper's analysis that reaches significance rather than washing out. It is a narrower, structural counterpart to Do expert personas actually improve LLM factual accuracy?, which varies the named role's domain expertise rather than the grammatical frame of address — together the two notes suggest that how a system prompt addresses its subject may matter slightly more than who it names.
The effect is explicitly described as small, and the paper does not report the raw accuracy difference between the two framings, only that a mixed-effects regression coefficient is statistically significant; nor does it test whether the audience-framing advantage holds for subjective tasks, longer conversations, or models outside the nine tested here. The result should be read as a minor, significant-but-small structural signal inside a study whose larger point is that persona content does not reliably help — not as a standalone prompting technique with a demonstrated practical effect size.
Inquiring lines that read this note 5
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What can prompting techniques actually accomplish in language models? How do prompt design choices and framing measurably influence model outputs?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Do personas in prompts actually improve LLM factual accuracy?
This research explores whether adding personas to system prompts—a popular technique—genuinely boosts how well language models answer factual questions, and whether we can predict which persona will help.
the same study's headline null result on persona identity, of which this framing effect is a smaller, secondary finding
-
Do expert personas actually improve LLM factual accuracy?
Persona prompting is widely recommended by major AI labs, but does assigning expert roles reliably boost performance on hard factual questions? Testing across models and datasets reveals the gap between best-practice advice and real-world results.
a narrower test of the same "assign-a-role" guidance, varying persona content rather than framing
-
Do pretrained models simulate humans better than instruction-tuned assistants?
This research explores whether instruction-tuned assistant models degrade human simulation accuracy through their post-training optimizations, and whether binding pretrained models to dialog samples offers a more faithful alternative.
Qualifies: instruction-tuned models prompted with personas, as in A, simulate humans less accurately than pretrained base models, per B
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models
- Prompting Science Report 4: Playing Pretend: Expert Personas Don't Improve Factual Accuracy
- Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performance
- MOMENTS: A Comprehensive Multimodal Benchmark for Theory of Mind
- The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs
- When Persona Attributes Improve Population Alignment in Large Language Models
- What Makes a Good Natural Language Prompt?
- Better Zero-Shot Reasoning with Role-Play Prompting
Original note title
audience-specific prompts outperform speaker-specific prompts on factual questions with a small but significant effect