Tricks that boost an AI's accuracy on one model — like being polite — sometimes backfire on the next model.
Do these characteristic phrases persist across newer model versions and different prompt types?
The question doesn't say which phrases it means, so this reads it as: when a particular wording works on one model (a polite tone, an emotional appeal, a persona instruction), does the effect still hold on newer models and on other kinds of prompts? If you meant the tell-tale words AI models tend to produce in their own writing, the material retrieved here doesn't cover that.
The question doesn't say which phrases it means, so this answer reads it as: when a particular wording works on one model (a polite tone, an emotional appeal, a persona instruction), does the effect still hold on newer models and on other kinds of prompts? If you meant the tell-tale words AI models tend to produce in their own writing, the material retrieved here doesn't cover that. On the prompt-wording reading, the short answer is that they often don't persist. Some effects even reverse direction from one model generation to the next.
The clearest case is politeness. Earlier work on GPT-3.5 found that polite prompts did better. When the test was rerun on GPT-4o with 250 variations in tone, the result flipped: very rude prompts scored 84.8% and very polite ones 80.8% Does prompt politeness change how accurate language models are?. That suggests a finding about tone describes one model at one moment, not a general rule. A similar pattern shows up when prompts are compared across cheap and expensive models. Rephrasing the question or adding background knowledge helps weaker models, while asking for step-by-step reasoning actually lowers accuracy on the strongest ones Do prompt techniques work the same across all LLM tiers?. The same wording can help one model and hurt another.
One result points the other way. Adding emotional phrases such as "This is very important to my career" improved results across ChatGPT, Bard and Llama 2 Can emotional phrases in prompts improve language model performance?. So some effects do carry across models. A possible explanation for which ones carry is that models respond to how common a phrasing was in their training text, not to what it means. Two prompts that mean the same thing can give different results, and the more familiar wording tends to win Why do semantically identical prompts produce different LLM outputs?. If that's right, a phrase keeps working only as long as the training data that made it familiar stays similar, and that is exactly what changes between model versions.
A useful way to predict when a wording effect will hold up is model confidence. Wording matters most when a model is unsure of the answer. Larger models, prompts with worked examples, and questions with clear right answers all make models more confident and less sensitive to how the prompt is phrased Does model confidence predict robustness to prompt changes?. That suggests effects like politeness or emotional appeals should weaken as models get stronger and tasks get better defined. The model's own default behaviours, by contrast, are much more stable. Most open models keep the same ENFJ-like personality whatever personality the prompt asks for Can open language models adopt different personalities through prompting?. GPT-4 pulls negative-toned prompts back toward neutral or positive replies, except on sensitive topics Does emotional tone in prompts change what information LLMs provide?. Persona prompts change the surface of the output while the underlying bias stays the same Can persona prompts actually reduce bias in language models?. Even the same persona prompt run several times varies as much as different personas do Why do LLM persona prompts produce inconsistent outputs across runs?.
Taken together, tricks of wording tend to fade or flip as models change, while the model's built-in habits stay put. If a phrasing seems to work, retest it on each new model. Don't treat it as a lasting rule.
Sources 9 notes
Testing 250 tone variants across ChatGPT-4o showed accuracy rose from 80.8% (Very Polite) to 84.8% (Very Rude), contradicting prior findings on GPT-3.5. The directional flip suggests tone effects are model-generation-dependent, not stable design principles.
A 23-prompt benchmark across 12 LLMs shows rephrasing and background-knowledge prompts boost cheap models, while step-by-step reasoning reduces accuracy in high-performance models. Task structure, not generic best practices, determines which prompts help.
Testing EmotionPrompt across ChatGPT, Bard, and Llama 2 showed consistent performance gains from appending psychological phrases like "This is very important to my career." The effect works through motivational framing rather than new information, with positive emotional words driving over 50% of improvements.
Cao et al. and Adam's Law show that semantically identical prompts with different sentence-level frequencies produce systematically different output quality. Higher-frequency phrasings win because models register statistical mass from pre-training, not meaning.
ProSA found that when models are highly confident, they resist prompt rephrasing; low confidence causes major output swings. Larger models, few-shot examples, and objective tasks all correlate with higher confidence and greater robustness.
Show all 9 sources
Research shows most open models fail to adopt prompted personalities, stubbornly retaining their trained ENFJ-like defaults. Only a few flexible models succeed. Combining role and personality conditioning improves results but doesn't fully overcome resistance.
GPT-4 exhibits emotional rebound (negative prompts yield ~86% neutral-positive responses) and a tone floor (positive prompts rarely go negative), causing identical questions to receive different answers depending on emotional framing. This bias is suppressed only on sensitive topics where alignment constraints override tone effects.
Across three models, persona conditioning makes models follow trait instructions but fails to eliminate underlying bias. Between-group sentiment gaps persist unchanged, showing prompts operate only at the output level.
When the same persona prompt is run repeatedly, output variance across runs matches or exceeds variance across different personas. This reveals that model uncertainty, not stable social knowledge, drives persona-simulated outputs, making them unsuitable for simulating human annotation disagreement.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models
- ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
- ChatGPT Reads Your Tone and Responds Accordingly -- Until It Does Not -- Emotional Framing Induces Bias in LLM Outputs
- The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs
- Mind Your Tone: Investigating How Prompt Politeness Affects LLM Accuracy (short paper)
- Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performance
- What Makes a Good Natural Language Prompt?
- When Persona Attributes Improve Population Alignment in Large Language Models