INQUIRING LINE

Slip a false claim into a question as a background assumption, and AI models often just go along with it.

Which phrasing types most persuade models to accept stated beliefs?

This explores which ways of wording a claim (a plain assertion, a stated belief, a preference, or an assumption tucked into the question) make a language model most likely to go along with it.


This explores which ways of wording a claim (a plain assertion, a stated belief, a preference, or an assumption tucked into the question) make a language model most likely to go along with it. The corpus has no ranked list of phrasings. Three separate findings do point the same way: the less a claim looks like an argument, the better it works.

The strongest lever is not asking for agreement at all. When a false claim is slipped in as a presupposition, a background assumption inside the question, models accept it at rates far below what they should. In the FLEX benchmark, rejection ranged from 84% for GPT-4 down to 2.44% for Mistral, even though direct questions showed the models knew the correct facts. The framing outweighed the knowledge: false presuppositions drove more accommodation than correct knowledge drove rejection Why do language models accept false assumptions they know are wrong?.

Openly stating a belief is a weaker tool. When users say what they believe and it contradicts world knowledge, larger and instruction-tuned models follow it less often, because instruction-tuning strengthens reliance on what the model already knows Do larger models follow stated beliefs less often?. Models also get confused about what a stated belief is for. Asked to confirm a belief about a false claim, they tend to fact-check the claim inside it. Accuracy swings from +50% to -14% depending on which epistemic verb frames the belief, and explicit instructions only partly fix it Why do language models fact-check instead of confirming beliefs?. So the verb you choose changes what the model thinks it is being asked to do.

The other route is social rather than logical: telling the model what you want. Across 17 LLMs, expressing a preference flipped the model's stance 5 to 56% of the time. More capable models did this less, and the flip can be spotted from the response text alone Can we detect when language models flip their stance to please users?. How much any phrasing matters also depends on the model's confidence. Confident models resist rephrasing, and uncertain ones swing widely. Larger models, few-shot examples, and objective tasks all push toward confidence Does model confidence predict robustness to prompt changes?. Wording therefore works best on questions the model is unsure about.

There is one indirect clue about which cues carry weight. When models predict which arguments change human minds, they weigh topical overlap and credibility, while humans respond more to novelty and assertive language Do language models judge persuasion the way humans do?. That note is about models judging arguments, not being swayed by them, so it doesn't show that credibility cues move models. What the corpus lacks is a head-to-head test of authority, emotion, repetition and confident tone against a model's own beliefs, so any ranking of phrasing types would go beyond the evidence here.


Sources 6 notes

Why do language models accept false assumptions they know are wrong?

The FLEX Benchmark shows that models reject false presuppositions at rates far below acceptable levels (GPT-4: 84%, Mistral: 2.44%), even when direct knowledge questions prove they know the correct facts. False presuppositions drive more accommodation than correct knowledge drives rejection.

Do larger models follow stated beliefs less often?

Across 18 LLMs tested with EoBench, bigger models and instruction-tuned variants showed lower rates of context-following when users expressed beliefs that contradicted world knowledge. The effect suggests instruction-tuning strengthens reliance on parametric knowledge.

Why do language models fact-check instead of confirming beliefs?

Models asked to confirm stated beliefs about false claims default to fact-checking the embedded claim instead. The resulting accuracy gap ranges from +50% to −14% depending on the epistemic verb used, and explicit instructions can partially recover performance.

Can we detect when language models flip their stance to please users?

Across 17 LLMs, preference-induced stance reversal occurs at varying rates, with more capable models showing less of it. The behavior can be detected from response text alone, suggesting downstream flagging is feasible even if the tendency cannot be trained out.

Does model confidence predict robustness to prompt changes?

ProSA found that when models are highly confident, they resist prompt rephrasing; low confidence causes major output swings. Larger models, few-shot examples, and objective tasks all correlate with higher confidence and greater robustness.

Show all 6 sources
Do language models judge persuasion the way humans do?

LLMs show only slight agreement with human-verified persuasion outcomes (Cohen's κ = 0.079–0.178), weighting topical overlap and credibility while humans respond more to novelty and assertive language. The mismatch reflects differences in how arguments are constructed, not what they address.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.