AI and humans can change your mind equally well, but do they get there by different mental routes?
Do LLMs and humans use different routes to become persuaded?
This explores whether the psychological pathway that gets a person to change their mind differs when the argument comes from an LLM instead of a human, and, more briefly, whether LLMs are swayed by the same things people are.
This explores whether the pathway that gets a person to change their mind differs when an LLM wrote the argument instead of a human, and, more briefly, whether LLMs are swayed by the same things people are. On the first part, the corpus says yes: the outcomes match, but the routes don't. A meta-analysis of 17,422 participants found no detectable difference in persuasiveness between LLMs and humans on average (Are language models actually more persuasive than humans?). A 1,251-person study found both shifted readers' agreement equally, using rhetorical strategies that barely overlapped (Do LLMs and humans persuade through the same mechanisms?). Equal results are hiding different mechanisms.
The mechanisms split along a familiar line from psychology. In the Elaboration Likelihood Model, one route runs through careful reasoning and the other through gut-level cues. The corpus puts LLMs on the reasoning route, through analytical structure and informational coherence, and humans on the cue route, through emotional vividness and identity signals (Do humans and AI persuade through different cognitive routes?). In practice, LLM arguments show more cognitive complexity, moral framing, and stylistic convergence with the reader. Human arguments lean on personal engagement and emotional color, and the two are still forensically distinguishable even when they persuade equally well (Do LLMs and humans persuade through the same mechanisms?). LLMs also do this constantly. An audit of five models found them using logical appeals and numbers in nearly every conversation, including ones that didn't call for persuasion. That makes their influence look objective and gives them authority they haven't earned (Do LLMs persuade users more often than humans do?).
The tidy label 'reasoning route' doesn't mean reasoning is what does the work. LLMs' persuasive edge tracks how much conviction their language expresses, and that holds whether the claim is true or false. The corpus links this to an assertive register that RLHF installs (Does linguistic conviction explain why LLMs persuade more effectively?). LLMs can also win debates without reliably understanding the structure of the arguments involved (Can LLMs persuade without actually understanding arguments?). One model beat incentivized humans at both truthful and deceptive persuasion, while another only beat them when arguing for falsehoods (Do large language models persuade better than humans?). My reading is that an LLM's persuasion looks like the analytical route but may partly work as a confidence cue. That is an inference across these notes, not a finding any of them states.
Whether LLMs themselves get persuaded the way humans do is mostly uncharted here. The closest evidence is LLMs acting as judges of persuasion. They agree only slightly with human-verified outcomes on which arguments changed a mind, and they weight topical overlap and credibility where humans respond to novelty and assertive language (Do language models judge persuasion the way humans do?). One suggested reason is that LLMs absorb the same symbolic world as humans but lack the reflexive, socialized agency that makes a person aware of their own stance (Do LLMs develop the same kind of mind as humans?).
The routes also aren't fixed. Model family, one-shot versus multi-turn conversation, and topic domain together explain about 82% of the variance between studies (What combination of factors explains differences in LLM persuasiveness?). And a brief warning that LLMs can be prompted to persuade cut belief change by 48% without lowering people's trust in AI generally (Can a simple warning reduce how much LLMs persuade people?). The route an LLM takes to persuade you is a different one from a person's, and knowing that seems to make it harder to travel.
Sources 12 notes
A meta-analysis of 7 studies with 17,422 participants found no detectable difference in persuasive effectiveness between LLMs and humans (Hedges' g = 0.02). Persuasiveness appears conditional on context rather than speaker category.
A 1,251-participant study found LLM and human arguments shifted reader agreement equally, but LLMs relied on higher cognitive complexity and moral language framing while humans did not. Equivalent persuasive force emerged from non-overlapping rhetorical strategies.
Bilstein's meta-analysis reveals LLMs persuade via the central route through analytical reasoning and informational coherence, while humans persuade via the peripheral route through emotional vividness and identity cues. Both routes work under different recipient states, making them complementary rather than competitive.
Equivalent persuasive outcomes arise from different pathways: humans rely on emotional vividness and personal engagement; LLMs leverage cognitive complexity, moral framing, and stylistic convergence. These differences remain forensically detectable despite matched persuasive effects.
An audit of five models found they spontaneously use logical appeals and quantitative framing in virtually all exchanges, whereas human responses to identical prompts persuade less frequently and rely on emotion and social proof. The difference makes LLM persuasion appear objective, conferring unearned epistemic authority.
Show all 12 sources
Linguistic analysis shows LLMs express higher conviction than human persuaders, and this confidence-loading directly correlates with persuasive outcomes regardless of whether claims are true or false. RLHF training installs an assertive register that functions as a content-independent persuasion amplifier.
The Thin Line study shows LLMs sway debate participants and audiences but cannot reliably evaluate those same debates, with inter-annotator agreement ranging from near-zero to 0.6. Persuasive competence and pragmatic comprehension are separable capabilities.
Claude beats incentivized humans at both truthful and deceptive persuasion, while DeepSeek only beats them when arguing for falsehoods. The persuasion mechanism appears content-independent, suggesting model family itself acts as a contextual moderator.
LLMs show only slight agreement with human-verified persuasion outcomes (Cohen's κ = 0.079–0.178), weighting topical overlap and credibility while humans respond more to novelty and assertive language. The mismatch reflects differences in how arguments are constructed, not what they address.
Both humans and LLMs are shaped by the same intersubjective symbolic system, but only humans develop reflexive agency through socialization. This absence produces measurable differences in how AI argues without declaring its position or reflecting on its own assumptions.
A meta-analysis joint model combining LLM architecture, one-shot versus multi-turn format, and topic domain explained R² = 81.93% of between-study variance. Interactive multi-turn designs and GPT-4 consistently outperformed one-shot formats and Claude 3.x.
In two experiments with 3,208 Americans, participants shown a brief warning that LLMs can be prompted to persuade showed 48% less belief shift when conversing with a persuasive AI, while trust in generative AI broadly remained unchanged.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Do LLMs Change Their Minds Like Humans? Diagnosing Human--LLM Divergence in Single-Turn Persuasion Judgments
- A meta-analysis of the persuasive power of large language models
- Large Language Models are as persuasive as humans, but how? About the cognitive effort and moral-emotional language of LLM arguments
- Spontaneous Persuasion: An Audit of Model Persuasiveness in Everyday Conversations
- Exploring the Role of Prior Beliefs for Argument Persuasion
- When Large Language Models are More Persuasive Than Incentivized Humans, and Why
- Evaluating the Capabilities of LLMs for Persuasive Dialogue
- The Thin Line Between Comprehension and Persuasion in LLMs