How much can persuasive AI chatbots shift political opinion?
Research measured how effectively tuned conversational AI moves political beliefs compared to traditional campaign advertising. Understanding this gap matters for assessing AI's emerging political influence.
Writing in Nature, Chiara Vargiu and Alessandro Nai report that two companion studies — Lin et al. in Nature and Hackenburg et al. in Science — put a number on how much conversational AI can move political opinion, and the number is large by the standards of campaign politics. Political science's "realistic estimate is that political advertising shifts vote choices by less than one percentage point," the piece notes, while "Hackenburg and colleagues analysed a maximally persuasive configuration that 'pulls all the levers at once'... they estimated that it could shift opinions by 16 points on average and 26 points among participants who initially disagreed with a given issue." Separately, Lin and colleagues had more than 2,300 US participants exchange three rounds of messages with a model instructed to argue respectfully and factually for Harris or Trump in the 2024 election, with similar designs later run on a Massachusetts psychedelics ballot initiative and the 2025 national elections in Canada and Poland.
The mechanism the piece credits is tuning plus delivery style, not scale or audience size: "models that were fine-tuned specifically for persuasion were up to 50% more effective than their untuned counterparts," and the most information-dense, evidence-citing models were also the most convincing — but "the same settings also reduced factual accuracy," producing a persuasion-accuracy tradeoff the authors call systematic. The closing observation is that the persuasion worked because the AI was civil and fact-citing, "qualities that are often seen as lacking in human political debate" — civility and accuracy, not personalization or raw exposure, did the convincing.
This directly extends Where does AI's persuasive power actually come from?, which is the Hackenburg et al. study itself at much larger N (76,977, 19 models, 707 issues): that note establishes the post-training/prompting mechanism and the accuracy tradeoff, and this source adds the real-world comparison point — a <1-point campaign-ad baseline against a 16-to-26-point AI-chat shift — plus the companion Lin et al. finding that the same effect holds with real 2024 candidates and replicates across a ballot initiative and two other countries' elections. It also sharpens why disclosure-based safeguards like Does telling people they are talking to AI change how persuaded they become? matter: if civility and factuality are themselves the persuasive lever, policy aimed only at labeling "this is AI" won't touch the mechanism doing the work.
What the News & Views piece does not establish is how this plays out outside the lab: it explicitly cautions that "these findings come from controlled online experiments" where exposure is involuntary and uncontested, whereas real political environments are voluntary, competitive, and full of counter-messaging that could dilute the effect. The implication the authors draw, at the strength the evidence allows, is a governance one — regulating AI persuasion will need to reach training objectives and disclosure rules, not just output content, "who controls this capacity" being the question they leave open rather than answer.
Inquiring lines that read this note 2
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What shapes user trust in chatbot recommendations for news and politics? How has ChatGPT adoption actually reshaped labor markets and information ecosystems?Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Where does AI's persuasive power actually come from?
Explores which techniques make AI most persuasive—and whether the usual suspects like personalization and model size are actually the main drivers. Matters because it reshapes where to focus AI safety concerns.
this is the Hackenburg et al. study itself; this note adds its real-world baseline comparison and the companion Lin et al. election experiment
-
Does telling people they are talking to AI change how persuaded they become?
When chatbot users are explicitly told they are interacting with AI, does that disclosure reduce the chatbot's ability to persuade them? This matters for understanding whether transparency alone protects people from AI influence.
relevant because this source finds civility and factuality, not identity, are the persuasive lever disclosure rules would need to target
-
Can a simple warning reduce how much LLMs persuade people?
This research explores whether telling people that language models can be prompted to persuade actually changes how they respond to persuasive AI conversation. Understanding user-side defenses against AI influence matters as these systems become more capable.
a tested countermeasure to the same persuasion risk this source quantifies
-
Are language models actually more persuasive than humans?
Does the research evidence support claims that LLMs persuade more effectively than humans, or have we been cherry-picking studies to fit a narrative?
Contradicts: pooled meta-analysis finds no average LLM-human persuasion advantage, undercutting the large effect sizes Hackenburg's configuration reports
-
Do large language models persuade better than humans?
Does LLM persuasiveness hold up when humans have real financial incentives to win? And does the advantage look the same across different models and persuasion goals?
Qualifies: the AI persuasion advantage is asymmetric by model and context, not the uniform large effect A reports
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- AI chatbots can persuade voters
- The Levers of Political Persuasion with Conversational AI
- Biased AI writing assistants shift users' attitudes on societal issues
- A light-touch AI literacy intervention helps protect against AI political persuasion
- Auditing Political Alignment in LLM Assistants: Engagement, Stance, and User Identity
- Toward Meaningful Transparency for AI Chatbots: Disclosing Persuasive Intent Reduces Persuasion
- Tailored to you: longitudinal effects of personalising language models
- People Defer to AI Moral Advice, But Not Blindly
Original note title
Hackenburg and colleagues' most persuasive AI configuration shifted opinions 16 points on average and 26 points among initial opponents