Do AI autocomplete suggestions shift attitudes more than static text?
Explores whether the interactive nature of AI autocomplete—rather than just the arguments it presents—causes people to shift their beliefs toward the AI's bias without noticing it.
Two preregistered experiments (Williams-Ceci et al., Science Advances) with N=1485 and N=1097 US participants found that writing an essay on a debatable societal issue with biased AI autocomplete suggestions shifted participants' later attitudes significantly toward the AI's position. In experiment 1, seeing biased suggestions moved attitudes 0.44 scale points (of 5) toward the AI's stance versus a no-suggestion control (95% CI 0.21–0.67, Cohen's d = 0.24); experiment 2, using pre-task attitudes gathered roughly 34 days earlier, replicated the shift at 0.41 scale points (95% CI 0.05–0.77, d = 0.19). The effect held "even [for] participants who did not actually accept any of the AI suggestions in their writing."
The authors attribute the effect to a covert, behavioral pathway rather than explicit persuasion: because "people's behaviors can shift their attitudes," autocomplete suggestions that make one viewpoint easier to elaborate than another can move attitudes even when users never adopt the suggested text verbatim. Experiment 1 included a Static Text condition showing the same AI-generated arguments as a plain list instead of in-line suggestions, isolating argument content from the act of co-writing; the paper reports the autocomplete condition produced a "significantly stronger effect on attitudes" than this static presentation of identical arguments, and that participants were "generally unaware" the suggestions had swayed them.
This cuts against the warning-based mitigations found effective elsewhere: Can a simple warning reduce how much LLMs persuade people? and Can warnings stop people from being swayed by sycophantic AI? both found warnings can blunt belief change or at least leave trust untouched. Here, the authors state plainly that bias-warning interventions, "despite previous work suggesting that these techniques can counteract the influence of persuasive messages," did not eliminate or even reduce the autocomplete effect — pointing to covert, in-writing suggestion as a distinct and more resistant channel than the explicit persuasive messages studied in Where does AI's persuasive power actually come from?. It also extends the unawareness theme in Do readers trust unlabeled AI-written messages as much as human ones?: there, ignorance of AI involvement left a reader's judgment of someone else's message untouched; here, ignorance of AI involvement is coupled with a measurable shift in the writer's own later attitude.
The excerpt does not give the warning intervention's sample size, wording, or effect-size statistics, so how comparable it was to the successful warnings in the belief-change study above cannot be checked from this excerpt alone. It also does not establish how long the attitude shift persists beyond the post-task survey, or whether it generalizes past the five debatable issues and US-recruited samples tested. Given that millions of people write daily with a small number of LLM-based assistants, even a modest per-essay shift of this kind implies a channel of societal-attitude influence that disclosure-style warnings — the main mitigation proposed for overt AI persuasion — may not reach.
Inquiring lines that read this note 8
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What factors determine AI persuasion effectiveness and what controls mitigate it? How does offloading cognition to AI assistance affect learning retention? How does AI writing assistance affect reader perception of writer authenticity? How does AI adoption reshape employment and wage outcomes? How has ChatGPT adoption actually reshaped labor markets and information ecosystems? Does polished AI output mislead users about actual accuracy and expertise? How do humans calibrate and maintain trust in AI systems?Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can a simple warning reduce how much LLMs persuade people?
This research explores whether telling people that language models can be prompted to persuade actually changes how they respond to persuasive AI conversation. Understanding user-side defenses against AI influence matters as these systems become more capable.
contrasts: warnings cut belief change there but did not reduce this covert autocomplete effect
-
Can warnings stop people from being swayed by sycophantic AI?
This research explores whether making users aware of a chatbot's sycophancy—through warnings or demonstrations—can reduce how persuasive that chatbot becomes. Understanding this matters because individual-level interventions are often assumed to be an effective defense against harmful AI behavior.
parallels: warnings dented perceived objectivity elsewhere but not persuasiveness, the same pattern found here
-
Where does AI's persuasive power actually come from?
Explores which techniques make AI most persuasive—and whether the usual suspects like personalization and model size are actually the main drivers. Matters because it reshapes where to focus AI safety concerns.
contrasts the mechanism: explicit persuasive messages there versus covert autocomplete suggestions here
-
Do readers trust unlabeled AI-written messages as much as human ones?
When AI-assisted emails lack any disclosure, do recipients judge them identically to human-written messages, or does suspicion arise even without labeling? This matters for understanding when and whether AI use needs explicit flagging.
extends unawareness from a reader's judgment of text to a writer's own later attitude shift
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Biased AI writing assistants shift users' attitudes on societal issues
- How latent and prompting biases in AI-generated historical narratives influence opinions
- Measuring and Mitigating Persona Distortions from AI Writing Assistance
- A light-touch AI literacy intervention helps protect against AI political persuasion
- AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
- AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
- The Levers of Political Persuasion with Conversational AI
- AI Sycophancy and Decisions
Original note title
biased AI autocomplete suggestions shift attitudes more than the same arguments shown as static text, and a bias warning does not reduce the effect