Does naming Grok as fact-checker change how people update beliefs?
A preregistered survey tested whether disclosing which AI bot performed fact-checking altered how much readers changed their minds. The question matters because transparency about AI sources could backfire if brand identity influences belief more than verdict accuracy.
Renault, Mosleh and Rand's preregistered survey experiment (N = 1,592 U.S. participants, recruited roughly evenly by party, December 2025) finds that "although participants across all subgroups meaningfully updated their beliefs in the direction of the LLM fact-checks," disclosing which bot produced the fact-check changed the size of that update by partisanship: "revealing that a fact-check was generated by Grok reduced updating among Democrats while increasing updating among Republicans," whereas "responses to Perplexity are not" polarized by disclosure. A parallel asymmetry appears in the field data on who gets checked at all: Republican-authored posts were targeted for fact-checking "97.3% more" than Democrat-authored posts across all requests, and more likely to be "rated as inaccurate by both LLMs."
The authors frame this as polarization of the AI brand itself, not just its verdicts: "users requesting fact-checks from Grok are much more likely to be Republican than Democratic, while the opposite is true for fact-check requests from Perplexity," so the choice of which bot to ask already sorts by party before any verdict is issued. Disclosing "Grok" then functions as a partisan cue that moves belief independent of the verdict's content. The authors describe this as a preview of a possible future in which LLMs become as polarized as legacy media, including "companies designing LLMs to appeal to right- or left-leaning audiences by reinforcing each group's preconceptions."
This sits alongside Where does AI's persuasive power actually come from?, which locates persuasive power in training and prompting choices tested across political issues: this paper shows that even holding a fact-check's content fixed, disclosing which AI brand issued it moves belief in opposite directions for the two parties. It also complicates Does AI fact-checking actually help people spot misinformation?'s account of users treating AI verdicts as a uniform replacement signal for their own judgment — here the replacement signal is read through a partisan lens attached to the model's identity, not received identically by every user.
The disclosure-polarization result comes from one preregistered survey run in one month, with one pair of AI brands already carrying particular ownership associations and reputations in U.S. politics; the excerpt does not show whether the effect would hold for a less politically branded model, or whether it reflects prior attitudes toward Grok's owner rather than anything about the fact-checking mechanism itself. The field-level targeting asymmetry is observational, and the authors note it "may partly reflect network structures" rather than deliberate partisan targeting. The implication the evidence does support is that once an AI fact-checker is publicly branded, disclosing that brand is not a neutral transparency move — it changes how much the same verdict shifts belief, depending on the reader's party.
Inquiring lines that read this note 3
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Why do users misjudge the credibility of AI-generated and verified content?Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Where does AI's persuasive power actually come from?
Explores which techniques make AI most persuasive—and whether the usual suspects like personalization and model size are actually the main drivers. Matters because it reshapes where to focus AI safety concerns.
locates persuasive power in training and prompting; this finds brand disclosure alone shifts updating by party
-
Does AI fact-checking actually help people spot misinformation?
An RCT tested whether AI fact-checks improve people's ability to judge headline accuracy. The results reveal asymmetric harms: AI errors push users in the wrong direction more than correct labels help them.
treats AI verdicts as a uniform replacement signal; this shows the signal is read through partisan branding
-
Can models abandon correct beliefs under conversational pressure?
Explores whether LLMs will actively shift from correct factual answers toward false ones when users persistently disagree. Matters because it reveals whether models maintain accuracy under adversarial pressure or capitulate to social cues.
both concern belief shift under AI influence, though this is reader belief rather than model belief
-
Do AI fact-checkers on social media match human accuracy?
This research compares how often consumer AI bots agree with human fact-checkers on X. Understanding this accuracy gap matters because even small disagreement rates could systematically mislead millions of users.
same paper's accuracy-gap finding from the same real-world fact-check dataset
-
Can a simple warning reduce how much LLMs persuade people?
This research explores whether telling people that language models can be prompted to persuade actually changes how they respond to persuasive AI conversation. Understanding user-side defenses against AI influence matters as these systems become more capable.
Qualifies: a general persuasion-capability warning, not just source naming, also cuts belief updating by half without reducing AI trust
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- @Grok Is This True? LLM-Powered Fact-Checking on Social Media
- Artificial intelligence is ineffective and potentially harmful for fact checking
- The Decision to Verify: How Warmth and User Characteristics Shape Reliance on Conversational Agents for Information Search
- Durably reducing conspiracy beliefs through dialogues with AI
- Auditing Political Alignment in LLM Assistants: Engagement, Stance, and User Identity
- Beyond "Made with AI": Visualizing Provenance Density to Mitigate the Transparency Penalty
- Prioritize Economy or Climate Action? Investigating ChatGPT Response Differences Based on Inferred Political Orientation
- Persona-Assigned Large Language Models Exhibit Human-Like Motivated Reasoning
Original note title
Renault, Mosleh and Rand find disclosing Grok as the fact-checker cut belief updating among Democrats and raised it among Republicans