Do reader judgments reflect actual authorship or just their beliefs?
When readers evaluate research abstracts, do their ratings track who actually wrote them, or are they shaped by what they believe about authorship—even when those beliefs are wrong?
Akpinar et al. report that "participants' beliefs about authorship shaped their evaluations even when inaccurate." The study separates two conditions. In the guess condition, readers estimate the degree of LLM involvement with no authorship information. In the information condition, the authorship of each abstract is disclosed. Disclosure is the second finding: "Across all abstract types, disclosure consistently elevated ratings of trust and quality." Readers "expressed neutrality when guessing but reported positive trust once authorship was revealed; even for fully LLM-generated texts."
The excerpt's account of the belief effect runs through prior assumptions. Readers start with "a baseline suspicion that LLMs were involved across all abstracts," and the authors set their results beside a human preference bias that Porter and Machery report, in which readers "judge LLM-generated works as human more often than the reverse." The ratings are Likert scales on information quality and trust, plus free-text reasons. The excerpt does not explain why disclosure raised ratings: the authors say the phenomenon is "discussed further in Section 5.3," which is not in the excerpt. Their stated reading is that disclosure "may have a more substantial impact on how readers judge trustworthiness and information quality" than abstract type does.
The disclosure result is a stated contrast. The authors write that it "contrasts the findings of prior work demonstrating decreases in credibility and quality judgments after AI use has been disclosed." That places it against the question in Does banning LLM use in peer review change review outcomes?: there, rules about LLM use barely moved reviewer scores, while here, information about authorship moved reader ratings. The two studies differ in population, outcome and manipulation, so they measure different things; the useful contrast is which lever moved judgment. The reader-side view is also consistent with Do writers want to see each other's AI prompts in shared editors?: if disclosure moves readers' ratings, writers' wish for visibility into AI use has a reason beyond their own workflow. The excerpt does not test writers.
The excerpt does not establish why disclosure raises ratings, since the explanation sits in Section 5.3, which is absent here. It gives no sample size, and its measures are self-reported ratings and stated preferences, not behavior. It therefore shows how readers rate abstracts under one disclosure label, not how they would act on that label in a journal or a review. At this strength, the implication is that disclosure is not a neutral act for readers: in this design, the label changed ratings. Disclosure rules should be tested with readers rather than taken from the prior-work penalty, which this study does not reproduce.
Inquiring lines that read this note 10
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How should human-AI contributions be measured, disclosed, and verified? Can AI systems perform peer review as effectively as humans?- How much do reviewer scores shift when manuscript framing changes but findings stay the same?
- Does presentation style bias how evaluators judge scientific methods and results?
- What makes rhetorical polish misleading in evaluating research quality?
- Can writers claim authorship without feeling cognitive ownership of the work?
- Do writers claim authorship without feeling they wrote the words?
- Do writers experience felt authorship differently from authorship they claim?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can readers tell LLM abstracts from human ones?
Do readers with ML expertise reliably distinguish human-written, LLM-generated, and LLM-edited research abstracts? Understanding this matters for evaluating whether readers can serve as effective gatekeepers against LLM content.
sibling note from the same survey: identification and clarity findings; this note covers belief and disclosure.
-
Does banning LLM use in peer review change review outcomes?
Can policies restricting or allowing AI tools shift how reviewers score papers and make decisions? This matters because review quality and fairness depend on consistent standards.
contrast: LLM-use rules barely moved reviewer scores there; authorship disclosure moved reader ratings here.
-
Do writers want to see each other's AI prompts in shared editors?
This study explores whether revealing AI prompting activity to collaborators in text editors affects how writers work together. Understanding prompt visibility matters because it shapes trust, learning, and awareness of AI's role in collaborative writing.
writer-side wish for visibility into AI use; this excerpt shows disclosure changing readers' ratings.
-
Does disclosing AI assistance make readers trust articles less?
When articles carry a label saying they used AI tools, do human and AI raters downgrade their quality assessments? This matters because writers worry disclosure could harm how their work is received.
Qualifies: for a human-written news article, AI disclosure lowered human and LLM raters' scores, by under 0.15 points on a 7-point scale
-
How does revealing AI authorship change reader trust?
When readers learn that AI wrote part of a text, do they trust the author less? This study tested whether disclosure of AI involvement shifts how readers judge an author's trustworthiness, caring, and likability across different types of writing.
Qualifies: AI disclosure eroded perceived trust and likability most steeply in interpersonal writing, so the abstract trust gain may not generalize
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- LLM or Human? Perceptions of Trust and Information Quality in Research Summaries
- Understanding Reader Perception Shifts upon Disclosure of AI Authorship
- The human-authorship halo: attribution bias in literary style evaluation by humans and AI
- LLM-REVal: Can We Trust LLM Reviewers Yet?
- Do LLMs Favor LLMs? Quantifying Interaction Effects in Peer Review
- Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writing
- The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing
- Stop Automating Peer Review Without Rigorous Evaluation
Original note title
reader judgments track beliefs about authorship even when those beliefs are wrong — disclosure raised trust for every abstract type