SYNTHESIS NOTE
Topics›Co Writing Collaboration›this note

Do writers actually edit AI-generated text before publishing?

This research tests whether the "human-in-the-loop" safeguard against AI text quality issues actually works in practice. It examines how often writers revise AI-generated paragraphs and how substantially they change them.

Synthesis note · 2026-05-01 · sourced from Co Writing Collaboration
How do people decide what to share with AI systems?

A common reassurance about AI writing assistance is that humans remain in the loop — they will edit, correct, override. The persona-distortion study tested this assumption directly. Writers were given AI-generated paragraphs and asked to edit them until the text reflected their opinions to their satisfaction. The result: writers edited the AI-generated paragraphs only 23 percent of the time, and most edits were minor — median Levenshtein ratio of 0.96, meaning the edited text was 96 percent identical to the AI's original.

This finding has two implications. First, the standard "human-in-the-loop" defense against AI text quality concerns is empirically wrong at population scale. Editing is rare and shallow when it does occur. The AI's text is reaching its audience in nearly the form the model produced it. Second, this means the persona distortions documented in the same study — opinionated, confident, demographically privileged, emotionally compressed — propagate with minimal human modulation. The distortion is not filtered by the writer's revision; it is embraced or ignored.

This forecloses one common mitigation strategy: relying on the writer to detect and remove distortions before publication. The writer who would have caught and corrected the distortion is the same writer who, the study shows, mostly does not edit and mostly prefers the AI version even after being given the chance to edit it. The distortion arrives at the audience because the writer does not interrupt it. Any intervention that hopes to reduce AI's influence on public discourse cannot rely on the writer-as-gatekeeper assumption — that role, in practice, is not being performed.

Inquiring lines that read this note 191

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Can we reliably distinguish AI-generated from human-written text? How does AI-generated content affect visibility and discourse in digital platforms? How does AI writing assistance affect reader perception of writer authenticity? Do reasoning traces accurately represent what models actually compute? What determines when personalization helps versus harms model behavior? How do LLMs generate false citations that fool readers and evaluators? Can verification capability keep pace with AI generation speed? What explains the gap between LLM semantic understanding and production? Does polished AI output mislead users about actual accuracy and expertise? Can AI systems adequately substitute for or supplement human peer review? What shapes user trust in chatbot recommendations for news and politics? How can we better validate AI research and prevent misconceptions? Can we reliably measure and demonstrate AI's actual productivity impact? Do admissions penalties for AI essays reflect detection accuracy or institutional distrust? How do clinicians evaluate the trustworthiness of AI medical recommendations? Does generative AI replace coordination with individual productivity? How do standardized forms and measurement artifacts shape observable evidence? How do different editing strategies affect output quality and agent safety? How does AI involvement in hiring affect fairness and stakeholder behavior? How does offloading cognition to AI assistance affect learning retention? Do language models truly understand their encoded knowledge or merely retrieve patterns? Do engagement-optimized chatbots create dependencies that undermine user autonomy? How should conversational agents balance proactive goal-pursuit with user autonomy?

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

The 23 percent edit rate of AI writing assistance establishes that distortions reach audiences in nearly unedited form