SYNTHESIS NOTE
TopicsCo Writing Collaborationthis note

Do writers actually edit AI-generated text before publishing?

This research tests whether the "human-in-the-loop" safeguard against AI text quality issues actually works in practice. It examines how often writers revise AI-generated paragraphs and how substantially they change them.

Synthesis note · 2026-05-01 · sourced from Co Writing Collaboration
How do people decide what to share with AI systems? Does personalization in AI increase trust or manipulation risk?

A common reassurance about AI writing assistance is that humans remain in the loop — they will edit, correct, override. The persona-distortion study tested this assumption directly. Writers were given AI-generated paragraphs and asked to edit them until the text reflected their opinions to their satisfaction. The result: writers edited the AI-generated paragraphs only 23 percent of the time, and most edits were minor — median Levenshtein ratio of 0.96, meaning the edited text was 96 percent identical to the AI's original.

This finding has two implications. First, the standard "human-in-the-loop" defense against AI text quality concerns is empirically wrong at population scale. Editing is rare and shallow when it does occur. The AI's text is reaching its audience in nearly the form the model produced it. Second, this means the persona distortions documented in the same study — opinionated, confident, demographically privileged, emotionally compressed — propagate with minimal human modulation. The distortion is not filtered by the writer's revision; it is embraced or ignored.

This forecloses one common mitigation strategy: relying on the writer to detect and remove distortions before publication. The writer who would have caught and corrected the distortion is the same writer who, the study shows, mostly does not edit and mostly prefers the AI version even after being given the chance to edit it. The distortion arrives at the audience because the writer does not interrupt it. Any intervention that hopes to reduce AI's influence on public discourse cannot rely on the writer-as-gatekeeper assumption — that role, in practice, is not being performed.

Inquiring lines that read this note 54

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Why can't humans reliably detect AI-generated text despite measurable linguistic signatures? How does AI-generated content transformation affect public discourse quality? Does AI text rewriting systematically distort writer intent and preference? Do reasoning traces faithfully represent or merely mimic actual model reasoning? What makes specific clarifying questions more effective than generic ones? Why does verification consistently lag behind AI generation? Do accurate-looking LLM outputs hide structural failures in learning and reasoning? Does AI fluency substitute for verifiable accuracy in human judgment? How should human oversight be integrated with autonomous AI systems?

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

The 23 percent edit rate of AI writing assistance establishes that distortions reach audiences in nearly unedited form