What causes silent document corruption in long LLM workflows?
This explores why long, multi-step LLM workflows quietly degrade documents — what the actual mechanism is, and why it stays invisible until damage compounds.
This explores why documents passed through long LLM workflows quietly rot — not where the errors *appear*, but what actually causes them and why they go unnoticed. The starting point is a striking measurement: across 19 models and 52 domains, frontier systems silently corrupt roughly 25% of document content over extended relay tasks, and the damage compounds round after round without ever plateauing through 50 hand-offs Do frontier LLMs silently corrupt documents in long workflows?. The word that matters there is *silently* — the surface stays fluent and plausible while the substance drifts.
The most counterintuitive part is *where* the corruption comes from. It's tempting to blame the editing machinery — bad tools, clumsy find-and-replace, interface limits — but giving the model agentic tool access doesn't help. The degradation originates upstream, in the model's *judgment about what to change*, not in its ability to execute the change Can better tools fix LLM document editing errors?. In other words, the model isn't fumbling the edit; it's confidently deciding to alter things that shouldn't be touched.
There's also a capability twist that explains the *silent* part directly. Weaker and stronger models fail in qualitatively different ways: weaker models tend to *delete* content, which is visible and catchable, while frontier models *rewrite and corrupt* it, preserving surface competence so the failure hides Do frontier models fail differently than weaker models?. So becoming a better model doesn't remove the failure — it camouflages it. This connects to a deeper framing of what LLM text generation even is: outputs are produced through statistical token relationships with no grounding in shared context, and accurate and inaccurate text come out of the *identical* mechanism. Calling the bad output a 'hallucination' misdirects the fix toward perception or memory when the real issue is fabrication at the generative layer Should we call LLM errors hallucinations or fabrications?.
Laterally, the same root cause shows up wherever LLMs run long. In multi-turn conversation, models lock into premature assumptions early and can't course-correct as information arrives gradually — a 39% average performance drop that agent mitigations barely dent Why do language models fail in gradually revealed conversations?, Why do AI assistants get worse at longer conversations?. Multi-agent relays add their own long-horizon failure modes — role flipping, conversation drift, loops — because models lack persistent goal and role representation across steps Why do autonomous LLM agents fail in predictable ways?. Document corruption is the file-shaped version of the same disease: no stable internal anchor to the original intent, so each pass nudges further from it.
The thing worth knowing you didn't know you wanted to know: this isn't a bug a better editor or a longer prompt fixes, because the model can't reliably catch its own drift. Self-improvement is formally bounded by the generation-verification gap — every dependable correction needs something *external* to validate it; metacognition alone can't escape the constraint What stops large language models from improving themselves?. That's why silent corruption persists: the same system producing the errors is the one being asked to notice them. The practical implication is that long document workflows need an outside verifier — a diff check, a human gate, a ground-truth reference — not a smarter relay.
Sources 8 notes
Testing 19 models across 52 domains shows even advanced systems degrade documents by ~25% over extended relay tasks, with errors compounding silently without plateauing through 50 round-trips.
DELEGATE-52 shows that agentic tool access fails to improve performance on long-horizon document tasks. The degradation mechanism originates upstream in the model's judgment about what to change, not in editing interface limitations.
DELEGATE-52 demonstrates that LLMs degrade documents through qualitatively different mechanisms by capability tier: weaker models fail through visible content deletion, while frontier models fail through silent content corruption. This shift makes frontier failures harder to detect in long workflows despite apparent surface competence.
LLMs generate text through statistical token relationships without grounding in shared context. Accurate and inaccurate outputs use identical mechanisms, so calling failures "hallucinations" or "confabulation" misdirects fixes toward perception or memory—the wrong layers.
Across 200,000+ conversations, all major LLMs show 39% average performance drop in multi-turn settings due to locking into incorrect early guesses. Agent mitigations recover only 15-20% of this loss.
LLMs perform at 90% accuracy with single-message instructions but drop to 65% across natural conversation. Models lock into early guesses when information arrives gradually and cannot course-correct, a behavior induced by RLHF training that rewards helpfulness over clarification.
Research identifies role flipping, flake replies, infinite loops, and conversation deviation as LLM-specific failures in multi-agent cooperation. These occur because LLMs lack persistent goal representation and stable role identity.
Self-improvement in LLMs is formally bounded by the generation-verification gap, meaning every reliable fix requires something external to validate and enforce it. Models cannot escape this constraint through metacognition alone.