INQUIRING LINE

Papers already leave out the dead ends and fixes behind a result, and abstracts cut what little survives.

Why do excerpts and abstracts miss the recovery ideas present in full papers?

This reads 'recovery ideas' as the material about how things go wrong and get fixed (dead ends, failed attempts, the repairs that follow) and asks why abstracts and excerpts drop it while full papers keep some of it. The corpus has no note that studies abstracts directly, so this is built from neighboring notes on how compressing research and experience loses this kind of content.


This reads 'recovery ideas' as the material about how things go wrong and get fixed (dead ends, failed attempts, the repairs that follow) and asks why abstracts and excerpts drop it while full papers keep some of it. The corpus has no note that studies abstracts directly, so what follows is built from neighboring notes on how compressing research and experience loses this kind of content.

Start with what a paper already is. One note describes the published paper as a lossy compiler: publishing imposes a 'Storytelling Tax' that erases process, failed branches and tacit reasoning, plus an 'Engineering Tax' that leaves out implementation detail Can research papers preserve the experiments that failed?. An abstract is a second round of compression on top of that first one. It is written to state the result, not the route, so the detours and the fixes that made the result possible are the first things cut. Whatever recovery knowledge survives tends to sit in the body of the paper, where the authors explain what they tried.

The details that get cut are also the ones that change what a reader does with the paper. In one study of self-evolving agents, changing the raw experience an agent had accumulated changed its behavior a lot, while changing the condensed summary of that experience barely mattered. The summaries had lost the critical details, and the models leaned on immediate context instead Why do LLM agents ignore condensed experience summaries?. A recovery idea is a detail of that kind. As an illustration, one note describes models that finetune on documents repeated in a cycle and start recovering performance on a document before they see it again, an effect that grows with scale Do networks recover from forgetting before re-encountering documents?. A one-line summary of 'models forget when trained on new data' would flatten that finding into the old story.

You also can't easily search your way to what an abstract leaves out. A query only carries what you already know to ask for. One note shows that a model's partial answer can expose gaps the original question couldn't express, and that using the draft answer as the next query pulls in what was missing Can a model's partial response guide what to retrieve next?. Another shows that retrieving isolated chunks destroys the document's structure, and that building a global summary first lets scattered evidence be found by its role in the document rather than by surface similarity Can building a document map first improve retrieval over long texts?. A 'what went wrong and how it was fixed' passage has a role but not a topic. It usually doesn't resemble the abstract's vocabulary, so nothing in the abstract points to it.

The loss is also hard to notice. Another note finds that frontier models degrade documents silently, keeping the surface looking intact, while weaker models visibly delete content Does model capability change how documents degrade?. That note is about document editing, not summarizing. Still, it suggests a compressed version can read as complete when it isn't. The practical move, which is my inference and not something a note tests, is to treat an abstract as a first draft of what you're looking for. Guess what the recovery story might be, then check the full text for the passages that confirm or contradict your guess.


Sources 6 notes

Can research papers preserve the experiments that failed?

Publishing imposes a Storytelling Tax (erasing process, failed branches, tacit reasoning) and Engineering Tax (omitting implementation specs). Agent-Native Research Artifacts address both by packaging logic, executable code, exploration graphs of failures, and evidence grounding—treating rejected branches as publishable deliverables rather than editorial casualties.

Why do LLM agents ignore condensed experience summaries?

Across 10 LLM models and 9 environments, perturbing raw experience changed agent behavior significantly, while altering condensed experience had minimal effect. Three causes drive this asymmetry: summaries lose critical details, models favor immediate context over retrieved information, and pretrained knowledge reduces reliance on external experience.

Do networks recover from forgetting before re-encountering documents?

Language models finetuned on cyclically repeated documents exhibit anticipatory recovery—restoring performance on a document before encountering it again—a phenomenon that emerges and strengthens with model scale, contradicting monotonic catastrophic interference.

Can a model's partial response guide what to retrieve next?

ITER-RETGEN shows that iteratively using generated responses as retrieval queries substantially improves performance on multi-hop reasoning and fact verification. Generation acts as both answer producer and information-need clarifier, surfacing implicit gaps that the original query missed.

Can building a document map first improve retrieval over long texts?

MiA-RAG inverts standard RAG by summarizing documents first, then conditioning retrieval on that global view. This approach recovers discourse structure that bag-of-chunks retrieval destroys, making scattered evidence findable by their document role rather than surface similarity alone.

Show all 6 sources
Does model capability change how documents degrade?

DELEGATE-52 shows weaker LLMs degrade documents through visible deletion, while frontier models degrade through subtle corruption that preserves surface integrity. This shift makes frontier failures harder to detect and potentially more dangerous at workflow scale.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.