INQUIRING LINE

Could AI agents skip re-planning from scratch each time by reusing a library of plans that already worked?

How do organizational memory and validated plans reduce agent replanning overhead?

This explores whether agents can stop rebuilding their plans from scratch every time, by drawing on stored institutional knowledge (what has worked before, how the system is organized) and on plans that have already been checked, and what that saves in cost and reliability.


This explores whether agents can avoid working out the same plan over and over by leaning on stored knowledge and pre-checked plans. One caveat first: the collection has no paper that directly measures a reusable library of validated plans. It does say a lot about the general idea of moving planning work out of the model and into structures around it, and that evidence points one way. The strongest framing is Where does agent reliability actually come from?. It argues that reliable agents don't come from bigger models. They come from offloading memory, reusable skills and interaction protocols into a harness layer, so the model no longer has to 'solve the same problems repeatedly.' In practice, that repeated solving is what replanning overhead is.

The most concrete evidence that stored organizational knowledge cuts planning effort comes from software. In Can explicit behavior maps help weaker planners compete with stronger models?, the researchers gave a planner a map linking what a system does to where that behavior lives in the code. The planner used 8–13% fewer tokens, won 10–19 points more often, and a weaker model with the map matched stronger models at finding the right code. The surprising part is that good organizational memory can stand in for raw model capability. The planner spends less effort because it no longer has to rediscover how the system is organized. Can agent harnesses be automatically optimized across many environments? tells a similar story at a larger scale: automatically tuning the harness found mechanisms (compacting context, handing off reading, handling observations) that cut token traffic by roughly 45–49% with no loss in performance.

Memory alone doesn't remove replanning. It depends on how the memory is structured. Can agents compress their own memory without losing critical details? has agents compress their own history into three stores: past episodes, current work and tool knowledge. This both saves tokens and gives the agent a clean point to pause and rethink its strategy, which makes replanning deliberate instead of constant. Can agents reconstruct memory on demand instead of retrieving it? goes further. Rather than retrieving a fixed bundle of facts and then reasoning over it, the agent explores its memory step by step and drops paths that the evidence rules out. That improved reasoning by up to 23% and lowered cost. Should agent memory live inside the model backbone? takes the opposite approach and builds memory into the model itself, arguing that external memory and the model can drift apart when they are trained separately.

The 'validated' part of the question matters more than it first appears. Why do multi-agent systems fail to coordinate at scale? found that agents accept information from neighboring agents without checking it, so errors spread across the network. Unvalidated shared plans don't just fail to save effort. They can multiply mistakes. One way to validate plans is to keep a human involved: Can users steer AI agents better by revising plans mid-execution? lets users edit and assign plan steps during execution, and users found this easier to steer than starting over through chat.

There is also an economic reason for all this. How does test-time scaling work at the agent level? reports that about 80% of multi-agent performance differences come down to how many tokens are spent, so any replanning you avoid shows up directly as lower cost. Can small language models handle most agent tasks? adds an implication: once a plan is settled and well defined, the repetitive steps can go to small models at 10–30× lower cost, with large models saved for actual replanning. The takeaway is that pre-checked plans and organized memory don't just make an agent faster. They change which model you need to run it.


Sources 10 notes

Where does agent reliability actually come from?

Research shows reliable LLM agents externalize three cognitive burdens—memory (state persistence), skills (procedural components), and protocols (structured interaction)—into a harness layer rather than relying on model scale alone. The harness unifies these externalities and eliminates the need for the model to solve the same problems repeatedly.

Can explicit behavior maps help weaker planners compete with stronger models?

A behavior-to-code mapping representation improved win rates by 10–19 points while reducing planner tokens by 8–13%. Weaker planners using this mapping matched stronger models' code localization across all precision and recall metrics.

Can agent harnesses be automatically optimized across many environments?

Cross-environment harness optimization yielded four mechanisms (action execution, context compaction, observation handling, delegated reading) that reduced token traffic by 44.7–49.0% while maintaining comparable performance on a 51-task benchmark, suggesting harness-level gains are orthogonal to model improvements.

Can agents compress their own memory without losing critical details?

DeepAgent's autonomous memory folding consolidates interaction history into episodic, working, and tool memory schemas. This reduces token overhead while letting agents pause to reconsider strategies—the autonomy and structure together avoid degradation that plagues poorly designed consolidation.

Can agents reconstruct memory on demand instead of retrieving it?

MRAgent achieves up to 23% gains on reasoning tasks by reconstructing memory through active graph traversal that prunes paths based on accumulated evidence, while reducing token and runtime cost compared to fixed-retrieval pipelines.

Show all 10 sources
Should agent memory live inside the model backbone?

Metis demonstrates that agent memory can be implemented as a persistent state and autonomous procedures within the model backbone rather than external modules. This approach enables end-to-end training and avoids the decoupling failures where external memory and backbone optimize independently.

Why do multi-agent systems fail to coordinate at scale?

AgentsNet benchmark shows agents fail to coordinate strategies either by agreeing too late or adopting strategies without informing neighbors. Agents accept neighbor information without verification, enabling error propagation while remaining capable of detecting direct conflicts.

Can users steer AI agents better by revising plans mid-execution?

Cocoa's system, which lets users assign plan steps to themselves or an agent and revise plans mid-execution, afforded greater steerability than chat-baseline interaction in a lab study (n=16) while maintaining ease of use, with field users valuing explicit work delegation.

How does test-time scaling work at the agent level?

Research shows 80% of multi-agent performance variance comes from token budget, not coordination intelligence. LatentMAS and shared-KV-cache approaches offer ways to decouple performance gains from token costs.

Can small language models handle most agent tasks?

SLMs handle the repetitive, well-defined language tasks that constitute most agent work at 10–30× lower cost than LLMs, making heterogeneous architectures (SLMs by default, LLMs selective) the economically rational design pattern.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.