Can external managers compress context better than frozen agents?
Explores whether offloading context management to a trained external system can adapt compression strategies to individual agent strengths, rather than forcing agents to manage their own context constraints.
Long-horizon agents accumulate context — tool results, intermediate reasoning — until stale content obscures salient evidence, amplifies positional bias, and degrades decisions. Prior fixes put the burden of managing context on the agent itself (agent-side control, or fixed summarization), which requires training the agent and is impractical for closed-source agents, and ignores that different agents need different strategies.
AdaCoM separates the concern entirely: train an external LLM to manage the context of a frozen agent through flexible modification actions and end-to-end RL. The manager prunes stale content while preserving task constraints and progress, improving diverse agents on web-search and deep-research benchmarks and transferring to unseen agents of similar capability.
The most useful finding is a fidelity–reliability trade-off. Agents with higher vanilla ReAct performance benefit from higher-fidelity context preservation — they can use more detail well. Lower-performing agents require more aggressive compression to stay within a reliable reasoning regime. The right amount of context is not a property of the task alone; it is indexed to the agent's own competence. This means context management is not one universal policy but a per-agent calibration — consistent with Does fixed sparsity work for all sequence lengths?, where the optimal budget is also conditional rather than fixed.
Inquiring lines that read this note 37
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does AI assistance affect human cognitive development and reasoning autonomy? How should agents balance memory condensation to optimize context efficiency?- How do perception and execution gaps limit current AI agent performance?
- Can the same compress-then-act pattern work for agent state memory?
- Why do weaker agents need more aggressive context compression than stronger ones?
- Should optimal context budgets scale with agent competence or task complexity?
- Can context management policies transfer across agents of similar capability levels?
- How should agents compress episodic interactions into working memory without accumulation?
- How do memory hygiene and context efficiency trade off in deployed agents?
- Why do agents ignore condensed experience in favor of raw data?
- Does selective history retrieval outperform full context inclusion in agent reasoning?
- How should embedding model speed constrain agent memory system design?
- Can task-agnostic compression of documents remain broadly useful for later queries?
- Does recurrent memory or gist compression work better for ultra-long context?
- How do memory hierarchies and compression reduce context management demands?
- How does reducing activation precision further extend context length?
- Can fixed-size latent states losslessly store arbitrary input context?
- Why does keeping full key-value blocks matter more than compressing them?
- What is the connection between model compression and data compression?
- Can external managers optimize context better than the model itself?
- Why is long-context compute spent transforming context into internal state rather than storing it?
- What components of agent scaffolding most impact domain-specific output quality?
- Can harness updates benefit agents equally across all model sizes?
- How should harness scaffolding be treated as a first-class object?
- How does external context control compare to agents managing their own state internally?
- Can externalizing bookkeeping to a stateful harness replace internalized memory control?
- What specific bookkeeping tasks can environments maintain more reliably than policies?
- Why does externalized state beat parameter scaling for agent reliability?
- How does externalizing reasoning into harness artifacts improve agent reliability?
- How does structured environment-side state reduce multi-turn agent failure better than transcript replay?
- How can harnesses externalize bookkeeping so models focus on semantic judgment?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can agents fail from weak memory control rather than missing knowledge?
As multi-turn agent workflows grow longer, performance degrades—but is this due to insufficient context or poor memory management? This explores whether memory *control* is the real bottleneck.
adjacent solution to the same accumulation problem; ACC commits state internally, AdaCoM manages it externally
-
Can context playbooks prevent knowledge loss during iteration?
When AI systems iteratively refine their instructions and memories, do structured incremental updates better preserve domain knowledge than traditional rewriting? This matters because context degradation undermines long-term agent performance.
both treat context as actively managed rather than passively appended
-
Where does agent reliability actually come from?
Exploring whether LLM agent performance depends on larger models or on thoughtful system design choices like memory, skills, and protocols that shift cognitive work outside the model.
the external manager is harness infrastructure for a frozen model
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Learning Agent-Compatible Context Management for Long-Horizon Tasks
- SearchSwarm: Towards Delegation Intelligence in Agentic LLMs for Long-Horizon Deep Research
- Large Language Model Agents Are Not Always Faithful Self-Evolvers
- From Model Scaling to System Scaling: Scaling the Harness in Agentic AI
- Towards a Science of Scaling Agent Systems
- LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agents
- Adaptation of Agentic AI
- Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
Original note title
context management can be offloaded to a trained external manager for a frozen agent and optimal compression depends on the agent's own reliability