Can external state caches let models solve harder problems?
Explores whether organizing model state across weights, context, persistent memory, and disk—rather than relying only on weights and tokens—expands what models can do. Matters because long-horizon tasks may need more state than a model can hold internally.
Prime Agent starts from a limit on the model itself: an LLM is "a bounded sequential processor whose next decision can use only state information exposed in its weights and active context." Long-horizon agency needs more state and computation than that, so the harness supplies a substrate. The introduction imagines that substrate as a state information cache with four levels. Model weights are L0 and active context is L1. A persistent REPL plus recursive subagents form L2, and disk-backed history, memories, and skills form L3. The paper calls the result "more von Neumann-like," because the model can read, transform, and write addressable state outside the instruction it is currently generating. The abstract reports that ARC-AGI-3 RHAE Best@1 rises from 30% to 95.5%, and that the harness "matches or exceeds native and popular harnesses" on long-context coding, GPU-kernel generation, emulator construction, and autonomous nanoGPT speedruns.
The mechanism is a division of labor. Prime Agent "standardizes execution, recovery, verification, and resource accounting while leaving strategy construction to the model." The authors call this a "low-friction, expressive membrane" that keeps harness failures from turning into model failures and moves measurement toward "the model's true maximal underlying capability." Persistence comes from Continual Harness, which carries histories, memories, skills, prompts, and subagent specifications across trajectories. Recursive subagents coordinate by direct agent-to-agent communication, and an Agents View lets humans inspect and manage daemon-backed sessions. The introduction treats agentic compaction, in which a model prunes its own context, as the first form of context management. It presents the other levels as what became necessary once the full information state outgrew weights and tokens.
Against the nearest notes, this adds two things. Where does agent reliability actually come from? already argues that the harness hosts externalized memory, skills, and protocols. Prime Agent orders that state by how far it sits from the weights, and it adds a measurement argument: a badly built harness contaminates what a benchmark says about the model. Can an external manager handle context for frozen agents? works at L1, learning what to keep in context. Prime Agent moves state out of L1 into levels the model addresses itself. Can delegation teach models to manage context more actively? reads subagents as a context tool, which matches their placement at L2 here. Should we evaluate deployed agents as whole environments instead? points the same way on evaluation, and the Agents View is one concrete human-facing surface.
The excerpt is silent on what produced the gain. It does not name the baseline harness or the models used, give sample sizes, define RHAE Best@1, or ablate the four levels, so the 30% to 95.5% jump cannot be credited to any one component. The cache mapping is offered as an image, and the excerpt gives no test of it. The discussion also undercuts its own measurement claim. It concedes that "models still experience friction" when allocating subagents, managing retained information, and refining reusable state, and that many harness capabilities go underused "because current models were not trained to operate them." The expectation that model-harness co-learning becomes "the dominant route to new long-horizon capabilities" is a forecast, not a result. At the strength the evidence allows, a score from this harness measures a model paired with a harness the model has not been trained to use fully, and it is not a clean reading of maximal capability.
Inquiring lines that read this note 16
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Do language models develop actual world models or merely task heuristics? How do standardized protocols improve multi-agent coordination and reliability? How does harness optimization generalize across different model architectures and domains? Why does adding new knowledge through fine-tuning degrade existing capabilities?- Can externalized memory and skills replace model scaling?
- Can a memory module be swapped between different base models?
- Does moving memory outside model weights avoid the limitations of in-weight retention?
- Does recoverable content elision in context management match externalized memory benefits?
- Does memory granularity need to match the task domain or the model size?
- When does persistent harmful memory create performance error floors?
- How does textual memory structure affect frozen model improvement?
- What makes execution and memory proxies more useful than dynamics prediction alone?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Where does agent reliability actually come from?
Exploring whether LLM agent performance depends on larger models or on thoughtful system design choices like memory, skills, and protocols that shift cognitive work outside the model.
the same harness-as-substrate thesis; this paper adds a layered ordering of state and a measurement argument
-
Can an external manager handle context for frozen agents?
Exploring whether a separate trained system can effectively manage a frozen agent's context window. This matters because many deployed agents are closed-source and can't be retrained, yet they suffer from context degradation.
an L1 context-pruning approach that Prime Agent's extra levels sit beyond
-
Can delegation teach models to manage context more actively?
Does training models to decompose tasks and delegate to subagents—rather than passively compressing when context fills up—improve their ability to reason over long horizons? And does this skill transfer to single-agent work?
treats subagents as context management, matching their L2 placement here
-
Should we evaluate deployed agents as whole environments instead?
Conventional LLM evaluation focuses on models or individual episodes, but what if the right measurement unit is the entire coupled human-agent system including memory, tools, and protocols observed over time?
also argues that what is measured depends on the surrounding system, not the model alone
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Prime Agent: A Self-Improving RLM Harness
- Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
- GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents
- From Model Scaling to System Scaling: Scaling the Harness in Agentic AI
- Useful Memories Become Faulty When Continuously Updated by LLMs
- Are We Ready For An Agent-Native Memory System?
- Metis: Memory Foundation Model
- Know It, Act on It: Investigating Memory Utilization in LLM Personalization
Original note title
a long-horizon harness extends model state through a cache hierarchy from weights to disk so harness failures do not become model failures