INQUIRING LINE

Every time an AI agent breaks, the easiest fix gets sprinkled wherever it fits — and those patches compound into chaos.

Why does the harness layer accumulate distributed behaviors over time?

This explores why, as an agent's scaffolding (its prompts, tools, and orchestration code — the 'harness') evolves, single behaviors end up smeared across many files and stages rather than living in one clean place.


This explores why the harness — the scaffolding of prompts, tools, and orchestration code wrapped around a model — ends up with single behaviors scattered across many locations as it grows. The short answer from the corpus: harness evolution is an accretion process, and accretion favors local patches over global reorganization. When an agent hits a failure, the cheapest fix is to graft a small correction onto whatever stage was running — a prompt tweak here, a tool guard there. Over many rollouts these grafts pile up, and because a single 'behavior' (say, how the agent decides when to stop) touches the planner, a tool wrapper, and a post-processing step, the fix for it gets deposited in all three. Why is finding distributed behavior code so hard? names this directly: harnesses distribute one behavior across files, functions, and stages, creating a mismatch between how we *ask* for a behavior and how the code is actually organized.

The reason this keeps happening rather than self-correcting is that the edits are shallow by nature. Do harness edits learn strategies or just memorize fixes? found that most evolved edits just cache a shortcut for an already-solvable task instead of distilling a reusable strategy — so the harness collects a sediment of narrow patches, each tied to a specific failure it once saw. There's no pressure toward consolidation because consolidating would mean *finding every place a behavior lives first*, which is exactly the hard part. That's why Are harness evolution gains really from better design? warns that apparent gains can be memorization in disguise: the harness is quietly hoarding task-specific fixes, and only a held-out test reveals whether anything general was learned.

There's also a structural reason baked into how self-improving agents work. Do self-improving agents really split into two distinct loops? describes two loops: a slow one that rewrites model weights and a fast one that rewrites prompts, memory, and tools. Almost all recent progress runs through the fast loop precisely because scaffold edits are cheap and reversible — but 'cheap and reversible' is also what lets them accumulate unchecked. Weight updates force integration; scaffold edits don't. So behaviors that a weight-based learner might fold into a single representation instead stay externalized and spread out across the harness.

The corpus also points at the fix, which tells you something about the cause. Can explicit behavior maps help weaker planners compete with stronger models? shows that giving the harness an explicit behavior-to-code map — a representation that says 'this behavior is implemented in these places' — raised win rates and even let weaker planners match stronger ones at finding the right code. The fact that this helps so much confirms that the distribution isn't inevitable; it's what you get when nothing in the loop maintains a map of where behaviors live. Compare Can agents learn new skills without forgetting old ones?, where VOYAGER stores skills as discrete, indexed, composable units: when the substrate is designed for retrieval and reuse, accumulation produces a *library* instead of a tangle. The harness accumulates distributed behaviors because, unlike a skill library, it has no native unit of behavior — so growth means scattering, not filing.

The quietly interesting part: this isn't a bug you patch once. Because the capacity to *benefit* from harness edits peaks at mid-tier models and doesn't scale cleanly (Do stronger models always evolve harnesses better?), even a very strong model doesn't automatically clean up its own scaffolding. Distribution of behavior is the default state of any system that improves by patching itself faster than it reorganizes itself.


Sources 7 notes

Why is finding distributed behavior code so hard?

The core difficulty in evolving production harnesses is not generating edits but finding every code location that implements a behavior. Harnesses distribute single behaviors across files, functions, and stages, creating a representational mismatch between behavioral requests and structural code organization.

Do harness edits learn strategies or just memorize fixes?

Inspecting evolved harness edits reveals rational changes across prompt and tool layers, but most persist fixes the agent could rediscover in one rollout. Gains remain limited because edits cache shortcuts for already-solvable tasks rather than converting failures into successes.

Are harness evolution gains really from better design?

Harness evolution is itself a search loop, so its reported improvements are confounded with search effort. Only improvements beyond equal task-level search budget can be attributed to harness design, and held-out evaluation is needed to rule out task memorization.

Do self-improving agents really split into two distinct loops?

A survey framework organizes self-improving agents into two update mechanisms: slow parametric loops updating foundation model weights, and fast non-parametric loops updating prompts, memory, and tools. Recent progress concentrates in the fast loop because scaffold updates are cheaper and reversible than weight updates.

Can explicit behavior maps help weaker planners compete with stronger models?

A behavior-to-code mapping representation improved win rates by 10–19 points while reducing planner tokens by 8–13%. Weaker planners using this mapping matched stronger models' code localization across all precision and recall metrics.

Show all 7 sources
Can agents learn new skills without forgetting old ones?

VOYAGER demonstrates that storing executable skills in an embedding-indexed library and composing complex skills from simpler ones allows agents to learn continuously while avoiding the forgetting that occurs with weight-update-based methods. Environmental feedback refines skills while an automatic curriculum drives continual exploration.

Do stronger models always evolve harnesses better?

Model capability to produce useful harness edits stays constant across tiers, but capacity to actually benefit from those edits follows an inverted U-shape, peaking in mid-tier models. Weak models fail to invoke harnesses; strong models struggle with faithful instruction-following.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.

Research prompt for your LLMexpand ↓

Copy into ChatGPT or Claude to take this line of inquiry further — it asks the model to find newer work and re-test which earlier constraints still hold.

You are a systems analyst studying LLM agent architecture. Open question, still live: why does the harness — the prompts, tools, and orchestration wrapped around a model — accumulate one behavior scattered across many locations as it grows, and must it stay that way?

What a curated library found — and when (dated claims, not current truth). These span roughly 2025–2026:
- Harness growth is accretion: the cheapest fix for a failure is a local graft (a prompt tweak, a tool guard), so a single behavior — e.g. deciding when to stop — gets deposited in the planner, a tool wrapper, AND post-processing at once (~2026).
- Most evolved edits memorize task-specific shortcuts rather than distilling reusable strategy, so only held-out tests separate general learning from hoarded fixes (~2026).
- Self-improving agents split into a slow weight loop and a fast scaffold loop; almost all progress runs through the fast loop because scaffold edits are cheap and reversible — which is exactly what lets them pile up unchecked (~2026).
- Giving the harness an explicit behavior-to-code map raised win rates and let weaker planners match stronger ones at finding the right code (~2026).
- Capacity to benefit from harness edits peaks at mid-tier models and is flat across tiers, so a stronger model won't auto-clean its own scaffolding (~2026).

Anchor papers (verify; mind their dates): Harness Updating Is Not Harness Benefit (2026, arXiv:2605.30621); Scaling Laws for Agent Harnesses via Effective Feedback Compute (2026, arXiv:2605.29682); Code as Agent Harness (2026, arXiv:2605.18747); From Model Scaling to System Scaling (2026, arXiv:2605.26112).

Your task:
(1) RE-TEST EACH CONSTRAINT. For every finding, judge whether newer models, training methods, tooling, orchestration (memory, caching, multi-agent), or evaluation have RELAXED or OVERTURNED it. Separate the durable question from the perishable limitation; cite what resolved it, and say plainly where a constraint still holds.
(2) Surface the strongest CONTRADICTING or SUPERSEDING work from the last ~6 months — especially the live disagreement over whether harness gains are real learning or memorization in disguise, and whether behavior-to-code maps genuinely help.
(3) Propose 2 research questions that ASSUME the regime may have moved.

Cite arXiv IDs; flag anything you cannot ground in a real paper.