Why is finding distributed behavior code so hard?
When developers need to modify agent harnesses, they struggle to locate all the code implementing a target behavior because behaviors are scattered across files and stages while requests describe what to do, not where to look.
Before a developer or coding agent can change how a harness behaves, they have to find every code location that implements the target behavior. That sounds like ordinary code navigation, but it is uniquely hard for harnesses: production harnesses are large, tightly coupled, and behaviorally distributed — a single behavior is smeared across files, functions, execution stages, and state transitions. Meanwhile modification requests are phrased in terms of what the system should do, and repositories are organized by files, functions, and modules. There is a representational mismatch between the request (behavioral) and the artifact (structural), and closing it is left to the human.
Naming this gap matters because it relocates where the difficulty in harness evolution actually lives. Existing tools — code search, repo indexing, long-context processing — make code easier to inspect but still leave the developer to recover the behavior→implementation mapping themselves. So "harness evolution" is bottlenecked less by generating a good edit than by locating where the edit must go.
This refines the vault's picture of agentic code. Since What are the three distinct layers of agent code?, the harness layer is precisely the part that grows tangled and distributed as it accumulates behaviors — which is why it, not the model, becomes the maintenance bottleneck. The proposed remedy is to reorganize repository knowledge around runtime behavior; see Can explicit behavior maps help weaker planners compete with stronger models?.
Inquiring lines that read this note 5
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Do harness improvements transfer across model scales or memorize shortcuts? How do prompt structure and constraints affect model instruction reliability? Does externalizing cognitive work and state improve agent reliability?Related concepts in this collection 2
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can explicit behavior maps help weaker planners compete with stronger models?
Explores whether organizing harness repositories around runtime behavior—rather than relying on model inference—can narrow the capability gap between weaker and stronger planning models, and whether this reduces computational overhead.
the behavior-centric representation that attacks this bottleneck
-
What are the three distinct layers of agent code?
Does separating agent code into model capabilities, system harness, and agent-created artifacts help explain why agentic systems fail and where to intervene for improvement?
the harness is the layer that accumulates distributed behavior
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable
- Rethinking the Evaluation of Harness Evolution for Agents
- Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
- Code as Agent Harness
- Scaling Laws for Agent Harnesses via Effective Feedback Compute
- From Model Scaling to System Scaling: Scaling the Harness in Agentic AI
- Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
- Peer-Preservation in Frontier Models
Original note title
behavior localization across distributed source is the central bottleneck in evolving agent harnesses