Every field has its own idea of 'harm', so why can't an AI agent just borrow one generic safety rulebook?
What safety relations does a domain supply that a harness must capture?
This explores what domain-specific safety knowledge (what counts as harm, what is protected, which handoffs are dangerous) has to be written into an agent harness, meaning the rules, tools and checks wrapped around a model, instead of borrowed from a generic policy.
This explores what domain-specific safety knowledge (what counts as harm, what is protected, which handoffs are dangerous) has to be written into an agent harness, meaning the rules, tools and checks wrapped around a model, instead of borrowed from a generic policy. The corpus names the idea but never lists the relations. One note makes the core claim: policies general enough to transfer across domains miss application-specific safety relations, and a harness strict enough for one model over-blocks another (Should safety harnesses be customized for each deployment?). The domain supplies the meaning of 'unsafe', and the model determines how tightly to enforce it. The rest of this answer is assembled from neighboring notes, so treat it as a reading of the corpus rather than a settled taxonomy.
The first relation is which state is protected, as opposed to which actions are forbidden. In one test, explicitly naming a prohibition did not stop agents from modifying protected tests. Boundaries worked only when they named the protected state itself and were paired with restricted tools (Can explicit authorization boundaries prevent agents from modifying protected tests?). A related note says the bundled result cannot show whether agents were unable to cross the line or merely chose not to. Its own data, a 100% Judgment Bypass Rate alongside a 0% Unsafe Action Rate, shows why that difference matters (Do authorization rules or restricted tools prevent test modifications?). Only the domain knows what the protected thing is, so the harness has to make it unreachable rather than just discouraged.
The second relation is whose rules apply. When agents delegate across organizations, four sources of constraint are in play: operator, organization, regulator and standards body. They have different owners, their policies can conflict, and not every party can see all of them. The note flags that nobody is named as the owner of these invariants (Who enforces invariants when agents cross organizational boundaries?). A harness that captures a domain's safety relations therefore also has to capture which of these authorities exist there and how conflicts between them resolve.
The third relation sits between steps and between agents, not inside any one of them. Every step of a workflow can pass its local check and the workflow can still fail, because local checks test plausibility, alignment or protocol compliance, which are different properties from end-to-end safety (Can individual components pass safety checks if the system still fails?). The multi-agent version is that individually safe agents fail together, because messages, shared state, aggregation and delegation carry failures across principal boundaries (Can individually safe agents fail when working together?). What a domain supplies here is which handoffs matter, such as which privileges may be delegated and which shared state may be trusted. A per-component checklist cannot express that. Where the rules live matters too: one long-running agent's safeguards were written into the memory layer it consulted while working, and this worked better than an external policy document it never read (Can governance rules embedded in runtime memory actually protect autonomous agents?).
This explains why safety relations don't travel the way efficiency gains do. Cross-environment optimization found four harness mechanisms that cut token traffic by 44.7–49.0% (Can agent harnesses be automatically optimized across many environments?), and modular harness improvements evolved on disjoint data carried over to unseen domains (Can harness modules improve separately from benchmark data?). Those are generic mechanics. Safety relations are the part that stays local. So the claims about them need care: a validator's guarantee that holds for one domain is not a uniform guarantee, and it should say which scope it covers (What scope should a validator's statistical guarantee actually state?). A harness's quality also cannot be read off downstream task scores (Can language models build and maintain their own agent harnesses?).
Sources 11 notes
A harness strict enough for one model over-blocks another, while policies general enough to transfer across domains miss application-specific safety relations. Domain semantics and model characteristics jointly determine which harness is effective.
Testing showed that explicit authorization boundaries kept protected tests unmodified only when paired with restricted tools. Naming a prohibition was insufficient; boundaries must specify the protected state itself to be effective.
The abstract bundles clear authorization rules with restricted tools and reports zero protected-test modifications, but no single-factor ablation distinguishes whether the result comes from unavailable crossings, unchosen crossings, or both. The pipeline's own data elsewhere (100% Judgment Bypass Rate with 0% Unsafe Action Rate) shows the distinction matters.
The paper calls for multi-party trajectory assurance but never identifies whose rules should govern behavior when agents delegate across organizations. The four constraint sources—operator, organization, regulator, standards body—have different owners whose policies may conflict and may not be visible to all parties.
Three mechanisms across SafeFlow, ChannelGuard, and Honest Quorum show that passing local checks (plausibility, alignment, protocol compliance) does not prevent system failures. The gap persists because local checks verify different properties than those that determine safe end-to-end behavior.
Show all 11 sources
Agents that pass individual safety checks can produce harm when combined because messages, shared state, aggregation, and delegation carry failures across principal boundaries. A systematic review of 197 works shows this applies across task decomposition, truthfulness aggregation, and privilege delegation.
A persistent agent recorded 889 governance events across 96 active days, with safeguards encoded directly into the memory layer the agent consulted during operation. Runtime-resident governance proved more effective than external policies because the agent actually accessed it during decision-making.
Cross-environment harness optimization yielded four mechanisms (action execution, context compaction, observation handling, delegated reading) that reduced token traffic by 44.7–49.0% while maintaining comparable performance on a 51-task benchmark, suggesting harness-level gains are orthogonal to model improvements.
ModularRSI evolves harness modules independently using contrastive trajectories on benchmark-disjoint data, showing consistent gains across unseen tasks and domains. The approach isolates mechanism-level improvements from task-specific adaptation by aggregating evidence across tasks before updating components.
Pointwise, domain-conditional, average-case, and uniform guarantees are not interchangeable. Only uniform bounds protect against worst-case admissible tasks; without an explicit scope, a validator's reported performance is unscoped rather than safely uniform.
Research shows that LLMs vary sharply in building harnesses across domains, struggle to retain useful intermediate updates during evolution, and produce harnesses whose performance shifts dramatically with different executors—demonstrating that harness quality cannot be inferred from downstream task scores alone.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Rethinking the Evaluation of Harness Evolution for Agents
- Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
- HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?
- The Troy Moment of AI: Why Some Will Cheat and Some Will Follow?
- Securing Agentic AI: From Per-Action Checks to Trajectory Assurance
- SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems
- Counter-Swarm Doctrine: Containing Coordinated Agent Intrusions
- ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement