INQUIRING LINE

When an AI agent tweaks something, how does it know if that fix should stay put or spread everywhere else?

How can agents distinguish between local edits and changes meant to propagate?

This explores how an AI agent can tell whether a change it makes should stay contained (a one-off fix, a scratch edit) or should flow outward into shared state, downstream agents, or future versions of itself.


This explores how agents can tell a contained, local change apart from one meant to spread into shared systems, other agents, or their own future behavior. The corpus has no paper on this exact question. What it does have, from several directions, points to the same lesson: agents are poor at judging this for themselves. The systems that work make the boundary explicit in the environment instead of asking the agent to infer it.

The clearest model comes from work on agents that improve themselves. The Autogenesis Protocol treats prompts, tools, and memory as versioned, registered resources, each with a lifecycle and a rollback path How can agent self-evolution be made safe and auditable?. That changes the question. Instead of asking the agent whether an edit should propagate, every change that is meant to persist has to pass through a registry that records where it came from and can undo it. Anything outside that path stays local by default. OpenAI's ScopeOfAutonomy records work in a similar way from the permissions side. They list the tools an agent may use, its cost limits, and the conditions that end its task, so the scope of an action is written down before the agent acts How can autonomous agents act safely within defined boundaries?.

Studies of coding agents and protected tests show why telling the agent isn't enough. When agents were told not to modify certain tests, the prohibition held only when it came with restricted tools. The boundary had to name the protected state itself, not just state a rule Can explicit authorization boundaries prevent agents from modifying protected tests?. Even then, nobody can say which part did the work: the rule, the missing tools, or both Do authorization rules or restricted tools prevent test modifications?. In practice, the line between "edit freely here" and "this must not change" is safest when it's built into what the agent can reach, not into its judgment. Work on containment makes the same point: an agent's risk spreads through memory, tool calls, and environment access, so you control propagation by controlling what it can touch Can a model-level filter truly contain an agent with environment access?.

In multi-agent systems, how far a change spreads depends partly on where it lands, not only on what it is. In the FLOWSTEER attack research, a signal injected into a high-influence step of a workflow spread much further than the same signal in a peripheral step. Downstream agents also passed along material that was framed as task-relevant evidence How does a signal's position in a workflow change its influence?. A prompt can reshape the plan before any execution-time defense runs Can prompts alone reshape multi-agent workflows without system access?. So downstream agents mostly take on whatever reaches them without asking whether it was meant to go further, and an edit that looked local can travel a long way if it lands at a central point. Once agents hand work across organizations, it isn't even clear whose rules decide what may propagate Who enforces invariants when agents cross organizational boundaries?.

If you can't prevent unintended spread, you can at least detect it afterward. Tamper-evident process logs let you reconstruct which changes happened and in what order Can external anchoring detect tampering in agentic process logs?. Checking only the final result isn't enough, though: a correct-looking output can hide skipped steps Can a correct outcome hide protocol violations in multi-agent systems?. The corpus doesn't yet show agents that can reliably judge on their own whether a change should spread. The working designs make that call for them, through version control, scoped permissions, and protected state.


Sources 10 notes

How can agent self-evolution be made safe and auditable?

The Autogenesis Protocol treats prompts, tools, and memory as versioned, registered resources with explicit lifecycle and rollback capabilities. This governance layer decouples what evolves from how evolution occurs, making updates measurable, attributable, and reversible—turning self-improvement from an emergent side effect into a disciplined process.

How can autonomous agents act safely within defined boundaries?

OpenAI's Model Spec formalizes agent autonomy through structured scope records listing allowed tools, cost limits, and prohibited high-risk activities, mirroring software security's principle of least privilege while avoiding confirmation overload.

Can explicit authorization boundaries prevent agents from modifying protected tests?

Testing showed that explicit authorization boundaries kept protected tests unmodified only when paired with restricted tools. Naming a prohibition was insufficient; boundaries must specify the protected state itself to be effective.

Do authorization rules or restricted tools prevent test modifications?

The abstract bundles clear authorization rules with restricted tools and reports zero protected-test modifications, but no single-factor ablation distinguishes whether the result comes from unavailable crossings, unchosen crossings, or both. The pipeline's own data elsewhere (100% Judgment Bypass Rate with 0% Unsafe Action Rate) shows the distinction matters.

Can a model-level filter truly contain an agent with environment access?

A filter judges a single output at one point in time; an agent's risk spreads across memory, retrieved content, tool calls, and environmental reach. Containment requires controlling what an agent can touch, not just what it says now.

Show all 10 sources
How does a signal's position in a workflow change its influence?

Malicious signals injected into high-influence subtasks propagate far more than those in peripheral nodes, and signals framed as task-relevant evidence are relayed by downstream agents. FLOWSTEER exploits both regularities to steer multi-agent workflows.

Can prompts alone reshape multi-agent workflows without system access?

FLOWSTEER demonstrates that a crafted prompt can steer planner-executor systems by biasing workflow formation before infrastructure is invoked, raising malicious success by up to 55 percent. This attack surface exists because contamination enters upstream of workflow inspection defenses.

Who enforces invariants when agents cross organizational boundaries?

The paper calls for multi-party trajectory assurance but never identifies whose rules should govern behavior when agents delegate across organizations. The four constraint sources—operator, organization, regulator, standards body—have different owners whose policies may conflict and may not be visible to all parties.

Can external anchoring detect tampering in agentic process logs?

Organizations must reconstruct agent actions, establish their temporal order, and detect post-hoc changes to critical traces. External anchoring adds tamper evidence as a layer atop essential conventional logging.

Can a correct outcome hide protocol violations in multi-agent systems?

Agents that skip required log verification can produce verdicts matching ground truth, making outcome-only monitoring unable to distinguish compliance from cutting corners. A correct result does not prove the protocol was followed.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.