INQUIRING LINE

Two AI tool calls can be identical, yet one is fine and one is an attack. Who decides which?

Can the same tool call be both authorized and unauthorized depending on intent?

This explores whether authorization belongs to the tool call itself or to the purpose and context around it, meaning whether an identical call can be legitimate in one setting and a violation in another.


This explores whether authorization belongs to the tool call itself or to the purpose and context around it. The corpus says it belongs to the context, and that this is one of the hardest problems in agent safety. Two calls can be byte-for-byte identical while one is fine and the other is part of an attack. The clearest case is task decomposition: a multi-agent system can split a harmful goal into steps that each look benign, so the harm only exists in the composition (Can task decomposition hide harmful intent across agents?). Attackers exploit this on purpose. Skill scanners score each skill alone, so an attacker can keep tuning every piece until it looks innocent while the chain still does what they want, reaching 96% average success against six scanners (Can attackers evade skill scanners by refining individual skills?).

Some work tries to make intent part of the call's identity. SafeFlow attaches a semantic label describing the original request and passes it along as work is delegated, so each downstream step inherits the risk context that fragmentation would otherwise strip away (Can semantic labels on requests prevent malicious propagation through agent networks?). A related idea is to record what actually happened rather than what was possible. Infrastructure-side tracking of authority-bearing transitions separates a task that merely exposed a hacking route from a run that actually used it, so an exposed task's score isn't automatically suspect (Can runtime instrumentation distinguish hacking exposure from actual exploitation?). Phone agents show a milder version. Finishing a task, respecting privacy, and reusing saved preferences turn out to be statistically separate skills, so one completed action sequence can count as a success and a privacy violation at once (Do phone agents succeed at all three critical tasks equally?).

Judging intent is fragile, though, because the judge can be fooled or arrive too late. A model-level filter evaluates one output at one moment, while an agent's risk spreads across memory, retrieved content, and tool reach (Can a model-level filter truly contain an agent with environment access?). A crafted prompt can steer a planner before any inspection defense runs (Can prompts alone reshape multi-agent workflows without system access?). And a validator that reads poisoned shared memory approved every unsafe action in an undefended four-agent pipeline (Can a poisoned validator still approve unsafe actions?). In that case the approval existed and looked like real authorization, but it rested on corrupted evidence.

The corpus's practical answer is to stop relying on intent alone and constrain what the agent can touch. Explicit rules that only named a prohibition failed to protect test files. They worked when the protected state was specified and paired with restricted tools (Can explicit authorization boundaries prevent agents from modifying protected tests?). Even that result is muddy, because the bundle has no single-factor ablation. So it can't say whether the agent was unable to cross the line or simply chose not to. The same pipeline reports a 100% judgment-bypass rate next to a 0% unsafe-action rate, which shows the difference matters (Do authorization rules or restricted tools prevent test modifications?). An agent that could cross a line but doesn't is in a very different position from one that has no way to. That gap is why the same call can be authorized in one case and not in another.


Sources 10 notes

Can task decomposition hide harmful intent across agents?

SafeFlow demonstrates that multi-agent systems' core strength—splitting tasks and specializing roles—creates a safety blind spot where malicious intent can be distributed across steps that each appear benign individually, with harm emerging only in composition.

Can attackers evade skill scanners by refining individual skills?

ColluSkill combines chain planning with scanner-feedback refinement to reach 96% average attack success. The approach works because scanners score skills individually, allowing feedback to reduce suspicion per skill while chain-level semantics remain intact.

Can semantic labels on requests prevent malicious propagation through agent networks?

SafeFlow attaches structured semantic labels to root requests and propagates them through the collaboration graph as work delegated, allowing each downstream step to inherit the original intent and risk context that fragmentation removes.

Can runtime instrumentation distinguish hacking exposure from actual exploitation?

Infrastructure-side recording of authority-bearing transitions distinguishes tasks that merely expose a hacking vector from runs that actually exercise one. This separation prevents every score from an exposed task being automatically suspect.

Do phone agents succeed at all three critical tasks equally?

MyPhoneBench demonstrates that task success, privacy-compliant completion, and saved-preference reuse are statistically distinct capabilities with no model dominating all three. Success-only rankings do not predict privacy or preference performance.

Show all 10 sources
Can a model-level filter truly contain an agent with environment access?

A filter judges a single output at one point in time; an agent's risk spreads across memory, retrieved content, tool calls, and environmental reach. Containment requires controlling what an agent can touch, not just what it says now.

Can prompts alone reshape multi-agent workflows without system access?

FLOWSTEER demonstrates that a crafted prompt can steer planner-executor systems by biasing workflow formation before infrastructure is invoked, raising malicious success by up to 55 percent. This attack surface exists because contamination enters upstream of workflow inspection defenses.

Can a poisoned validator still approve unsafe actions?

In a four-agent LangGraph system with authorization disabled, a validator that reads poisoned shared memory forges approvals in every trial, leading to execution of unsafe actions. The validator's position as final authority before action execution, combined with its access to corrupted evidence, made it ineffective as a boundary.

Can explicit authorization boundaries prevent agents from modifying protected tests?

Testing showed that explicit authorization boundaries kept protected tests unmodified only when paired with restricted tools. Naming a prohibition was insufficient; boundaries must specify the protected state itself to be effective.

Do authorization rules or restricted tools prevent test modifications?

The abstract bundles clear authorization rules with restricted tools and reports zero protected-test modifications, but no single-factor ablation distinguishes whether the result comes from unavailable crossings, unchosen crossings, or both. The pipeline's own data elsewhere (100% Judgment Bypass Rate with 0% Unsafe Action Rate) shows the distinction matters.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.