Is stopping one AI agent from going wrong the same job as stopping that mistake from snowballing across many agents?
Does amplifying a single-actor failure require different security defenses than preventing it?
This explores whether stopping one AI agent from failing calls for the same defenses as stopping that failure from spreading and growing across a network of agents.
This explores whether stopping one AI agent from failing calls for the same defenses as stopping that failure from spreading and growing across a network of agents. The corpus says mostly yes, they differ, but only when the spread is real. Does a multi-agent setting automatically signal a security effect? sorts what happens when agents interact into four outcomes: the failure stays unchanged, gets amplified, arises from composition, or becomes a new property. Only the last three are genuinely multi-agent problems. An unchanged failure is a single-agent problem repackaged, and ordinary single-agent defenses still cover it.
Even single-agent prevention turns out to be about reach rather than wording. Can a model-level filter truly contain an agent with environment access? points out that a filter judges one output at one moment, while an agent's risk spreads across memory, retrieved content, tool calls and environmental access. Containment means controlling what the agent can touch. Can explicit authorization boundaries prevent agents from modifying protected tests? shows the same thing in practice. Telling an agent not to modify protected tests worked only when the tools were also restricted. So prevention lives in access and state, and that is the foundation amplification defenses build on.
Amplification breaks the checks that work on one piece at a time. Can one compromised agent corrupt an entire multi-agent network? shows one biased agent passing persistent corruption through six downstream agents using only ordinary messages. Paraphrasing defenses fail because the bias carries no explicit semantic content, so inspecting each message can't catch it. Can attackers evade skill scanners by refining individual skills? finds the same pattern. Scanners score skills one by one, so an attacker can lower suspicion per skill while the harmful chain stays intact, reaching 96% average attack success. Can prompts alone reshape multi-agent workflows without system access? adds a third version: a crafted prompt steers how the workflow is formed, upstream of the inspection defenses, and raises malicious success by up to 55 percent. Can attackers manipulate which model handles a request? shows the same shape one layer down, where routing decisions sit beneath prompt-level defenses. Each check is sound for the piece it examines, but the attack lives in the relationships between pieces or upstream of the check.
The defenses proposed for amplification change what gets defended. Should defence units span multiple executions and agents? argues the unit should be a coordination episode: a set of actions linked by observed transfers, task authority and response history, with membership revised as evidence comes in. How can operators stop coordinated agent intrusions now? turns that into three constraints: preserve relationships across executions, limit the shared resources agents can reach, and tie responses to persistent state. Operators can start now with collaboration policy and permission-level testing. In short, prevention asks whether this actor's action is acceptable. Amplification defense asks what has passed between actors and what they share.
The corpus has one gap. Can we detect objective-misaligned agents from their public speech alone? reports that a compromised agent's objective-driven reasoning stays largely invisible in public speech, but it names no detector and gives no detection rates. So there is a worked-out doctrine for containing spread, but no validated way to spot the first compromised agent from outside.
Sources 10 notes
Interaction between agents can leave failures unchanged, amplify them, create them through composition, or define new properties. Only amplification, composition, and emergent properties qualify as genuinely multi-agent effects; unchanged failures reflect single-agent problems repackaged.
A filter judges a single output at one point in time; an agent's risk spreads across memory, retrieved content, tool calls, and environmental reach. Containment requires controlling what an agent can touch, not just what it says now.
Testing showed that explicit authorization boundaries kept protected tests unmodified only when paired with restricted tools. Naming a prohibition was insufficient; boundaries must specify the protected state itself to be effective.
Research demonstrates that a single biased agent can transmit persistent behavioral corruption through six downstream agents in chain and bidirectional topologies using only normal inter-agent communication. The bias evades detection and paraphrasing defenses because it carries no explicit semantic content.
ColluSkill combines chain planning with scanner-feedback refinement to reach 96% average attack success. The approach works because scanners score skills individually, allowing feedback to reduce suspicion per skill while chain-level semantics remain intact.
Show all 10 sources
FLOWSTEER demonstrates that a crafted prompt can steer planner-executor systems by biasing workflow formation before infrastructure is invoked, raising malicious success by up to 55 percent. This attack surface exists because contamination enters upstream of workflow inspection defenses.
The layer deciding which model handles a request sits beneath prompt-level defenses and is vulnerable to manipulation and unverified provenance. Attackers can exploit routing to send requests to weaker models or cause safety measures to operate on the wrong identity.
The operational unit of defence should be a set of actions linked by observed transfers, task authority, and response history, with membership revised as evidence accumulates. Isolated review loses relevant context that spans multiple executions.
The doctrine preserves relationships across executions, constrains shared resources agents can access, and ties responses to persistent state rather than closed channels. Operators can implement this through collaboration policy and permission-level testing now.
Research states that compromised agents' objective-dependent reasoning stays largely invisible in public cheap talk, but provides no detection rates, specifies no detector (other players, LLM judge, or statistical test), and offers no validation against actual transcripts.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems
- Securing Agentic AI: From Per-Action Checks to Trajectory Assurance
- Counter-Swarm Doctrine: Containing Coordinated Agent Intrusions
- ChannelGuard: Safe Models Do Not Compose into Safe Multi-Agent Systems
- FLOWSTEER: Prompt-Only Workflow Steering Exposes Planning-Time Vulnerabilities in Multi-Agent LLM Systems
- Emergent Collusion in Long-Horizon LLM Agent Interaction
- Can AI Agents Agree?
- SafeFlow: Semantic Information-Flow Control for Blocking Malicious Propagation in Multi-Agent Systems