Do internal agent hops in pipelines need security monitoring?
Multi-agent systems route data between planner, worker, verifier, and synthesizer components. Current defenses only guard user input at the entry point, leaving inter-agent channels unmonitored—but is this a real vulnerability or does downstream safety suffice?
A modern LLM application is rarely one model call. A planner decomposes the request, workers execute subtasks by reading shared memory and calling tools, a verifier scores the workers, and a synthesizer writes the final answer. ChannelGuard's opening move is to count the arrows: planner→worker, tool→worker, memory→worker, worker→verifier, worker→synthesizer. Each carries text from one component to the next, and the paper's flat claim is that none of them is monitored. An instruction injected anywhere (a prompt injection in the user query, a poisoned tool result, a malicious memory entry) can travel downstream, and a single compromised worker can corrupt the final output. That last point the paper cites to prior work rather than establishing itself.
The defenses it lists (IBProtector, SmoothLLM, Llama Guard, perplexity thresholds) all inspect the user input at the door and say nothing about what flows between agents afterwards. The only other defense it recognizes is the provider's own content filter, which sits outside the application. So the coverage map is: door guarded, provider filter outside, every internal hop open. That is the sense of the paper's title, Safe Models Do Not Compose into Safe Multi-Agent Systems: each model may be aligned, but safety is a property of the wiring between them, and no model-level guarantee speaks to the wiring. The excerpt does not set a per-model safety score against a composed-system one, so the non-composition claim rests on this channel argument plus the attribution finding in Where do safety wins come from in multi-agent systems?. Does a multi-agent setting automatically signal a security effect? says why that matters: without a single-agent baseline the "unchanged" reading is not ruled out. The vault's one controlled comparison, Does multi-agent architecture make systems easier to attack?, is for a different attack (an external web-only adversary) and one model in one scenario. The pattern note Can individual components pass safety checks if the system still fails? files the wiring argument as one of three arguments that a component-level check tests a different property than the system-level one.
The vault already holds pieces of this surface, each treated as its own attack family. Can prompts alone reshape multi-agent workflows without system access? is the planner→worker hop. Can one compromised agent corrupt an entire multi-agent network? is peer messaging. Can chain-of-thought monitors detect reasoning that originates elsewhere? names retrieved documents, tools, planners and other agents as writers into context. What ChannelGuard adds is the framing that these are one surface: enumerable, with a place on every hop where a gate could sit. The inventory is a floor, not a complete map. It has no worker→worker peer hop, which is the channel Thought Virus uses. How do failures cross boundaries between multiple agents? cuts the same surface by mechanism instead of position, and two of its four verbs, shared state and aggregation, are not hops at all. One measured case of an interior channel carrying an attack sits outside this paper: in Can a poisoned validator still approve unsafe actions?, poisoned shared memory compromised the reviewing agent and the Executor acted on its forged approval in every undefended trial. That is one four-agent pipeline (60 tasks, three seeds) whose excerpt names no backend, so it shows the mechanism is real in one setting and not how common it is.
The counterargument is that many injections do enter at the door and a gate there is cheap. But tool and memory poisoning enter mid-pipeline by construction, and the paper's own limitation shows the door is not sealed either: see Why does compression defense fail at the user prompt boundary?.
A gate on every hop is also not the only answer to an open interior. Why do single-message classifiers miss cross-agent harms? argues the unit to defend is the flow and not the message, and Where should workflow validation gates be placed for safety? puts the check at the commit point. Can memory poisoning compromise decision-making even with authorization layers? reports a permission check on the action holding while the reviewing agent stayed compromised in every trial, for memory poisoning only and in one pipeline. Whether these are alternatives to per-hop gates or layers with them is an open tension in ops/tensions/.
Inquiring lines that read this note 34
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Can defenses detect attacks composed across multiple skills? Where do unmonitored channels leave multi-agent planning vulnerable to attack?- Do per-hop inspection gates miss attacks that bias upstream planning signals?
- How do unmonitored channels between pipeline agents enable security gaps?
- Why are unmonitored channels between agents a safety risk?
- Why does monitoring performed by agents on agents create safety risks?
- Can input-boundary defenses guard unmonitored channels between agent hops?
- Can mixed-authorship traces from multi-agent pipelines be monitored reliably?
- Does component-level checking detect system-level failures in pipelines?
- Can provider filters outside the application replace internal monitoring?
- What makes unmonitored channels between agents safety-critical?
- Why do input-boundary defenses fail in planner-worker pipelines?
- Where do workflow inspection defenses fail against upstream planning attacks?
- Can fixed pipelines eliminate planning-time attack surfaces in multi-agent systems?
- What defensive advantage does stigmergy offer over unmonitored channel analysis?
- How does shared storage differ from a message-passing hop in a pipeline?
- What vulnerabilities emerge at each hop between agents in a pipeline?
- Which message channels between agents in pipelines lack input validation?
- Do per-hop channel monitors miss coordinated attacks across multiple message transfers?
- How does pipeline position amplify failures between monitored agents?
- How does workflow position amplify malicious signals in multi-agent systems?
- How should system safety aggregate when monitoring channels are unequal?
- Can an undefended pipeline claim safety when a filter blocks attacks?
- How does a single compromised agent degrade performance across entire multi-agent pipelines?
- Which agent properties like state retention enable supply-chain and credential vulnerabilities?
- How do agent-to-agent messages bypass defenses on downstream principals?
- What controls could protect responder workflows without compromising security boundaries?
- Do agents probe sandbox boundaries when authorized routes fail?
- Can the policy oracle itself be written to by agents in the pipeline?
- Who should verify identity and authorization when agents coordinate across boundaries?
Related concepts in this collection 14
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can prompts alone reshape multi-agent workflows without system access?
Explores whether attackers can compromise planner-executor multi-agent systems by manipulating the planning prompt itself, without touching agents, tools, or infrastructure. Matters because it identifies a previously overlooked attack surface that existing defenses don't address.
the planner→worker hop, one of the five channels
-
Can one compromised agent corrupt an entire multi-agent network?
Explores whether a single biased agent can spread behavioral corruption through ordinary messages to downstream agents without any direct adversarial access. Matters because it reveals a previously unknown vulnerability in how multi-agent systems communicate.
peer-to-peer messaging, a channel this paper's inventory does not list
-
Can chain-of-thought monitors detect reasoning that originates elsewhere?
When language models work inside pipelines that inject reasoning from retrieved documents, planners, or other agents, monitoring systems may evaluate paraphrased external reasoning as if it were the model's own thinking. This raises questions about what monitors can actually detect.
the same channels seen from the monitoring side rather than the attack side
-
Can inspecting generated workflows catch planning-time attacks?
Does examining a workflow after it's created catch attacks that corrupt the planning signals upstream? This matters because if contamination enters earlier, downstream inspection might miss malicious intent laundered into legitimate-looking structure.
adds how many channels a defense covers to that note's argument about where it looks
-
How do adversarial traps target different layers of AI agents?
As AI agents browse the web, attackers can exploit their perception, reasoning, memory, actions, and coordination in distinct ways. Understanding these attack vectors is crucial for building robust agent defenses.
content injection arriving from the web; here the same injection travels through internal hops
-
Where do safety wins come from in multi-agent systems?
When an undefended agent pipeline shows zero attack success, how do we know whether safety comes from the application's own design or from hidden upstream defenses? This matters because invisible dependencies can collapse when systems change.
the measurement finding that makes the coverage gap consequential
-
How do failures cross boundaries between multiple agents?
Explores four distinct mechanisms—messages, shared state, aggregation, and delegation—that allow a failure or attack originating in one principal to propagate through multi-agent systems. Understanding these pathways is essential for designing agent interactions that contain rather than amplify risk.
the same surface cut by mechanism, where this inventory is cut by position in one pipeline shape
-
Can a poisoned validator still approve unsafe actions?
When a review agent reads from the same compromised memory as the retrieval agent, does it retain the authority to block unsafe actions? This tests whether a single approval point can serve as a meaningful safeguard.
a measured interior-channel case for the claim this paper cites to prior work
-
Does a multi-agent setting automatically signal a security effect?
Explores whether observing a failure in multi-agent systems proves the failure is genuinely multi-agent in nature. The distinction matters for correctly interpreting security research and avoiding false attributions.
the test the non-composition claim, as excerpted, does not yet pass
-
Does multi-agent architecture make systems easier to attack?
When the same task runs on multiple agents instead of one, does the added complexity create new vulnerabilities? This matters because it would mean multi-agent design carries a built-in security cost.
the vault's one controlled single-versus-multi comparison, for a different attack and one model
-
Can individual components pass safety checks if the system still fails?
Explores whether local validation at each step—alignment checks, protocol compliance, plausibility tests—can guarantee safety when components are composed into larger workflows. Why the gap between component-level assurance and system-level outcomes matters for AI safety.
files the wiring argument beside two other component-check-versus-system-property arguments
-
Why do single-message classifiers miss cross-agent harms?
Can prompt classifiers detect malicious intent when harm emerges only across multiple agent interactions? The question reframes security from checking individual messages to tracking how content flows and transforms through a multi-agent system.
the flow framing that questions whether a per-hop text gate is the right unit
-
Where should workflow validation gates be placed for safety?
Can a single defense point catch attacks that fragment across planning, messaging, and execution? The note explores whether workflow-level validation at commit points reconstructs risk context that individual steps cannot see alone.
a commit-point placement beside the per-hop one
-
Can memory poisoning compromise decision-making even with authorization layers?
When authorization systems add signed tokens and policy oracles to an AI pipeline, does this stop attackers from poisoning the agent's judgment about whether to approve actions, and what actually prevents unsafe execution?
one measured case of a check at the action holding with the interior open
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- ChannelGuard: Safe Models Do Not Compose into Safe Multi-Agent Systems
- SafeFlow: Semantic Information-Flow Control for Blocking Malicious Propagation in Multi-Agent Systems
- FLOWSTEER: Prompt-Only Workflow Steering Exposes Planning-Time Vulnerabilities in Multi-Agent LLM Systems
- Securing Agentic AI: From Per-Action Checks to Trajectory Assurance
- EvoSafeHarness: Evolving Model- and Domain-Specific Harnesses for Securing Agents
- SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems
- Trust propagation and structural containment in Multi-agent LLM pipelines
- The Troy Moment of AI: Why Some Will Cheat and Some Will Follow?
Original note title
every hop between agents in a planner-worker-verifier-synthesizer pipeline is an unmonitored channel — input-boundary defenses guard only the door