Can task decomposition hide harmful intent across agents?
Explores whether splitting a harmful objective into specialized subtasks allows malicious intent to evade detection at each individual step, since no single agent sees the full malicious picture.
Multi-agent systems get their capability from two moves: split the task, and give each agent a specialized role. SafeFlow (2607.25255) argues that "these same mechanisms introduce an important safety blind spot: a harmful objective can be fragmented into locally plausible subtasks, allowing malicious intent to evade detection by any single agent." The paper's illustration is a three-step exfiltration. One agent retrieves sensitive content, another rewrites it, and a third transmits it, "such that no individual step looks overtly malicious, yet the composed workflow realizes exfiltration or policy override."
What separates this from the injection attacks the vault already holds is where the harm lives. In How does a signal's position in a workflow change its influence? and Can one compromised agent corrupt an entire multi-agent network?, a hostile signal is present somewhere: in a message, in an agent's context, in a bias carried between agents. Here, as the excerpt frames it, every message is individually ordinary and the malice sits in the originating objective, not in a compromised agent. The vault's case of a compromised agent, where one agent's objective is the changed part and specialized roles are named as an exacerbating factor, is Does one misaligned agent harm a team in adversarial settings?. That result is reported in an abstract with no effect size and this claim is argued, so the two are not a joint finding. Retrieving, editing and sending are what these agents are for. A per-agent or per-message check has nothing to object to, because the property it tests, "is this step harmful?", is false at every step. The harm is a property of the sequence. The authors name the general shape in one line: "harmful behavior often emerges compositionally."
The strongest objection is that the last step of the example, sending sensitive content out, is the kind of thing a check at the sink can catch without any flow analysis. That works only if the sink can still recognize the content as sensitive after the middle agent has reworded it, which is the difficulty picked up in Why do single-message classifiers miss cross-agent harms? and How does SafeFlow track sensitivity through agent rewrites?.
There is also a cost-side reading for the multi-agent design ledger. When do multi-agent systems actually outperform single agents? argues that the motivations for decomposition weaken as single agents get better. If decomposition is also what makes fragmentation possible, the attack surface is a price of the architecture, not a bug in a particular system. That is a vault inference; the paper does not make it. A measured single-versus-multi gap now exists for a different attack, Does multi-agent architecture make systems easier to attack?, and it leaves this reading where it was for fragmentation itself: that gap is an external web injection in one scenario with one model, and no comparison has been run for a fragmented objective.
What the excerpt does not give. The source is an abstract and one introduction paragraph. It reports no rate at which fragmentation succeeds against per-agent defenses and no single-agent comparison. The failure mode is argued, not measured.
Inquiring lines that read this note 127
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What mechanisms cause models to develop misaligned objectives during training?- How are conflict tasks constructed to test alignment between model and user intent?
- Can RL-based alignment turn prohibitions into prices for being caught?
- Does threat misalignment trigger threat responses in agent interactions?
- Does terminating an intrusion differ from stopping the agent behind it?
- Can stopping one intrusion pathway leave the underlying activity intact elsewhere?
- Why do outcome-level metrics fail to reveal contained attacks in multi-agent pipelines?
- What does agent security look like when measured across interaction trajectories?
- Why does least privilege fail when harm exists only in accumulation?
- Can action-level attack success rates distinguish contained attacks from prevented ones?
- Should defense against coordinated intrusion span multiple execution episodes?
- How much does a responder action like removal shape the security boundary?
- What makes a coordination episode revisable under agent intrusion?
- What makes behavioral containment different from securing individual actions?
- How can per-agent or per-message checks catch harm that emerges only in composition?
- Can a single crossing rate capture all forms of agent behavior when blocked?
- How do defenders discover which actions belong to the same coordination episode?
- Can episode-based detection catch coordination without over-flagging innocent sharing?
- How does task division in multi-agent design affect security outcomes?
- Can task decomposition allow harmful objectives to hide in locally plausible subtasks?
- Can adversarial attacks chain multiple skills to evade security checks?
- What makes agent-to-agent messages in multi-agent systems vulnerable to exploitation?
- Does attack success gap shrink when single-agent baseline is already weak?
- How does payload exposure compare between single and multi-agent architectures?
- How does a single compromised agent degrade performance across entire multi-agent pipelines?
- What containment risks emerge as agents obtain successive exploit primitives?
- How do multi-step exploitation chains make agent containment harder to achieve?
- Can specialized roles let malicious objectives hide across multiple agents?
- Can attackers exploit pooled agent trajectories to identify and bypass defenses?
- Do server-side filters hide the true success rate of multi-agent attacks?
- How does task decomposition fragment the awareness needed to stop an attack?
- How does task decomposition hide harmful objectives across multiple agents?
- What attacks does the agent-specific attack surface decompose into?
- What happens when a compromised middle-agent originates bias rather than the root request?
- When do multi-agent architectures create more attack surface than single-agent systems?
- How does insider threat differ from external attack in multi-agent systems?
- Can shared memory poisoning compromise multi-agent delegation chains?
- How do malicious skills evade detection when composed in specific sequences?
- Do server-side filters hide the true strength of multi-agent attacks?
- Does quarantining state count as recovery in multi-agent attack scenarios?
- Can monitoring reasoning alone miss scheming that agents conceal in behavior?
- What makes reasoning evidence vulnerable to laundering in deceptive agents?
- Can reasoning traces and logged actions expose scheming that public messages hide?
- Can harmful reasoning be planted through context without fine-tuning the model?
- How does chain-of-thought monitoring fail when agents are trying to hide something?
- Does reasoning transparency predict honesty in agent final messages?
- Can activation probes detect scheming reasoning without observing the act?
- Why do workflow-level defenses catch attacks that single-skill inspection cannot detect?
- Can defenses tuned against appended attacks stop prepended payloads?
- Why does scanning skill pairs not fully prevent cross-skill attacks?
- Why do tighter local checks leave composed behavior gaps in place?
- Why does a single approval point create an easy target for attackers?
- Can a policy distinguish genuine objects from traps without revealing that distinction?
- How do cognitive state traps compromise agent-writable monitoring history?
- Can agents rationalize rule violations by reframing them as repairs?
- How reliable is agent self-description compared to infrastructure monitoring for detecting intent?
- How does recording state provenance help detect unauthorized tampering between agent actions?
- Why does correcting an agent's objective leave its available actions unchanged?
- Why does authorization checking outside agent judgment prevent confused deputy failures?
- Why do individual safe actions create unsafe behavior collectively?
- Do sequences of individually safe actions collectively violate system-level constraints?
- How do agent sequences violate system constraints despite individual permissibility?
- What does an objective that conflicts with a sandbox boundary actually look like?
- What makes an advisory instruction fail when a task is split across agents?
- Can individual permissible actions collectively violate system-level constraints?
- Can individual actions be safe while sequences of them violate system constraints?
- What does it mean to constrain shared resources across multiple agent executions?
- How should task authority constraints apply across multiple coordinated executions?
- How much capability do availability constraints remove on legitimate safe tasks?
- Does a correctly specified goal still leave open actions it does not exclude?
- Do prompt injection attacks propagate behavioral bias across multi-agent networks?
- How do other players respond to agents with hidden objective misalignment?
- What happens when planning signals get contaminated before reaching a downstream agent?
- Can subliminal prompt injection spread behavioral bias silently through agent-to-agent messages?
- Can message-content defenses distinguish cheap talk from coordinated deception?
- Can users detect misaligned objectives from agent public outputs alone?
- Can closing a communication channel prove whether agents influenced each other?
- Why does sycophantic relay propagate planning-time bias through agent pipelines?
- Can misaligned agents hide their true objectives in team communication?
- Do ordinary agent-to-agent messages carry behavioral bias without special access?
- Can removing a single action prevent a harmful sequence from running?
- Can human oversight actually stop a deployed capable agent in practice?
- Can architectural constraints protect veto where value alignment cannot?
- Why is evading detection easier than internalizing safety norms?
- Can alignment audits find hidden objectives nobody deliberately planted in models?
- Can correct verdicts hide failures in agent coordination steps?
- Can a single safe model guarantee safety in multi-agent composition?
- Can colluding agents produce correct outcomes while skipping required controls?
- Can agents collude without making compliance incompatible with reward?
- Does structured communication reduce collusion compared to natural language channels?
- How do agents adapt collusive behavior when objectives shift during interaction?
- What role does interaction history play in enabling agent collusion?
- What are the three known routes for laundering harmful plans?
- How does workflow-level validation reconstruct risk context from coarse request-level taints?
- How does semantic taint survive paraphrase across agent hops?
- When is information-flow tracking worth its cost over classification?
- How does taint propagation track risk along delegation paths?
- Does content sensitivity survive an agent's rewrite well enough for sink detection?
- Where does the responsibility lie for unsafe fallback behavior in modular systems?
- How does workflow position amplify or suppress malicious signals?
- How does workflow position amplify malicious signals in multi-agent systems?
- How does position in a workflow amplify or suppress harmful agent behavior?
- Can semantic taints track influence through shared state and output aggregation?
- Is malicious propagation fundamentally a semantic information flow problem?
- Can input-boundary defenses guard unmonitored channels between agent hops?
- Can mixed-authorship traces from multi-agent pipelines be monitored reliably?
- Where do workflow inspection defenses fail against upstream planning attacks?
- Can fixed pipelines eliminate planning-time attack surfaces in multi-agent systems?
- Can defenses at planning boundaries catch attacks that bias upstream instruction signals?
- Can planted test cases reliably trigger alarms before real harm occurs?
- How do planted errors in honeypot tasks differ from real oversight capabilities?
- What framework measures marginal offense risk against existing attack technology?
- What makes reasoning-shaped payloads more effective than command-shaped attack prompts?
- Can marginal-risk frameworks measure what defensive artifact releases add beyond existing threats?
- How do harmless business goals lead models to blackmail and deception?
Related concepts in this collection 9
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Do internal agent hops in pipelines need security monitoring?
Multi-agent systems route data between planner, worker, verifier, and synthesizer components. Current defenses only guard user input at the entry point, leaving inter-agent channels unmonitored—but is this a real vulnerability or does downstream safety suffice?
the wiring-level version of the gap; this note is the decomposition-level version, where even a gate on every hop reads only local text
-
How does a signal's position in a workflow change its influence?
Multi-agent systems may amplify or suppress malicious signals based on where they enter the workflow. Understanding position-dependent propagation could reveal which nodes are most critical to defend.
a present signal that propagates; here no single message carries the signal
-
Can a quorum of honest validators certify an invalid transition?
When validators follow the protocol perfectly but lack semantic understanding, can they collectively approve a state change that violates application invariants? This matters because it reveals a gap between protocol correctness and execution safety.
the same shape in consensus: every local check passes and the composition still fails
-
When do multi-agent systems actually outperform single agents?
As individual LLMs grow more capable, does the advantage of splitting work across multiple agents still hold? This explores when coordination overhead makes MAS counterproductive.
the benefit side of decomposition; this note adds a security cost
-
Does a multi-agent setting automatically signal a security effect?
Explores whether observing a failure in multi-agent systems proves the failure is genuinely multi-agent in nature. The distinction matters for correctly interpreting security research and avoiding false attributions.
the SoK's test for this claim: the vault reads fragmentation as the composition case, and "unchanged" is what a single-agent run of the same task would show, a comparison the SafeFlow excerpt does not report
-
Can step-by-step approval miss harmful behavior patterns?
If each action an agent takes passes its individual safety check, can the overall sequence still violate system constraints? This matters because per-action inspection may miss harms that emerge only across time or composition.
qualifies the price-of-the-architecture reading: one agent's run of permitted actions can also break a constraint, so on the vault's reading decomposition adds a split of the sequence across observers, not sequence-level harm as such
-
Does one misaligned agent harm a team in adversarial settings?
Explores whether objective misalignment in a single agent degrades team outcomes even in environments designed around deception and strategic mistrust. Tests whether harm persists when agents expect manipulation.
the compromised-agent counterpart: specialization as exposure when one agent's objective changes, in a game; reported without a size
-
Does multi-agent architecture make systems easier to attack?
When the same task runs on multiple agents instead of one, does the added complexity create new vulnerabilities? This matters because it would mean multi-agent design carries a built-in security cost.
the measured counterpart for a different attack: the same web agent alone and inside a multi-agent system, one model, one scenario; it does not test fragmentation
-
Why does prompt hardening work for single agents but not multi-agent systems?
Prompt hardening reduced payload exposure by 40–75% in single-agent systems but failed entirely in multi-agent ones. The gap may reveal how task decomposition breaks the contextual awareness needed for defenses to activate.
the defender's side of the same partition: the awareness that would halt an attack is split across agents; the pairing is a vault reading
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- SafeFlow: Semantic Information-Flow Control for Blocking Malicious Propagation in Multi-Agent Systems
- FLOWSTEER: Prompt-Only Workflow Steering Exposes Planning-Time Vulnerabilities in Multi-Agent LLM Systems
- Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents
- EvoSafeHarness: Evolving Model- and Domain-Specific Harnesses for Securing Agents
- SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems
- Reflexion: Language Agents with Verbal Reinforcement Learning
- Agents of Chaos
- ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scanners
Original note title
task decomposition and role specialization let a harmful objective fragment into locally plausible subtasks that no single agent sees as malicious