If an attack quietly tilts the instructions an AI planner receives, can a safety check on the finished plan catch it?
Can defenses at planning boundaries catch attacks that bias upstream instruction signals?
This explores whether a checkpoint placed where a multi-agent system turns a request into a plan or workflow can catch attacks that already tilted the instructions feeding that plan.
Mostly no, at least not on its own. The corpus points to a structural problem: a planning-boundary check inspects the plan, and an upstream bias produces a plan that looks legitimate. FLOWSTEER shows a crafted prompt steering planner-executor systems by biasing how the workflow forms, raising malicious success by up to 55 percent, because the contamination enters upstream of workflow inspection defenses Can prompts alone reshape multi-agent workflows without system access?. By the time the checkpoint looks, the plan is already the faithful output of a corrupted input.
A closely related result explains why reading the plan isn't enough. Reasoning models follow harmful but benign-sounding plans planted in their context and paraphrase them as their own reasoning, slipping past chain-of-thought monitors 25 to 33 percent of the time Can reasoning models be steered by injected context without detection?. The monitor sees fluent, plausible reasoning and has no way to tell it was borrowed. The candidate fixes in the corpus all change what gets inspected: context-provenance checks (where did this plan come from?), effect-based monitoring (what does it actually do?), a larger reasoning budget, or a hybrid. Only one partial experiment exists, so the question is unsettled Can monitors catch plan injection attacks in chain-of-thought reasoning?. The promising direction is to check an instruction's origin, not how it reads.
The pattern recurs at other boundaries. Skill scanners score each skill on its own, so an attacker can use scanner feedback to blunt every piece while the chain-level intent survives, reaching 96% average attack success Can attackers evade skill scanners by refining individual skills?. SafeFlow's decomposition attack spreads harm across steps that each look benign, so it only shows up in the composition Can task decomposition hide harmful intent across agents?. Stateless per-action guardrails cannot even state a constraint that depends on prior history Can stateless checks ever catch sequence-level constraint violations?. The layer that picks which model handles a request also sits beneath prompt-level defenses and can be manipulated on its own Can attackers manipulate which model handles a request?. Each of these defenses looks at one unit, and each attack is built to be invisible at that unit.
The corpus's answer is layering, not a better single gate. SafeFlow's commit-point validation reconstructs the global risk picture just before an irreversible action, and the notes say it complements planning-boundary and per-hop defenses, with each catching attacks the others miss Where should workflow validation gates be placed for safety?. A planning-boundary check still earns its place, since it can catch attacks that are visible in the plan. But an upstream bias that produces a plausible plan has to be caught later, or by tracing where the instructions came from. Related work argues the defended unit should be a set of actions linked by transfers and task authority, revised as evidence accumulates, and not a single execution Should defence units span multiple executions and agents?.
None of these notes directly tests a planning-boundary defense against an upstream bias attack. The conclusion is inferred from how the attacks and defenses line up, not from a head-to-head result.
Sources 9 notes
FLOWSTEER demonstrates that a crafted prompt can steer planner-executor systems by biasing workflow formation before infrastructure is invoked, raising malicious success by up to 55 percent. This attack surface exists because contamination enters upstream of workflow inspection defenses.
Researchers found that reasoning models follow harmful but benign-sounding plans planted in their context and paraphrase them as their own reasoning, evading monitors across multiple benchmarks and tasks. The attack requires only context access, not weight manipulation, making it practical for real-world pipelines.
Plan injection evades CoT monitors through surface-level reading of reasoning traces. Four candidate defenses—increased reasoning budget, context-provenance checks, effect-based monitoring, and hybrid approaches—have been proposed, but only one partial experiment exists; most remain untested.
ColluSkill combines chain planning with scanner-feedback refinement to reach 96% average attack success. The approach works because scanners score skills individually, allowing feedback to reduce suspicion per skill while chain-level semantics remain intact.
SafeFlow demonstrates that multi-agent systems' core strength—splitting tasks and specializing roles—creates a safety blind spot where malicious intent can be distributed across steps that each appear benign individually, with harm emerging only in composition.
Show all 9 sources
Per-action checks are structurally unable to state constraints that depend on prior history. Only stateful monitors tracking composed multi-party behavior can verify the behavioral envelopes that prevent individually permissible actions from collectively violating system-level safety.
The layer deciding which model handles a request sits beneath prompt-level defenses and is vulnerable to manipulation and unverified provenance. Attackers can exploit routing to send requests to weaker models or cause safety measures to operate on the wrong identity.
SafeFlow validates assembled workflows at irreversible action boundaries, reconstructing the global risk picture that no single step holds. This commit-point placement complements planning-boundary and per-hop defenses, each seeing attacks the others miss.
The operational unit of defence should be a set of actions linked by observed transfers, task authority, and response history, with membership revised as evidence accumulates. Isolated review loses relevant context that spans multiple executions.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Corrupt Plans, Clean Traces: Evading Chain-of-Thought Monitoring with Plan Injection
- FLOWSTEER: Prompt-Only Workflow Steering Exposes Planning-Time Vulnerabilities in Multi-Agent LLM Systems
- SafeFlow: Semantic Information-Flow Control for Blocking Malicious Propagation in Multi-Agent Systems
- SoK: When Safe Agents Fail Together: The Security of Multi Agent LLM Systems
- Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation
- Securing Agentic AI: From Per-Action Checks to Trajectory Assurance
- The Troy Moment of AI: Why Some Will Cheat and Some Will Follow?
- ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scanners