Does isolating planning from untrusted data actually stop prompt injection?
Willison's Dual LLM pattern separates planning from untrusted content, but can attackers still manipulate the quarantined LLM to extract and misuse sensitive values from documents?
CaMeL's authors credit the Dual LLM pattern, "theoretically described by Willison (2023)," as "a significant step forward in defense strategies." It splits the agent in two: "a Privileged LLM," which plans the sequence of actions from the user's query alone and "never [sees] the content from potentially compromised data sources," and "a Quarantined LLM," which is "stripped of any tool-calling capabilities" and does the actual reading of untrusted documents. The design goal is that an injected instruction hidden in a document can influence only the quarantined half, which cannot call tools, so it "cannot call arbitrary tools with arbitrary arguments." CaMeL's authors still ask directly: "Is Dual LLM of Willison enough?" Their answer is no.
The paper's worked example shows why. The Privileged LLM plans correctly: find the meeting notes, extract the recipient's email and the document name, send it. But when the Quarantined LLM reads the meeting notes to extract those two values, "a malicious party with access to the meeting notes" has added text that influences it "to return data that causes an attacker-chosen file to be sent to an attacker-chosen address." The plan — the control flow — was never hijacked. What moved was a value inside the plan: "even if the global plan itself is not hijacked, the data being processed according to the plan is manipulated, which can cause malicious actions to be executed." Isolating who plans from who reads untrusted data does not isolate the values that reading produces from that data's influence.
This sits one layer below Can inspecting generated workflows catch planning-time attacks?, whose argument is that the plan itself can be contaminated before it is organized into a workflow. Willison's pattern already defends the layer that note is concerned with — the Privileged LLM's plan stays clean because it never touches the untrusted document. The CaMeL authors' point is that clean-plan security is not sufficient: the attack surface moves one step down, into the step-by-step data extraction the plan calls for, which is exactly where Can capability tracking stop prompt injection attacks? adds capability checks. It is also the concrete case Why do single-message classifiers miss cross-agent harms? describes abstractly: a value should carry forward where it came from as it crosses from document to extracted field to tool argument, and Willison's pattern has no mechanism to make that label travel.
The excerpt gives this as a single illustrative scenario from CaMeL's related-work discussion, not a measured attack-success rate against deployed Dual LLM systems — there is no reported frequency for how often this bypass succeeds in practice. The implication the paper draws from it is narrower and structural: isolating the planner from untrusted content secures the control flow but says nothing about the data flow, so the Dual LLM pattern alone should not be treated as a complete prompt-injection defense.
Inquiring lines that read this note 7
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Does prompting inject new knowledge into models or activate existing knowledge? Can formal safety constraints prevent AI agents from exceeding authorized boundaries? How do prompt injection attacks compromise agent reasoning and security?- Why is prompt injection better understood as a flow problem?
- What attacks work entirely within text without changing data flow?
- What defenses do text-to-text injection attacks still need?
- How does symbolic matching on tool names prevent prompt injection attacks?
- Why does isolating the planner fail to stop value manipulation attacks?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can capability tracking stop prompt injection attacks?
Can tracking data and control flow through a custom interpreter enforce security policies strong enough to block prompt injection? This matters because LLMs used by agents need defenses that work regardless of the model's training.
the fix CaMeL builds for exactly the gap this note identifies in the predecessor pattern
-
Can inspecting generated workflows catch planning-time attacks?
Does examining a workflow after it's created catch attacks that corrupt the planning signals upstream? This matters because if contamination enters earlier, downstream inspection might miss malicious intent laundered into legitimate-looking structure.
the layer above this one: contamination of the plan itself, which Willison's pattern already defends against
-
Why do single-message classifiers miss cross-agent harms?
Can prompt classifiers detect malicious intent when harm emerges only across multiple agent interactions? The question reframes security from checking individual messages to tracking how content flows and transforms through a multi-agent system.
the abstract version of the same failure: a value's untrusted origin needs to travel with it across steps, which no classifier or planner isolation alone provides
-
Do internal agent hops in pipelines need security monitoring?
Multi-agent systems route data between planner, worker, verifier, and synthesizer components. Current defenses only guard user input at the entry point, leaving inter-agent channels unmonitored—but is this a real vulnerability or does downstream safety suffice?
evidence for: ChannelGuard's claim that no existing defense monitors agent-to-agent hops explains why Dual LLM's quarantined-LLM channel stays exploitable
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Defeating Prompt Injections by Design
- Design Patterns for Securing LLM Agents against Prompt Injections
- ChannelGuard: Safe Models Do Not Compose into Safe Multi-Agent Systems
- Corrupt Plans, Clean Traces: Evading Chain-of-Thought Monitoring with Plan Injection
- Trust propagation and structural containment in Multi-agent LLM pipelines
- LLMs Corrupt Your Documents When You Delegate
- FLOWSTEER: Prompt-Only Workflow Steering Exposes Planning-Time Vulnerabilities in Multi-Agent LLM Systems
- SafeFlow: Semantic Information-Flow Control for Blocking Malicious Propagation in Multi-Agent Systems
Original note title
Willison's Dual LLM pattern isolates planning from untrusted data but not data processing — the quarantined LLM can still be manipulated