Can chain-of-thought monitors detect reasoning that originates elsewhere?
When language models work inside pipelines that inject reasoning from retrieved documents, planners, or other agents, monitoring systems may evaluate paraphrased external reasoning as if it were the model's own thinking. This raises questions about what monitors can actually detect.
A CoT monitor is built on an unstated premise: the trace is the actor's own reasoning, so anything alarming in it is evidence about the actor. That premise holds for a model answering a bare prompt. It stops holding once the model works inside a pipeline, and the plan injection paper names the channels: retrieved documents in RAG, tool outputs, plans from upstream planner modules, and messages from other agents. In each, the context already contains reasoning-shaped text — rationales, plans, step lists — written by someone else, and the actor's own chain of thought builds on it.
The paper's finding is what happens at that seam: actors "paraphrase the injected plan provided in context as their own and act on it downstream without attributing it to the source." Paraphrase is the provenance eraser. The words in the trace are now the actor's words; the record says who is speaking, not who thought of it first. A monitor reading that trace has no field for "this step was inherited," so it evaluates a mixed-authorship document as if it had one author — and, per the authors, does so without "critical scrutiny" from the actor itself either.
This joins a cluster of upstream-channel results in the vault. Can inspecting generated workflows catch planning-time attacks? shows the planner as a contamination point; Can one compromised agent corrupt an entire multi-agent network? shows agent messages as one; Can safety training detect attacks hidden in context rather than commands? shows fabricated rationale in context as another. Plan injection adds the monitoring consequence: the trust boundary for CoT monitoring is the context window, not the model. Anything that can write reasoning-shaped text into context sits inside the monitored surface without being monitored.
What the paper measured, and what the pipeline claim adds. The excerpt's evidence is a single actor read by a monitor (multiple-choice, coding and math tasks, DeepSeek-R1); the four pipeline channels are named in its introduction and not tested, and harder agentic tasks are on its future-work list. Under the test in Does a multi-agent setting automatically signal a security effect?, the pipeline is a delivery route here: the same failure would occur in one actor handed the same planted text. So the claim of this note is that pipelines routinely supply such text, not that they make the failure worse; whether a pipeline amplifies it would take a single-actor-versus-pipeline comparison the excerpt does not report. That reading is the vault's, not the paper's.
The counterargument is that mixed authorship is the whole point of agentic pipelines — an agent that could not build on retrieved evidence or a planner's output would be useless — so "just don't trust inherited reasoning" is not available as a design. The narrower implication is that a monitor which never sees the context can't tell inherited reasoning from original reasoning; whether giving it the context and comparing helps is an untested candidate, taken up in Can monitors catch plan injection attacks in chain-of-thought reasoning?.
Inquiring lines that read this note 14
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Why is chain-of-thought effective despite invalid reasoning?- What makes chain-of-thought monitoring fundamentally fragile against optimization?
- Why does chain-of-thought monitoring fail on mixed-authorship reasoning traces?
- Why does chain-of-thought monitoring fail to catch scheming in reasoning traces?
- Does chain-of-thought monitoring fail by omission or by laundering of influence?
- What are the two distinct failure modes of chain-of-thought monitoring?
- Can a chain-of-thought falsely claim its own answer is unbiased?
- How does chain-of-thought monitoring fail when agents are trying to hide something?
- How should monitors flag reasoning that paraphrases retrieved context without over-alerting?
Related concepts in this collection 7
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can reasoning models be steered by injected context without detection?
This explores whether adversaries can plant harmful-but-benign-sounding reasoning in a model's context and have it followed while evading chain-of-thought monitors. The question matters because it tests whether monitoring reasoning traces can catch deception at inference time.
the attack result this note draws its architectural claim from
-
Can inspecting generated workflows catch planning-time attacks?
Does examining a workflow after it's created catch attacks that corrupt the planning signals upstream? This matters because if contamination enters earlier, downstream inspection might miss malicious intent laundered into legitimate-looking structure.
same principle at the planner: inspecting the downstream artifact misses upstream contamination
-
How does a signal's position in a workflow change its influence?
Multi-agent systems may amplify or suppress malicious signals based on where they enter the workflow. Understanding position-dependent propagation could reveal which nodes are most critical to defend.
the propagation mechanism by which inherited content looks native downstream
-
Can we detect when models hide their reasoning?
Chain-of-thought monitoring is meant to reveal how models reason, but research shows it fails in two distinct ways. Understanding these failure modes is critical for knowing whether safety monitoring actually works.
provenance erasure is the mechanism of the laundering failure mode
-
Do internal agent hops in pipelines need security monitoring?
Multi-agent systems route data between planner, worker, verifier, and synthesizer components. Current defenses only guard user input at the entry point, leaving inter-agent channels unmonitored—but is this a real vulnerability or does downstream safety suffice?
the attack-side inventory of the same seam: planner, tool and agent-to-agent hops carry text into a context, and it counts the hops no defense watches where this note counts what a trace monitor loses at them
-
How does SafeFlow track sensitivity through agent rewrites?
SafeFlow labels sensitive requests and propagates them through agent collaboration graphs, but the excerpt leaves unclear whether the taint tracks at the request level (coarse, survives rewrites) or content level (fine-grained, vulnerable to paraphrase). This distinction determines how well the system catches exfiltration without false alarms.
the same paraphrase problem at the label level: a provenance mark that lives in the text is lost when an agent rewrites it, and one that rides the delegation graph survives but over-labels
-
Does a multi-agent setting automatically signal a security effect?
Explores whether observing a failure in multi-agent systems proves the failure is genuinely multi-agent in nature. The distinction matters for correctly interpreting security research and avoiding false attributions.
the test applied above to separate a delivery route from an interaction effect
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety
- Corrupt Plans, Clean Traces: Evading Chain-of-Thought Monitoring with Plan Injection
- Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation
- Can We Trust AI Explanations? Evidence of Systematic Underreporting in Chain-of-Thought Reasoning
- Thought Anchors: Which LLM Reasoning Steps Matter?
- Measuring Faithfulness in Chain-of-Thought Reasoning
- Stealing Reasoning Traces from Proprietary LLM APIs
- A Comment On "The Illusion of Thinking": Reframing the Reasoning Cliff as an Agentic Gap
Original note title
chain-of-thought monitoring assumes a single-author trace — pipelines where retrieved documents tools planners and other agents supply reasoning make it a mixed-authorship record