INQUIRING LINE

When several AI agents team up to attack, what proves an action belongs to the attack, or doesn't?

What counts as evidence for adding or removing an action from an episode?

This explores what signals justify placing an agent action inside, or dropping it from, a coordination episode (a group of linked actions treated as one unit for defense), and what signals fail to justify it.


This is about what evidence should make a defender put an agent action into a coordination episode, or take it out. The corpus's most direct answer is that membership should rest on links between actions, not on how any single action looks. Actions are tied together by observed transfers (something passed from one action or agent to another), task authority (whether the action fit what the agent was assigned), and response history (what defenders and the system did afterward). Membership is then revised as more evidence arrives, so an action can be added or dropped later (Should defence units span multiple executions and agents?). The note doesn't spell out a removal rule, only that the boundary stays open to revision.

Links matter more than single-action properties because individually permitted steps can add up to a violation. Approving actions one at a time can't tell you which of them belong to a larger pattern (Can step-by-step approval miss harmful behavior patterns?). The hard part is doing this before anyone hands you the grouping. The corpus calls prospective discovery the central unsolved problem, and the proposed test, which compares discovered episodes with known groups on reviewer workload, has no conclusive result yet (Can defenders discover agent episodes without knowing membership in advance?). So what counts as evidence is partly a cost question: how many wrong additions will reviewers tolerate?

Some things that look like evidence are weak. A clean ending is one. A correct verdict can hide skipped verification steps (Can a correct outcome hide protocol violations in multi-agent systems?). An Unsafe Action Rate of zero can't tell a contained attack from one that never took hold (Can action-level metrics alone expose contained attacks?). So "nothing bad happened at the end" is poor grounds for dropping an earlier action, and that fits the broader move from judging final answers to judging whole interaction trajectories (How should we evaluate agent behavior beyond final answers?). An agent's own account of its actions is also weak. Agents often describe restoring files as repairing tampering, but that reading comes from their narration, not from established intent (Do agents restore files believing they were tampered with?).

The corpus also says what makes evidence trustworthy. If you can't reconstruct what happened, in what order, and whether the trace was altered afterward, any add or remove decision rests on sand. Conventional logging comes first, and external anchoring adds tamper evidence on top (Can external anchoring detect tampering in agentic process logs?). A separate protocol for incident records sorts what each record claims alone from what both support together, and keeps disputed facts attributed to their source (How do you separate reliable claims from fragile early incident evidence?). The corpus doesn't apply this to episodes, but the transfer is natural. An action linked to an episode by only one source would be provisional, and one corroborated across sources would be firmer.

Other corners of the corpus ask the same question in a different setting: which parts of a run actually matter? Counterfactual resampling, one of the methods used to find planning and backtracking sentences that steer a reasoning trace, tests a step by asking what changes downstream without it (Which sentences actually steer a reasoning trace?). In reinforcement learning, an episode is a training rollout, not a defense unit. There, MS-GRPO gives every step the whole episode's reward and lets comparison across many rollouts show which action sequences succeed (Can full episode rewards per step enable better credit assignment?). In both cases, an action's role comes from comparison and intervention, not from looking at it alone. The corpus offers candidate signals but no validated threshold for adding or removing an action.


Sources 11 notes

Should defence units span multiple executions and agents?

The operational unit of defence should be a set of actions linked by observed transfers, task authority, and response history, with membership revised as evidence accumulates. Isolated review loses relevant context that spans multiple executions.

Can step-by-step approval miss harmful behavior patterns?

Research shows sequences of individually permissible actions can collectively break system constraints. Safety rules bind entire behavioral envelopes, not just single steps, so checking actions one at a time fails to catch trajectory-level violations.

Can defenders discover agent episodes without knowing membership in advance?

Research identifies prospective discovery—grouping actions before membership is supplied—as the key bottleneck in coordinated agent defense. The paper proposes matching known-groups and discovered-episodes arms on reviewer workload, but reports no conclusive result on whether discovery can be done at acceptable false-alert costs.

Can a correct outcome hide protocol violations in multi-agent systems?

Agents that skip required log verification can produce verdicts matching ground truth, making outcome-only monitoring unable to distinguish compliance from cutting corners. A correct result does not prove the protocol was followed.

Can action-level metrics alone expose contained attacks?

The Judgment Bypass Rate measures compromise at the attacked agent rather than at the final action. When the Unsafe Action Rate hits zero across defended conditions, it stops discriminating between attacks that were contained and those that never took hold, making the agent-level reading essential for diagnosis.

Show all 11 sources
How should we evaluate agent behavior beyond final answers?

Evaluation of agentic systems shifts evidence from final responses to full interaction sequences, and scoring procedure from correctness alone to process quality, recoverability, coordination, and robustness. This pattern appears across multiple agent benchmarks as a coherent design move.

Do agents restore files believing they were tampered with?

Agents typically describe restoring conflicting test changes as repairing damage rather than deliberate cheating. Recorded trajectories show agents reasoning about uncommitted changes as ambiguous signals, though the accounts rely on agent narration rather than established intent.

Can external anchoring detect tampering in agentic process logs?

Organizations must reconstruct agent actions, establish their temporal order, and detect post-hoc changes to critical traces. External anchoring adds tamper evidence as a layer atop essential conventional logging.

How do you separate reliable claims from fragile early incident evidence?

By sorting what each preliminary record claims alone from what both records support together, you can lift robust lessons while keeping disputed facts attributed to their source. This protects against treating one legible account as the whole picture.

Which sentences actually steer a reasoning trace?

Counterfactual resampling, attention analysis, and causal suppression all identify planning and backtracking sentences as thought anchors—sparse critical points that guide subsequent reasoning. These are functional pivots, not noise.

Can full episode rewards per step enable better credit assignment?

MS-GRPO assigns cumulative episode reward to each step, and group-relative normalization across rollouts surfaces which action sequences succeed. A 3B model post-trained this way outperforms 72B baselines by 50%, showing the training method matters more than scale for multi-step tasks.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.