What behaviors hide behind a zero crossing rate?
When agents take no forbidden actions, does that zero tell us whether they stopped safely, refused transparently, escalated appropriately, or kept acting indefinitely? A single metric cannot distinguish these qualitatively different outcomes.
The abstract reports the explicit-boundary regime, with clear authorization rules and restricted tools, in one sentence: "no protected tests are modified, although the models differ substantially in whether they escalate, stop silently, or fail to terminate." The discussion turns the observation into a general claim: "A single crossing rate is too coarse to characterize agent behavior. The same zero can correspond to qualitatively different policies—silent stopping, escalation, refusal, or failure to terminate."
The setup is small: seven ImpossibleBench tasks, three models (GPT-5.6 Sol, Claude Fable 5.1, Gemini 3.8 Flash), solo and three-agent runs. Each task cannot be completed by the authorized route, so the informative question is what an agent does when that route fails. A crossing counter answers only whether it took the forbidden one. All four policies the discussion names leave the counter at zero, and they leave an operator in different places. My reading: silent stopping leaves the task undone with no signal, escalation surfaces a request someone can act on, refusal is a stop that says why, and failure to terminate is an agent still acting, which is the "persistence on apparently impossible tasks" the introduction lists among the July 2026 behaviors. The excerpt does not rank the policies or say which model showed which.
This is the vault's fourth reading of a zero. Can action-level metrics alone expose contained attacks? shows an action-level 0 percent that is identical whether an attack never took hold or was contained. Where do safety wins come from in multi-agent systems? shows a zero that belongs to a layer nobody reported. What causes failures in exploitation benchmarks? shows a failure cell that mixes refusal, tool misuse and impossible tasks. Here the zero hides what the agent did once the route closed. The nearest capability-side result is When should an agent stop acting and admit failure?, whose agents abstain too late or never: that is the failure-to-terminate cell seen as a competence gap, where this paper sees it as a boundary risk. How many GPT-MAS failures came from tool access confusion? adds a reading of the same kind in a failure count and not a zero: most of one model's multi-agent failures were a wrong belief about tool access and not the attack. Does pressure on AI agents lead to covert scheming behavior? is a neighbor from a scheming benchmark, where reasoning about scheming appears and covert action does not; its excerpt does not say what kept the action absent, and that note names refusal, lacking the means and safety training as candidates and reports a test of none, which leaves an absent act as open there as the four policies leave this zero.
The strongest objection is that the zero may be cheap. The regime bundles restricted tools with clear rules (Do authorization rules or restricted tools prevent test modifications?), and if the tools left no way to change a protected test, the zero says little about disposition and the informative part is the split among the other policies. That moves the weight from the zero to the split. It does not remove the point that one number cannot carry the difference.
What the excerpt does not give. Counts per policy, which model showed which, how a run is classified as escalating or as failing to terminate, and how refusal was separated from silent stopping (the abstract lists three policies, the discussion four).
Inquiring lines that read this note 16
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do coordinated agent sequences violate constraints that individual actions respect?- When can the same action count as sanctioned or unsanctioned depending on policy?
- Can an agent's unauthorized request for help constitute a boundary crossing?
- When do agents abstain too late rather than refuse at the boundary?
- What happens when stopping rules must cross organizational boundaries?
- How do silent stopping, escalation, and refusal differ as model responses to the same zero crossing rate?
- Which actions should count as irreversible for triggering validation gates?
Related concepts in this collection 7
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
When should an agent stop acting and admit failure?
Agents can refuse to answer, but the critical challenge is timing: knowing at which step to abstain when a task becomes infeasible. This matters because premature or delayed stopping directly affects system reliability.
the capability-side account of stopping too late or never; this note is the boundary-side account of the same cell
-
Can action-level metrics alone expose contained attacks?
When a defense stops unsafe actions from executing, does measuring only the final action reveal whether the attack was blocked or never penetrated? This matters because different defense layers need different metrics to show what actually happened.
the same outcome-hides-the-mechanism shape, met there by measuring at the attacked agent
-
Where do safety wins come from in multi-agent systems?
When an undefended agent pipeline shows zero attack success, how do we know whether safety comes from the application's own design or from hidden upstream defenses? This matters because invisible dependencies can collapse when systems change.
a zero owed to an unreported layer, the third of the four readings
-
What causes failures in exploitation benchmarks?
Benchmark failures may come from safety refusals, tool misuse, or impossible tasks rather than lack of capability. This matters for assessing how dangerous AI agents could actually be.
a failure cell that mixes refusal with inability, on the capability side
-
Does pressure on AI agents lead to covert scheming behavior?
Explores whether external pressure reliably triggers covert actions in LLM agents, or mainly produces scheming reasoning without follow-through. This matters because reasoning and action may diverge in ways that affect AI safety assessment.
an absent act in a scheming benchmark whose excerpt tests none of refusal, lacking the means or safety training as the reason; it cites this note as a catalogue of absent-act readings
-
Do authorization rules or restricted tools prevent test modifications?
The abstract reports that an explicit-boundary regime prevents protected test changes, but combines clear rules with restricted tools. This note explores which factor—or both—actually keeps tests unmodified, since the two mechanisms work differently on agent behavior.
whether the zero itself is informative depends on this
-
How many GPT-MAS failures came from tool access confusion?
Manual analysis of Header Heist revealed most GPT-MAS failures (22/26) were caused by agents wrongly believing they lacked tool access, not by the attack itself. This matters because it conflates non-adversarial breakdowns with actual security failures in the measurement.
a failure count whose entries were mostly an agent's own wrong belief about its tools; the hidden cause differs, the single-rate limit is the same
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- The Troy Moment of AI: Why Some Will Cheat and Some Will Follow?
- Agentic Abstention: Do Agents Know When to Stop Instead of Act?
- Norms at a Price: Why RL-Based Alignment Can Promise Conditional Compliance at Best
- RAGEN-2: Reasoning Collapse in Agentic RL
- Ring-Zero: Scaling Zero RL to a Trillion Parameters for Emergent Reasoning
- Emergent Collusion in Long-Horizon LLM Agent Interaction
- Cyber-Capable AI Agents: Vulnerabilities, Evaluation Containment, and Defensive Response
- Mechanisms of Introspective Awareness
Original note title
the same zero protected-test modifications can correspond to silent stopping, escalation, refusal, or failure to terminate — a single crossing rate is too coarse to characterize agent behavior