When should an agent stop acting and admit failure?
Agents can refuse to answer, but the critical challenge is timing: knowing at which step to abstain when a task becomes infeasible. This matters because premature or delayed stopping directly affects system reliability.
Standard LLM abstention is a single-turn answer-or-abstain choice. Agentic Abstention reframes it as a sequential decision problem: at each turn an agent can answer, abstain, or gather more information, and — crucially — the need to abstain may only become clear after interacting with the environment. A task can look feasible at the outset and reveal itself as unresolvable only several tool calls in. Evaluating 13 LLM-as-agent systems and 2 scaffolds over 28,000+ web-shopping, terminal, and QA tasks, the finding is not that agents lack the ability to abstain but that they lack the timing: some never abstain when they should, while others abstain only after many wasteful interactions.
This isolates a competence that task-completion benchmarks systematically miss. Reliability requires not just stronger execution but better judgment about when continued action stops being useful — a failure of stopping, not of capability. It connects to Why do RL agents stop asking informative questions?: both describe agents mismanaging low-information regimes, but where self-locking is over-caution, late abstention is under-caution — the agent keeps acting past the point of usefulness. The paper's fix, CONVOLVE, is notable because it distills interaction trajectories into reusable stopping rules supplied as context, improving timing without updating parameters — placing the missing competence in the prompt/scaffold layer rather than the weights, which means stopping behavior can be repaired at inference time.
Related concepts in this collection 2
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Why do RL agents stop asking informative questions?
RL-trained agents often fail to seek information effectively, despite being trained to do so. Understanding whether this reflects a capability gap or a training dynamics problem could reveal how to unlock better information-seeking behavior.
relates: both are low-information-regime failures, but opposite in direction (over- vs under-caution)
-
Are reasoning model collapses really failures of reasoning?
Explores whether language models hit a fundamental reasoning ceiling or whether text-only evaluation masks execution limitations. Examines how tool access might reveal hidden reasoning capabilities.
relates: both separate a reasoning-quality question from an action/execution-judgment question in agents
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Agentic Abstention: Do Agents Know When to Stop Instead of Act?
- AbstentionBench: Reasoning LLMs Fail on Unanswerable Questions
- Can Large Language Models Reason and Optimize Under Constraints?
- Silence is Not Consensus: Disrupting Agreement Bias in Multi-Agent LLMs via Catfish Agent for Clinical Decision Making
- Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Tasks
- What Does It Take to Be a Good AI Research Agent? Studying the Role of Ideation Diversity
- A Comment On "The Illusion of Thinking": Reframing the Reasoning Cliff as an Agentic Gap
- LiveMCP-101: Stress Testing and Diagnosing MCP-enabled Agents on Challenging Queries
Original note title
agentic abstention is a sequential decision not a single-turn judgment — the hard part is not whether an agent can stop but when