SYNTHESIS NOTE
TopicsReasoning Architecturesthis note

When should an agent stop acting and admit failure?

Agents can refuse to answer, but the critical challenge is timing: knowing at which step to abstain when a task becomes infeasible. This matters because premature or delayed stopping directly affects system reliability.

Synthesis note · 2026-07-17 · sourced from Reasoning Architectures
How do LLMs fail to know what they seem to understand? How do you navigate synthesis across fragmented research topics?

Standard LLM abstention is a single-turn answer-or-abstain choice. Agentic Abstention reframes it as a sequential decision problem: at each turn an agent can answer, abstain, or gather more information, and — crucially — the need to abstain may only become clear after interacting with the environment. A task can look feasible at the outset and reveal itself as unresolvable only several tool calls in. Evaluating 13 LLM-as-agent systems and 2 scaffolds over 28,000+ web-shopping, terminal, and QA tasks, the finding is not that agents lack the ability to abstain but that they lack the timing: some never abstain when they should, while others abstain only after many wasteful interactions.

This isolates a competence that task-completion benchmarks systematically miss. Reliability requires not just stronger execution but better judgment about when continued action stops being useful — a failure of stopping, not of capability. It connects to Why do RL agents stop asking informative questions?: both describe agents mismanaging low-information regimes, but where self-locking is over-caution, late abstention is under-caution — the agent keeps acting past the point of usefulness. The paper's fix, CONVOLVE, is notable because it distills interaction trajectories into reusable stopping rules supplied as context, improving timing without updating parameters — placing the missing competence in the prompt/scaffold layer rather than the weights, which means stopping behavior can be repaired at inference time.

Related concepts in this collection 2

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
13 direct connections · 144 in 2-hop network ·dense cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

agentic abstention is a sequential decision not a single-turn judgment — the hard part is not whether an agent can stop but when