When AI agents face uncertainty with limited information, what drives some to keep grinding while others quit — and which wins?
How do agents differ in caution versus persistence across low-information scenarios?
This explores what makes an agent keep pushing versus hold back when it can't see the full picture — and what the corpus says drives that split.
This explores the tension between an agent that keeps grinding on a hard task and one that stops early or plays it safe when information is scarce — and the corpus suggests these aren't opposite virtues so much as different responses to uncertainty. The clearest signal on persistence comes from ultra-long-horizon work: across 17 frontier models on expert optimization tasks, the single best predictor of success wasn't how good the first attempt was, but whether the agent kept running the benchmark-edit-incorporate loop instead of quitting or burning its budget spinning What predicts success in ultra-long-horizon agent tasks?. Most models terminated early. That early termination is exactly the failure mode you'd call excess caution — and it shows the caution/persistence split is real and measurable, not just a personality metaphor.
But persistence only pays off when the agent can actually read its situation, and low information breaks that. When one model secretly controls every character in a social scene, LLMs look socially fluent; give the agents genuinely private information and they fail systematically, because they were skipping the grounding work that real information asymmetry demands Why do LLMs fail when simulating agents with private information?. So the same agent can look confident and capable right up until the information dries up — which means blind persistence in a low-information setting can just be persistence in the wrong direction.
What separates productive persistence from stubborn flailing is having a signal to update on. Agents that store verbal self-reflections in episodic memory can learn from trial and error precisely because a clean success/failure signal stops them from rationalizing — the binary feedback prevents them from talking themselves out of a real mistake Can agents learn from failure without updating their weights?. And it turns out successes and failures deserve different treatment: keeping wins as concrete demonstrations but abstracting failures into general lessons outperforms treating every episode the same Should successful and failed episodes be processed differently?. Persistence, in other words, is only as good as how carefully the agent metabolizes what each attempt taught it.
Here's the part you might not expect: agents may be systematically biased in how they read low-information outcomes. Language models show human-like asymmetric belief updating — optimism about the actions they chose, pessimism about the roads not taken — and this bias only appears when the model is framed as an agent making choices Do language models learn differently from good versus bad outcomes?. That's a caution-versus-persistence dial hidden inside the model itself: optimism about a chosen path fuels persistence, but in a low-information scenario it can curdle into confirmation bias, keeping the agent committed to a line it should abandon. The research frames this as possibly rational rather than a straight bug, which is what makes it slippery.
The throughline is that caution and persistence aren't traits you tune in isolation — they're downstream of feedback quality and autonomy. Reliable agents get that way by externalizing memory and procedure into a harness rather than leaning on raw model scale to power through Where does agent reliability actually come from?, and the safety literature argues risk climbs monotonically with how much autonomy you cede, favoring a governed spectrum over an all-out persistent agent Does AI risk increase with the autonomy we give it?. Read together, the corpus's answer is that you don't want a maximally cautious or maximally persistent agent — you want one whose persistence is gated by how well it can actually sense its own situation.
Sources 7 notes
Across 17 frontier models on 36 expert-curated optimization tasks, repeated benchmark-edit-incorporate cycles within a wall-clock budget proved the dominant success predictor. Most models terminated early or burned budget unproductively; Claude Opus 4.6 stood out as persistent.
Research shows LLMs perform well when one model controls all interlocutors but fail systematically when agents possess private information. This reveals that apparent social competence relies on grounding work that models skip in omniscient settings.
Reflexion demonstrates that unambiguous environmental feedback (success/failure) enables agents to write useful self-diagnoses and improve across episodes without parameter updates. The binary signal prevents rationalization, and keeping reflections uncompressed preserves their usability.
SkillRL demonstrates that treating successful episodes as concrete demonstrations and failures as abstracted lessons achieves state-of-the-art performance on complex tasks while using substantially less context than uniform approaches. The asymmetry mirrors human expert reasoning and avoids the degradation seen in uniform consolidation methods.
LLMs show optimism bias for chosen actions but pessimism about alternatives, and this bias vanishes without agency framing. Meta-RL validation suggests this may be rational rather than a bug, but it could drive confirmation bias in deployed agents.
Show all 7 sources
Research shows reliable LLM agents externalize three cognitive burdens—memory (state persistence), skills (procedural components), and protocols (structured interaction)—into a harness layer rather than relying on model scale alone. The harness unifies these externalities and eliminates the need for the model to solve the same problems repeatedly.
Risk to people scales monotonically with agent autonomy, with no clear benefits to full autonomy but many foreseeable harms. A governed spectrum of autonomy levels is safer and more practical than either unrestricted agents or exhaustive oversight.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Useful Memories Become Faulty When Continuously Updated by LLMs
- Artifacts as Memory Beyond the Agent Boundary
- Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs
- Do Role-Playing Agents Practice What They Preach? Belief-Behavior Consistency in LLM-Based Simulations of Human Trust
- AgentFly: Fine-tuning LLM Agents without Fine-tuning LLMs
- AutoLab: Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks?
- RLVMR: Reinforcement Learning with Verifiable Meta-Reasoning Rewards for Robust Long-Horizon Agents
- LLMs Corrupt Your Documents When You Delegate