INQUIRING LINE

When AI agents face uncertainty with limited information, what drives some to keep grinding while others quit — and which wins?

How do agents differ in caution versus persistence across low-information scenarios?

This explores what makes an agent keep pushing versus hold back when it can't see the full picture — and what the corpus says drives that split.


This explores the tension between an agent that keeps grinding on a hard task and one that stops early or plays it safe when information is scarce — and the corpus suggests these aren't opposite virtues so much as different responses to uncertainty. The clearest signal on persistence comes from ultra-long-horizon work: across 17 frontier models on expert optimization tasks, the single best predictor of success wasn't how good the first attempt was, but whether the agent kept running the benchmark-edit-incorporate loop instead of quitting or burning its budget spinning What predicts success in ultra-long-horizon agent tasks?. Most models terminated early. That early termination is exactly the failure mode you'd call excess caution — and it shows the caution/persistence split is real and measurable, not just a personality metaphor.

But persistence only pays off when the agent can actually read its situation, and low information breaks that. When one model secretly controls every character in a social scene, LLMs look socially fluent; give the agents genuinely private information and they fail systematically, because they were skipping the grounding work that real information asymmetry demands Why do LLMs fail when simulating agents with private information?. So the same agent can look confident and capable right up until the information dries up — which means blind persistence in a low-information setting can just be persistence in the wrong direction.

What separates productive persistence from stubborn flailing is having a signal to update on. Agents that store verbal self-reflections in episodic memory can learn from trial and error precisely because a clean success/failure signal stops them from rationalizing — the binary feedback prevents them from talking themselves out of a real mistake Can agents learn from failure without updating their weights?. And it turns out successes and failures deserve different treatment: keeping wins as concrete demonstrations but abstracting failures into general lessons outperforms treating every episode the same Should successful and failed episodes be processed differently?. Persistence, in other words, is only as good as how carefully the agent metabolizes what each attempt taught it.

Here's the part you might not expect: agents may be systematically biased in how they read low-information outcomes. Language models show human-like asymmetric belief updating — optimism about the actions they chose, pessimism about the roads not taken — and this bias only appears when the model is framed as an agent making choices Do language models learn differently from good versus bad outcomes?. That's a caution-versus-persistence dial hidden inside the model itself: optimism about a chosen path fuels persistence, but in a low-information scenario it can curdle into confirmation bias, keeping the agent committed to a line it should abandon. The research frames this as possibly rational rather than a straight bug, which is what makes it slippery.

The throughline is that caution and persistence aren't traits you tune in isolation — they're downstream of feedback quality and autonomy. Reliable agents get that way by externalizing memory and procedure into a harness rather than leaning on raw model scale to power through Where does agent reliability actually come from?, and the safety literature argues risk climbs monotonically with how much autonomy you cede, favoring a governed spectrum over an all-out persistent agent Does AI risk increase with the autonomy we give it?. Read together, the corpus's answer is that you don't want a maximally cautious or maximally persistent agent — you want one whose persistence is gated by how well it can actually sense its own situation.


Sources 7 notes

What predicts success in ultra-long-horizon agent tasks?

Across 17 frontier models on 36 expert-curated optimization tasks, repeated benchmark-edit-incorporate cycles within a wall-clock budget proved the dominant success predictor. Most models terminated early or burned budget unproductively; Claude Opus 4.6 stood out as persistent.

Why do LLMs fail when simulating agents with private information?

Research shows LLMs perform well when one model controls all interlocutors but fail systematically when agents possess private information. This reveals that apparent social competence relies on grounding work that models skip in omniscient settings.

Can agents learn from failure without updating their weights?

Reflexion demonstrates that unambiguous environmental feedback (success/failure) enables agents to write useful self-diagnoses and improve across episodes without parameter updates. The binary signal prevents rationalization, and keeping reflections uncompressed preserves their usability.

Should successful and failed episodes be processed differently?

SkillRL demonstrates that treating successful episodes as concrete demonstrations and failures as abstracted lessons achieves state-of-the-art performance on complex tasks while using substantially less context than uniform approaches. The asymmetry mirrors human expert reasoning and avoids the degradation seen in uniform consolidation methods.

Do language models learn differently from good versus bad outcomes?

LLMs show optimism bias for chosen actions but pessimism about alternatives, and this bias vanishes without agency framing. Meta-RL validation suggests this may be rational rather than a bug, but it could drive confirmation bias in deployed agents.

Show all 7 sources
Where does agent reliability actually come from?

Research shows reliable LLM agents externalize three cognitive burdens—memory (state persistence), skills (procedural components), and protocols (structured interaction)—into a harness layer rather than relying on model scale alone. The harness unifies these externalities and eliminates the need for the model to solve the same problems repeatedly.

Does AI risk increase with the autonomy we give it?

Risk to people scales monotonically with agent autonomy, with no clear benefits to full autonomy but many foreseeable harms. A governed spectrum of autonomy levels is safer and more practical than either unrestricted agents or exhaustive oversight.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.

Research prompt for your LLMexpand ↓

Copy into ChatGPT or Claude to take this line of inquiry further — it asks the model to find newer work and re-test which earlier constraints still hold.

You are an AI-agent behavior analyst. Still-open question: how do agents differ in caution versus persistence across low-information scenarios, and is that split a tunable trait or downstream of feedback and autonomy?

What a curated library found — and when (dated claims, not current truth; findings span ~2023–2026):
- Across 17 frontier models on expert optimization tasks, the best predictor of success was persistence in the benchmark-edit-incorporate loop, not first-attempt quality; most models terminated early (~2026).
- LLMs look socially fluent when one model secretly controls every character, but fail systematically once given genuinely private information, skipping the grounding work asymmetry demands (~2024).
- Verbal self-reflections stored in episodic memory let agents learn from trial and error; a clean binary success/failure signal stops them rationalizing away real mistakes (~2023).
- Differential trajectory processing — keeping wins as concrete demos but abstracting failures into general lessons — beats treating every episode alike (~2025).
- Agents show human-like asymmetric belief updating: optimism about chosen actions, pessimism about roads not taken — appearing only when framed as an agent making choices (~2024).

Anchor papers (verify; mind their dates): AutoLab (arXiv:2606.05080, 2026); In-context learning agents are asymmetric belief updaters (arXiv:2402.03969, 2024); Is this the real life? Simulating Social Interaction (arXiv:2403.05020, 2024); CLIN (arXiv:2310.10134, 2023).

Your task: (1) RE-TEST EACH CONSTRAINT. For every finding, judge whether newer models, training, tooling, orchestration (memory, caching, multi-agent), or evaluation has RELAXED or OVERTURNED it. Separate the durable question from the perishable limit; cite what resolved it, and say plainly where a constraint still holds. (2) Surface the strongest contradicting or superseding work from the last ~6 months. (3) Propose 2 research questions that assume the regime has moved.

Cite arXiv IDs; flag anything you cannot ground in a real paper.