Are AI models held back from their autonomy potential?
Anthropic measured Claude Code sessions over three months and found longest runtimes nearly doubled. This raises whether deployed AI agents operate well below their actual capability ceiling, and what explains the gap.
Anthropic's own research report states that "Claude Code is working autonomously for longer." Looking at its longest-running sessions, Anthropic reports that "the length of time Claude Code works before stopping has nearly doubled in three months, from under 25 minutes to over 45 minutes." Measured precisely as the 99.9th percentile turn duration, the figure "nearly doubled, from under 25 minutes to over 45 minutes" between October 2025 and January 2026. Anthropic frames the tail of the distribution, not the average, as "the more revealing signal," since "the longest turns tell us the most about the most ambitious uses of Claude Code, and point to where autonomy is heading."
The mechanism Anthropic gives is that "this increase is smooth across model releases," which it says would not be expected "if autonomy were purely a function of model capability" — a sharp jump would track each launch instead. The smoothness instead points to several factors acting together: "power users building trust with the tool over time, applying Claude to increasingly ambitious tasks, and the product itself improving." Anthropic's stated conclusion is that "existing models are capable of more autonomy than they exercise in practice," and, combined with its separate capability evaluations, that the two together describe "a significant deployment overhang, where the autonomy models are capable of handling exceeds what they exercise in practice."
This measurement runs the opposite empirical direction from Does granting agents more autonomy undermine human oversight?, which argues current agent design erodes the human's capacity to oversee as autonomy grows. Anthropic's data instead shows people granting Claude Code autonomy more slowly than the model could absorb it — a gap on the human side of restraint, not (in this telling) a gap caused by eroded capacity. It also supplies something Can we design AI autonomy separately from capability? explicitly lacked: that paper's five-level taxonomy was offered with "no user study, deployment data" showing where real products sit on the scale; Anthropic's turn-duration trend is a concrete, if indirect, data point that actual usage is clustered well below the ceiling the models could support.
The measurement is specific to Claude Code and Anthropic's own API traffic, not to agent products generally, so it does not establish that other agents or domains show the same overhang. Anthropic itself cautions that agents are "difficult to study empirically" because there is no agreed definition of an agent and no reliable way to stitch independent API requests into sessions. The figures are Anthropic's own internal telemetry, not externally audited, and the explanation for the smooth trend ("several potential factors") is offered as a plausible reading rather than a tested cause.
Inquiring lines that read this note 1
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Does expanding agent autonomy undermine human oversight capacity?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does granting agents more autonomy undermine human oversight?
Explores whether the design of autonomous AI systems—by giving agents greater independence—actually weakens the human overseer's ability to catch problems. Matters because oversight is a key safeguard against AI failures.
contrasts: this measurement shows autonomy granted lagging capability, not oversight capacity being outpaced by granted autonomy
-
Can we design AI autonomy separately from capability?
Explores whether an AI agent's autonomy—how much it operates without user involvement—is a design choice independent of what the agent can actually do. This matters because it opens autonomy to governance and calibration rather than treating it as fixed by capability.
supplies the empirical data point that framework's taxonomy lacked, on where real usage sits relative to the autonomy ceiling
-
Do experienced AI users trust agents more or just oversee differently?
Claude Code users with more experience auto-approve actions more often but also interrupt more frequently. Does this reveal changing trust levels, or a fundamental shift in how oversight works as people learn?
companion finding from the same report on how granted autonomy changes with user experience
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Measuring AI agent autonomy in practice
- When AI builds itself
- Summary of METR's predeployment evaluation of Claude Opus 5.5
- How AI is transforming work at Anthropic
- Anthropic Economic Index report: Cadences
- Agentic coding and persistent returns to expertise
- Agentic Misalignment: How LLMs Could Be Insider Threats
- Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLI
Original note title
Anthropic finds Claude Code's longest sessions nearly doubled to over 45 minutes — evidence of a deployment overhang in agent autonomy