Do experienced AI users trust agents more or just oversee differently?
Claude Code users with more experience auto-approve actions more often but also interrupt more frequently. Does this reveal changing trust levels, or a fundamental shift in how oversight works as people learn?
Anthropic's research report measures how Claude Code users change their oversight behavior as they gain experience with the tool, and finds two numbers rising together. On auto-approval: "newer users (<50 sessions) employ full auto-approve roughly 20% of the time; by 750 sessions, this increases to over 40% of sessions." On interruption: "new users (those with around 10 sessions) interrupt Claude in 5% of turns, while more experienced users interrupt in around 9% of turns."
Anthropic names this "an apparent contradiction" and reads it as "a shift in users' oversight strategy" rather than a simple increase or decrease in trust. New users "are more likely to approve each action before it's taken, and therefore rarely need to interrupt Claude mid-execution." Experienced users instead "let Claude work autonomously, stepping in when something goes wrong or needs redirection" — oversight moves from pre-approval to monitoring-and-correction. Anthropic adds that the higher interrupt rate "may also reflect active monitoring by users who have more honed instincts for when their intervention is needed," and expects the per-turn rate to "eventually plateau," though it says widening confidence intervals at high session counts make that hard to confirm yet. A parallel pattern appears on Anthropic's public API, where "87% of tool calls on minimal-complexity tasks...have some form of human involvement, compared to only 67% of tool calls for high-complexity tasks" — which Anthropic itself calls "counterintuitive."
This complicates Can we design AI autonomy separately from capability?, whose taxonomy treats a user's role — operator, approver, observer, and so on — as a design choice a developer fixes for a given agent. Anthropic's data shows the same user moving across that spectrum as their own experience changes, without any change to the agent's design: toward something closer to approver or observer for routine actions, while retaining an operator-like interrupt capacity for the moments that need it. It also qualifies Does granting agents more autonomy undermine human oversight?: that paper frames extended use of agent systems as something that erodes the judgment oversight depends on, but Anthropic's experienced users interrupt more often, not less — consistent with sharpened rather than only degraded instincts, at least on this measure, though a rising interrupt rate against a shrinking share of reviewed actions does not rule out that each intervention now catches a smaller slice of total behavior.
The finding is Anthropic's own interpretation of its own product's telemetry, not a controlled study: the claim that experience changes oversight strategy, rather than that more experienced users simply select different or more trustworthy tasks, is offered as a probable reading ("may also reflect") rather than a demonstrated mechanism, and whether the interrupt rate truly plateaus is explicitly unconfirmed in the source.
Inquiring lines that read this note 12
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Does expanding agent autonomy undermine human oversight capacity?- How much agent behavior escapes user review once auto-approval rates rise?
- Does extended use of coding agents erode the skills needed for oversight?
- When developers delegate to other agents, what oversight work actually transfers?
- What happens to human oversight skills when automation increases over time?
- How do experienced users shift their oversight strategy over time?
- What specific checkpoints should trigger mandatory human approval for agent actions?
- How does Claude detect when operator instructions become clearly harmful?
- Does Claude Code audit which branches agents are permitted to push to?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can we design AI autonomy separately from capability?
Explores whether an AI agent's autonomy—how much it operates without user involvement—is a design choice independent of what the agent can actually do. This matters because it opens autonomy to governance and calibration rather than treating it as fixed by capability.
complicates: the same user shifts across this framework's fixed design-time roles as their own experience changes
-
Does granting agents more autonomy undermine human oversight?
Explores whether the design of autonomous AI systems—by giving agents greater independence—actually weakens the human overseer's ability to catch problems. Matters because oversight is a key safeguard against AI failures.
qualifies: experienced users here interrupt more, not less, against that paper's erosion claim
-
Where do user values break down in agent supervision?
When people use AI agents, their values tend to align with delivered outputs but conflict during oversight. What explains this gap, and what does it reveal about delegation design?
companion evidence that supervision behavior itself, not just agent design, shapes oversight outcomes
-
Are AI models held back from their autonomy potential?
Anthropic measured Claude Code sessions over three months and found longest runtimes nearly doubled. This raises whether deployed AI agents operate well below their actual capability ceiling, and what explains the gap.
companion finding from the same report on autonomy granted lagging autonomy exercised
-
Does oversight strategy prevent risky agent actions or just catch them?
When AI agents handle web tasks, different oversight designs might stop problems before they start—but can they help users actually intervene once a risky action is underway?
Qualifies A: oversight strategy changes whether a risky action occurs, not whether users can actually stop it once started
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Measuring AI agent autonomy in practice
- Agentic coding and persistent returns to expertise
- Beyond permission prompts: making Claude Code more secure and autonomous
- Agentic Misalignment: How LLMs Could Be Insider Threats
- How AI is transforming work at Anthropic
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Adoption and Impact of Command-Line AI Coding Agents: A Study of Microsoft's Early 2026 Rollout of Claude Code and GitHub Copilot CLI
- Introducing Anthropic Interviewer: What 1,250 professionals told us about working with AI
Original note title
Anthropic finds experienced Claude Code users both auto-approve and interrupt more often — a shift in oversight strategy, not a contradiction