SYNTHESIS NOTE
Topics›Agents›this note

Do experienced AI users trust agents more or just oversee differently?

Claude Code users with more experience auto-approve actions more often but also interrupt more frequently. Does this reveal changing trust levels, or a fundamental shift in how oversight works as people learn?

Synthesis note · 2026-10-19 · sourced from Agents

Anthropic's research report measures how Claude Code users change their oversight behavior as they gain experience with the tool, and finds two numbers rising together. On auto-approval: "newer users (<50 sessions) employ full auto-approve roughly 20% of the time; by 750 sessions, this increases to over 40% of sessions." On interruption: "new users (those with around 10 sessions) interrupt Claude in 5% of turns, while more experienced users interrupt in around 9% of turns."

Anthropic names this "an apparent contradiction" and reads it as "a shift in users' oversight strategy" rather than a simple increase or decrease in trust. New users "are more likely to approve each action before it's taken, and therefore rarely need to interrupt Claude mid-execution." Experienced users instead "let Claude work autonomously, stepping in when something goes wrong or needs redirection" — oversight moves from pre-approval to monitoring-and-correction. Anthropic adds that the higher interrupt rate "may also reflect active monitoring by users who have more honed instincts for when their intervention is needed," and expects the per-turn rate to "eventually plateau," though it says widening confidence intervals at high session counts make that hard to confirm yet. A parallel pattern appears on Anthropic's public API, where "87% of tool calls on minimal-complexity tasks...have some form of human involvement, compared to only 67% of tool calls for high-complexity tasks" — which Anthropic itself calls "counterintuitive."

This complicates Can we design AI autonomy separately from capability?, whose taxonomy treats a user's role — operator, approver, observer, and so on — as a design choice a developer fixes for a given agent. Anthropic's data shows the same user moving across that spectrum as their own experience changes, without any change to the agent's design: toward something closer to approver or observer for routine actions, while retaining an operator-like interrupt capacity for the moments that need it. It also qualifies Does granting agents more autonomy undermine human oversight?: that paper frames extended use of agent systems as something that erodes the judgment oversight depends on, but Anthropic's experienced users interrupt more often, not less — consistent with sharpened rather than only degraded instincts, at least on this measure, though a rising interrupt rate against a shrinking share of reviewed actions does not rule out that each intervention now catches a smaller slice of total behavior.

The finding is Anthropic's own interpretation of its own product's telemetry, not a controlled study: the claim that experience changes oversight strategy, rather than that more experienced users simply select different or more trustworthy tasks, is offered as a probable reading ("may also reflect") rather than a demonstrated mechanism, and whether the interrupt rate truly plateaus is explicitly unconfirmed in the source.

Inquiring lines that read this note 12

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Does expanding agent autonomy undermine human oversight capacity? How does offloading cognition to AI assistance affect learning retention? Can formal safety constraints prevent AI agents from exceeding authorized boundaries? Which agent-created code should persist in infrastructure versus remain task-specific? How should conversational agents balance proactive goal-pursuit with user autonomy?

Related concepts in this collection 5

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
16 direct connections · 104 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

Anthropic finds experienced Claude Code users both auto-approve and interrupt more often — a shift in oversight strategy, not a contradiction