Can automation and human control increase together?
Does the long-standing trade-off between automation and human control reflect an unavoidable constraint, or a design choice? This matters because it determines whether systems can be both powerful and trustworthy.
The paper argues that the long-standing one-dimensional levels-of-automation model — running from Sheridan and Verplank's (1978) ten levels through the US Society of Automotive Engineers' six levels for self-driving cars — wrongly assumes "increases in automation must come at the cost of lowering human control." Its Human-Centered Artificial Intelligence (HCAI) framework proposes decoupling the two into independent axes, so that "achieving high levels of human control and high levels of automation is possible" in what it calls the upper-right quadrant of a two-dimensional grid. Reaching that quadrant, the paper states, is "more likely to produce designs that are Reliable, Safe & Trustworthy (RST)."
The reasoning draws on prior critics who had already catalogued the costs of chasing autonomy alone on a single dial — Bainbridge's "ironies" (1983), Bradshaw et al.'s "myths" (2013), Endsley's "conundrums" (2017), Hancock's "paradoxes" (2017) — converging on the point that "humans have to spend more effort monitoring autonomous computers because they are unsure of what it will do." Rather than abandon automation, the paper reassigns quadrants by task type: the lower-right (high automation, low control) suits rapid, well-understood actions such as airbag deployment or anti-lock brakes, where "there is no time for human intervention"; the upper-left (high control, low automation) suits mastery-building tasks like bicycle riding or piano playing; the upper-right is reserved for "poorly understood and complex tasks with varying contexts of use," illustrated with a patient-controlled-analgesia device that lets a patient trigger dosing while sensors and machine learning choose safe amounts and a hospital control center monitors "hundreds of PCA devices" for audit and improvement.
This reframes a question the vault otherwise treats as a spectrum problem. Can we design AI autonomy separately from capability? also rejects a single autonomy dial, but indexes its five levels to the role a user holds at a given moment; this paper instead treats control and automation as two separately tunable design variables that can both be pushed toward maximum, naming the assumed trade-off itself — not just the coarseness of the levels — as the design error. What UX principles do workplace users want in AI agents? finds users rank human control alongside reliability and safety as top design principles; this paper supplies an underlying design logic for why those qualities need not compete with higher automation.
The excerpt is a position and framework paper, not an evaluation: no instrument for measuring "levels of control and autonomy" yet exists, which the paper itself names as "an important research direction," and the PCA and self-driving-car illustrations are worked examples rather than tested deployments. It also does not resolve Does granting agents more autonomy undermine human oversight?' empirical worry that oversight capacity erodes with use — this paper names "de-skilling effects" and "the difficulty of remaining vigilant when user actions become less frequent" only as open limitations, not problems its two-axis framework is shown to solve. What follows at the strength of a framework paper: the two-dimensional model is a design target to aim for, not yet a demonstrated route for getting there.
Inquiring lines that read this note 13
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does AI adoption reshape employment and wage outcomes?- Why have AI investments historically favored automation over human augmentation?
- Are automation and augmentation actually contradictory or can they work together?
- What causes automation to make easy tasks easier but hard tasks harder?
- Why do ATMs and automated systems often complement rather than replace human workers?
- Can complementarity between automation and human work offset job displacement broadly?
- Can advanced automation systems require better human oversight than simpler ones?
- What happens to human oversight skills when automation increases over time?
- Do managers currently measure error correlation when deciding on automation?
- Can keeping humans in high-stakes decisions prevent automation failures?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can we design AI autonomy separately from capability?
Explores whether an AI agent's autonomy—how much it operates without user involvement—is a design choice independent of what the agent can actually do. This matters because it opens autonomy to governance and calibration rather than treating it as fixed by capability.
both reject a single autonomy dial, but this paper indexes to two independent design axes rather than user role
-
What UX principles do workplace users want in AI agents?
A multi-method study asked business users what design principles matter most for human-AI collaboration at work. The findings prioritize oversight and reliability over convenience.
shares the same valued qualities; this paper gives the design logic for why control and automation need not trade off
-
Does granting agents more autonomy undermine human oversight?
Explores whether the design of autonomous AI systems—by giving agents greater independence—actually weakens the human overseer's ability to catch problems. Matters because oversight is a key safeguard against AI failures.
the de-skilling and vigilance worry this paper names as an open limitation rather than something its framework solves
-
Can we separate reliability, safety, and trust into distinct mechanisms?
Does treating trustworthiness as three independent levers—technical practice, safety culture, and oversight structure—provide a more actionable framework for building AI systems that users can depend on?
companion framework from the same paper, defining what "RST" means once the two-axis design goal is reached
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
- Human Performance Consequences of Stages and Levels of Automation: An Integrated Meta-Analysis
- A Model for Types and Levels of Human Interaction with Automation
- Augmenting the algorithm: Emerging human-in-the-loop work configurations
- Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems
- When combinations of humans and AI are useful: A systematic review and meta-analysis
- The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyond
- AI Agents Push Humans Out of the Loop
Original note title
Shneiderman's human-centered AI framework decouples automation and human control so both can be maximized together