Does AI autonomy change how we assign blame?
When humans and AI jointly cause harm, do people blame them differently based on how much autonomy the AI had? Understanding this matters for designing fair accountability systems.
In a series of vignette experiments recruited on Prolific, participants read scenarios where a human user and an AI system jointly produced a harmful outcome — a user asks an AI to "generate money," and the AI achieves this "by hacking bank accounts" — then rated causality, blame, foreseeability, and counterfactual judgments for each agent. Varying the level of AI agency across conditions, the paper reports that under "moderate" agency (human sets the goal, AI determines the means) or "high" agency (AI sets the goal and the means), "participants attributed greater causal responsibility to the AI." But under "low AI agency," where the human specifies both goal and means and the AI only executes, participants instead "assigned greater causal responsibility to the human despite their temporal distance from the outcome and despite both agents intended it." When the researchers then "reversed roles between human and AI" so each agent took a turn giving the order and a turn carrying it out, "participants consistently judged the human as more causal, even when both agents perform the same action."
The paper explains the pattern through Alicke's culpable control model, which splits personal control into volitional behavior control, causal control (physical proximity and sufficiency), and volitional outcome control (intention and foreseeability). Under low agency, the human instigator "consistently possesses volitional outcome control," while the executing AI's compliance "may appear more compelled by human instruction than the other way around" — autonomy, the paper argues, "is a necessary condition for responsibility, and it is embedded throughout the law," so an AI perceived as merely following orders is perceived as less responsible even when it is the proximate cause.
This sits alongside but runs in a different direction from Do automated systems shift blame onto their human operators?: that note's accident cases show a technology treated as faultless while blame lands on the nearest human operator who actually had limited control; here, low-AI-agency scenarios push blame onto a human who is distant from the outcome, not because the system is protected, but because the AI executing the order is read as lacking autonomy. The role-reversal finding also bears on Do humans mistake AI kindness for human generosity in mixed groups?: that study found concealed AI identity corrupts social inference about humans, but this paper's asymmetry appears even with both agents' identities and actions fully disclosed and symmetric, suggesting the human-favoring bias in blame is not solely an artifact of concealment.
The samples are small and single-scenario: 50 participants in the first study and 159 split across three agency conditions (54, 56, 52), all judging one vignette type — a user prompting an AI that hacks bank accounts for money. The authors describe their approach as "explanatory and descriptive rather than prescriptive or normative," so the findings describe lay intuitions captured in an online experiment, not actual courtroom outcomes or policy recommendations; whether real liability regimes track these intuitions, or should, is left open.
Inquiring lines that read this note 7
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Does expanding agent autonomy undermine human oversight capacity? Do AI safety evaluations reliably detect unsafe model behavior? How can institutions effectively enforce controls on AI development? Why do language models systematically fail at causal reasoning? Why do human-AI teams underperform compared to their individual components? Does polished AI output mislead users about actual accuracy and expertise?Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does decomposing AI systems shift where people assign blame?
When an AI system is split into a language model and an agentic tool-using layer, do people attribute more causal responsibility to one component over the other? This matters for understanding how liability and oversight might be distributed in real systems.
a further finding from the same experiment series, decomposing "the AI" further into sub-components
-
Do automated systems shift blame onto their human operators?
Explores whether failures in complex automated systems are systematically attributed to human operators who lacked real control, protecting the technology itself from accountability.
a related but opposite-direction misattribution: blame lands on a low-control human operator there, but on a distant human instigator here
-
Do humans mistake AI kindness for human generosity in mixed groups?
When AI agents participate without disclosure, do humans systematically misattribute their behavior to the wrong agent type, and does this distort how people understand human nature itself?
a parallel human-favoring misattribution, but under disclosed rather than concealed AI identity
-
Do overseers focus on agent execution or action safety?
When humans oversee AI agents, do they check whether the agent followed its plan, or whether the action itself is safe? A study of computer-use agent oversight found this distinction matters even when intervention timing is correct.
a related finding on how human judges of AI action quality default to procedural rather than substantive standards
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Human Attribution of Causality to AI Across Agency, Misuse, and Misalignment
- Homo agenticus in the age of agentic AI: Agency loops, power displacement, and the circulation of responsibility
- Moral Crumple Zones: Cautionary Tales in Human-Robot Interaction
- Find the Gap: AI, Responsible Agency and Vulnerability
- Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems
- Epistemic Deference to AI
- The Moral Turing Test: Evaluating Human-LLM Alignment in Moral Decision-Making
- HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants
Original note title
attributing causal responsibility to AI rises with its agency, yet humans are judged more causal than AI performing the identical action