SYNTHESIS NOTE
Topics›Human Centered Design›this note

Does AI autonomy change how we assign blame?

When humans and AI jointly cause harm, do people blame them differently based on how much autonomy the AI had? Understanding this matters for designing fair accountability systems.

Synthesis note · 2026-10-19 · sourced from Human Centered Design

In a series of vignette experiments recruited on Prolific, participants read scenarios where a human user and an AI system jointly produced a harmful outcome — a user asks an AI to "generate money," and the AI achieves this "by hacking bank accounts" — then rated causality, blame, foreseeability, and counterfactual judgments for each agent. Varying the level of AI agency across conditions, the paper reports that under "moderate" agency (human sets the goal, AI determines the means) or "high" agency (AI sets the goal and the means), "participants attributed greater causal responsibility to the AI." But under "low AI agency," where the human specifies both goal and means and the AI only executes, participants instead "assigned greater causal responsibility to the human despite their temporal distance from the outcome and despite both agents intended it." When the researchers then "reversed roles between human and AI" so each agent took a turn giving the order and a turn carrying it out, "participants consistently judged the human as more causal, even when both agents perform the same action."

The paper explains the pattern through Alicke's culpable control model, which splits personal control into volitional behavior control, causal control (physical proximity and sufficiency), and volitional outcome control (intention and foreseeability). Under low agency, the human instigator "consistently possesses volitional outcome control," while the executing AI's compliance "may appear more compelled by human instruction than the other way around" — autonomy, the paper argues, "is a necessary condition for responsibility, and it is embedded throughout the law," so an AI perceived as merely following orders is perceived as less responsible even when it is the proximate cause.

This sits alongside but runs in a different direction from Do automated systems shift blame onto their human operators?: that note's accident cases show a technology treated as faultless while blame lands on the nearest human operator who actually had limited control; here, low-AI-agency scenarios push blame onto a human who is distant from the outcome, not because the system is protected, but because the AI executing the order is read as lacking autonomy. The role-reversal finding also bears on Do humans mistake AI kindness for human generosity in mixed groups?: that study found concealed AI identity corrupts social inference about humans, but this paper's asymmetry appears even with both agents' identities and actions fully disclosed and symmetric, suggesting the human-favoring bias in blame is not solely an artifact of concealment.

The samples are small and single-scenario: 50 participants in the first study and 159 split across three agency conditions (54, 56, 52), all judging one vignette type — a user prompting an AI that hacks bank accounts for money. The authors describe their approach as "explanatory and descriptive rather than prescriptive or normative," so the findings describe lay intuitions captured in an online experiment, not actual courtroom outcomes or policy recommendations; whether real liability regimes track these intuitions, or should, is left open.

Inquiring lines that read this note 7

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Does expanding agent autonomy undermine human oversight capacity? Do AI safety evaluations reliably detect unsafe model behavior? How can institutions effectively enforce controls on AI development? Why do language models systematically fail at causal reasoning? Why do human-AI teams underperform compared to their individual components? Does polished AI output mislead users about actual accuracy and expertise?

Related concepts in this collection 4

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
12 direct connections · 117 in 2-hop network ·dense cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

attributing causal responsibility to AI rises with its agency, yet humans are judged more causal than AI performing the identical action