Does decomposing AI systems shift where people assign blame?
When an AI system is split into a language model and an agentic tool-using layer, do people attribute more causal responsibility to one component over the other? This matters for understanding how liability and oversight might be distributed in real systems.
Beyond the human-versus-AI comparisons that make up most of the paper's experiments, one study decomposes "the AI" itself into two parts and asks which one participants hold more responsible. The abstract states the result plainly: "Decomposing the AI into a large language model and an agentic component showed that the agentic part was judged as more causal in the chain." The discussion frames this as a Study 5 finding: "when both agents are different components of an AI system, thus sharing the same nature, participants attribute greater causality to the agent that is more proximate to the outcome in the chain."
The mechanism the paper proposes is a reversion to proximity once the autonomy asymmetry between human and AI is no longer in play. Earlier studies in the same series find that attributions track perceived autonomy when one agent is human and the other is AI, but when both compared agents are AI components — "sharing the same nature" — that asymmetry drops out, and the proximity heuristic documented in prior causal-chain research reasserts itself: the component doing the proximate, world-touching action (the agentic, tool-using part) draws more blame than the component generating the underlying reasoning (the LLM). The paper notes this echoes findings for all-human chains, where "the one closer to the outcome tends to receive higher causal ratings" (citing Cheung et al., 2024).
This connects to Does role-play distinguish real harm from simulated harm?, which treats played action with real consequences as genuine action in effect. This folk-attribution finding gives an empirical echo of that claim at the level of lay judgment: when asked to assign blame, people also locate it in the tool-using, world-touching layer rather than in the generative model behind it. It also bears on Does human-in-the-loop design actually enable effective oversight?, since if folk and future liability judgments concentrate on the agentic layer, oversight built around only the base model's outputs would be observing the wrong component. The finding sits alongside its sibling note, Does AI autonomy change how we assign blame?, as a further decomposition within the same experiment series rather than a separate study.
The finding comes from a single study (Study 5) using the same financial-hacking vignette as the rest of the paper, and the excerpt does not define "agentic component" architecturally beyond that vignette's framing — it does not say how real engineering teams, auditors, or regulators would draw the line between a system's "agentic" and "language model" parts in practice. At the strength the evidence allows, the result suggests that if liability frameworks come to track lay intuition, scrutiny of agentic systems may concentrate on the tool-using layer rather than the underlying model, but the paper offers this as a single experimental result, not a design recommendation.
Inquiring lines that read this note 6
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Does expanding agent autonomy undermine human oversight capacity? When does governance become the bottleneck for agentic AI? Do AI safety evaluations reliably detect unsafe model behavior? How can institutions effectively enforce controls on AI development? Why do language models systematically fail at causal reasoning? Why do human-AI teams underperform compared to their individual components?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does AI autonomy change how we assign blame?
When humans and AI jointly cause harm, do people blame them differently based on how much autonomy the AI had? Understanding this matters for designing fair accountability systems.
the paper's central agency/autonomy finding that this decomposition result extends within the same experiment series
-
Does role-play distinguish real harm from simulated harm?
When AI agents role-play characters with access to real tools like email or financial APIs, does the distinction between pretend and genuine agency still hold? The question matters because it determines whether framing tool-equipped agents as simulators actually reduces safety risks.
argues the tool-using layer carries real-world consequence regardless of the model's "intent"; this study finds folk judgment locates blame there too
-
Does human-in-the-loop design actually enable effective oversight?
When AI agents include humans in the decision loop, does that automatically provide meaningful oversight? The research explores what specific capabilities humans need to actually oversee agent behavior.
if blame concentrates on the agentic layer, oversight aimed only at model outputs misses the component people (and perhaps liability law) hold most causal
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Human Attribution of Causality to AI Across Agency, Misuse, and Misalignment
- Agentifying Agentic AI
- Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents
- Homo agenticus in the age of agentic AI: Agency loops, power displacement, and the circulation of responsibility
- Atria Dawn: The Dawn of Agentic Superintelligence
- The Work Behind Delegation: A Framework for Supervising AI Coding Agents
- Moral Crumple Zones: Cautionary Tales in Human-Robot Interaction
- Explaining AI Agents Through Execution Traces
Original note title
decomposing an AI system into an agentic component and a language model shifts causal blame onto the agentic part