INQUIRING LINE

When an AI system blames its 'acting' part over its 'thinking' part for a mistake, is that fair — or just because it was closer to the damage?

How does physical proximity to harm affect causal blame assignment?

This explores whether being closer to a harmful outcome (in physical space, or in the chain of events) makes people blame you more, and since this corpus is about AI, the question becomes how that 'closeness' instinct shapes who gets blamed when AI systems cause harm.


This explores whether being closer to a harmful outcome makes someone look more responsible for it. The corpus doesn't study physical distance in the classic philosophy-experiment sense, like pushing someone versus pulling a lever. What it does show is a close cousin of that instinct at work in AI: people tend to blame whatever sits nearest to the harm in the chain of events, even when that thing had little real control.

The clearest evidence comes from a study that split an AI system into two parts: a language model that 'thinks' and a tool-using agent layer that 'acts.' Participants blamed the agent layer more, because it was the part that touched the outcome Does decomposing AI systems shift where people assign blame?. The researchers call this a proximity heuristic. There's a catch, though: it only clearly won out when both parts were the same kind of thing, two pieces of software. Once you mix humans and AI, a second bias takes over. People blame AI more as it becomes more autonomous, but they still judge a human as more causal than an AI that did exactly the same thing Does AI autonomy change how we assign blame?. So proximity matters, but it competes with a stubborn sense that humans are the 'real' causes.

Put those two instincts together and you get the most consequential finding here: the moral crumple zone. When an automated system fails, investigators and the media tend to pin the blame on the nearest human operator, such as the pilot or the safety driver, whatever that person's actual authority or information Do automated systems shift blame onto their human operators?. The operator is close to the harm and human, so both biases point at them at once. Like the crumple zone of a car, the person absorbs the impact, and the technology's reputation comes out intact. Being near the harm becomes a liability in itself.

Why would people's sense of cause work this way? Research on causal reasoning suggests our intuitions take shortcuts. For example, we don't properly discount one cause when another already explains the outcome, and LLMs trained on human text pick up the same errors Do large language models make the same causal reasoning mistakes as humans?. Pure causal models also leave out the associative and emotional pulls that shape real judgments Can causal models alone capture how humans actually reason?. 'Whoever was closest' is exactly the kind of associative shortcut those formal models miss.

The practical upshot is easy to miss. As AI systems are built from more layers (models, agents, tools, human overseers), the way the system is drawn shapes who gets blamed. Put a human 'in the loop' at the last step and you may have created a scapegoat, not a safeguard. If you want to go deeper, start with the crumple-zone note, then the decomposition study.


Sources 5 notes

Does decomposing AI systems shift where people assign blame?

Study 5 found that when participants evaluated an AI split into a language model and tool-using agentic layer, they attributed greater causality to the agentic part. The mechanism appears to be a proximity heuristic: when both agents share the same nature, people judge the component closer to the outcome as more causal.

Does AI autonomy change how we assign blame?

A vignette study found participants attributed more causal responsibility to AI as its agency increased, but even when human and AI performed identical actions, participants consistently judged humans as more causal—suggesting autonomy shapes blame but doesn't fully override a human bias.

Do automated systems shift blame onto their human operators?

Elish demonstrates that when automated systems malfunction, investigators and media assign responsibility to nearby human operators regardless of their actual authority or information access, protecting the technology's reputation while the operator absorbs moral and legal liability.

Do large language models make the same causal reasoning mistakes as humans?

LLMs show weak explaining away and Markov violations in collider networks, matching human error patterns exactly. This suggests shared mechanisms rooted in training data statistics rather than categorical reasoning inferiority.

Can causal models alone capture how humans actually reason?

Causal belief networks excel at modeling causal reasoning but cannot represent associative links, analogical mappings, or emotion-driven belief shifts. The GenMinds framework itself acknowledges this as a tractable starting point rather than a complete theory.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.