SYNTHESIS NOTE
Topics›Human Centered Design›this note

Who bears responsibility when AI seems human-like?

Does human-likeness in AI come from how users perceive systems or how designers build them? Understanding this distinction clarifies where accountability lies when AI causes harm.

Synthesis note · 2026-04-18 · sourced from Human Centered Design

When an AI system appears human-like, the critical question is who is responsible for the human-likeness: the user who perceives it, or the designer who built it? This distinction, drawn from Shevlin (2025), separates two mechanisms that are routinely conflated:

Anthropomorphism — the user perceives human-like qualities in the system. The responsible party is the perceiver. This is a cognitive tendency: humans attribute beliefs, desires, and emotions to non-human entities. The human-likeness is in the eye of the beholder.

Anthropomimesis — the designer builds human-like features into the system. The responsible party is the developer. This is a design decision: features that mimic human appearance, behavior, or biological structure are deliberately or inadvertently engineered into the artifact.

Anthropomimesis operates on three dimensions:

Shevlin further distinguishes weak anthropomimesis (surface-level features like voice and interface — e.g., ELIZA) from robust anthropomimesis (deep structural mimicry of human cognitive or biological processes).

The accountability implication is direct: when a human-like AI causes harm, the locus of responsibility depends on whether the human-likeness was designed in (anthropomimesis — designer accountable) or perceived by the user (anthropomorphism — design may be neutral, user response is the mechanism). In practice, both often co-occur — a human-like design elicits perception of human-likeness — but distinguishing which mechanism is operating determines where intervention should target: redesigning the system vs. educating the user.

Since Why do people trust AI outputs they shouldn't?, the anthropomorphism/anthropomimesis distinction clarifies Rose-Frame's Trap 2 (mistaking intuition for reason): when anthropomimetic design features (conversational voice, empathetic phrasing) trigger anthropomorphic perception, they activate System 1 trust responses that bypass reflective evaluation. The cognitive trap is partly designed in, not purely a user failure.

Inquiring lines that read this note 20

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How can we determine if computational systems are genuinely conscious? How should control and autonomy be allocated in human-AI collaboration? Why do human-AI teams underperform compared to their individual components? Why do consumers overtrust AI preference agents despite limited understanding? What systematic biases emerge in AI shopping agents' decision-making? Do AI safety evaluations reliably detect unsafe model behavior? How should AI ethics integrate consciousness, values, and transparent disclosure? When does governance become the bottleneck for agentic AI? Does expanding agent autonomy undermine human oversight capacity? How can institutions effectively enforce controls on AI development? Does polished AI output mislead users about actual accuracy and expertise?

Related concepts in this collection 4

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
15 direct connections · 144 in 2-hop network ·dense cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

anthropomorphism and anthropomimesis assign responsibility for human-likeness to different parties — user perception versus designer intention create distinct accountability structures