Are we underestimating human minds while debating machine minds?
Public AI discourse focuses on whether machines have too much attributed mind, but what if the real risk is humans coming to see themselves as mere language models? This explores the neglected inverse problem.
Public discourse on AI minds runs almost entirely in one direction: are we anthropomorphizing, attributing too much consciousness, agency, or understanding to systems that merely predict tokens? The LLMorphism argument flips the asymmetry. The more consequential error may be the reverse inference — once machines speak fluently, people begin to suspect that humans, too, are "just" predicting the next word, that thought is nothing more than what an LLM does. The bias is not over-crediting machines but under-crediting humans, draining mind, agency, and grounding away from the human side of the comparison.
This matters because the two errors have opposite remedies and opposite stakes. Anthropomorphism inflates a tool; it can mislead trust and accountability, but its target is a machine. LLMorphism deflates a person; its target is human dignity, responsibility, and the felt sense that our reasoning is embodied and meaningful rather than statistical. A culture that treats human cognition as a degraded language model will redesign work, education, and healthcare around that premise. The reverse inference is unsound on its face — similar linguistic output does not entail similar cognitive architecture — yet psychological availability, not logical validity, drives cultural uptake. Naming the missing half of the debate is the first defense.
Inquiring lines that read this note 6
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does AI-generated content transformation affect public discourse quality? How can conversational AI maintain consistent personas across conversations? When should tasks involve human-AI partnership versus full automation? How do we evaluate AI systems when user perception misleads actual performance? Is embodied interaction necessary for language meaning and genuine agency?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does human language use ever exist outside communication?
Explores whether humans can use language in non-communicative ways, or whether the communicative scaffold learned in childhood persists through all language use including private writing and internal thought.
grounds the asymmetry: human language is communicative and embodied in ways LLM output is not
-
Can we defend modest mental attributions to large language models?
Do deflationist arguments decisively rule out ascribing beliefs and desires to LLMs, or do they beg the question? Exploring whether metaphysically undemanding mental states can be attributed without claiming consciousness.
contradicts the framing's emphasis: it argues the over-attribution worry is harder to dismiss than deflationists claim, balancing this note's claim that under-attribution to humans is the neglected error — together they map both directions of the debate
-
Can computation arise without a conscious mapmaker?
Explores whether algorithms can generate the conscious agent needed to convert continuous physics into discrete symbols, or whether that agent must exist prior to computation itself.
grounds the unsoundness of the reverse inference: if computation logically presupposes an experiencing agent, then human cognition cannot be reduced to the token-prediction LLMorphism deflates it to
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- LLMorphism: When humans come to see themselves as language models
- Deflating Deflationism: A Critical Perspective on Debunking Arguments Against LLM Mentality
- A Comment On "The Illusion of Thinking": Reframing the Reasoning Cliff as an Agentic Gap
- Beyond Hallucinations: The Illusion of Understanding in Large Language Models
- Emergent Introspective Awareness in Large Language Models
- AI Models Exceed Individual Human Accuracy in Predicting Everyday Social Norms
- Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs
- Simulacra as conscious exotica
Original note title
the public ai debate is missing half the problem — we worry about too much mind in machines not too little in humans