Can disembodied language models ever qualify as conscious?
Explores whether current LLMs lack the conditions needed for consciousness discourse to even apply, not because they're definitely not conscious but because they lack the shared embodied world that grounds consciousness language.
Shanahan's Simulacra as Conscious Exotica argues that the question "is an LLM conscious?" cannot even be properly asked about current disembodied systems — not because the answer is "no" but because the vocabulary of consciousness has no application surface.
The argument: consciousness language originates from and applies to entities that share a world with us. The basis for treating other humans as fellow conscious beings is co-presence — we can hear, look at, point to, or touch the same things. We triangulate on shared objects. "Consciousness" is not just a behavioral predicate; it is grounded in this triangulation practice.
Current LLM-based conversational agents are not embodied. We cannot be with them in a shared world. The words of consciousness therefore cannot get a grip on them — not because LLMs are definitely not conscious, but because the conditions for the concept to apply are absent. This is a Wittgensteinian move: meaning is use, and the use of "conscious" is anchored in co-presence.
Embodiment opens the door. A robot controlled by an LLM that exhibits human-like behavior would be an "especially exotic artefact" — but one for which consciousness discourse becomes at least applicable. A mobile-device agent with visual and audio input that accompanies a user might also constitute a minimal form of shared world, though Shanahan is cautious. The criterion is whether encounters can be engineered, even in principle.
This is distinct from the enactive agency argument (What makes linguistic agency impossible for language models?). The enactive view concerns linguistic agency specifically; Shanahan's argument concerns consciousness candidacy through a different route — the Wittgensteinian condition that meaning requires shared practice. Both converge on embodiment as necessary, for different reasons.
What should happen to consciousness discourse for LLMs? Perhaps a new vocabulary, "consciousness-adjacent," that can accommodate the exoticism without forcing the concept onto systems for which it doesn't fit. The anthropological imagination of a science fiction writer is recommended.
Inquiring lines that use this note as a source 43
This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.
- What does disembodied orality mean for how we evaluate AI outputs?
- Can secondary orality exist without any embodied human participant at all?
- Can we develop competent reading practices for disembodied orality?
- Can knowledge flow without an embodied carrier transmitting it?
- Which interaction design changes most effectively prevent consciousness attribution?
- What role does user interface framing play in consciousness perception?
- How does enactive theory define language differently than computational linguistics?
- Can linguistic agency exist without embodiment and real-world participation?
- What makes sincerity impossible without a coherent first-person perspective?
- What counts as genuine memory under the Extended Mind thesis?
- Can self-description of internal states influence consciousness attribution?
- Do anthropomorphic features like names drive consciousness attribution more than voice?
- What responsibility do designers bear for consciousness attribution risk?
- Can design choices reduce harm without resolving the consciousness question?
- Why do users attribute consciousness to language models in practice?
- What would genuine semiosis require in an artificial system?
- When both anthropomorphism and anthropomimesis occur together, which should we address first?
- What makes linguistic agency impossible for systems without embodiment?
- Can robots with sensors create the shared world that consciousness requires?
- How does role play differ from consciousness grounded in stable selfhood?
- Does psychological continuity require uninterrupted consciousness or restored context?
- Can we use folk-psychology without committing to genuine mental states?
- Can LLMs participate meaningfully in discourse without consciousness or understanding?
- How do LLMs access and draw on the same shared symbolic universe as humans?
- Does embodiment matter for genuine linguistic agency?
- Can language meaning emerge without joint attention and shared embodied interaction?
- Can disembodied systems qualify as conscious or conscious-like entities?
- How does embodiment affect whether LLMs can participate in Wittgensteinian language games?
- Does role-playing without biological needs constitute genuine linguistic agency?
- Can LLMs develop genuine understanding without embodied experience?
- What distinguishes pseudo-objectivity from genuine intersubjective discourse?
- What makes a mental state metaphysically demanding versus undemanding?
- Why do relational states like speech-acts resist quasi-interpretive treatment?
- Can the intentional stance meaningfully apply to entities with no stable self?
- How does embodiment relate to whether something can have a persistent identity?
- What would consciousness require that pure roleplay LLMs cannot provide?
- What does embodiment and precariousness mean for linguistic agency?
- Why does conceptual priming alone fail to produce consciousness claims?
- Can a virtual instance be individuated from its conversational context?
- What makes the Extended Mind thesis incompatible with internalism?
- What does partial co-presence remove from the ritual obligations of talk?
- What emergent abilities appear only in truly unified multimodal systems?
- Can the human mind be uploaded or only its context?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
What makes linguistic agency impossible for language models?
From an enactive perspective, does linguistic agency require embodied participation and real stakes that LLMs fundamentally lack? This matters because it challenges whether LLMs can truly engage in language or only generate text.
convergent conclusion (embodiment necessary) through different route: enactive agency vs. Wittgensteinian shared-world grounding
-
What anchors a stable identity beneath an LLM's persona?
Human personas are grounded in biological needs and embodied experience, creating a stable self beneath social performance. Do LLMs have any comparable anchor, or is their identity purely situational?
the "no stable self" claim from the same paper; consciousness requires more than role play generates
-
Do LLMs develop the same kind of mind as humans?
Explores whether LLMs and humans share the intersubjective linguistic training that shapes cognition, and whether that shared training produces equivalent forms of agency and reflexivity.
the Habermasian version of the shared-substrate/absent-participation pattern
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Simulacra as conscious exotica
- Levels of Analysis for Large Language Models
- The Abstraction Fallacy: Why AI Can Simulate But Not Instantiate Consciousness
- Language Models’ Hall of Mirrors Problem: Why AI Alignment Requires Peircean Semiosis
- Deflating Deflationism: A Critical Perspective on Debunking Arguments Against LLM Mentality
- Quantitative Introspection in Language Models: Tracking Internal States Across Conversation
- What we talk to when we talk to language models
- Computational structuralism: Toward a formal theory of meaning in the age of digital intelligence
Original note title
consciousness candidacy requires engineering an embodied encounter in a shared world — disembodied llms cannot qualify