SYNTHESIS NOTE
TopicsPhilosophy Subjectivitythis note

Can we defend modest mental attributions to large language models?

Do deflationist arguments decisively rule out ascribing beliefs and desires to LLMs, or do they beg the question? Exploring whether metaphysically undemanding mental states can be attributed without claiming consciousness.

Synthesis note · 2026-04-18 · sourced from Philosophy Subjectivity
What grounds language understanding in systems without embodiment? What kind of thing is an LLM really?

Two standard deflationist strategies against LLM mentality each fall short:

The robustness strategy challenges attributions on functional grounds — LLM behaviors fail to generalize appropriately, so putatively cognitive behaviors are not robust. But this begs the question by assuming that only human-like generalization patterns count as robust. Non-human animals have beliefs and desires despite non-human-like generalization profiles.

The etiological strategy appeals to causal history — LLMs are trained on next-token prediction, not on learning about the world, so their behaviors should not be interpreted mentalistically. But this also begs the question: the causal history of a system does not straightforwardly determine what mental states (if any) it instantiates. Evolution optimized for reproductive fitness, not for truth — yet we attribute beliefs to evolved creatures.

The modest position: Ascribe mentality where the mental states at issue are metaphysically undemanding (beliefs, desires, knowledge) — concepts that already have broad application across species and don't require phenomenal consciousness. Withhold attribution for metaphysically demanding states (qualia, phenomenal experience). This mirrors how we attribute beliefs to non-human animals without claiming equivalence.

This directly challenges the Chalmers engagement's framing. Since Should AI alignment target preferences or social role norms?, the question of LLM mentality is not binary (has mind / doesn't have mind) but graded and domain-specific. The modest inflationist position creates trouble for both sides of the debate — deflationists who dismiss all attribution, and inflationists like Chalmers who want to extend consciousness.

Since Does AI generate genuine utterances or just text patterns?, modest inflationism might be what happens at the receiving end: users attribute beliefs and desires (metaphysically undemanding) to LLMs precisely because the conversational structure makes such attributions pragmatically useful, regardless of whether they are metaphysically accurate.

Inquiring lines that read this note 68

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

What mechanisms enable AI systems to generate and spread false beliefs? How do LLMs distinguish causal reasoning from temporal and semantic associations? How do interface design choices shape consciousness attribution? Is embodied interaction necessary for language meaning and genuine agency? How do language models establish social grounding in human dialogue? Why do language models reinforce false assumptions instead of correcting them? Is model self-awareness based on genuine introspection or pattern matching? What role does compression play in language model capability and generalization? What memory architectures best support persistent reasoning across extended interactions? How should models express uncertainty rather than forced confident answers? Can LLM personas constitute genuine psychology or remain linguistic role-play? How faithfully do LLMs reflect their actual reasoning in outputs and explanations? Can AI-generated outputs constitute genuine knowledge or valid claims? Why do persona-level simulations fail to predict individual preferences accurately? What actually drives chain-of-thought reasoning improvements in language models? Does AI fluency substitute for verifiable accuracy in human judgment? Do accurate-looking LLM outputs hide structural failures in learning and reasoning? How can conversational AI maintain consistent personas across conversations? How can persona representations reduce language model variance and improve task accuracy? Do reasoning traces faithfully represent or merely mimic actual model reasoning? How does rhetorical adaptation affect LLM persuasion and detectability? Do language models develop causal world models or rely on statistical patterns? Why should disagreement be treated as signal in collaborative reasoning? Do base models contain latent reasoning that training can unlock?

Related concepts in this collection 2

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
14 direct connections · 119 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

modest inflationism about LLM mentality is defensible — both deflationist debunking strategies fail to decisively rule out metaphysically undemanding mental state attributions