SYNTHESIS NOTE
Topics›Discourses›this note

Do humans and LLMs differ fundamentally or just superficially?

Explores whether the gap between human and AI cognition is categorical or contextual. Matters because it shapes how we design, evaluate, and interact with language models in practice.

Synthesis note · 2026-02-21 · sourced from Discourses

This is a direct application of Habermas's distinction between the "perspective of an observer" and the "perspective of a participant in interaction."

From the observer perspective, the difference is categorical and clear: humans are biological agents with embodied consciousness, socialized subjectivity, and reflexive self-understanding. LLMs are statistical pattern-matching systems running on hardware, with no awareness or agency. Their computational mechanisms are nothing alike.

From the participant perspective — inside a discourse, where what matters is the meaning being exchanged — the difference is more subtle. Both participants are drawing on the same intersubjectively shared universe of meanings. The LLM produces outputs that are structurally meaningful within that universe because it was trained on it. Whether it "understands" in any deeper sense is secondary to the fact that its outputs enter the discourse on the same terms.

This is not a claim that LLMs are conscious or that the distinction doesn't matter. It is a structural observation about what discourse is: a space defined by shared symbolic resources, not by the inner states of participants. From inside that space, the LLM is a participant drawing on the right resources.

The practical implication for AI design: designing interactions around the observer perspective ("it's just a statistical model") misses what users actually experience. Users interact from within discourse — from the participant perspective — and that perspective is where the LLM's shared symbolic substrate makes it feel more like a peer than a tool.

Inquiring lines that read this note 70

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Does polished AI output mislead users about actual accuracy and expertise? How does offloading cognition to AI assistance affect learning retention? Can we reliably distinguish AI-generated from human-written text? What conversation mechanics enable genuine human-AI communicative participation? Why doesn't LLM knowledge translate to improved reasoning outputs? What reasoning limitations and biases do language models systematically exhibit? What distinguishes genuine understanding from correct linguistic performance? Do language models learn underlying linguistic structure or merely surface patterns? Can language models develop genuine communicative grounding with humans? When do multi-agent systems outperform single agents? How should control and autonomy be allocated in human-AI collaboration? Does preference-optimized training sacrifice accuracy and calibration for perceived quality? What determines whether visible reasoning traces improve task performance? What makes reasoning models struggle with ill-posed and unfamiliar problems? Do language models genuinely understand or primarily match statistical patterns? Do AI explanations represent actual model reasoning or constructed post-hoc narratives? How can we determine if computational systems are genuinely conscious? Do language models truly understand their encoded knowledge or merely retrieve patterns? What explains the gap between LLM semantic understanding and production? How does explicit structure improve LLM reasoning on complex tasks? What is the actual bottleneck preventing effective AI research automation? Why do human-AI teams underperform compared to their individual components? How do transformer circuits and attention mechanisms enable or limit reasoning? How does AI writing assistance affect reader perception of writer authenticity? How do standardized artifacts improve coordination in multi-agent systems? What distinguishes emotionally supportive AI from AI that fosters unhealthy dependence? Do standard benchmarks reveal AI capability in real-world contexts? What determines how neural networks organize their internal knowledge representations?

Related concepts in this collection 2

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
21 direct connections · 205 in 2-hop network ·dense cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

from the observer perspective humans and llms differ categorically but from the participant perspective the difference is subtle