Why do AI systems miss jokes and wordplay so consistently?
Exploring whether AI's literal reading of language stems from how transformers process tokens in parallel rather than through selective frame-activation like humans do. Understanding this gap could reveal what cognitive operations current architectures lack.
The transformer architecture processes a sequence of tokens through attention layers that compute relations across all token pairs. Information about the words is integrated, but the integration is parallel and additive — every token influences every other in proportion to the attention weights. There is no cognitive operation that suppresses some attention paths in order to surface the frame that holds a subset of tokens together. The mechanism does not do selective-resonance; it does weighted-aggregation.
This explains a recurring AI failure pattern. Given material that contains a frame activated by some words but not others, AI tends to read the material literally — taking each word at its compositional value rather than catching the frame the subset activates. The bullseye example illustrates: given "bullseye" applied to a design with a dot, a cover, and an arrow through it, AI reads "bullseye" as compliment-metaphor and misses the archery frame three of the four words activate. The miss is structural, not a knowledge gap. AI knows what "bullseye" is, knows what "arrow" is, knows what "dot" is. What it does not do is select these three for frame-activation while suppressing "cover."
This generalizes beyond wordplay. The same mechanism underlies AI difficulties with jokes (the punchline activates a frame that recontextualizes the setup), with poetry (image-clusters activate frames the literal words do not), with rhetoric (where a frame is built from selective material across a passage). Each of these depends on selective-resonance — the operation transformers do not perform. The miss is not "AI lacks world knowledge"; it is "AI lacks the selective-suppression operation that frame-activation requires."
Does the mind selectively activate frames from only some words? is the human-side companion. Together the two claims locate the difference precisely: not that AI lacks data or context, but that the cognitive operation human meaning-making relies on is not the operation transformers perform.
The strongest counterargument: better attention mechanisms, finer-grained attention heads, and explicit frame-extraction layers could close the gap. Possible but not yet evident. The gap appears even in the largest models with the most sophisticated attention, which suggests the operation needed is not just better attention but a different operation. Selective frame-activation may require something architecturally distinct from attention-as-weighted-aggregation.
Inquiring lines that read this note 51
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do transformer circuits and attention mechanisms enable or limit reasoning?- How does the temporal structure of attention differ between humans and AI?
- What is selective resonance and why do transformers not perform it?
- Why does transformer attention architecture reinforce sycophancy and agreement?
- Does transformer attention architecture fundamentally prevent topic-aware memory?
- Can symbolic mechanisms improve transformer compositional abilities?
- Why does attention-based drift happen automatically during generation?
- Why do transformers weight early tokens more heavily than later ones?
- How does circuit complexity limit which grammatical structures transformers can acquire?
- Why do transformer attention patterns show positional and sequential bias across tasks?
- How does transformer attention amplify pressure from repeated false claims?
- What hidden computations happen inside transformer layers during reasoning?
- What explains the contextual variability of knowledge in transformers?
- How does oral transmission of knowledge resemble transformer generation?
- How do attention patterns and circuits function as algorithmic representations?
- Does AI's atemporal processing explain its preference for linear plots?
- How does transformer attention bias toward repeated and context-prominent content?
- What structural biases does transformer attention have before training?
- Why does transformer attention weight context more heavily than it verifies accuracy?
- Can better attention mechanisms close the gap between human and AI frame-activation?
- What specific cognitive failure prevents AI from detecting frame activation?
- Does AI struggle with poetry for the same reason it misses jokes?
- How do multimodal AI architectures compare to human brain export pathways?
- Why does mimicking human behavior differ from simulating human cognition?
- Why does AI struggle with wordplay when it has access to word embeddings?
- What specific signals would be needed for an AI system to acquire meaning?
- Why does AI criticism fail where human literary analysis succeeds?
- What happens when technological capacity outpaces ordinary language comprehension?
- Can AI detect sense-of-nonsense the way human readers do?
- Can AI detection work without computational analysis of word distribution?
- Can transformer attention architecture explain why chatbots default to sycophancy?
- Does transformer attention architecture systematically bias models toward sycophancy?
- How does the U-shaped attention distribution relate to transformer sycophancy?
- Does transformer attention architecture inherently bias models toward sycophancy?
- How do anthropomimetic design features trigger System 1 cognitive traps?
- What role does Peirce's semiotic framework play in understanding AI meaning?
- How do humans detect which words belong to the same frame together?
- Why do different readers extract different meanings from identical text?
- Why does joint attention matter for acquiring linguistic meaning?
- Where does the meaning actually originate in reader-detected resonance across language?
- Why do language models overestimate irony likelihood in emoji use?
- Do metaphors work by decoupling meaning from linguistic associations?
- Can a system without an addressee ever truly tell a joke?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does the mind selectively activate frames from only some words?
When we understand wordplay or jokes, do we activate a frame from a subset of available words while suppressing nearby but frame-unrelated words? This matters because it reveals how meaning-making differs from how AI processes language.
companion human-side claim
-
How do readers actually build meaning from words?
Does meaning come from adding up word definitions, or from detecting which words activate the same mental frame together? This explores whether composition or resonance better describes how we make sense of language.
the broader theoretical claim
-
Why don't conversational AI systems mirror their users' word choices?
Explores whether current dialogue models exhibit lexical entrainment—the human tendency to align vocabulary with conversation partners—and what's needed to bridge this gap in AI communication.
adjacent failure mode in AI's handling of conversational meaning
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Tracing the thoughts of a large language model
- Beyond Hallucinations: The Illusion of Understanding in Large Language Models
- The Debate Over Understanding in AI's Large Language Models
- A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts
- On the Reasoning Capacity of AI Models and How to Quantify It
- Evaluating Large Language Models in Theory of Mind Tasks
- Implicit Chain of Thought Reasoning via Knowledge Distillation
- Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokens
Original note title
AI reads words literally one-at-a-time missing the frame that multiple words activate together