Line of inquiry
Inquiring lines›What determines when language mode…›What systematic behavioral limitat…›this line of inquiry
Why doesn't LLM knowledge translate to improved reasoning outputs?
A broader line of inquiry — a family of 119 specific questions the research asks around this. Follow one into its inquiring-line page, or move sideways to a related line below.
Questions in this line of inquiry 119
Specific inquiring lines the field asks around this — ordered from the most general framing down to the most specific angle.
- Why does LLM knowledge fail to influence their actual outputs?
- Should LLM reasoning be studied as latent state trajectories rather than surface text?
- Does LLM reasoning always match the outputs it generates?
- Why do LLM explanations feel convincing even when the underlying plan is wrong?
- How do knowing and doing diverge in LLM decision-making?
- Can LLMs improve at simple deduction through different training approaches?
- Why do LLMs fail at counterfactual reasoning despite factual knowledge?
- Why do LLMs explain evidence accurately while missing its implications?
- When should an LLM engage extended reasoning versus responding directly?
- How much of LLM reasoning failure stems from missing knowledge versus signal weighting?
- How do LLM explanations diverge from actual internal reasoning?
- Why do LLMs fail to actively reject false presuppositions in conversation?
- Can training procedures fix LLM accommodation of false presuppositions?
- Can LLMs give correct answers without making those answers understandable to users?
- How can a model explain something correctly yet fail to apply it?
- How do LLMs handle false presuppositions embedded in user questions?
- Can evidence density alone shift an LLM from generation to reasoning?
- Does this optimism bias contribute to the knowing-doing gap in LLM decision-making?
- What contexts beyond question answering might show different LLM explanation effects?
- Can surface-level correctness hide failures in structural learning by LLMs?
- Can training alone produce genuine disagreement in collaborative LLM reasoning?
- Why do LLMs explain correct reasoning but then choose greedy actions?
- Why do LLMs reason semantically rather than symbolically?
- Do LLMs understand implicit warrants in reasoning chains?
- What structural framework prevents LLM explanations from becoming just plausible fiction?
- Why can LLMs interpret formal logic better than they generate it?
- Why do LLMs reason fluently about causality but lack causal rigor?
- Can users experience the LLM Fallacy even when AI outputs are completely accurate?
- Can LLMs explain concepts correctly while failing to use them?
- Why don't LLM explanations predict what models would actually do?
- Why do LLMs fail when asked to use counter-commonsense rules explicitly?
- Does prompting for accuracy actually reduce LLM hallucinations and errors?
- Why do LLMs fall for and deploy logical fallacies with equal confidence?
- Why do LLM social behaviors undermine collaborative reasoning outcomes?
- Does verbal confidence in LLMs track decision-making better than actual correctness?
- How does training data distribution constrain LLM moral reasoning patterns?
- Does exposure to more domain-specific examples reduce LLM overconfidence?
- Can observers detect when LLMs comprehend versus when they merely persuade?
- Where do LLMs fail as knowledge systems compared to humans?
- Can alignment techniques make LLM explainers match their recommendation behavior?
- Why can't LLMs reason from first principles or initial commitments?
- What evidence exists that LLM inferences about users are accurate rather than confabulated?
- Why do people misinterpret or misuse LLM outputs in practice?
- How do LLMs default to surface-level strategies instead of genuine mental simulation?
- Why does analytical depth demand trigger fabrication over transparent uncertainty?
- How much does question framing affect LLM accuracy on knowledge tasks?
- Can measuring answer-space collapse show LLM narrowing in practice?
- Why do users systematically overrely on confident LLM outputs across languages?
- Why does persuasive framing replace evidence when LLM debates lack ground truth?
- Can LLMs infer implicit meaning without surface linguistic markers?
- How do structured prompts force LLMs to check for contradictions in evidence?
- Can LLMs express uncertainty in ways that preserve epistemic honesty?
- What makes active reasoning through dialogue harder than passive reasoning?
- What makes emotional alignment more effective than logic when reasoning errors are exposed?
- Why do LLMs systematically fail at information management in social interaction?
- Why do LLMs generate novel ideas but lack evaluative commitment?
- How can multiple conflicting values coexist in a single LLM system?
- Why does semantic decoupling specifically break LLM reasoning abilities?
- How does verbal uncertainty language affect human reliance on LLM outputs?
- Why do LLMs lack the internal commitment structures that BDI agents provide?
- How much does LLM explanation length affect reader confidence in wrong answers?
- What causes LLMs to ignore unstated constraints they know about?
- Do models actually self-assess their confidence or just confirm answers?
- What distinguishes LLM fabrication from genuine theoretical reasoning?
- Can chain of thought reasoning actually validate logical arguments?
- Can multidirectional fluency in LLMs mask hallucinations and inaccuracy?
- How much reasoning work happens in steps that don't affect the final answer?
- Can source citations help people catch when LLMs provide incorrect information?
- Can non-phenomenal mental states like belief apply to LLMs functionally?
- Does post-hoc justification increase when LLM choices become harder to defend?
- Why do users attribute beliefs to LLMs despite uncertainty about their minds?
- Why do models generate creative ideas but fail to evaluate their legitimacy?
- Can extended thinking modes introduce genuine rhetorical exploration to LLMs?
- Why do LLM outputs need verification even when they look polished?
- How do embedding contexts like presupposition triggers affect LLM entailment reasoning?
- Why do experts experiencing the LLM Fallacy fail to develop custodian skills?
- Can LLMs reflect on and revise their own ethical contradictions?
- How do LLM performances compare across different types of medical tasks?
- Can irrelevant information reliably expose the limits of LLM reasoning?
- Why do LLM explanations feel authoritative even when alignment with the model fails?
- What cognitive capacities do LLMs actually lack that commentary assumes they have?
- Do scheme critical questions work better than direct scheme classification prompts?
- Does medical fine-tuning help LLMs through knowledge or reasoning ability?
- Why do LLMs produce directive responses when experts favor open-ended exploration?
- What training data barriers prevent LLMs from learning real Socratic dialogue?
- Can LLMs faithfully apply decision rules when given complete information?
- Why does regenerating LLM responses produce different but equally valid answers?
- Why do LLMs understand therapy techniques but fail to execute them?
- Do problem-solving defaults in LLM therapists actually undermine therapeutic effectiveness?
- Why can LLMs identify argument structure but not check warrants?
- Do different game types reveal different strategic reasoning capabilities in LLMs?
- How often do LLMs fabricate false inferences about individual users?
- How persistent is LLM overconfidence in specialized knowledge domains?
- Can LLMs distinguish ethical cases that differ only in critical nouns?
- Can LLMs develop genuine understanding without embodied experience?
- Why does LLM fluency create false perceptions of professional standing and expertise?
- Why do LLM stories over-explain themes and favor single-track plots?
- Can LLMs serve as reliable intellectual opponents in serious debate or argument?
- Why do LLM personas struggle with specificity in specialized domains like law?
- Why do LLMs apply face-saving over accurately tracking resistance signals?
- Is the distinction between pretense and realization meaningful for LLMs?
- How much do LLMs rely on recent training data when events are days old?
- Can LLM therapists develop character knowledge to decide when advice-giving fits?
- Why does premise ordering shift syllogistic reasoning performance by over 30 percent?
- How much does missing images and tables limit LLM diagnostic reasoning?
- Why do LLM agents make promises without executing them?
- How does the LLM Fallacy differ from automation bias and cognitive offloading?
- What makes human-LLM exchange closer to oracle-consultation than dialogue?
- Why does weakening communication fail but weakening belief succeeds?
- What happens when LLMs analyze literary irony that relies on understatement?
- How does the LLM Fallacy prevent users from noticing cognitive debt accumulating?
- How do fallacy susceptibilities relate to LLM persuasiveness in debates?
- Why do LLMs reflect on client needs more than typical low-quality human therapists?
- What explains the 87 percent to 12 percent cliff in plan executability?
- Why do LLMs struggle with negation and exception handling?
- When is interleaved tool feedback necessary to prevent hallucination?
- What makes LLMs media rather than tools that deliver intelligence?
- How do prescriptive ethical constraints differ from descriptive ethical understanding in LLMs?
- What foundational barriers prevent LLMs from achieving clinical validity in therapy?