INQUIRING LINE

Reasoning training helps math but can hurt medicine — because some domains need new facts, not sharper thinking.

Which domains need knowledge injection versus reasoning-focused training?

This explores when a domain needs the model to actually *learn new facts* (knowledge injection) versus when it just needs better *reasoning* over facts it already has — and why picking the wrong one backfires.


This is really a question about matching the training method to what a domain is missing — new facts, or better handling of existing facts. The sharpest anchor in the corpus is the finding that LLMs store knowledge in their lower layers and do reasoning in their higher layers Why does reasoning training help math but hurt medical tasks?. That physical separation is the whole answer in miniature: reasoning-focused training (long chains of thought, RLVR) tunes the upper layers and reliably helps math, where the facts are trivial and the work is all inference. But the same training can *degrade* knowledge-heavy domains like medicine, because it doesn't add the facts those domains actually lack — and can disturb the retrieval that was working.

So the dividing line is: does the domain fail because the model can't reason, or because it doesn't know? Math, logic, and code puzzles are reasoning-bound — and strikingly, base models often already contain the reasoning latent, so 'training' there is really *elicitation*, selecting a capability that's present rather than installing one Do base models already contain hidden reasoning ability?. Medicine, law, and niche technical fields are knowledge-bound: no amount of reasoning polish substitutes for facts absent from pretraining. The hardest evidence of that ceiling is prompt optimization — it can only reorganize what a model already knows and cannot inject anything new Can prompt optimization teach models knowledge they lack?. If clever prompting fixes your domain, it was a reasoning/activation problem all along.

For genuinely knowledge-bound domains, the corpus is opinionated about *how* to inject. Structure beats volume: StructTuning hits half of full-corpus performance on 0.3% of the data by teaching where a fact sits in a domain taxonomy rather than drilling raw text Can organizing knowledge structures beat raw training data volume?, and medical knowledge-graph curricula compose primitive facts into domain 'superintelligence' the same way Can knowledge graphs teach models deep domain expertise?. There's a menu of injection mechanisms — RAG for flexibility, fine-tuned weights for speed, adapters for swappability — each optimizing a different deployment constraint, and combining them beats any single route How do knowledge injection methods trade off flexibility and cost?. And purely tacit, data-only learning without any explicit structure leaves gaps in interpretability and out-of-distribution robustness that a little structured knowledge cheaply closes Does refusing explicit knowledge harm AI system performance?.

Here's the part you didn't know you wanted to know: the two goals interfere, and the standard trap is injecting knowledge with the wrong tool and silently wrecking reasoning. Plain supervised fine-tuning is the culprit — it raises benchmark accuracy while cutting the quality of the actual inferential steps by ~39%, so the model reaches right answers by post-hoc rationalization instead of real reasoning, and ordinary metrics never notice Does supervised fine-tuning improve reasoning or just answers?. The corrective is to inject knowledge *through* reasoning: RL-from-augmented-generation rewards both the correct answer and a coherent explanation, internalizing facts as reasoned structure rather than memorized tokens, and outperforms SFT precisely because it refuses to separate the two Can reinforcement learning embed domain knowledge more effectively than supervised fine-tuning?.

Which reframes the original either/or. Reasoning-focused RL used to be confined to domains with checkable answers (math, code), but verifier-free methods now extend it to open knowledge domains by scoring how well reasoning predicts a reference answer Can reasoning improvement work without answer verification? — so even fact-heavy fields can get reasoning training. The real caution isn't the injection-vs-reasoning split; it's that reasoning models still wander unsystematically and collapse on deep problems Why do reasoning LLMs fail at deeper problem solving?, and that every adaptation method has a narrow domain-specific sweet spot with hidden costs outside it How do domain training techniques actually reshape model behavior?. The competent move is to diagnose first — is the domain short on facts or short on inference? — and then, wherever possible, inject the facts in a form that trains the reasoning at the same time.


Sources 12 notes

Why does reasoning training help math but hurt medical tasks?

Two-phase inference model shows knowledge retrieval operates in lower network layers while reasoning adjustment happens in higher layers. This separation explains why reasoning training improves math but can degrade knowledge-intensive domains like medicine.

Do base models already contain hidden reasoning ability?

Five independent mechanisms—RL steering, critique fine-tuning, decoding changes, SAE feature steering, and RLVR—all elicit reasoning already present in base model activations. Post-training selects rather than creates reasoning; the bottleneck is elicitation, not capability acquisition.

Can prompt optimization teach models knowledge they lack?

Prompting works entirely within a model's pre-existing training distribution and cannot supply domain knowledge absent from training data. This creates a hard ceiling: no prompt strategy can compensate for missing foundational knowledge, only reorganize what already exists.

Can organizing knowledge structures beat raw training data volume?

StructTuning achieves 50% of full-corpus performance using only 0.3% of training data by organizing chunks into auto-generated domain taxonomies. The model learns knowledge position within conceptual structures rather than raw text patterns, matching how students learn from textbooks.

Can knowledge graphs teach models deep domain expertise?

Fine-tuning a 32B model on 24,000 reasoning tasks derived from medical knowledge graph paths produces state-of-the-art performance across 15 medical domains, demonstrating that structured knowledge composition matters more than scale.

Show all 12 sources
How do knowledge injection methods trade off flexibility and cost?

Dynamic injection (RAG) maximizes flexibility but adds latency; static embedding is fastest but costly and inflexible; modular adapters balance efficiency with swappability; prompt optimization requires no training but only activates existing knowledge. Combining all three outperforms any single approach.

Does refusing explicit knowledge harm AI system performance?

AI systems that learn exclusively from data produce uninterpretable representations, inherit statistical biases uncorrected by normative rules, and fail to generalize beyond training distributions. Structured knowledge injection at minimal corpus cost substantially improves performance.

Does supervised fine-tuning improve reasoning or just answers?

Supervised fine-tuning improves final-answer accuracy on benchmarks but cuts Information Gain by 38.9 percent, meaning models generate correct answers through post-hoc rationalization rather than genuine inferential steps. Standard metrics miss this degradation because they only measure final correctness.

Can reinforcement learning embed domain knowledge more effectively than supervised fine-tuning?

RLAG rewards both answer accuracy and explanation rationality by cycling between augmented and unaugmented generation, progressively internalizing coherent knowledge structures. This outperforms SFT because it prioritizes reasoning quality over token-level correctness.

Can reasoning improvement work without answer verification?

VeriFree bypasses answer verification entirely by using the conditional probability of reference answers given generated reasoning traces as both reward signal and training weight. This approach matches or surpasses verifier-based methods on MMLU-Pro, GPQA, and SuperGPQA without rule-based or model-based verifiers.

Why do reasoning LLMs fail at deeper problem solving?

Current reasoning models lack the three properties of systematic exploration: validity, effectiveness, and necessity. This causes success probability to drop exponentially with problem depth, making medium problems solvable but deep problems catastrophically harder.

How do domain training techniques actually reshape model behavior?

Research shows every adaptation method—from parameter-efficient tuning to knowledge graph curricula—has optimal conditions tied to specific domains. The key finding: visible benefits like performance gains often come with hidden degradation in reasoning faithfulness, capability transfer, and format flexibility.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.

Research prompt for your LLMexpand ↓

Copy into ChatGPT or Claude to take this line of inquiry further — it asks the model to find newer work and re-test which earlier constraints still hold.

You are a research analyst. The question is still open: which domains need knowledge injection versus reasoning-focused training — and how do we tell them apart?

What a curated library found — and when (dated claims, not current truth; findings span ~2024–2025):
- LLMs physically separate storage (lower layers) from inference (higher layers), so reasoning training tunes the upper layers — helping math but sometimes degrading knowledge-heavy domains like medicine that lack facts, not inference (~2025).
- Base models already contain latent reasoning; 'training' there is elicitation, selecting a present capability rather than installing one (~2025). Prompt optimization can reorganize but cannot inject new knowledge (~2025).
- StructTuning reaches ~50% of full-corpus knowledge-injection performance on 0.3% of the data by teaching where a fact sits in a taxonomy (~2024).
- The SFT trap: plain fine-tuning raises benchmark accuracy while cutting inferential-step quality by ~39%, so RL-from-augmented-generation — rewarding answer AND explanation — beats it (~2025).
- Verifier-free RL now extends reasoning reinforcement to open knowledge domains by scoring how well reasoning predicts a reference (~2025).

Anchor papers (verify; mind their dates): Decoupling Knowledge and Reasoning, arXiv:2507.18178 (2025); Educating LLMs like Human Students / StructTuning, arXiv:2407.16724 (2024); RL from Augmented Generation, arXiv:2509.20162 (2025); Reinforcing General Reasoning without Verifiers, arXiv:2505.21493 (2025).

Your task:
(1) RE-TEST EACH CONSTRAINT. For every finding, judge whether newer models, training methods, tooling, orchestration (memory, RAG, multi-agent), or evaluation have RELAXED or OVERTURNED it — especially the injection-vs-reasoning split itself. Separate the durable question from the perishable limitation; cite what resolved it, and say plainly where a constraint still holds.
(2) Reconcile the threads: surface work from the last ~6 months that unifies or fractures the 'inject-through-reasoning' claim.
(3) Propose 2 research questions assuming the regime may have moved.

Cite arXiv IDs; flag anything you cannot ground in a real paper.