Line of inquiry
Inquiring lines›How do training methods and scalin…›How do different training methods…›this line of inquiry
Does RL create genuinely new reasoning capabilities or refine existing ones?
A broader line of inquiry — a family of 114 specific questions the research asks around this. Follow one into its inquiring-line page, or move sideways to a related line below.
Questions in this line of inquiry 114
Specific inquiring lines the field asks around this — ordered from the most general framing down to the most specific angle.
- Can reinforcement learning add new capabilities or only remove inaccurate knowledge?
- Can RL create new reasoning primitives that pretraining never established?
- Does RL amplify existing reasoning or create genuinely new computational strategies?
- Does RL refine existing knowledge or discover entirely new capabilities?
- How does RL refine reasoning paths without simply adding model capability?
- When does RL discover genuinely novel reasoning strategies versus timing optimization?
- Does RL primarily teach when to use reasoning or how to reason?
- Does RL teach models new reasoning or just better timing?
- Does reinforcement learning preserve reasoning quality better than supervised fine-tuning?
- When does reinforcement learning actually produce true reasoning gains in models?
- Does RL teach models when to use reasoning or how to reason?
- Can extended RL training unlock genuinely new reasoning strategies models cannot discover otherwise?
- Why does prolonged RL discover strategies absent from any base model sample?
- Does reinforcement learning learn optimal per-turn reasoning discipline?
- Can reinforcement learning fix the reasoning gaps that supervised fine-tuning misses?
- How does RL compress reasoning path diversity during training?
- Why do reasoning gains from RL require models trained with headroom and edge-of-competence data?
- Can base models spontaneously produce reasoning traces without any RL training?
- Why does RL improve sampling efficiency but not expand capability boundaries?
- Can RLVR expand a model's reasoning capabilities beyond its training ceiling?
- Why do current RLVR methods fail to expand reasoning capability beyond base model boundaries?
- Can single-problem fine-tuning match full RL pipeline reasoning gains?
- Can RL teach when to use reasoning versus when to respond directly?
- Can reinforcement learning add missing domain knowledge to fine-tuned reasoning models?
- How does pretraining quality versus quantity affect downstream RL gains?
- Why does RL behavior differ between standard reasoning tasks and complex planning domains?
- Can reinforcement learning teach AI when to ask clarifying questions?
- Why do overtrained domains show different RL training outcomes than novel tasks?
- Does format-based pretraining determine how models respond to reinforcement learning?
- Can one training example activate mathematical reasoning in RL-trained models?
- Does reinforcement learning require sufficient pretraining to be effective?
- Can reinforcement learning improve how accurately models explain themselves?
- Can reinforcement learning close the gap between LLM reasoning and action?
- What makes pretraining composition more important than reward engineering?
- How do sparse parameter updates enable when-not-how training to work?
- Are RLVR models worse than non-reasoning models for subjective annotation?
- Why does outcome-based RL specifically lose diversity during training?
- Can out-of-distribution tests expose memorization in reinforcement learning fine-tuned models?
- Does RLVR expand model capability or reorganize existing capability?
- Does RLVR teach new reasoning or activate existing pretraining capabilities?
- How does the pretrained prior set a capability ceiling for reward model exploration?
- What limits RL's ability to scale for reasoning at training time?
- Can verifier-free RL work without manual preference labels or task-specific training?
- Can explicitly optimizing for semantic diversity during RL training improve both quality and variation?
- Does the reinforcement learning improvement rate depend on model initialization?
- Does reinforcement learning teach models how to reason or when to reason?
- What limits RLVR effectiveness beyond mathematical and coding domains?
- Why does standard RL cause traces to collapse into redundant reasoning paths?
- Can smaller models achieve domain expertise through focused RL training?
- How does baseline capability level affect RL improvement ceiling?
- Why does supervised fine-tuning on diverse demonstrations expand exploration diversity compared to RL?
- What role does reinforcement learning play in optimizing inference compute?
- How does imitation pretraining followed by RL exploration compare to either method alone?
- How do extrapolative and contextual generalization measure RL reasoning gains?
- Can in-context learning replicate the timing effects that RL teaches models?
- What role does natural language play in breaking reinforcement learning performance plateaus?
- Should larger compute budgets allocate more resources to reinforcement learning?
- What capacity threshold determines whether RL teaches activation versus shortcut learning?
- How does pretraining determine what RL can later teach a model?
- Why does the pretrained prior determine the exploration ceiling?
- Can in-context reinforcement learning match human sample efficiency on real problems?
- What makes supervised fine-tuning worsen RL exploration later?
- What breaks when you apply reinforcement learning after supervised fine-tuning?
- Can combining SRL with RLVR outperform either method used alone?
- How does reinforcement learning compare to differentiable joint training for RAG?
- How do self-evolving curricula help RL break beyond base model capability boundaries?
- Does the pretrained model prior limit RL search capability more than the optimization algorithm itself?
- Can negative reinforcement alone match full RL performance on domain tasks?
- Why does exploration diversity behave differently under reinforcement learning versus supervised fine-tuning?
- Can pretraining alone achieve chess performance without reinforcement learning?
- What scaling properties emerge from RL training dynamics beyond verification?
- Can RL directly optimize attention distributions instead of text generation?
- What does RL post-training actually teach reasoning systems?
- What training duration is actually needed for RL to expand capabilities?
- Why do models follow a two-phase pattern of procedural then strategic learning?
- How should humans specify deterministic abstractions of RL problems?
- Why does reinforcement learning training degrade model calibration?
- What distinguishes high-signal prompts from low-signal ones in RL training?
- Can LLM-synthesized behavioral heuristics compete with learned policy improvements?
- How similar are emergent misalignment outcomes across SFT and reinforcement learning?
- Can offline reinforcement learning improve dialogue policy baseline performance?
- How does LLM simulation of APIs avoid instability without sacrificing training signal?
- Why does medium difficulty outperform both easy and hard RLVR training samples?
- How does Supervised RL bridge the gap between SFT and RLVR?
- Does RL training redirect self-doubt into productive gap analysis?
- What distinguishes RL that creates new capabilities from RL that merely teaches timing?
- Does sparsity in RL arise from training on policy-distribution data?
- Does task ordering affect multi-task reinforcement learning outcomes?
- Why do single-turn RL methods fail to generalize to multi-turn tasks?
- What behavioral changes occur during reward learning training?
- Can models learn both what and how to study through reinforcement learning?
- How can verifier-free reinforcement learning handle reasoning without task-specific checks?
- How does reinforcement learning differ from chain-of-thought distillation?
- How does prolonged RL training differ from standard RLVR approaches?
- How does non-reasoning SFT prevent overfitting before RL training begins?
- How do verifier-free and adversarial approaches compare in extending reasoning RL?
- Why does early experience provide better warm-starts for downstream reinforcement learning?
- Can continuous spectrum training outperform sequential SFT-then-RL stages?
- How does the pretrained prior constrain the ceiling for empathy RL improvements?
- Can the exploration ceiling be raised beyond what pretraining established?
- Can one training example activate mathematical reasoning without reinforcement learning?
- How do residual connections and layer norm stabilize training in deep RL?
- How do RL training and base models differ in creating MI peaks?
- Which recipe choices determine the asymptotic ceiling in RL training?
- What makes software engineering environments better suited for RL than other interactive domains?
- How does RLSVR differ from using model probability or self-judgment?
- What makes a task at the edge of competence optimal for RL?
- Does negative reinforcement alone achieve what full RL training accomplishes?
- What makes some tasks bounded enough for reliable RL?
- Can meta-reinforcement learning explain why this bias pattern emerges rationally?
- How does scaffolding unstable mechanics improve reinforcement learning for search?
- Does replay fidelity hold when policies explore branches history never visited?
- How are exploration policies refined against the simulator in practice?
- How does behavior cloning reduce complexity before RL training in rerankers?