Why does more reasoning sometimes make models worse?
Explores whether extended thinking tokens genuinely improve model accuracy or can actively harm it by causing models to abandon correct answers mid-reasoning.
The dominant test-time-compute assumption is monotonic: more thinking, better answers. "When More Thinking Hurts" falsifies it with a specific mechanism. Tracking flip events — moments where the model, mid-trace, moves off an answer it had already reached — shows overthinking is not merely diminishing returns but active regression: extended reasoning is associated with abandoning previously-correct answers. Accuracy is therefore non-monotonic in trace length, not just concave.
This sharpens the vault's overthinking thread. Does more thinking time always improve reasoning accuracy? establishes that a threshold exists; the flip-event lens names what happens at it — the model second-guesses a correct commitment and talks itself out of it. It is distinct from Do reasoning models switch between ideas too frequently?: underthinking abandons a path too early before it pays off, whereas a flip event abandons a path that had already produced the right answer. Both are switching failures, but on opposite sides of the payoff.
The practical consequence is a measurement demand: report efficiency frontiers, not just accuracy-vs-budget curves. Because marginal utility falls sharply and can go negative, the paper's cost-aware framing shows stopping at a moderate budget can cut computation substantially while holding accuracy roughly constant — the extra tokens were buying flip risk, not correctness. This is a direct argument against uniform "think as long as possible" decoding.
Inquiring lines that read this note 4
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
When do additional thinking tokens stop improving reasoning performance? Can next-token prediction alone produce genuine language understanding?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does more thinking time always improve reasoning accuracy?
Explores whether extending a model's thinking tokens linearly improves performance, or if there's a point beyond which additional reasoning becomes counterproductive.
extends: names the flip-event mechanism behind the accuracy-degradation threshold
-
Do reasoning models switch between ideas too frequently?
Research explores whether o1-like models abandon promising reasoning paths prematurely by switching to different approaches without sufficient depth, and whether penalizing such transitions could improve accuracy.
contrasts: flip events abandon already-correct answers, not premature paths
-
Do iterative refinement methods suffer from overthinking?
Iterative refinement approaches like Self-Refine structurally resemble token-level overthinking in o1-like models. Does revision across multiple inference calls reproduce the same accuracy degradation seen within single inferences?
parallel: the same regression appears across refinement iterations
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Think Deep, Not Just Long: Measuring LLM Reasoning Effort via Deep-Thinking Tokens
- The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
- AbstentionBench: Reasoning LLMs Fail on Unanswerable Questions
- When More Thinking Hurts: Overthinking in LLM Test-Time Compute Scaling
- Mining Hidden Thoughts from Texts: Evaluating Continual Pretraining with Synthetic Data for LLM Reasoning
- Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMs
- Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokens
- Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens
Original note title
overthinking is a flip event — extended reasoning makes models abandon answers they had already gotten right