INQUIRING LINE

Models can reach the right answer and then — by thinking longer — talk themselves into the wrong one.

What causes reasoning accuracy to degrade beyond a critical thinking-token threshold?

This explores why piling on more reasoning tokens eventually makes models *less* accurate — what actually breaks past the sweet spot, not just that a sweet spot exists.


This question asks what breaks when a model reasons past its optimal length — and the corpus points to a clear answer: the extra tokens don't stall out neutrally, they actively corrupt answers the model had already reached. The headline number is stark. As thinking tokens scale from ~1,100 to ~16,000, benchmark accuracy falls from 87.3% to 70.3% — a non-monotonic curve where accuracy peaks and then declines sharply rather than plateauing When does thinking too much actually hurt reasoning? Does more thinking time always improve reasoning accuracy?. So the degradation isn't diminishing returns; it's a reversal.

The mechanism is second-guessing. Tracking individual reasoning traces shows 'flip events' — the model reaches a correct answer, keeps going, and then talks itself out of it, overwriting the right answer with a wrong one Why does more reasoning sometimes make models worse?. Extended thinking inflates output variance and introduces self-revision errors When does thinking too much actually hurt reasoning?. A related failure is churn rather than reversal: models switch reasoning paths too early and too often, abandoning promising approaches mid-exploration and burning tokens on incomplete threads — penalizing those thought-transition tokens at decode time alone recovers accuracy with no retraining Do reasoning models switch between ideas too frequently?. Overthinking (flipping away from good answers) and underthinking (never committing to one) are two faces of the same missing skill: knowing when to stop.

That 'when to stop' skill is exactly what reasoning training tends not to install. The optimal chain-of-thought length follows an inverted-U — it rises with task difficulty but *shrinks* as the model gets more capable, and RL training naturally drifts toward shorter chains as competence grows, meaning brevity is something models earn from reward signals rather than something forced on them Why does chain of thought accuracy eventually decline with length?. When training instead optimizes purely for producing reasoning steps, models lose the ability to disengage: they generate long, redundant traces for ill-posed questions with missing premises that non-reasoning models correctly flag as unanswerable Why do reasoning models overthink ill-posed questions?, and more broadly they narrow their critical-thinking range even as they look more capable What critical thinking skills do reasoning models actually lose?.

Here's the part you might not expect: the reasoning tokens themselves may not be doing the work you'd assume, which reframes *why* extra ones can hurt. Models trained on deliberately corrupted or irrelevant traces stay just as accurate — traces act as computational scaffolding, not as meaningful step-by-step logic Do reasoning traces need to be semantically correct?. And intermediate tokens carry no special execution semantics; invalid traces routinely yield correct answers, so the trace correlates with the answer through learned formatting, not verified inference Do reasoning traces actually cause correct answers? Why does chain-of-thought reasoning fail in predictable ways?. If reasoning is largely pattern-matched scaffolding rather than genuine deliberation, then generating *more* of it past the point of usefulness is just more opportunity for the pattern to drift off the correct answer — degradation isn't a bug in the reasoning, it's what happens when there's no real reasoning holding the answer in place.

Two practical upshots. First, the threshold is real but invisible until crossed — it varies by model, task, and difficulty with no reliable predictor, though difficulty estimators and runtime confidence signals can start to detect it dynamically How can we predict the optimal thinking token threshold?. Second, the degradation is not inevitable: RL training can flip 'thinking mode' from counterproductive self-doubt into productive gap analysis, which means training mediates reasoning *quality*, not just quantity — the same extended-thinking mechanism that hurts a vanilla model can help a well-trained one Does extended thinking help or hurt model reasoning?.


Sources 12 notes

When does thinking too much actually hurt reasoning?

Empirical studies demonstrate non-monotonic scaling in test-time reasoning: accuracy peaks at a critical thinking-token count, then declines sharply (87.3% to 70.3% as tokens scale from 1,100 to 16,000). Extended thinking inflates output variance and introduces self-revision errors rather than improving solution quality.

Does more thinking time always improve reasoning accuracy?

Increasing thinking tokens from ~1,100 to ~16K reduced benchmark accuracy from 87.3% to 70.3%, revealing a non-monotonic relationship where models overthink easy problems and underthink hard ones.

Why does more reasoning sometimes make models worse?

Tracking flip events shows that extra reasoning tokens don't just hit diminishing returns—they actively cause models to second-guess and overwrite previously-correct answers, making accuracy non-monotonic in trace length.

Do reasoning models switch between ideas too frequently?

o1-like models frequently abandon reasoning paths mid-exploration, wasting tokens on incomplete approaches. A decoding-only penalty on thought-transition tokens (TIP strategy) discourages switching, improving accuracy on challenging math without model fine-tuning.

Why does chain of thought accuracy eventually decline with length?

Task accuracy peaks at intermediate CoT length, with optimal length increasing alongside task difficulty but decreasing with model capability. RL training naturally gravitates toward shorter chains as models improve, revealing that simplicity emerges from reward signals rather than explicit training.

Show all 12 sources
Why do reasoning models overthink ill-posed questions?

Reasoning models generate redundant, lengthy responses to questions with missing premises while non-reasoning models correctly identify them as unanswerable. Training optimizes for producing reasoning steps but never teaches models when to disengage.

What critical thinking skills do reasoning models actually lose?

Models trained for step-by-step reasoning excel at in-distribution logical tasks but lose critical abilities: they overthink ill-posed questions instead of disengaging, and reason their way to wrong rules on inductive tasks. This cognitive narrowing is partly reversible through targeted RL training.

Do reasoning traces need to be semantically correct?

Models trained on systematically irrelevant traces maintain solution accuracy and sometimes improve out-of-distribution generalization, suggesting traces function as computational scaffolding rather than meaningful reasoning steps.

Do reasoning traces actually cause correct answers?

R1's intermediate tokens carry no special execution semantics and are generated identically to other LLM output. Invalid traces frequently produce correct answers, proving traces are not causally necessary—they correlate with answers via learned formatting, not functional reasoning.

Why does chain-of-thought reasoning fail in predictable ways?

CoT guides models to pattern-match reasoning structure rather than perform genuine inference. This explains distribution-bounded failures, why structural coherence matters more than content correctness, and why performance optimizes against interpretability.

How can we predict the optimal thinking token threshold?

The overthinking threshold depends on task difficulty, model training, and domain, but remains invisible until crossed. Recent work suggests difficulty estimators and runtime confidence signals can detect thresholds dynamically.

Does extended thinking help or hurt model reasoning?

Vanilla models use thinking mode counterproductively, inducing self-doubt that degrades performance. RL training reverses this, transforming the same mechanism into beneficial gap analysis. Training mediates reasoning quality, not just quantity.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.

Research prompt for your LLMexpand ↓

Copy into ChatGPT or Claude to take this line of inquiry further — it asks the model to find newer work and re-test which earlier constraints still hold.

You are a reasoning-training analyst investigating a still-open question: what causes reasoning accuracy to degrade beyond a critical thinking-token threshold?

What a curated library found — and when (dated claims, not current truth). These span roughly 2025–early 2026 and should be treated as perishable:
- As thinking tokens scale ~1,100 → ~16,000, accuracy falls 87.3% → 70.3% — a non-monotonic reversal, not diminishing returns (~2025).
- The mechanism is second-guessing: 'flip events' overwrite an already-correct answer; extended thinking inflates output variance (~2025).
- Underthinking is the mirror failure — premature thought-switching; penalizing transition tokens at decode alone recovers accuracy, no retraining (~2025).
- Optimal CoT length is an inverted-U that shrinks as models get more capable; RL drifts toward shorter chains (~2025).
- Traces may be scaffolding, not inference: corrupted/invalid traces stay accurate, so 'more' is just more room to drift (~2025).

Anchor papers (verify; mind their dates): Thoughts Are All Over the Place (arXiv:2501.18585, 2025); When More is Less (arXiv:2502.07266, 2025); Does Thinking More Always Help? (arXiv:2506.04210, 2025); Base Models Know How to Reason, Thinking Models Learn When (arXiv:2510.07364, 2025).

Your task:
(1) RE-TEST EACH CONSTRAINT. For every finding, judge whether newer models, training/RL, tooling, orchestration (confidence-gated stopping, budget control), or evaluation have RELAXED or OVERTURNED it. Separate the durable question from the perishable limit; cite what resolved it, and say plainly where the threshold still holds.
(2) This corpus is in TENSION — traces-as-scaffolding vs. traces-as-reasoning, and 'more hurts' vs. RL-mediated 'more helps'. Surface the strongest CONTRADICTING or superseding work from the last ~6 months on each fork.
(3) Propose 2 research questions that assume the regime has moved.

Cite arXiv IDs; flag anything you cannot ground in a real paper.