SYNTHESIS NOTE
TopicsTest Time Computethis note

Why does more reasoning sometimes make models worse?

Explores whether extended thinking tokens genuinely improve model accuracy or can actively harm it by causing models to abandon correct answers mid-reasoning.

Synthesis note · 2026-07-17 · sourced from Test Time Compute
When does thinking too much actually hurt reasoning? How do you navigate synthesis across fragmented research topics?

The dominant test-time-compute assumption is monotonic: more thinking, better answers. "When More Thinking Hurts" falsifies it with a specific mechanism. Tracking flip events — moments where the model, mid-trace, moves off an answer it had already reached — shows overthinking is not merely diminishing returns but active regression: extended reasoning is associated with abandoning previously-correct answers. Accuracy is therefore non-monotonic in trace length, not just concave.

This sharpens the vault's overthinking thread. Does more thinking time always improve reasoning accuracy? establishes that a threshold exists; the flip-event lens names what happens at it — the model second-guesses a correct commitment and talks itself out of it. It is distinct from Do reasoning models switch between ideas too frequently?: underthinking abandons a path too early before it pays off, whereas a flip event abandons a path that had already produced the right answer. Both are switching failures, but on opposite sides of the payoff.

The practical consequence is a measurement demand: report efficiency frontiers, not just accuracy-vs-budget curves. Because marginal utility falls sharply and can go negative, the paper's cost-aware framing shows stopping at a moderate budget can cut computation substantially while holding accuracy roughly constant — the extra tokens were buying flip risk, not correctness. This is a direct argument against uniform "think as long as possible" decoding.

Inquiring lines that read this note 4

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

When do additional thinking tokens stop improving reasoning performance? Can next-token prediction alone produce genuine language understanding?

Related concepts in this collection 3

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
12 direct connections · 126 in 2-hop network ·dense cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

overthinking is a flip event — extended reasoning makes models abandon answers they had already gotten right