SYNTHESIS NOTE
TopicsTest Time Computethis note

Can verification accuracy scale without retraining the model?

Does correctness-checking improve as its own inference-time scaling axis, separate from pre-training and post-training compute? This matters because it could unlock better feedback for reasoning without expensive model retraining.

Synthesis note · 2026-07-17 · sourced from Test Time Compute
How well do reward models actually evaluate AI reasoning? How do you navigate synthesis across fragmented research topics?

Generation has three well-worn scaling axes — pre-training, post-training, test-time compute — and LLM-as-a-Verifier argues verification is a fourth that has not been scaled the same way. The claim is that determining whether a solution is correct is not a byproduct of a good generator but a separable capability with its own scaling dimensions: score granularity, repeated evaluation, and criteria decomposition. Each can be dialed up at inference, without additional training, to buy more verification accuracy.

This reframes a bottleneck. Since What is the actual reusable unit of reasoning data?, the verifier is the load-bearing component of reasoning training — yet current verifiers are weak: LM judges collapse into coarse discrete scores that tie, and learned reward models are stuck inside their training distribution and fail to generalize across domains. If verification is a scaling axis, then those failures are not fixed properties but under-scaled ones, and the way to a better verifier is to spend more inference compute on it rather than to train a bespoke reward model.

The three dimensions decompose the gains cleanly: granularity gives better positive/negative separation, repeated evaluation reduces variance, and criteria decomposition reduces complexity per judgment. This connects to the panel-of-judges result — Can smaller models in panels outperform a single large judge? is a special case of scaling repeated evaluation across evaluators — but LLM-as-a-Verifier generalizes it into a training-free framework that provides dense agentic feedback where discrete judges provide none.

Inquiring lines that read this note 1

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Can ensemble evaluation methods reduce bias more than single judges?

Related concepts in this collection 3

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
14 direct connections · 119 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

verification is a distinct scaling axis alongside pre-training, post-training, and test-time compute