Can verification accuracy scale without retraining the model?
Does correctness-checking improve as its own inference-time scaling axis, separate from pre-training and post-training compute? This matters because it could unlock better feedback for reasoning without expensive model retraining.
Generation has three well-worn scaling axes — pre-training, post-training, test-time compute — and LLM-as-a-Verifier argues verification is a fourth that has not been scaled the same way. The claim is that determining whether a solution is correct is not a byproduct of a good generator but a separable capability with its own scaling dimensions: score granularity, repeated evaluation, and criteria decomposition. Each can be dialed up at inference, without additional training, to buy more verification accuracy.
This reframes a bottleneck. Since What is the actual reusable unit of reasoning data?, the verifier is the load-bearing component of reasoning training — yet current verifiers are weak: LM judges collapse into coarse discrete scores that tie, and learned reward models are stuck inside their training distribution and fail to generalize across domains. If verification is a scaling axis, then those failures are not fixed properties but under-scaled ones, and the way to a better verifier is to spend more inference compute on it rather than to train a bespoke reward model.
The three dimensions decompose the gains cleanly: granularity gives better positive/negative separation, repeated evaluation reduces variance, and criteria decomposition reduces complexity per judgment. This connects to the panel-of-judges result — Can smaller models in panels outperform a single large judge? is a special case of scaling repeated evaluation across evaluators — but LLM-as-a-Verifier generalizes it into a training-free framework that provides dense agentic feedback where discrete judges provide none.
Inquiring lines that read this note 1
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Can ensemble evaluation methods reduce bias more than single judges?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
What is the actual reusable unit of reasoning data?
Does post-training reasoning transfer as prompt-response pairs, or as something more complex? Understanding what artifact actually drives gains matters for reproducibility and attribution.
grounds: the verifier is the reusable core, so scaling it scales reasoning
-
Can smaller models in panels outperform a single large judge?
Does replacing one large language model judge with a diverse panel of smaller models improve evaluation quality while reducing cost and bias? This matters because LLM-based evaluation is widespread but suffers from expense and family-specific bias.
extends: panel judging is one instance of scaling repeated evaluation
-
Can generative reasoning beat discriminative models with less training data?
Do process reward models that generate reasoning before judging achieve better performance than traditional discriminative approaches when trained on dramatically smaller datasets? This tests whether generative verification can scale more efficiently.
parallel: another route to denser, more general verification signal
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- LLM-as-a-Verifier: A General-Purpose Verification Framework
- Mind the Gap: Examining the Self-Improvement Capabilities of Large Language Models
- SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
- A Primer in Post-Training Reasoning Data: What We Know About How It Works
- FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
- Towards Large Reasoning Models: A Survey on Scaling LLM Reasoning Capabilities
- Process Reward Models That Think
- Local Coherence or Global Validity? Investigating RLVR Traces in Math Domains
Original note title
verification is a distinct scaling axis alongside pre-training, post-training, and test-time compute