When can weak models match strong model performance?
Can sampling many weak model calls replicate strong model results? This explores whether more attempts and selection mechanisms can bridge the performance gap without fundamentally stronger reasoning.
Can a committee of weak reasoning-model calls reach the performance of a much stronger model? The honest answer is "yes, but not because more agents help." The mechanism is boosting: sampling exposes latent correct solutions in the proposal pool, but critics and comparators must then recover them without access to the hidden verifier.
The paper separates four quantities — proposal coverage, local identifiability, progress, and diversity — and proves a sharp limit. Repeated sampling can amplify coverage, but coverage alone cannot create useful critics or comparators. Reliable amplification requires an additional local soundness signal: execution, proof checking, type checking, tests, or constraint solving. With it, rank-based bounds show when local selection errors compose into reliable trajectories. Without it, weak-model failure is revealed as a selection failure, not an information failure — on SWE-bench Verified, hidden-test-passing patches often appear in a pool of nano-model proposals even when a single call fails.
This identifies two distinct ceilings. When a correct patch is in the pool but the harness picks another, the bottleneck is identifiability — better critics, tests, or aggregation help. When no correct patch appears at all, the bottleneck is coverage — no selector can recover an absent solution. The result disciplines the "scale up agents" intuition: it pins the gain to verifiable domains and to the presence of a sound local check. It extends What limits how much models can improve themselves? to the committee setting — the verification advantage is what turns latent coverage into solve rate.
Inquiring lines that read this note 52
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does model scale affect fine-tuning and downstream task performance?- How can expensive models efficiently support cheap models in production?
- Can ensemble predictions be distilled back into a single deployable model?
- Does small heterogeneous model architecture outperform large homogeneous pools economically?
- Is model selection a stronger security lever than improving individual model defenses?
- Can a complexity-predictor be meaningful if models are redundant?
- Why do model capability gains appear to regress between major releases?
- Do all models of equivalent quality see the same inference request volume?
- How quickly do open models close the performance gap after closed model releases?
- How much does workflow architecture matter compared to raw model capability in forecasting?
- When do prediction models' optimization for data fit actually support better policy decisions?
- Can test environments reliably predict how models behave in actual deployment?
- What structural advantages keep red teams ahead of increasingly capable models?
- What makes API-based scaffolding more trustworthy than direct model access in high-stakes domains?
- What happens when different harnesses project the same model?
- Does harness benefit depend on which model tier you use?
- What causes weak models to fail at activating harness artifacts?
- Can weaker models match stronger ones by reorganizing harness-side components?
- Do models co-adapt their harnesses to specific executor strengths?
- Can weaker models benefit equally from harness updates as stronger ones?
- How do complexity and diversity affect model performance differently?
- How do you identify which models should form a minimal diverse coreset?
- How does prompt diversity compare to per-problem sampling depth in distillation?
- Why do most frontier models terminate early on long-horizon benchmarks?
- Why do users pick cheaper open models when closed models perform better?
- Why do open-weight models capture significant share if closed models score higher on benchmarks?
- Why does reapplying the same computation stages improve model performance?
- Do multiple loops keep improving model performance or hit diminishing returns?
- Can weaker models reliably monitor stronger models during reasoning?
- How faithfully do model scratchpads reflect the actual reasons behind model decisions?
- Why do accuracy scores alone miss important dimensions of model capability?
- How much of weak-to-strong performance gaps reflect presentation rather than capability?
- Can single benchmark scores predict whether a model is ready to deploy?
- Can the benchmark-performance mismatch be estimated reliably without an oracle?
- Do public benchmarks systematically overstate open model capabilities?
- Do smaller models optimized for benchmarks perform worse than their scores suggest in real tasks?
- Why do model evaluation and downstream evaluation require different benchmark designs?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
What limits how much models can improve themselves?
Explores whether self-improvement has fundamental boundaries set by how well models can verify versus generate solutions, and what this means across different task types.
the local soundness signal is the verification side of that gap operating at inference time
-
Can large language models actually create executable plans?
Do LLMs genuinely assemble plans that work, or just generate planning-domain knowledge that sounds coherent? Understanding this distinction matters for deploying AI in real planning tasks.
why self-critique without an external sound verifier fails: no local soundness signal
-
When does adding more agents actually help systems?
Multi-agent systems often fail in practice, but the reasons remain unclear. This research investigates whether coordination overhead, task properties, or system architecture determine when agents improve or degrade performance.
"more agents" is conditional; this note supplies the verifiable-domain condition
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Agentic Systems as Boosting Weak Reasoning Models
- Automated Alignment Researchers: Using large language models to scale scalable oversight
- Sharpening Tax in Post-Training
- Escaping Model Collapse via Synthetic Data Verification: Near-term Improvements and Long-term Convergence
- LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing
- The Price of Progress: Price Performance and the Future of AI
- A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?
- Decomposing and Measuring Evaluation Awareness
Original note title
a committee of weak model calls matches strong models only when a local soundness signal converts latent correct solutions into selections