Line of inquiry
Inquiring lines›How do architecture and constraint…›How do architectural decisions and…›this line of inquiry
Can intelligent model routing compete with model scaling as an optimization lever?
A broader line of inquiry — a family of 27 specific questions the research asks around this. Follow one into its inquiring-line page, or move sideways to a related line below.
Questions in this line of inquiry 27
Specific inquiring lines the field asks around this — ordered from the most general framing down to the most specific angle.
- Can routing ever beat model improvement as a performance lever?
- Can multiple small models outperform a single large model with good routing?
- What makes routing a better investment than training larger models?
- Should model routing decisions account for prompt-tier dependencies?
- Does model selection matter more than model improvement for query routing?
- How do routing and test-time compute scaling work together as optimization axes?
- Can routing policies remain meaningful over behaviorally homogeneous model pools?
- Can embedding-cluster routing outperform a single frontier model?
- Can compute allocation and model routing be combined for better results?
- Do engineering costs of routing layers offset the savings from cheaper models?
- Can routing enable heterogeneous SLM-first architectures at scale?
- Why might diverse smaller models with routing beat one giant model?
- How does routing decide between models before generation happens?
- Can model routing and compute allocation work together as independent optimizations?
- Can routing systems prevent expert models from failing outside their specialty?
- What makes query complexity a better routing signal than response quality?
- Why does single-model routing beat ensemble and cascade approaches on latency?
- Does curating smaller model pools improve router recall compared to scaling?
- Can semantic routing couple similarity matching with resource constraints?
- Does model capability still matter once coordination infrastructure is optimized?
- Can routing signals organize training data into a meaningful curriculum automatically?
- Does surface-form query rewriting allow attackers to steer model routing decisions?
- Can hierarchical vector routing reduce context overhead while maintaining tool coverage?
- How do cost-aware cascades compare to single-turn routing in the component framework?
- How much does evaluation methodology affect routing research claims?
- How does semantic clustering help decide which model handles each query?
- How much latency cost does query cascading actually add?