Does LLM price alone determine which model users choose?
If cheaper models offer 10-30x cost savings, why don't they dominate adoption? This explores whether price is the primary driver of LLM selection or whether other factors like quality and reliability matter equally.
Analyzing "Effective Cost vs Usage Dynamics" across its 100-trillion-token OpenRouter dataset, the study concludes that "the LLM market does not seem to behave like a commodity just yet: price alone explains little about usage." Instead, it reports that "users balance cost with reasoning quality, reliability, and breadth of capability" when choosing which model to send a request to.
The study builds this on an "effective cost" metric "based on average input plus output tokens" that "accounts for caching effects," compared against each model's observed token volume. Because the underlying dataset is metadata-only — "we did not have access to the underlying text of prompts or completions" — the "balance" the authors describe is inferred from the shape of the price-versus-usage relationship across models, not measured by asking users why they chose a given model. The paper generalizes the pattern into a market-structure claim: users "select systems along multiple axes such as capability, latency, price, and trust depending on context," which it calls "a fundamental property of the market" rather than "a transient phase."
This bears directly on the cost-driven architecture argument in Can small language models handle most agent tasks?, which reasons that 10-30x cheaper SLM inference should make smaller models the default choice for scoped subtasks. The OpenRouter finding qualifies how far that logic extends across a real market: if price alone drove adoption, token share should concentrate on whichever model is cheapest for a task, but the study reports usage spread across a price range instead. How much do open-weight models actually get used in practice? shows what this looks like in practice — cheaper open models take a meaningful share without taking all of it, which is consistent with price being one factor among several rather than the deciding one.
The study does not identify which specific factor — quality, reliability, latency, or trust — drives any individual user's or developer's choice; it reports only that price by itself fails to account for the usage distribution it measured on one platform. Because the effective-cost figures and category data come from OpenRouter's own logs and a classifier sampled on roughly 0.25% of traffic, the claim describes patterns in that platform's observed window rather than a general law of how LLM pricing and adoption relate.
Inquiring lines that read this note 5
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What fundamentally drives AI inference pricing and cost decline patterns?- How do different financing terms affect total cost of ownership?
- What evidence shows users genuinely prioritize factors beyond cost when selecting models?
Related concepts in this collection 2
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can small language models handle most agent tasks?
Explores whether smaller, cheaper models are actually sufficient for the repetitive, scoped work that dominates deployed agent systems, rather than relying on large models by default.
qualifies the pure cost-savings case by showing price alone fails to predict aggregate usage
-
How much do open-weight models actually get used in practice?
Real-world inference routing data can reveal whether open models capture meaningful market share despite proprietary model advantages. Understanding actual usage patterns matters for predicting the future of AI infrastructure.
same study's companion finding on the resulting open/closed usage split
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- The Latent Role of Open Models in the AI Economy
- State of AI: An Empirical 100 Trillion Token Study with OpenRouter
- How 100 Enterprise CIOs Are Building and Buying Gen AI in 2025
- Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer
- The Price of Progress: Price Performance and the Future of AI
- LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing
- RouteLLM: Learning to Route LLMs with Preference Data
- A Cost-Benefit Analysis of On-Premise Large Language Model Deployment: Breaking Even with Commercial LLM Services
Original note title
OpenRouter's 100-trillion-token study finds price alone poorly predicts LLM usage as users trade cost against quality reliability and breadth