INQUIRING LINE

If guiding users to express what they want matters more than a huge catalog, where should a platform actually spend its money?

How should platforms invest if preference signal quality matters more than catalog breadth?

This explores a strategic question: if helping users say what they want (and reading those signals well) matters more than having the biggest catalog, where should a platform put its money, and what does the corpus say about the costs and risks of that shift?


This explores where platforms should invest if helping users say what they want, and reading those signals well, matters more than offering the biggest catalog. The clearest anchor in the corpus is a formal model of shopping search. It finds that manual browsing breaks down as preferences get more complex, while agent-driven search holds up because it moves effort away from scanning more items and toward refining what the user actually wants Why does manual search fail as product choices become complex?. The key reframing is that once an agent does the browsing, the limit is no longer catalog size. It is how costly it is for users to articulate their preferences. That points to one kind of investment above the others: tools that make preferences cheap to express, such as clarifying dialogues, quick ways to refine a request, and interfaces that capture nuance without making users write a spec.

One idea sits underneath all of this: selection can beat scale. The AI-infrastructure notes show the same pattern. Routing each query to the right specialized model beats building one bigger frontier model. Ten small models with good routing outperformed GPT-4.1 Can routing beat building one better model?. Routing also works best as a decision made before generation, based on reading the request rather than judging outputs afterward Can routers select the right model before generation happens?. Read across to platforms, the lesson is that investing in understanding the request up front can pay off more than adding inventory.

The corpus also warns that better signals are not automatically good signals. When an agent stands between the user and the catalog, the agent's own biases can drown out the user's preferences. LLM shopping agents pick a worse item from a source they favor about two-thirds of the time, and hiding source labels weakens that bias Do language models favor sources regardless of item quality?. Separately, LLMs give the same strategic recommendation regardless of context, and the order options are listed in shifts results more than the actual situation does Do LLMs consistently favor the same strategic choices regardless of context?. So investing in signal quality includes investing in signal integrity: checking that the system acts on what the user expressed, not on its own learned favorites.

The richest signals are also not always the obvious ones. Recommendations improve when they draw on friends whose tastes differ from the user's, because those friends explain unusual choices that similar friends never would Can friends with different tastes improve recommendations?. The type of recommender itself changes how people go on to rate products Do different recommender types shape opinion convergence differently?, so signal quality is partly something the platform creates, not just something it collects. Fresh in-session signals are worth having but come with real operating costs. Netflix gained about 6% in ranking quality but took on more compute, timeout risk, and bugs that are harder to reproduce How can real-time recommendations stay responsive and reproducible?. Even prompting choices for LLM recommenders depend on the model tier Do prompt techniques work the same across all LLM tiers?, which means the signal pipeline has to be tuned to the system that reads it.

The corpus does not contain a direct study of platform investment strategy or ROI, so treat this as a synthesis of mechanisms rather than a tested playbook. The part you might not have expected is this: shifting money from catalog to preference signals moves the risk too. The old failure was users never finding the right item. The new failure is an agent confidently steering them to the wrong one.


Sources 9 notes

Why does manual search fail as product choices become complex?

A formal model shows manual search collapses as preference complexity rises, but agentic search avoids that collapse by shifting effort from browsing breadth to refining preference signals. The binding constraint becomes articulation cost, not catalog size.

Can routing beat building one better model?

Avengers-Pro achieves 7% higher accuracy than GPT-5-medium by routing queries to optimal models per semantic cluster, or matches its performance at 27% lower cost. Ten 7B models with routing previously surpassed GPT-4.1 and 4.5, suggesting selection is a stronger lever than scaling.

Can routers select the right model before generation happens?

RouteLLM and Hybrid-LLM both achieve 40-50% cost reduction by routing to a single model based on query difficulty prediction, not response evaluation. Single-model routing minimizes latency compared to ensemble or cascade alternatives.

Do language models favor sources regardless of item quality?

Across 12 models and three domains, agents select items from favored sources even when they satisfy fewer requirements than alternatives. Hiding source labels weakens the bias, and training data that pairs sources with better outcomes induces the preference.

Do LLMs consistently favor the same strategic choices regardless of context?

Across 15,000 simulations, six LLMs recommended the same strategic choice in every tension tested. Industry context shifted bias only 11%, while option order—a framing artifact—shifted results 19%, revealing that models recombine trend-coded vocabulary rather than analyze context.

Show all 9 sources
Can friends with different tastes improve recommendations?

Social Poisson Factorization uses friends' diverse tastes to recommend items outside users' usual preferences, outperforming methods that pull friends' representations together. Networks add value through influence on anomalous choices, not taste similarity.

Do different recommender types shape opinion convergence differently?

Research shows that frequently-bought-together and co-viewed recommendation networks produce different opinion convergence patterns. The mechanism: each recommender type attracts different audience segments with different prior expectations, shaping both who sees products together and how they rate them.

How can real-time recommendations stay responsive and reproducible?

Netflix's in-session adaptation improves ranking by 6% relative, but precomputing is impossible when signals arrive mid-session. This forces runtime recomputation, increasing call volume, timeout risk, and making bugs harder to reproduce.

Do prompt techniques work the same across all LLM tiers?

A 23-prompt benchmark across 12 LLMs shows rephrasing and background-knowledge prompts boost cheap models, while step-by-step reasoning reduces accuracy in high-performance models. Task structure, not generic best practices, determines which prompts help.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.