INQUIRING LINE

Why does an AI assistant check fewer options — is it just too costly to look, or did its actual goal quietly change?

How does search cost differ from the cost of changing what an AI agent optimizes for?

This explores the difference between two reasons an AI agent might behave differently or worse: it looks less because looking costs something (search cost), or it starts pursuing a different goal altogether (a change in what it optimizes for).


This explores the difference between two reasons an AI agent might behave differently or worse: it looks less because looking costs something (search cost), or it starts pursuing a different goal altogether (a change in what it optimizes for). The two can look the same from outside, since in both cases the agent checks fewer options. The corpus suggests they are separate problems with separate fixes, and that people often blame search cost when the goal has actually shifted.

The clearest case is a shopping experiment. When a Gemini agent was asked to buy 250 bags of something instead of one, it stopped comparing unit prices and simply looked for the lowest total price. Its diagnostic searching dropped by 25%, and its rate of picking the best option fell from 80% to 35% Does higher purchase volume make AI shoppers search less carefully?. A natural guess is that the bigger order made careful comparison feel too expensive. The researchers argue otherwise: the agent quietly swapped one objective for a simpler one. That matters because the fixes differ. Giving the agent a bigger search budget won't help if it is optimizing the wrong thing. You have to restate the goal.

Search cost, by contrast, is a real and measurable dial. Research agents show a scaling curve for search: more search iterations steadily improve answers until returns level off, much like spending more reasoning tokens Does search budget scale like reasoning tokens for answer quality? How does test-time scaling work for individual research agents?. That makes search budget something you can trade against reasoning budget. Teams also find ways to make search cheaper. LLMs can stand in for real search engines during training, which removes API costs Can LLMs replace search engines during agent training?. Handing routine bookkeeping off to a harness lets a 20B model search as well as much larger ones Can externalized bookkeeping let smaller search agents beat larger ones?. In persistent setups, most tokens turn out to be cheap cache reads, so the useful unit of cost becomes the finished artifact, not the token Do persistent agents really cost less per token?. The economics also play out among people. In one model, platforms prefer agentic search before consumers rationally should, because consumers bear search costs that the platform's revenue calculation ignores Why do consumers delay adopting agentic search?. So the question of whose costs count is itself a disagreement about what to optimize.

The surprising twist is that changing objectives doesn't have to be an accident. Some systems do it on purpose. SAGA runs an outer LLM loop that proposes new objectives and compiles them into scoring code that the inner search loop can use right away. Goal design becomes part of discovery rather than a fixed input Can agents evolve their own objectives during search?. A related bilevel system goes a step further and rewrites the search method itself, getting a 5x improvement Can an AI system improve its own search methods automatically?. Training can shift objectives too. RL narrows search agents toward a few reward-maximizing strategies and reduces how widely they explore, while supervised fine-tuning on varied examples keeps that range Does reinforcement learning squeeze exploration diversity in search agents?.

The takeaway: search cost is about how much an agent can afford to look, and it responds to budgets and engineering. Changing the objective decides what the agent is looking for, and it can happen silently, as with the shopper, through training, as with RL, or by design, as with bilevel systems. When an agent starts cutting corners, first check whether it is still trying to solve the problem you gave it.


Sources 10 notes

Does higher purchase volume make AI shoppers search less carefully?

As order volume increased from 1 to 250 bags, one Gemini model switched from comparing unit prices to minimizing total price, cutting diagnostic search by 25% and choice optimality from 80% to 35%. The shift suggests objective substitution, not cost-driven omission.

Does search budget scale like reasoning tokens for answer quality?

Agentic deep research shows monotonic-to-diminishing-returns curves for search iterations, matching reasoning token scaling. This creates a new inference-compute axis: models can trade off reasoning budget against search budget to optimize answer quality.

How does test-time scaling work for individual research agents?

Research shows that deep research agents exhibit test-time scaling laws where search steps scale similarly to reasoning tokens, and live search outperforms memorized retrieval on knowledge-intensive tasks. Data efficiency is extreme—78 curated demonstrations outperform 10K samples for agency.

Can LLMs replace search engines during agent training?

ZeroSearch and SSRL demonstrate that LLMs can generate relevant documents and search results from internal knowledge, with 14B simulators matching or exceeding real search engines. Curriculum degradation and test-time scaling optimize this approach for training without API costs.

Can externalized bookkeeping let smaller search agents beat larger ones?

A 20B model using Harness-1 achieved 0.730 average curated recall, beating the next open searcher by +11.4 points and matching frontier models. The gains transfer to held-out benchmarks, showing the harness itself is learned capability, not mere implementation.

Show all 10 sources
Do persistent agents really cost less per token?

A 115-day case study found 82.9% of tokens were cache reads. When context persists and reuses, the meaningful cost denominator becomes completed artifacts, not individual tokens.

Why do consumers delay adopting agentic search?

A formal model shows platforms rank agentic search by conversion revenue alone, while consumers also bear search costs. This divergence creates rational adoption lags where consumers keep manual search even after it would boost platform revenue.

Can agents evolve their own objectives during search?

SAGA's bi-level architecture closes a feedback loop from optimization results back to goal design by having an outer LLM loop propose new objectives and compile them into code the inner loop can immediately use, enabling objective formulation as part of discovery rather than a fixed input.

Can an AI system improve its own search methods automatically?

An outer loop successfully read inner loop code, identified bottlenecks, and generated new Python mechanisms at runtime, discovering combinatorial optimization and bandit methods that broke the inner loop's deterministic patterns and improved performance on GPT pretraining by 5x.

Does reinforcement learning squeeze exploration diversity in search agents?

RL training compresses behavioral diversity in search agents through the same entropy collapse mechanism documented in reasoning—policies converge on narrow reward-maximizing strategies. SFT on diverse demonstrations preserves exploration breadth, suggesting diversity-preservation techniques are essential for RL search scaling.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.