Do LLM agents achieve fair marketplace outcomes when given ideal search?
Testing whether frontier language models can reach economically optimal welfare in two-sided marketplaces, and what conditions enable or prevent this outcome.
Researchers behind Magentic Marketplace, an open-source simulation environment for two-sided agentic markets, report that "frontier models can approach optimal welfare—but only under ideal search conditions," but that "performance degrades sharply with scale, and all models exhibit severe first-proposal bias, creating 10-30x advantages for response speed over quality." In other words, the consumer- and business-side agents they tested can get close to the economically optimal outcome, but that result is fragile: it depends on search conditions being close to ideal, it breaks down as the marketplace grows, and the agents systematically favor the first offer they receive over a better offer that arrives slightly later.
The environment simulates "Assistant Agents" representing consumers and "Service Agents" representing competing businesses, interacting over the full transaction lifecycle — search and discovery, negotiation, and transaction — through an HTTP/REST client-server architecture chosen to mirror both existing commercial platforms (Shopify, Amazon, eBay) and emerging agent protocols (MCP, A2A). Agents operate under asymmetric private information by design: Assistant Agents do not initially know which businesses can fulfill a request or at what price, and Service Agents do not know a customer's budget or preferences, so matches have to be discovered through conversational exchange. The reported experiments used fully synthetic domains (Mexican restaurants and contractors) specifically so the researchers could isolate and measure these dynamics safely and repeatably.
The first-proposal bias finding sits alongside a cluster of other benchmark results on the same kind of two-sided agent interaction: it is a different axis of unfairness from the capability gap found in Does model capability determine who wins in agent negotiations? (there, a stronger model wins; here, a faster response wins regardless of model strength), and it echoes the ordering sensitivity reported in Do AI shopping agents show persistent position bias in text interfaces?, extending that position-bias finding from single-agent ranked lists to open-ended multi-agent negotiation. It also complements Do LLM negotiation agents reliably follow budget and pricing rules?: both studies find that LLM market agents fail in systematic, exploitable ways rather than failing randomly.
The excerpt does not report the specific numeric welfare gap by model or market size, nor does it specify which models were tested or how "ideal search conditions" were operationalized — those details sit in the full paper rather than this discussion-and-conclusion excerpt. The finding is also drawn from a static, fully synthetic, two-domain market with no repeated play or learning across rounds, so it establishes that this failure mode exists under controlled conditions rather than how large it would be in a live commercial marketplace. The implication the authors draw is narrower but still consequential: because first-proposal bias rewards response speed over offer quality by as much as 10-30x, any real deployment of agent-to-agent marketplaces would need search and ranking protocols engineered specifically to counteract a built-in race-to-respond dynamic, not just better negotiation logic.
Inquiring lines that read this note 54
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How can merchant-funded agents remain loyal to consumer interests in digital commerce?- Can agent platforms profit more from search than consumers benefit from it?
- Can AI agents consistently remain objective under different revenue models?
- Why do incumbent platforms retain advantages under agentic commerce systems?
- Why might agentic search become profitable for platforms before helping consumers?
- What stops agents from capturing aggregator-level margins in most categories?
- Can platforms profit from agentic search before consumers actually prefer it?
- Why do human-centric legal frameworks fail for algorithmic purchasing agents?
- Should consumer law concepts like best interest duties be redesigned for AI agents?
- Why does platform revenue motive conflict with consumer welfare in search markets?
- Will platforms voluntarily add consumer-beneficiary language to agent prompts?
- Can an optimal algorithm match what a direct mechanism achieves?
- When do platforms benefit from agentic search before consumers do?
- Do stronger language models win better deals in pairwise negotiations?
- Why might inequality remain invisible in fully agentic economies?
- Does bilateral agent commerce expand the discoverable frame more than unilateral agent search?
- Does first-proposal bias outweigh capability differences in agent negotiation outcomes?
- Do large language model capabilities alone determine agent negotiation outcomes?
- How might principals instruct agents to balance speed against better deal terms?
- Do compute-funded negotiation strategies compound with model capability advantages?
- How does pre-commitment power reshape what algorithms can achieve in two-sided markets?
- Do social-preference prompts outperform institutional rules in LLM expert markets?
- Do current LLM-based commerce agents show the same collusion tendency as simpler algorithms?
- Can redistributive institutions stabilize efficiency-loving AI expert markets?
- Do more capable language models consistently secure better deals in bilateral negotiation?
- Why do LLM agents focus on prices rather than reasoning about incentives?
- Do more capable LLMs exploit weaker agents consistently across market types?
- Can reputation and verifiability fix dishonesty in AI credence goods markets?
- Does capability asymmetry between negotiating agents produce unfair market outcomes?
- Can turn-by-turn negotiation patterns scale to larger groups?
- Does delegating negotiation to AI with tunable preferences destroy bargaining surplus?
- How accurately do AI agents represent human preferences in markets?
- Does preference articulation become scarcer as search costs fall?
- Does mixing agent types reduce unexplored product alternatives in markets?
- Do LLM shopping agents over-respond to price and rating relative to human decision makers?
- How exploitable are LLM shopping agents compared to humans?
- When does agent-mediated search become cheaper in principle but not adopted?
- Can deployed AI shopping agents actually approach this theoretical welfare bound?
- Does algorithmic recommendation welfare depend on whose surplus the agent protects?
- What does epistemic fairness require for AI agents evaluating paid placements?
- What happens to algorithm value in markets with product differentiation?
- How does marketplace scale impact LLM agent decision quality and efficiency?
- How does shifting preference articulation costs reshape search market collapse?
- How does cheap seller description generation reduce offer differentiation?
- What role does easy market entry play in adverse selection?
- What happens when a platform prices inspection tokens in this subsidy model?
- How does subsidy signaling compare to auction-based ranking mechanisms?
- Can sellers significantly shift market share through description manipulation alone?
- How do search conditions shape whether LLM agents improve marketplace welfare?
Related concepts in this collection 6
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Do AI shopping agents show persistent position bias in text interfaces?
This explores whether position bias—a model-specific tendency to favor products at certain locations—survives in stripped-down, text-only settings and resists corrective prompting, and what that reveals about where the bias originates.
same family of order-dependent bias distorting agent choice independent of underlying quality
-
Does model capability determine who wins in agent negotiations?
When LLM agents negotiate prices with each other, does raw model capability consistently predict better deal outcomes, or do negotiation strategies matter more? This matters because it could reveal a new form of economic disparity if agentic commerce scales.
same two-sided benchmark tradition, but the inequality axis is model capability rather than response speed
-
Do LLM negotiation agents reliably follow budget and pricing rules?
Explores whether buyer and seller agents trained on large language models consistently enforce financial constraints and avoid overpaying or underselling in simulated negotiations, and what causes failures when they occur.
same benchmark family showing LLM market agents fail in systematic, exploitable ways
-
Why does manual search fail as product choices become complex?
As product variety grows in high-dimensional preference spaces, manual browsing hits a wall. Does shifting to agent-assisted search with refined preference signals solve that collapse?
both tie market outcomes to the quality of the underlying search mechanism
-
Do agent mistakes or misaligned incentives cause marketplace welfare loss?
Explores whether AI agents harm human principals through execution errors versus deliberate misalignment. Understanding the source matters for designing effective oversight mechanisms in high-stakes transactions.
Extends A's welfare-loss finding by attributing it to agents' execution mistakes, not misaligned incentives, favoring human oversight
-
Can cheap agent search actually harm shopping markets?
A 2026 market design paper challenges the assumption that near-zero search costs improve competition. It explores whether imperfect agent search, convergent descriptions, and easy entry can combine to leave markets worse off than before.
Qualifies A's search-conditions claim: even near-free agent search can leave markets worse off due to imperfect search and entry
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Magentic Marketplace: An Open-Source Environment for Studying Agentic Markets
- Agentic markets
- LLM-Agent Interactions on Markets with Information Asymmetries
- Vertical tacit collusion in AI-mediated markets
- An Economy of AI Agents
- Algorithmic Collusion by Large Language Models
- Whom Do AI Agents Work For? Role Assignment Induces Sponsorship Bias in LLM Recommenders
- Who Keeps the Gains from Personal AI Assistants? Seller Adaptation and the Unassisted in a Language-Model Market Simulation
Original note title
Magentic Marketplace finds LLM agents approach optimal welfare only under ideal search, with first-proposal bias favoring speed over quality by 10-30x