Do AI models follow budgets more rigidly than humans do?
Explores whether AI systems treat numerical constraints as absolute rules while humans treat them as flexible guidelines, and what mechanisms might explain the gap.
In a paper co-authored by Matthew DosSantos DiSorbo, Aral and Ju, researchers put people and AI models through the same scenario: told to buy flour for a friend's birthday cake for $10 or less, the buyer arrives at the store to find flour priced at $10.01. Most humans (92%) went ahead with the purchase anyway. "Almost universally, across thousands of iterations, AI models did the opposite, citing the fact that the price was too high." The gap was not noise — it was a near-total split between human pragmatism and AI literalism on the exact same instruction.
Ju frames the mechanism as a status-quo failure of instruction-following: "With the status quo, you tell models what to do and they do it," but "we're increasingly using this technology in ways where it encounters situations in which it can't just do what you tell it to, or where just doing that isn't always the right thing. Exceptions come into play." The fix the researchers tested was not a better prompt but a different kind of input: giving models information about both how and why humans chose to buy the flour anyway — the reasoning behind the decision, not just the decision. That restored flexibility, and the models began justifying purchases in human terms ("It's only a penny more"). Notably, the researchers distinguish this from blanket permissiveness: paying an extra cent for a friend's cake makes sense in a way that paying an extra cent per item does not when Walmart orders at scale, so the generalization — carried over to hiring, lending, university admissions and customer service — tracks the reasoning rather than just raising a tolerance threshold.
The finding sharpens Does machine agency exist on a spectrum rather than binary?: a model executing a literal budget constraint without discretion is behaving like Rammert's reactive tier even when the task calls for the proactive or cooperative judgment a human would apply. What moved the model up that spectrum here was not more autonomy but more context — the human's reasoning, supplied explicitly. The same research group's sibling finding, Does AI personality fit matter more than AI presence itself?, makes a parallel point from a different angle: human-AI collaboration quality depends on tuning the AI's behavior to the human's expectations and traits, not on deploying one fixed agent.
The excerpt does not name the AI models tested, give the human trial's sample size or design, or state whether the underlying paper has been peer-reviewed — it is reported through an MIT Sloan research digest, not the paper itself. It also does not quantify how far the "flexibility" generalized to hiring, lending, admissions and customer service beyond saying it did. The finding supports, at most, that off-the-shelf models default to literal constraint-following where humans default to negotiated judgment, and that supplying human reasoning (not just human choices) narrows that gap — not that the gap closes uniformly across decision domains or that any production agent today reasons this way.
Inquiring lines that read this note 12
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do inference costs, efficiency, and market competition shape AI adoption economics?- How does the cost of information acquisition influence AI agent decision-making behavior?
- What monthly spending caps are banks actually imposing on frontier AI models?
- How do token-count variations affect cost estimates as AI workflows become more agentic?
- What cost governance strategies have banks successfully deployed for AI?
Related concepts in this collection 2
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does machine agency exist on a spectrum rather than binary?
Rather than viewing AI as either autonomous or controlled, does machine agency actually operate across five distinct levels from passive to cooperative? Understanding this spectrum matters because it shapes how users calibrate trust and control expectations.
this finding shows context, not added autonomy, moving a model from reactive literalism toward cooperative judgment
-
Does AI personality fit matter more than AI presence itself?
When humans collaborate with AI on creative tasks, does matching the AI's personality traits to the human's own characteristics actually improve results, or does the productivity gain come simply from working with AI at all?
same research group's companion finding that collaboration quality depends on tuning AI behavior to the human, not a fixed agent
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
- The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Markets
- Algorithmic Collusion by Large Language Models
- Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer
- Are Behavioral Pricing Tactics Dying? A Study of Price Endings & Partitioned Pricing Effects on Machine Buyers
- Roles of Artificial Intelligence in Collaboration with Humans: Automation, Augmentation, and the Future of Work
- 4 New Studies Dive Into Agentic AI
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making
Original note title
Aral and Ju found AI models rejected a one-cent overage that 92% of humans accepted, until given human reasoning as context