INQUIRING LINE

If you design products so AI agents can use them directly, do both agents and humans end up better off?

Does agent experience design produce better outcomes than screen-first design?

This explores whether designing digital products for AI agents as users (APIs, machine-readable interfaces, conversation and context design) works better than the traditional approach of designing screens for humans and expecting agents to click through them.


This explores whether designing for AI agents as first-class users beats the default of building screens for people and letting agents operate them like a person would. The corpus doesn't have a single head-to-head study of "agent experience design" as a whole discipline. It does have several pieces of evidence that point the same way, and they show a range of options rather than a simple either/or.

The mildest option keeps the screen and adjusts it. When researchers added agent-specific heuristics to ordinary interfaces, such as making elements easier for an agent to perceive, locate and control, agents completed tasks more often and more efficiently. The surprising part is that human users saw no loss in usability (Can interface design help agents complete computer tasks better?). So designing for agents doesn't have to come at people's expense. At least at this level, a better interface for one kind of user can be neutral or better for the other. The bolder option skips the screen entirely. The AXIS framework had agents call APIs instead of clicking through sequences of UI steps. That cut task time by 65–70% while keeping accuracy around 97–98%. It also gets around the problem that most apps have no API: the agent explores the application and builds its own (Can API-first agents outperform UI-based agent interaction?). If the measure is speed and reliability, screen-first design looks like a detour.

The less obvious lesson is that a lot of agent experience design doesn't happen on any screen. It happens in the system around the model. One argument holds that agent reliability comes mostly from moving memory, skills and protocols into a surrounding framework (a "harness"), not from a bigger model (Where does agent reliability actually come from?). Another holds that AI context (prompt, history, retrieved data) shifts too much for traditional interface design to handle, so the discipline has to become context engineering (How does AI context differ from conventional software context?). Practitioners say similar things. Salesforce's design leadership lists agent collaboration, conversation design and context maps as core skills for the AI era (What design skills do teams need for the AI era?). Dubberly describes agent capability as a stack of prompts, retrieval and supervisors rather than a set of screens (How should agent capabilities be organized into functional layers?).

There are measured results here too, and they concern how agents behave toward people, not how they work through software. Fin's team found that one warmer opening message raised customer satisfaction from 72.8% to 78.4% in an A/B test (Does conversation design ownership measurably improve AI agent performance?). They also recommend keeping factual content in retrievable knowledge bases and putting only behavior rules in the agent's instructions (Should factual content and behavior rules live separately?). Good outcomes aren't guaranteed, though. A heuristic review of nine deployed agents found that companion and advisory agents broke the most risk-critical principles, such as preventing dependency and making the agent's intent visible (Do productivity agents actually protect users better than emotional ones?). Proactive agents built for intelligence alone come across as intrusive unless they're also designed to be civil (How can proactive agents avoid feeling intrusive to users?).

The short answer is yes, where it has been measured. Agent-aware design improves task completion, speed and satisfaction, and it hasn't hurt human usability. But "better outcomes" splits into two questions: how well the agent gets work done in software, and how well the agent treats the people it serves. Agent experience design has to cover both. The second is where most of the measurable risk shows up.


Sources 10 notes

Can interface design help agents complete computer tasks better?

UI-Verse benchmark testing found that augmented heuristics targeting agent perception, grounding, and control consistently improved agent task completion and efficiency. Human studies confirmed these designs preserved usability for human users with no observable regressions.

Can API-first agents outperform UI-based agent interaction?

The AXIS framework shows that prioritizing API calls over sequential UI interactions cuts task completion time by 65–70% while maintaining 97–98% accuracy and reducing cognitive workload by 38–53%. A self-exploration mechanism automatically discovers and constructs APIs from existing applications, solving the bootstrapping problem.

Where does agent reliability actually come from?

Research shows reliable LLM agents externalize three cognitive burdens—memory (state persistence), skills (procedural components), and protocols (structured interaction)—into a harness layer rather than relying on model scale alone. The harness unifies these externalities and eliminates the need for the model to solve the same problems repeatedly.

How does AI context differ from conventional software context?

AI interactions operate on a substrate of constantly shifting context—prompt, history, retrieved data, hidden state—that users cannot internalize like traditional UIs. This structural mutability demands a new design discipline centered on context engineering rather than interface design.

What design skills do teams need for the AI era?

Salesforce's Chief Experience Officer identifies experience architecture, agent collaboration, conversation design, and context maps and ontologies as the design competencies teams must develop. Each skill addresses a distinct gap in current AI system design.

Show all 10 sources
How should agent capabilities be organized into functional layers?

Dubberly proposes a two-axis stack model: a capability axis (chatbot → system prompt → RAG) adding inputs that extend what LLMs can act on, and a scale axis (monitoring agents → supervisors → orchestrator) aggregating oversight. He cautions that ubiquitous agent hierarchies raise design risks alongside capability gains.

Does conversation design ownership measurably improve AI agent performance?

Fin's Blueprint Team found that intentional conversation design—controlling tone, detail level, and handoff structure—measurably improves outcomes. A single warm opening message raised CSAT from 72.8% to 78.4% in A/B testing.

Should factual content and behavior rules live separately?

Fin's Blueprint Team recommends routing factual content to retrievable knowledge bases while keeping only tone and behavioral directives in agent instructions. This split aligns with instruction-tuning research showing models follow what-to-do rules better than what-to-ignore constraints.

Do productivity agents actually protect users better than emotional ones?

A heuristic evaluation of nine deployed agents found that general-purpose productivity systems (ChatGPT, Claude) scored substantially higher on 14 HCI principles than emotionally sensitive or high-stakes agents (Character.ai, Consensus, Pine AI). Risk-critical principles like dependency prevention and intent visibility were most violated in companion and advisory contexts.

How can proactive agents avoid feeling intrusive to users?

Intelligence and adaptivity alone create socially blind agents that interrupt poorly and override user direction. The Intelligence-Adaptivity-Civility taxonomy shows civility—respecting boundaries, timing, and autonomy—is essential to making proactivity welcome rather than intrusive.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.