INQUIRING LINE

When AI does the making and you just grade its work, why does that smaller role make you care less?

Why does shifting work from production to evaluation reduce user engagement?

This explores why people can become less engaged, and less invested, when AI does the making and their role narrows to checking and judging what the AI made.


This explores why people can become less engaged, and less invested, when AI does the making and their role narrows to checking and judging what the AI made. The corpus doesn't have a single study that isolates this mechanism. What it does have, read together, points to a clear answer: evaluation is a thinner kind of involvement than production. It gives people less control, less feedback and less ownership. It also tends to grow faster than anyone's ability to keep up with it.

The idea comes from decades of research on automation, not from AI. Simkute and colleagues take established Human Factors principles, first developed for cockpits and control rooms, and apply them to generative AI Can Human Factors design fixes restore GenAI productivity losses?. That older research found that when machines take over the doing, humans become monitors. Monitoring is hard to sustain because it gives you less feedback and less sense of what's going on. The proposed fixes show what gets lost: continuous feedback, interfaces that keep the task visible, stable task structure and clear division of who does what. One caveat matters: these fixes are proposals, not tested remedies. The diagnosis is better supported than the cure.

The ownership research adds a second piece. People feel a piece of AI-generated text is theirs in proportion to how much they shaped it Does user control over AI text shape feelings of ownership?. A personalized AI model didn't change that feeling. Only real influence over the output did. So when someone moves from writing to approving, the work feels less like theirs, and people put less care into things they don't feel they own. Tool design can make this worse. Generated interfaces in AI-assisted analysis make results clearer but harder to change mid-task Do generated analysis UIs really work better than chat?. That pushes users further toward approving or rejecting and away from shaping.

Then there's scale. When AI produces faster than people can judge, evaluation becomes a backlog instead of a craft. One paper calls this "epistemic hyperinflation": confidence in knowledge collapses the way money loses value in hyperinflation Can AI generate knowledge faster than humans can evaluate it?. The same pattern shows up in academic publishing, where AI-scaled paper production drives AI-automated review, which in turn invites manipulation and countermeasures Does AI create a coupled arms race in research production and review?. Once checking is handed to machines too, people are pushed one step further from the work.

One result you might not expect: "engagement" can drop for an almost opposite reason. In Nextdoor's experiments, better AI summaries *reduced* clicks Does better summary writing actually increase user engagement?. The AI had already done the reader's work of judging whether a post was worth opening, so they had no reason to click. Together, these findings suggest engagement depends on whether the user still has something meaningful left to do. Take away the making and people disengage from the work. Take away the judging as well and they stop showing up at all.


Sources 6 notes

Can Human Factors design fixes restore GenAI productivity losses?

Simkute and colleagues map five established automation-design principles onto GenAI interaction challenges, focusing on continuous feedback, personalization, ecological interfaces, task stabilization, and clear task allocation. These proposals remain untested research directions rather than validated interventions.

Does user control over AI text shape feelings of ownership?

Study 1 found that greater user control over generated text raised sense of ownership, while personalizing the AI model had no impact on the AI Ghostwriter Effect.

Do generated analysis UIs really work better than chat?

TaskArtisan found that GUI widgets improve clarity and presentation in LLM-assisted analysis but introduce rigidity and prompting overhead. This trade-off between malleability and specification appears unavoidable: easier-to-use UIs are harder to customize mid-workflow, while flexible UIs demand engineering-style thinking from non-programmers.

Can AI generate knowledge faster than humans can evaluate it?

AI produces knowledge faster than human judgment can verify it, collapsing epistemic confidence just as monetary hyperinflation collapses purchasing power. The gap self-reinforces because evaluation tools are themselves AI-generated, trapping the system in acceleration.

Does AI create a coupled arms race in research production and review?

A survey of 230 publications reveals production scaling, evaluation automation, manipulation, defenses, evasion, and ecosystem feedback as linked response relations among actors. Evidence is strongest for early stages and weakens toward long-horizon adaptation and feedback.

Show all 6 sources
Does better summary writing actually increase user engagement?

Nextdoor experiments showed LLM-generated summaries were objectively more informative but decreased click-through rates. Users had no reason to open notifications when the summary already satisfied their information need, demonstrating how optimizing for informativeness can backfire on engagement metrics.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.