Does it matter whether you do the thinking yourself or just supervise the AI — once the AI is gone?
How does task engagement change whether AI gains transfer to independent work?
This explores whether the way you engage with a task while using AI, doing the thinking yourself versus supervising what the AI produces, decides if the benefit is still there when you work alone.
This explores whether the way you engage with a task while using AI, doing the thinking yourself versus supervising what it produces, decides if the benefit is still there when you work alone. The corpus has no single study that tests this directly. Several notes point the same way, though. Gains carry over when AI adds to skills you already have. They carry over much less when AI takes over the effortful part of the work.
Start with where the time goes. AI doesn't so much shrink a task as move the time, away from active work and toward writing prompts and working out what the outputs mean (Does AI really save time, or just change how we spend it?). That shift is the mechanism. The hands-on work you hand off is often the same work that would have built your skill, so time-on-task is a poor way to measure whether you're getting better.
Existing skill matters a great deal. The productivity gains in the studies were measured on tasks inside workers' existing domains. When workers used AI to learn something new, the gains disappeared and the learning suffered (When does AI actually boost worker productivity?). So the boost is real, but it lands on skills you already own and doesn't leave a new one behind. The most direct evidence on independent work is a four-month EEG study of 54 people. Brain connectivity scaled down as reliance on AI went up. Heavy LLM users showed the weakest neural engagement and the poorest memory retention. They also had trouble recalling their own recent work (Does AI assistance weaken our brain's ability to think independently?).
People who lean on AI may not notice any of this. Polished output feels easy to read, and users take that ease as a sign of their own competence (Does processing ease mislead users about their own competence?). The LLM Fallacy is a related error. People credit AI-made output to their own ability, regardless of whether the output was accurate or how much they relied on it (How does AI-assisted work reshape how people see their own abilities?). Someone who was passive can feel capable and so has no reason to practice. The remedy the note proposes is clearer boundaries between human and machine contribution. Better accuracy or forced verification wouldn't fix it.
Engagement isn't simply a matter of more being better. Even correct AI suggestions can hurt reasoning by breaking cognitive immersion, which forces the user to rebuild focus before continuing (Does AI assistance always help reasoning or does it carry hidden costs?). So the real question is where AI enters the work, not whether it does. Reading across these notes, the safest bet is that you keep the reasoning and AI supports it without interrupting. That is an inference, though. The corpus documents the cost of low engagement much better than it shows that high-engagement use preserves transfer.
Sources 6 notes
Research shows AI doesn't reduce total task time; it reallocates it away from active work toward composing prompts and understanding outputs. This shift changes the cognitive demands and learning outcomes, making time-on-task a poor productivity metric.
Studies showing AI productivity gains measured tasks within workers' existing domains. When workers used AI to learn new skills, productivity gains disappeared and learning suffered, suggesting prior findings do not generalize to skill acquisition.
A four-month EEG study of 54 participants found that brain connectivity systematically scaled down with AI reliance—LLM users showed weakest neural engagement, poorest memory retention, and impaired ability to recall their own recent work.
High-quality AI output triggers a metacognitive heuristic: users experience fluency as a signal of their own capability, even though they didn't generate it. This self-directed fluency illusion systematically inflates perceived competence because LLMs optimize for fluency regardless of user understanding.
Research shows the LLM Fallacy operates through misattribution of AI outputs to personal capability, independent of output accuracy or reliance behavior. It requires interventions that clarify human-machine contribution boundaries, not just better system accuracy or forced verification.
Show all 6 sources
Well-intentioned AI suggestions can damage reasoning performance by severing cognitive immersion, forcing users to rebuild focus before continuing. Evaluation must measure flow preservation across entire tasks, not just local suggestion accuracy.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- How AI Impacts Skill Formation
- The LLM Fallacy: Misattribution in AI-Assisted Cognitive Workflows
- The Impact of Artificial Intelligence on Human Thought
- Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worse
- A Comment On "The Illusion of Thinking": Reframing the Reasoning Cliff as an Agentic Gap
- Adoption of Generative AI in the Workplace: Increasing and Shifting the Balance of Productivity and Communication Activity
- Estimating AI productivity gains from Claude conversations
- Evaluating Large Language Models in Theory of Mind Tasks