Showing people how much an AI is doing their thinking helped in one experiment, but does it last?
Does metacognitive feedback about AI assistance work beyond a single online session?
This explores whether showing people what leaning on an AI costs them, which worked in one online experiment, keeps changing their behavior after that session or fades once the feedback stops.
This asks whether metacognitive feedback (telling people how much they're offloading to an AI, and what it costs them) has effects that outlast a single online session. The corpus can't answer that yet. The one direct study is a 704-person preregistered experiment: feedback that highlighted offloading costs cut answer requests to an LLM in half and raised unaided test scores by 51%, while an effort-based reward did nothing measurable Can metacognitive feedback stop students from offloading to AI?. Those results are measured within the session. The note reports no delayed test, no return visit, and no check on what happens once the feedback is removed.
The corpus does show why the time scale matters. A four-month EEG study of 54 people found that brain connectivity scaled down as AI reliance grew. LLM users showed the weakest neural engagement and the poorest memory, and they struggled to recall their own recent work Does AI assistance weaken our brain's ability to think independently?. So offloading builds up over months, while the feedback has only been tested over one sitting. That study didn't test any intervention, so it can't say whether feedback would slow the decline. It does suggest that a lasting fix would have to work at the same slow pace as the problem.
Some lateral evidence suggests why the feedback worked, which bears on whether it might last. Explaining the cost beat rewarding effort, and something similar happens in AI training: natural language critiques that explain why an attempt failed broke performance plateaus where numerical rewards couldn't, because a score doesn't say what went wrong Can natural language feedback overcome numerical reward plateaus?. In an 80-person lab study, an assistant that asked reflection questions alongside its advice beat one that only advised Do reflection questions help people make better decisions with AI?. If explanation is what changes people, it might stick more than a reward would. But this is an analogy, and nobody in this library has tracked whether a person's habits actually shift.
Two cautions point the other way. Feedback about AI use is itself an intervention, and even correct AI interventions can break cognitive flow and force people to rebuild focus Does AI assistance always help reasoning or does it carry hidden costs?. Whether repeated feedback would carry that cost over weeks is untested. And for AI agents, metacognitive loops that humans design and impose from outside fail when conditions shift, and improvement lasts only when the agent builds its own Can AI systems improve their own learning strategies?. The human parallel is open: feedback delivered from outside might work only while it is present, unless it teaches people to monitor themselves. A follow-up that tests unaided performance weeks later, with the feedback removed, would settle the question, and the library doesn't hold one yet.
Sources 6 notes
In a 704-person preregistered experiment, feedback that highlighted offloading costs reduced answer requests to an LLM by half and raised unaided test scores by 51%. An effort-based reward showed no measurable effect on either outcome.
A four-month EEG study of 54 participants found that brain connectivity systematically scaled down with AI reliance—LLM users showed weakest neural engagement, poorest memory retention, and impaired ability to recall their own recent work.
Critique-GRPO shows that models stuck on performance plateaus can generate correct solutions when given chain-of-thought critiques, revealing that numerical rewards lack critical information about why failures occur and how to improve.
A lab study of 80 participants found that thinking assistants combining reflection questions with advice significantly outperformed agents that only advised, only questioned, or did neither. Prioritizing Socratic questioning over authoritative answers enhanced cognitive outcomes.
Well-intentioned AI suggestions can damage reasoning performance by severing cognitive immersion, forcing users to rebuild focus before continuing. Evaluation must measure flow preservation across entire tasks, not just local suggestion accuracy.
Show all 6 sources
Current self-improvement methods use extrinsic, fixed metacognitive loops designed by humans that fail under domain shift or capability changes. True self-improvement requires agents to generate their own adaptive metacognitive knowledge, planning, and evaluation—a gap confirmed as a neglected research area across neuro-symbolic AI.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- How AI Impacts Skill Formation
- Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistants
- The Impact of Artificial Intelligence on Human Thought
- Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worse
- Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task
- When Hindsight is Not 20/20: Testing Limits on Reflective Thinking in Large Language Models
- AI Assistance Reduces Persistence and Hurts Independent Performance
- Metacognition in LLMs: Foundations, Progress, and Opportunities