Do reflection questions help people make better decisions with AI?
This explores whether conversational AI that prompts users to think through problems outperforms AI that simply provides answers. Understanding this matters for designing AI tools that genuinely improve human judgment rather than replace it.
Through a lab study (N=80), LLM-based "Thinking Assistants" that combine asking reflection questions with providing advice outperform conversational agents that only ask questions, only provide advice, or neither. The key insight: "Rather than adhering to the prevailing authoritative approach of generating definitive answers, LLM agents aimed at assisting with cognitive enhancement should prioritize fostering reflection. They should initially provide responses designed to prompt thoughtful consideration through inquiring, followed by offering advice only after gaining a deeper understanding of the user's context and needs."
This directly challenges the default LLM interaction paradigm. Since Why can't conversational AI agents take the initiative?, the Thinking Assistant approach provides an alternative to passivity that doesn't require proactivity in the traditional sense — instead of the AI taking initiative to redirect, it takes initiative to question. This is proactivity in the Socratic mode rather than the directive mode.
The approach leverages LLMs' encoded "world-knowledge" while avoiding the authority-without-accountability problem that since Does polished AI output trick audiences into trusting it?, direct answers carry unearned authority. Questions carry no such risk — they prompt the human to exercise their own judgment.
Inquiring lines that read this note 39
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What conversation mechanics enable genuine human-AI communicative participation?- What are the five specific conversation triggers where AI intervention adds value?
- Why do conversational systems benefit from post-thinking between user turns?
- Does conversational AI reduce learner control over information selection?
- When do AI overviews beat conversational chat for answering user questions?
- How does AI assistance differ from search engines in cognitive impact?
- Does the timing of AI feedback relative to user reasoning change its effectiveness?
- Can users tell the difference between their own thinking and AI contribution?
- How does AI assistance affect human cognitive development over time?
- How does AI assistance change learning outcomes across different cognitive engagement levels?
- Can explicit reflection during AI-assisted work improve transfer of learning?
- Does metacognitive feedback about AI assistance work beyond a single online session?
- Does metacognitive feedback reduce reliance on AI-generated answers?
- Can metacognitive feedback reduce how much people offload thinking to AI?
- Can metacognitive feedback prompts reduce students' reliance on AI assistance for answers?
- Does AI taking active roles in conversation improve human understanding or outcomes?
- How can AI systems help users clarify what they actually want?
- Can perspective-taking theory predict who benefits most from human-AI partnership?
- How does perspective-taking predict who benefits from human-AI collaboration?
- Do AI rationales explain why a choice was made or justify it afterward?
- Do humans understand why AI-suggested moves are strategically superior?
- Why does knowing what questions to ask improve AI output?
- Why does AI assistance trigger harsher judgment than other workplace tools?
- What design features make tutoring AI preserve learning better than answer-giving AI?
- Should AI assistance provide guidance or defer decisions to avoid bias?
- Does repeated human-AI interaction change human decision-making preferences?
- When humans retain final decisions while AI proposes methods, who answers for errors?
- Is judgment the scarce asset when AI handles most cognitive tasks?
- Can AI advice improve crowd decision-making when the crowd might reject correct answers?
Related concepts in this collection 1
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can models learn to ask clarifying questions instead of guessing?
Exploring whether large language models can be trained to detect incomplete queries and actively request missing information rather than hallucinating answers or refusing to respond. This matters because conversational agents today remain passive, responding only when prompted.
Thinking Assistants are the decision-support analog of proactive critical thinking
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Thinking Assistants: LLM-Based Conversational Assistants that Help Users Think By Asking rather than Answering
- When Hindsight is Not 20/20: Testing Limits on Reflective Thinking in Large Language Models
- Toward Measuring AI's Effects on Skill Formation: The Stock-Formation Gap
- GenAI as a Power Persuader: How Professionals Get Persuasion Bombed When They Attempt to Validate LLMs
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making
- AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
- Exploring the Impact of Artificial Intelligence: Prediction versus Judgment
- Self-Reflection in LLM Agents: Effects on Problem-Solving Performance
Original note title
thinking assistants that ask reflection questions outperform those that only provide answers — fostering reflection over authority improves human decision-making with AI