Does generative AI chat actually replace traditional search?
Exploring whether AI-powered chat is fundamentally changing how people seek information, or if traditional search remains central to real research workflows.
Nielsen Norman Group ran a qualitative lab study in which participants brought their own real research tasks, to watch how AI-powered search and chat are changing information-seeking habits. Its central finding is that generative AI "isn't close to completely replacing traditional search": every participant still used traditional search — keywords, results pages, visiting content pages — multiple times during the study, and "nobody relied entirely on genAI's responses (in chat or in an AI overview) for all their information-seeking needs." Traditional search and AI chat were often run "in tandem," sometimes even to fact-check each other. Within ordinary search, though, attention is already shifting: the AI overviews that "now top almost all search-results pages" steal attention and often answer the query without a click, a pattern NN/G says a quantitative study by Pew Research confirmed — Google searchers who saw an AI overview were "substantially less likely to click on results links."
The mechanism NN/G gives is habit stickiness plus an incentive threshold, not technology novelty. "Information-seeking habits are sticky" once a method feels reliable and convenient — their example is a participant who defaulted to Google "because it was built into his Chrome browser" — and changing an ingrained habit requires "a significant incentive." GenAI clears that bar often enough to be reshaping behavior, but the clearest obstacle NN/G reports is not resistance, it's discoverability: one participant used ChatGPT routinely for work email yet "had never considered using it for information seeking" until the study put him in front of Gemini for a plumbing question. NN/G's conclusion is that "discoverability remains a major challenge for genAI design — not only the discoverability of the tools, but also the discoverability of its possible functions and how to use it," and that AI overviews work best for "quick definitions and fast facts" rather than the synthesis-heavy tasks where chat has the edge.
This sits beside Which AI design principles for social media have research support?, whose only principle that note found backed by reported results was interface simplicity; NN/G's study gives that principle a concrete field case — a user with months of ChatGPT experience still didn't know chat applied to search until prompted. It also qualifies Do generated interfaces outperform text-based chat for most tasks?: that paper frames structured generated UI as beating conversational chat on preference grounds, while NN/G's participants weren't comparing interface styles at all — they simply hadn't discovered that chat was an option for this kind of task, a prior-to-preference barrier the UI-generation framing doesn't address.
NN/G does not report how many participants it studied, so the behavioral claims rest on an unspecified small qualitative sample plus one cited external figure (the Pew Research click-through finding, not NN/G's own data) — there is no quantitative measure here of how widespread the discoverability gap or the habit shift actually is across the population of search users. The piece also does not resolve whether the current AI-chat discoverability gap is a transient early-adoption lag, likely to close as "Chat" becomes a verb the way "google" did, or a durable design failure that will persist regardless of model capability; NN/G frames it as an open design challenge rather than predicting which.
Inquiring lines that read this note 12
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How can AI systems reliably guide voters without introducing political bias?- Does ChatGPT displace search engines or question-and-answer platforms?
- Does chatbot use for schoolwork reduce students' critical thinking skills?
- Do AI-generated articles now dominate search results as organic traffic declines?
- How do publishers distinguish between search crawling and AI training requests?
- When do AI overviews beat conversational chat for answering user questions?
- Which search queries trigger AI summaries most often on Google?
- Do searchers prefer clarity about AI involvement when viewing search overviews?
- Are zero-click searches rising because of AI answer summaries?
- Does effort reduction during search affect how deeply people understand topics?
- Do assistant sessions interleave with web content differently than search sessions do?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Which AI design principles for social media have research support?
The paper proposes four principles for ethical AI integration on social media. But how many actually rest on tested evidence versus untested assumptions? The distinction matters for platforms deciding what to implement.
NN/G's discoverability gap is a field case for that paper's untested "intuitive interfaces" principle
-
Do generated interfaces outperform text-based chat for most tasks?
Explores whether LLMs should create interactive UIs instead of text responses, and under what conditions users prefer dynamic interfaces to traditional conversational chat.
NN/G shows a prior-to-preference barrier (users don't know chat applies) that this UI-preference framing doesn't capture
-
Does ChatGPT harm informal learning compared to Google Search?
An 8-day experiment tested whether using ChatGPT for self-directed learning produces different knowledge gains than Google Search, and explored what mechanisms might explain any differences.
Qualifies A's claim: worse learning outcomes with ChatGPT vs Google suggest quality, not just discoverability, limits adoption
-
Do people use AI assistants before or after searching?
A panel study examined the sequence of assistant use relative to search and browsing in actual user sessions. Understanding this order matters for how AI assistants fit into people's real information-seeking workflows.
Evidence for A: assistant sessions usually follow, not precede, search/browsing — supporting the claim that AI chat supplements rather than replaces search
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- How AI Is Changing Search Behaviors
- Investigating the Impacts of Generative AI on Information Seeking
- The New Shape of Search: How Conversational AI Recomposes Information Seeking
- Learning by Chatting? Investigating the Impact of Generative AI on Information Seeking and Learning
- The Decision to Verify: How Warmth and User Characteristics Shape Reliance on Conversational Agents for Information Search
- Emerging uses of AI chatbots for news and what it means for journalism (Digital News Report 2026)
- The Impact of Generative AI on Social Media: An Experimental Study
- Seeing to Think? How Source Transparency Design Shapes Interactive Information Seeking and Evaluation in Conversational AI
Original note title
Nielsen Norman Group's study finds AI chat supplements but does not replace traditional search — discoverability of its use cases remains the barrier