SYNTHESIS NOTE
Topics›Design Frameworks›this note

Can language models discover what users actually want from activity logs?

Users pursue month-long interest journeys that transcend individual item clicks. Can LLMs extract these persistent goals from behavioral patterns, and does this change how we should think about personalization?

Synthesis note · 2026-02-23 · sourced from Design Frameworks

Recommender systems predict the next item a user might click on, given their history. But when you ask users what they're actually doing on the platform, they describe something different: persistent, overarching interests — "designing hydroponic systems for small spaces," "learning the ukulele as a beginner," "cooking Italian recipes." These are interest journeys, and they operate at a completely different level of abstraction from next-item prediction.

Survey data shows 66% of respondents recently pursued a valued journey on the platform. Of those, 80% consumed relevant content for more than a month, with half saying some journeys last more than a year. People pursue 1-3 journeys simultaneously.

The semantic gap is real: collaborative filtering captures correlational patterns between items ("people who watched X also watched Y") but cannot reason about the user's underlying goal, need, or interest. Two users both interested in stand-up comedy may pursue completely different aspects — history documentaries vs. SNL skits. The journey is personalized at a granularity collaborative filtering cannot reach.

LLMs can bridge this gap. Through personalized clustering of user activity logs followed by LLM-powered journey naming, the system produces journey descriptions users identify with. But specificity matters — "greenhouse designs for cold climates" was irrelevant for someone pursuing indoor gardening. The right level of abstraction is what the user would actually say to a friend asking about their interests.

This connects to How do personalization granularity levels trade precision against scalability? — interest journeys operate at the user level but require persona-level precision. Since Does chatbot personalization build trust or expose privacy risks?, journey-aware systems that understand your persistent interests will trigger both the trust and privacy dimensions of this dual dynamic.

Inquiring lines that read this note 41

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How do dialogue structure and state management affect multi-turn reasoning quality? How should AI ethics integrate consciousness, values, and transparent disclosure? How can recommendation systems balance individual and population-level goals? How can outcome-only reporting obscure the true mechanisms of safety? How can knowledge graph structure improve reasoning and retrieval? What determines when personalization helps versus harms model behavior? What conversation mechanics enable genuine human-AI communicative participation? Does chatbot personalization simultaneously increase both user trust and privacy concerns? How should conversational recommenders decide when to ask versus recommend? Can persona prompting reliably change how language models behave? What reasoning limitations and biases do language models systematically exhibit? Can structural constraints replace embedding depth in collaborative filtering? What distinguishes genuine understanding from correct linguistic performance? How can we distinguish genuine model self-knowledge from behavioral performance? How much do stated privacy concerns predict actual privacy-protective behavior? How can persona-based systems overcome their inherent limitations in modeling diversity? What is the actual bottleneck preventing effective AI research automation? Do language models genuinely understand or primarily match statistical patterns? How much do feedback loops and social biases compound in rating systems? What systematic biases emerge in AI shopping agents' decision-making? How should conversational agents balance proactive goal-pursuit with user autonomy?

Related concepts in this collection 5

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
14 direct connections · 120 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

LLMs can discover and describe persistent user interest journeys from activity patterns but recommender systems predict next items instead