Skilled listeners use five different kinds of silence — can an AI learn to pick the right one in the moment?
How do silence and timing affect perceived naturalness in conversational agents?
This explores how an AI's choices about when to pause, when to speak, and when to interrupt shape whether talking with it feels natural, across both text chat and voice.
This explores how an AI's choices about when to pause, when to speak, and when to interrupt shape whether talking with it feels natural. The corpus suggests that silence is not one thing. It is a set of different moves. A study of skilled human active listeners found five distinct pacing strategies: reflective silence, facilitative silence, empathic silence, holding space, and immediate response. Each one fits a different moment in a conversation. An LLM agent could tell which one a moment called for with about 86% accuracy What pacing moves make conversational agents sound like active listeners?. When those strategies were built into a support chatbot, people rated it a better listener and more human-like, and they shared more about themselves than with a bot that paced every reply the same way Can pacing strategies make conversational agents feel more human?. The surprise is that this happened in text chat, where you might expect timing to matter little. A well-placed delay still read as attention.
A second line of work treats staying quiet as something a model has to learn on purpose. DiscussLLM makes 'say nothing' an explicit choice, alongside five types of intervention, so the model learns when to speak as a separate skill from what to say Can models learn when NOT to speak in conversations?. Voice systems take this further. Instead of a pipeline that waits for you to finish and then replies, a single streaming model can take in audio and video continuously and learn turn-taking as part of its behavior, with response times under a second Can a single model learn when to speak and respond?. Both approaches point the same way: natural timing works better when it's learned than when it's bolted on as a rule.
The most useful tension in the corpus comes from two studies with older adults. In one, a voice agent that could interrupt and be interrupted, and that made small 'mm-hm' backchannel sounds, felt more natural, engaging, and fluent than a strict turn-taking agent. Its own topic-changing interruptions even steered talk toward what participants cared about, and nobody resented them Do voice agents that interrupt feel more natural to older adults?. In the other, frequent backchannel lowered older adults' ratings. Age-related slowing in auditory processing made rapid cues hard to separate from the conversation, so they felt like noise rather than engagement Does frequent backchannel from voice agents help or hurt older adults?. Read together, the lesson is not 'more backchannel' or 'less backchannel'. Natural timing depends on the listener. The same cue that signals attention to one person is clutter to another, depending on how fast they process speech.
Why does timing carry so much weight? One answer is that users judge an agent partly on human-likeness and communicative flexibility, not just competence. Those two factors make up about half of how people model a dialogue partner How do users mentally model dialogue agent partners?. A more philosophical answer is that AI output lacks the real-time event structure of a human utterance, so users do the work of turning text into a felt exchange Does AI generate genuine utterances or just text patterns?. On that view, good pacing helps the user do that work. It supplies some of the rhythm that makes a reply feel like a response to you rather than text that simply appears.
The corpus has gaps. It has little on measured latency thresholds, such as how many milliseconds of delay start to feel unnatural, and little on how timing norms differ across cultures. The strongest evidence covers support conversations and older adults, so treat the broader claims as promising rather than settled.
Sources 8 notes
A qualitative analysis of ten active-listening videos identified five distinct pacing strategies (Reflective Silence, Facilitative Silence, Empathic Silence, Holding Space, Immediate Response), each triggered by different conversational contexts and operationalized into eight communicative moves. When implemented in an LLM agent, these strategies achieved 86.2% accuracy in real-time classification.
A 50-person study found that conversational agents using dynamic pacing strategies outperformed static-pacing baselines on perceived listening quality, human-likeness, and user self-disclosure in text-based career and relationship support scenarios.
DiscussLLM trains AI to decide between five intervention types or remaining silent using an 88K synthetic discussion dataset. A decoupled classifier-generator architecture achieves better computational efficiency, while end-to-end training better integrates when-to-speak and what-to-say decisions.
Wan-Streamer represents language, audio, and video as one interleaved causal token stream, allowing response timing and turn management to be learned jointly within a single Transformer rather than engineered as separate modules, achieving sub-second latency.
Older adults rated a barge-in voice agent that interrupts mid-utterance and produces backchannel cues as more natural, engaging, and fluent than a turn-taking baseline. The agent's self-initiated topic-changing interruptions steered conversation toward participants' interests without causing resentment.
Show all 8 sources
A CHI 2025 study found that frequent backchannel cues from an LLM voice agent reduced older adults' experience ratings. Age-related slowing in central auditory processing made rapid backchannel signals harder to distinguish and integrate into conversation, feeling disruptive rather than engaging.
The Partner Modelling Questionnaire reveals that perceived competence dominates user impressions (49% of variance), followed by human-likeness (32%) and communicative flexibility (19%). This three-factor structure reflects how people evaluate dialogue partners against both functional and social standards.
AI output carries communicative markers inherited from training data but lacks the event structure that produces actual utterances. Users supply the missing orientation through interpretive labor, creating a pseudo-event with structure only on the human side.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics
- Proactive Conversational Agents with Inner Thoughts
- Hear You in Silence: Designing for Active Listening in Human Interaction with Conversational Agents Using Context-Aware Pacing
- Toward Enabling Natural Conversation with Older Adults via the Design of LLM-Powered Voice Agents that Support Interruptions and Backchannels
- DiscussLLM: Teaching Large Language Models When to Speak
- Assessing the Applicability of Existing Design Recommendations to AI Companion Design: A Multi-Method Study
- From speaking like a person to being personal: The effects of personalized, regular interactions with conversational agents
- Does My Chatbot Have an Agenda? Understanding Human and AI Agency in Human-Human-like Chatbot Interaction