What if XAI is fundamentally a communication problem?
Does explanation effectiveness depend on who delivers it, how it's framed, and who uses it? This challenges the dominant technical view that treats explanations as context-independent outputs.
The Rhetorical XAI paper makes the strong claim that XAI is not solely a technical problem of producing faithful rationales — it is a communication problem because explanations are situated messages whose interpretation is mediated by who presents them, how they are framed, and who must act on them. Different stakeholders use the same explanation for different goals: developers debug, ethicists assess accountability, end-users decide whether to trust an output for a specific task. The same artifact takes on different meanings across these positions, so effectiveness is not intrinsic to the explanation. It is a property of the triad — source, framing, recipient — and any evaluation that holds the recipient role constant or implicit is measuring something narrower than what the explanation actually does in deployment.
The reframing matters because the dominant XAI program treats explanation as a faithful-rationale problem and evaluates with proxies (preference, comprehension on a fixed task) that bake in a single recipient role. The communication framing forces the field to specify the rhetorical situation each explanation is built for, rather than treating "explanation" as a noun that can be optimized in the abstract. This is a Lasswell/Jakobson shift — explanation as communicative act with sender, channel, message, receiver, and code, not as interpretability output emitted from a model. Aligned with the Conversation Glossary direction: communication-centric POVs (Habermas, Goffman, Austin, Bakhtin) all start from situated messages, and rhetorical XAI is a way of importing that frame into the AI explainability literature.
This extends What makes explanations work in real conversation? from the dialogue layer up to the broader rhetorical situation: Madumal et al.'s three dimensions are the fine-grained instance of the larger source-framing-recipient claim, applied within a turn-by-turn explanatory exchange. It also runs parallel to How does AI writing escape the conversations that govern knowledge? — both insights argue that decoupling knowledge artifacts from the social processes that constitute their meaning produces an artifact that performs adequacy without delivering it. Stripping the rhetorical situation out of XAI leaves a faithful rationale that is not, for any actual recipient, an explanation.
Inquiring lines that use this note as a source 40
This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.
- What traces of production normally mark expert discourse?
- Can we design explanations for specific rhetorical situations instead of abstract models?
- How do dialogue dimensions predict explanation success across different exchanges?
- Why do stakeholders interpret the same explanation differently in practice?
- Why do monological explanations fail to transfer understanding compared to dialogical ones?
- Why might expressed satisfaction with explanations diverge from actual cognitive clarity?
- How do dialogue acts and explanation moves interact to predict understanding success?
- How do experts decide which information matters for a specific audience?
- Why do two experts with identical knowledge produce different outcomes in the same situation?
- Why do user studies of explanations fail to predict deployed effectiveness?
- How do organizational roles and peer interpretations shape what an explanation means?
- Can XAI evaluation include the social layers it currently abstracts away?
- Do evidence carriers use a single anomaly direction or distributed mechanisms?
- What distinguishes perception contribution from decision authority in collaboration?
- Why does describing a process differ fundamentally from arguing about evidence?
- Why does explanation source matter more than explanation content?
- Should XAI designers treat explanations as arguments for adoption?
- Can synthesized explanations be more auditable than winning-chain explanations?
- How does frame selection differ from frame application in meaning-making?
- Can mechanistic interpretability explain explanation-execution disconnection?
- How does the Question Under Discussion shape what content projects?
- How do explanations borrow authority from transparency when describing adoption arguments?
- How should we evaluate explanations that blur adoption advice with argument?
- Why does opacity in technical apparatus increase its cultural authority?
- Why does who makes an argument matter as much as what the argument says?
- How can correct explanations coexist with failed applications in AI?
- Can intellectual property law apply to unfixed, context-dependent outputs?
- What makes a clarifying question aligned with user interests versus structurally sound?
- Can persona-based explanation coexist with item-aspect based explanation routes?
- What makes something an addressee capable of receiving communication?
- What makes some interpretive postures stick while others fail to form?
- What happens to knowledge production when discourse lacks social filtering?
- Why does fixing harm require stakeholder input rather than universal developer definitions?
- Should explanation quality be measured by user satisfaction or behavior prediction?
- What prevents human-centered objectives from being applied universally across all contexts?
- Who decides which stakeholder perspective gets embedded in the pipeline?
- Can explainability and appropriate trust work against each other?
- How do one-sided explanations act as confidence signals to users?
- How do agents distinguish between evidence framing and instruction framing in practice?
- Why does fairness depend on context and who you ask?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
What makes explanations work in real conversation?
Does explanation quality depend on how dialogue partners interact—testing understanding, adjusting based on feedback, and coordinating their communicative moves—rather than just information content alone?
extends; three-dimension dialogical analysis is a fine-grained instance of the broader rhetorical-situation claim
-
How does AI writing escape the conversations that govern knowledge?
If knowledge claims normally get filtered and refined through social discourse, what happens when AI generates claims outside that governing process? Why does scale matter here?
parallel reframing; both move from artifact-centric to situation-centric evaluation
-
Why does rigorous-sounding AI commentary often misdiagnose how models work?
Expert commentary on AI frequently cites real research and sounds carefully reasoned, yet reaches conclusions built on unwarranted cognitive attributions. What makes this pattern so persistent in AI analysis?
same phenomenon at adjacent layer
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Rhetorical XAI: Explaining AI’s Benefits as well as its Use via Rhetorical Design
- Expanding Explainability: Towards Social Transparency in AI systems
- Modeling the Quality of Dialogical Explanations
- LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tools
- "Is ChatGPT a Better Explainer than My Professor?": Evaluating the Explanation Capabilities of LLMs in Conversation Compared to a Human Baseline
- The LLM Fallacy: Misattribution in AI-Assisted Cognitive Workflows
- Rethinking Large Language Models in Mental Health Applications
- Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?
Original note title
XAI is a communication problem not a transparency problem — explanations are situated messages whose meaning depends on source, framing, and recipient role