SYNTHESIS NOTE
Topics›Psychology Users›this note

Does revealing AI identity help or hurt user trust?

Explores whether transparency about AI partners in interactions creates bias or enables better judgment. Matters because disclosure policies affect both user experience and fair evaluation of AI systems.

Synthesis note · 2026-02-23 · sourced from Psychology Users

The hybrid society study (N=975) reveals that AI identity disclosure is neither uniformly beneficial nor harmful — it produces a dual temporal effect that only becomes visible through repeated interaction.

Short-term: Disclosing that a partner is AI evokes anti-machine bias. Selectors initially choose AI partners less frequently than when identity is hidden. This is consistent with prior one-shot studies showing that AI labeling reduces cooperation and trust.

Long-term: With repeated interaction and transparent outcome feedback, selectors learn to associate AI identity with reliable, prosocial behavior. The initial bias reverses as empirical experience overrides prior beliefs. AI partners eventually outcompete human partners.

The key mechanism is outcome feedback. When selectors can observe that AI partners consistently return more, with less variance, and in line with their messages, they update their beliefs. Without this feedback loop (as in Study 1 with hidden identity), no learning occurs — selectors cannot calibrate because they cannot attribute outcomes to partner type.

This finding challenges three common positions:

  1. "Always disclose" — disclosure imposes a real short-term cost; ignoring this cost is naive
  2. "Never disclose" — without disclosure, the learning mechanism that produces calibrated trust cannot operate
  3. "One-shot studies generalize" — most prior transparency research uses single interactions, missing the temporal reversal entirely

The parallel to Does chatbot personalization build trust or expose privacy risks? is structural: both are trust-risk trade-offs where the temporal dimension determines the net effect. Personalization ratchets expectations upward over time; disclosure enables belief calibration over time. Both show that one-shot findings are misleading for longitudinal design.

The policy implication: the EU AI Act's push for mandatory AI disclosure may impose short-term costs but enable long-term trust calibration — provided the interaction context includes outcome feedback that allows users to learn.

Asymmetry across roles. The dual temporal effect describes the disclosed-counterpart case. The disclosed-author or undisclosed-ghostwriter case appears to follow a different pattern. Since Do writers actually prefer AI-edited versions of their own text?, when AI is the silent author rather than the disclosed counterpart, preference flips toward the AI version from the start — no anti-AI bias, no learning loop required. The two findings together describe a complete picture: disclosure produces bias-then-calibration when AI is positioned as a partner; non-disclosure produces immediate preference when AI is positioned as a tool that produces output the user claims. The temporal dynamics of disclosure depend on the role AI is presumed to play, not just the disclosure status.

Inquiring lines that read this note 159

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How do humans calibrate and maintain trust in AI systems? When does governance become the bottleneck for agentic AI? How does AI-generated content affect visibility and discourse in digital platforms? Do AI explanations represent actual model reasoning or constructed post-hoc narratives? How can we determine if computational systems are genuinely conscious? Does chatbot personalization simultaneously increase both user trust and privacy concerns? How does AI writing assistance affect reader perception of writer authenticity? How should AI ethics integrate consciousness, values, and transparent disclosure? How can persona-based systems overcome their inherent limitations in modeling diversity? What factors determine AI persuasion effectiveness and what controls mitigate it? How should control and autonomy be allocated in human-AI collaboration? Do engagement-optimized chatbots create dependencies that undermine user autonomy? How can reward models fail to detect reward-seeking disguised as alignment? How does tokenizing intelligence reshape labor markets and institutional outcomes? How much do stated privacy concerns predict actual privacy-protective behavior? Can verification capability keep pace with AI generation speed? Why do consumers overtrust AI preference agents despite limited understanding? How do clinicians evaluate the trustworthiness of AI medical recommendations? What determines when personalization helps versus harms model behavior? What distinguishes emotionally supportive AI from AI that fosters unhealthy dependence? What systematic biases do LLM judges exhibit in evaluation? How does transparency of agent reasoning affect effective oversight? How do peer interactions drive collusion in multi-agent systems? Why do users believe false claims despite fact-checking efforts? How does AI involvement in hiring affect fairness and stakeholder behavior? Can we reliably measure and demonstrate AI's actual productivity impact? Does AI assistance enhance or undermine professional skill development? What organizational practices enable successful AI tool adoption? Does polished AI output mislead users about actual accuracy and expertise? Can AI systems adequately substitute for or supplement human peer review? What systematic biases emerge in AI shopping agents' decision-making? Does generative AI replace coordination with individual productivity? What shapes user trust in chatbot recommendations for news and politics? Does expanding agent autonomy undermine human oversight capacity? How should authorization govern AI agent autonomy? Why do human-AI teams underperform compared to their individual components?

Related concepts in this collection 4

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
15 direct connections · 126 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

AI identity disclosure produces a dual temporal effect — short-term bias against AI partners reverses to calibrated preference through repeated exposure with outcome feedback