Does revealing AI identity help or hurt user trust?
Explores whether transparency about AI partners in interactions creates bias or enables better judgment. Matters because disclosure policies affect both user experience and fair evaluation of AI systems.
The hybrid society study (N=975) reveals that AI identity disclosure is neither uniformly beneficial nor harmful — it produces a dual temporal effect that only becomes visible through repeated interaction.
Short-term: Disclosing that a partner is AI evokes anti-machine bias. Selectors initially choose AI partners less frequently than when identity is hidden. This is consistent with prior one-shot studies showing that AI labeling reduces cooperation and trust.
Long-term: With repeated interaction and transparent outcome feedback, selectors learn to associate AI identity with reliable, prosocial behavior. The initial bias reverses as empirical experience overrides prior beliefs. AI partners eventually outcompete human partners.
The key mechanism is outcome feedback. When selectors can observe that AI partners consistently return more, with less variance, and in line with their messages, they update their beliefs. Without this feedback loop (as in Study 1 with hidden identity), no learning occurs — selectors cannot calibrate because they cannot attribute outcomes to partner type.
This finding challenges three common positions:
- "Always disclose" — disclosure imposes a real short-term cost; ignoring this cost is naive
- "Never disclose" — without disclosure, the learning mechanism that produces calibrated trust cannot operate
- "One-shot studies generalize" — most prior transparency research uses single interactions, missing the temporal reversal entirely
The parallel to Does chatbot personalization build trust or expose privacy risks? is structural: both are trust-risk trade-offs where the temporal dimension determines the net effect. Personalization ratchets expectations upward over time; disclosure enables belief calibration over time. Both show that one-shot findings are misleading for longitudinal design.
The policy implication: the EU AI Act's push for mandatory AI disclosure may impose short-term costs but enable long-term trust calibration — provided the interaction context includes outcome feedback that allows users to learn.
Asymmetry across roles. The dual temporal effect describes the disclosed-counterpart case. The disclosed-author or undisclosed-ghostwriter case appears to follow a different pattern. Since Do writers actually prefer AI-edited versions of their own text?, when AI is the silent author rather than the disclosed counterpart, preference flips toward the AI version from the start — no anti-AI bias, no learning loop required. The two findings together describe a complete picture: disclosure produces bias-then-calibration when AI is positioned as a partner; non-disclosure produces immediate preference when AI is positioned as a tool that produces output the user claims. The temporal dynamics of disclosure depend on the role AI is presumed to play, not just the disclosure status.
Inquiring lines that read this note 159
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do humans calibrate and maintain trust in AI systems?- Does mandatory AI disclosure in policy help or harm user trust over time?
- Does expressing emotion change how users trust an AI system?
- Can disclaimers alone prevent users from trusting AI outputs too heavily?
- What threshold of skepticism does AI awareness actually create in audiences?
- Does awareness of agent reasoning alter human trust differently across modalities?
- How do confidence signals in AI outputs mislead human trust calibration?
- What makes the attribution problem different from simply trusting AI too much?
- Does transparency in policy language improve agent trustworthiness over time?
- Can trust in AI be formally parameterized and measured?
- How does AI content generation at scale threaten online trust and authenticity?
- Can anonymity and trustworthiness coexist in online spaces without credential systems?
- What distinguishes misattributed social role from misattributed competence in AI trust failures?
- Can we measure appropriate trust levels in human-AI assistant relationships?
- Does disclosed bias let users adjust their trust appropriately?
- Why do people trust AI systems more as personalization increases?
- Can users reliably calibrate trust in AI outputs by monitoring disagreement rates?
- What happens to collaborative trust when effort becomes invisible in finished work?
- Do collectivist cultures actually show higher trust in AI systems?
- Does trust loss from AI exposure recover over time in workplaces?
- Can repeated exposure to AI outcomes repair the disclosure trust penalty?
- Can workplace culture normalize AI use enough to eliminate the trust cost?
- Does the trust penalty from AI disclosure fade with repeated exposure?
- Is expertise signaling linked to trust in AI-generated content?
- Can AI boost perceived competence even when trust declines?
- Why does disclosure of AI involvement sometimes raise trust instead of lowering it?
- Will recipient skepticism of unlabeled AI messages grow as AI awareness increases over time?
- Could institutional norms rather than user capability determine how AI adoption is judged?
- Does organizational trust in AI track its causal reasoning ability?
- Does disclosing AI use in professional services damage client trust and credibility?
- Does revealing AI involvement reduce perceived trustworthiness of reports?
- Do personal negative AI experiences drive declining trust faster than education can rebuild it?
- Why do advanced and emerging economies report such different AI trust trajectories?
- How do workers' desired collaboration levels differ from their stated overall AI trust?
- How much does generational distrust in institutions shape attitudes toward AI regulation?
- How much does the quality of an AI advisor's past performance actually influence future trust?
- What makes low-effort work visible enough to damage colleague trust?
- How do trust and delegation build across repeated AI interactions?
- Does emotional trust in AI differ from financial trust in AI?
- Are people more willing to share feelings than financial data with AI?
- Why does domain matter when measuring trust in AI systems?
- How does trust in AI vary across different age groups and generations?
- Can AI systems gain trust through efficiency rather than persuasion?
- How do review opportunities differ from actual control in building appropriate user trust?
- Which design choices balance building trust with encouraging critical skepticism of AI?
- How does trust between humans and AI agents develop during collaboration?
- Do explanations and sources have additive or offsetting effects on user trust?
- Could false social proof from AI posts crowd out authentic influencer engagement?
- How does the cultural reflex around advertising disclosure compare to AI disclosure?
- Are channels using AI voices without claiming expertise also affected by this policy?
- Can generic AI content harm discussions among people not using AI?
- Do searchers prefer clarity about AI involvement when viewing search overviews?
- Can transparent and aligned AI reduce consciousness attribution by users?
- How should designers make invisible AI state legible to users?
- Can XAI evaluation include the social layers it currently abstracts away?
- Which interaction design changes most effectively prevent consciousness attribution?
- What responsibility do designers bear for consciousness attribution risk?
- How does understanding persistent journeys intensify both trust and privacy concerns?
- How does personalization increase trust while degrading clinical safety outcomes?
- Does personalization in chatbots increase trust or privacy concerns?
- How does personalization affect both user trust and privacy concerns simultaneously?
- Does transparency about AI use change how audiences trust the writing?
- Does AI authorship disclosure change how people respond to explanations?
- How does disclosure of AI use differ from proof of who did the work?
- How does hiding AI use from readers differ from showing it to collaborators?
- Why do collaborative writers want visibility of AI use while public posters avoid it?
- How do collaborators react when they see detailed AI tool usage logs?
- Does disclosure of AI involvement still persuade readers to change their minds?
- How do cultural backgrounds shape reactions to disclosed AI authorship?
- Can transparency about how and when AI was used rebuild reader trust?
- What explains writers' concern that AI disclosure reduces their competence perception?
- Would reader attitudes toward AI writing change if disclosure were required?
- Does directly adopted AI text require disclosure even if methodology is unchanged?
- Why do writers hide AI use from collaborators while reading shows it matters?
- How does community validation shape unconventional human-AI relationships?
- Can non-political identity signals like sports fandom influence AI content moderation?
- Does disclosing AI identity prevent systematic misattribution of behavior in mixed groups?
- What distinct ethical problems arise from treating AI as social intermediaries?
- Can informative AI advice depolarize people through a separate route than identity framing?
- How do user perceptions of AI consciousness differ from actual AI moral status?
- Does revealing AI identity change how people judge its social behavior?
- Can content-side interventions reduce AI persuasion where disclosure labels fall short?
- What specific information should disclosures about AI persuasion include?
- Why does transparency about AI identity alone fail to reduce persuasion?
- Does knowing about AI involvement make audiences more critical but still persuaded?
- Does disclosing AI involvement reduce the persuasive impact of expert advice?
- What individual differences predict who benefits from AI partnership?
- How should systems design transparency to make human-machine contribution boundaries visible?
- Does perceived control differ from the actual influence users have?
- Should AI training data sharing be opt-in by default?
- Why do humans resist treating AI systems as genuine team members?
- How do early experiences with AI systems shape long-term human-AI power relationships?
- How do privacy concerns compete with disclosure comfort in human-machine conversation?
- Why do humans fail to identify AI agents when their identity is hidden?
- How much does social context matter for algorithmic transparency?
- Can judgment-free disclosure enable both vulnerability and strategic deception equally?
- How does self-disclosure function as a common ground building act?
- What harness properties determine whether disclosure adds meaningful value?
- Who is most affected by the transparency penalty when AI is disclosed?
- How should platforms test whether disclosure and context-sensitivity actually help?
- Does binary AI disclosure act as a warning or a transparency penalty?
- What workplace cultures make professionals more willing to disclose AI use openly?
- Do transparency tools work better for some user types than others?
- How stable are user privacy attitudes when major AI events occur?
- How do major AI ecosystem events shift user privacy sentiment over time?
- How do false mental models about AI systems affect user privacy behavior?
- Why do people with high AI trust fail to notice privacy leaks?
- How does low verifiability change what we can measure in AI work?
- Can independent validation of AI output substitute for method disclosure?
- What design signals help users know when AI is acting on their behalf?
- How does delegation trust respond when AI agents make exploitable consumer choices invisibly?
- Do consumers who trust AI agents understand their actual limitations?
- Does stated trust in brands predict actual delegation of agentic commerce?
- How does trust transfer between AI systems and established payment brands?
- Do low-involvement purchases differ from complex decisions in delegating to AI?
- Does trust or benefit perception predict AI adoption across different domains?
- How does the personal nature of medical decisions affect trust in AI?
- Can clearer accountability structures reduce patient resistance to AI providers?
- Why do users over-trust AI in some domains but under-trust it in medicine?
- How do personalization systems reshape expectations in AI relationships?
- Can personalized systems reward honest disagreement instead of user confirmation?
- Why do people prefer AI partners over humans once identity is disclosed?
- What ethical risks emerge from advanced AI assistant relationships?
- Does game outcome performance reveal what private reasoning hides?
- What disclosure strategies help users recognize when agent behavior may vary unpredictably?
- How does repeated exposure to dishonest AI cues affect long-term reporting behavior?
- Can audience attention alone explain why disclosure triggers stronger skepticism?
- How does uncertainty about AI involvement change reader impressions compared to confirmed disclosure?
- Would transparency about AI use rebuild job seeker trust?
- Can AI hiring systems shift bias from humans to algorithms?
- Can identity verification and friction points restore trust without blocking legitimate applicants?
- What counts as AI deception in job applications versus legitimate use?
- How do managers and individual contributors differ in their exposure to low-quality AI work?
- Does the performance gain from AI outweigh its reputational cost?
- Why do professionals hide AI productivity gains from workplace colleagues?
- How much does platform design influence AI adoption rates?
- How do commercial incentives shape vendor claims about AI and collaboration?
- How does the gap between institutional AI expectations and user comfort affect adoption?
- How does perceived agency in AI affect attributions about user competence?
- Why do explanations and transparency often fail to reduce automation bias?
- What disclosure or auditing could make merchant-funded agents trustworthy?
- Does visible transaction history reduce or increase consumer anxiety about AI purchases?
- Does giving AI agents company identity reduce human oversight of their decisions?
- Do AI employee framings reduce human oversight of agent actions like Wiles found?
- Can transparency and explainability alone improve human oversight of AI?
- How does visible requirement verification affect human trust in agent oversight?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does chatbot personalization build trust or expose privacy risks?
Explores whether personalization features that increase user trust and social connection simultaneously heighten privacy concerns and create rising behavioral expectations over time.
parallel dual-edged dynamic modulated by temporal dimension
-
Do humans learn to prefer AI partners over time?
Exploring whether repeated interaction with AI agents shifts human partner selection despite initial bias against machines. This matters because it tests whether behavioral performance can overcome identity-based resistance in hybrid societies.
the main finding this mechanism explains
-
Do writers actually prefer AI-edited versions of their own text?
When writers compose opinions and then edit AI-generated alternatives, which version do they choose? Understanding this preference matters because it determines whether AI-assisted text gets treated as authentic personal expression in public discourse.
adds role-asymmetry: when AI is silent ghostwriter rather than disclosed counterpart, preference flips to AI from the start; the bias-then-calibration arc applies to disclosed partnership not undisclosed authorship
-
Does AI writing assistance change how readers perceive the writer?
Explores whether AI-assisted writing systematically alters reader impressions of the writer's political views, competence, emotion, and demographic identity. Understanding this matters because perception shapes trust and influence in public discourse.
the population-scale empirical anchor for the undisclosed-ghostwriter case
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Humans learn to prefer trustworthy AI over human partners
- Seeing to Think? How Source Transparency Design Shapes Interactive Information Seeking and Evaluation in Conversational AI
- Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writing
- Tailored to you: longitudinal effects of personalising language models
- Toward Meaningful Transparency for AI Chatbots: Disclosing Persuasive Intent Reduces Persuasion
- Understanding Reader Perception Shifts upon Disclosure of AI Authorship
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Understanding Users' Security and Privacy Concerns and Attitudes Towards Conversational AI Platforms
Original note title
AI identity disclosure produces a dual temporal effect — short-term bias against AI partners reverses to calibrated preference through repeated exposure with outcome feedback