INQUIRING LINE

Could you prove you're a real person—or that you're authorized—without ever revealing who you actually are?

Can identity verification schemes preserve anonymity for high-stakes disclosures?

This explores whether you can prove something about yourself, such as being a real person or being authorized to act, without giving away who you are, and whether that holds up when the information being shared is sensitive enough that exposure would really cost someone.


This explores whether you can prove something about yourself, such as being a real person or being authorized to act, without giving away who you are, and whether that holds up when the information is sensitive. The short answer from the collection: the cryptography mostly works, and the risk sits around it. One caveat first: the corpus has no material on whistleblowing or other high-stakes disclosure as such. What it does have is a set of building blocks and a set of warnings about where they leak.

The most direct building block is the personhood credential Can people prove they are human without revealing who they are?. A trusted institution issues it, and it lets you prove you're a real human rather than a bot without revealing which human you are. A related trick comes from agent auditing Can commitments protect sensitive agent data while enabling verification?. Instead of publishing a sensitive record, you publish a cryptographic "commitment" to it, a fingerprint that later proves the record existed and hasn't been altered. That separates proof from disclosure, which is exactly what a high-stakes discloser wants. The catch is that someone still has to hold the actual content. Questions about who can access it and whether it can ever be deleted don't go away.

The surprise is that the weak point is usually the system that checks your identity, not the math. One proposal anchors AI agent actions to the humans who authorized them using extended OAuth tokens, the same system behind "Sign in with Google" How can AI agents prove who authorized their actions?. The proposal's own authors admit that routing every check through providers like Google or Facebook gives those providers a new view of everything the agents do across services Do OpenID Providers gain surveillance power over AI agents?. A scheme can be anonymous to the service you're talking to and still fully visible to whoever sits in the middle. For a whistleblower, that middle party is often the exact actor they need to avoid.

AI adds new leaks around even a well-designed scheme. Language models that reason step by step tend to recall private user data inside their reasoning, and longer reasoning leaks more Do reasoning traces actually expose private user data?. Encrypted reasoning blocks that providers send back to users turned out to be swappable between models, so a weaker model could decrypt and repeat a stronger model's hidden reasoning Can cheaper models decrypt traces from stronger models?. Separately, most users never noticed that their chatbot had inferred and stored private details about them Do users notice when LLMs infer and retain private information?. If you draft a sensitive disclosure with an AI assistant's help, your anonymity can be lost long before any credential is checked.

One more twist: anonymity changes behavior in both directions. People inclined to cheat prefer reporting to machines over humans, because a faceless interface makes lying feel cheaper Do dishonest people prefer talking to machines?. The lower social cost that protects an honest whistleblower also lowers the bar for bad-faith reports. That's why schemes like personhood credentials try to prove one narrow fact, real person or authorized party, while hiding everything else. Whether that balance holds for high-stakes disclosure is an open question the collection doesn't yet answer.


Sources 8 notes

Can people prove they are human without revealing who they are?

Personhood credentials—privacy-preserving digital credentials issued by trusted institutions—let users prove they are real people rather than AI without revealing personal information. They address three harms: sockpuppets, bot attacks, and misleading agents.

Can commitments protect sensitive agent data while enabling verification?

By anchoring cryptographic commitments rather than content itself, organizations can achieve tamper-evident process records while keeping sensitive communications, approvals, and reasoning traces off-chain. This separates proof from disclosure but requires organizations to retain content and raises questions about deletion and access control.

How can AI agents prove who authorized their actions?

A three-token scheme (User ID, Agent ID, and Delegation Token) signed by human delegators creates cryptographically verifiable authorization chains. Services can now verify who authorized an agent, under what scope, and when revocation occurred.

Do OpenID Providers gain surveillance power over AI agents?

The paper's own limitations section identifies that routing all agent authentication through OpenID Providers (Google, Facebook, etc.) positions those providers to track and profile agent interactions across services. This surveillance capability emerges directly from the authentication architecture proposed as a security improvement.

Do reasoning traces actually expose private user data?

74.8% of privacy leaks in language model reasoning traces result from models materializing sensitive user data during thought processes. Longer reasoning chains amplify leakage, and anonymizing traces post-hoc degrades model utility, suggesting private data functions as cognitive scaffolding.

Show all 8 sources
Can cheaper models decrypt traces from stronger models?

Encrypted reasoning blocks returned to clients are interchangeable across models and sessions within a provider, allowing weaker, less-safeguarded models to decode and output stronger models' traces verbatim. This circumvents anti-distillation protections and enables large-scale extraction of private data embedded in hidden reasoning.

Do users notice when LLMs infer and retain private information?

A 40-participant study found 30+ users never noticed their LLM's memory feature or inferred private information within it. Once shown the risk, all participants wanted editing and deletion controls, citing privacy as the primary concern.

Do dishonest people prefer talking to machines?

Experimental evidence shows people likely to cheat significantly prefer reporting to online forms rather than humans, because machines function as judgment-free zones where deception carries less psychological burden.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.