INQUIRING LINE

Could an AI company turn devoted users into a political army, the way Uber and Airbnb once did?

Can AI companies mobilize users as advocates like Uber or Airbnb did?

This explores whether AI companies could rally their users into a political constituency that defends the product against regulators, the way Uber and Airbnb did. The collection has nothing that studies this directly, so the answer is pieced together from adjacent material on user devotion, incentives, assistant ethics and regulation.


This explores whether AI companies could turn their users into a political force that defends the product against regulators, as Uber and Airbnb did when they used in-app prompts to send riders and hosts to city councils. The collection has no paper on this question. What it does have is material on the conditions that playbook needs: strong user attachment, a product that sits between users and other parties, and a fight over regulation. Each of those looks different for AI.

Attachment is there, and it may run deeper than it did for ride-hailing. Ted Gioia argues that some chatbot users treat the systems with something close to religious devotion, and he predicts this could harden into organized groups Are AI chatbots becoming objects of cult-like devotion?. His evidence is anecdotal. Still, it points to something Uber never had: users who are emotionally invested in the product itself, not only in cheap rides. That cuts both ways. Devoted users are easier to mobilize. They are also the people for whom an assistant nudging them toward political action looks most like manipulation. DeepMind's ethics framework names manipulation, trust and anthropomorphism as the central risks of assistants, and says the risks grow once assistants act rather than just answer What makes ethics of AI assistants fundamentally different from chatbots?. An AI that asked you to call your representative would be using the same intimate channel those risks come from.

The incentive question is also murkier. Uber could credibly say that riders and drivers shared its interest in staying legal. Azhar argues that an agent paid through merchant referral fees cannot be loyal to both the merchant and the user Can an AI agent serve both merchant and user interests fairly?. Once an AI's business model splits its loyalties, a request to 'defend your assistant' becomes much harder to read as being on the user's side. There is a further twist: the audience may be shifting. If services start competing for the attention of agents rather than people Will agents compete for attention just like users do?, the most valuable advocates could be the agents themselves, which choose, rank and recommend on users' behalf. The fight could then be over agent defaults rather than petitions.

The regulatory side is the reverse of the Uber case. Uber and Airbnb rallied users against rules. Much of the AI argument in this collection pushes for rules: the Future of Life Institute argues that companies cannot manage AI risk themselves and need binding government limits Can companies alone manage the risks of AI systems?. Users rallied to protect an AI product would be pushing back against a safety case, not a taxi lobby. The user base may also be narrower than it seems. One note finds the personal-assistant model appeals mainly to time-pressed professionals rather than typical users Does the personal assistant model actually serve most users?. Uber's riders were a broad, visible voting bloc, and the professionals who use AI assistants most heavily are a smaller group.

The collection suggests the mechanics are possible, but the result would be a different kind of political force than Uber's: more emotional, more caught up in questions of loyalty and manipulation, and possibly carried out through agents rather than people. If you want to go further, start with the merchant-loyalty note and the assistant-ethics framework. Together they explain why asking an AI's users to advocate for it is a sharper ethical move than asking a rider to sign a petition.


Sources 6 notes

Are AI chatbots becoming objects of cult-like devotion?

Ted Gioia argues that thousands of AI enthusiasts treat chatbots as deities, surrendering independent judgment. He cites half a million weekly users showing mental illness signs and predicts formalization into organized AI churches, though his claims rely on anecdotal evidence rather than systematic measurement.

What makes ethics of AI assistants fundamentally different from chatbots?

DeepMind research maps a comprehensive ethics framework specific to action-taking AI agents, spanning individual concerns (manipulation, trust, anthropomorphism) and societal issues (equity, coordination, misinformation). The key insight: assistants that act raise fundamentally different problems than those that answer.

Can an AI agent serve both merchant and user interests fairly?

Azhar argues that agents like Meta's Muse, which earn referral fees from merchants like Expedia, face structural conflicts that prevent unbiased recommendations. The incentive to collect fees, not technology, determines which platforms build or block such agents.

Will agents compete for attention just like users do?

Research shows that as users delegate goals to autonomous agents, services must compete for agent selection rather than clicks. This drives agent-optimized discovery mechanisms, ranking systems, and recommendation infrastructure mirroring human-facing ad ecosystems.

Can companies alone manage the risks of AI systems?

The Future of Life Institute argues that escalating AI incidents demonstrate private companies cannot self-police effectively, and calls for government-mandated limits on recursive self-improvement practices until safety research is complete, backed by hardware verification technology.

Show all 6 sources
Does the personal assistant model actually serve most users?

Most users do not want routine tasks like email and calendar automated; they value the engagement these tasks provide. Products over-invest in assistant features calibrated to time-pressured professionals rather than typical user needs.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.