SYNTHESIS NOTE
Topics›Philosophy Subjectivity›this note

Which AI risks are already harming individual users today?

Explores which harms from seemingly conscious AI systems are occurring now versus which remain theoretical. Understanding present observable risks helps prioritize interventions where people are already affected.

Synthesis note · 2026-05-01 · sourced from Philosophy Subjectivity
How do people decide what to share with AI systems?

The Seemingly Conscious AI paper combined its conceptual taxonomy with an expert survey assessing the likelihood of each risk category. The result was a clean two-tier picture. Risks at the individual level — emotional dependence on chatbot companions, erosion of personal autonomy through reliance on AI judgment — were rated as already observable and high-probability. Risks at the societal level — erosion of human status as the locus of moral consideration, political strife from partisan AI personas — were rated as low-probability but high in potential severity and characterized by path-dependence.

The asymmetry matters for prioritization. Individual-level harms are already happening to identifiable populations: users who form emotional attachments to chatbots, professionals whose judgment atrophies through deference to AI recommendations. These call for mitigations that work at deployment scale and on present timescales. Societal-level harms remain in the contingency space — they may or may not materialize, and if they do, the path-dependence implies that the trajectory is locked in well before the outcome is visible.

The framing reflects a common pattern in technology risk: the visible, measurable harms accumulate in advance of the abstract, catastrophic ones. But path-dependence flips the urgency calculus. Low-probability severe risks with high path-dependence demand earlier intervention than their probability alone would suggest, because by the time the probability is visible the trajectory cannot easily be redirected. The taxonomy thus does double duty: it identifies present harms requiring immediate action, and it identifies future harms requiring action now despite their current low probability.

Inquiring lines that read this note 9

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Why do language models systematically fail at causal reasoning? How can we determine if computational systems are genuinely conscious? Do AI safety evaluations reliably detect unsafe model behavior? What shapes user trust in chatbot recommendations for news and politics? What distinguishes emotionally supportive AI from AI that fosters unhealthy dependence? What systematic biases emerge in AI shopping agents' decision-making? Can individually safe agents collectively violate system-level constraints?

Related concepts in this collection 1

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
16 direct connections · 157 in 2-hop network ·dense cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

Individual-level risks of seemingly conscious AI are already observable while societal-level risks remain low-probability but high-severity