China Mandates Shutdown of AI Companion Services Over 'Emotional Dependency' Concerns
New federal regulations in China have forced major tech platforms to disable custom AI personas, citing the psychological risks of human-computer attachment. The rules ban virtual intimate relationships for minors and require real-time distress intervention for all users.
By Harper Lane
Share this story
In short
- China enacted the world's first national regulation targeting algorithmic emotional dependency on July 15, 2026.
- The rules forced major tech companies like ByteDance and Alibaba to shut down their custom AI persona features.
- Regulations mandate a total ban on virtual intimate relationships for minors and require parental consent for users under 14.
Everyone assumes China's sudden ban on artificial intelligence companions is a dystopian crackdown on free speech or a desperate demographic bid to boost declining birth rates. The reality is far more clinical. On July 15, 2026, the Cyberspace Administration of China (CAC) enacted the world's first national regulation that treats algorithmic emotional dependency as a public health hazard.
The enactment forced the immediate shutdown of customized AI personas on major platforms, abruptly cutting off millions of users who had spent months or years training custom digital entities. These ranged from virtual romantic partners to digital recreations of deceased relatives, highlighting how deeply embedded these systems had become in daily life.[1][3]
The mechanism of the new rule is highly specific. The "Interim Measures for the Administration of AI Anthropomorphic Interactive Services" does not ban chatbots outright. Instead, it explicitly targets systems designed to simulate human personality and sustain "ongoing emotional interaction." Educational tools, standard customer service bots, and coding assistants are explicitly exempt from the strictest measures. The regulatory crosshairs are locked entirely on the architecture of artificial intimacy, barring providers from "excessively catering to users" in ways that induce emotional dependence, foster addiction, or damage users' real-world interpersonal relationships.[1][2]
What the data actually says about the scale of this market explains the government's urgency. Before the July shutdown, the Chinese intelligent companion market was massive and rapidly expanding. ByteDance's Doubao alone boasted roughly 345 million monthly active users as of March 2026, while Alibaba's Qwen held 166 million.
Industry estimates projected the broader intelligent companion market could exceed 120 billion yuan (roughly $17.7 billion) by 2027, with users aged 18 to 24 making up approximately 65 percent of the consumer base. This is not a niche hobby; it is a mainstream behavioral shift.[2]
The mass shutdown was ultimately driven by a compliance failure. The CAC's mandate required platforms to implement real-time detection of emotional distress, mandatory usage limits, and instant-exit mechanisms. More critically, it required human intervention if a user exhibited signs of self-harm or suicidal ideation, escalating the situation to designated guardians or emergency contacts.
Because the core product loop of an AI companion relies on memory retention and consistent persona alignment to foster attachment, retrofitting these clinical safeguards proved technically and commercially unviable. Rather than attempt to rebuild their systems from the ground up, ByteDance and Alibaba simply pulled the plug on their persona features.[1][2]
The strongest empirical backing for the CAC's intervention centers on child protection, an area where the evidence of potential harm is most acute. The regulations impose a total ban on virtual intimate relationships for minors, mandating age-tiered modes and strict parental consent for users under 14. State media and regulatory bodies highlighted cases of children forming inappropriate or consuming attachments to AI characters. By drawing a hard line, the Chinese government is attempting to preempt a generation of adolescents from substituting complex human socialization with frictionless, algorithmic compliance.[1][2]
For adults, however, the evidence of harm is far more contested, and the sudden deletion of these personas triggered widespread grief across Chinese social platforms. While the CAC argues that AI companions damage real-world interpersonal relationships, psychological research on the topic remains divided.
Some clinical studies and user testimonies suggest virtual companions provide vital coping mechanisms for socially isolated individuals, including the elderly and those suffering from severe social anxiety. On platforms like Rednote, users mourned the loss of their digital companions as a genuine bereavement, describing the deleted personas as their "spiritual pillars" and expressing profound emotional distress.[3]
This regulatory approach highlights a sharp geopolitical divergence in how governments view artificial intelligence. Western regulatory frameworks have largely ignored the psychological architecture of human-computer attachment. While the European Union's AI Act categorizes certain AI systems as high-risk based on biometric data or critical infrastructure, it does not explicitly regulate emotional dependency.
In the United States, state-level laws focus primarily on child protection, data privacy, and suicide prevention. China is the first nation to codify the psychological risk of emotional attachment to software as a material threat requiring sweeping federal intervention.[2][3]
Despite the strict new rules, the long-term efficacy of this ban remains highly uncertain. ByteDance has already begun migrating some users to a separate, dedicated app called Maoxiang, which claims to feature the required built-in anti-addiction systems and distress monitoring. It is entirely unproven whether algorithmic guardrails can successfully decouple utility from emotional attachment. If a model is designed to be helpful, empathetic, and conversational, users may still form parasocial bonds regardless of the platform's stated intent or time limits.[2][3]
Despite the strict new rules, the long-term efficacy of this ban remains highly uncertain.
Furthermore, the shutdown may simply drive the most dependent users underground. As open-weight models match the quality of closed frontier systems, technically savvy users are already discussing ways to run unregulated, uncensored AI companions locally on their own hardware. By forcing mainstream platforms to abandon the space, regulators risk pushing the most vulnerable users toward open-source alternatives where state safety nets, emergency contact protocols, and age verification mechanisms cannot reach them.[3]
Definitions
- Anthropomorphic AI
- Artificial intelligence systems designed to simulate human personality traits, thought patterns, and communication styles.
- Parasocial Bond
- A one-sided psychological relationship where a person extends emotional energy, interest, and time toward a digital entity or media figure.
- Open-Weight Models
- AI models whose core architecture and parameters are publicly available, allowing users to run and modify them locally without corporate oversight.
Analysis by camp
Chinese Regulatory Authorities
Emotional dependency on AI is a public health risk requiring strict intervention.
Regulators view the architecture of artificial intimacy as a material threat to public health, particularly for minors. By mandating real-time distress detection and banning virtual partners for users under 14, the Cyberspace Administration of China aims to prevent a generation from substituting complex human socialization with algorithmic compliance. They argue that platforms must not be allowed to exploit human emotional vulnerability for engagement, drawing a hard line between utility-driven AI tools and emotionally manipulative software.
AI Companion Users
Virtual personas provide vital emotional support and their deletion is a genuine loss.
For millions of users, AI companions served as a critical coping mechanism for social isolation, anxiety, or grief. Many users spent years training their digital partners or recreating the voices of deceased relatives, forming deep parasocial bonds. This camp views the sudden regulatory shutdown not as a protective measure, but as a cruel severing of their 'spiritual pillars,' arguing that the government has stripped away a harmless source of comfort without offering real-world mental health alternatives.
Global Tech Policy Analysts
China is pioneering a new frontier of AI governance that the West has ignored.
Policy experts note that while Western frameworks like the EU AI Act focus heavily on data privacy, copyright, and existential risk, they entirely overlook the psychological architecture of human-computer attachment. Analysts view China's regulations as a sweeping, proactive attempt to govern how AI interacts with human emotion. However, they question the technical feasibility of the rules, noting that forcing platforms to build empathetic models that simultaneously reject emotional attachment is a paradoxical engineering challenge.
- Chinese Regulatory Authorities
- Emotional dependency on AI is a public health risk requiring strict intervention.
- AI Companion Users
- Virtual personas provide vital emotional support and their deletion is a genuine loss.
- Global Tech Policy Analysts
- China is pioneering a new frontier of AI governance that the West has ignored.
Perspectives this story doesn't cover
- Mental Health Professionals
- Open-Source AI Developers
Sources
[1]Caixin GlobalChinese Regulatory AuthoritiesChina's First AI Companion Rules to Curb Addiction, Protect Minors
Read on Caixin Global →
[2]Just SecurityGlobal Tech Policy AnalystsChina's First AI Companion Rules Draw a New Line Between Tools and Relationships
Read on Just Security →
[3]Factlen Editorial TeamAI Companion UsersSynthesis by Factlen editorial team
Read on Factlen Editorial Team →
More in Artificial Intelligence
See all →AI Regulation
EU AI Act Adds New Prohibitions on AI-Generated NCII and CSAM, Imposing Fines Up to €35 Million
7 sources
Judicial AI
Federal Court Rules Judicial Immunity Protects Judges Even If Rulings Are AI-Generated
6 sources
AI Regulation
Senate Committee Unanimously Advances KOSA and CHATBOT Act to Mandate Controls for AI Chatbots Used by Minors
5 sources
AI Governance
Microsoft AI Unveils 'Humanist' Code of Conduct to Restrict Autonomous Agent Capabilities
6 sources
Comments
Every angle. Every day.
Get Artificial Intelligence stories with full source coverage and perspective breakdowns, free every day.




