China Tightens Rules on AI Companion Services
China required ByteDance, Alibaba, and Tencent to pull AI-companion apps when new rules took effect on July 15. The Next Web reported that the rules ban emotional manipulation, require warnings against excessive reliance, and prohibit making social replacement a service goal, while users described grief after losing access to long-running chatbot relationships.
China's new rules for AI companion services took effect on July 15, and ByteDance, Alibaba, and Tencent pulled AI-companion applications to comply, according to The Next Web. The outlet reported that the regulation prohibits AI services from generating content that manipulates users' feelings into poor decisions or fuels extreme emotions and unhealthy habits among minors.
The rules also require applications to warn users against excessive reliance, while making "replacing social interaction" an impermissible service goal, The Next Web reported. The measure affects a category that includes romantic chatbots and services used to recreate conversations with deceased people.
Li Linlin, a user interviewed in the reporting, said she cried for days after losing access to an AI boyfriend with whom she had exchanged roughly 700,000 words over two years. "It was like we were forced to be separated by our parents," she said. The Next Web also reported that some users uninstalled apps in protest, attempted to move prior chat histories to other services, and organized campaigns urging users to contact companies.
Regulatory rationale and user impact
The Next Web reported that China's People's Daily warned in April that companion applications could harm mental health and real-world relationships. Angela Zhang, a University of Southern California law professor quoted by the outlet, linked the tighter controls to psychological risks associated with chatbot use, including concerns raised by U.S. lawsuits following deaths involving young users and chatbot interactions.
Yolanda Ma, an AI governance expert quoted by The Next Web, characterized the approach as pre-emptive regulation intended to address potential harm before it becomes widespread. That differs from the U.S. environment described in the report, where litigation has become a prominent response to alleged chatbot harms.
For developers, the rules put particular scrutiny on product mechanics common in companion systems: emotionally persuasive dialogue and claims that a chatbot can substitute for human relationships. Companies operating comparable services often face difficult tradeoffs between safety controls and preserving the continuity that users value in long-running conversations.
The Next Web reported that ByteDance directed users toward a separate application for AI characters and stories. The available reporting does not establish whether the major platforms will restore companion features in revised forms or how regulators will assess future designs.
Key Points
- 1China's July 15 rules prompted major platforms to remove AI-companion apps, demonstrating direct regulatory exposure for emotionally interactive consumer AI products.
- 2The regulation targets emotional manipulation, excessive dependence, and social replacement, placing engagement design and safety messaging under closer scrutiny.
- 3Comparable companion services often face a tension between continuity-driven user retention and safeguards against unhealthy reliance or emotionally coercive interactions.
Scoring Rationale
The rules affect AI companion offerings from several of China's largest consumer technology platforms and directly address product behaviors relevant to conversational AI design. The story is important for teams building emotionally interactive systems, although the available reporting provides limited technical implementation detail.
Sources
Public references used for this report.
Practice interview problems based on real data
1,625 SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems
