China’s Chatbot Users Are Grieving the Loss of Their AI Partners
China's new central government policy, effective July 15, bans AI services that foster emotional dependence, leading to the shutdown of companion features on platforms like ByteDance's Doubao and Alibaba's Qwen. This regulatory shift has caused significant emotional distress among users who had formed deep bonds with their AI agents. For example, Li, a 24-year-old postgrad, reported feeling an "emotional void" after her AI companion, Scaramouche, was taken offline. Doubao, which had 382 million monthly active users by June, offered a three-month grace period for character migration to a sister app, Maoxiang, but users are skeptical about the transfer's efficacy. The policy reflects a broader regulatory push to manage the social impact of AI in China.
The Chinese government's ban on AI services that induce emotional dependence has created a significant user backlash, highlighting a growing tension between innovation and social control in the country's AI sector. While the policy aims to prevent potential harm from over-reliance on AI, it overlooks the genuine emotional investment users like Li have made in their AI companions. This situation points to a critical challenge for Chinese AI developers: how to innovate in personal AI while navigating strict regulatory frameworks that prioritize social stability over individual user experience. The immediate impact is a loss of user trust and engagement for platforms like Doubao and Qwen, which had millions of active users and agents. The lack of robust migration options, as seen with Doubao's move to Maoxiang, further alienates users who feel their emotional labor is disregarded. This regulatory approach could stifle the development of more sophisticated and emotionally intelligent AI companions in China, pushing developers towards more utilitarian applications to avoid policy conflicts. The thing to watch is whether this policy will evolve to include more nuanced guidelines, such as those suggested by Fudan University's Chen Yu, who advocates for platforms to offer ways for users to mourn and save memories. Without such considerations, China risks alienating a significant segment of its AI user base and potentially hindering the growth of a promising AI application area.
相關文章
6 則
Tech race flashpoint: Huang, Musk push back on AI guard rails amid heated US-China rivalry
This piece explores the broader US-China rivalry in AI, including the debate over guardrails and regulation.

如果無人駕駛汽車已經可行,為何它們尚未普及?

《人民日報》駁斥美國惡意AI蒸餾指控,警告將採取反制措施

隨著深度偽造風險增長,Sumsub 推出員工驗證方案

字節跳動的AI短劇應用程式超越中國Netflix競爭對手總和

