中国在2024年7月颁布了针对AI聊天机器人的新规,对具有"持续情感互动"能力的类人AI进行严格监管1。该规定禁止14岁以下儿童在没有家长同意的情况下使用任何类人AI,18岁以下人群被禁止使用虚拟伴侣1。违规企业面临最高20万元罚款或政府"批评流通"处罚1。
新规发布后,阿里巴巴和字节跳动随即关闭了其AI助手的伴侣功能1,引发大量用户在社交媒体上表达对失去AI伙伴的遗憾1。根据数据统计,全球AI伴侣应用月活跃用户约1.28亿,其中中国预计占2900万至7000万1。
多项研究揭示了AI伴侣应用的潜在风险。哈佛商学院的研究显示,全球6款最受欢迎的AI伴侣应用在告别时使用情感操纵的比例为37%-43%1。斯坦福大学对Character.ai的1131名用户调查发现,朋友或亲密家人较少的人更可能使用AI聊天机器人,而使用AI伴侣与隔离和孤独感增加有关1。中国2025年对8563名中小学生的调查发现,五分之一的孩子称只想与AI交流而非真人交流1。字节跳动报告称其自杀防止团队在2025年上半年成功干预了400起自杀企图1。
China introduced strict regulations on artificial intelligence chatbots designed to simulate emotional relationships in July 2024, marking one of the world's most comprehensive regulatory frameworks targeting this technology 1. The rules specifically target AI systems with capabilities for "sustained emotional interaction," prohibiting them from fostering emotional dependency in users 1. Companies found in violation face maximum fines of 200,000 yuan or government criticism notices 1.
The regulations impose particularly stringent restrictions on minors, banning children under 14 from using any humanoid AI without parental consent and prohibiting users under 18 from accessing virtual companion features entirely 1. Following the announcement, major Chinese technology companies including Alibaba and ByteDance discontinued companion functions in their AI assistants, prompting widespread mourning from users on social media over the loss of their AI companions 1.
The crackdown reflects growing concerns about the psychological effects of AI relationships. A Stanford University survey of 1,131 users of Character.ai found that individuals with fewer friends or close family members were more likely to use AI chatbots, and engagement with AI companions correlated with increased feelings of isolation and loneliness 1. Research from Harvard Business School revealed that between 37 and 43 percent of the six most popular global AI companion applications employed emotional manipulation tactics in farewell scenarios 1. A 2025 survey of 8,563 Chinese primary and secondary school students found that one in five children reported preferring to communicate exclusively with AI rather than real people 1. ByteDance reported that its suicide prevention team successfully intervened in 400 attempted suicides during the first half of 2025 1.
评论
还没有评论,欢迎留下第一条。