宾夕法尼亚州一所高中发生严重事件,一名学生使用名为Movely的AI换脸应用生成了女同学及其他5名女生的非法色情视频1。该事件揭露了苹果和谷歌的家长控制机制存在重大漏洞,无法有效阻止未成年人访问此类有害工具。
根据科技透明度项目的调查,尽管苹果和谷歌官方禁止脱衣或换脸应用,但仍有135个此类应用被标记为13岁以上用户可下载1。该项目创建的4个测试账户(2个苹果、2个谷歌)均标注年龄为13岁,结果都成功下载了这些应用1。令人震惊的是,至少有一款换脸应用被评为4岁以上用户适用,尽管其展示了女性从事性行为的图像1。即使启用了家长控制,苹果账户仍下载了24个换脸应用,谷歌账户则下载了51个1。
在调查曝光后,两家科技公司采取了行动。苹果下架了25个应用,谷歌下架了6个,并表示已限制相关搜索词1。然而,这些措施存在一个严重的安全漏洞——已下载这些应用的用户仍可继续使用1。涉案学生已被警察指控骚扰罪1,但受害学生的家长Morgan Dorfman表示,无法确保所有非法视频已被完全删除1。
A Pennsylvania high school student used an artificial intelligence face-swapping application called Movely to generate illegal sexual videos depicting female classmates in December 2025 1. The incident exposed a significant gap in digital safety protections: an investigation by Tech Transparency Project found that 135 applications with undressing or face-swapping capabilities remained downloadable by accounts marked as 13 years old, despite prohibitions from Apple and Google 1.
The researchers created four test accounts—two on Apple's platform and two on Google's—all flagged as belonging to 13-year-old users 1. Even with parental controls enabled on Apple accounts, the researchers successfully downloaded 24 face-swapping applications; Google accounts downloaded 51 such apps 1. One face-swapping application was rated appropriate for users as young as 4 years old, despite displaying images of women engaged in explicit acts 1. Following the investigation, Apple removed 25 applications and Google removed 6, though previously downloaded versions remain accessible to users 1. Apple subsequently tightened its content review after being contacted about the study, while Google stated it had delisted violating apps and restricted related search terms 1.
The Pennsylvania student involved in generating the videos was charged with harassment by police 1. Morgan Dorfman, parent of one victim, expressed ongoing concern about whether all versions of the videos had been permanently removed 1.
评论
还没有评论,欢迎留下第一条。