在过去24小时内，来自OpenAI、Anthropic和谷歌等科技公司的多位AI研究人员公开表达了对人工智能技术安全的严重担忧。1一位前OpenAI研究人员警告称，这项技术可能在十年内导致致命后果。1随后，Anthropic的Evan Hubinger和Samuel Marks等多位研究人员予以响应和背书。1谷歌前员工Alex Turner、OpenAI的Jason Wolfe和首席科学家Jakub Pachocki也表示了担忧。1
本周，Anthropic的一名研究员辞职并在社交媒体发布警告，称公司正在"直奔自我改进的超级智能并赌上我们的生命"。2该公司的对齐负责人共同签署了这份警告。2与此同时，多名来自Anthropic和Google的AI研究人员因对安全隐患的担忧而离职，称"房间里没有成年人"。34这一系列警告在Anthropic据报准备进行IPO的时机下引发了关注。2
美国国会因这些AI灾难性警告陷入恐慌。3然而，警告也招致了批评。Hugging Face首席执行官和Altimeter资本创始人对这些AI灭绝警告提出质疑。5这些声明反映了AI开发领域内对安全隐患的持续争议和分歧。4
Multiple artificial intelligence researchers from leading tech companies have publicly expressed grave concerns about AI safety in recent days, marking a significant moment of dissent within the industry.134 Researchers from OpenAI, Anthropic, and Google have warned that advanced AI systems pose existential risks to humanity, with one former OpenAI researcher cautioning that the technology could lead to fatal consequences within a decade.1
The warnings have prompted departures from major AI companies. An Anthropic researcher resigned this week after posting on social media that the company is "racing straight to self-improving superintelligence and gambling with our lives."2 Multiple AI researchers from both Anthropic and Google have stepped down over safety concerns, with some characterizing the current state of AI development as lacking adult oversight.345 Notably, Anthropic's alignment lead co-signed the safety warning rather than dismissing it.2
The coordinated expressions of concern represent what some observers describe as a resistance movement within the AI community. Signatories include researchers such as Evan Hubinger and Samuel Marks from Anthropic, along with OpenAI scientists including Jakub Pachocki and Jason Wolfe, as well as former Google employee Alex Turner.1 These individuals have stressed that they are articulating concerns widely shared among their colleagues.1
The timing of these warnings has drawn particular attention, coinciding with reports that Anthropic is preparing for an initial public offering.2 The public safety concerns have also generated discussion in U.S. Congress and prompted scrutiny from industry observers.3 However, the warnings have faced skepticism from some figures in the AI sector, with critics questioning the motivations behind extinction risk warnings.5
评论
还没有评论，欢迎留下第一条。