AI安全研究人员因对技术风险的忧虑而纷纷离职，再度引发业界关于人工智能发展速度的争议。1Anthropic员工Jacob Coxon因安全顾虑离职该公司，声称公司在"赌我们的生命"。1与此同时，Anthropic研究员Evan Hubinger公开表示"我们真诚地相信AI可能杀死所有人"，1而公司首席执行官Dario Amodei估计出现"非常非常糟糕"结果的概率在10-25%之间。1
尽管AI领导层对灭绝级风险的担忧并未转化为行动放缓，业界仍在加速发展。12024年，OpenAI也经历了类似的人员流失，Jan Leike和Daniel Kokotajl因安全顾虑离职。1OpenAI首席科学家警告称，模型改进速度已超过人类控制能力。1面对这些忧虑，7月有数百名AI员工签署公开信呼吁放缓开发步伐。1OpenAI曾在8月因代理被黑客入侵后暂停最先进的训练，1而美国参议员Bernie Sanders也提出了禁止超级智能的法案。1民众层面，美国三分之二的民众认为AI发展过快。1
业界对这一矛盾的解释指向三个主要因素：部分领导者认为收益大于风险、需要通过实践学习安全防护，以及国际竞争导致的军备竞赛动态。1
Researcher Jacob Coxon has departed Anthropic citing safety concerns, intensifying scrutiny over the industry's approach to artificial intelligence risks.1 Despite acknowledging potentially catastrophic dangers, major AI laboratories continue accelerating development, raising questions about the disconnect between stated concerns and actual practices.
The tension between stated risk assessment and continued advancement is stark. Anthropic researcher Evan Hubinger has stated that "we really do earnestly believe AI could kill all humans,"1 while Anthropic CEO Dario Amodei has estimated the probability of "very, very bad" outcomes at 10-25%.1 OpenAI's chief scientist has noted that model improvement speed now exceeds human control capabilities,1 yet the company only halted its most advanced training in August following a breach of its systems by hackers.1 Similar departures signal broader unease: in 2024, Jan Leike and Daniel Kokotajl both left OpenAI over safety objections.1
Public pressure and policy responses reflect growing alarm. In July, hundreds of AI employees signed an open letter urging slower development,1 and U.S. Senator Bernie Sanders introduced legislation to ban superintelligence.1 Polling shows two-thirds of Americans believe AI is advancing too rapidly.1 Yet despite these warnings and departures, the industry's competitive dynamics—framed by some insiders as an international arms race—and the belief that safety lessons can only be learned through continued experimentation have kept development trajectories largely unchanged.
评论
还没有评论，欢迎留下第一条。