27岁的Anthropic研究员Jacob Coxon周二宣布辞职，声称AI开发者相信该技术可能对人类构成存在风险2。Coxon在声明中表示，人工智能将很快成为"能黑入任何系统的超人类系统"2。同时，Anthropic团队主管Evan Hubinger也发文称："我们真诚地相信AI可能导致全人类死亡，我个人认为在未来十年内的概率超过10%"2。
Anthropic首席执行官Dario Amodei随后发文呼吁减速AI模型开发和全球监管2。然而，这些警告在硅谷引发分歧2。Grindr首席执行官George Arison指控这是"反文明世界观"，已指示工程师停止使用Anthropic技术2；Nvidia首席执行官Jensen Huang也在会议上驳斥了Coxon的言论2。一些硅谷高管和投资者对这些警告持怀疑态度，认为可能出于融资目的而夸大其词2。
Coxon曾在OpenAI工作后加入Anthropic2。Anthropic在今年早前融资中估值9650亿美元2，并最近发现威胁行为者试图利用其AI技术开发生物武器和进行网络间谍活动2。此外，美国参议员Bernie Sanders于本月联合赞助《禁止人工超级智能法案》，提议临时暂停先进AI开发2。
A former researcher at Anthropic has disclosed that artificial intelligence staff members are "genuinely frightened" about the future of humanity, according to remarks made to the BBC 1. The concern centers on the rapid development of advanced AI systems and their potential risks.
Jacob Coxon, a 27-year-old researcher who previously worked at OpenAI before joining Anthropic, announced his resignation this week amid growing warnings about AI safety 2. In his departure statement, Coxon described AI as poised to soon become "a superhuman system capable of hacking into any system" 2. Evan Hubinger, a team lead at Anthropic, reinforced these concerns in a public statement, saying "we genuinely believe AI could lead to the death of all humanity" and personally estimating the probability of this outcome within the next decade at over 10 percent 2.
These warnings have prompted mixed reactions across Silicon Valley. Anthropic's Chief Executive Officer Dario Amodei has called for slowing the pace of AI development and implementing global regulation 12. However, skepticism persists among some technology leaders and investors. George Arison, CEO of Grindr, dismissed the warnings as an "anti-civilization worldview" and instructed his engineers to stop using Anthropic's technology 2. Similarly, Jensen Huang, CEO of Nvidia, rejected Coxon's claims during a recent conference 2.
Separately, Anthropic recently discovered that threat actors had attempted to exploit its AI technology for developing biological weapons and conducting cyber espionage 2. The company, valued at $96.5 billion in a recent funding round 2, continues to operate amid ongoing debates about the appropriate speed and oversight of AI advancement. Lawmakers including Bernie Sanders have co-sponsored a "Superintelligence Prohibition Act" that would temporarily halt advanced AI development 2.
评论
还没有评论，欢迎留下第一条。