软件工程行业当前缺乏与土木工程相当的职业问责制,这一差距在安全攸关领域带来了严重风险。1土木工程师必须在设计图纸上签字认可,建筑倒塌时需承担直接个人责任,而软件工程师却可以在几乎不负责任的情况下部署可能导致数百人死亡的代码。1俄乌战争中已出现自主无人机需要软件做出杀伤决策的情况,人工智能模型也成为几乎所有行业安全攸关系统的关键组成部分。1
为推动软件行业建立更严格的规范,业界人士提出了一系列具体建议。1这些建议包括在计算机科学学位课程中强制纳入伦理教育、建立专业认证结构、从卫生和运输等已有强监管基础的领域开始试点新规则、为软件项目建立单一清晰的负责人制度,以及建立类似航空业匿名安全事件报告系统(ASRS)的举措。1建议还涉及要求政府和大型采购方推动质量标准的实施。1
监管框架的必要性在于当前行业规模与从业人员背景的现状。1美国大约有200万软件工程师,而土木工程师仅约20万,许多编码人员还是自学成才。1相关人士已帮助启动了原则科技联盟,推动在创新与安全之间取得平衡。1
The software engineering sector lacks the professional oversight standards that govern established engineering disciplines, creating dangerous accountability gaps despite the industry's growing influence over critical systems worldwide.1 Unlike civil engineers who must stamp approved design blueprints and face direct personal liability if structures fail, software engineers can deploy code potentially causing hundreds of deaths with minimal professional consequences.1
The stakes have become increasingly urgent as autonomous systems assume life-or-death decision-making roles.1 Autonomous drones requiring software-based targeting decisions have already appeared in the Russia-Ukraine conflict, and artificial intelligence models now form core components of safety-critical systems across nearly every industry.1 The scale of the profession compounds these risks: the United States has approximately two million software engineers compared to roughly 200,000 civil engineers, with many coders being self-taught rather than formally credentialed.1
To bridge this regulatory gap, concrete measures have been proposed to establish professional standards while preserving innovation.1 Recommendations include mandating ethics coursework in computer science degree programs, creating formal professional certification structures, implementing single-person accountability mechanisms for software projects, and establishing sector-specific pilot programs beginning with heavily regulated industries such as healthcare and transportation.1 Additionally, an anonymous safety incident reporting system modeled after aviation's ASRS framework could enable systematic learning from failures, and large procurement bodies could leverage their purchasing power to enforce quality standards across the industry.1 The author has recently helped establish the Alliance for Principled Tech to advance these regulatory efforts.1
评论
还没有评论,欢迎留下第一条。