Heidy Khlaaf<\/p>\n
Chief AI Scientist, AI Now Institute<\/p>\n
We are in the dangerous territory where Large Language Models (LLMs) and generative AI are being normalized as a valid technology to be instrumented within both AI-Decision Support Systems (DSS) and Lethal Autonomous Weapons Systems (LAWS) for targeting purposes. Yet current framing regarding Anthropic\u2019s and OpenAI\u2019s negotiations with the US\u2019s Department of War instead risks overindexing on myopic interpretations of human oversight, or a particular companies\u2019 so-called \u2018red lines\u2019, papering over what should be the real target of our scrutiny: that generative AI algorithms are a flawed and inaccurate technology that fabricate and \u201challucinate\u201d outputs, often at a rate of 50% accuracy, where they\u2019re unlikely to be able to solve tasks outside of their data distribution and training data sets.<\/p>\n
Generative AI\u2019s inability to handle novel scenarios that would arise from the fog of war thus raises serious questions about whether they can be successful in military settings. Furthermore, these \u201challucinations\u201d are an inherent property of these models given their probabilistic nature, with model providers stating that these issues are to persist.<\/p>\n
Letting Anthropic\u2019s safety theater drive the discourse additionally overlooks what is ultimately a superficial distinction between AI-DSS and LAWS in practice. The difference often separating AI-DSS, which is how they\u2019re currently being used, and AI-driven AWS, is a human in the loop that is likely to be impacted by automation bias. If Anthropic itself admits that its models are too unreliable for LAWS, that would imply they are not reliable for AI-DSS either, nor the autonomous drone swarming technologies they\u2019ve put proposals forward for.<\/p>\n
Regardless of oversight levels, current LLM safety is far from the reliability and accuracy measures that have long been a prerequisite for defense and safety-critical systems. Deploying them for either AI-DSS or AWS may ultimately lead to conflicts becoming indiscriminate lethal campaigns.<\/p>\n
Read more here.<\/p>\n
The post Key Questions on the Role of Technology in the Expanding Middle East War appeared first on AI Now Institute.<\/p>\n","protected":false},"excerpt":{"rendered":"
Tech Policy Press asked experts working at the intersection of technology policy, security, and international affairs to share what they are watching as the situation unfolds.<\/p>\n
The post Key Questions on the Role of Technology in the Expanding Middle East War<\/a> appeared first on AI Now Institute<\/a>.<\/p>\n<\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[1,13,86],"tags":[3],"class_list":["post-1761","post","type-post","status-publish","format-standard","hentry","category-ai-and-ml","category-news","category-press","tag-ai"],"yoast_head":"\n