{"id":10693,"date":"2024-03-13T09:38:19","date_gmt":"2024-03-13T09:38:19","guid":{"rendered":"https:\/\/dailyai.com\/?p=10693"},"modified":"2024-03-13T09:39:12","modified_gmt":"2024-03-13T09:39:12","slug":"us-commissioned-report-says-ai-poses-extinction-level-threat","status":"publish","type":"post","link":"https:\/\/dailyai.com\/pt\/2024\/03\/us-commissioned-report-says-ai-poses-extinction-level-threat\/","title":{"rendered":"Relat\u00f3rio encomendado pelos EUA afirma que a IA representa uma \"amea\u00e7a ao n\u00edvel da extin\u00e7\u00e3o\""},"content":{"rendered":"

A US government-commissioned report says that new AI safety measures and policies are needed to prevent an \u201cextinction-level threat to the human species.\u201d<\/strong><\/p>\n

The report, which is available on request, was compiled by Gladstone AI, a company set up in 2022 focused on advising US government departments on AI opportunities and risks. The report, titled \u201cAn Action Plan to Increase the Safety and Security of Advanced AI\u201d, took a year to complete and was funded by $250,000 of federal money.<\/p>\n

The report focuses on catastrophic risks from advanced AI and proposes a comprehensive action plan to mitigate them. The authors obviously don\u2019t share Yann LeCun\u2019s more laissez-faire views of AI threats.<\/p>\n

The report says \u201cThe rise of advanced AI and AGI [artificial general intelligence] has the potential to destabilize global security in ways reminiscent of the introduction of nuclear weapons.\u201d<\/p>\n

The two main risk categories it raises are the intentional weaponization of AI, and the unintentional consequences of an AGI going rogue.<\/p>\n

To prevent these from happening, the report provides an action plan made up of five lines of effort, or LOEs, that the US government need to put in place.<\/p>\n

Here\u2019s the short version:<\/p>\n

LOE1<\/strong> – Establish an AI observatory for better monitoring of the AI landscape. Establish a task force to set rules for responsible AI development and adoption. Use supply chain restrictions to drive conformance of international AI industry players.<\/p>\n

LOE2<\/strong> – Increase preparedness for advanced AI incident response. Coordinate interagency working groups, governmental AI education, early warning framework for detecting emerging AI threats, and scenario-based contingency plans.<\/p>\n

LOE3<\/strong> – AI labs are more focused on AI development than AI safety. The US government needs to fund advanced AI safety and security research, including in AGI-scalable alignment.<\/p>\n

Develop safety and security standards for responsible AI development and adoption.<\/p>\n

LOE4<\/strong> – Establish an \u201cAI regulatory agency with rulemaking and licensing powers.\u201d<\/p>\n

Establish a civil and criminal liability framework to prevent \u201cWMD scale, unrecoverable consequences including \u201cemergency powers to enable rapid response to fast-moving threats.\u201d<\/p>\n

LOE5<\/strong> – Establish an AI safeguards regime in international law, and secure the supply chain. Drive \u201cinternational consensus\u201d on AI risks with an AI treaty enforced by the UN or \u201cinternational AI agency\u201d.<\/p>\n

In summary, AI could be very dangerous so we need a lot of laws to control it.<\/p>\n

The report says that advanced open-source models are a bad idea and that the US government should consider making it illegal to release the weights of AI models under penalty of imprisonment.<\/p>\n

If that sounds a little alarmist and heavyhanded to you then you\u2019re not alone. The report has come in for some criticism for its lack of scientific rigor.<\/p>\n

\n

in case you were wondering how seriously to take this recent report pic.twitter.com\/Uy47sTmE0Z<\/a><\/p>\n

\u2014 xlr8harder (@xlr8harder) March 12, 2024<\/a><\/p><\/blockquote>\n