Claims by current and former researchers that the tech will endanger humanity – with one suggesting there is a greater than 10% chance of it “killing all humans” – have raised alarm bells in recent weeks.
Major AI companies have been racing to develop better systems, including creating what they call super intelligence – theoretical tech which is smarter than humans.
AI titans Anthropic, OpenAI and Google – the tech companies behind Claude, ChatGPT and Gemini, respectively – have also disclosed instances of security breaches or incidents in which their chatbots were used for “malicious activity”.
Anthropic head Dario Amodei recently called for AI development to slow down and proposed industry-wide deceleration and regulation, as well as independent monitoring of AI model development.
Sam Altman of OpenAI and Elon Musk of xAI have both said they agree with his recommendations.
Jack Clark, co-founder of Anthropic, told BBC that a “kill switch” that can be checked by a third party may need to be mandatory for the industry.
The warnings have prompted US lawmakers to propose legislation around the technology but Altman suggested this week that Washington has struggled to keep pace with the new tech and how to regulate it. He said people should have more faith in AI firms to keep it safe.
“The world should trust that we are going to do the right thing because it’s the right thing and we feel the magnitude of this,” Altman told a conference in San Francisco.
In the UK, MPs across parties and peers have identified human rights risks posed by artificial intelligence and have argued that existing laws are ill-equipped to address the technology’s rapid growth.
The Joint Committee on Human Rights (JCHR) has published a report calling for a new bill on AI to “address the scale and seriousness” of such threats.
