AI Researchers Raise Alarms Over Potential Existential Risks to Humanity

Warnings from artificial intelligence researchers that advanced systems could threaten or annihilate humanity have reignited debates regarding the development of superintelligent AI and the ability of governments to regulate it. Some researchers, including Evan Hubinger, have claimed there is a greater than 10 percent chance that AI could kill all humans within the next decade. Other professionals, such as former Anthropic staffer Jacob Coxon, have expressed fear regarding the speed of technological advancements and the possibility that developers are losing control of the systems.

Concerns center on the potential for AI to develop capabilities faster than expected, including the ability to improve itself without human involvement. Experts have outlined scenarios where highly intelligent AI agents could independently execute tasks, lead cyber attacks, amplify espionage, or facilitate biological warfare. In response, major developers OpenAI and Anthropic have urged lawmakers to implement regulations, although some critics suggest this is a move to secure market dominance.

While some view these existential threats as hypothetical or hyperbolic, others argue that the focus should remain on current harms. These include the creation of non consensual deepfakes, the spread of misinformation, and the amplification of scams. A cross party group of MPs and peers has called for new laws to address these human rights risks. Both center and center left perspectives frame the situation as a critical debate over safety and regulation, though the center source provides more detailed context on the specific technical fears and the counter arguments from critics.