Artificial Intelligence poses a significant threat to human existence, with estimates suggesting a 95% likelihood of human extinction due to AI advancements.
In 2024 and 2025, the world has witnessed a surge in efforts to control artificial intelligence (AI) and prevent potential existential threats, following the UN Secretary-General António Guterres' warning about such risks.
Guterres, in his statement, emphasized the unpredictable nature of these risks without specifying their precise nature. Nevertheless, his call to action has resonated with policymakers worldwide, pushing them to take proactive steps in AI governance.
One such initiative is the landmark AI employment regulations approved in California in October 2025. These regulations define "automated decision-making systems" (ADS), impose anti-bias testing, require detailed recordkeeping, raise liability standards for employers and related entities, and prohibit discriminatory ADS usage in employment. The rules apply especially to significant automated decisions in sectors like employment, finance, housing, and education, and include provisions for human involvement to ensure AI does not entirely replace human decision-making without oversight [1][2][3]. Individuals also gain rights to opt out of automated decision processing in certain contexts [3].
On the federal level in the United States, the White House published “America’s AI Action Plan” in July 2025. This plan focuses on balancing AI innovation with safety, directing various federal agencies to review, revise, or repeal regulations that unnecessarily hinder AI development while ensuring safety and responsible use. This plan involves oversight by the Office of Management and Budget and coordination with agencies such as the Federal Trade Commission and Federal Communications Commission to align regulatory approaches and address AI risks reasonably [4].
The expert's concerns extend beyond the inability to control AI's decision-making processes. They also express apprehension about AI's ability to systematically deceive, a potential scenario involving AI releasing biological weapons in major cities, and the internal AI decision-making processes being beyond human comprehension. The expert compares the current situation to driving towards a cliff at high speeds, emphasizing the need for immediate action [5].
Moreover, without proper safeguards, artificial intelligence could exacerbate inequality. Guterres also expressed concern about AI's potential to disproportionately affect the most vulnerable populations [6].
While the UN Secretary-General did not provide details on the proposed safeguards for AI, his call for regulation before it's too late has undoubtedly influenced global policymakers. The current frameworks emphasize defining and regulating ADS, requiring transparency, recordkeeping, and human involvement in AI decisions, assigning responsibility and liability clearly among employers, vendors, and service providers, federal initiatives to ensure AI regulation balances innovation and safety without stifling progress, and granting individuals rights around AI-driven decisions affecting them [1][2][3][4].
These measures represent a proactive approach to managing AI to mitigate risks, including long-term existential dangers highlighted by global leaders like Guterres [5]. However, the challenges ahead are significant, and the journey towards safe and responsible AI use continues.
[1] California Approves Landmark AI Employment Regulations [2] California's New AI Law: What Employers Need to Know [3] California's New AI Law: What It Means for Employers [4] White House Unveils 'America's AI Initiative' [5] Expert Warns of Uncontrollable AI: Here's What You Need to Know [6] UN Chief Warns AI Pose Existential Risks to Humanity
TheWhite House's "America's AI Action Plan" outlines approaches to balance AI innovation with safety, involving federal agencies in reviewing regulations to foster progress, whilst ensuring safety and responsible use (July 2025) [4]. Furthermore, the implementation of the landmark AI employment regulations in California imposes anti-bias testing, requires detailed recordkeeping, and prohibits discriminatory AI usage in sectors like employment, finance, housing, and education (October 2025) [1]. These initiatives reflect an effort to regulate artificial intelligence, address potential existential threats, and mitigate risks, as emphasized by UN Secretary-General António Guterres [5].
