When AI is subject to less regulation than your fridge, something is startlingly wrong
Let’s be clear: the risk to humanity is unprecedented. Without an urgent public debate and robust use of international law, we will lose control of the future

TL;DR
- AI poses an unprecedented existential risk to humanity, potentially causing mass death or depriving billions of agency.
- The disclosure of the Hugging Face hack and Jacob Coxon's resignation have brought AI risks to public discourse, creating an opportunity for regulation.
- Urgent international coordination and public engagement are necessary to regulate frontier AI and ensure it benefits humanity, not just a few.
- AI risks are categorized into existential risk (e.g., enabling bioweapons, AI deciding to eliminate humans) and existential challenge (depriving billions of agency).
- The complexity and rapid development of AI mean humans may not understand or be able to control it, similar to the 2008 financial crisis but on a larger scale.
- Current AI regulation is less stringent than for household appliances, and the industry is incentivized to accelerate development due to competition between nations and profit motives.
- International law is crucial for AI regulation, requiring cooperation between the US, China, like-minded states, and the tech sector.
- Democracy demands an urgent public debate to retain agency over our future and shape AI to serve the public good.
- New governing theories are needed to determine AI control, regulation, and the beneficiaries of its advancements.