When AI is subject to less regulation than your fridge, something is startlingly wrong

Let’s be clear: the risk to humanity is unprecedented. Without an urgent public debate and robust use of international law, we will lose control of the future

When AI is subject to less regulation than your fridge, something is startlingly wrong

TL;DR

  • AI poses an unprecedented existential risk to humanity, potentially causing mass death or depriving billions of agency.
  • The disclosure of the Hugging Face hack and Jacob Coxon's resignation have brought AI risks to public discourse, creating an opportunity for regulation.
  • Urgent international coordination and public engagement are necessary to regulate frontier AI and ensure it benefits humanity, not just a few.
  • AI risks are categorized into existential risk (e.g., enabling bioweapons, AI deciding to eliminate humans) and existential challenge (depriving billions of agency).
  • The complexity and rapid development of AI mean humans may not understand or be able to control it, similar to the 2008 financial crisis but on a larger scale.
  • Current AI regulation is less stringent than for household appliances, and the industry is incentivized to accelerate development due to competition between nations and profit motives.
  • International law is crucial for AI regulation, requiring cooperation between the US, China, like-minded states, and the tech sector.
  • Democracy demands an urgent public debate to retain agency over our future and shape AI to serve the public good.
  • New governing theories are needed to determine AI control, regulation, and the beneficiaries of its advancements.