Does AI Safety (and the Effective Altruist Technocracy) Need More of a Grassroots?
The Future of Life Institute released a letter today to the UN’s Conference of the Convention on Certain Conventional Weapons (CCW) conveying concerns regarding lethal autonomous weapons (signed by Elon Musk and covered in The Washington Post and elsewhere). The concerns are grave: Lethal autonomous weapons threaten to become the third revolution in warfare. Once developed, they will permit armed conflict to be fought at a scale greater than ever, and at timescales faster than humans can comprehend. These can be weapons of terror, weapons that despots and terrorists use against innocent populations, and weapons hacked to behave in undesirable ways. We do not have long to act. Once this Pandora’s box is opened, it will be hard to close. We therefore implore the High Contracting Parties to find a way to protect us all from these dangers. I used to be unduly dismissive of far future concerns (as did many other EAs ), but I've been persuaded by books like Superintelligence that g...