Hugo de Garis is one of the first AGI thinkers that I came across in 2012, when I decided to focus my life on the post-human transition. Aside from Bostrom and Al-Rodhan, few thinkers molded my early ideas about AGI and transhumanism more than de Garis.
I believe that two of his ideas are extremely important, and are somewhat absent in most of the artificial general intelligence conversations today (and even most of the discussions from 2010-2014). Those ideas are what de Garis calls “Globism” (global world order) and “Cosmism” (the belief that humanity should create diety-level machine intelligences).
The following screenshot is from de Garis’s (seemingly neglected) online blog:
Since first exploring Kurzweil’s ideas in The Singularity is Near, it seemed evident to me that the default mode of technology development would be competition – the economic or military “state of nature” – and that conflict is extremely likely if new forms of thinking and valuing come into existence.
If this is the case, then humanity must get on the same page about “the two questions“:
1. What is a beneficial transition beyond humanity?
2. How do we get there from here without destroying ourselves?
I hope dearly that the United Nations develop a Sustainable Development Goals for (a) determining a shared end-goal of post-human transition, and (b) uniting humanity in a safe transition to the post-human condition. This is probably too much to ask, though I wish I had been able to address these topics directly when I gave my last presentation (on deepfakes and AI security concerns) at United Nations HQ. I suspect it’ll be a few years until I’m invited to talk about the grand trajectory of intelligence.
This almost inevitably will involve global transparency and security regarding emerging tech, and it will almost inevitably require some kind of shared cosmopolitan plan of how we transition beyond humanity in a reasonably safe way. No safe way is evident, but anything other than the state of nature (i.e. the US and China build AGI and cognitively enhanced soldiers and compete for supremacy) seems to be preferable to the state of nature.
Only some kind of global governance structure could achieve such an aim. It seems remarkably unlikely that humanity will pool its efforts unless it experiences a dire and horrible tragedy that forces us to realize that we need to “get on the same page” about the end-game of intelligence, and a shared human vision thereof – or perish. I fear that fear alone could do the job of this kind of uniting.
Literally every TEDx talk I’ve presented has ended with this same call to action. Namely, some form of “We should facilitative international discourse to determine where this AI stuff goes, guys, because the default isn’t pretty.”
Kurzweil, the supreme optimist, doesn’t address the arms race concerns directly, and doesn’t seem to be concerned with them.
Hugo is concerned, however, as I think more of us should be.
I believe that de Garis is right, and that global world order (or war), and post-human artificial intelligence (or war) are both near-inescapable in the coming 50 years.
In the long run, if we are to survive the coming waves of emerging tech (hundreds more years), we’ll need global world order.
In the long run, if any remnant of the legacy of homo sapiens is to survive (billions more years), we’ll need to create a kind of greater, vaster intelligence which can further discern nature, discern the good, and perpetuate itself into the galaxy. In the words of Lucretius, to “[Raid] the fields of the unmeasured All.”
Whether or not we can live out a few more good centuries (or decades), and whether or not we can pass the baton properly (whatever that means) – is yet to be determined.
Header image credit: Adam Ford’s YouTube Channel – https://www.youtube.com/channel/UCEne3aAgie57IvOZKKSxi9Q
Joining us in the third episode of our series AGI Governance on The Trajectory is Stephen Ibaraki, Founder of the UN ITU AI for Good, and Chairman at REDDS Capital….
Joining us in our eleventh episode of our series AGI Governance on The Trajectory is Irakli Beridze, Director of the UNICRI Centre for Artificial Intelligence and Robotics under the United…
Joining us in our twelfth episode of our series AGI Governance on The Trajectory is Aza Raskin, co-founder of the Center for Humane Technology and co-founder of the Earth Species…
I’ve been diving into “Human Enhancement” (Oxford) as of late, and came across a topic that was bristling in my own mind before I saw the name of the chapter….
Human nature has always been to gain control over the physical world — both in maximizing its output for our benefit (farming, mining, etc), and in lessening the risks it…
The substrate monopoly hypothesis: In the remaining part of the 21st century, all competition between the world’s most powerful nations or organizations (whether economic competition, political competition, or military conflict)…
The more humanity comes to understand the cosmos, the more we see the cosmos as a set of processes. We once thought the universe “always was,” and now we see…
Episode 1 of The Trajectory is with none other than the Turing Award winner, MILA Scientific Director, ML godfather, and (very recently) AI safety advocate, Yoshua Bengio. My first interview…
Episode 2 of The Trajectory is with the Co-Founder of Skype, a prolific funder of AI safety research, and member of the United Nations Secretary General’s AI Council – Jaan…