Negative Utilitarianism Won’t Take Us Where We Need to Go
What matters more, happiness or suffering? For almost all of us – utilitarians or not – both positive and negative qualia matter, and register when we make decisions about our…
Can we do better than the state of nature?
Or, rather, can we do better than nature herself?
When it comes to the trajectory of intelligence itself, some humans seem to think that we can. From Goertzel’s ideas about decentralized artificial general intelligence to Omohundro’s Safe-AI Scaffolding to Stuart Russell’s Human Compatible and beyond, many of the efforts of intellectuals in the AGI/transhumanism space seem to believe that there are actions humans can take
Ultimately, the arguments around how hands-on we should be with AGI are arguments around which scenario one believes to be most likely. The arguments might look something like this:
In this brief essay, I’ll aim to pose a “for” and “against” argument for the idea of humanity guiding the trajectory of intelligence.
This topic is broad, and I don’t expect to do more than scratch the surface.
That said, I hope to further open up the important debate around how and if we might influence the future of post-human life. In my heart of hearts, I hope that through an explanation of the positions “for” and “against,” I’ll be able to flesh out better, more robust approaches “for” – but I accept that the arguments against might be stronger.
Up until this point, intelligence and complexity have developed primarily through fecundity and conflict/challenge. Through fecundity, new forms and new versions of forms are constantly created – and through challenge or conflict, life adapts to develop new capabilities that give it a better ability to survive and reproduce – filling the future with either more versions of itself, or more permutations of its genetic line as it evolves.
If we take the most successful species of bird or frog in a given environment today – and place it in similar environments on Earth 1 billion years ago – it’s extremely unlikely that these same species would thrive. The oxygen content of the air, the other competing animals in the ecosystems, the food sources, and the fauna – all change, and life adapts and changes with it.
We can imagine a hypothetical council of all of the apes of the world, coming together 7 million years ago, deciding on how to develop the next level of intelligence. What features should this creature develop? What traits would make it most likely to survive and reproduce and solve high-order problems than the apes of that 7,000,000 BC?
Obviously, this kind of future planning and coordination is beyond the intelligence of apes of that era, but let’s suspect they got together and posited answers to those questions above. They might desire a future entity who could:
The importance of written language, the importance of cerebral cortex, the importance of developing societies and culture – nevermind manned flight and the internet – would almost certainly never have dawned on apes.
Similarly, one could argue (and I would) that humanity does not know:
For that reason, one might argue that overtly designing AGI will at best be another version of fecundity, which will be best suited to enter the world of conflict and challenge, and develop the same way other intelligences have developed: By competing to survive and persist.
There is no way to tell if life on Earth would be more or less rich, more or less worthwhile, had a meteor not struck the Earth and killed off the dinosaurs 66 million years ago.
There is no way to tell if humanity, slowing and carefully calibrating the birth of AGI, will produce a better long-term future (whatever “better” means) than if we just went to war with AGI weapons and let conflict determine the winner – as has been the case for literally every species before us.
But this core uncertainty hasn’t stopped humanity from doing what we do best – or rather – what nature does best, though us: To try anyway. For example:
Similarly – while we can’t possibly know if our efforts can positively influence the future of intelligence and intelligent life (heck, we don’t know if we have volition in the first place) – we’ll probably find that we can’t do help ourselves but try.
Even some of those often labeled pessimists, from Yampolskiy to Bostrom, presumably publish their work and share their ideas with some notion that it might make a positive impact on how humanity steers its way through the dangerous scenarios ahead.
Maybe it’ll all just be a Sisyphean gag either way. Maybe it’ll be worthwhile. Maybe time will tell. If we have to choose between giving up entirely or taking a swing, we might as well swing.
Header image credit: Siege of Akhaltsikhe by January Suchodolski (via Fine Art America)
What matters more, happiness or suffering? For almost all of us – utilitarians or not – both positive and negative qualia matter, and register when we make decisions about our…
In business, blindly assuming you’ll be profitable is a recipe for bankruptcy. In the outdoors, blindly assuming you’ll find water and shelter is a recipe for death. And yet, many…
Many renown technology pundits, entrepreneurs, and inventors have posited a similar vision of an artificial intelligence-enabled future: Artificial intelligence and other future technologies will amass tremendous wealth in the hands of a few…
Total Recall is a 1990 Schwarzenegger blockbuster that, until yesterday, I had never seen. The movie centers around the story of a construction worker who is treated by a company…
As human beings we are propelled by our varied hopes, our lives are in many ways driven by them. On the day-to-day, we hope to make the sale, to avoid…
At some point, AGI or non-biological intelligence will accomplish most of what there is to be done in the universe, and humanity won’t be contributing meaningfully to anything (discovery of…
The following are assumptions that most of us hold as iron truths: Happiness is only made possible because of its opposite: Pain. Without pain, there is no real happiness. If…
This new installment of the Worthy Successor series is an interview with Terrence Deacon, emeritus professor of cognitive science and anthropology from UC Berkeley. Terrence’s work focuses on language, symbolic…
In my discussions around posthumanism and AGI, I’ve noticed something curious: Almost all discussions in the intergovernmental world, tech media, and social media center around specific policy decisions – not…