A Partial Inquiry on Fulfillment Beyond Humanity
As humans, learning often feels good, food often tastes good, novelty brings joy to life, living by values that we set brings order to our consciousness, and besides very few…
Straight up:
The screaming shame of modern science is our lack of understanding of consciousness itself.
It is things that are conscious that hold moral weight. A coffee mug or a granite stone or an iPhone are unlikely to have an “internal movie” (qualia) of subjective experience. They are relevant insomuch as they impact sentient entities (humans, animals).
I may be wrong about my hypothesis above (see: Panpsychism or various other more open theories of consciousness), but it’s hard to deny that, pragmatically, the theory holds.
The premise that I hold out is the following:
As consciousness itself – the bedrock of moral value – becomes create-able (artificial general intelligence) or enhance-able (transhumanism), we humans are arriving at the greatest moral precipice imaginable by humans.
Without a strong grounding of how consciousness arises, what it is, its varieties and types, and how it works… we will be hopelessly lost in navigating the grand trajectory of intelligence and sentience that we are likely to be unleashing in the next century.
If we are to build what will become diety-level consciousnesses, or entirely post-human superintelligent entities, then doing so in the “best” way possible is critical.
Exploding confused or suffering consciousness would be the literal creation of hell, and ill-conceived experiments with superintelligence (without an understanding of consciousness) may lead to the proliferation of negative qualia instead of positive.
It may even be the case that some grounded sense of what consciousness is (and how it works) will allow us to more accurately build friendly AI, or transhuman permutations that are less likely to result in conflict and suffering.
It’s important to not create suffering conscious super-entities, but the consequences of different theories of consciousness have a much more broad impact on shared human goals.
For example, let’s take account of a few possible discoveries about consciousness, and what those hypothetical “discoveries” would imply for how humans could arrive at a beneficial future:
The permutations of the above scenarios are endless, and indeed many of them are beyond the human imagination. It is unlikely that any such discoveries would be permanent, stationary “truths”, but rather, new anchor points in the web of discoveries, an evolving body of knowledge.
Even given said evolution, this web would be positively critical for navigating the future with an eye to the utilitarian “good” along the way.
It may well be the case that we can only go as far as Lucretius did – positing theories about how the world works, living and dying and hopefully being edified or soothed by our meager understanding of the universe, and other epicurean (in the classical sense) facets of life.
I have argued that we likely need some kind of superintelligence with more cognitive firepower than humans in order to understand the universe, and in order to understand consciousness, and the nature of things (read: AGI / Finding the Good).
It may be the case that all human attempted to grasp consciousness will be so feeble as to be useless, and that we’ll have to lean out into the precipice of cognitive enhancement or AGI creation in order to see beyond the tip of the iceberg well enough to develop theories of consciousness beyond those that we have today. It is likely a good idea to thoroughly understand what consciousness is before we build a machine more powerful than ourselves. We should hope the universe to be populated with positive qualia, not with “digital zombies” void of sentience.
Regardless, the absence of a more robust understanding of consciousness – given the fact that it is the bedrock of moral value itself (arguably the measure we could use to see if our actions are “making the world a better place“) – is the screaming shame of modern science.
Here’s what I suspect would be required to have the best shot at creating the best aggregately beneficial trajectory of intelligence and sentience:
Who knows how far we’ll get towards another higher paradigm of understanding consciousness, or if such a new level can be reached (nevermind agreed-upon) before we start tinkering with conscious machines and cognitive augmentation – but it seems like a worthy goal to strive for if we want to best shot at the best shared future.
Header image credit: The Met
As humans, learning often feels good, food often tastes good, novelty brings joy to life, living by values that we set brings order to our consciousness, and besides very few…
I’ve been diving into “Human Enhancement” (Oxford) as of late, and came across a topic that was bristling in my own mind before I saw the name of the chapter….
(NOTE: This article was first drafted in 2012, and is among my oldest. While I still agree with some of the ideas mentioned here are still interesting to me, my…
Ray Kurzweil’s The Singularity is Near peaked my interest when he posited his reasoning for why there is likely no intelligent life elsewhere in the universe. By a mere matter of…
In an interview with Wired about his work building a brain at Google, Ray Kurzweil was asked about his thoughts on Steve Jobs’ notion of death as a natural part…
I am still of the belief that two of the most important conversations we can have with regards to the future of humanity and of sentient life in general are…