Sentient Potential and Stoic Ideals
In my writing about superintelligence, I often openly wonder about the values, ideals, and preferences of such an entity. In fact, my initial series of interviews with ancient philosophy professors…
I’ve been cajoled into watching Netflix’s Black Mirror, and a friend of mine recommended watching the San Junipero episode next. As I mentioned in my last Black Morror reflection, and I didn’t plan on watching anything that wasn’t worth 40 minutes. San Junipero was a good pick, and it’s nice to know that the class of ideas being brought up in this piece
For those of you who haven’t watched the episode, here’s the gist:
Of course there’s more to the episode than that, but I’m going to get the plot of story out of the way for now and use the rest of this article to explore the particular details about this mind uploading scenario, and what I think Black Mirror got right and wrong in terms of how this kind of scenario might play out in the decades ahead.
Let’s dive in:
Outside of Johnny Depp’s 2014 Transcendence – and up until Musk started tweeting about it – this concept of mind uploading hasn’t left the realm of Less Wrong message boards and and assorted articles on Humanity+ and the IEET. My TEDx on cognitive enhancement gets more views now on YouTube than it ever did back in 2014 when it went live – probably because nobody was Googling related terms until somewhat recently.
All in all San Junipero brings many important ideas to light, in a way that I think is somewhat true to how it might go down during our lifetimes.
Kelly, one of the girls in the main story, resists the idea of going to a fantasy land after death. As an old woman, she’s been widowed, and her husband is also died. Her reasoning is similar to what we should expect from humans:
“…Wars with their noise affright us: when they cease,
We are worse in peace:
What then remains, but that we still should cry,
Not to be born, or being born, to die.”––Sir Francis Bacon, the last 4 lines of ‘The Life of Man’
Indeed our condition is outlandishly tragic. Hopefully, however, technology will help to overcome some of the seemingly unnecessary suffering from our condition, and I believe that a properly crafted digital afterlife could never be anything but “gradients of bliss” (to quote my favorite David Pearce-ism), but I’ll get on to that in the WRONG section below.
In the WRONG section below, I’ll cover why I believe that this will change quickly, but it seems reasonable to suspect that early mind uploading experiences will be a kind of perfectly calibrated regular human experience.
For Yorkie and Kelly in the San Junipero story, the 80’s were a kind of ideal time. We get the idea that they were born in the 60’s and came of age in the 80’s. Just like our parents, and their parents, we are brought to a special reverie by memories of our first loves and challenges in the world, and the 80’s San Junipero is like a nostalgic dream.
The 80’s certainly isn’t everyone’s idea of heaven, but the idea is the same: Take some preferred experience or time period in a human life and “freeze frame” it to be a digital afterlife.
Other potential examples include might include experiencing the digital afterlife as:
You get the idea.
I’m more or less revolted by the idea that this would be the full extent of the digital afterlife, and I believe strongly (as I’ll cover in WRONG section) that we’ll quickly zoom beyond the present sensory experience of humanity when transhumanism becomes viable, but initial demand will simply be for variants of what we think we want now.
In the San Junipero episode, we hear an elder care professional (taking care of Yorkie, who is on her death bed) state that they must limit the use of the neural device that hooks up living patients to the digital experience. While there isn’t much of an explanation, we are left with the impression that it is done as a precautionary measure because the effects of using such a neural device aren’t understood well enough at the time.
Indeed if neural prosthetic devices allow us to “beam” our minds into different bodies and different worlds, there will be huge ethical and social considerations, including:
In the “real world” featured in the episode San Junipiero – which we are left suspecting is around 2050 – this mind uploading technology is still relatively new. It is that inflection point that I think we should consider as a species, and so I’m glad that this was the time horizon that the episode focused on. I consider it to be plausible that when a technology of this kind is still experimental, there will be much trepidation with prolonged exposure for humans, and I think the episode nailed that sense of both limitless possibility and mortal danger.
For all that the show did well, I believe that the virtual destination of San Junipero varies from the kind of “digital eternity” experience that anyone would seriously prefer.
I believe quite firmly that upon developing the ability to upload human minds, we will quickly be carried vastly beyond “optimized” versions of the human experience into new vistas of conscious experience, vastly more blissful and interesting than any human has ever experienced.
The furthest, distant, technologically enhanced version of conscious experience is not a nostalgic 80’s bar, and it isn’t anything human beings have ever experienced. I’ll articulate this in greater depth:
If full-blown digital immersion were possible, it would be much more rich or compelling than this San Junipero world shows itself to be.
There are only so many sunny tropical island adventures, only so many hot tub experiences with 1994 Neve Campbell… before the hedonic treadmill of our condition kicks in, and it isn’t good enough anymore.
Look at suicide rates in the first world (seriously, look).
Somewhere around one in nine Americans is taking an antidepressant. In my “AI for Good” TEDx (embedded below at the proper time-stamp in the presentation), I state openly that we live like gods compared to our ancestors 200 years ago but we still off ourselves on the regular. I’m not sure what’s more depressing than that. It’s our condition, from Ecclesiastes to Rasselas and from the West to the East the spiritual lessons are common: Happiness is not for this man.
To quote our tender Epicurean sage:
“For when he saw that almost all things necessarily required for subsistence, and which may render life comfortable, are already prepared to their hand, that men may abundantly attain wealth, honour, praise, may rejoice in the reputation of their children, yet that, notwithstanding, every one has none the less in his heart and home anxieties and a mind enslaved by wearing complaints, he saw that the vessel itself was in fault, and that all good things which were brought into it from without were spoilt by its own imperfections.”
—Lucretius, De Rerum Natura, vi. 9.
It’s the vessel that is flawed. If wellbeing is the aim, if rich and robust positive conscious experience is the goal here, then maintaining the ability to be bored, to be jealous, to be sad, to be angry… to be in a state of always running from one angst to another (i.e. our present condition) – this would be heaven to no one.
The likely progression of virtual experiences for uploaded (or maybe even just enhanced) humans minds will probably be thus:
The veil of tears and perpetual Dukkha would have to cease for digital eternity to be preferable. End of story. We never got to that point in San Junipero. In the show, people were still sad, still jealous, still angry in their digital “heaven”.
Beyond that, though, the boundaries around the “human experience” (our senses, our memory, our needs and preferences) will quickly be altered and blown away once mind uploading and virtual experiences are possible. Life is incessant, and will not permit an eternity in an old form.
I wrote an entire other article on this idea of the farther reaches of post-human experience called “Epitome of Freedom“, which goes into these ideas a bit more (albeit the article was written some 4-5 years back).
Not surprisingly, Emerson has clothed this thought in words better than I can:
“Man, made of the dust of the world, does not forget his origin; and all that is yet inanimate will one day speak and reason. Unpublished nature will have its whole secret told. Shall we say that quartz mountains will pulverize into innumerable Werners*, Von Buchs*, and Beaumonts*; and the laboratory of the atmosphere holds in solution I know not what Berzeliuses* and Davys*?”
––Ralph Waldo Emerson, from ‘The Uses of Great Men‘
(*Emerson is referencing some of the eminent scientific thinkers of his era)
That “reaching” tendency in humanity – in nature itself – isn’t something we can expect to go away as we enter new substrates. I suspect that as with other technologies, the process will only speed up.
“Mortals, amongst themselves, live by turns, and, like the runners
in the games, give up the lamp, when they have won the race, to the
next comer.”—Lucretius, De Rerum Natura, ii. 75, 78.
I’m not sure what we’ll be handing the baton to next, but it seems prudent to think that hand-off through as ardently as we damn well can.
As a sidebar, absolutely all prognostications about mind uploading are nothing but speculation, and it’s clear that Black Mirror’s creators wanted to drive home a (mostly skeptical) point. With that end in mind, making a happier digital afterlife wouldn’t make for a good story, and an experience one beyond human comprehension is by definition not something we can imagine (and so also wouldn’t make for a good show).
For those reasons, putting “right” and “wrong” in the title of this article isn’t justified – but it was the only way to keep the title within a reasonable range of characters. They explored what I consider to be an tremendously important technology in an important light.
I’m not a betting man, and I’ve never been a “Futurist” (it feels too much like calling oneself a philosopher or poet, an icky kind of immodesty), but if I were a betting man, here’s what I’d bet on as the phases of change once mind uploading becomes viable. In order:
Maybe there will be an end to it. A finish line, the embrace of some all-knowing God that is happy that we passed the painful test of evolving from amoebas to Christ and Confucius to some kind of deity-like superintelligence capable of comprehending it all.
Probably not, I suspect.
There are probably just more questions, more to explore – all the way until this universe or all possible universes cease. There’s a chance that there’s a “point” to it all… but more likely the “point” would be to see and know more in order to discern what to do. The grandest “What to do?” questions will likely be answered be something beyond current humanity.
We come back to Bacon, and to the sense of urgency in figuring our what is actually going on in this often confusing and painful jumble of experience that is life:
“My only earthly wish is… to stretch the deplorably narrow limits of man’s dominion over the universe to their promised bounds… [nature will be] bound into service, hounded in her wanderings and put on the rack and tortured for her secrets.”
–– commonly attributed to Sir Francis Bacon
If it sounds like the man is railing against a tormented existence then… yeah… that’s exactly what he’s doing here.
Certainly there are beautiful aspects of our fleeting lives, enough for most of us to not take our own lives, and enough for many of us to report being happy or fulfilled.
I suppose we should be grateful we weren’t born as an earthworm or algae and we have the mental horsepower to at least think our way through what’s next, what’s beyond this condition and where we should go from here in terms of the trajectory of consciousness and intelligence itself. In my opinion the “what’s after people” question is the most ethically relevant question there is.
That’s something, at least. At least there’s something to work on.
In my writing about superintelligence, I often openly wonder about the values, ideals, and preferences of such an entity. In fact, my initial series of interviews with ancient philosophy professors…
As humans, learning often feels good, food often tastes good, novelty brings joy to life, living by values that we set brings order to our consciousness, and besides very few…
This article was written as an exploration – and has no initial agenda or objective outside of discovering potential interesting connections through a look at transhumanism through the lens of…
Seneca, Epictetus, Aurelius – even westerners unfamiliar with “Stoicism” recognize many of the names that brought this Philosophy to bear. Today, there are few self-professed Stoics in the world, but…
In the very first part of this 2007 article, Nick Bostram of the Future of Humanity Institute at Oxford writes: Traditionally, the future of humanity has been a topic for…
I’ve gotten my hands on a new copy of Human Enhancement, edited by Julian Avulescu and Nick Bostrom, and the first article I chose to delve into was titled: “Enhancements…