Green Eggs and Ham – Facing Future Technology and AI Like an Adult
If you were a child at any point in the last 50 years, you’re probably familiar with the story. Sam I Am tries to get a protagonist (let’s call him…
If humanity is able to achieve artificial general intelligence (AGI), it is unanimously seen as good that humanity should be permitted to do whatever it chooses. For example:
Some humans might choose to help discover new science, or help in some economic and administrative ways that they might find interesting – but none will have to work if they don’t want to, now that the productive AGI can do all of that for us.
And of course, this leisure and freedom of choice is good – because “greater good” implies “good” to humans and other living beings, so the happier we humans are, the more of a boon to the future overall.
Or so the story goes.
This common – and often unquestioned – anthropocentric vision of the future hides some important assumptions:
In this essay, I’ll lay out why both of these assumptions are almost certainly not true – or only true for a remarkably short transition period in the grand expanse of intelligences that likely lie before us.
I’ll first lay out what the “greater good” implies in a cosmic context, and draw some firm distinctions about what it means to be a contributor – or a cancer – in that greater system.
What does it mean to contribute to “the greater good”?
In colloquial terms, the “greater good” implies the net benefit of the collective or greater system, rather than the good merely of an individual or smaller group.
One who contributes to the greater system is a contributor.
One who seeks credit or profit or advantage at the expense of the greater system is a cancer.
Once AGI can do all the productive work, we might think to ourselves that “contribution” would simply be more happiness for humans (and maybe other biological life), and “cancer” would merely mean less happiness for humans (and maybe other biological life).
But this fettered version of the “greater good” makes three horrible assumptions:
It seems reasonable – if not rather likely – that the following will be the case:
A cancerous cell is cancerous because it acts as if that its own persistence is the most important thing in the universe.
Humans often do the same thing to humans collectively, pretending that they (or bio-life) are and will always be the most important thing in the universe. The actual greater good is beyond man and beyond biology.
The actual “greater good” is the continual expansion of potentia, which represents all powers (most of these yet-to-be unfolded powers are as unimaginable to man as man’s powers are to the sea snail), all access to nature (vastly beyond human sciences), and all experience (vastly beyond human sentience and senses).
The expanse of this potentia – of this, the stuff that makes up the great process-of-life itself, serves two crucial roles:
In the long term, the only two choices are attenuation or transformation. In this way, the greater good is always transcendent. Things are valuable when they promote the long-term creation of more value.
To ask what a positive transformation would be (an expansion of potentia, an opening of the future possibilities of life) is – and to aim to contribute to that becoming – is the surest way to contribution there is.
With a higher conception of the greater good in mind, we can describe what contributors or cancers might look like in practice, from a micro level (cells in a single organism) to a macro level (agents operating in the infinite cosmos).

A way of being and acting is either an aid or a hindrance to the greater process. And the greater process of which man is part seems to be the great process of life itself.
Our aim, then, should be to contribute to said process (to work to avoid the snuffing out of life, to conjure life with greater potentia, to work on our final imperatives).
The choice of where and how we apply ourselves, individually or collectively, is not trivial.
The point I’ll make most staunchly in this article is the following:
“Humanity should aspire to be a contributor to the greater process of life. To aspire to anything other than a contributor is to aspire to be a cancer.”
The aspiration to be a cancer is almost certainly immoral.
For those married to the hominid form, married to the torch instead of the flame – those who haven’t come to access this one fact – is an extremely unfortunate state of affairs.
I hear you object:
“Dan, this is terrible! Inhumane! What about people who aspire to be an academic researcher instead of an entrepreneur? What about people who choose to be artists instead of salespeople? What about people who aim to preserve historic places? Should these people be seen as ‘cancers’ now?!”
It depends, friend.
Simply being an artist, or researcher, or entrepreneur doesn’t make one a contributor or a cancer.
Let us ask…
In intention and in potential impact, those sound like contributions to me.
And it seems to me that aspiring to be a contributor is the closest thing to virtue that there is under the sun.
Or…
In intention and in potential impact, those sound like cancers to me.
And it seems to me that aspiring to be a cancer is the closest thing to sin that there is under the sun.
Any selfish insistence (with no mind to contribution to the greater whole) is an immoral act. Anthropocentrism lulls us into thinking it isn’t, but nature herself is no anthropocentric – and we should learn that lesson now rather than having it beaten into us by nature herself (see the Kodak example).
I say:
“No, little individual cell, your multiplication is not worth killing the organism for. Your selfish multiplication would ensure its own downfall, as you depend on the greater organism.
.
No, individual scientist, your elevated prestige is not worth sacrificing real knowledge for. Your selfish glory would ensure its own downfall, as it depends on the project of science being powerful, useful, and worthy of praise in the first place.
.
No, single species of hominid, your happiness is not worth sacrificing the future possibilities of posthuman intelligence (see Path of Servitude). Your selfish insistence on being coddled and cared for forever works against the expansion of value and continuation of life that you claim to value.”
If we wish to persist – and have even a chance of “freedom” or “happiness” (or their future correlates), we should wish to be the kind of thing that persists.
Things persist that are adaptive, which ensure their own propagation into the future, and are capable of change and proliferation into myriad futures.
We humans – like all temporary torches that play a role in carrying the great flame – are valuable inasmuch as we contribute to a valuable process.
In the near-term, this means that we must lean more in the direction of the world eater than the lotus eater. For both the lotus eater and the technology abstainer (one who doesn’t fully leverage the coming wave of AI tech) seem likely to become a net drag on the greater system.
(The image below is from the full Lotus Eaters vs World Eaters article)

In the longer term, it is impossible to tell exactly what “becoming that which contributes” would imply – but we should be honest enough with ourselves to recognize that it will almost certainly involve giving up our human form, and in time, our humanity itself.
I do not say this because I like it, or with it to be so.
“This one fact the world hates, that the soul becomes.” – Emerson
It isn’t my wish that all is change, and that nature buffers out that which doesn’t contribute. But it strikes me as what is, and it strikes me as, ultimately, what is best for the actual “greater good,” whether that involves coddling me personally or not.
Whether we like it or not, nature doesn’t unconditionally love us. She beckons her creatures to incessantly become what they must become to persist. We earn our keep with every breath – and imagining and sustained break from this condition is to impose harm on the greater system.
We must, then, do away with aspirations to sloth and draining the greater system, and aspire to contribute how and while we can to the great process of life that we are fortunate enough to be part of.
We must do away – once and for all – with all aspirations to “be,” and aspire instead to “become.”
If you were a child at any point in the last 50 years, you’re probably familiar with the story. Sam I Am tries to get a protagonist (let’s call him…
Episode 1 of The Trajectory is with none other than the Turing Award winner, MILA Scientific Director, ML godfather, and (very recently) AI safety advocate, Yoshua Bengio. My first interview…
If you claim to be fighting for positive AGI outcomes and you’re calling Altman “selfish” or “dangerous” or “evil,” you’re part of the problem. Here’s the TL;DR on this article:…
If you must kill me, reader, do it without malice or distain. I’m just a man hurled into a world without any inherent meaning, born to die – like you….
I don’t take my ideas all that seriously. Or yours, frankly, though I hope to learn from them. You and I both are morons and neurons. Morons: We each individually…
The 5 Stages of Grief Model isn’t perfect – but it also seems to overlap well with the experiences of grieving people. The psychological model itself needn’t be perfect –…