AGI and the Final Kingdom
In history, we are reminded that all is in flux. America is likened to Rome. China today is likened to the Tang Dynasty many centuries ago. Europe was pure barbarity,…
This post is not intended as an article, but as an opportunity to define a term I often refer to in talks and essays. For more context on these essays, see the reference links below.
We might define the eternal hominid kingdom as:
Any desired future where humans or hominid-like entities continue to be the most powerful and/or morally valuable species in existence.
There are some people who wish to either prevent the emergence of AGI or ensure that all permutations of AI are merely tools of humanity. Some of these people believe that, even a million or billion years into the future, the best possible future is one where humans “run the show,” where no species of entities with greater potentia exist (or if they do exist, they completely serve man).
I argue that this eternal hominid kingdom goal is potentially bad for humanity (a single torch), and is almost certainly bad for life itself (the flame, of which humanity is but part). I explore why I believe these things in the essays below:
Header image credit: Charlene Costanzo
In history, we are reminded that all is in flux. America is likened to Rome. China today is likened to the Tang Dynasty many centuries ago. Europe was pure barbarity,…
“Wow, I can’t wait for AGI! We’re about to be rich! Yay, Santa Claus is coming to town!” This is the sentiment of a child. Naive, irrational, and wholly at…
If humanity is able to achieve artificial general intelligence (AGI), it is unanimously seen as good that humanity should be permitted to do whatever it chooses. For example: Some humans…
“It is the mark of an educated mind to be able to entertain a thought without accepting it.” – Aristotle Many who would read those words and smile confidently, knowing…
Given a long enough time horizon, all things (individuals, species, forms) die out completely or transform into something else. Lucretius and the second law of thermodynamics concur here. In this…
This is an interview with Joshua Clymer, a technical AI safety researcher at Redwood Research. Before that, he researched AI threat models and developed evaluations for self-improvement capabilities at METR….
In business, blindly assuming you’ll be profitable is a recipe for bankruptcy. In the outdoors, blindly assuming you’ll find water and shelter is a recipe for death. And yet, many…
This is the first episode in our new Early Experience of AGI series – where we explore the subtle signs of AGI’s rise long before its dominance is declared. This…
Since the publication of the Worthy Successor essay in 2023, I’ve been glad to see the enthusiasm around exploring posthuman futures from people in tech and policy (especially on Twitter,…