AGI ≠ Santa Claus
“Wow, I can’t wait for AGI! We’re about to be rich! Yay, Santa Claus is coming to town!” This is the sentiment of a child. Naive, irrational, and wholly at…
Nothing I’ve ever said is remotely unique.
My entire Cause, my entire reason for being around discerning and moving towards a Worthy Successor (and the expansion of Potentia), my entire perspective on the flame of life continuing beyond man — is just downstream from reading Emerson’s Circles essay.
Follow these two steps and you’ll more or less land where I have landed with regards to the possibilities and inevitability of the posthuman transition:
That’s it.
There isn’t much where you’ll say “Wow, how did Dan come up with THIS?!”
You’re more likely to say “Yeah, okay, basically Dan is just extrapolating Emerson’s conclusions.”
Some of the specifics of what I think we should do about AGI / posthuman transition governance aren’t directly from Emerson. But even those molded pretty directly by Montaigne and Al-Rodhan’s wise and rightfully amoral perspectives on human nature. Read them and you can anticipate all of me. I don’t even add any useful ingredients, really.
I wish I could say that I’m a conduit (see Virtue of a Pipe) to something uniquely from my own special genius, but it isn’t true. I play a lesser role – and I’m well aware of my lowliness. But I play my little role.
“Wow, I can’t wait for AGI! We’re about to be rich! Yay, Santa Claus is coming to town!” This is the sentiment of a child. Naive, irrational, and wholly at…
If humanity is able to achieve artificial general intelligence (AGI), it is unanimously seen as good that humanity should be permitted to do whatever it chooses. For example: Some humans…
“It is the mark of an educated mind to be able to entertain a thought without accepting it.” – Aristotle Many who would read those words and smile confidently, knowing…
Given a long enough time horizon, all things (individuals, species, forms) die out completely or transform into something else. Lucretius and the second law of thermodynamics concur here. In this…
This is an interview with Joshua Clymer, a technical AI safety researcher at Redwood Research. Before that, he researched AI threat models and developed evaluations for self-improvement capabilities at METR….
In business, blindly assuming you’ll be profitable is a recipe for bankruptcy. In the outdoors, blindly assuming you’ll find water and shelter is a recipe for death. And yet, many…
This is the first episode in our new Early Experience of AGI series – where we explore the subtle signs of AGI’s rise long before its dominance is declared. This…
Since the publication of the Worthy Successor essay in 2023, I’ve been glad to see the enthusiasm around exploring posthuman futures from people in tech and policy (especially on Twitter,…
As the AGI race intensifies, it brings to bear more questions about what humanity’s role is in the future of life and intelligence. People ask: “How can we stay alive?”…