by Dan | Mar 11, 2019 | Exploring the End Game, Facilitating Post-human Transition Collaboration
The human race has two critical questions to answer in the 21st century: 1. What is a beneficial transition beyond humanity? 2. How do we get there from here without destroying ourselves? These questions presuppose the following hypotheses: Humanity will likely...
by Dan | Mar 9, 2019 | Digitized and Digested
“Sugar cubes” – Refers to the tiny hypothetical form that human mind uploads might take when they are condensed and stored. These small cubes of computational substrate would likely contain more than our human senses, memories, and consciousness...
by Dan | Mar 8, 2019 | Controlling Intelligent Substrate, Morality as Arbitrary and Contextual, The Good Must Be Explored, Transhuman Transition
The AI value alignment argument goes something like this: As artificial intelligence will continue to approach human-level intelligence Artificial intelligence will generally be driven by a reward function, by a kind of abstract goal Any such goal could have...
by Dan | Mar 3, 2019 | Exploring the End Game, Managing the Transhuman Transition
Many renown technology pundits, entrepreneurs, and inventors have posited a similar vision of an artificial intelligence-enabled future: Artificial intelligence and other future technologies will amass tremendous wealth in the hands of a few powerful, dominant...
by Dan | Feb 4, 2019 | Consciousness is What Counts, Managing the Transhuman Transition
Nick Bostrom’s 2007 TED presentation (titled: Humanity’s biggest problems aren’t what you think they are) involved an illustration that I liked so much that I modeled it – and credited Bostrom – in my first TEDx back in late 2014. I present a...
by Dan | Jan 9, 2019 | Discerning the Good Itself, Reflecting on What I've Read, The Good Must Be Explored
What matters most? If we have a reasonable chance of building conscious AI and/or post-human intelligence in the next 60 years, it makes sense for us to consider where we’re headed. If we presume we have any control over our fate at all – where will we point the...
by Dan | Dec 30, 2018 | Amoral Solipsism, Facilitating Post-human Transition Collaboration, Reflecting on What I've Read
During my most recent UN speaking engagement in Shanghai, I wasn’t able to access Google (or my email), and was left with only a few books and the tabs I had open. One of those tabs was a blog post from Andres Gomez Emilsson, which I’m glad I had opened...
by Dan | Dec 23, 2018 | Discerning the Good Itself, Morality as Arbitrary and Contextual
What is the “meaning” of the Singularity? If we look forward to the potential trajectories of intelligence and sentience, we wonder: Where is the future taking us? What does the future “want”? Some people have posited theories about the meaning...
by Dan | Oct 21, 2018 | Creating or Enhancing Consciousness, Exploring the End Game, Glossary, Managing the Transhuman Transition
The “Grand Trajectory” refers to the direction of development of intelligence and sentience. If the following two hypotheses are true: The moral worth of an entity can be measured – as best we can – by the richness of its intelligence and...
by Dan | Sep 16, 2018 | Glossary, Morality as Arbitrary and Contextual
Alexander the Great had enough time in his 32 years to accomplish many objectives. Defeating the Persian empire, conquering the Hellenic world and large swaths of India, and so on. Succession planning, as it turns out, hadn’t been much a priority for the...
