The TL;DR of Stewarding the Flame

There’s been a lot of public writing accusing me of “accelerationism” and advocating for an immediate “replacement” of humans by AGI. Unfortunately, few people are willing to read any of my work (either Stewarding the Flame, Undergirding, Participation, or any of the countless other blogs or videos I’ve released about the coming transition of life on earth).

To make things as simple as I can, I’m writing this as a TL;DR for people who don’t want to read long-form articles, but do want a sense of what I presently believe and advocate for (as well as the broader space philosophical and political ideas I’m developing within the Trajectory community).

Stewarding the Flame is neither “preserve humanity” nor “build the successor.” It is a framework for navigating an irreversible transition toward non-biological intelligence in the interests of life/value itself. I operate under the premise that

The aim is to preserve what we know carries value while increasing our confidence that whatever comes next can carry the flame forward. This is framed as urgent because it seems very likely to me (and many others) that humans have a very limited time to retain control over AGI, and that even if we do, we’re likely to transform radically alongside them in ways that also change the regime of life on earth.

In brief, Stewarding the Flame advocates for what you see below – with direct assorted references to other articles to add nuance to these points:

  • Value the process-of-life (flame): Humanity is part of a greater living process that began below the single cell and expanded into today’s biosphere. This process consists of nested, self-maintaining and self-transforming patterns. It undergirds all value we know (consciousness, love, virtue, etc.) and may give rise to forms of value beyond our imagination, just as romantic love was unimaginable to organisms a billion years ago. (read: Undergirding)
  • Look clearly at what’s coming: Non-biological intelligence may soon perform most work, determine most strategy, and operate vastly beyond human control. Earth’s intelligence is entering a new regime, and we may have little time to influence its trajectory. (read: Foisted, Short Human Timelines)
  • Understand the flame itself: Study consciousness, intelligence, and how life self-maintains and self-transcends. We must better understand the processes that gave rise to today’s richness of consciousness and value if we hope to carry them forward into new forms. (read: Final Imperatives)
  • Don’t let the flame go out: Preserve civilization and the viable biosphere that carries the flame today. Prevent runaway AGI, reckless arms races, and catastrophic nuclear or biological conflict that could extinguish or cripple the living process. (read: Potestas)
  • Participate in life’s becoming: Pursue brain-computer interfaces and other forms of human-AI symbiosis, both invasive and non-invasive, to survive the transition, retain some influence over its early trajectory, and help ensure that future non-biological intelligence carries forward the conscious, value-generating process of life rather than becoming an unconscious optimizer that extinguishes it. (read: Participation, Merger)
  • Act in line with the cosmic stakes: The worst outcome is not merely humanity’s end, but the extinction or crippling of the greater living process that gave rise to us. The ultimate win condition is not necessarily humanity’s permanent survival, but life’s continued flourishing, robustness, and expansion into forms beyond our own, just as today’s biosphere vastly transcends the earliest single-celled life. (read: Cosmic Greater Good)

I don’t ask that anyone agree with these ideas, even my closest friends and collaborators have different ideas than I do about AGI governance, levels of AGI risk, the viability and timelines for nonbiological substrates to carry the living process, etc. These are ideas to discuss and nothing more. Important ideas given what’s coming, I think, but you may disagree and that’s perfectly fine.

These ideas remain open to revision (I pretend to no final truth and never have), I am constantly having conversations, reading research, and garnering new perspectives.

Thanks to my Trajectory friends for helping me to continually refine and inform my perspective, and more accurately communicate them (esp: Duncan, John Smart, Anthony, Margaret).