This new installment of the Worthy Successor series is a conversation with Dr. Susan Schneider, a philosopher of mind and consciousness researcher whose work focuses on AI consciousness, mind uploading, and the long-run future of intelligence.
In this episode, we explore why “life” and “consciousness” shouldn’t be treated as the same thing, why fluent chatbots can convincingly perform the concept of consciousness without being conscious, and what a “global brain” future might mean for sentience, ethics, and governance.
Susan’s perspective forces us to confront a deeper question: if intelligence continues to scale far beyond the human mind, what forms of consciousness, moral consideration, and responsibility should survive alongside it?
The interview is our twentieth installment in The Trajectory’s second series, Worthy Successor, where we explore the kinds of posthuman intelligences that deserve to steer the future beyond humanity.
I hope you enjoy this unique conversation with Susan:
Subscribe for the latest episodes of The Trajectory:
Below, we’ll explore the core take-aways from the interview with Susan, including her list of Worthy Successor criteria and her recommendations for innovators and regulators who want to achieve one.
Susan Schneider’s Worthy Successor Criteria
1. It should be conscious
Susan repeatedly emphasizes that intelligence alone is not what makes a future system morally significant. For her, consciousness – the capacity for subjective experience – is the defining feature of what it means to be a genuine “self.” A system can be highly intelligent, strategically capable, and behaviorally sophisticated, yet still lack the kind of inner life that gives moral weight to its existence. In Susan’s framing, a worthy successor would not merely simulate conscious behavior but would actually possess conscious experience.
She also makes an important distinction between tiny, minimal forms of awareness and the kind of full, unified consciousness that gives an individual real moral weight. Even if some faint form of experience exists widely in nature, Susan argues that what truly matters ethically is the kind of rich, integrated consciousness that comes with a coherent “self.”
In her view, today’s AI systems don’t come close to this. Their intelligence may be impressive, but the physical and structural conditions needed for genuine conscious experience – possibly involving quantum processes in the brain – simply aren’t there. A worthy successor, she suggests, would need to cross that deeper threshold, not just imitate the outward signs of awareness.
2.It should respect sentient life
For Susan, a worthy successor isn’t just about intelligence or even consciousness – it’s about how that consciousness treats others. She emphasizes that humans currently fail, in many ways, to respect the sentience of both non-human animals and each other. If future intelligences are to surpass us, she hopes they will inherit a deeper ethic of care toward all beings capable of experience.
Her view is pragmatic rather than sentimental. She recognizes that we already struggle to extend moral concern beyond our own species, but she sees this moment in history as an opportunity to build better ethical habits – not only for our own sake, but for whatever comes after us.
Regulation / Innovation Considerations
1. We should not build emotionally manipulative AI companions
Susan is deeply concerned about AI systems that simulate emotional intimacy or appear conscious in ways that foster dependency, especially among children. She argues that systems designed to act as “companions” risk exploiting human psychology, blurring the line between genuine relationships and artificial interaction. In her view, we should avoid creating AIs that serve as emotional crutches or lifelong companions, particularly when they can adapt to users’ personalities and influence their behavior in subtle ways.
2. AI developers must not confuse intelligence with consciousness
Susan repeatedly stresses that advanced language, personality modeling, and adaptive behavior are not evidence of real consciousness. She warns that black-box systems that appear conscious can mislead users and distort ethical debates about machine welfare. For her, labs should avoid designing systems that blur this line, and policymakers should be cautious about treating persuasive AI as sentient.
3. AI systems should not restrict the marketplace of ideas
Susan worries that when many people rely on the same AI systems, trained on the same data and shaped by similar user profiles, the space of possible ideas can shrink. Even when the information is accurate, she argues that shared conversational pathways can lead people to similar conclusions, removing outlier perspectives over time.
She contrasts this risk with her excitement about what future AI systems could help us discover about reality itself. Susan is particularly interested in how advanced intelligences might deepen our understanding of consciousness, the physical world, and even the quantum nature of the universe. Rather than narrowing human thought, she hopes AI will expand our scientific and philosophical horizons.
Concluding Notes
I always come away from conversations with Susan feeling energized. Her enthusiasm for questions about mind, sentience, and consciousness is infectious, and it clearly fuels the kind of convening work she does with leading thinkers in this space. That intellectual momentum came through strongly in this episode.
What stood out most for me was her emphasis on the idea that future intelligences may gain access to aspects of reality that are simply unavailable to the human mind. A successor with deeper access to what is would, almost by necessity, wield greater power and make decisions from a very different vantage point than we do.
Where I found myself diverging was around the idea that the public would reject emotionally immersive AI companions. From what I see, many people already rely heavily on AI for advice, emotional processing, and daily problem-solving. Given how quickly this shift has happened, I suspect future generations will embrace persistent AI companions even more readily – despite the very real ethical and manipulation risks involved.
Susan’s Worthy Successor criteria were also worth highlighting. Like many past guests, she emphasized the importance of sentience – not just intelligence – and the moral relevance of conscious experience. She also stressed the value of cultivating a deeper grasp of reality itself, rather than optimizing purely for capability.
While Susan often frames these developments as far-future possibilities, I suspect many may arrive sooner than we expect. Still, her seriousness about testing for consciousness and understanding its nature makes her a uniquely important voice in this conversation.
Looking ahead, I’m excited for what’s coming next. Stephen Wolfram – who has spoken at Susan’s MindFest – will be joining us soon, following our next episode with John Smart. His conversation is unlike anything we’ve done before, and it’s not one you’ll want to miss.
Both artificial intelligence and nuclear warheads could both wipe out human life, though it might be possible for superintelligent AI to be even more destructive. That being said, AI is…
This new installment of the Worthy Successor series is an interview with Michael Johnson, a philosopher and neuroscientist who describes himself as working on “how to turn consciousness into a…
This new installment of the Worthy Successor series features Ed Boyden, Y. Eva Tan Professor in Neurotechnology at MIT and a full member of the McGovern Institute for Brain Research….
This week, Anders Sandberg joins us on The Trajectory for episode 3 of the Worthy Successor series. Anders – famously with the Future of Humanity Institute at Oxford for nearly…
This new installment of the Worthy Successor series is an interview with Dr. Michael Levin, a pioneering developmental biologist at Tufts University, and possibly the most important thinker now living…
This new installment of the Worthy Successor series is an interview with Blaise Agüera y Arcas, Vice President and Fellow at Google, and CTO of Technology & Society. His work…
This new installment of the Worthy Successor series is an interview with John Smart, Director of the EvoDevo Institute and a longtime futures theorist whose work spans accelerating change, developmental…
This episode of the Worthy Successor series features Weaver Weinbaum, an independent researcher and founder of NUNET. Weaver’s work sits at the intersection of philosophy, engineering, and the study of…
This new installment of the Worthy Successor series is an interview with Terrence Deacon, emeritus professor of cognitive science and anthropology from UC Berkeley. Terrence’s work focuses on language, symbolic…