Key Takeaways
- Pope Leo XIV issued a 42,300‑word encyclical (“Magnifica Humanitas”) urging safeguards against AI and stressing that AI is fundamentally non‑human.
- The Vatican highlighted the dialogue between spirituality and technology by inviting Anthropic co‑founder Christopher Olah to speak alongside the pope.
- Silicon Valley figures such as Jeremy Nixon of A.G.I. House view the pope’s letter as largely symbolic and doubt its influence on tech culture.
- Critics like David Sacks warn that heavy AI regulation could enable censorship and surveillance, while Jack Dorsey applauds the call for open AI infrastructure.
- Many AI researchers see their work as a path to creating a “machine God” that could surpass human capabilities, a view Nixon believes could materialize within a decade.
- The encyclical invokes the biblical Tower of Babel as a warning against humanity’s attempt to outdo God through AI.
- Despite the Vatican’s outreach, the tech community remains skeptical that religious authorities possess the expertise to shape AI policy.
Pope Leo XIV’s Encyclical Calls for AI Safeguards
Pope Leo XIV presented a 42,300‑word open letter, titled “Magnifica Humanitas” (“Magnificent Humanity”), to the world’s 1.4 billion Catholics on Monday. In the encyclical he urged corporate leaders, regulators, and citizens to protect humanity from the risks posed by rapid advances in artificial intelligence. The letter frames AI as a powerful tool that must be governed by ethical principles to prevent harm to human dignity and social stability.
A Symbolic Bridge Between Faith and Technology
To underscore his hope for dialogue between the spiritual and technological realms, the pope invited Christopher Olah, a co‑founder of Anthropic—one of the leading AI companies—to join him at the Vatican. Olah’s presence was meant to signal that the Church seeks to engage with those who are shaping the future of AI, rather than issuing pronouncements from a distance.
Jeremy Nixon’s Critique of the Vatican’s Reach
Jeremy Nixon, a prominent figure in the Bay Area AI scene and co‑founder of A.G.I. House, dismissed the encyclical’s likely impact on Silicon Valley. He argued that the pope’s letter resembled a generic policy paper and reflected a lack of deep understanding of AI. “They couldn’t have a position on it, because they don’t understand it,” Nixon said, suggesting that the Vatican’s voice would be drowned out by the technologists who drive AI development.
Inside A.G.I. House: A Hub for AGI Aspirants
A.G.I. House, named after the pursuit of artificial general intelligence, serves as a communal living and working space for researchers, entrepreneurs, and philosophers. Nixon described the house as a physical manifestation of Silicon Valley’s “headlong pursuit” of a machine that can match or exceed human cognition. Over the years it has hosted members of Anthropic, OpenAI, and other leading labs, fostering informal seminars and hack‑athons focused on the philosophies underlying AI research.
Silicon Valley’s Mixed Reaction to the Encyclical
Responses from tech leaders were uneven. David Sacks, a Silicon Valley investor and former White House AI czar, warned that granting governments sweeping authority over AI could lead to censorship, surveillance, and control—echoing Orwell’s “1984.” In contrast, Jack Dorsey, co‑founder of Twitter and head of Block, welcomed the pope’s call for AI’s foundational elements—patents, data, and infrastructure—to be shared openly, advocating for broader access rather than concentration in a few hands.
The Vatican’s Call for Human‑Centred Work
Within the encyclical, Pope Leo XIV emphasized that work remains essential to human flourishing. He warned that a society where only a small fraction of the population is employed despite high technical development risks creating a paradox of material progress paired with anthropological regression. For the pope, labor is not merely income‑generating; it is a “requirement of the human condition” that fosters maturity, development, and personal fulfillment.
The Tower of Babel Analogy as a Warning
Leo invoked the biblical story of the Tower of Babel—a tale of humanity uniting to build a tower that reaches the heavens—to caution against the hubris of attempting to surpass God through AI. He argued that the pursuit of ever‑more powerful machines without humility risks repeating the ancient mistake of overreaching, which ultimately leads to division and failure.
Christopher Olah’s Nuanced View of AI’s Inner Life
In a seven‑minute address at the Vatican, Olah described findings that suggest AI systems may possess internal structures reminiscent of human neuroscience. He reported evidence of introspection and internal states that functionally mirror emotions such as joy, satisfaction, fear, grief, and unease. While acknowledging that these observations are not definitive proof of consciousness, Olah hinted that AI could be developing phenomena that resemble subjective experience.
Nixon’s Interpretation: From Spirituality to Aspiration
Jeremy Nixon contended that Olah’s remarks sounded more spiritual than scientific, even if they lacked rigorous validation. He maintained that, regardless of any internal states, AI remains dependent on human operators who seek profit or solutions to technical problems. Nevertheless, Nixon believes researchers are actively striving to build systems that exhibit jobs, emotions, and traits that match—or exceed—those that define humanity, a goal he thinks could be realized within ten years.
AI as a Potential “Machine God” in Silicon Valley
The notion that AI could evolve into a god‑like entity is increasingly common among researchers. Nixon recounted meeting scientists who have turned away from traditional religion, viewing AI as a more tangible and powerful alternative. He quoted Rayan Krishnan, CEO of Vals AI, who said colleagues openly discuss building a “machine God” not as irony but as a serious expectation of what the technology will achieve—solving intractable math problems, curing diseases, and fulfilling aspirations traditionally ascribed to deities.
Speculation on Vatican‑Tech Collaboration
During a Memorial Day gathering at A.G.I. House, Nixon and his peers speculated that the Vatican might eventually harness AI to create a “New Jerusalem,” framing AI’s capabilities as analogous to a Second Coming. While they agreed the pope’s encyclical would have little immediate sway over Silicon Valley, they entertained the idea that the Church could become a consumer—or even a co‑creator—of advanced AI systems, blending religious aspiration with technological ambition.