The Last Guardrail for AI: Magnifica Humanitas
Even the language of geopolitics has begun to change. Following discussions between Donald Trump and Xi Jinping, the two powers locked in their own AI race, the word “guardrails” emerged.
COMMENTARIES
Asanga Abeyagoonasekera
6/10/20265 min read
Pic: Pope Leo XIV signed his first encyclical, ‘Magnifica Humanitas:’ On Safeguarding the Human Person in the Time of Artificial Intelligence, on May 15, 2026, the 135th anniversary of the encyclical ‘Rerum Novarum’ by Pope Leo XIII. ‘Magnifica Humanitas’ was released on May 25, 2026. | Credit: Vatican Media.
In the quiet glow of a screen in Washington, a man continued to speak long after his body had left the room.
At The Millennium Project, Jerome C. Glenn has created his digital twin. The face appears, the voice answers questions with unsettling precision. I spoke to it about South Asia, about the fractures of democracy, about the anxieties I had collected from villages and capitals stretching from Colombo to Bangkok. The machine answered without hesitation. It knew the reports. It understood the data. It spoke with the calm certainty of a man who had spent decades studying the future.
And yet halfway through the conversation, fear arrived.
Not the fear of malfunction, but the fear of perfection.
The responses were too coherent, too immediate, too detached from the hesitations that make us human. A person pauses. A person doubts. A person carries silence between thoughts. The machine did not. It spoke as though certainty itself had become automated.
Perhaps this is the beginning of our new century: not with a scream, but with the disappearance of uncertainty.
Digital twins are not yet AGI, but they already blur the boundary between human presence and machine simulation.
For years, Glenn has warned that Artificial General Intelligence cannot be treated as another ordinary technological transition. The language emerging from his work—guardrails, governance, oversight, anticipatory ethics—was once dismissed as speculative caution. Today it sounds less like theory and more like survival. From Shanghai to Tokyo to Washington, he has argued that civilization is approaching a threshold where intelligence may cease to remain exclusively human.
History is full of inventions that altered civilization. Fire, electricity, the atom. But AGI is different because it approaches the one territory people believed belonged only to themselves: cognition. It does not merely extend human power. It imitates the human mind.
And every imitation contains the possibility of replacement.
The wars in Ukraine and the Middle East have already shown the first shadows of this transformation. Autonomous targeting systems. Drone warfare guided by algorithms. Machine-assisted killing executed with distance and efficiency. Hundreds die, yet responsibility becomes increasingly abstract, dispersed between code, operators, and systems. Violence no longer arrives only through ideology or rage. It arrives through optimization.
Now the relationship between war and artificial intelligence is becoming more explicit. Anthropic ’s AI model Claude was reportedly integrated into the Palantir Technologies Maven system by the United States Department of Defense during the ongoing conflict involving Iran. Pentagon Chief Information Officer Kirsten A. Davies confirmed during a Senate hearing that the system was being deployed as part of Operation Epic Fury. The battlefield is no longer merely physical terrain. It is computational terrain. Decisions once slowed by deliberation increasingly move at machine speed.
Even the language of geopolitics has begun to change. Following discussions between Donald Trump and Xi Jinping, the two powers locked in their own AI race, the word “guardrails” emerged. “We talked about possibly working together for guardrails on AI,” Trump told reporters aboard Air Force One. It was a rare recognition that rivalry alone cannot govern technologies capable of destabilizing civilization itself. States may compete, but intelligence without limits threatens all sides equally.
There is irony in this. Nations divided by borders and ideology may only discover cooperation when confronted by a machine that recognizes neither.
In 1891, Pope Leo XIII issued Rerum Novarum, defending the dignity of labor during the Industrial Revolution. The machine had begun replacing the worker, and the Church intervened to remind the world that economic progress without moral value becomes decay.
Now, 135 years later, Pope Leo XIV confronts a different revolution. His recent reflection on AI, Magnifica Humanitas, arrives as a warning to a civilization drifting toward technological absolutism. If Rerum Novarum defended the dignity of labor, this new appeal defends the dignity of consciousness itself.
The relationship between religion and science has never been peaceful. It is a history marked by suspicion, resistance, and uneasy reconciliation. Galileo Galilei’s telescope became dangerous not because it distorted truth, but because it revealed a universe larger than inherited belief. Yet history turns quietly. Centuries later, it is the Vatican itself warning society against another form of unrestrained discovery. The conflict is no longer between faith and science, but between wisdom and power.
The Pope invokes the biblical story of the Tower of Babel—humanity united by one language, attempting to reach heaven through its own ambition. God scatters the people across the earth, not merely as punishment, but as preservation. Diversity becomes protection against concentrated power.
Today technology has become a universal language. Screens homogenize culture. Algorithms flatten difference. People increasingly consume identical symbols, identical desires, identical fears. The machine promises connection while quietly producing conformity.
The warning from the Vatican arrives at the precise moment when futures institutions like The Millennium Project argue that AGI governance is no longer optional. Thousands around the world have supported calls demanding restraint, oversight, and international cooperation. They are not enemies of innovation. They are witnesses to acceleration.
What makes the present moment dangerous is not only the speed of AI development, but the weakness of social preparation.
Long before AGI arrives, societies are already struggling to govern the digital systems shaping everyday life. Children and adults alike move endlessly through streams of images, short videos, and algorithmic persuasion. Attention itself has become colonized. Behind every screen stand hidden persuaders—platform designers, advertisers, political actors—guiding emotion with remarkable precision. Many consumers lack the intellectual habits needed to distinguish nourishment from manipulation.
This erosion of judgment is no longer abstract. At the upcoming INCWP Conference on Blurred Morality in Thailand, scholars and practitioners will confront a similar question: what happens when societies lose the principles that once guided restraint? The danger is not simply that machines become intelligent, but that people gradually weaken their own inner moral compass while surrendering decision-making to systems designed for efficiency rather than wisdom.
A civilization unable to govern social media will struggle profoundly to govern superintelligence.
I remember Glenn once telling me, almost casually, “Get used to losing your job.”
He was not speaking cruelly. He was speaking historically.
As a geopolitical risk analyst, I understood immediately that much of what I do—pattern recognition, forecasting, synthesis—can eventually be replicated by machines. That realization changed the way I approached my recent research for Winds of Change. I travelled more. I listened more carefully. I sat with people individually, not merely as data points but as human presences.
A displaced worker in Colombo. A family fractured by political instability. A citizen caught between great power rivalries. These realities cannot be fully understood through datasets alone. Suffering possesses texture. Emotion carries context. Culture breathes through pauses, gestures, memory, and silence. Machines may eventually simulate empathy, but simulation is not experience.
That distinction still matters.
The great danger of AGI is not necessarily extermination. It may be irrelevance. Civilization could slowly surrender judgment to systems more efficient than itself, until moral agency becomes outsourced entirely. Society would continue functioning, but without conscious depth at its center.
This is why guardrails matter. Not to reject technology, but to govern transition before transition governs us. Recent work on AGI governance argues that the critical moment is not after superintelligence emerges, but now, while moral guidance remains possible. The AGI report outlining many of these governance proposals is available through UNCPGA AGI Report.
Responsibility begins before certainty.
The question before civilization is no longer whether AGI will arrive. It is whether wisdom will arrive first.
At the edge of a greater intelligence, the challenge is not to remain dominant.
It is to remain human.
Asanga Abeyagoonasekera is a Senior Fellow at the Millennium Project Washington DC. He is the author of Winds of Change(2026) published by World Scientific Singapore. Initially published at South Asia Journal.
