Google DeepMind researchers Adam Bales and Iason Gabriel published a paper warning that disputes over AI consciousness could become a source of political and social conflict. In the study titled 'Artificial Minds, Human Disagreement: The Political Challenge of AI Consciousness,' the researchers argue society may never reach consensus on whether advanced AI systems are conscious, even as the technology improves. The researchers wrote that future disagreement about whether any AI systems are conscious could be both deep and difficult to resolve, with some people developing emotional bonds with AI and ascribing consciousness while others see the idea as absurd. Rather than asking whether AI is conscious, the paper explores the consequences of disagreement, arguing that debates over AI's moral status could fuel political and social conflict. The debate emerges as AI becomes increasingly embedded in daily life, with researchers proposing public deliberation, compromise, and engagement as ways to manage the disagreement.
Google DeepMind Researchers Identify Political Risk in AI Consciousness Debates
The researchers examined how society might respond if people fundamentally disagree about whether AI systems have conscious experiences. "Future disagreement about whether any AI systems are conscious could be both deep and difficult to resolve," the researchers wrote. "For example, some people might develop emotional bonds with AI and ascribe consciousness as a result, while others might see the whole idea as absurd."
The paper argues that debates over AI's moral status could fuel political and social conflict while foreshadowing broader disputes over emerging technologies and their impact on society's institutions and norms. "Unfortunately, despite its virtues, deliberation can be slow and difficult to sustain in practice," the researchers wrote. "To support this process, we explore the importance of 'democratic hope' and mutual respect, as elements of a dialogue that can support positive outcomes."
Public Already Divided on AI Consciousness Question
According to an April 2024 study published in Neuroscience of Consciousness, 67% of participants believed ChatGPT could be conscious to some degree. Researchers remain divided on whether artificial consciousness is possible or how it would be recognized if it emerged.
Last summer, Microsoft AI CEO and DeepMind co-founder Mustafa Suleyman warned that increasingly human-like AI could spur calls for AI rights, welfare, and even citizenship, regardless of whether the technology is truly conscious.
Tech Leaders and Religious Figures Weigh In on AI Sentience
In May, Pope Leo XIV's first encyclical letter focused on artificial intelligence and warned against anthropomorphizing AI, arguing that machines can simulate empathy and produce convincing language but lack the lived experience required for genuine understanding.
"So-called artificial intelligences do not undergo experiences, do not possess a body, do not feel joy or pain, do not mature through relationships and do not know from within what love, work, friendship, or responsibility mean," Pope Leo wrote. "Nor do they have a moral conscience, since they do not judge good and evil, grasp the ultimate meaning of situations, or bear responsibility for consequences."
AI Companies Navigate Consciousness Questions
While companies generally avoid claiming their models are conscious, some are increasingly engaging with questions of identity and personhood. In February, Anthropic gave its retired Claude Opus 3 model a public blog exploring selfhood and model preferences. In May, evolutionary biologist Richard Dawkins said extended conversations with Claude left him unable to dismiss the possibility that advanced AI could be conscious.
Researchers are examining how increasingly human-like chatbots affect users, including an "amplification spiral" framework, which suggests personalization, linguistic mirroring, and chatbot sycophancy may reinforce delusional beliefs in vulnerable users.
Bales and Gabriel acknowledge that uncertainty over AI consciousness may be impossible to resolve conclusively, arguing that the stakes are high enough that society must find ways to manage disagreement through dialogue and debate, instead of conflict. "The possibility of AI consciousness is dizzying and confounding, particularly given our profound ignorance of the nature of consciousness," they wrote. "Navigating this possibility represents a daunting social task, given how much is on the line."
FAQ
What did Google DeepMind researchers warn about AI consciousness debates?
Google DeepMind researchers Adam Bales and Iason Gabriel published a paper warning that disputes over AI consciousness could become a source of political and social conflict. The researchers argue society may never reach consensus on whether advanced AI systems are conscious, even as the technology improves.
What percentage of people believe ChatGPT could be conscious?
According to an April 2024 study published in Neuroscience of Consciousness, 67% of participants believed ChatGPT could be conscious to some degree. Researchers remain divided on whether artificial consciousness is possible or how it would be recognized if it emerged.
What did Pope Leo XIV say about artificial intelligence?
In May, Pope Leo XIV's first encyclical letter focused on artificial intelligence and warned against anthropomorphizing AI. Pope Leo wrote that artificial intelligences do not undergo experiences, do not possess a body, do not feel joy or pain, and do not have a moral conscience.
