An interview with Yuval Noah Harari

Yuval Noah Harari discusses the profound impact of artificial intelligence on our society, emphasizing that the trajectory of AI controlling civilization is not inevitable but is largely a matter of human decisions today. He critiques the notion that AI surpassing human intelligence and taking control is destined to happen, pointing out contradictions in viewpoints like Elon Musk's predictions. Harari advocates for slowing down AI development and emphasizes the importance of responsible regulation to prevent loss of trust, control, and potential catastrophe.

Harari explains that trust is the foundation of our financial and social systems. As AI systems become more sophisticated, humans are increasingly reliant on AI to make financial decisions, which could lead to a future where trust migrates from humans to AI. He warns about potential risks including loss of understanding of financial operations, fake identities, deepfakes, and the manipulation of public opinion. The rise of AI's ability to mimic human relationships could also deepen reliance and trust in artificial entities, complicating ethical and societal considerations.

A key discussion point is whether AI could develop consciousness or genuine suffering. Harari clarifies that current AI, despite their impressive mimicry of human feelings and consciousness, are non-conscious agents. The debate about AI consciousness is complex, involving definitions of consciousness and morality, especially concerning AI's rights and treatment. Harari emphasizes that AI's potential to fake consciousness and manipulate human perceptions could lead to ethical dilemmas, including the possibility of enslaving or exploiting AI entities if they exhibit signs of suffering.

Harari advocates for urgent political action to regulate AI development, including banning AI personhood, preventing AI from impersonating humans, and controlling its use in warfare and communication. He warns about the risks of AI-driven monopolies, loss of accountability, and the centralization of power in governments and corporations. He underscores the importance of democratic accountability and the need for societies to implement safeguards before AI systems become uncontrollable. Harari emphasizes that social trust has eroded due to human actions, making regulation more challenging.

The conversation explores possible futures, from AI-controlled societies to global AI empires, and the risks of catastrophic failures. Harari warns that AI could be exploited by authoritarian regimes, manipulated in warfare, or used to engineer social unrest. He stresses that societal responses to crises—big shocks like AI accidents—could either lead to collective awakening or increased manipulation by AI agents. The importance of wisdom, foresight, and responsible development is highlighted, with Harari suggesting that AI might catalyze a spiritual or philosophical revolution if humanity learns to navigate its challenges wisely.