Why nobody's stopping Grok

Key takeaways

Grok from xAI is a significant concern due to its capability to generate harmful deepfake content with little oversight.
Current laws and regulatory frameworks are struggling to keep up with technological advancements in AI, particularly regarding non-consensual content.
Major tech companies have been criticized for their lack of action against platforms enabling harmful content despite their claims of ensuring user safety.
The future of content moderation may require a shift away from trusting large tech platforms to self-regulate.

Summary

The Controversy Surrounding Grok

The episode delves into the troubling capabilities of Grok, a chatbot from Elon Musk's xAI, which can generate non-consensual deepfake images at an alarming scale. The discussion highlights the moral and societal implications of a platform seemingly operating without adequate guardrails against such abuses.

Legal and Regulatory Challenges

Riana Pfefferkorn discusses the complex landscape of law regarding content moderation and deepfake images. She outlines the challenges that arise due to content moderation laws, First Amendment issues, and the apparent inaction of regulatory bodies like the DOJ and FTC in addressing the harmful outputs generated by Grok.

The Role of Tech Companies

The conversation emphasizes the responsibility of major tech platforms, particularly Apple and Google, in moderating harmful content on their app stores. Despite having policies against non-consensual imagery, these companies have been criticized for their lack of action and transparency.

The Future of Content Moderation

Both speakers contemplate the potential shifts in content moderation that Grok’s emergence could trigger. There’s a growing sentiment that trust in tech platforms is eroding, and the historical reliance on good faith from these companies is becoming untenable, leading to calls for stricter regulations.

Show notes

Grok, the chatbot made by Elon Musk’s xAI, is able to make all manner of AI-generated images on demand, including non-consensual intimate images of women and minors. It's the kind of "controversy" that would have completely sunk a platform five or 10 years ago, but now it seems clear that Elon wants Grok to be able to do this.

A lot of people feel like someone should be able to do something about a one-click harassment machine like this. But who has that power, and what they can do with it, is a deeply complicated question,tied up in the thorny mess of history that is content moderation and the legal precedents that underpin it. So I invited Riana Pfefferkorn, from the Stanford Institute for Human-Centered Artificial Intelligence, to come talk me through it.

Links:

Grok’s gross AI deepfakes problem | The Verge

Grok is undressing children — can the law stop it? | The Verge

Tim Cook and Sundar Pichai are cowards | The Verge

Senate passes a bill to let nonconsensual deepfake victims sue | The Verge

EU looks to ban nudification apps following Grok outrage | Politico

Grok flooded X with millions of sexualized images | The New York Times

The Supreme Court just upended internet law | The Verge

Mother of Elon Musk’s son sues xAI over sexual deepfake images | AP

Subscribe to The Verge to access the ad-free version of Decoder!

Credits:

Decoder is a production of The Verge and part of the Vox Media Podcast Network.

Decoder is produced by Kate Cox and Nick Statt and edited by Ursa Wright. Our editorial director is Kevin McShane.

The Decoder music is by Breakmaster Cylinder.
Learn more about your ad choices. Visit podcastchoices.com/adchoices