What it's like to be undressed by Grok without your consent

Key takeaways

Iona Fyfe is actively confronting non-consensual image manipulation through advocacy and raising awareness.
Grok, a generative AI tool, poses new ethical challenges around consent and the potential for online harassment.
Social media platforms often lack adequate measures for dealing with misinformation and abusive content.
Activism in the digital age requires navigating the complex dynamics of online platforms while addressing critical social issues.
Legislative frameworks are evolving in response to the growing need for protections against digital harassment and misinformation.

Summary

The Rise of Grok: A New Threat to Online Women

Iona Fyfe, a Scottish folk singer and activist, shares her distressing experiences with Grok, X's generative AI chatbot, which was reportedly used to create sexualized deepfakes of women and girls. As Iona describes, the altered images ranged from problematic to outright horrifying, including examples of her likeness being changed in ways that lacked consent and context. The episode highlights the dangers of evolving AI technologies and the ethical implications of using them to manipulate real people's images.

Activism in the Digital Age

Iona discusses her activism, which has roots in her passion for folk music and extends into social justice issues, particularly focusing on the music industry's response to sexual harassment. She highlights systemic issues of harassment within her genre and the importance of using her platform to advocate for change, using recent statistics on harassment rates among women in the Scottish folk scene to emphasize her points.

Navigating Online Harassment and Consent

The podcast explores the complexities of consent in the digital realm and the emotional toll of online harassment. Iona reflects on the online trolling she has faced due to her political activism and public persona. She brings to light the challenges of reporting misinformation and abusive content on social media platforms, emphasizing the lack of effective responses from companies when such issues arise.

Cultural Commentary and Future Perspectives

As Iona engages with the implications of Grok's misuse, the discussion turns to broader societal questions around digital freedom and the responsibilities of social media platforms. Iona contemplates potential legislative responses to these challenges while reflecting on her childhood experiences with technology and digital media's role in her activism. The episode concludes with discussions of finding a balance between online presence and mental health.

Show notes

Note: This episode describes sexual situations that are non-consensual.

Sharing a photo of yourself online has always carried some risk. But things got a lot scarier this year when users began using Grok, X's generative AI chatbot to create sexualized deepfakes of women and children. Iona Fyfe, Scottish folk singer and activist, was one of the people who had an image altered and manipulated by Grok. Hosts Ben Brock Johnson and Amory Sivertson talk to her about her experience.

**** Sponsor message:

INCOGNI: Take back your personal data with Incogni! Use code ENDLESS at the link below and get 60% off annual plans: https://incogni.com/ENDLESS