Are The Kids Alright?

Key takeaways

Surveillance tools in schools are widespread and promoted as safety solutions, but their effectiveness is not well-verified and they pose serious privacy risks.
Automated monitoring systems can generate false positives that lead to unnecessary escalation, censorship, and potential harm, especially for marginalized students.
There is a significant racial and bias issue in AI-based student monitoring, which can disproportionately target and harm students of color and disabled students.
Many surveillance practices lack transparency and consent, often being implemented without adequate community discussion or awareness.
The profit motive of surveillance companies can influence public policies, often prioritizing data collection over student rights and safety.
Proactive education around digital privacy, consent, and respectful use of technology is crucial, rather than reliance on punitive monitoring measures.
Balancing safety with privacy and ethical considerations requires human-centered approaches, such as mental health support and open dialogue, rather than solely technological fixes.

Summary

The Growing Use of Monitoring Software in Schools and for Children

The podcast explores the increasing deployment of surveillance and monitoring tools in educational settings and at home. Companies like Gaggle and Bark market their products as essential safety measures to prevent tragedies like school shootings and suicides, promising to scan emails, documents, and social media for keywords indicating self-harm, bullying, or violence. However, this rush to implement surveillance technology raises significant privacy concerns, especially regarding the accuracy of these tools, their potential to generate false positives, and the broader implications for student rights and safety.

Privacy and Ethical Concerns with Student Monitoring Technologies

Experts and journalists interview with educators, parents, and researchers highlight the risks associated with these tools. They point out issues like false positives leading to unwarranted escalation, censorship of students, racial bias in AI algorithms, and the dangerous potential for data collection and sharing with law enforcement. The episode critically examines how these surveillance practices may disproportionately impact students of color, disabled students, and vulnerable populations, as well as the lack of transparency and consent in many implementations.

Commercial Interests and the Business of Surveillance in Education and Beyond

The podcast discusses how companies like Gaggle and Bark profit from selling surveillance tools to schools and parents, despite limited evidence of their effectiveness. These companies make claims about preventing shootings and self-harm, but independent verification is scarce. The financial incentives drive a broad adoption of monitoring technologies, and the episode raises questions about how these business models could influence public policy and educational practices, often at a cost to student privacy and well-being.

Parent and Community Perspectives on Monitoring and Privacy

Parents, educators, and community members express concern over the lack of transparency and the potential for surveillance tools to chill free expression and reinforce stereotypes or biases. Stories are shared about false alarms and students self-censoring to avoid trouble. The episode emphasizes the importance of human-centered approaches like counseling and respectful communication over purely technological solutions, advocating for ongoing, open conversations about privacy, consent, and the purpose of monitoring.

The Cultural and Future Implications of Surveillance and Automation in Schools

The episode concludes with reflections on how surveillance technology shapes societal norms and the way young people understand privacy and trust. Experts warn of the risks of normalizing constant monitoring and highlight the need for more education about digital citizenship, privacy rights, and healthy relationships with technology. The overall message urges a reevaluation of what safety means and the importance of balancing technological innovation with human engagement and ethical considerations.

Show notes

In this anxious era of bullying, teen depression, and school shootings, tech companies are selling software to schools and parents that make big promises about keeping kids secure by monitoring what they say and write online. But these apps demand disturbing trade-offs in the name of safety. In this episode, we dive into the normative, privacy, and transparency implications of this software for both schools and families, and examine how the rush to fix societal problems with technology can amplify harm to young people while enriching companies that stand to profit from increased surveillance.

Show Notes

Gennie Gebhart's bio | Twitter - 00:38

Electronic Frontier Foundation - 1:02

The EFF's 2017 report on student privacy (PDF) - 1:12

"Facial Recognition Tech Comes to Schools and Summer Camps" (Wall Street Journal) - 1:32

"Heal the Internet," our episode on removing tracking pixels from emails - 2:06

"Big Brother at the Office," our episode on workplace surveillance - 2:10

Previous episodes on Big Tech include "100% Facebook-Free," "The Google Ads Shakedown," and "Nevermore, Amazon" - 3:19

"Breaking the Black Box," our episode about algorithmic bias - 3:24

Caroline Haskins on Twitter | her stories for Vice | her stories for BuzzFeed News - 3:51

BuzzFeed News' series on schools and surveillance - 4:04

"Gaggle Knows Everything About Teens And Kids In School" (BuzzFeed News) - 4:06