EP276 AI Governance vs. The Hyper-Velocity Agentic Future: A Lawyer's Take

The hosts begin by discussing how AI is perceived differently from other emerging technologies like cloud, 5G, or quantum computing. The guest, James Sherer, emphasizes that AI is not just another emerging tech but a phenomenon that projects human-like agency and reasoning onto these systems, which influences human interaction and societal expectations. This projection leads to misconceptions about AI's intent and capabilities. The conversation highlights the societal shift where AI, viewed as a tool, is increasingly seen as capable of human-like agency, creating deep implications for trust, governance, and ethical considerations.

A significant part of the episode focuses on how organizations can effectively govern AI, especially given its rapid evolution and the difficulty of applying traditional data governance frameworks. James Sherer underscores the importance of starting with comprehensive policies based on existing frameworks like NIST or ISO, and continuously updating them to reflect technological advancements. The discussion stresses the need for practical, risk-based governance approaches, emphasizing the importance of understanding what AI technologies are doing internally, monitoring outputs, and establishing accountability and responsibility—akin to audits—particularly as AI outputs become indistinguishable from human work.

The hosts address the challenge posed by the hyper-velocity of AI innovation. James Sherer advocates for organizations to create flexible, broad policies and cultivate a culture of continuous monitoring and adaptation. He compares organizations' handling of AI governance to maintaining health—regular checkups and incremental improvements are key. The need for a balanced approach that combines technical controls with behavioral and HR considerations is discussed, emphasizing that organizations should be prepared for rapid change without trying to control every detail but instead focus on resilient, adaptable governance frameworks.

The episode covers the potential unintended consequences of AI deployment, especially in regulated industries like law and healthcare. Sherer highlights the importance of transparency, training, and aligning AI use with legal and ethical standards. The discussion includes legal examples, like lawyers' use of AI, and stresses the importance of scrutinizing outputs and maintaining oversight. The conversation emphasizes that no organization can achieve perfect outcomes but should aim for reasonable, risk-based approaches that can defend their AI strategies under scrutiny, including regulatory and legal challenges.