EU AI Act - Navigating New Legislation // Petar Tsankov // MLOps Podcast #271 · Agentic Conversations (formally mlops.community) summary

Key takeaways

Understanding the EU AI Regulation Act is essential for companies operating in the AI space within Europe.
AI governance needs to evolve from deployment to structured management of risks and compliance.
Tools like 'Comply' are crucial for bridging the gap between legal requirements and actionable measures in AI compliance.
Translation of high-level regulations into quantifiable metrics is vital for organizations to demonstrate compliance.
Ongoing collaboration between AI vendors, regulatory bodies, and organizations will shape the future of AI compliance and safety.

Summary

Navigating the EU AI Regulation Act

Petar Tankov delves into the newly introduced EU AI Regulation Act, discussing its implications for organizations working with AI in the European Union. The conversation highlights the common narrative that regulations stifle innovation, countered by insights that these regulations can offer structured pathways for safe AI deployment. Petar emphasizes the need for businesses to understand the legal terminology and how to transform it into actionable steps for compliance.

The Shift in AI Governance

The discussion evolves into how organizations have shifted from merely deploying AI to ensuring its governance. Petar shares that many companies, previously overwhelmed by the rapid development and application of AI, are now implementing AI governance frameworks. He notes a surge in awareness about the importance of understanding the risks posed by AI applications, especially in light of recent regulation.

AI Compliance and Safety: A Dynamic Approach

Petar introduces his initiative, 'Comply', an open-source tool designed to provide an evaluation framework for compliance with the EU AI Act. This tool aims to make the compliance process more transparent and practical, offering a scoring system to assess language models against the principles set out in the EU Act. Their recent work indicates models are often more optimized for capabilities rather than compliance, highlighting a gap that tools like Comply can bridge.

Actionable Metrics for Compliance

The conversation covers the importance of translating the high-level mandates of the EU AI Act into tangible metrics that organizations can measure against. Petar explains how the collaboration with various stakeholders, including regulatory bodies, is essential to create benchmarks that organizations can use to assess their compliance. This transition is critical in a landscape where compliance could prevent potential legal repercussions and reputation loss.

The Future of AI Regulations and Benchmarks

The podcast concludes with a consideration of the evolving landscape of AI regulation. Petar reflects on how future regulatory frameworks will need to be adaptable, allowing for continuous learning and development as both AI technology and its applications evolve. He emphasizes the need for both regulatory bodies and organizations to foster a collaborative environment for ongoing discussions about compliance and safety.

Show notes

Dr. Petar Tsankov is a researcher and entrepreneur in the field of Computer Science and Artificial Intelligence (AI). EU AI Act - Navigating New Legislation

// MLOps Podcast #271 with Petar Tsankov, Co-Founder and CEO of LatticeFlow AI.

Big thanks to LatticeFlow for sponsoring this episode!

// Abstract

Dive into AI risk and compliance. Petar Tsankov, a leader in AI safety, talks about turning complex regulations into clear technical requirements and the importance of benchmarks in AI compliance, especially with the EU AI Act. We explore his work with big AI players and the EU on safer, compliant models, covering topics from multimodal AI to managing AI risks. He also shares insights on "Comply," an open-source tool for checking AI models against EU standards, making compliance simpler for AI developers. A must-listen for those tackling AI regulation and safety.

// Bio

Co-founder & CEO at LatticeFlow AI, building the world's first product enabling organizations to build performant, safe, and trustworthy AI systems. Before starting LatticeFlow AI, Petar was a senior researcher at ETH Zurich working on the security and reliability of modern systems, including deep learning models, smart contracts, and programmable networks.

Petar has co-created multiple publicly available security and reliability systems that are regularly used:

= ERAN, the world's first scalable verifier for deep neural networks: https://github.com/eth-sri/eran

= VerX, the world's first fully automated verifier for smart contracts: https://verx.ch

= Securify, the first scalable security scanner for Ethereum smart contracts: https://securify.ch

= DeGuard, de-obfuscates Android binaries: http://apk-deguard.com

= SyNET, the first scalable network-wide configuration synthesis tool: https://synet.ethz.ch

Petar also co-founded ChainSecurity, an ETH spin-off that, within 2 years, became a leader in formal smart contract audits and was acquired by PwC Switzerland in 2020.

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links

Website: https://latticeflow.ai/

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Follow us on Twitter: @mlopscommunity

Sign up for the next meetup: https://go.mlops.community/register

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Petar on LinkedIn: https://www.linkedin.com/in/petartsankov/

Timestamps:

[00:00] Petar's preferred coffee

[00:13] Takeaways

[01:12] AI Governance and EU Compliance

[04:16] AI Governance and Model Management

[09:48] AI Governance and Risk Management

[11:38] COMPL-AI

[15:02] EU AI Act Compliance Challenges

[17:16] EU AI Act Actionability

[22:26] Compliance and toxicity issues

[25:48] Model benchmarking and metrics

[28:13] Copyright and model evaluation

[32:28] SOC AI certification

[33:07] EU AI Act Gaps

[37:05] Integrity, safety, and compliance

[41:13] Benchmarking and Overfitting Concerns

[43:15] Tiered compliance approaches

[46:03] Bridging Law and Tech

[48:00] Multimodal AI Feature

[51:45] AI Risk and Mitigation

[55:37] Future Directions for Multimodal Models

[57:33] Wrap up

EU AI Act - Navigating New Legislation // Petar Tsankov // MLOps Podcast #271