AI-Driven Code: Navigating Due Diligence & Transparency in MLOps // Matt van Itallie // #275

Key takeaways

Code-based scans assess multiple dimensions of a codebase, crucial for technical due diligence.
Eight components evaluated in code scans include code quality, development process, team retention, and more.
Generative AI enhances coding productivity but requires strict quality and security reviews.
Technical findings should be communicated in a business context to engage non-technical stakeholders.
Concerns about exit risks relate to the potential for generative AI to replicate technologies easily.
M&A activity is expected to increase, particularly in the SaaS sector over the next few years.

Summary

The Importance of Code-Based Scans

Matt Van Itallie, founder and CEO of Sema, discusses how comprehensive evaluations of codebases are essential for technical due diligence, particularly when companies are looking to buy. He emphasizes that code scans are not just about the functionality of the code but also about assessing risks related to code quality and compliance. Sema's product scores code quality and other key metrics on a scale of 1 to 100, making it accessible to non-technical stakeholders.

Understanding the Eight Components of Code Scans

Van Itallie outlines eight components that Sema’s code scans assess: code quality, development process consistency, team retention, cloud spend/utilization, intellectual property risk from open-source code, code security, cyber assets review, and the newly introduced generative AI component. He explains that these elements help in determining how well a codebase can be maintained, expanded, and whether it poses compliance risks.

The Impact of Generative AI on Code Quality

The discussion turns to the influence of generative AI on software development. Van Itallie introduces the idea of the Generative AI Bill of Materials (GBOM), which quantifies the amount of AI-generated code within a codebase. The risks associated with using generative AI, such as security and maintainability risks, are emphasized. He advises that while generative AI coding can enhance productivity, rigorous review processes should remain in place.

Bridging the Gap Between Technical and Business Perspectives

Van Itallie elaborates on the importance of making technical data understandable for non-technical stakeholders. He recommends explaining code quality metrics in terms that relate directly to business outcomes, such as translating findings into potential developer hours or costs. He believes it is crucial to put technical information in context to facilitate better decision-making by leadership.

Exit Risk and Market Trends in M&A Activity

Towards the end, the podcast explores exit risks, where the value of a company might diminish if buyers perceive that its technology can be easily replicated using generative AI methods. Van Itallie predicts growth in M&A activity, with a significant increase expected in 2025, driven by sufficient dry powder in the investor market and an appreciation for the speed and efficiency generative AI can bring to software development.

Show notes

Matt Van Itallieis the founder and CEO ofSema. Prior to this, they were the Vice President of Customer Support and Customer Operations at Social Solutions.

AI-Driven Code: Navigating Due Diligence & Transparency in MLOps // MLOps Podcast #275 with Matt van Itallie, Founder and CEO of Sema.

// Abstract

Matt Van Itallie, founder and CEO of Sema, discusses how comprehensive codebase evaluations play a crucial role in MLOps and technical due diligence. He highlights the impact of Generative AI on code transparency and explains the Generative AI Bill of Materials (GBOM), which helps identify and manage risks in AI-generated code. This talk offers practical insights for technical and non-technical audiences, showing how proper diligence can enhance value and mitigate risks in machine learning operations.

// Bio

Matt Van Itallie is the Founder and CEO of Sema. He and his team have developed Comprehensive Codebase Scans, the most thorough and easily understandable assessment of a codebase and engineering organization. These scans are crucial for private equity and venture capital firms looking to make informed investment decisions. Sema has evaluated code within organizations that have a collective value of over $1 trillion. In 2023, Sema served 7 of the 9 largest global investors, along with market-leading strategic investors, private equity, and venture capital firms, providing them with critical insights.

In addition, Sema is at the forefront of Generative AI Code Transparency, which measures how much code created by GenAI is in a codebase. They are the inventors behind the Generative AI Bill of Materials (GBOM), an essential resource for investors to understand and mitigate risks associated with AI-generated code.

Before founding Sema, Matt was a Private Equity operating executive and a management consultant at McKinsey. He graduated from Harvard Law School and has had some interesting adventures, like hiking a third of the Appalachian Trail and biking from Boston to Seattle.

Full bio: https://alistar.fm/bio/matt-van-itallie

// MLOps Swag/Merch

https://shop.mlops.community/

// Related LinksWebsite: https://en.m.wikipedia.org/wiki/Michael_Gschwind

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Follow us on Twitter: @mlopscommunity

Sign up for the next meetup: https://go.mlops.community/register

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Matt on LinkedIn: https://www.linkedin.com/in/mvi/

Timestamps: