The a16z Show

How Enterprise AI Really Gets Deployed

· Summarized

Share this episode
Anyone with this link can open it.
Share Link
Start at 0:00

Key takeaways

  • Decagon shifted from frontier, closed-source models to open-source models for better control, latency, and cost efficiencies in enterprise AI applications.
  • Enterprise AI success depends on building comprehensive infrastructure—tools, monitoring, testing—and integrating AI within existing legacy systems rather than just deploying large models.
  • The future of enterprise AI involves continuous experimentation, rapid iteration, and productization, enabling enterprises to adapt and scale AI solutions swiftly.
  • AI is viewed as an enabler that creates new jobs and opportunities by automating mundane tasks, freeing human talent to focus on strategic initiatives.
  • Building a strong, aligned company culture that encourages collaboration, transparency, and high accountability is critical for scaling AI-driven organizations.

Summary

Decagon’s Strategic Shift Towards Open Source AI Models

This section explores Decagon's transition from relying primarily on frontier, closed-source models towards adopting open-source AI models. Jesse Zang details that their initial use of large, proprietary models was driven by immediate delivery of value, but as latency and control issues arose, they shifted focus to open source models. These smaller models offered better performance on specific tasks, faster response times, and lower costs, enabling Decagon to optimize enterprise AI applications such as voice agents and operational workflows. The discussion emphasizes that the biggest innovations in enterprise AI are happening around productization and tuning of models rather than just the models themselves. Jesse also discusses the importance of evaluating models along costs, intelligence, and latency, and how open source models can outperform larger models for specific tasks when properly fine-tuned.

Building AI for Enterprises: Infrastructure and Productization

This section centers on how Decagon develops AI systems tailored for large organizations. Ashwin Srinivas underscores that deploying AI at scale requires significant infrastructure—such as collaboration tools, testing, monitoring, and security protocols—to make models enterprise-ready. Jesse describes how Decagon’s approach involves building tools and procedures that turn complex, manual work into automatable processes via AI agents. The narrative highlights that successful enterprise AI deployment involves more than just powerful models; it requires embedding these models within entire systems that integrate legacy tech, ensure compliance, and facilitate continuous improvement. The discussion also touches on the ongoing evolution of AI capabilities and the need for continuous model training and evaluation to stay ahead in the market.

The Future of AI Applications and Enterprise Software Ecosystem

This section discusses the evolving landscape of AI in enterprise settings, including the role of application companies versus labs. Jesse and Ashwin debate whether deep, specialized vertical solutions or broad, horizontal platforms are more sustainable long-term. They emphasize that enterprise AI will be an ongoing process, with AI agents acting as interfaces (‘AI concierge’) integrating with CRM and other legacy systems. The conversation also covers the importance of fast iteration and product-led growth, with Decagon focusing on delivering core products that empower customers to build and adapt their own AI solutions. Additionally, they express optimism about AI creating new jobs and expanding capacity for enterprise teams by automating mundane tasks and enabling more strategic work.

Operational Insights on Enterprise AI Adoption and Market Dynamics

In this practical section, Jesse and Ashwin share insights into how large enterprises are adopting AI faster due to the clear value proposition in cost reduction and improved customer experience. They describe their successful sales strategies, including rapid iteration, controlled deployment, and close customer collaboration. The podcast highlights that AI’s rapid progress demands agile, highly responsive teams, including founders actively involved in sales and product iteration. They reflect on how AI is transforming roles, not eliminating careers—by automating routine tasks, AI allows enterprise employees to focus on higher-value work. Judgments are also made on geographic expansion, the importance of building a scalable product, and balancing global growth with local market needs.

Cultural and Organizational Aspects of an AI-Driven Company

This section delves into Decagon’s company culture and operational practices, especially as they scale globally. Jesse and Ashwin emphasize a culture of hard work, camaraderie, and a deeply integrated team environment, where sales and engineering teams collaborate closely. They state they avoid the 'grind culture' narrative, viewing hard work as a natural part of their mission-driven approach. The company invests heavily in onboarding new offices internationally by immersing new hires in the core culture. They also highlight the importance of maintaining high accountability, continuous communication, and aligning the team around a shared vision for AI’s role in enterprise transformation.

Sponsors

  • a16z · Thanks for listening to this episode of the A16Z podcast. If you like this episode, be sure to like, comment, subscribe, leave us a rating or a review, and share it with your friends and family. For more episodes, go to YouTube, Apple Podcasts, and Spotify. Follow us on X, A16Z, and subscribe to our substack at a16z.substack.com. Thanks again for listening, and I'll see you in the next episode.

Show notes

Sarah Wang and Kimberly Tan are joined by Jesse Zhang and Ashwin Sreenivas, co-founders of Decagon, to discuss the evolution of enterprise AI agents, why the company increasingly relies on open-source models, and how it is helping some of the world’s largest companies deploy AI in production.

Decagon has become one of the fastest-growing AI companies by building agents that automate customer support, sales, and operational workflows. Jesse, Decagon’s CEO, and Ashwin, its president, explain how the company is building enterprise AI at scale.

They unpack why Decagon moved most of its inference to open-source models, how latency, evaluation, and fine-tuning shape production AI systems, and why enterprise AI requires far more than simply plugging into frontier models. The conversation also explores forward-deployed engineering, enterprise sales, AI’s impact on jobs, and why application companies will continue to thrive alongside the foundation model labs.

 

Resources:

Follow Jesse Zhang on X:https://x.com/thejessezhang

Follow Ashwin Sreenivas on X: https://x.com/AshwinSreenivas

Follow Sarah Wang on X: https://x.com/sarahdingwang

Follow Kimberly Tan on X:https://x.com/kimberlywtan

Stay Updated:

Find a16z on YouTube: YouTube

Find a16z on X

Find a16z on LinkedIn

Listen to the a16z Show on Spotify

Listen to the a16z Show on Apple Podcasts

Follow our host: https://twitter.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account

Couldn't load the audio. A blocker may be stopping the show's tracking links. Open the file