#30: DeepSeek Deployed, How Open Source Wins, The Small Model Revolution, AI Infrastructure Wars, and the Future of AI w/ Fireworks AI CEO Lin Qiao

Key takeaways

The shift towards open source AI models is gaining momentum, with the potential to surpass proprietary models in capability and efficiency.
Enterprises are transitioning from experimentation to full-scale AI deployment, highlighting the need for scalable infrastructure.
Specialized expert AI models are on the rise, enabling tailored solutions for various industries beyond general-purpose applications.
The future of AI infrastructure will heavily focus on inference needs, potentially transforming how organizations utilize AI.
Founders and investors should prioritize rapid iteration and responsiveness to market demands in the evolving AI landscape.

Summary

Introduction to the Future of AI Infrastructure

In this episode of the Five Year Frontier Podcast, host Daniel Darling delves into the rapidly evolving landscape of AI infrastructure, with a focus on open source supremacy and innovations that could revolutionize the field. The episode features Lin Qiao, CEO and co-founder of Fireworks AI, who shares insights from her journey in the AI industry, highlighted by the importance of scalable and customizable AI solutions.

The Open Source vs. Proprietary Landscape

Lin discusses the shift towards open source AI models, marking a significant transition in how AI is developed and deployed. DeepSeek is highlighted as a cutting-edge example, potentially surpassing proprietary models in various applications. The discussion centers on how the collaborative nature of the open-source community allows for rapid advancements in AI capabilities.

Enterprise AI Adoption and Challenges

The conversation shifts towards the current state of AI adoption within enterprises, noting that many organizations are moving beyond testing phases to full-scale deployment. Lin emphasizes the importance of efficiency and cost-effectiveness in deploying complex AI models, addressing the challenges enterprises face, particularly with large models that demand substantial resources.

The Rise of Specialized AI Models

Lin predicts a future dominated by smaller, specialized expert AI models rather than large, general-purpose models. This shift will enable companies to harness specific AI capabilities tailored to their unique needs. The discussion touches on various use cases, from legal and medical applications to enhancing business processes.

The Future of Inference and AI Infrastructure

As the demand for inference increases, Lin outlines how Fireworks AI focuses on developing a highly scalable infrastructure to meet growing enterprise needs. She predicts that as the gap between training costs diminishes, enterprises will shift their focus towards efficient inference solutions driven by deep-seek advancements.

Advice for Founders and Investors in AI

In concluding segments, Lin shares valuable insights for founders seeking to build AI-native companies, emphasizing rapid validation and adaptability in product development. She also highlights the role of strategic thinking among investors as critical for navigating this fast-paced and evolving market.

Show notes

The future of AI infrastructure. We cover Open Source supremacy, DeepSeek disruption, building small expert models, and staying ahead of the blazing pace of AI innovation.

Lin Qiao is the CEO and co-founder of Fireworks AI, a company pioneering scalable AI infrastructure to help businesses build, customize, and deploy AI models and applications with speed and efficiency. Fireworks provides seamless access to over 100 AI models, including those from OpenAI, DeepSeek, and other leading providers, making enterprise AI adoption faster and more flexible. Founded in 2022, Fireworks AI has already gained high-profile customers such as DoorDash, Verizon, and Upwork. Backed by Sequoia, the company has raised $77 million to date and is currently valued at $550 million. Lin brings a wealth of experience in AI infrastructure and engineering leadership. She has held key technical roles at IBM and LinkedIn, but is best known for her tenure at Meta, where she led a team of 300+ world-class engineers in AI frameworks and platforms. She played a pivotal role in scaling PyTorch, deploying it across Facebook’s global data centers and billions of devices, cementing it as one of the most widely used open-source AI frameworks today. Lin holds a Ph.D. in Computer Science from UC Santa Barbara and a Master’s in Computer Science from Fudan University in China.

Sign up for new podcasts and our newsletter, and email me on danieldarling@focal.vc

See omnystudio.com/listener for privacy information.