David Senra
Jonathan Ross, Founder of Groq
· Summarized
Key takeaways
- Speed in decision-making and acting quickly can lead to game-changing opportunities, as exemplified by the NVIDIA deal.
- Combining specialized hardware like GPUs and LPUs can significantly enhance AI performance by overcoming bottlenecks.
- Effective leadership involves asking the right questions, building autonomous teams, and fostering trust rather than micromanaging.
- Creative financial strategies, such as 'Groq bonds,' can be vital during crises to extend runway and keep a company afloat.
- Recognizing and seizing lucky opportunities early can dramatically shape a company's success.
- The future of AI democratizes innovation, enabling small players to make impactful contributions, especially if society adopts a mindset of asking questions rather than simply providing answers.
- Relentless pursuit of societal impact, including medical advancements through increased compute, defines Ross's sense of purpose and leadership.
Summary
The Rapid Development of a $20 Billion NVIDIA Deal
Jonathan Ross recounts how Groq closed a $20 billion partnership with NVIDIA in just three weeks from initial proposal to completion. The deal exemplifies how speed in decision-making—and acting fast—can create enormous opportunities. Ross emphasizes that this agility is driven by a team environment rooted in autonomous experimentation and collaborative innovation.
The Power of GPU and LPU Integration for AI Performance
Ross discusses the synergistic benefits of combining GPUs and LPUs to optimize performance for AI models, especially in processing tokens for large language models (LLMs). He explains how different hardware components excel at different tasks—compute-constrained versus memory throughput—and their joint use overcomes bottlenecks, significantly boosting AI speeds and capabilities.
Leadership and Innovation in Tech Companies
Ross elaborates on his leadership philosophy rooted in asking the right questions, confidence, and creating autonomous teams. He contrasts his style with traditional command-and-control, advocating for clear high-level goals with minimal constraints that enable creative problem-solving. He also highlights the importance of transparency, reducing politics, and fostering trust within teams.
Handling Crises with Creative Strategies
Faced with near-bankruptcy, Ross created 'Groq bonds'—a salary-to-equity exchange—participated by 80% of his team, as a critical move to extend runway and save the company. This innovative approach turned a dire financial situation into a team effort, engaging everyone in the company’s survival and deepening commitment.
Seizing Opportunities and the Role of Luck
Ross emphasizes the importance of recognizing and seizing lucky opportunities, like the rapid deployment of LLMs, and how often companies fail to capitalize on such moments. His approach involves resilience, first principles thinking, and rapid experimentation—often underestimating the power of speed and early action.
The Future of AI and Education
Ross is optimistic about AI’s potential to democratize innovation. He envisions a future where accessible AI tools empower individuals and small startups to create impactful solutions, disrupting traditional industries. He advocates for educational reform—teaching kids to ask questions rather than answer them, fostering curiosity and critical thinking in an AI-powered world.
Vision for Continuous Discontent and Social Impact
Ross talks about his ongoing 'manufactured discontent,' driven by a sense of responsibility to improve societal outcomes, such as increasing computational capacity for AI to accelerate medical breakthroughs and aging research. He underscores that relentless pursuit of progress is central to impactful entrepreneurship and innovation.
Sponsors
- Ramp · Ramp helps many of the most innovative businesses in the world cut their expenses by 5% and grow their revenue by 16%. It is designed to make your finance team faster and happier, giving you a competitive advantage.
- AppLovin · AppLovin connects you with over a billion potential new customers inside mobile games. Their ads are full-screen videos watched for an average of 35 seconds, ensuring high retention. It’s easy to launch and scale, with immediate results that increase revenue.
- Deel · Deel helps businesses hire, pay, and manage workers anywhere in the world, enabling them to retain top talent globally and focus on delivering value.
Show notes
Jonathan Ross is the founder of Groq and the inventor of the Google Tensor Processing Unit (TPU), now a senior executive at NVIDIA following the company's $20 billion partnership with Groq.
Before Groq, Ross built something that didn't exist: a custom AI chip at Google called the TPU, which became the backbone of DeepMind's AlphaGo — the system that defeated world Go champion Lee Sedol in 2016. After watching the TPU push AlphaGo's ELO score up by hundreds of points overnight, Ross grasped a principle that would define his next decade: faster inference produces more capable models. He left Google to act on it.
Groq's first decade was brutal. Early West Coast VCs passed — and would later watch as NVIDIA announced what Ross describes as the firm's largest deal by nearly 3x. Ross came within weeks of running out of money. Rather than lay off the engineers he needed to hit a critical product milestone, he created "Groq bonds" — war-bond–style instruments that exchanged salary for equity. About 80% of the team participated; nearly half took statutory minimum wage. They saved two months of runway and kept the company alive.
The core bet Ross made — that fast inference would matter — was widely dismissed, inside Groq and out. When the CEO of GitHub called needing chips to run LLMs, Ross's own engineers told him it couldn't be done. He eventually stopped asking and started declaring: "I intend to do this." He describes that shift — from inviting pessimism to announcing direction — as the most important leadership change he made.
Now at NVIDIA, Ross carries what he calls manufactured discontent: a deliberate refusal to rest, convinced that every day without sufficient compute is a day the world waits longer for cures for cancer and aging.
Show notes: https://www.davidsenra.com/episode/jonathan-ross
Made possible by
Ramp: https://ramp.com
AppLovin: https://applovin.com/senra
Deel: https://deel.com/senra
Chapters
(00:00:00) The $20 Billion NVIDIA Deal Closed In 3 Weeks
(00:00:25) Why GPUs And LPUs Are Better Together
(00:01:46) When AI Talks To AI, Speed Wins
(00:03:30) Always Start With A Hobby Project
(00:05:55) Ask The Right Questions, Not Answer Them
(00:08:23) There Are Infinite Ways To Be A Leader
(00:13:00) I Was One Of The World's Worst Leaders
(00:14:34) Fewer Constraints, More Room To Surprise You
(00:16:31) At NVIDIA There Is No Politics
(00:19:44) You Have To Learn Confidence
(00:22:23) East Coast VCs Think, West Coast VCs Follow
(00:23:50) The Keynesian Beauty Contest Of Silicon Valley
(00:26:48) The Autonomy That Created The NVIDIA Deal
(00:30:07) Making A Model Smarter By Making It Faster
(00:34:52) Reality Quotient Beats Intelligence Quotient
(00:35:44) Find The Dominant Game And Play It
(00:37:11) A Founder's Job Is Full-Time Change Management
(00:38:34) Return On Luck: Seize It Better Than Anyone
(00:42:54) You Can't Sell Speed, You Have To Let People Try It
(00:46:32) I Intend To: Intentional Leadership
(00:51:07) Groq Bonds: Trading Salary For Survival
(00:54:13) Hire For Negatives, Grow For Positives
(00:58:46) Loss Aversion And Booking The Win Early
(01:00:37) How Michael Jordan Weaponized Humiliation
(01:03:13) Manufactured Discontent Drives Everything
(01:05:02) Every Day Without Compute Has A Real Cost
(01:07:07) Code Was Rationed, Now It's Nearly Free
(01:10:04) Teach Kids To Ask Questions, Not Answer Them
Learn more about your ad choices. Visit megaphone.fm/adchoices
Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account