Is the SaaSpocalypse Over?
· Summarized
Key takeaways
- The biggest cheat code for finding your ideal customer, in Aaron's words,, is to 'talk to your customers'.
- Don't pick your ideal customer by revenue alone; understanding how they use the product is crucial, as evidenced by an enterprise customer who uses DocsBot very differently.
- Customers who leave to build their own alternatives are often not your best-fit customers, frequently due to being too price sensitive or having small teams.
- Using bring-your-own-key allows a bootstrapped SaaS to launch an AI product without paying inference costs for around two years.
- Speed matters in AI support agents, so choosing the newest, most advanced model isn't always optimal for response time.
- Model upgrades can cause regressions in performance that aren't obvious through standard evals, so ongoing monitoring is essential.
- Choosing models involves balancing cost, speed, and quality—newest models aren't always the best choice for every use case.
- Specialized and smaller models, like Mistral for PDF extraction or domain-specific models, are currently more cost-effective and practical for many tasks.
Summary
Intro: Is the SaaS apocalypse over?
The episode begins with a light-hearted remark that the SaaS apocalypse has passed and the industry has yet to face its end. Craig engages with Aaron, who built the AI tool DocsBot, about his current feelings on the viability of AI SaaS products. Aaron shares that despite slower growth—indicated by a leveling out of monthly recurring revenue (MRR)—his business remains stable. He notes that while acquisition has declined—seeing a significant drop in new customer sign-ups—his existing customers are paying more, and churn has decreased. This shift suggests a focus on better targeting, product refinement, and higher-value customers.
Refining customer acquisition and focusing on ideal customers
Aaron discusses how his team has shifted their strategy towards focusing on the right customer segments by narrowing their ideal customer profile (ICP). They have targeted their marketing efforts more precisely, restructured plans, and increased prices on their most popular plans to align with competitors. As a result, revenue per customer has grown by 20%, and churn has decreased. Aaron emphasizes the importance of talking to customers directly through surveys and calls to understand their needs, and applies insights from Jason Cohen's book 'Hidden Multipliers' to refine ICP segmentation. He cautions that very small customer bases—less than 500—struggle to yield reliable conclusions due to low signal density.
Customer acquisition channels in a changed landscape
Aaron reports that traditional channels like organic search remain significant, although their effectiveness has declined slightly. Referrals and AI-related search contributions are also important. The team has invested heavily in in-person events and conferences such as WordCamp and industry-focused gatherings, building a partner program to enable agencies to resell their product. While this channel is promising, Aaron notes that establishing effective partnerships takes considerable effort, and an exponential growth from this approach has yet to be seen. Despite these challenges, they see events and in-person networking as valuable, especially as a way to sell directly through demos and building relationships.
Enterprise inertia and customer support in the AI era
The discussion shifts to enterprise customer behavior, emphasizing that larger companies tend to move slowly due to internal approval processes. This inertia makes their commitments stickier once adopted, as changing infrastructure entails significant effort. Aaron shares how AI has transformed customer support procurement, with customers initially using AI tools internally but now increasingly expecting AI-driven support solutions integrated into their workflows. He describes their own product’s success, noting a 30% ticket reduction after deploying their AI support agent, and highlights the importance of monitoring and updating documentation based on customer interactions to improve AI performance over time.
Model costs, evaluation, and switching models in AI products
The episode explores the financial considerations of running AI SaaS, discussing how model token costs influence pricing strategies. Aaron explains how his team initially avoided paying for inference by letting customers supply their own OpenAI API keys, then transitioned to a credit-based pricing system that factors in token consumption. They balance model choice by considering speed, cost, and performance, avoiding always opting for the newest, most powerful models. Evaluating models internally is complicated by options like user customization and potential regressions, such as changes in classification behavior—like GPT-4 responding more literally. They emphasize the challenge of keeping pace with rapidly evolving AI models while maintaining stable, reliable product performance.
The future of local and specialized AI models
Aaron elaborates on the limitations of deploying large models locally, citing challenges around reliability and cost. Instead, his team uses specialized models for tasks like document extraction, applying smaller or domain-specific models such as Mistral for PDF parsing or Cohere for multilingual embedding. He envisions a future where highly optimized, small models tailored to specific domains could run on consumer hardware, like modest MacBooks, which would be game-changing for privacy and accessibility. He notes that open models are currently more suitable for regulated industries concerned with data security, but infrastructure and cost barriers remain. They also employ privacy measures, such as on-device models that redact PII in real time before data leaves the user’s browser.
Next steps and exciting AI paradigms
Towards the end, Aaron discusses the potential of new AI paradigms, such as re-ranking search results with more cost-effective models. He mentions the recent release of models like Gemini and new approaches like using the Jev classifier for improving retrieval accuracy in complex queries. Aaron sees these innovations as shifts that could redefine how AI is integrated into SaaS products, making solutions more efficient, accurate, and adaptable. Despite his enthusiasm for cutting-edge models, he emphasizes the importance of practical considerations like speed, cost, and stability for real-world applications. The episode closes with Aaron expressing ongoing curiosity and excitement about future AI developments—especially the prospect of highly specialized, small models tailored for specific tasks.
Sponsors
- DocSpot · Check out DocSpot, an AI support tool built by Aaron's team, which leverages the latest in AI to improve customer support with lower costs and better insights.
Show notes
In this episode
Craig talks with Aaron, who built DocsBot, an AI customer support agent that's almost four years old, about what AI is really doing to SaaS. Aaron shares DocsBot's numbers: slower growth and fewer new customers, but more revenue per customer and lower churn after narrowing in on the right customers. They also get into what it costs to run an AI product, how to choose and switch models, and the AI tools Aaron is excited about next.
Topics discussed
- Growth in the AI era: new customer acquisition is down year over year, but revenue per customer is up 20% from last year
- Finding the ideal customer: talking to customers, cancellation surveys, and pointing AI agents at all of the product and Stripe data, after reading Jason Cohen's book Hidden Multipliers
- Signal density: why founders with only a handful of customers struggle to draw conclusions
- Where customers come from now: organic search, AI search, referrals, conferences like WordCamp, and an agency partner program
- Why big companies move slowly: and why that makes larger customers stickier
- Churn to DIY: churned customers citing AI or their own custom solution went from 1.6% to 13%, and most weren't a good fit anyway
- Pricing around token costs: from bring-your-own-key to included usage to AI credits
- Evaluating new models: why letting customers edit their system prompt makes evals hard, and a classifier that behaved differently on GPT-5.4
- Choosing models: balancing cost, speed and quality instead of reaching for the newest model
- Local and specialised models: embedding models, Cohere for other languages, and Mistral for PDF extraction
- Privacy: a tiny model in the chat widget that redacts personal information before it leaves the user's browser
- What's next: using a new model to re-rank search results at a fraction of the cost
Key takeaways
- The biggest cheat code for finding your ideal customer, in Aaron's words, is to "talk to your customers".
- Don't pick your ideal customer by revenue alone: DocsBot's biggest enterprise customer uses the product completely differently from almost everyone else.
- Customers who leave to build their own alternative are often not best-fit customers: too price sensitive, a tiny team, or not enough support tickets.
- Bring-your-own-key let a fully bootstrapped company launch an AI product without paying for inference for about the first two years.
- For an AI support agent, speed matters, so the newest model on its highest reasoning setting isn't always the right choice.
- Model upgrades can cause regressions that evals don't necessarily show.
Chapters
- (00:00:00) - Intro: Is the SaaS apocalypse here?
- (00:00:59) - Growth metrics and MRR trends over 12 months
- (00:02:08) - Focusing on ICP to boost revenue per customer
- (00:03:11) - Churn rates and pricing restructuring
- (00:04:49) - Talking to customers to define the ideal customer profile
- (00:07:32) - Signal density and sample size in customer data
- (00:09:13) - Customer acquisition channels and what's working now
- (00:10:47) - Events, conferences, and agency partnerships
- (00:13:05) - Enterprise inertia vs. consumer switching risk
- (00:15:19) - Enterprise adoption pace and pilot deployment friction
- (00:17:03) - How AI changes customer support buying behavior
- (00:19:07) - DIY/AI churn: are customers building their own solutions?
- (00:20:45) - Price increases and churn reasons breakdown
- (00:21:55) - Token costs, pricing strategy, and bring-your-own-key history
- (00:26:06) - Evaluating and switching AI models internally
- (00:29:24) - Personal model stack and balancing cost, speed, quality
- (00:34:00) - Local models, embeddings, and specialized extraction tools
- (00:36:25) - Small/local models and future of specialized AI
- (00:38:56) - PII redaction with tiny on-device models
- (00:40:16) - What's exciting next: re-ranking, Gemini, and new paradigms
- (00:43:19) - Wrap-up and where to find DocSpot
Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account