Mostly Technical

151: Tokenmogged

· Summarized

Share this episode
Anyone with this link can open it.
Share Link
Start at 0:00

Key takeaways

  • Zvix has effectively solved the hard problems of scaling webhooks, allowing companies to avoid issues like fail deliveries and incremental feature builds.
  • Jesse Bentley’s use of tokens for UI redesigns is exceptionally high, demonstrating the power and cost of modern AI tooling in infrastructure work.
  • Opus 5.5 has significantly improved over previous models, offering better review, PR, testing, and UI design capabilities, making it a marked upgrade.
  • Aaron’s HomeOS exemplifies a comprehensive personal infrastructure built on Cloudflare primitives, emphasizing modularity, automation, and experimentation with AI.
  • The episode advocates for SaaS products to actively raise prices now, leveraging the stability of existing customer bases and the current AI-driven market shifts.
  • Most users prefer external API or CLI access for AI features over embedding AI directly into consumer apps, due to simplicity and control.
  • There is a growing belief that application hosting is a more sustainable business model than building infrastructure or primitives, especially as AI and cloud solutions mature.
  • The hosts see a bright future in combining AI with application layer services, but emphasize that most development will still revolve around existing SaaS interfaces rather than internal AI systems.

Summary

Intro, Sponsor Mentions, and Episode Overview

The episode opens with Ian and Aaron discussing sponsorships from Svix, Bento, SerpAPI, Laracon AU, and Typesense. They joke about their new sponsorship pre-rolls and promote Zvix's webhook scaling solution, sharing positive listener feedback about Zvix. The hosts note Jesse Hanley's tweet about trying Bento's email service, teasing Jesse's upcoming product launch. They humorously assign Jesse Bentley as Jesse Hanley's new name, joking about branding and fame. The hosts then shift into a lively discussion about their current projects, especially Aaron's token usage and AI experimentation, and Ian's office redesign plans. The conversation features detailed insights into their tools, infrastructure, and AI applications, with a focus on how AI is evolving and influencing their development workflows.

Jesse Bentley and the Branding Gag

Ian and Aaron tease Jesse Hanley's product branding, jokingly renaming him Jesse Bentley. They reflect humorously on Jesse’s branding efforts, and Ian suggests Jesse can send them a Bentley in return. The banter highlights the playful nature of the hosts' relationship and their inside jokes. They also discuss Jesse's work on token usage, noting that Jesse has used over 25 billion tokens in three weeks, vastly outperforming Aaron's 2.5 billion tokens over a similar period. The conversation covers Jesse’s rapid UI redesign for Bento, which reportedly took just three days and involved significant token expenditure, leading Ian to jokingly call him 'token mugged.' The hosts analyze Jesse’s approach to AI and infrastructure, contrasting it with their own.

Aaron's Token Usage and AI Projects

Aaron shares details about his extensive token consumption while working on Help Spot UI and other projects, illustrating his deep engagement with AI tooling. He humorously describes his attempts to manipulate API plans to maximize resets and tokens, revealing the addictive nature of AI development. The discussion turns to AI model improvements, with Aaron noting how Opus 5.5 significantly surpassed previous models like Fable and Opus 5.0. They talk about AI’s current capabilities, especially in code review and UI design, praising Opus 5.5 for its effectiveness. Aaron describes his experiments with using AI for categorization, design fixes, and generating prompts for AI assistance, emphasizing the ongoing evolution in AI tools.

Aaron's HomeOS and Infrastructure Experiments

Aaron provides an in-depth update on his HomeOS project, built entirely on Cloudflare’s primitives. He describes its modules, including email forwarding, reminders, finance tracking via Tiller and Yodely, receipts, bookmarks, and a newsletter system that interfaces with AI. The system aims to centralize personal data and automate daily tasks. He discusses plans to incorporate voice interaction and home automation, envisioning a future where he can speak commands to a home AI. Aaron explains how his HomeOS is a technical sandbox for exploring Cloudflare OS and primitives, with ideas to eventually port it to a Laravel-based platform. The conversation explores the role of AI and infrastructure boundaries, and Aaron reflects on Cloudflare’s architecture and his desire to build a more integrated, application-focused home OS.

Discussion: AI and Application Development Trends

The hosts converse about the trend toward raising prices for SaaS and AI-enabled products, emphasizing the time to do so is now, especially for existing products with stable customers. They highlight the importance of external API and CLI access over embedding AI directly into apps, pointing out that most users prefer to interface externally rather than build internal AI systems. Ian discusses the idea that developers want control via APIs and MCP (Meta Cloud Platform), while average users are unlikely to build custom AI on their own. They argue that most SaaS and enterprise users will continue to operate within applications rather than outside them, advocating for offering easy external access rather than internal AI ubiquity. The episode concludes with a reflection on the importance of adapting pricing strategies in the evolving AI landscape.

Sponsors

  • Svix · Zvix has solved all the hard problems about scaling webhooks so you can avoid triaging, fail deliveries, and incremental build features. Check them out over on Zvix.com. In the link below, there is our custom links.
  • Bento · Jesse Bentley's team is launching a new product PostShiba, a transactional email platform that powers Bento's delivery rates. Join the waitlist at postshiba.com if you're looking for a replacement to SendGrid, Mailgun, Resend, or SES.
  • SerpAPI · Access Google Search, Maps, Shopping, and other search engines via API with SerpAPI. It’s ready in Markdown and JSON format for your AI tools, eliminating scraping headaches.
  • Laracon AU · Join the Laravel community in Brisbane this November for workshops and deep practical talks about building and maintaining real software. Get your tickets at LaraCon.au.
  • Typesense · Lightning-fast open source search engines perfect for your site or app, natively integrated with Laravel Scout. Check them out at typesense.org.

Show notes

Ian and Aaron discuss Opus 5.5, Aaron's HomeOS, Ian's token usage, what's new with Aaron's office, and so much more.

Sponsored by Svix, Bento, PostShiba, SerpAPI, Laracon AU, and Typesense.

Interested in sponsoring Mostly Technical?  Head to https://mostlytechnical.com/sponsor to learn more.

  • (00:00) - Ian Loves Developers!
  • (05:16) - I Have Become Aaron, Destroyer of Worlds
  • (12:11) - Update on Aaron's Office
  • (22:18) - Orbin & Mogging
  • (26:36) - Update on Jev
  • (31:19) - HomeOS
  • (48:23) - Opus 5.5
  • (55:48) - The Best Time Ever To Raise Prices

Links:

Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account

Couldn't load the audio. A blocker may be stopping the show's tracking links. Open the file