How I AI

How Intercom 2x’d their engineering velocity in 9 months with Claude Code | Brian Scanlan

· Summarized

Share this episode
Anyone with this link can open it.
Share Link
Start at 0:00

Key takeaways

  • AI-driven engineering transformations can drastically increase developer velocity and code quality when properly measured and managed.
  • Instrumentation and telemetry are essential for scaling AI adoption; tracking usage and performance metrics guides continuous improvement.
  • Embedding standards and guardrails into AI-powered workflows ensures quality and reliability at scale.
  • Fostering a high-trust, permission-giving culture accelerates innovation and helps skeptics adopt AI tools.
  • Preparing products for an agent-first world involves building CLI, APIs, and system-level interfaces that are fast, reliable, and user-friendly.
  • AI can empower entire organizations to eliminate backlogs, reduce technical debt, and reimagine workflows—creating a culture of fun and ownership.

Summary

The Transformation of Intercom’s Engineering Velocity with AI

The episode explores how Brian Scanlan, a senior principal engineer at Intercom, led the company’s rapid AI-driven transformation, which doubled R&D throughput in just nine months. The discussion highlights how integrating Claude Code allowed every engineer, product manager, and designer to contribute to code shipping more efficiently, fostering a culture focused on innovation, speed, and quality. The episode underscores the importance of measuring AI adoption through telemetry, building standards into skills repositories, and reimagining technical workflows to be agent-first with CLIs, MCPs, and ephemeral APIs.

The Power of Telemetry and Skills Automation in AI Adoption

Intercom extensively instrumented their internal tools with telemetry to track usage, effectiveness, and quality of their AI Skills. They built a skills repository with hooks enforcing standards automatically, enabling consistent and high-quality output across teams. This infrastructure grants visibility into how often skills are used, their impact on code quality, and allows continuous improvement driven by data. The discussion emphasizes the importance of systemic transparency and measurement to scale AI efforts confidently across large organizations.

Changing Developer Workflows and Culture through AI

The episode details how AI has reshaped development practices at Intercom—remarkably increasing PR throughput, reducing cycle times from code inception to deployment, and enabling backlog elimination. They’ve created a ‘factory-like’ environment where standards are embedded into the code pipeline, leading to more reliable and predictable outputs. The discussion also touches on how AI fosters a culture of fun, speed, and ownership, transforming internal workflows and lowering barriers to innovation.

Building and Maintaining Effective AI Skills and Infrastructure

Intercom’s approach to AI skills involves creating a varied repository of plug-ins and skills, with quality maintained through rigorous evaluation and monitoring. They leverage tools like Honeycomb for real-time usage analytics and session data collection, providing insights for continuous refinement. Skills are designed to be modular, reusable, and integrated deeply into engineering processes, which allows for rapid problem-solving, tech debt reduction, and quality improvements. The team emphasizes the importance of infrastructure, guardrails, and ownership in scaling AI capabilities.

The Future of Customer and Product Experience with AI

The conversation shifts to how AI is influencing the customer experience—specifically, how agent-driven workflows, API integrations, CLI interfaces, and intelligent automation can empower customer support. They discuss making SaaS products increasingly agent-friendly by building APIs and mini-interfaces that enable users (both internal and external) to perform complex tasks quickly and efficiently, reducing frustrations, and boosting growth. The insights suggest that embracing AI-driven agent workflows will significantly impact product design, customer satisfaction, and business agility.

Overcoming Skepticism and Cultivating AI Adoption Culture

Brian emphasizes the importance of leadership, permission, and a high-trust culture to foster AI experimentation and scaling. He advocates for giving engineers and teams the confidence and responsibility to push boundaries, even in the face of initial skepticism. Leaders model accountability and emphasize the strategic importance of AI as an existential lever for competitive advantage, encouraging a culture where rapid iteration and learning are normalized. The overall message is that with proper mindset and frameworks, skepticism can be transformed into innovation.

Key Lessons and Final Takeaways

Listeners are left with vital lessons: the significance of systemic measurement, embedding standards into workflows, and fostering a culture of experimentation and risk-taking. The episode illustrates that AI can dramatically boost velocity, quality, and morale if approached thoughtfully. Building trust, metrics, and infrastructure upfront creates a sustainable path to continuous improvement, and organizations should prioritize getting their developer workflows agent-friendly to remain competitive in an AI-driven future.

Sponsors

  • Celigo · Celigo makes AI inside your business processes accessible, connecting systems and turning intent into action with Soligo Aura. Companies like Databricks, PayPal, and OliPOP rely on it to operate at scale.
  • Cursor · Cursor is the favorite multi-model coding platform for building with AI, offering plan mode, AI-generated diffs, cloud agents, and automated code maintenance. It’s trusted by teams at Stripe, OpenAI, and Sigma.

Show notes

Brian Scanlan is a senior principal engineer at Intercom, where he’s led the company’s transformation to AI-first engineering. In just nine months, Intercom doubled their R&D throughput while maintaining code quality, with 100% of engineers—plus designers, PMs, and TPMs—now shipping code via Claude Code.


What you’ll learn:

  1. How Intercom doubled their merged PRs per R&D employee in just nine months using Claude Code
  2. The telemetry infrastructure they built to measure AI adoption and quality across hundreds of engineers
  3. Why they built a skills repository with hooks that enforce engineering standards automatically
  4. How they’re preparing their product for an agent-first world with CLIs, MCPs, and ephemeral APIs
  5. The permission and accountability framework that enabled rapid AI adoption
  6. Why backlog zero is now achievable and what that means for engineering culture

—

Brought to you by:

Celigo—Intelligent automation built for AI

Cursor—The best way to code with AI

—

In this episode, we cover:

(00:00) Introduction to Brian Scanlan

(02:40) Why Intercom went all-in on AI for both product and engineering

(05:01) The breakthrough moment with Opus 4.6 and Christmas break 2025

(07:02) Demo: Intercom’s merged PRs per R&D head

(12:50) Agent-first work as a fundamental reimagining of technical workflows

(14:27) The cost tradeoff: treating AI spend as an investment

(16:47) Measuring quality

(21:22) Demo: Shipping a redirect in the Rails monolith with Claude Code

(24:03) Creating a custom PR skill

(26:33) Building a software factory with predictable quality standards

(30:15) Telemetry infrastructure: Honeycomb for skill usage tracking

(32:10) Session data collection and personalized usage insights

(36:08) Quick overview

(39:20) Walking through Intercom’s skills repository

(42:16) Deep dive: The flaky spec skill and how it reached 100x capability

(46:44) The “and then” workflow for building comprehensive skills

(52:31) The live website and overview of workflows

(53:32) How internal AI experience informs customer product decisions

(56:18) Making SaaS products agent-friendly with CLIs and helpful hints

(01:03:49) Why conversion drop-off is invisible in agent-driven workflows

(01:05:28) Lightning round and final thoughts

—

Detailed workflow walkthroughs from this episode:

• How Intercom Doubled Engineering Output: Brian Scanlan's 4 AI Workflows for Claude Code: https://www.chatprd.ai/how-i-ai/how-intercom-doubled-engineering-output-brian-scanlan-ai-workflows-for-claude-code

• Design an Agent-Friendly CLI to Automate SaaS Product Onboarding: https://www.chatprd.ai/how-i-ai/workflows/design-an-agent-friendly-cli-to-automate-saas-product-onboarding

• Build a Self-Improving AI Agent to Automatically Fix Flaky Tests: https://www.chatprd.ai/how-i-ai/workflows/build-a-self-improving-ai-agent-to-automatically-fix-flaky-tests

• Automate High-Quality Pull Request Descriptions with a Custom AI Skill: https://www.chatprd.ai/how-i-ai/workflows/automate-high-quality-pull-request-descriptions-with-a-custom-ai-skill

—

Tools referenced:

• Claude Code: https://claude.ai/code

• Cursor: https://cursor.com/

• Honeycomb: https://www.honeycomb.io/

• Snowflake: https://www.snowflake.com/

• Fin AI: https://www.intercom.com/fin

• Vercel: https://vercel.com/

—

Other references:

• Intercom GitHub Repo: https://github.com/intercom

• Google API Go Client Repo: https://github.com/googleapis/google-api-go-client

—

Where to find Brian Scanlan:

X: https://x.com/brian_scanlan

LinkedIn: https://www.linkedin.com/in/scanlanb/

Company: https://www.intercom.com

—

Where to find Claire Vo:

ChatPRD: https://www.chatprd.ai/

Website: https://clairevo.com/

LinkedIn: https://www.linkedin.com/in/clairevo/

X: https://x.com/clairevo

—

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email jordan@penname.co.

Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account

Couldn't load the audio. A blocker may be stopping the show's tracking links. Open the file