AI and productivity: A year-in-review with Microsoft, Google, and GitHub researchers

Dec 29, 2025 · Summarized Dec 29, 2025

Listen in Apple Podcasts Pocket Casts Castro

Key takeaways

Measuring AI's impact requires a nuanced, multidimensional approach that goes beyond traditional metrics.
Developer roles are evolving, particularly for junior engineers, who may now focus more on orchestration and collaboration with AI.
Relying on simplified metrics, like lines of code, can obscure the true picture of productivity and performance.
Trust and collaboration are essential as developers begin to work alongside AI, with an emphasis on maintaining interpersonal skills.
Looking towards 2026, organizations should focus on leveraging AI to enhance developer experiences and solve existing pain points.

Summary

The Increasing Complexity of Measuring AI Impact

In this episode, the panel emphasizes the difficulty in measuring the true impact of AI on developer productivity and organizational outcomes. With 90% of developers using AI tools regularly, the discussion centers around the need for a multidimensional approach to metrics, moving beyond traditional measurements like lines of code. The guests share insights on frameworks like SPACE and DORA that provide a more nuanced view of how AI affects developers.

Evolving Developer Roles and Skill Sets

The role of developers is shifting significantly as AI tools become more prevalent. Panelists discuss the transition in junior engineers' skill sets as they focus on orchestration of tasks and collaboration with AI. The conversation also touches on how AI may impact the learning curve for junior engineers, with a potential enhancement in their skills due to AI guidance, rather than replacement.

The Dangers of Simplified Metrics

A recurring theme in the discussion is the misinterpretation of metrics, particularly lines of code, which is often seen as a straightforward indicator of productivity. The panel critiques this approach and argues for a broader understanding of metrics that reflect the complexities of developer work. They highlight the dangers of relying on oversimplified metrics and the necessity for organizations to adopt more comprehensive measurement frameworks.

Collaboration, Trust, and the Future of Team Dynamics

As AI tools become integrated into workflows, the importance of collaborative dynamics is emphasized. Panelists discuss how developers interact with AI and the trust issues surrounding these tools. They highlight the need to ensure that AI adoption does not lead to the downfall of critical interpersonal skills, thereby maintaining a balance between technology and human collaboration.

Looking Ahead: AI Trends for 2026

In this forward-looking segment, the panel explores potential trends for AI and how they might influence the software development landscape moving into 2026. Discussions include the emergence of agent workflows, collaborative team integrations with AI, and a renewed focus on developer happiness and productivity. The guests underscore the importance of continuous research to understand the evolving technology landscape.

Show notes

As AI adoption accelerates across the software industry, engineering leaders are increasingly focused on a harder question: how to understand whether these tools are actually improving developer experience and organizational outcomes.

In this year-end episode of the Engineering Enablement podcast, host Laura Tacho is joined by Brian Houck from Microsoft, Collin Green and Ciera Jaspan from Google, and Eirini Kalliamvakou from GitHub to examine what 2025 research reveals about AI impact in engineering teams. The panel discusses why measuring AI’s effectiveness is inherently complex, why familiar metrics like lines of code continue to resurface despite their limitations, and how multidimensional frameworks such as SPACE and DORA provide a more accurate view of developer productivity.

The conversation also looks ahead to 2026, exploring how AI is beginning to reshape the role of the developer, how junior engineers’ skill sets may evolve, where agentic workflows are emerging, and why some widely shared AI studies were misunderstood. Together, the panel offers a grounded perspective on moving beyond hype toward more thoughtful, evidence-based AI adoption.

Where to find Brian Houck:

• LinkedIn: https://www.linkedin.com/in/brianhouck/

• Website: https://www.microsoft.com/en-us/research/people/bhouck/

Where to find Collin Green:

• LinkedIn: https://www.linkedin.com/in/collin-green-97720378

• Website: https://research.google/people/107023

Where to find Ciera Jaspan:

• LinkedIn: https://www.linkedin.com/in/ciera

• Website: https://research.google/people/cierajaspan/

Where to find Eirini Kalliamvakou:

• LinkedIn: https://www.linkedin.com/in/eirini-kalliamvakou-1016865/

• X: https://x.com/irina_kAl