Engineering Enablement by DX

Measuring AI impact, assessing readiness, and new data trends

· Summarized

Share this episode
Anyone with this link can open it.
Share Link
Start at 0:00

Key takeaways

  • AI is reshaping the Software Development Life Cycle (SDLC) by influencing more areas than just code generation.
  • AI readiness is crucial and relates directly to foundational elements of developer experience like documentation and standardization.
  • The focus should be on enabling teams through education and experimentation rather than just selecting specific tools for AI.
  • Measuring the ROI of AI involves understanding both its amplification of human efforts and its role in augmenting the workforce with agents.
  • The role of engineers is expected to evolve towards orchestration and leadership, rather than purely coding.
  • Clear specifications and quality documentation are increasingly important as AI tools become integrated into the development process.
  • As AI changes the developer landscape, it also prompts a reconsideration of traditional methodologies such as sprint cycles.

Summary

The Evolution of AI in Software Development Life Cycle (SDLC)

In this section, Jesse Adametz and Abi Noda discuss how AI is increasingly present across the SDLC, moving beyond just code generation to influence various stages such as planning, review, and prototyping. They highlight the need for leaders in developer productivity to steer the conversation towards the future of the SDLC and to recognize where new bottlenecks and opportunities arise in developer experience.

Understanding AI Readiness

The importance of AI readiness is emphasized, with Jesse and Abi noting that many organizations are grappling with the foundational pieces of developer experience—such as standardized environments and documentation—that are critical to effectively incorporating AI into their processes. They explore the risks that come with rushing AI adoption without ensuring readiness.

Enablement over Tool Choice

The conversation shifts to the notion that enablement activities—like education and experimentation—are far more critical than merely choosing the right tools. This section underscores the belief that successful AI implementation depends on how well teams leverage the tools they have rather than which tools they choose.

Measuring ROI and the Impact of AI

Here, the discussion dives into methodologies for assessing AI's return on investment (ROI). They concur that measuring throughput and developer experience scores can provide insight into how AI tools amplify human productivity. The significance of distinguishing between 'amplification' (increased human productivity) versus 'augmentation' (the role of agents) is also discussed.

Role Evolution of Engineers

Jesse and Abi predict an evolution in the role of engineers, suggesting a shift towards orchestration rather than mere coding. They address the potential challenges this poses, such as the necessity for strong leadership and understanding of broader contexts, and distinguish between engineers who thrive in code versus those who may be less keen on a managerial approach.

Specs, Documentation, and Non-Engineers in Coding

As AI tools rise in prominence, so does the need for clear specifications and documentation. This section discusses how the quality of specifications impacts AI performance, and examines the growing trend of non-engineers contributing code. The conversation highlights the implications of this shift for team dynamics and product management.

The Changing Landscape of SDLC

Concluding the episode, Jesse and Abi reflect on questions surrounding the traditional structures of the SDLC, such as sprint cycles. They advocate for the necessity of planning and prioritization while acknowledging the ongoing evolution of workflows triggered by AI advancements.

Sponsors

  • DX · We've developed the AI measurement framework through ongoing research as well as practical experience helping hundreds of companies like booking.com and block.

Show notes

In this episode of Engineering Enablement, Jesse Adametz joins Abi Noda, this time to host. 


Together, they explore how AI is showing up across the SDLC, not just in code generation, and how it is shifting bottlenecks across the development process. They unpack what “AI readiness” actually means in practice, and why it often comes down to developer experience fundamentals like documentation, environments, and feedback loops.

They also discuss why enablement matters more than tool choice, how teams are thinking about measuring ROI, and what changes as background agents become more common. Finally, they explore how the role of the engineer may evolve, the open questions teams are still grappling with, and the challenges of non-engineers contributing to codebases.


Where to find Jesse Adametz: 

• LinkedIn: https://www.linkedin.com/in/jesseadametz 

• X: https://x.com/jesseadametz 

• Website: https://www.jesseadametz.com/


Where to find Abi Noda:

• LinkedIn: https://www.linkedin.com/in/abinoda 


In this episode, we cover:

(00:00) Intro

(02:12) Where AI is showing up across the SDLC

(05:53) AI readiness and its link to developer experience

(08:23) Why enablement, education, and experimentation matter more than tool choice

(13:05) The case for a dedicated enablement team

(14:50) Measuring AI ROI: challenges and tradeoffs

(19:46) Background agents and token spend

(24:12) Measuring agent output with PR throughput

(26:58) How the engineer role might change

(31:01) Specs and documentation in the age of AI

(33:11) Non-engineers writing code

(35:30) What’s changing in the SDLC and open questions


Referenced:

• Measuring AI code assistants and agents

• Lessons from Twilio’s multi-year platform consolidation

• The Phoenix Project: A Novel About IT, DevOps, and Helping Your Business Win

• How Claude remembers your project - Claude Code Docs

• specIsJustCode : r/ProgrammerHumor

Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account

Couldn't load the audio. A blocker may be stopping the show's tracking links. Open the file