DX Core 4: 2024 benchmarks

Key takeaways

The DX Core 4 framework provides an integrated approach to measure productivity, drawing from established methodologies like Dora, Space, and DevX.
2024 benchmarks reveal crucial insights about engineering performance across over 500 companies, aiding organizations in contextualizing their productivity.
Variations in performance metrics among tech and non-tech companies highlight how industry context affects developer productivity.
Metrics like Change Failure Rate and Developer Experience Index should be viewed collectively to understand the full picture of engineering effectiveness.
Utilizing benchmark data effectively requires establishing baselines, continuous performance tracking, and telling a compelling story to stakeholders about productivity improvements.

Summary

Overview of the DX Core 4 Framework

In this episode, the hosts, Avi and Laura, revisit the DX Core 4 framework for measuring developer productivity. They explain how this framework integrates various existing models like Dora, Space, and DevX, providing a comprehensive method for understanding productivity. This is important for organizations looking to improve their performance and is based on extensive research and practical applications with companies like Dropbox, Etsy, and Pfizer.

Introduction of the 2024 Benchmarks

The hosts announce the launch of the 2024 DX Core 4 benchmarks, which are critical for engineering leaders seeking to contextualize their organizational performance against industry standards. They discuss the first set of benchmarks—data gathered from over 500 companies—and the importance of using benchmarks to set high performance standards and assess where organizations stand relative to their peers.

Key Insights from Benchmark Data

Avi and Laura dive into the insights derived from the benchmark data, discussing findings like the difference in PR throughput between tech and non-tech companies, and the unique challenges that mobile engineers face. They share how developer experience impacts overall productivity and highlight the variance in performance even within different tech startups.

Interpreting Developer Experience Index and Change Failure Rate

The episode also explores the Developer Experience Index, which gauges how frictionless the developer’s environment is, and the Change Failure Rate, a critical metric used to measure the quality of changes made in production. The presenters discuss how higher failure rates in larger tech companies correlate with rapid growth and organizational challenges. They emphasize the importance of understanding these metrics as interconnected rather than standalone.

Using Benchmarking Data Effectively

Finally, Avi and Laura provide practical advice on leveraging benchmarking data within organizations. The key is to establish a baseline, continuously monitor performance through internal and external benchmarks, and communicate effectively with decision-makers to drive investments in areas that need improvement. They emphasize telling a compelling story with data, making it relevant, and ensuring that several performance dimensions are considered together.

Show notes

In this episode, Abi and Laura dive into the 2024 DX Core 4 benchmarks, sharing insights across data from 500+ companies. They discuss what these benchmarks mean for engineering leaders, how to interpret key metrics like the Developer Experience Index, and offer advice on how to best use benchmarking data in your organization.

Mentions and Links:

DX core 4 benchmarks
Measuring developer productivity with the DX Core 4
Developer experience index (DXI)
Will Larson’s article on the Core 4 and power of benchmarking data

Discussion points:

(0:42) What benchmarks are for
(3:44) Overview of the DX Core 4 benchmarks
(6:07) PR throughput data
(11:05) Key insights related to startups and mobile teams
(14:54) Change fail rate data
(19:42) How to best use benchmarking data