Engineering Enablement by DX
The science behind DORA | Derek DeBellis (Google)
This episode isn’t summarized yet
Create a free account and summarize it. In a few minutes you’ll have the key takeaways and a section-by-section summary.
Show notes
Click here to view the episode transcript.
In this week's episode, we welcome Derek DeBellis, lead researcher on Google's DORA team, for a deep dive into the science and methodology behind DORA's research. We explore Derek's background, his role at Google, and how DORA intersects with other research disciplines. Derek takes us through DORA's research process step by step, from defining outcomes and factors to survey design, analysis, and structural equation modeling.
Mentions and Links:
- Derek DeBellis on LinkedIn
- DX’s guide to measuring GenAI adoption and impact
- 2023 Accelerate State of DevOps Report
Discussion points:
- (3:00)Derek’s transition from Microsoft to the DORA team at Google
- (4:28) Derek talks about his connection to surveys
- (6:16) Derek’s journey to becoming a quantitative user experience researcher
- (7:48) Derek simplifies DORA
- (8:19) DORA - Philosophy vs practice
- (11:09) Understanding desired outcomes
- (12:45) Self reported outcomes vs objective outcomes
- (16:16) Derek and Abi discuss the nuances of literature review
- (19:57) Derek details survey development
- (27:55) Pretesting issues
- (29:30) Designing surveys for other companies
- (35:02) Derek simplifies model analysis and validation techniques
- (38:48) Benchmarks: Balancing data limitations with method sensitivity