Designing the AI‑native engineering organization with 1Password, Microsoft and Atlassian
· Summarized
Key takeaways
- AI is reshaping engineering structures, promoting smaller, agile teams that focus on rapid learning and experimentation.
- The role of engineers is shifting toward a maker’s mindset—being adaptable, generalist, and outcome-oriented—integrating more product management and design skills.
- Adoption of AI is best encouraged through culture, enablement, and local champions, rather than mandates, with success measured by outcomes like speed, quality, and productivity.
- The software development lifecycle is moving towards planning and validation driven by AI, reducing build time and increasing emphasis on design and verification.
- Effective measurement of AI's impact involves tracking token usage, feature delivery speed, and qualitative success, with a focus on demonstrating business value.
Summary
Transformation of Engineering Teams through AI
The panel discusses how AI is influencing engineering organization structures and planning cycles. The trend shows smaller, cross-functional teams forming for specific projects, especially for zero-to-one initiatives, leveraging AI to accelerate building and learning processes. There's a shift from long-term planning (12-18 months) to much shorter, quarter-based planning due to rapid industry pivots, particularly in security. These organizational changes aim to optimize speed, experimentation, and learning, while maintaining clarity on long-term vision.
Evolving Roles and Skills of Engineers in an AI Era
Engineers' roles are evolving from traditional coding tasks towards a maker's mindset—being objective-oriented and craft-focused. The panel highlights the blurring boundaries between product managers, designers, and engineers, with more product engineers involved early in prototyping. Success is increasingly tied to generalist capabilities, problem abstraction, and decision-making agency. There is a strong emphasis on hiring and nurturing individuals with a maker’s mindset, adaptability across the tech stack, and the ability to influence product outcomes.
AI Adoption: Culture, Enablement, and Measurement
Rather than mandating AI use, organizations are fostering adoption through enablement, training, and local champions, encouraging experimentation without strict mandates. Measurement focuses on outcomes like speed, ease, and quality, rather than activity metrics. The panel discusses the importance of understanding not just AI activity but also its impact on business metrics, productivity, and product lifecycle. Challenges include measuring ROI, managing token costs, and balancing innovation with responsible governance—particularly around critical systems like security and infrastructure.
Future of the Software Development Lifecycle and Human Judgment
AI is dramatically transforming the SDLC, especially in planning and validation, shifting much of the human effort from coding to designing and verifying. Prototype-driven development accelerates requirements gathering and technical validation, reducing lead times and promoting quality. Human oversight remains essential, particularly in security, high-stakes components, and maintaining code quality. As AI advances, parts of the SDLC like incident response, operational management, and toil reduction are expected to become increasingly automated, with human expertise still crucial for complex decisions.
Measuring and Communicating AI Impact to Leadership
Effective measurement involves tracking token usage, feature velocity, adoption metrics, and qualitative feedback. The goal is to demonstrate how AI accelerates product delivery, improves developer efficiency, and contributes to business outcomes. When reporting to executives and boards, organizations connect AI investments to revenue, customer adoption, and operational efficiency, emphasizing the importance of experimentation for long-term learning, even if immediate ROI is hard to quantify.
Sponsors
- 1Password · Nancy Wang, CTO of 1Password, leads innovation across security and AI.
- Microsoft · Tim Bozarth, Corporate VP at Microsoft’s Core AI division, focuses on AI-driven developer experiences and internal infrastructure.
- Atlassian · Taroon Mandana, CTO of AI and Teamwork at Atlassian, oversees engineering for Jira, Confluence, Loom, and Rovo, and focuses on developer productivity.
Show notes
Abi Noda is joined live at DX Annual by three engineering leaders shaping AI adoption at scale: Tim Bozarth, Corporate Vice President in Microsoft’s CoreAI division; Nancy Wang, CTO of 1Password; and Taroon Mandhana, CTO of AI and Teamwork at Atlassian. Together, they discuss how AI is changing engineering organizations, from team structures and planning cycles to hiring, governance, and measurement.
The panel explores how the profile of a great engineer is evolving, why smaller cross-functional teams are becoming more effective, and what happens when product managers, designers, and customer support teams start contributing code. They also share why they are encouraging AI adoption through enablement, training, and local champions rather than mandates, and how AI is shifting more of the software development lifecycle toward planning and validation.
Finally, they discuss where human judgment remains essential, how to measure adoption and manage token usage, and how to connect AI investments to business outcomes while preserving room for experimentation and learning.
Where to find Nancy Wang:
• LinkedIn: https://www.linkedin.com/in/wangnancy
Where to find Taroon Mandhana:
• LinkedIn: https://www.linkedin.com/in/taroonm
Where to find Tim Bozarth:
• LinkedIn: https://www.linkedin.com/in/tbozarth
Where to find Abi Noda:
• LinkedIn: https://www.linkedin.com/in/abinoda
In this episode, we cover:
(00:00) Intro
(01:08) Introducing the panelists
(02:16) AI’s impact on engineering team structures and planning cycles
(05:00) How the role of the engineer is changing and what makes a great engineer
(10:11) The opportunities and challenges of non-engineers writing code
(15:26) Encouraging AI adoption without mandating it
(21:25) What an AI-native SDLC looks like and why human judgment still matters
(30:56) Measuring AI adoption, token usage, and ROI
(37:06) How to tie AI investments to business outcomes
Referenced:
• DX Core 4 Productivity Framework
• Jira
• Loom
• Rovo
Follow this show on AudioBrevity and new episodes get summarized for you. Create a free account