0:0019:18

The Yin and the Yang of managing complex technical projects

Nadia Clifford 19:18 2023

Complex tech projects can't be controlled, only kept in balance

On a typical complexity graph, predictability plummets from 100% to zero at just seven variables, and a modern tech initiative has far more. That is why squeezing complexity into the neat boxes of milestones or even Agile sprints so often fails. Nadia Clifford, a senior engineering program director whose work spans thousands of IoT devices on New York City subway trains, turns to a 5,000-year-old philosophy to ask what should replace control.

Get five practical balances, from mind mapping to t-shirt sizing, for steering complex projects

Watch on YouTube

In short

Nadia Clifford argues that modern technology initiatives meet the scientific definition of complex systems, so linear plans and rigid control are bound to disappoint. Drawing on complexity theory and the Taoist idea of yin and yang, she shows how to manage projects by balancing complementary forces such as structure and flow, detail and vision, scope and time, and execution and reflection.

“Predictability and control fall dramatically as complexity rises, which essentially means it's impossible to know with any certainty the effects of a single action in a complex system.”
“And we have literally shortened projects by several months just because we allowed ideas to flow.”

What you will learn

  • Recognize why a technology initiative meets the scientific definition of a complex system and why tight control fails.
  • Open new development with a mind mapping session before moving into structured planning.
  • Estimate annual roadmaps with high-level t-shirt sizes and save low-level detail for execution.
  • Decide explicitly as an organization whether time or scope flexes when the two collide.
  • Build reflection into team and leadership rhythms instead of executing nonstop.

Key takeaways from the speaker

  • Understanding why complex technology is so difficult to manage and why a lot of methodologies fail
  • Understanding of a new mindful approach to managing complex technology initiatives
  • Ideas on balancing structure and flow, such as disciplined execution vs space for innovation

Details

Level
Intermediate
Format
Talk
Technical depth
Introductory technical
For
Mid-career, Senior individual contributor, People manager
Length
19:18
Published
June 2023

Questions this talk answers

Why are complex technology projects so hard to manage?

A tech initiative's software, infrastructure, hardware and people are diverse, connected, interdependent and adaptable, so the system's behavior cannot be inferred from its parts. Predictability falls sharply as variables increase, making rigorous control impossible.

What does yin and yang have to do with project management?

Yin and yang describes complementary opposites in dynamic balance, and imbalance creates stress. Clifford applies it to pairs such as structure and flow, detail and vision, scope and time, and execution and reflection.

How should teams estimate an annual roadmap when details are unknown?

Clifford has teams give high-level relative t-shirt size estimates, framed as gut feel rather than precision. Low-level detail comes later, when the team is ready to execute.

What should happen when scope and time conflict?

The organization needs a crucial conversation about which one it can adjust. If the timeline is hard, scope should be negotiable, and if scope is non-negotiable, the timeline should move.

Does balance mean keeping everything at 50/50?

No. Dynamic balance flows from 80/20 to 70/30 to 50/50, and the natural healthy state is for the balance to move.

About this talk

Nadia Clifford is a seasoned technology delivery leader. She has worked on highly complex projects - from a biotech science system to a crypto platform to the largest IoT network on public transit. As a result, Nadia knows firsthand the pitfalls of traditional linear thinking of fitting high complexity into the neat boxes of project milestones or even Agile sprints.

In this talk, she reveals the secrets of approaching complexity in technology (and beyond) using the ancient philosophy of the Yin and the Yang, balancing Structure and Flow. Find out how this new old mindset can help you see complexity and risk management in a completely new light.

Topics

Related talks

Browse the library