BEWARE THE DARK SIDE OF METRICS! Agile Arizona 2019 Barbara - - PowerPoint PPT Presentation

▶
beware the dark side of metrics
SMART_READER_LITE
LIVE PREVIEW

BEWARE THE DARK SIDE OF METRICS! Agile Arizona 2019 Barbara - - PowerPoint PPT Presentation

Dec 24, 2022 289 likes •513 views

BEWARE THE DARK SIDE OF METRICS! Agile Arizona 2019 Barbara Anderson Unrestricted Content 11/27/19 1 This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations

slide-1
SLIDE 1

11/27/19

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

1

BEWARE THE DARK SIDE OF METRICS!

  • Agile Arizona 2019
  • Barbara Anderson
slide-2
SLIDE 2

2 Scrum@Scale Trainer

slide-3
SLIDE 3

Team Working Agreement

11/27/19

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

3

slide-4
SLIDE 4

Why do we collect metrics?

  • Group exercise:
  • At your tables, take 5 minutes to create a list of agile metrics & why each is useful

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

4

slide-5
SLIDE 5

Performance Tracking Mechanisms

  • Burndown Charts
  • Utilized to predict when all work in

an increment will be completed

  • Remember that story points are

relative estimates and therefore burndown will be relative estimate

  • f scope left

5

Burndown Charts Provide Quick Visual of Planned Work Remaining

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

slide-6
SLIDE 6

Performance Tracking Mechanisms

  • Velocity Charts
  • Measures amount of work a team can

tackle during a single sprint

  • Velocities trending downwards indicate

problems within a team

  • Continuously improving teams should

see upward trends as processes are streamlined and barriers are removed

  • Average velocity and standard

deviation of velocity are useful metrics for predicting amount of scope team can achieve in future sprints

6

Velocity Charts Provide Visual of Team Performance Trends

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

slide-7
SLIDE 7

Sprint Tracking Mechanisms

  • Using a burnup chart allows

ease of visualizing situation where team finishes early and brings in additional work

7

Sprint Burnup shows progress in meeting iteration goals

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

slide-8
SLIDE 8

Example burn-up charts

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

5 10 15 20 25 30 35 40 10 20 30 40 50 5 10 15 20 25 30 35 40 45 50 5 10 15 20 25 30

Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9 Day 10 Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9 Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9 Day 10 Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9 Day 10 Day 10

slide-9
SLIDE 9

Sprint Tracking Mechanisms

  • Story and Task Boards
  • Communicates progress in the current

sprint to stakeholders

  • Focuses team on highest priority work
  • Promotes transparency and visibility of

work

  • Signs of healthy sprints:
  • Highest priority items completing early
  • Limited work in progress
  • Warning signs during a sprint:
  • No items completed, high quantity of items

in progress

  • Lower priority items completed, higher

priority items not started

9

Story and Task Boards Provide Daily Visual Communication

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

slide-10
SLIDE 10

How is this team doing?

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

1

slide-11
SLIDE 11

Managing WIP

  • Cumulative Flow Diagram
  • Clearly visualizes work in progress (vertical

line)

  • Shows lead time & cycle time (horizontal

lines)

11

Cumulative Flow Diagram provides ability to visualize & manage WIP

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

slide-12
SLIDE 12

https://welcome.wf.com/renew/

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

12

What is the context behind this Wells Fargo message?

slide-13
SLIDE 13

Metrics and Transparency

  • Metrics must make people have conversations

and to provide frequent and regular feedback.

  • Goodhart’s Law: when a measure becomes a

target, it ceases to be a good measure.

  • Metrics can be used as part of Kaizen, continuous

improvement.

  • Beware of the “dark side” of Metrics.
  • The misuse of a metric, often by leadership, is

likely to promote the intentional manipulation

  • f the metric, a dysfunctional behavior usually

referred as “gaming.”

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

1 3

slide-14
SLIDE 14

Spurious Correlations

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

14

https://www.tylervigen.com/spurious-correlations

slide-15
SLIDE 15

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

15

https://www.tylervigen.com/spurious-correlations

Spurious Correlations

slide-16
SLIDE 16

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

16

https://www.tylervigen.com/spurious-correlations

Spurious Correlations

slide-17
SLIDE 17

Four Lenses for Measuring Progress

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

17

Are we improving our ability to deliver product over time? Are we prioritizing the right features to deliver first? Are we meeting our quality standards? Are we working in a way we can continue for the long run? Productivity Value Delivery Quality Sustainability

slide-18
SLIDE 18

Discuss:

  • Leading/Lagging
  • Pros/Cons
  • Side effects
  • Be ready to present a good

metric and a bad metric. Describe why.

Discussion: What metrics should we track?

18

Productivity Value Delivery Quality Sustainability

Brain storm metrics for your table’s topic

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

slide-19
SLIDE 19

Looking at Metrics Together Reveals Insight

19

Sprint Velocity (points) Quarter Rev $/point

Sprint

Happiness rating

The Team is working well

Sprint Velocity (points)

Quarter

Rev $/point

Sprint

Happi- ness

Team is driving velocity by focusing on easy, low-value stories

Sprint Velocity (points)

Quarter

Rev $/point

Sprint

Happi- ness

Team is burning out to deliver results

A B C

V

$

H

Conclusion

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

slide-20
SLIDE 20

Program Velocity - Grouped by Value

20

High Value

Legend:

Medium Value Unassigned Low Value

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

slide-21
SLIDE 21

21

Discussion / Questions?

Unrestricted Content This document does not contain technology or technical data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.