"An Agile Throwdown: Munich Takes On the Columbus Agile - - PDF document

an agile throwdown munich takes on the columbus agile
SMART_READER_LITE
LIVE PREVIEW

"An Agile Throwdown: Munich Takes On the Columbus Agile - - PDF document

! K3 K3 Keynote! 6/5/2014!8:45:00!AM ! ! ! ! "An Agile Throwdown: Munich Takes On the Columbus Agile Benchmark Study" ! ! ! Presented by: Michael Mah QSM Associates, Inc. ! ! ! ! Brought(to(you(by:( ! ! !


slide-1
SLIDE 1

!

K3 K3

Keynote! 6/5/2014!8:45:00!AM!

! ! !

"An Agile Throwdown: Munich Takes On the Columbus Agile Benchmark Study"

! ! !

Presented by: Michael Mah QSM Associates, Inc.

! ! ! !

Brought(to(you(by:(

! ! ! 340!Corporate!Way,!Suite!300,!Orange!Park,!FL!32073! 888E268E8770!F!904E278E0524!F!sqeinfo@sqe.com!F!www.sqe.com

slide-2
SLIDE 2

! ! ! ! !

!Michael Mah

QSM Associates, Inc.

! !

With twenty-five years of industry experience Michael Mah teaches, writes, and consults for QSM Associates to tech companies on measuring and estimating software projects for offshore, waterfall, and agile. Michael and his QSM partners have researched thousands

  • f projects worldwide. His work examines time-pressure dynamics of

teams and their contribution to project success and failure. Michael’s clients include Boeing, Progressive, Verizon Wireless, Nationwide, JPMorgan Chase, and other Fortune 100 companies. He is the director of the Benchmarking Practice at the Cutter Consortium in the United States. A private pilot, Michael lives in the mountains of western Massachusetts. Reach Michael at qsma.com.! !

slide-3
SLIDE 3

3/17/14 1

Michael Mah QSM Associates, Inc. June 1-6, 2014 Las Vegas, Nevada Caesars Palace

An Agile Throwdown: Munich Germany Takes on the Columbus Agile Benchmark Study

(#2)

Without metrics,

youre just another person with a different opinion.

slide-4
SLIDE 4

3/17/14 2

(#3) (#4)

The Columbus Agile Benchmark Study (Columbus vs the World)

slide-5
SLIDE 5

3/17/14 3

(#5)

Industry Average Schedules* Industry Average Defects* AGILE 30% Quicker Schedules AGILE 75% Fewer Defects 20 40 60 80 100 Comparing Columbus AGILE projects vs. Industry Averages*

  • - 75% Fewer Defects, 30% Quicker Schedules --

*Industry Averages for Defects & Schedules come from the QSM, In database of several thousand Business type applications. (#6)

The QSM SLIM Database

QSM maintains the worlds largest benchmarking database of 12,000+ completed software projects collected worldwide. We put industry productivity statistics on the desktop. The QSM SLIM database contains projects in all industries, waterfall, Agile, offshore/outsourced, in- house, new development, and maintenance. SLIM tools enable managers to measure and estimate Agile and/or waterfall projects.

slide-6
SLIDE 6

3/17/14 4

(#7)

British Telecom SAP Microsoft Intel AT&T/BellSouth Nationwide Motorola VerizonWireless Roche Diagnostics Fiserv Corp IBM Global Misys Healthcare JPMorganChase Boeing Bank of New York Mellon Lockheed Martin Progressive Insurance DirecTV

The QSM SLIM Database

(#8)

How Might Agile Be Successful?

Agile projects can be considered more successful in the sense that they deliver more functionality with fewer defects.

  • Kent Beck

(xp creator)

slide-7
SLIDE 7

3/17/14 5

(#9) (#10)

slide-8
SLIDE 8

3/17/14 6

(#11) (#12)

slide-9
SLIDE 9

3/17/14 7

(#13) (#14)

slide-10
SLIDE 10

3/17/14 8

(#15) (#16)

slide-11
SLIDE 11

3/17/14 9

(#17) footer

The SLIM-Suite

SLIM- Estimate: Size, Schedule, Cost & Quality Estimating

SLIM-DataManager Software Project Metrics Repository

SLIM-Control: Variance Analysis & Adaptive Forecasting SLIM-Metrics: Industry Benchmarking & Process Improvement SLIM- MasterPlan: Incremental Development & Project Aggregation

The SLIM-Suite

(#18)

slide-12
SLIDE 12

3/17/14 10

(#19) (#20)

Project Sketch – Core Metrics

slide-13
SLIDE 13

3/17/14 11

(#21)

Input to SLIM

Size Time Defects Effort

(#22)

Trendline Assessment – Build Phase Schedule

Main Build Phase Duration vs Size 100 1,000 Effective SLOC (thousands) 1 10 100 Time (Months) Rel 5.0 Rel 6.0 Rel 6.5 Rel 7.5 Rel 7.0 Rel 8.0 Rel 5.0 Rel 6.0 Rel 6.5 Rel 7.5 Rel 7.0 Rel 8.0

Business Systems Avionic Systems Command & Control Microcode Systems Process Control QSM 2005 Business

  • Avg. Line Style

1 Sigma Line Style

Faster Schedules

slide-14
SLIDE 14

3/17/14 12

(#23)

Trendline Assessment – Defects/ Quality

Defects During Test 100 1,000 Effective SLOC (thousands) 10 100 1,000 10,000 Errors (SysInt-Del) Rel 5.0 Rel 6.0 Rel 6.5 Rel 7.5 Rel 7.0 Rel 8.0 Rel 5.0 Rel 6.0 Rel 6.5 Rel 7.5 Rel 7.0 Rel 8.0

Business Sy stems Av ionic Sy stems Command & Control Microcode Sy stems Process Control QSM 2005 Business Av g. Line Sty le 1 Sigma Line Sty le

Fewer Defects

Defects During Test 100 1,000 Effective SLOC (thousands) 10 100 1,000 10,000 Errors (SysInt-Del) Rel 5.0 Rel 6.0 Rel 6.5 Rel 7.5 Rel 7.0 Rel 8.0 Rel 5.0 Rel 6.0 Rel 6.5 Rel 7.5 Rel 7.0 Rel 8.0

Business Systems Avionic Systems Command & Control Microcode Systems Process Control QSM 2005 Business

  • Avg. Line Style

1 Sigma Line Style

Fewer Defects

(#24)

Industry Average Current Performance Delta

Project Cost $3.5 Million $2.2 Million

  • $1.3M

Schedule 12.6 months 7.8 months

  • 4.8 mos

QA Defects 242 121

  • 50%

Staffing 35 35 n/a

Follett vs. Industry Average

slide-15
SLIDE 15

3/17/14 13

(#25) (#26)

slide-16
SLIDE 16

3/17/14 14

(#27) (#28)

slide-17
SLIDE 17

3/17/14 15

(#29) (#30)

Agile Captures the Right Metrics for SLIM

Velocity/Burndown Headcount Stories and Point Sizing Bugs

slide-18
SLIDE 18

3/17/14 16

(#31)

The Columbus Agile Benchmark Study (Columbus vs the World)

(#32)

Industry Average Schedules* Industry Average Defects* AGILE 30% Quicker Schedules AGILE 75% Fewer Defects 20 40 60 80 100 Comparing Columbus AGILE projects vs. Industry Averages*

  • - 75% Fewer Defects, 30% Quicker Schedules --

*Industry Averages for Defects & Schedules come from the QSM, In database of several thousand Business type applications.

slide-19
SLIDE 19

3/17/14 17

(#33)

The Munich Agile Benchmark Study (Munich vs the World)

(#34)

slide-20
SLIDE 20

3/17/14 18

(#35)

Munich vs. Columbus

(#36)

July Release: · 4 months duration · 10 FTE staff · 139 Stories, 553 Story Points · Delivered by Adding/Creating (an additional) 26,579 New Code, plus 7,615 Changed Code = 34,194 New and Changed Code (Other code = same/unchanged or deleted) · 45 Defects during QA Testing

Sample Agile Release Summary

slide-21
SLIDE 21

3/17/14 19

(#37) (#38)

slide-22
SLIDE 22

3/17/14 20

(#39)

Staffing - Columbus

Average Staff 1 10 100 1,000 New + Modified Size (thousands) 0.1 1 10 100 FTE Headcount

United States QSM Business

  • Avg. Line Style

1 Sigma Line Style

Larger Teams

(#40)

Average Staff 1 10 100 1,000 New + Modified Size (thousands) 0.1 1 10 100 FTE Headcount

United States QSM Business

  • Avg. Line Style

1 Sigma Line Style

Larger Teams

Staffing - Columbus

Larger Teams

slide-23
SLIDE 23

3/17/14 21

(#41)

Average Staff 1 10 100 1,000 New + Modified Size (thousands) 0.1 1 10 100 FTE Headcount

Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Smaller Teams

Staffing - Munich

Smaller Teams

(#42)

Average Staff 1 10 100 1,000 New + Modified Size (thousands) 0.1 1 10 100 FTE Headcount

Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Smaller Teams Smaller Teams

Staffing - Munich

slide-24
SLIDE 24

3/17/14 22

(#43)

Staffing – Columbus and Munich

Average Staff 1 10 100 1,000 New + Modified Size (thousands) 0.1 1 10 100 FTE Headcount

United States Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Larger Teams Smaller Teams

(#44)

Average Staff 1 10 100 1,000 New + Modified Size (thousands) 0.1 1 10 100 FTE Headcount

United States Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Staffing – Columbus and Munich

Larger Teams Smaller Teams

slide-25
SLIDE 25

3/17/14 23

(#45)

Effort – Columbus

Effort 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 Person-Months

United States QSM Business

  • Avg. Line Style

1 Sigma Line Style

Higher Effort/Cost Lower Effort/Cost

(#46)

Effort – Columbus

Effort 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 Person-Months

United States QSM Business

  • Avg. Line Style

1 Sigma Line Style

Higher Effort/Cost Lower Effort/Cost

slide-26
SLIDE 26

3/17/14 24

(#47)

Effort - Munich

Effort 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 Person-Months

Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Higher Effort/Cost Lower Effort/Cost

(#48)

Effort - Munich

Effort 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 Person-Months

Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Higher Effort/Cost Lower Effort/Cost

slide-27
SLIDE 27

3/17/14 25

(#49)

Effort – Columbus and Munich

Effort 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 Person-Months

United States Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Higher Effort/Cost Lower Effort/Cost

(#50)

slide-28
SLIDE 28

3/17/14 26

(#51)

Speed - Columbus

Time-to-Market 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 Months

United States QSM Business

  • Avg. Line Style

1 Sigma Line Style

Faster Schedules Faster Schedules

(#52)

Time-to-Market 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 Months

United States QSM Business

  • Avg. Line Style

1 Sigma Line Style

Faster Schedules

Speed - Columbus

slide-29
SLIDE 29

3/17/14 27

(#53)

Speed - Munich

Time-to-Market 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 Months

Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Faster Schedules

(#54)

Speed - Munich

Time-to-Market 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 Months

Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Faster Schedules

slide-30
SLIDE 30

3/17/14 28

(#55)

Speed – Columbus and Munich

Time-to-Market 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 Months

United States Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Faster Schedules

(#56)

Speed – Columbus and Munich

Time-to-Market 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 Months

United States Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Faster Schedules

slide-31
SLIDE 31

3/17/14 29

(#57) (#58)

Bugs - Columbus

Defects 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 10,000 Defects

United States QSM Business

  • Avg. Line Style

1 Sigma Line Style

Fewer Defects Fewer Defects

slide-32
SLIDE 32

3/17/14 30

(#59)

Bugs - Columbus

Defects 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 10,000 Defects

United States QSM Business

  • Avg. Line Style

1 Sigma Line Style

Fewer Defects

(#60)

Bugs - Munich

Defects 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 10,000 Defects

Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Fewer Defects

slide-33
SLIDE 33

3/17/14 31

(#61)

Bugs - Munich

Defects 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 10,000 Defects

Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Fewer Defects

(#62)

Bugs – Columbus and Munich

Defects 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 10,000 Defects

United States Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Fewer Defects

slide-34
SLIDE 34

3/17/14 32

(#63)

Bugs – Columbus and Munich

Defects 1 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 10,000 Defects

United States Germany QSM Business

  • Avg. Line Style

1 Sigma Line Style

Fewer Defects

(#64)

Scorecard USA - ? Germany - ?

slide-35
SLIDE 35

3/17/14 33

(#65)

But wait, theres more…

(#66)

slide-36
SLIDE 36

3/17/14 34

(#67)

Columbus Agile Benchmark Trends

Agile Trends - Iterations/Build Phase

Time-to-Market 10 100 1,000 New + Modified Size (thousands) 1 10 100 Months Effort 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 10,000 Person-Months Average Staff 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 Headcount Bugs During QA 10 100 1,000 New + Modified Size (thousands) 1 10 100 1,000 10,000 Defects

(#68)

Youre Invited!

Agile Benchmark Study Anytime Michael Mah The Web

slide-37
SLIDE 37

3/17/14 35

(#69)

Auf den OOP 2013 und 2014 haben Michael Mah und Andrea Gelli überzeugend gezeigt, dass agile Teams in den USA über eine Periode von 10 Jahren schnellere Entwicklungszyklen und eine bessere Qualität erreicht

  • haben. Eine ähnliche Studie wurde im 2013 von QSM in Europa

durchgeführt. Hiermit möchten wir herzlich zur Teilnahme an der QSM "Europe Agile Analysis 2014" einladen. Diese Analyse wird von Michael Mah und Andrea Gelli durchgeführt, ist kostenlos und wird ausschliesslich den Teilnehmenden der OOP 2014 offeriert. QSM wird für diese Studie die gleichen Techniken wie in der USA-Studie anwenden und die Resultate mit den QSM-SLIM Referenz-Daten vergleichen

  • einer der grössten Datenbanken von Software-Projekten.

Die Analyse beinhaltet zwei Teile: Eine Coaching-Session von 45 Minuten für die Erhebung der Projektdaten und, nach Abschluss der Studie, eine WEBEX-Präsentation, die zeigen wird, wie Ihre Projekte gegenüber den QSM-Referenz-Daten abschneiden. Diese Resultate werden vertraulich mitgeteilt: Sie entscheiden, ob Sie diese weitergeben möchten. Sie können mit bis zu fünf Agilen Projekten an der Studie teilnehmen. Für jedes Projekt müssen Sie folgende Grund-Daten ermitteln:

  • Dauer - Start der ersten, Ende der letzten Iteration
  • Aufwand - Personalbestand von Anfang bis Ende
  • Software-Grösse - Cumulative Velocity (Total Stories,

Story Points und Code Statistiken)

  • Qualität - Gefundene Bugs (in QA oder in den letzten 30%

des Projektes) Anmeldungen für die Analyse werden bis zum 28. Februar berücksichtigt (als Anmeldung genügt eine E-Mail an andrea.gelli@qsma.ch). Projektdaten werden bis zum 30. April erwartet. Die WEBEX Präsentation erfolgt anschliessend pro Teilnehmer. Nach der Anmeldung erhalten Sie von QSM eine kurze Anleitung und Termin-Vorschläge für die Coaching Session.

Einladung zur Europe Agile Analysis 2014