Using Metrics to Accelerate Value Stream Flow Making more money, faster Helen Beal Chief Ambassador DevOps Institute @BealHelen helen@devopsinstitute.com 1
Agenda o Why metrics matter Helen Beal o What metrics matter Chief Ambassador o How to get your metrics @BealHelen DevOps and Ways of Working coach, consultant, o When metrics matter learning facilitator. Writer, speaker, analyst and o Metrics evolution strategic advisor. 2 2 2
Why Metrics Matter 3 3 3
Why Metrics Matter “Without a knowledge of what your work is We manage what we measure • really costing you, you They provide insights into • are in no position to say improvement opportunities to what extent your real They show progress • costs vary from what A DevOps journey is a big • your work should cost investment – we need to know the you. You have no gauge on return performance. Further, The goal is to become, or retain a • because you don’t position, as a high performing employ time-study organization methods and have no Core to DevOps culture is trust: • definite tasks, you have data is evidence and builds trust no means of knowing what performance should be.” 1918 4 4
Who Metrics Matter To “High-velocity managers are not in place to command, control, berate, intimidate, or evaluate through a contrived set of metrics, but to ensure that their organizations become ever more self- diagnosing and self-improving, skilled at detecting problems, solving them, and multiplying the effect by making the solutions available throughout the organization.” Dr. Stephen Spear 5 5
What Metrics Matter 6 6 6
A C C E L E R A T E State of DevOps 2019 Aspect of So f ware Delivery Performance* Elite High Medium Low Deployment frequency On-demand Between once Between once Between once For the primary application or service you work on, how (multiple per day and per week and per month and o f en does your organization deploy code to production deploys per day) once per week once per month once every six or release it to end users? months Lead time for changes Less than Between one Between one Between one For the primary application or service you work on, what is your one day day and week and month and lead time for changes (i.e., how long does it take to go from code one week one month six months committed to code successfully running in production)? Time to restore service Less than Less than Less than Between one For the primary application or service you work on, how long one hour one day a one day a week and does it generally take to restore service when a service incident one month or a defect that impacts users occurs (e.g., unplanned outage or service impairment)? Change failure rate 0-15% b,c 0-15% b,d 0-15% c,d 46-60% For the primary application or service you work on, what percentage of changes to production or released to users result in degraded service (e.g., lead to service impairment or service outage) and subsequently require remediation (e.g., require a hotfix, rollback, fix forward, patch)? 7 7 7
Velocity Flow Velocity is the number of flow Items of each type completed over a particular period of time - also referred to as throughput Distribution Flow Distribution measures the ratio of the four Flow Items completed over a particular window of time Time Flow Time measures the time it takes for Flow Items to go from ‘work start’ to ‘work complete’, including both active and wait times Efficiency Flow Efficiency is the ratio of active time vs. wait time out of the total Flow Time Load Flow Load measures the number of Flow Items currently in progress (active or waiting) within a particular value stream 8 8
Definition of Value value noun /ˈvæl.juː/ 1. The amount of money that can be received for something 2. The importance or worth of something for someone 9 9
How to Get Your Metrics 10 10 10
Start with Value Stream Thinking 6 5 Selecting Which Understanding the Work in Value Stream Our Value Stream, Making it to Start With Visible, and Expanding it Across the Organization “Once we have identified a value stream to which we want to apply DevOps principles and patterns, our next step is to gain a sufficient understanding of how value is delivered to the customer: what work is performed and by whom, and what steps can we take to improve flow.” 11 11
Start with Value Stream Mapping 12 12
Virtual Value Stream Mapping 13 13
Move to Value Stream Management Value Stream Management Tools The Forrester New Wave™: Value Stream Q3 2018 Management Tools, Q3 2018 Strong Challengers Contenders Performers Leaders The 13 Providers That Matter Most And How They Stack Up by Christopher Condo and Bill Seguin Stronger current August 6, 2018 offering CollabNet VersionOne Plutora Targetprocess XebiaLabs Jama Software VSM is an emerging tool category that connects Intland Software an organization’s business to its software delivery Blueprint Software Systems GitLab capability. VSM tools provide multiple roles — Panaya Tasktop CA Technologies product managers, developers, QA, and Electric Cloud release managers — a view into planning, health indicators, and analytics, helping them CloudBees collaborate more effectively to reduce waste Weaker current and focus on work that delivers value to the offering customer and the business. Weaker strategy Stronger strategy Market presence* *Gray marker indicates incomplete vendor participation. 14 14
A Value Cycle INSIGHTS AND ANALYSIS PORTFOLIO AND BACKLOG Monitoring and observability provide Vision and goals are set and insights into customer reaction to changes aligned to epics, features, PBIs and report on value realization. and user stories. CONTINUOUS DELIVERY CONTINUOUS INTEGRATION The changes are approved, released and Code is created, artifacts operated in the live incorporated, versions environment. controlled, code is built in a trunk based manner. CONTINUOUS TESTING Functional and non-functional testing takes place at every commit at every step or 15 15 gate through route to live.
Where Metrics Live Value Stream Management: FLOW & CYCLE TIME Portfolio & Continuous Continuous Continuous Insights and Backlog Integration Testing Delivery Analysis Tool Jira Jenkins Jenkins ServiceNow New Relic Metric Lead Time Deployment Defect rate Change fail Value Frequency rate, MTTR 16 16
When Metrics Matter 17 17 17
When Metrics Matter product is euthanized) Ad infinitum (or until DevOps Journey Sprint Sprint Sprint Sprint Sprint Sprint Baseline 18 18 18
When Metrics Matter product is euthanized) Ad infinitum (or until DevOps Journey Sprint Sprint Sprint Sprint Sprint Sprint Baseline 19 19 19
When Metrics Matter Sprint Review Inspect success of sprint goal using value stream metrics – inspect Value Stream Management Tool Sprint Planning Align sprint goal to value stream metrics – inspect Sprint Value Stream Sprint Retro Management Tool Look for improvement opportunities – inspect insights from Value Stream Management Tool 20 20 20
Metrics & The Improvement Kata 1 2 4 3 Inspect Set next Set the current target long term PDCA condition state vision 21 21
Metrics Evolution product is euthanized) Ad infinitum (or until DevOps Journey Sprint Sprint Sprint Sprint Sprint Sprint Baseline Deployment Deployment frequency: Once frequency: On every three demand months 22 22 22
THANK YOU! Meet me in the Network Chat Lounge for questions 23 23 23
Recommend
More recommend
