DEVOPS METRICS ANDREW SHAFER - PATRICK DEBOIS - ISRAEL GAT Thursday 16 June 2011
Patrick Debois Jedi @patrickdebois http://jedi.be/blog http://www.vectronicsappleworld.com/collection/articlepics/joysticks/snap23.jpg Thursday 16 June 2011
Israel Gat Cutter Consortium @agileexec http://theagileexecutive.com Thursday 16 June 2011
Andrew Shafer - Rabble Rouser - Cloudscaling @littleidea - http://stochasticresonance.wordpress.com Thursday 16 June 2011
http://www.flickr.com/photos/quinnanya/3588989219 Thursday 16 June 2011
http://www.flickr.com/photos/zen/3233023066/ Thursday 16 June 2011
To Compare http://www.flickr.com/photos/thebusybrain/2492945625/ Thursday 16 June 2011
http://www.flickr.com/photos/topshampatti/219953012/ Thursday 16 June 2011
To Understand Thursday 16 June 2011
To Protect Thursday 16 June 2011
To Improve http://www.flickr.com/photos/vizzzual-dot-com/2655969483/ Thursday 16 June 2011
Describing a Metric http://www.flickr.com/photos/chandramarsono/4324373384/ Thursday 16 June 2011
Describing a Metric • basis of measurement http://www.flickr.com/photos/chandramarsono/4324373384/ Thursday 16 June 2011
Describing a Metric • basis of measurement • assumptions http://www.flickr.com/photos/chandramarsono/4324373384/ Thursday 16 June 2011
Describing a Metric • basis of measurement • assumptions • level and usage http://www.flickr.com/photos/chandramarsono/4324373384/ Thursday 16 June 2011
Describing a Metric • basis of measurement • assumptions • level and usage • desired trend http://www.flickr.com/photos/chandramarsono/4324373384/ Thursday 16 June 2011
Describing a Metric • basis of measurement • assumptions • level and usage • desired trend • when to use http://www.flickr.com/photos/chandramarsono/4324373384/ Thursday 16 June 2011
Describing a Metric • basis of measurement • assumptions • level and usage • desired trend • when to use • when to stop http://www.flickr.com/photos/chandramarsono/4324373384/ Thursday 16 June 2011
Describing a Metric • basis of measurement • assumptions • level and usage • desired trend • when to use • when to stop • how to game http://www.flickr.com/photos/chandramarsono/4324373384/ Thursday 16 June 2011
Describing a Metric • basis of measurement • assumptions • level and usage • desired trend • when to use • when to stop • how to game • warnings http://www.flickr.com/photos/chandramarsono/4324373384/ Thursday 16 June 2011
Beware of Vanity Metrics UNACTIONABLE INACCESSIBLE UNAUDITABLE http://www.flickr.com/photos/centralasian/5829549813/ Thursday 16 June 2011
Red is good , Green is worthless • http://www.reliableplant.com/Read/21305/lean-metrics-red-is-good,-green-is-worthless Thursday 16 June 2011
Thursday 16 June 2011
“In truth, a good case could be made that if your knowledge is meagre and unsatisfactory, the last thing in the world you should do is make measurements; the chance is negligible that you will measure the right things accidentally.” George Miller http://stochasticresonance.wordpress.com/2008/08/03/miles-per-gallon/ Thursday 16 June 2011
What we can learn from monitoring http://www.experimentalistsanonymous.com/stuff/paralleluniverse/images/2edmoneyshot.jpg Thursday 16 June 2011
Level 0 - Individual Resource Thursday 16 June 2011
Availability Processes, Port,SSH Login Network, Memory, CPU Thursday 16 June 2011
Availability Processes, Port,SSH Login Network, Memory, CPU Thursday 16 June 2011
Capacity Processes, Port,SSH Login Network, Memory, CPU Thursday 16 June 2011
Capacity Processes, Port,SSH Login Network, Memory, CPU Thursday 16 June 2011
Health Thresholds http://www.smiley-faces.org/wallpaper/smiley-face-wallpaper-001.jpg http://www.geocities.jp/nikonikocalendar/index_en.html Thursday 16 June 2011
Health Thresholds http://www.smiley-faces.org/wallpaper/smiley-face-wallpaper-001.jpg http://www.geocities.jp/nikonikocalendar/index_en.html Thursday 16 June 2011
Metric versus Diagnostic Does it contribute to Yes Measurement Metric the bottom line? No Diagnostic Pete Behrens, Trail Ridge Consulting http://www.slideshare.net/krivitsky/agile-metrics-presentation-654259 Thursday 16 June 2011
Level 1 - Services Level Thursday 16 June 2011
Performance SSH, HTTP , NTP Thursday 16 June 2011
Performance SSH, HTTP , NTP # Servers/Admin Thursday 16 June 2011
Performance SSH, HTTP , NTP # Servers/Admin # Line of Code/Developer Thursday 16 June 2011
“Gameable” http://kithicor.org/wp/wp-content/uploads/2010/01/gamerEvolution.jpg Thursday 16 June 2011
Level 2 - Team Level Thursday 16 June 2011
Aggregation LB-WEB WEB WEB WEB 2 3 1 Thursday 16 June 2011
Aggregation DEV Project Team DEV DEV DEV Thursday 16 June 2011
Burn up chart Thursday 16 June 2011
Team Utilization Thursday 16 June 2011
“Velocity also has a direction component ” http://www.randomstew.com/wp-content/uploads/mooneye.jpg Thursday 16 June 2011
What about efficiency? http://www.flickr.com/photos/jdiggans/92981578/ Thursday 16 June 2011
http://sievertschreiber.files.wordpress.com/2009/12/good-code-is-measured-in-wtf-per-minute.jpg Thursday 16 June 2011
Incentives & Behaviors http://www.flickr.com/photos/turtlemadness/2439050717/ Thursday 16 June 2011
Development Operations Level 3 - Integration Level http://www.xgn.nl/images/upload/20081020225036.jpg http://www.kawaiikakkoiisugoi.com/wp-content/uploads/2011/03/pacman-screen.jpg Thursday 16 June 2011
Integration WEB DB APP Thursday 16 June 2011
Collaboration QA DEV OPS # of deploys / day http://www.sage.org/lists/sage-members-archive/2001/msg01208.html http://www.datacenterknowledge.com/archives/2009/12/30/how-many-servers-can-one-admin-manage/ http://fc04.deviantart.net/fs70/f/2010/108/2/3/Pac_Man_Widescreen_by_molotov_arts.jpg Thursday 16 June 2011
Counting Collaboration More interaction doesn’t mean a better party • http://www.nature.com/news/2010/101013/full/news.2010.538.html Thursday 16 June 2011
Measuring Collaboration? “Play Nice Study” http:///www.healthylarimer.org/documents/PlayNice.ppt Thursday 16 June 2011
Levels Collaboration Collaboration Coalition Coordination Cooperation Thursday 16 June 2011
Cooperation provide information somewhat defined roles formal communication decisions made independently Thursday 16 June 2011
• share information & resources • defined roles Coordination • frequent communication • some shared decision making Thursday 16 June 2011
• share ideas • share resources Coalition • frequent & prioritized communication • all members have a vote on decisions Thursday 16 June 2011
Collaboration • members belong to one system • frequent communication characterized by mutual trust • consensus on all decisions Thursday 16 June 2011
Knowledge sharing http://www.au.af.mil/au/awc/awcgate/navy/onr_metrics_on_collab.pdf Thursday 16 June 2011
Team Resilience Truck Factor 10th Floor Test to take a random machine in your infrastructure , drop it from the 10th floor, and be able to restore your infrastructure to working within 5-10 minute The number of people on your team who have to be hit with a truck before the project is in serious trouble Resilience should be a 4th management objective, John Allspaw alongside Better/Faster/Cheaper http://www.kitchensoap.com/ Thursday 16 June 2011
Black Hole Theory Absorbs light, to see the effects you need to look at nearby objects http://www.collaborate.com/blog/2010/01/28/musing-metrics-collaboration Thursday 16 June 2011
Quest for proof • Innovating and/or providing decision support • Saving time or Money (tangible but less than (tangible) quality) • Increase Quality • Easing access to and (tangible... but less so) interactions with subject- matter experts (intangible) http://communityandbusiness.groupsite.com/group/Collaboration20/post/measuring-the-value-of-collaboation Thursday 16 June 2011
More vs Better Widgets Add more servers Tune existing servers Process Improvement Quality Improvement Easier More Difficult!! http://socialconsulting.wordpress.com/2009/02/24/measuring-collaboration/ Thursday 16 June 2011
Collaboration Challenge “Maximize Team Utility” Thursday 16 June 2011
Level 4 - Business Level Thursday 16 June 2011
AHA KA-CHING! Thursday 16 June 2011
Return on Investment http://www.flickr.com/photos/hanekomu/4481674104/ Thursday 16 June 2011
Inventory (WIP) Thursday 16 June 2011
Time to Market http://stefanroock.wordpress.com/2010/03/02/kanban-definition-of-lead-time-and-cycle-time/ Thursday 16 June 2011
Mean Time Between Failure http://museumdosgames.blogspot.com/2010/04/game-over.html Thursday 16 June 2011
Mean Time Between Resolution Thursday 16 June 2011
Recommend
More recommend
