metrics driven engineering
play

Metrics-Driven Engineering Mike Brittain @ mikebrittain Director of - PowerPoint PPT Presentation

Metrics-Driven Engineering Mike Brittain @ mikebrittain Director of engineering, Infrastructure October 13, 2011 Tools and Process at Etsy How many new visits? How many listings created? How many registrations? How do people use Etsy? How


  1. We could stare at graphs all day...

  2. http://graphite/render? from=-1hours&width=600&height=200 &target=webs.errorLog.warning&rawData=1

  3. http://graphite/render? from=-1hours&width=600&height=200 &target=webs.errorLog.warning&rawData=1 webs.errorLog.warning,1318444930,1318448530,60| 5.0,1.0,3.0,1.0,0.0,9.0,0.0,1.0,3.0,2.0,1.0,6.0,2.0,6.0,3.0,6.0,4.0,4.0,2.0, 1.0,1.0,8.0,2.0,3.0,6.0,3.0,5.0,3.0,0.0,4.0,6.0,2.0,0.0,2.0,0.0,4.0,0.0,3.0, 1.0,3.0,4.0,2.0,10.0,3.0,0.0,6.0,0.0,4.0,2.0,5.0,18.0,1.0,1.0,2.0,1.0,8.0,5. 0,1.0,1.0,None

  4. Holt-Winters Confidence Bands upper lower

  5. Holt-Winters Aberration

  6. Business metrics + Confidence bands _____________ Alertable metrics

  7. 40,000+ metrics at Etsy Systems, Applications, Business

  8. Dashboards

  9. Dashboards

  10. Kind of Hard :-/ <a href="http://graphite.etsycorp.com/render?from=-1hours&width=800&height=600&title=File+or +Script+Not+Found&yMin=0&target=webs.errorLog.notExist&target=drawAsInfinite %28deploys.config.production%29&target=drawAsInfinite%28deploys.web.production %29&target=drawAsInfinite%28deploys.search.production%29&target=drawAsInfinite %28deploys.imagestorage.other%29&colorList=%2300cc00,%230000ff, %23ff0000,%23006633,%23cc6600"> <img src="http://graphite.etsycorp.com/render? from=-1hours&width=280&height=220&title=File+or+Script+Not +Found&hideLegend=1&yMin=0&target=webs.errorLog.notExist&target=drawAsInfinite %28deploys.config.production%29&target=drawAsInfinite%28deploys.web.production %29&target=drawAsInfinite%28deploys.search.production%29&target=drawAsInfinite %28deploys.imagestorage.other%29&colorList=%2300cc00,%230000ff, %23ff0000,%23006633,%23cc6600"> </a>

  11. Super Easy! $g = new Graphite($time); $g->setTitle('File Not Found'); $g->addMetric('webs.errorLog.notExist', '#00cc00'); echo $g->getDashboardHTML(280, 220);

  12. Metrics!

  13. Metrics! Metrics + Events

  14. Metrics! Metrics + Events Metrics + Alerts

  15. Metrics! Metrics + Events Metrics + Alerts Metrics + Metrics

  16. High-level, real-time visibility

  17. Detect problems quickly

  18. CONFIDENCE

Recommend


More recommend