You build it, you run it Matthias Rampke, SoundCloud You build it, - PowerPoint PPT Presentation

You build it, you run it Matthias Rampke, SoundCloud

You build it, you run it Operating SoundCloud's microservice architecture GOTO Berlin 2016

Intro: me Who I am and where I work Engineer in Production Engineering (platform, monitoring, availability) previously in Systems Engineering (ops remnant catch-all)

Intro: SoundCloud Who I am and where I work a cloud full of sounds 135M tracks, 12M artists, 175M listeners 300+ employees no ops team

Intro: Agenda Where we came from Where we are today Why we did it How you can do it How does this compare to…?

⋁ Where we came from ⋁

In the beginning … the early days One team One table One codebase

2009/2010 growing pains 20-50 engineers hired an ops team, 24/7 on-call app team deploys the monolith first separate "micro"services

2011/2012 the fork in the road more microservices deployment platform SRE/platforms team multiple on-call rotations

2013-2015 maturing cambrian explosion of microservices feature teams and collectives client specific APIs shared components & libraries continuous delivery

⋁ Where we are today ⋁

Org chart simplified

Ownership You buildown it, you run it every feature • service • codebase is owned by a team

On Call owners are on call for what they own groups of teams work together to reduce load remove alerts • write documentation

Shared Components avoid shared infrastructure be flexible don't duplicate work

Production Engineering run the systems that run systems monitoring & availability internal consulting

⋁ Why we did it ⋁

Delivery get more done, consistently autonomy predictability velocity

Personal growth learn something new every day no pure specialists internal mobility

Better systems simple resilient operable

⋁ How you can do it ⋁

Prerequisites basic automation openness pride trust

Expanding ownership testing & deployment on-call provisioning dependencies

Checks & Balances internal moves escalation paths documentation tooling

Postmortems learn improve commiserate

⋁ How does this compare to …? ⋁

Site Reliability Engineering as Google describes it no assignment to SWE teams no on-call handoff no deploy blocks

Radical agility as Zalando describe it more shared code more communication infrastructure & core teams

DevOps as described by Etsy no Ops team less shared infrastructure less standardization deploys spread in a different dimension

Slides: https://bit.ly/gotober16-sc Please rate! . soundcloud.com Berlin New York San Francisco London

You build it, you run it Matthias Rampke, SoundCloud You build it, - PowerPoint PPT Presentation

You build it, you run it Matthias Rampke, SoundCloud You build it, you run it Operating SoundCloud's microservice architecture GOTO Berlin 2016 Intro: me Who I am and where I work Engineer in Production Engineering (platform, monitoring,

self build housing Ted Stevens NaSBA Chair What is Self/Custom Build? Who does it/what is

Build-Finance or Design-Build-Finance Transportation Projects Types of P3s Design-Build (DB)

Build Build Build Build System building The process of compiling and linking software

Build it, Break it, Fix it Build-it Lecture Prof. Eric Bodden Build It, Break It, Fix It SS

Heapsort Build-Max-Heap Next we build a full heap from an unsorted sequence Build-Max-Heap(A)

Best Practices and lessons learned about the Design Build process 2 3 Includes the

BUILD BUILD BUILD Nigerias Infrastructure Space Opportunities & Challenges PRESENTATION

Can we build a complete set of tools ? RT Can we build a complete set of tools ? RT Spectra,

Media actions to increase the visibility of BUILD UP and its Partners Gilles VAILLE BUILD UP

Build Engineering Build Engineering Evolution in Managing OS Pete Garcin , Senior Product

We cant always build the fvture for our youth, but we can build our youth for the fvture.

Design-Build Presentation Objectives- Why Design-Build? What is the rush? What is the

WE BUILD & WEB APP We build elegant and functional solutions We deliver apps essentials at

Build a Geant4 application Geant4 tutorial Application build process 1) Properly organize your

ABF as a Development Framework with ARM-powered Build Nodes by the example of OpenMandriva

Validate Configuration against Build Artifacts: An Essential Step for your Build Process by

N A TIO N A L FO RUM F O R HEA RT D ISEA SE & STRO KE PREV EN TIO N O c t o b e r 1 9 , 2 0

Effec)ve Structured Query Formula)on for Session Search Dongyi

Taking Linux File and Storage Systems into the Future Ric Wheeler Director Kernel File and

Dr Kulshresthas Summerfield Family Practice General Practitioners Dr Rajendra Kulshrestha

Meaning Internalism and Natural History Paul M. Pietroski University of Maryland Dept. of

The mod_proxy Cookbook A collection of proxy recipes to suit your discerning palate Daniel

TIF 101 Legislator Meeting September 5, 2019 franczek.com How a TIF district works franczek.com

Career speech In 8th grade I valued... I wanted to be an artist so I read about Aliza. Aliza is an

You build it, you run it Matthias Rampke, SoundCloud You build it, - PowerPoint PPT Presentation

You build it, you run it Matthias Rampke, SoundCloud You build it, you run it Operating SoundCloud's microservice architecture GOTO Berlin 2016 Intro: me Who I am and where I work Engineer in Production Engineering (platform, monitoring,

self build housing Ted Stevens NaSBA Chair What is Self/Custom Build? Who does it/what is

Build-Finance or Design-Build-Finance Transportation Projects Types of P3s Design-Build (DB)

Build Build Build Build System building The process of compiling and linking software

Build it, Break it, Fix it Build-it Lecture Prof. Eric Bodden Build It, Break It, Fix It SS

Heapsort Build-Max-Heap Next we build a full heap from an unsorted sequence Build-Max-Heap(A)

Best Practices and lessons learned about the Design Build process 2 3 Includes the

BUILD BUILD BUILD Nigerias Infrastructure Space Opportunities &amp; Challenges PRESENTATION

Can we build a complete set of tools ? RT Can we build a complete set of tools ? RT Spectra,

Media actions to increase the visibility of BUILD UP and its Partners Gilles VAILLE BUILD UP

Build Engineering Build Engineering Evolution in Managing OS Pete Garcin , Senior Product

We cant always build the fvture for our youth, but we can build our youth for the fvture.

Design-Build Presentation Objectives- Why Design-Build? What is the rush? What is the

WE BUILD &amp; WEB APP We build elegant and functional solutions We deliver apps essentials at

Build a Geant4 application Geant4 tutorial Application build process 1) Properly organize your

ABF as a Development Framework with ARM-powered Build Nodes by the example of OpenMandriva

Validate Configuration against Build Artifacts: An Essential Step for your Build Process by

N A TIO N A L FO RUM F O R HEA RT D ISEA SE &amp; STRO KE PREV EN TIO N O c t o b e r 1 9 , 2 0

Effec)ve Structured Query Formula)on for Session Search Dongyi

Taking Linux File and Storage Systems into the Future Ric Wheeler Director Kernel File and

Dr Kulshresthas Summerfield Family Practice General Practitioners Dr Rajendra Kulshrestha

Meaning Internalism and Natural History Paul M. Pietroski University of Maryland Dept. of

The mod_proxy Cookbook A collection of proxy recipes to suit your discerning palate Daniel

TIF 101 Legislator Meeting September 5, 2019 franczek.com How a TIF district works franczek.com

Career speech In 8th grade I valued... I wanted to be an artist so I read about Aliza. Aliza is an

BUILD BUILD BUILD Nigerias Infrastructure Space Opportunities & Challenges PRESENTATION

WE BUILD & WEB APP We build elegant and functional solutions We deliver apps essentials at

N A TIO N A L FO RUM F O R HEA RT D ISEA SE & STRO KE PREV EN TIO N O c t o b e r 1 9 , 2 0