what has soundcloud learnt about microservices
play

What has SoundCloud learnt about microservices? Phil Calado - PowerPoint PPT Presentation

Feb 09, 2024 •254 likes •789 views

What has SoundCloud learnt about microservices? Phil Calado SoundCloud >11 hours of audio uploaded every minute ~300 million people every month What we did in 2012-13 SoundCloud.com Sounds Social Activity & Sets Graph

  1. What has SoundCloud learnt about microservices? Phil Calçado SoundCloud

  4. >11 hours of audio uploaded every minute

  5. ~300 million people every month

  7. What we did in 2012-13

  8. SoundCloud.com

  9. Sounds ˝ Social Activity & Sets Graph Stream Premium ˝ Features Search API

  10. Sounds ˝ Social & Sets Graph Activity API Stream Premium ˝ Search Features

  11. api.soundcloud.com iOS Android Desktop Widget 3rd Party

  12. api-mobile api web api-partn iOS 3rd Party Android Desktop Widget

  13. More details http://bit.ly/dealing-with-the-monolith

  14. minimise #1 your fixed cost per app

  15. every new app answers What language? What build system? What I/O lib? How do we deploy? What do we monitor?

  16. typical agile project iteration 0 iteration 1 iteration 2 iteration 3 iteration 4 technical tasks user stories

  17. typical microservices project iteration 0 iteration 1 iteration 2 iteration 3 iteration 4

  18. You will have lots of microservices

  19. Consider having a “standard”, well- supported and documented stack

  20. outsource #2 as much as possible

  21. micro service x-ray app infrastructure

  22. Avoid building as much ˝ infrastructure as possible

  23. some good options

  24. Only infrastructure we need to build is the glue between the lib and our quirks

  25. Avoid having quirks

  26. acknowledge #3 the new complexity

  27. user track likes

  28. typical app user track likes unit test single process run inside an IDE

  29. microservice user track likes integration test multiple processes stubs and fakes

  30. must be easy to provision + +

  31. make #4 everything visible

  33. make interactions visible

  34. standardised dashboards

  35. wrap your #5 legacy with stranglers

  36. not exactly true api-mobile api web api-partn iOS 3rd Party Android Desktop Widget

  37. mothership still alive api web api-partn api.soundcloud.com iOS Android Desktop Widget 3rd Party

  39. api.soundcloud.com Client

  40. api.soundcloud.com strangler Client

  41. api.soundcloud.com strangler Client

  42. api.soundcloud.com strangler Client

  43. what changed changed since 2013?

  45. Stop babysitting ☑ Rails

  46. Enable & empower ☑ app devs

  47. “Experience based” ☒ api?

  48. What comes next?

  49. more devices

  50. IDL based RPC?

  51. ephemeral test environments

  53. phil calçado http://philcalcado.com˝ @pcalcado˝ www.soundcloud.com˝

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Breaking the Monolith Microservice Extraction at SoundCloud Soundcloud 11 hours uploaded

Breaking the Monolith Microservice Extraction at SoundCloud Soundcloud 11 hours uploaded

Breaking the Monolith Microservice Extraction at SoundCloud Soundcloud 11 hours uploaded every minute 150 million tracks 300 million users 2 History Rails 2.3 MySQL S3 3 What happened then? 4 Success! 5

714 views • 56 slides
You build it, you run it Matthias Rampke, SoundCloud You build it, you run it Operating

You build it, you run it Matthias Rampke, SoundCloud You build it, you run it Operating

You build it, you run it Matthias Rampke, SoundCloud You build it, you run it Operating SoundCloud's microservice architecture GOTO Berlin 2016 Intro: me Who I am and where I work Engineer in Production Engineering (platform, monitoring,

583 views • 32 slides
Consistency without consensus: CRDTs in production at SoundCloud Consistency without

Consistency without consensus: CRDTs in production at SoundCloud Consistency without

Consistency without consensus: CRDTs in production at SoundCloud Consistency without consensus: CRDTs in production at SoundCloud Me Some guy Embedded, sensor networks Distributed systems SoundCloud infrastructure Theory Distributed

1.12k views • 86 slides
Why code in Node . js often get rejected by SoundCloud Phil Calado - SoundCloud @pcalcado http

Why code in Node . js often get rejected by SoundCloud Phil Calado - SoundCloud @pcalcado http

Why code in Node . js often get rejected by SoundCloud Phil Calado - SoundCloud @pcalcado http :// philcalcado . com Tuesday, October 1, 13 2011: Phil zieht nach Berlin Tuesday, October 1, 13 Tuesday, October 1, 13 > 11 hours of audio

867 views • 62 slides
WHAT COMES AFTER MICROSERVICES? MATT RANNEY WHAT COMES AFTER MICROSERVICES? MATT RANNEY We

WHAT COMES AFTER MICROSERVICES? MATT RANNEY WHAT COMES AFTER MICROSERVICES? MATT RANNEY We

WHAT COMES AFTER MICROSERVICES? MATT RANNEY WHAT COMES AFTER MICROSERVICES? MATT RANNEY We hired lots of engineers. They wrote lots of software. This causes lots of problems. Why use microservices at all? Easier releases? Ef fj ciency

709 views • 55 slides
Microservices Security Fundamentals MICROSERVICES SECURITY CHALLENGES Wojciech Lesniak PRINCIPAL

Microservices Security Fundamentals MICROSERVICES SECURITY CHALLENGES Wojciech Lesniak PRINCIPAL

Microservices Security Fundamentals MICROSERVICES SECURITY CHALLENGES Wojciech Lesniak PRINCIPAL DEVELOPER / TECH LEAD @voit3k Microservices International Data Corporation (IDC) predicts that by: 2019 Q1 Microservices International Data

641 views • 39 slides
KrakenD API Gateway Product overview @devopsfaith Microservices are challenging The need for

KrakenD API Gateway Product overview @devopsfaith Microservices are challenging The need for

KrakenD API Gateway Product overview @devopsfaith Microservices are challenging The need for agility and scalability has driven Microservices adoption, but: 91% of Internet businesses are using or have plans to use microservices 86% expect

696 views • 53 slides
AID FOR TRADE What have we learnt? Which way ahead? 1 AID FOR TRADE What have we learnt? Which

AID FOR TRADE What have we learnt? Which way ahead? 1 AID FOR TRADE What have we learnt? Which

AID FOR TRADE What have we learnt? Which way ahead? 1 AID FOR TRADE What have we learnt? Which way ahead? I - Aid for Trade: Looking Ahead Olivier Cadot and Jaime de Melo II - Evaluation in Aid for Trade: From Case Study Counting to Measuring

360 views • 10 slides
Reactive Microsystems The Evolution of Microservices at Scale Jonas Bonr @jboner

Reactive Microsystems The Evolution of Microservices at Scale Jonas Bonr @jboner

Reactive Microsystems The Evolution of Microservices at Scale Jonas Bonr @jboner Microservices Are Hyped So You Want To strangle The Almighty Monolith And Move Towards Microservices? Do Not Settle For Microliths Microlith Single

1.66k views • 127 slides
Eric Wahlforss CTO/SoundCloud GOTO Aarhus 2011 L O O C Eric Wahlforss CTO/SoundCloud GOTO

Eric Wahlforss CTO/SoundCloud GOTO Aarhus 2011 L O O C Eric Wahlforss CTO/SoundCloud GOTO

Eric Wahlforss CTO/SoundCloud GOTO Aarhus 2011 L O O C Eric Wahlforss CTO/SoundCloud GOTO Aarhus 2011 L N O O T O C C O O L Eric Wahlforss CTO/SoundCloud GOTO Aarhus 2011 Sound Sound COOL Sound soundcloud.com/eric

1.04k views • 82 slides
FROM HTTP TO KAFKA-BASED FROM HTTP TO KAFKA-BASED MICROSERVICES MICROSERVICES Wojciech Rzsa,

FROM HTTP TO KAFKA-BASED FROM HTTP TO KAFKA-BASED MICROSERVICES MICROSERVICES Wojciech Rzsa,

7/17/2019 From HTTP to Kafka-based microservices FROM HTTP TO KAFKA-BASED FROM HTTP TO KAFKA-BASED MICROSERVICES MICROSERVICES Wojciech Rzsa, FLYR Poland @wrzasa localhost:4567/index.html?print-pdf#/ 1/83 From HTTP to Kafka-based

1.15k views • 83 slides
Were All Designers @cattsmall @cattsmall Im Catt Small! Product Designer at SoundCloud

Were All Designers @cattsmall @cattsmall Im Catt Small! Product Designer at SoundCloud

Were All Designers @cattsmall @cattsmall Im Catt Small! Product Designer at SoundCloud Previously worked with companies such as Bedrocket, NASDAQ OMX, & ParksByNature Game artist & programmer Event Organizer for

596 views • 38 slides
Microservices: Service Oriented Development Rafael Schloming How do I break up my monolith? How

Microservices: Service Oriented Development Rafael Schloming How do I break up my monolith? How

Microservices: Service Oriented Development Rafael Schloming How do I break up my monolith? How do I architect my app with microservices? What infrastructure do I need in place before I can benefit from microservices? datawire.io 2

770 views • 50 slides
Microservices Smaller is Better? Eberhard Wolff Freelance consultant & trainer

Microservices Smaller is Better? Eberhard Wolff Freelance consultant & trainer

Microservices Smaller is Better? Eberhard Wolff Freelance consultant & trainer http://ewolff.com Why Microservices? Eberhard Wolff - @ewolff Why Microservices? Strong modularization Sustainable Replaceability Development speed

1.25k views • 48 slides
DDD & Microservices At last, some boundaries! Eric Evans @ericevans0 domainlanguage.com

DDD & Microservices At last, some boundaries! Eric Evans @ericevans0 domainlanguage.com

DDD & Microservices At last, some boundaries! Eric Evans @ericevans0 domainlanguage.com Why do I like microservices? Autonomous teams with isolated implementation. Acknowledge the rough and tumble of enterprises. Cattle not

557 views • 37 slides
Beyond Microservices: Streams, State and Scalability Gwen Shapira, Engineering Manager @gwenshap

Beyond Microservices: Streams, State and Scalability Gwen Shapira, Engineering Manager @gwenshap

1 Beyond Microservices: Streams, State and Scalability Gwen Shapira, Engineering Manager @gwenshap 2 In the beginning 3 We Have Microservices 3 4 We Microservices 4 5 They need to communicate 5 I know! Ill use REST APIs 6

751 views • 64 slides
Handling all Facebook requests with JITed C++ code Yuhan Guo, Huapeng Zhou Software Engineers,

Handling all Facebook requests with JITed C++ code Yuhan Guo, Huapeng Zhou Software Engineers,

Handling all Facebook requests with JITed C++ code Yuhan Guo, Huapeng Zhou Software Engineers, Facebook User requests L7 User Web servers Loadbalancer User requests L7 User Web servers Loadbalancer Core HTTP stack +

702 views • 23 slides
A Carbuncle-free Roe-Type Solver for the Euler Equations Friedemann Kemm BTU Cottbus

A Carbuncle-free Roe-Type Solver for the Euler Equations Friedemann Kemm BTU Cottbus

A Carbuncle-free Roe-Type Solver for the Euler Equations Friedemann Kemm BTU Cottbus kemm@math.tu-cottbus.de 70 70 60 60 70 70 50 50 60 60 40 40 50 50 30 30 40 40 20 20 30 30 10 10 20 20 0 0 10 10 0 0 30 30 25

325 views • 20 slides
Kristina T outanova Joint work with entities relations city_of Honolulu born_in United

Kristina T outanova Joint work with entities relations city_of Honolulu born_in United

Kristina T outanova Joint work with entities relations city_of Honolulu born_in United States Barack Obama spouse Michelle Obama city_of Honolulu born_in lived_in United States Barack Obama nationality spouse Michelle Obama

671 views • 26 slides
New Exotica Scenario for the New Exotica Scenario for the LHC: Quirks Q A A. De Roeck De

New Exotica Scenario for the New Exotica Scenario for the LHC: Quirks Q A A. De Roeck De

New Exotica Scenario for the New Exotica Scenario for the LHC: Quirks Q A A. De Roeck De Roeck CERN Quirks are exotic vector-like fermions that transform as a fundamental under a hidden confining group, but also carry g g p, y Quirks!

394 views • 10 slides
Logic as a Tool Chapter 2: Deductive Reasoning in Propositional Logic 2.4 Propositional Natural

Logic as a Tool Chapter 2: Deductive Reasoning in Propositional Logic 2.4 Propositional Natural

Logic as a Tool Chapter 2: Deductive Reasoning in Propositional Logic 2.4 Propositional Natural Deduction Valentin Goranko Stockholm University November 2020 Goranko Natural Deduction Natural Deduction (ND): System for structured logical

1.18k views • 100 slides
Logic as a Tool Chapter 2: Deductive Reasoning in Propositional Logic 2.4 Propositional Natural

Logic as a Tool Chapter 2: Deductive Reasoning in Propositional Logic 2.4 Propositional Natural

Logic as a Tool Chapter 2: Deductive Reasoning in Propositional Logic 2.4 Propositional Natural Deduction Valentin Goranko Stockholm University November 2020 Goranko Natural Deduction Natural Deduction (ND): System for structured logical

375 views • 21 slides
Positive Intuitionistic Propositional Logic Carl Pollard November 15, 2011 Positive

Positive Intuitionistic Propositional Logic Carl Pollard November 15, 2011 Positive

Positive Intuitionistic Propositional Logic Carl Pollard November 15, 2011 Positive Intuitionistic Propositional Logic (PIPL) PIPL is like LL but with more connectives and rules. The only connectives of PIPL are The 0-ary connective T

274 views • 5 slides
A Gentle Introduction to Mathematical Fuzzy Logic 2. Basic properties of ukasiewicz and

A Gentle Introduction to Mathematical Fuzzy Logic 2. Basic properties of ukasiewicz and

A Gentle Introduction to Mathematical Fuzzy Logic 2. Basic properties of ukasiewicz and GdelDummett logic Petr Cintula 1 and Carles Noguera 2 1 Institute of Computer Science, Czech Academy of Sciences, Prague, Czech Republic 2 Institute of

1.17k views • 97 slides

More recommend