deploying and scaling microservices
play

DEPLOYING AND SCALING MICROSERVICES Sam Newman Goto Chicago 2016 - PowerPoint PPT Presentation

Dec 22, 2022 •456 likes •2.36k views

DEPLOYING AND SCALING MICROSERVICES Sam Newman Goto Chicago 2016 @samnewman Building Microservices DESIGNING FINE - GRAINED SYSTEMS Sam Newman @samnewman Core Principles @samnewman Core Principles Artifacts @samnewman Core Principles

  1. DEPLOYING AND SCALING MICROSERVICES Sam Newman Goto Chicago 2016

  2. @samnewman

  3. Building Microservices DESIGNING FINE - GRAINED SYSTEMS Sam Newman @samnewman

  4. Core Principles @samnewman

  5. Core Principles Artifacts @samnewman

  6. Core Principles Artifacts Platforms @samnewman

  7. Core Principles Artifacts Platforms @samnewman

  8. Shipping Returns Customer Service Invoicing Accounts Inventory @samnewman

  9. Independent Deployability @samnewman

  10. Shipping v123 Returns v345 Customer Service Invoicing Accounts Inventory @samnewman

  11. Shipping v456 Returns v890 Customer Service Invoicing Accounts Inventory @samnewman

  12. https://www. fl ickr.com/photos/torkildr/3462607995/ @samnewman

  13. https://www. fl ickr.com/ Prod Build Tests UAT Performance @samnewman

  14. Source Control https://www. fl ickr.com/ Prod Build Tests UAT Performance @samnewman

  15. Source Control https://www. fl ickr.com/ Prod Build Tests UAT Performance @samnewman

  16. Source Control https://www. fl ickr.com/ Prod Build Tests UAT Performance @samnewman

  17. Source Control https://www. fl ickr.com/ � Prod Build Tests UAT Performance @samnewman

  18. Source Control https://www. fl ickr.com/ � � Prod Build Tests UAT Performance @samnewman

  19. Source Control https://www. fl ickr.com/ � � � Prod Build Tests UAT Performance @samnewman

  20. Source Control https://www. fl ickr.com/ � � � Prod Build Tests UAT Performance @samnewman

  21. Source Control https://www. fl ickr.com/ � � � Prod Build Tests UAT Performance One Artifact For All Environments @samnewman

  22. Source Control https://www. fl ickr.com/ � � � Prod Build Tests UAT Performance One Artifact For All Environments Same Deployment Process Everywhere @samnewman

  23. $ deploy Returns v456 Production @samnewman

  24. Service Name $ deploy Returns v456 Production @samnewman

  25. Service Name Version $ deploy Returns v456 Production @samnewman

  26. Service Name Version local $ deploy Returns v456 Production @samnewman

  27. Service Name Version local latest $ deploy Returns v456 Production @samnewman

  28. Service Name Version local latest $ deploy Returns v456 Production Environment @samnewman

  29. Build Tests Large Tests Perf Prod UAT Machine Machine DB UAT Environment @samnewman

  30. Prod Build Tests UAT Perf Machine Machine Machine Machine Master Slave DB DB Production Environment @samnewman

  31. Same Artifact @samnewman

  32. Same Artifact Di ff erent Topology @samnewman

  33. Core Principles? @samnewman

  34. Core Principles? Independent Deployability @samnewman

  35. Core Principles? Independent Deployability One Artifact For All Environments @samnewman

  36. Core Principles? Independent Deployability One Artifact For All Environments Same Deployment Process Everywhere @samnewman

  37. Core Principles Artifacts Platforms @samnewman

  38. What do we want from an artifact? @samnewman

  39. What do we want from an artifact? @samnewman

  40. What do we want from an artifact? Easy to create @samnewman

  41. What do we want from an artifact? Easy to create Easy to deploy @samnewman

  42. What do we want from an artifact? Easy to create Easy to deploy Abstract out the tech stack @samnewman

  43. What do we want from an artifact? Easy to create Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  44. Tarballs @samnewman

  45. Tarballs Giant bundles of stu ff @samnewman

  46. Tarballs Easy to create Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  47. Tarballs � Easy to create Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  48. Tarballs � Easy to create Easy to deploy � Abstract out the tech stack Good for dev, good for ops @samnewman

  49. Tarballs � Easy to create Easy to deploy � Abstract out the tech stack � Good for dev, good for ops @samnewman

  50. Tarballs � Easy to create Easy to deploy � Abstract out the tech stack � Good for dev, good for ops � @samnewman

  51. Stack-speci fi c @samnewman

  52. Stack-speci fi c nuget pip jar gems @samnewman

  53. Stack-speci fi c Easy to create Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  54. Stack-speci fi c � Easy to create Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  55. Stack-speci fi c � Easy to create Easy to deploy � Abstract out the tech stack Good for dev, good for ops @samnewman

  56. Stack-speci fi c � Easy to create Easy to deploy � Abstract out the tech stack � Good for dev, good for ops @samnewman

  57. Stack-speci fi c � Easy to create Easy to deploy � Abstract out the tech stack � Good for dev, good for ops � @samnewman

  58. Everything in Go is Awesome @samnewman

  59. Everything in Go is Awesome FACT @samnewman

  60. OS-Speci fi c @samnewman

  61. OS-Speci fi c $ sudo apt-get install myservice @samnewman

  62. OS-Speci fi c $ sudo apt-get install myservice $ deploy Returns v456 Production @samnewman

  63. OS-Speci fi c Easy to create Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  64. OS-Speci fi c Easy to create � Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  65. OS-Speci fi c Easy to create � � Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  66. OS-Speci fi c Easy to create � � Easy to deploy � Abstract out the tech stack Good for dev, good for ops @samnewman

  67. OS-Speci fi c Easy to create � � Easy to deploy � Abstract out the tech stack Good for dev, good for ops � @samnewman

  68. Build @samnewman

  69. Build Deb Repo @samnewman

  70. Build Host Deb Repo @samnewman

  71. Build Host Deb Repo @samnewman

  72. Build Host Deb Repo @samnewman

  73. @samnewman

  74. A v1.5 @samnewman

  75. A A v1.5 v2.1 @samnewman

  76. A A v1.5 v2.1 @samnewman

  77. Host @samnewman

  78. Host @samnewman

  79. Host Host Host Host @samnewman

  80. Independent Execution Host Host Environments FTW! Host Host @samnewman

  81. Custom Images Easy to create Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  82. Custom Images Easy to create � Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  83. Custom Images Easy to create � Easy to deploy � Abstract out the tech stack Good for dev, good for ops @samnewman

  84. Custom Images Easy to create � Easy to deploy � � Abstract out the tech stack Good for dev, good for ops @samnewman

  85. Custom Images Easy to create � Easy to deploy � � Abstract out the tech stack Good for dev, good for ops � @samnewman

  86. @samnewman

  87. @samnewman

  88. Cost of isolated hosts is reduced… @samnewman

  89. Cost of isolated hosts is reduced… …in terms of e ff ort… @samnewman

  90. Cost of isolated hosts is reduced… …in terms of e ff ort… …and computing resources @samnewman

  91. Docker! Easy to create Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  92. Docker! Easy to create � Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  93. Docker! Easy to create � � Easy to deploy Abstract out the tech stack Good for dev, good for ops @samnewman

  94. Docker! Easy to create � � Easy to deploy � Abstract out the tech stack Good for dev, good for ops @samnewman

  95. Docker! Easy to create � � Easy to deploy � Abstract out the tech stack Good for dev, good for ops � @samnewman

  96. Core Principles Artifacts Platforms @samnewman

  97. What do we want from our deployment platform? @samnewman

  98. What do we want from our deployment platform? Separate artifact from topology @samnewman

  99. What do we want from our deployment platform? Separate artifact from topology Makes handling lots of services easy! @samnewman

  100. What do we want from our deployment platform? Separate artifact from topology Makes handling lots of services easy! Supports docker images @samnewman

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Building and deploying microservices with event sourcing, CQRS and Docker Chris Richardson

Building and deploying microservices with event sourcing, CQRS and Docker Chris Richardson

Building and deploying microservices with event sourcing, CQRS and Docker Chris Richardson Author of POJOs in Action Founder of the original CloudFoundry.com @crichardson chris@chrisrichardson.net http://plainoldobjects.com

827 views • 65 slides
Building and deploying microservices with event sourcing, CQRS and Docker Chris Richardson

Building and deploying microservices with event sourcing, CQRS and Docker Chris Richardson

Building and deploying microservices with event sourcing, CQRS and Docker Chris Richardson Author of POJOs in Action Founder of the original CloudFoundry.com @crichardson chris@chrisrichardson.net http://plainoldobjects.com @crichardson

687 views • 64 slides
Lessons Learned: Deploying Microservices Software Product in Customer Environments Mark Galpin,

Lessons Learned: Deploying Microservices Software Product in Customer Environments Mark Galpin,

Lessons Learned: Deploying Microservices Software Product in Customer Environments Mark Galpin, Solution Architect, JFrog, Inc. Whos speaking? Mark Galpin Solution Architect @jfrog magalpin Microservices are Cool But what about

709 views • 24 slides
DEPLOYING TWO APPS, THREE MICROSERVICES AND ONE WEBSITE WITH ZERO HAIR LOSS: WHAT WORKED FOR US

DEPLOYING TWO APPS, THREE MICROSERVICES AND ONE WEBSITE WITH ZERO HAIR LOSS: WHAT WORKED FOR US

DEPLOYING TWO APPS, THREE MICROSERVICES AND ONE WEBSITE WITH ZERO HAIR LOSS: WHAT WORKED FOR US Charles Korn 1 THE PROJECT 2 Architecture 3 ARCHITECTURE AngularJS Website Event log Event log WordPress content content Golang

525 views • 20 slides
TESTING & DEPLOYING MICROSERVICES Sam Newman Flowcon, September 2014 1 Shipping Returns

TESTING & DEPLOYING MICROSERVICES Sam Newman Flowcon, September 2014 1 Shipping Returns

TESTING & DEPLOYING MICROSERVICES Sam Newman Flowcon, September 2014 1 Shipping Returns Customer Service Invoicing Accounts Inventory @ fl owconsf @samnewman Focused around a business domain Shipping Returns Customer Service

1.47k views • 112 slides
Overload Control for Scaling WeChat Microservices WeChat The new way to connect Chat Moments

Overload Control for Scaling WeChat Microservices WeChat The new way to connect Chat Moments

Overload Control for Scaling WeChat Microservices WeChat The new way to connect Chat Moments Contacts Search Pay 1 Billion monthly active users WeChats Microservice Architecture Service DAG Vertex: a distinct service; Edge: call

675 views • 14 slides
Sidecars and Service Meshes Next level scaling for microservices User Interface(s): HTML, CSS,

Sidecars and Service Meshes Next level scaling for microservices User Interface(s): HTML, CSS,

Sidecars and Service Meshes Next level scaling for microservices User Interface(s): HTML, CSS, etc HTTPS API Gateway: REST, gRPC, etc Message Session User Management Handling Management Post-Processing Data Retrieval Model Execution

513 views • 27 slides
Towards Quantifiable Boundaries for Elastic Horizontal Scaling of Microservices Manuel Ramrez

Towards Quantifiable Boundaries for Elastic Horizontal Scaling of Microservices Manuel Ramrez

Towards Quantifiable Boundaries for Elastic Horizontal Scaling of Microservices Manuel Ramrez Lpez <ramz@zhaw.ch> & Josef Spillner <josef.spillner@zhaw.ch> Service Prototyping Lab (blog.zhaw.ch/icclab) Dec 5, 2017 | 6th

197 views • 16 slides
Hyper-scaling on Openstack with Open Source tooling A use case in deploying hyper-scale grid

Hyper-scaling on Openstack with Open Source tooling A use case in deploying hyper-scale grid

Hyper-scaling on Openstack with Open Source tooling A use case in deploying hyper-scale grid computing on Open Telekom Cloud Why Open Source? Open Open Design Open Choice Standards Community Lead Contributor Model No-Lock in Cloud Design

416 views • 14 slides
WHAT COMES AFTER MICROSERVICES? MATT RANNEY WHAT COMES AFTER MICROSERVICES? MATT RANNEY We

WHAT COMES AFTER MICROSERVICES? MATT RANNEY WHAT COMES AFTER MICROSERVICES? MATT RANNEY We

WHAT COMES AFTER MICROSERVICES? MATT RANNEY WHAT COMES AFTER MICROSERVICES? MATT RANNEY We hired lots of engineers. They wrote lots of software. This causes lots of problems. Why use microservices at all? Easier releases? Ef fj ciency

709 views • 55 slides
Microservices Security Fundamentals MICROSERVICES SECURITY CHALLENGES Wojciech Lesniak PRINCIPAL

Microservices Security Fundamentals MICROSERVICES SECURITY CHALLENGES Wojciech Lesniak PRINCIPAL

Microservices Security Fundamentals MICROSERVICES SECURITY CHALLENGES Wojciech Lesniak PRINCIPAL DEVELOPER / TECH LEAD @voit3k Microservices International Data Corporation (IDC) predicts that by: 2019 Q1 Microservices International Data

641 views • 39 slides
Microservices in a Streaming World There are many good reasons for building service-based

Microservices in a Streaming World There are many good reasons for building service-based

Microservices in a Streaming World There are many good reasons for building service-based systems Loose Coupling Bounded Contexts Autonomy Ease of scaling Composability But when we do, were building a distributed system

1.96k views • 138 slides
KrakenD API Gateway Product overview @devopsfaith Microservices are challenging The need for

KrakenD API Gateway Product overview @devopsfaith Microservices are challenging The need for

KrakenD API Gateway Product overview @devopsfaith Microservices are challenging The need for agility and scalability has driven Microservices adoption, but: 91% of Internet businesses are using or have plans to use microservices 86% expect

696 views • 53 slides
Scaling container policy management with kernel features Joe Stringer Cilium.io Linux Plumbers

Scaling container policy management with kernel features Joe Stringer Cilium.io Linux Plumbers

Scaling container policy management with kernel features Joe Stringer Cilium.io Linux Plumbers 2019, Lisbon, Portugal Joe Stringer Scaling container policy with eBPF Sep 11, 2019 1 / 29 Overview 1 Background 2 Deploying fast datapaths fast

831 views • 53 slides
Reactive Microsystems The Evolution of Microservices at Scale Jonas Bonr @jboner

Reactive Microsystems The Evolution of Microservices at Scale Jonas Bonr @jboner

Reactive Microsystems The Evolution of Microservices at Scale Jonas Bonr @jboner Microservices Are Hyped So You Want To strangle The Almighty Monolith And Move Towards Microservices? Do Not Settle For Microliths Microlith Single

1.66k views • 127 slides
Analysis of Scaling Algorithms for Matrix & Operator Scaling Contents Scaling Algorithms

Analysis of Scaling Algorithms for Matrix & Operator Scaling Contents Scaling Algorithms

Rafael Oliveira University of Toronto Analysis of Scaling Algorithms for Matrix & Operator Scaling Contents Scaling Algorithms Three Step Analysis Generalization One More Application of Scaling Non-Negative Matrices &

604 views • 15 slides
Optimal convergence rates for distributed optimization Francis Bach Inria - Ecole Normale

Optimal convergence rates for distributed optimization Francis Bach Inria - Ecole Normale

Optimal convergence rates for distributed optimization Francis Bach Inria - Ecole Normale Sup erieure, Paris Joint work with K. Scaman , S. Bubeck, Y.-T. Lee and L. Massouli e LCCC Workshop - June 2017 Motivations Typical Machine

999 views • 51 slides
Big Data for Data Science The MapReduce Framework & Hadoop event.cwi.nl/lsde Key premise:

Big Data for Data Science The MapReduce Framework & Hadoop event.cwi.nl/lsde Key premise:

Big Data for Data Science The MapReduce Framework & Hadoop event.cwi.nl/lsde Key premise: divide and conquer work partition w 1 w 2 w 3 worker worker worker r 1 r 2 r 3 combine result event.cwi.nl/lsde Parallelisation challenges

906 views • 68 slides
Continuous Integration & Deploying using Jenkins and uDeploy (Projects used are of

Continuous Integration & Deploying using Jenkins and uDeploy (Projects used are of

Continuous Integration & Deploying using Jenkins and uDeploy (Projects used are of Java,PHP&Dotnet) Contents Installing the UDeploy Agent

797 views • 42 slides
Spark architecture Spark architecture Hardware organization Hardware organization In local

Spark architecture Spark architecture Hardware organization Hardware organization In local

Spark architecture Spark architecture Hardware organization Hardware organization In local installation, cores serve as master & slaves Communication Communication Sh Sh uf uf fle fle Same machines are used for both map and reduce

341 views • 12 slides
Parallel applications in the cloud Diana Naranjo Pomalaya Computao Paralela e Distribuida

Parallel applications in the cloud Diana Naranjo Pomalaya Computao Paralela e Distribuida

Parallel applications in the cloud Diana Naranjo Pomalaya Computao Paralela e Distribuida Agenda Introduction MapReduce Solutions Haloop iMapReduce Pig Global Data Center Traffic Source: Cisco Global Cloud Index,

391 views • 25 slides
of optimized code Michael Ernst University of Washington (work done at Microsoft Research)

of optimized code Michael Ernst University of Washington (work done at Microsoft Research)

Practical fine-grained static slicing of optimized code Michael Ernst University of Washington (work done at Microsoft Research) Ernst Slicing 5/97 Page 1 Simple example Ernst Slicing 5/97 Page 2 Example: function calls and pointers Ernst

862 views • 34 slides
Execution-based Prediction Using Speculative Slices Craig Zilles and Guri Sohi University of

Execution-based Prediction Using Speculative Slices Craig Zilles and Guri Sohi University of

Execution-based Prediction Using Speculative Slices Craig Zilles and Guri Sohi University of Wisconsin - Madison International Symposium on Computer Architecture July, 2001 The Problem Two major barriers to achieving high ILP: MISPREDICTED

427 views • 27 slides
Slices Chapter 10 SL1 Program slice What is a program slice? SL2 Program slice

Slices Chapter 10 SL1 Program slice What is a program slice? SL2 Program slice

Slices Chapter 10 SL1 Program slice What is a program slice? SL2 Program slice Informally What is a program slice? A program slice is a set of program statements that contributes to or affects the value of a variable at

517 views • 18 slides

More recommend