SLIDE 1
The Next Generation of Microservices
Phil Calçado http://philcalcado.com @pcalcado
The Next Generation of Microservices Phil Calado - - PowerPoint PPT Presentation
The Next Generation of Microservices Phil Calado - - PowerPoint PPT Presentation
The Next Generation of Microservices Phil Calado http://philcalcado.com @pcalcado We can think of microservices as highly distributed application architecture Highly distributed application architectures are just a flavor of distributed
SLIDE 2
SLIDE 3
highly distributed application architecture
We can think of microservices as
SLIDE 4
Highly distributed application architectures are just a flavor of
distributed computing
SLIDE 5
Technical Challenges Organization Challenges
Introducing distribution into your architecture brings up new
SLIDE 6
Introducing distribution into your architecture brings up new
SLIDE 7
SLIDE 8
The example we will work with today:
Recovering from temporary failure
SLIDE 9
Back in 2013…
SLIDE 10
SLIDE 11
"I know, let’s use microservices”
SLIDE 12 Timeouts
Your code looks like this now
Biz Logic Timeouts SLIDE 13
server client
SLIDE 14 Timeouts
Your code looks like this now
Biz Logic Timeouts RPC code SLIDE 15
server client 🔦 🔦 🔦
SLIDE 16
SLIDE 17
🔦
wait
☺ 😱
🔦 🔦
wait
☺ 😱
🔦
☺ ☺ ☺ ☺ ☺ ☺ ☺ ☺
SLIDE 18
"I know, let’s implement circuit breakers and timeouts”
SLIDE 19 Circuit breakers Timeouts
Your code looks like this now
Biz Logic Timeouts Telemetry RPC code SLIDE 20
server client client client client client client
SLIDE 21
🔦
wait
☺ 😱
🔦 🔦
wait
☺ 😱
🔦
☺ ☺ ☺ ☺ ☺ ☺ ☺ ☺
SLIDE 22
🔦
wait
☺ 😱
🔦
🔦
☺
wait
😱 ☺
🔦
🔦
wait
😱 ☺
🔦
🔦
wait
😱 ☺
🔦
🔦
…
SLIDE 23
🔦 🗒
SLIDE 24
"I know, let’s have all circuit breakers share state”
SLIDE 25
"I know, let’s have all circuit breakers share state”
Answer to the question “how did my application ended up importing a Zookeeper library again?"
SLIDE 26 Circuit breakers Timeouts
Your code looks like this now
Biz Logic Timeouts Telemetry RPC code Distributed state SLIDE 27
server client 🔦 🔦 🔦 server server server server 🔦 🔦 🔦 💪 🤕
Which instance should we talk to?
☺
SLIDE 28
DNS be like…
路
SLIDE 29
"I know, let’s have clients keep track of healthy instances”
SLIDE 30 Circuit breakers Timeouts
Your code looks like this now
Biz Logic Timeouts Telemetry RPC code Distributed state Client-side Service Discovery SLIDE 31
And that’s just for RPC reliability.
SLIDE 32
What makes 2017 different?
SLIDE 33
Experience reports Open-source software you can use
SLIDE 34 Circuit breakers Timeouts Biz Logic Timeouts Telemetry RPC code Distributed state Client-side Service Discovery
SDK
SLIDE 35 Application Transport Internet Network Circuit breakers Telemetry RPC code Distributed state Client-side Service Discovery
} TCP/IP } ?
One way to think about it
SLIDE 36
But how does one go about adding a new layer to the TCP/IP stack?
SLIDE 37
Sidecars to the rescue
Circuit breakers Timeouts Biz Logic Timeouts Telemetry RPC code Distributed state Client-side Service Discovery SCARY OUTSIDE WORLD SLIDE 38
Sidecars to the rescue
Circuit breakers Timeouts Biz Logic Timeouts Telemetry RPC code Distributed state Client-side Service Discovery SCARY OUTSIDE WORLDSidecar
SLIDE 39
Sidecars to the rescue
SLIDE 40
SLIDE 41
How does that impact your service?
SLIDE 42 Circuit breakers Timeouts Biz Logic Timeouts Telemetry RPC code Distributed state Client-side Service Discovery
Service Platform
SLIDE 43 Biz Logic
Stability
Service Platform
SLIDE 44
SLIDE 45 Timeouts Biz Logic Stability
Service Platform
Capacity Security Availability SLIDE 46 Biz Logic
Service Platform
Service Mesh
SLIDE 47
Allows our services to pretend some of those are true
SLIDE 48
It’s not that these patterns aren’t used anymore, it’s just that the dumb work moved down the stack.
SLIDE 49
New, optmised, protocols are quite opaque (e.g. gRPC and friends)
Works better with metadata-rich protocols
SLIDE 50
It makes it even harder to fully replicate production earlier in the development cycle
Coupled to the platform
SLIDE 51
Not everything will be part of the mesh, i.e. the network still isn’t homogeneous
Leaky abstraction
SLIDE 52
Q&A