SLIDE 1
Stuff I do Follow me! https://pasztor.at @janoszen About this - - PowerPoint PPT Presentation
Stuff I do Follow me! https://pasztor.at @janoszen About this - - PowerPoint PPT Presentation
Stuff I do Follow me! https://pasztor.at @janoszen About this talk 1. The problem with CDNs About this talk 1. The problem with CDNs 2. How does a CDN work? About this talk 1. The problem with CDNs 2. How does a CDN work? 3. Static
SLIDE 2
SLIDE 3
Follow me!
https://pasztor.at @janoszen
SLIDE 4
About this talk
- 1. The problem with CDNs
SLIDE 5
About this talk
- 1. The problem with CDNs
- 2. How does a CDN work?
SLIDE 6
About this talk
- 1. The problem with CDNs
- 2. How does a CDN work?
- 3. Static content CDN
SLIDE 7
About this talk
- 1. The problem with CDNs
- 2. How does a CDN work?
- 3. Static content CDN
- 4. Hosting dynamic content
SLIDE 8
Assumptions
You know what HTTP is.
SLIDE 9
Assumptions
You know what HTTP is. You know what a DNS is.
SLIDE 10
Assumptions
You know what HTTP is. You know what a DNS is. You know what a CDN is.
SLIDE 11
Warning!
Don’t do this at home!
This is as experimental as it gets.
SLIDE 12
The problem with CDNs
Low-traffic sites don’t work well with a CDN
SLIDE 13
The problem with CDNs
SLIDE 14
The problem with CDNs
SLIDE 15
The problem with CDNs
SLIDE 16
The problem with CDNs
SLIDE 17
The problem with CDNs
SLIDE 18
The problem with CDNs
SLIDE 19
The problem with CDNs
SLIDE 20
The problem with CDNs
SLIDE 21
The problem with CDNs
SLIDE 22
The problem with CDNs
User CDN Origin GET /avatar.jpg Cache
SLIDE 23
The problem with CDNs
User CDN Origin GET /avatar.jpg Cache
SLIDE 24
The problem with CDNs
User CDN Origin GET /avatar.jpg Cache GET /avatar.jpg
SLIDE 25
The problem with CDNs
User CDN Origin Cache GET /avatar.jpg GET /avatar.jpg
SLIDE 26
The problem with CDNs
User CDN Origin GET /avatar.jpg Cache GET /avatar.jpg
SLIDE 27
The problem with CDNs
User CDN Origin Cache GET /avatar.jpg
SLIDE 28
The problem with CDNs
User CDN Origin Cache ~30-40 ms ~160 ms
SLIDE 29
The problem with CDNs
User CDN Origin Cache ~30-40 ms ~160 ms ~30-40 ms ~10 ms
SLIDE 30
The problem with CDNs
User CDN Origin Cache ~30-40 ms ~160 ms ~160 ms ~30-40 ms ~10 ms
SLIDE 31
The problem with CDNs
User CDN Origin Cache ~30-40 ms ~160 ms ~160 ms ~160 ms ~200 ms ~50 ms ~30-40 ms ~10 ms
SLIDE 32
The problem with CDNs
Workaround:
SLIDE 33
The problem with CDNs
Workaround:
Cache-Control: s-maxage=31536000
SLIDE 34
The problem with CDNs
Caveat:
All files must have unique URLs! Does not always work.
SLIDE 35
How do CDNs work?
Locating the proper edge node
SLIDE 36
How do CDNs work?
User CDN POP in Europe CDN POP in the USA
SLIDE 37
How do CDNs work?
User CDN POP in Europe CDN POP in the USA
SLIDE 38
How do CDNs work?
User CDN POP in Europe CDN POP in the USA
SLIDE 39
How do CDNs work?
User CDN POP in Europe CDN POP in the USA
SLIDE 40
How do CDNs work?
User CDN POP in Europe CDN POP in the USA
SLIDE 41
How do CDNs work?
User CDN POP in Europe CDN POP in the USA
SLIDE 42
How do CDNs work?
User CDN POP in Europe CDN POP in the USA I have 1.2.3.4!
SLIDE 43
How do CDNs work?
User CDN POP in Europe CDN POP in the USA I have 1.2.3.4!
SLIDE 44
How do CDNs work?
User CDN POP in Europe CDN POP in the USA I have 1.2.3.4!
SLIDE 45
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4
SLIDE 46
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 I have 1.2.3.4!
SLIDE 47
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 I have 1.2.3.4!
SLIDE 48
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 I have 1.2.3.4!
SLIDE 49
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 I have 1.2.3.4!
SLIDE 50
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 I have 1.2.3.4!
SLIDE 51
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 I have 1.2.3.4!
SLIDE 52
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 1.2.3.4
SLIDE 53
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 1.2.3.4 3 hops 6 hops
SLIDE 54
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 1.2.3.4
SLIDE 55
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 1.2.3.4 10.1.0.1 10.2.0.1
SLIDE 56
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 1.2.3.4 10.1.0.1 10.2.0.1
What is the IP for pasztor.at?
SLIDE 57
How do CDNs work?
User CDN POP in Europe CDN POP in the USA 1.2.3.4 1.2.3.4 10.1.0.1 10.2.0.1
10.1.0.1
SLIDE 58
How do CDNs work?
User CDN POP in Europe CDN POP in the USA
Anycast is ONLY used for DNS lookups!
See https://engineering.linkedin.com/network-performance/tcp-over-ip-anycast-pipe-dream-or-reality
SLIDE 59
Hosting static content
Part 1:
Finding a DNS provider
SLIDE 60
Hosting static content
Anycast servers
SLIDE 61
Hosting static content
Anycast servers Latency- or GeoIP based responses
SLIDE 62
✓ ✓
Hosting static content
Anycast servers Latency- or GeoIP based responses
SLIDE 63
Hosting static content
eu-central-1.glb.techblog.cloud. IN A 18.194.241.96 us-east-1.glb.techblog.cloud. IN A 54.152.113.29 us-west-1.glb.techblog.cloud. IN A 52.9.244.13
SLIDE 64
Hosting static content
eu-central-1.glb.techblog.cloud. IN A 18.194.241.96 us-east-1.glb.techblog.cloud. IN A 54.152.113.29 us-west-1.glb.techblog.cloud. IN A 52.9.244.13 glb.techblog.cloud. IN ALIAS eu-central-1.glb.techblog.cloud. glb.techblog.cloud. IN ALIAS us-east-1.glb.techblog.cloud. glb.techblog.cloud. IN ALIAS us-west-1.glb.techblog.cloud.
SLIDE 65
Hosting static content
SLIDE 66
Hosting static content
Part 2:
Docker
SLIDE 67
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance My laptop EC2 instance EC2 instance
SLIDE 68
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
ECS AGENT
My laptop ECS ECS ECS EC2 instance
ECS AGENT
EC2 instance
ECS AGENT
SLIDE 69
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
ECS AGENT WEB SERVER
My laptop ECS ECS ECS EC2 instance
ECS AGENT WEB SERVER
EC2 instance
ECS AGENT WEB SERVER
SLIDE 70
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
ECS AGENT WEB SERVER
My laptop ECS ECS ECS EC2 instance
ECS AGENT WEB SERVER
EC2 instance
ECS AGENT WEB SERVER
ECR
SLIDE 71
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
ECS AGENT WEB SERVER
My laptop ECR ECS ECS ECS EC2 instance
ECS AGENT WEB SERVER
EC2 instance
ECS AGENT WEB SERVER Docker Image Webserver Content
SLIDE 72
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
ECS AGENT WEB SERVER
My laptop ECR ECS ECS ECS EC2 instance
ECS AGENT WEB SERVER
EC2 instance
ECS AGENT WEB SERVER Docker Image
SLIDE 73
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
ECS AGENT WEB SERVER
My laptop ECS ECS ECS EC2 instance
ECS AGENT WEB SERVER
EC2 instance
ECS AGENT WEB SERVER Docker Image
ECR
SLIDE 74
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
ECS AGENT WEB SERVER
My laptop ECR ECS ECS ECS EC2 instance
ECS AGENT WEB SERVER
EC2 instance
ECS AGENT WEB SERVER
SLIDE 75
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
WEB SERVER
My laptop ECR EC2 instance
WEB SERVER
EC2 instance
WEB SERVER ECS AGENT
ECS ECS ECS
ECS AGENT ECS AGENT
SLIDE 76
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
WEB SERVER
My laptop ECS ECS ECS EC2 instance
WEB SERVER
EC2 instance
WEB SERVER ECS AGENT
ECR
ECS AGENT ECS AGENT
SLIDE 77
Hosting static content
us-west-1 us-east-1 eu-central-1 EC2 instance
ECS AGENT WEB SERVER
My laptop ECR ECS ECS ECS EC2 instance
ECS AGENT WEB SERVER
EC2 instance
ECS AGENT WEB SERVER
SLIDE 78
Hosting dynamic content
Can it run Wordpress?
SLIDE 79
Hosting dynamic content
us-west-1 us-east-1 eu-central-1 EC2 instance EC2 instance EC2 instance
SLIDE 80
Hosting dynamic content
us-west-1 us-east-1 eu-central-1 EC2 instance EC2 instance EC2 instance INTERNET
SLIDE 81
Hosting dynamic content
us-west-1 us-east-1 eu-central-1 EC2 instance EC2 instance EC2 instance INTERNET
Docker Swarm Overlay Network
SLIDE 82
Hosting dynamic content
us-west-1 us-east-1 eu-central-1 EC2 instance EC2 instance EC2 instance INTERNET
WEB SERVER WEB SERVER WEB SERVER
SLIDE 83
Hosting dynamic content
us-west-1 us-east-1 eu-central-1 EC2 instance EC2 instance EC2 instance INTERNET
WEB SERVER WEB SERVER WEB SERVER GALERA GALERA GALERA
SLIDE 84
Hosting dynamic content
SLIDE 85
Hosting dynamic content
Unsolved issues:
SLIDE 86
Hosting dynamic content
Unsolved issues: Distributing Static Content
SLIDE 87
Hosting dynamic content
Unsolved issues: Distributing Static Content Downtime-less Updates
SLIDE 88
Hosting dynamic content
Unsolved issues: Distributing Static Content Downtime-less Updates Monitoring
SLIDE 89
Summary
Is it worth it?
SLIDE 90
Summary
SLIDE 91
Summary
SLIDE 92
Summary
SLIDE 93
Summary
SLIDE 94
Summary
Probably not.
SLIDE 95
Summary
Questions?
Many thanks to Bence Sántha, Dan Radenković, Gábor Vereb, János Angeli, Krisztián Papp for their inspiration and feedback.