#RP30 Automated Deployment and Scaling of Named Data Networks in - - PowerPoint PPT Presentation

rp30
SMART_READER_LITE
LIVE PREVIEW

#RP30 Automated Deployment and Scaling of Named Data Networks in - - PowerPoint PPT Presentation

#RP30 Automated Deployment and Scaling of Named Data Networks in Cloud Environments Sean Liao Supervisor: Zhiming Zhao 1 Next 20 mins... Some academic(s) arrive to tell us that (once again) they have Fixed the Internet, and (once again) it


slide-1
SLIDE 1

#RP30

Automated Deployment and Scaling of Named Data Networks in Cloud Environments

1

Sean Liao Supervisor: Zhiming Zhao

slide-2
SLIDE 2

Next 20 mins...

Some academic(s) arrive to tell us that (once again) they have Fixed the Internet, and (once again) it runs on top of the current actually-working internet, and (once again) if you sign up you can communicate with as many as twelve other computers.

n-gate.com in reference to SCION

2

slide-3
SLIDE 3

Introduction

3

slide-4
SLIDE 4

ENVRI-FAIR

4

ENVironmental Research Infrastructures (ENVRI) connection to European Open Science Cloud (EOSC)

https://envri.eu/about-envri-fair/

slide-5
SLIDE 5

Data distribution

5

slide-6
SLIDE 6

Content Distribution Network

6

slide-7
SLIDE 7

Federated Clouds

7

slide-8
SLIDE 8

Named Data Networking (NDN)

8

slide-9
SLIDE 9

Named Data Networking

9

NSF Future Internet Architecture Program Information distribution network Potential benefits:

  • content caching
  • network level security of data
slide-10
SLIDE 10

1.2.3.4/a/b/c/d

10

slide-11
SLIDE 11

Route directly to data

11

IPv4: 1.2.3.4 IPv6: 1:2:3:4:5:6:7:8 NDN: /arbitrary/strings/infinite/address/space

slide-12
SLIDE 12

1-1 Request-Response (Interest-Data)

12

slide-13
SLIDE 13

In network caching

13

slide-14
SLIDE 14

Run it

14

slide-15
SLIDE 15

In the Cloud

15

Overlay over IP Simplify deployment Scalable Existing Tools

Router: NFD Link State Routing: NLSR Dynamic route updates on static network Connectivity: FCH Find closest hub/gateway

slide-16
SLIDE 16

Overlay over TCP / UDP

16

Each point is average over 10K requests

slide-17
SLIDE 17

Processing Overhead

17

Subtract network roundtrip time: 0.174ms

slide-18
SLIDE 18

Testing notes

Performance severely degrades with 50000+ cached / in-flight requests

18

slide-19
SLIDE 19

Scaling Up

19

slide-20
SLIDE 20

Problem: Growing a node

20

slide-21
SLIDE 21

Replace

21

slide-22
SLIDE 22

New Node in Front

22

slide-23
SLIDE 23

New Node Behind (Chain)

23

slide-24
SLIDE 24

New Node Behind (Load Balancing)

24

slide-25
SLIDE 25

Growing the Network

25

slide-26
SLIDE 26

Problem: New Node

26

slide-27
SLIDE 27

Broadcast / Multicast

27

slide-28
SLIDE 28

Bootstrap Gossip

28

slide-29
SLIDE 29

Central Discovery Server

29

slide-30
SLIDE 30

Network Architecture

30

slide-31
SLIDE 31

3 Layer Cache

31

slide-32
SLIDE 32

Mesh Network

32

slide-33
SLIDE 33

Automation

33

slide-34
SLIDE 34

In-band Management

34

slide-35
SLIDE 35

Out of Band Management

35

slide-36
SLIDE 36

Proof of Concept

36

slide-37
SLIDE 37

Necessary Configuration

37

Discovery Server

  • Write down its address / Give it a preconfigured address

Load Balancer

  • Address of Discovery Server
  • Write down its address / Give it a preconfigured address

Caching Server

  • Address of Load Balancer
slide-38
SLIDE 38

38

No Cache 1 Cache Increased Path 2 Caches

slide-39
SLIDE 39

Proof of Concept Performance

Scraping state of router through CLI (on a timer) TCP connections propagate routes and updates Coarse grained partitioning of routes

39

slide-40
SLIDE 40

Conclusion

40

slide-41
SLIDE 41

Does it work?

41

Reuse existing router in a load balancing configuration Minimal configuration, self connecting network

slide-42
SLIDE 42

Lessons Learned

Now

Rapidly evolving research testbed for new ideas Things break or are not optimized

Future Some new network based

  • n these ideas

Or maybe not (IPv6…)

42

slide-43
SLIDE 43

Demo: add load balancer (40s)

43

slide-44
SLIDE 44

Demo: remove load balancer (16s)

44

slide-45
SLIDE 45

Demo: add Cache (44s)

45

slide-46
SLIDE 46

Demo: remove Cache (17s)

46