Application Migration for Geographically Shifting Workloads Zhiming - - PowerPoint PPT Presentation

▶
application migration for
SMART_READER_LITE
LIVE PREVIEW

Application Migration for Geographically Shifting Workloads Zhiming - - PowerPoint PPT Presentation

Jan 05, 2024 172 likes •421 views

Follow the Sun through the Clouds: Application Migration for Geographically Shifting Workloads Zhiming Shen Cornell University Joint work with Qin Jia, Gur-Eyal Sela, Ben Rainero, Weijia Song, Robbert van Renesse, Hakim Weatherspoon 1

slide-1
SLIDE 1

Follow the Sun through the Clouds: Application Migration for Geographically Shifting Workloads

Zhiming Shen Cornell University Joint work with Qin Jia, Gur-Eyal Sela, Ben Rainero, Weijia Song, Robbert van Renesse, Hakim Weatherspoon

1

slide-2
SLIDE 2

Supercloud Demo

2

Nested VM

VM VM

slide-3
SLIDE 3

Supercloud Demo

2

Nested VM

HTTP VM VM

slide-4
SLIDE 4

Supercloud Demo

2

Nested VM

HTTP VM VM

slide-5
SLIDE 5

Highlights

  • Automatic VM placement and migration
  • Migrated VMs are LIVE
  • IP addresses are not changed
  • TCP connections are not broken

3

slide-6
SLIDE 6

Demo

4

(Full video available at http://supercloud.cs.cornell.edu)

slide-7
SLIDE 7

Full Demo (http://supercloud.cs.cornell.edu)

5

slide-8
SLIDE 8

Highlights

  • Automatic VM placement and migration
  • Migrated VMs are LIVE
  • IP addresses are not changed
  • TCP connections are not broken
  • Appears as a unified private cloud that spans all clouds
  • Controlled by the user!

6

slide-9
SLIDE 9

Research Challenges

  • How to migrate across incompatible virtualization platforms?
  • How to keep IP addresses unchanged and TCP connections unbroken?
  • How to decide when and where to migrate?
  • How to make the system efficient?

7

slide-10
SLIDE 10

Supercloud is the first system that supports automatic, efficient, and live VM migration across heterogeneous cloud providers without changing IP addresses

  • r breaking TCP connections.

8

slide-11
SLIDE 11

Supercloud Architecture

9

  • Computation
  • Nested hypervisor: Xen-Blanket
  • Support all major platforms
  • Network
  • SDN overlay
  • Support migration with public IP
  • Storage:
  • Geo-replicated storage
  • Optimized for serving VM images
  • Resource management
  • OpenStack platform
  • Automatic scheduling framework

First Layer

KVM/virtio Dom0 KVM/virtio Dom0 Availability Zone 1 Availability Zone 2

Cloud Provider 1 Cloud Provider 2

Xen-Blanket Xen-Blanket Xen-Blanket OpenStack OpenStack OpenStack User VMs

Second Layer

User VMs User VMs User VMs User VMs User VMs

First-layer VM Geo-replicated Image Storage Second-layer VM Second-layer hypervisor

Xen/PV-on-HVM

First-layer hypervisor Software-Defined Network (SDN)

slide-12
SLIDE 12

Supercloud Networking

  • Challenges:
  • Optimal routing without extra forwarding
  • Migration without changing IP addresses
  • Solution:
  • VPN overlay with full-mesh tunnels
  • Frenetic SDN controller

10

vSwitch vSwitch vSwitch vSwitch

VM

vSwitch

VM

Cloud 1 Cloud 2

slide-13
SLIDE 13

Supercloud Networking

  • Challenges:
  • Optimal routing without extra forwarding
  • Migration without changing IP addresses
  • Solution:
  • VPN overlay with full-mesh tunnels
  • Frenetic SDN controller

10

vSwitch vSwitch vSwitch vSwitch

VM

vSwitch

VM

Cloud 1 Cloud 2

slide-14
SLIDE 14

VM Migration with Public IP Address

11

VM Pub IP front-end

54.172.26.213 54.172.26.213

slide-15
SLIDE 15

VM Migration with Public IP Address

11

VM Pub IP front-end

54.172.26.213 54.172.26.213

slide-16
SLIDE 16

VM Migration with Public IP Address

11

VM Pub IP front-end

54.172.26.213 54.172.26.213

Dynamic DNS?

  • Can be delayed due to cache
  • Can cause connection interrupts
  • Some applications might not work
slide-17
SLIDE 17

VM Migration with Public IP Address

12

VM Pub IP front-end

54.172.26.213

Pub IP front-end

52.69.94.195

slide-18
SLIDE 18

VM Migration with Public IP Address

12

VM Pub IP front-end

54.172.26.213

Pub IP front-end

52.69.94.195

slide-19
SLIDE 19

Centralized VM Image Storage

13

VM Image Long latency; Low throughput

slide-20
SLIDE 20

Geo-Replicated VM Image Storage

14

VM Image Image

slide-21
SLIDE 21

Geo-Replicated VM Image Storage

14

VM Image Image

slide-22
SLIDE 22

Geo-Replicated VM Image Storage

14

VM Image Image

Challenges:

  • Strong consistency requirement
  • Long latency and low throughput in WAN

Supercloud VM image storage:

  • Decoupling consistency from data propagation.
  • Propagating data according to disk access patterns.
slide-23
SLIDE 23

In the Paper

  • Comparison with application-level migration
  • Placement policies for different types of applications
  • Detail design of the image storage
  • Hierarchical network topology
  • Evaluations

15

slide-24
SLIDE 24

Conclusion

  • Supercloud: application migration for geographically shifting workloads
  • Crossing heterogeneous cloud providers
  • Automatic placement and migration
  • Geo-replicated image storage
  • Wide-area SDN
  • A unified private cloud that spans all clouds
  • Controlled by the user!
  • More at http://supercloud.cs.cornell.edu

16

Thank You. Questions?