Virtual machine images as structured data The Mirage image library - - PowerPoint PPT Presentation

▶
virtual machine images as structured data the mirage
SMART_READER_LITE
LIVE PREVIEW

Virtual machine images as structured data The Mirage image library - - PowerPoint PPT Presentation

Mar 13, 2024 537 likes •723 views

Virtual machine images as structured data The Mirage image library Glenn Ammons, Vasanth Bala, Todd Mummert, Darrell Reimer, Xiaolan Zhang IBM Research Why image libraries? VM image puts app config in one place; image library puts

slide-1
SLIDE 1

Virtual machine images as structured data The Mirage image library Glenn Ammons, Vasanth Bala, Todd Mummert, Darrell Reimer, Xiaolan Zhang IBM Research

slide-2
SLIDE 2

June 2011 IBM Research 2

Why image libraries?

  • VM image puts app config in one place; image

library puts enterprise config in one place

  • Improve maintenance: scans, patches
  • Permit analyses: search, mine, compare

– What DBMSs do we use? Why did our webapp break?

  • Image libraries: go beyond deploy/capture
  • Provenance
  • Version and access control
  • Efficient, offline maintenance and analyses
slide-3
SLIDE 3

June 2011 IBM Research 3

VM images as structured data

Unstructured (hypervisor) Structured (Mirage)

Image manifest FS manifest

/etc/passwd /usr/bin/ls ...

Metadata File contents (in CAS) Checkin Checkout Disk manifest VM image

slide-4
SLIDE 4

June 2011 IBM Research 4

Experience: RC2

  • Problem: convert all images from Xen to KVM
  • No downtime, low resource use, user transparency
  • Must install kernels, kernel modules, change config.
  • Iterative: fail → find bug → fix → try again
  • Version control useful

– Rollback – Comparisons for debugging

  • Used virtual mount to speed conversion
slide-5
SLIDE 5

June 2011 IBM Research 5

Virtual mount

Structured (Mirage)

Image manifest FS manifest

/boot/kernel /etc/network/foo ...

Metadata File contents (in CAS) Disk manifest % import kvm-kernel % vmount IMAGE /mnt

slide-6
SLIDE 6

June 2011 IBM Research 6

Virtual mount

Structured (Mirage)

Image manifest FS manifest

/boot/kernel /etc/network/foo ...

Metadata File contents (in CAS) Disk manifest % import kvm-kernel % vmount IMAGE /mnt % replace-content \ /boot/kernel

slide-7
SLIDE 7

June 2011 IBM Research 7

Virtual mount

Structured (Mirage)

Image manifest FS manifest

/boot/kernel /etc/network/foo ...

Metadata File contents (in CAS) Disk manifest % import kvm-kernel % vmount IMAGE /mnt % replace-content \ /boot/kernel % vi /etc/network/foo

slide-8
SLIDE 8

June 2011 IBM Research 8

Experience: IBM Workload Deployer

OS team MW team App team A.0 B.0 clone B.1 Install MW C.0 clone C.1 Install app

slide-9
SLIDE 9

June 2011 IBM Research 9

Experience: IBM Workload Deployer

OS team MW team App team A.0 B.0 clone B.1 Install MW C.0 clone C.1 Install app A.1 Update OS

slide-10
SLIDE 10

June 2011 IBM Research 10

Experience: IBM Workload Deployer

OS team MW team App team A.0 B.0 clone B.1 Install MW C.0 clone C.1 Install app A.1 B.2 Patch w/ diff(A.0, A.1) Update OS

slide-11
SLIDE 11

June 2011 IBM Research 11

Backup slides

slide-12
SLIDE 12

June 2011 IBM Research 12

Mirage architecture

Catalog manager Library services Image indexer Content-addressed store Database Storage Clients

slide-13
SLIDE 13

June 2011 IBM Research 13

Mirage architecture

Catalog manager Library services Image indexer Content-addressed store Database Storage Clients Deduplication Garbage collection Structure-aware Optimized for images Deduplication Garbage collection Structure-aware Optimized for images

slide-14
SLIDE 14

June 2011 IBM Research 14

Mirage architecture

Catalog manager Library services Image indexer Content-addressed store Database Storage Clients Converts to and from Mirage format Flexible plugin architecture Converts to and from Mirage format Flexible plugin architecture

slide-15
SLIDE 15

June 2011 IBM Research 15

Mirage architecture

Catalog manager Library services Image indexer Content-addressed store Database Storage Clients Maintains metadata State (active/deleted) Provenance tree Access control Version control Maintains metadata State (active/deleted) Provenance tree Access control Version control

slide-16
SLIDE 16

June 2011 IBM Research 16

Mirage architecture

Catalog manager Library services Image indexer Content-addressed store Database Storage Clients Checkin/checkout Virtual mount Describe, list, compare, search Admin functions Checkin/checkout Virtual mount Describe, list, compare, search Admin functions

slide-17
SLIDE 17

June 2011 IBM Research 17

Reducing translation costs

  • Runtime translation costs reduced by
  • Structure-aware CAS (faster lookups)
  • Virtual mount (avoids translation)
  • Delta deployment (exploits sharing)
  • Hybrid indexing reduces dev. Costs
  • Offloads grotty details to backup/restore tools
  • See paper for details