Impact of Advanced Virtualization S. Freitag Technologies on Grid - - PowerPoint PPT Presentation

▶
impact of advanced virtualization
SMART_READER_LITE
LIVE PREVIEW

Impact of Advanced Virtualization S. Freitag Technologies on Grid - - PowerPoint PPT Presentation

Mar 13, 2023 162 likes •334 views

Virtualization in Grid Computing Centers Impact of Advanced Virtualization S. Freitag Technologies on Grid Computing Centers Virtualization International Symposium on Grid Computing 2009 Impact on Grid Computing Conclusion Stefan

slide-1
SLIDE 1

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Impact of Advanced Virtualization Technologies on Grid Computing Centers

International Symposium on Grid Computing 2009 Stefan Freitag

Robotics Research Institute Dortmund University of Technology

  • 23. April 2009
slide-2
SLIDE 2

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Overview

1 Virtualization 2 Impact on Grid Computing 3 Conclusion

slide-3
SLIDE 3

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Introduction

Application Resource Virtualization OS Level Network Platform Full Storage Input/Output Paravirtualized

Figure: Types of Virtualization

slide-4
SLIDE 4

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Network

VPN (Virtual Private Network) disjunct network partitions gateway service for tunneling WAN for interconnect

WAN

LAN 1

LAN 2 LAN 3

FW FW FW GW GW GW

slide-5
SLIDE 5

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Network

VLAN (Virtual Local Area Network) Layer 2 (data link layer) construct, IEEE 802.1Q standard Devices on different physical LAN segments Communication as if on same physical LAN segment (bcast domain) Configuration of VLAN through software Traffic shaping/ QoS

LAN

. . . . . . S1 S4 . . . S3 . . . S2 VLAN2 VLAN1

slide-6
SLIDE 6

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Storage

decreasing storage costs (GByte/$) increasing management complexity full SAN bandwidth for I/O requests separation of data and metadata into different places control unit: appliances or SAN switches

Virtualization 2 3 4 1

Virtualization 2 1 Control 5 3 6 4 Virtualization 1a 1b 2 3 4 Control 1

slide-7
SLIDE 7

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Platform

Full virtualized Environment

guest unaware of virtualization, run native OS reduced performance because of hardware emulation

Para virtualized Environment

management module (hypervisor or virtual machine monitor) operates with modified operating system guest OS has much closer control of the underlying hardware (security, influence on other VMs)

VM Management Virtual Hardware Virtual Hardware Guest OS Application Guest OS Application X86 Hardware Host OS Virtualization Layer X86 Hardware Virtualization Layer Application Application Management VM Guest OS Guest OS (modified) (modified) Host OS

slide-8
SLIDE 8

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Input/ Output (IOV)

Typical configuration: 4 to 6 I/O cards per server

Ethernet Infiniband Fiber Channel

add I/O virtualization capability to PCIe

disaggreation consolidation virtualization

/WAN LAN SAN PCIe NICs IOV Switch HBAs Server

slide-9
SLIDE 9

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Input/ Output (IOV)

I/O consolidation 100% of server connected to Ethernet, only 20% to FC FiberChannel over Ethernet (FCoE), pre-standard converged Network Adapter (C-NIC/ CNA) benefit for compute centers

fewer adapters power savings cable management

LAN /WAN SAN Server C−NIC FCoE Switch

Ethernet Switch
slide-10
SLIDE 10

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Present situation

Platform and storage virtualization in use server consolidation

improved utilization of existing servers increased number of services per m2 reducing TCO (maintenance,...) in the long-run

high availability run legacy applications managing mass-storage backends migration of virtual machines is bound to restrictions

storage network reconfiguration

slide-11
SLIDE 11

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Platform Virtualization @ LRMS level

Job = Virtual Machine

share same operations (start, stop, suspend, checkpointing)

Scenarios:

user submits self-prepared virtual machine

  • n-demand creation of virtual machine by LRMS

VM description as part of job specification LRMS schedules jobs and/ or virtual machines Not so good: black-box execution performance loss (MPI) compared to non-virtualized solution

slide-12
SLIDE 12

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

IOV @ LRMS level

vNIC (virtual Network Interface Card) vHBA (virtual Host Bus Adapter)

FC WWN used to identify to segregate devices for access control Virtualized environments: adapter’s WWN represents all DomUs (Xen) DomU migrates to new server, but WWN does not zoning and LUN masking (access control) ineffective vHBA gets own WWN which migrates with VM

slide-13
SLIDE 13

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Platform Virtualization @ Grid Level

Benefits provide uniform environment to Grid users rapid on-demand provisioning of Grid nodes non-interfering execution of multiple Grid middlewares decoupling of knowledge (grid operator/ grid user) job exchange, e.g. inter cluster/ Grid resources

slide-14
SLIDE 14

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Platform Virtualization @ Grid Level

Drawback resources run different virtualization software

Xen, KVM, VMware, . . .

creation of user environment for each resource

slide-15
SLIDE 15

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Virtual Appliances

encapsulate user environment in a virtual appliance virtual appliance = virtual machine + operating system + application level software + MD5 Job = virtual machine virtual appliance virtual appliance is already technology-dependent :-( better approach step 1: create

  • perating system + application level software + MD5

step 2: make it technology-dependent

slide-16
SLIDE 16

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

KIWI

idea: prepare once, run anywhere distribution independent, currently only SuSE supported centralized image description based on XML

  • utput formats: xen, vmware, Amazon EC2, iso, . . .

adoption to Scientific Linux ongoing in Dortmund

Packed Image description Image software packages additional ready 2 serve access via chroot access via loop Unpacked Image

Figure: from: KIWI Cookbook

slide-17
SLIDE 17

Virtualization in Grid Computing Centers

  • S. Freitag

Virtualization Impact on Grid Computing Conclusion

Conclusion & Outlook

Conclusion platform and storage virtualization widely spread increased flexibility with I/O virtualization/ FCoE Grids profit at LRMS and Grid layer from virtualization

  • n-demand provisioning of virtual appliances

Outlook Grid resource provides bare metal + virtualization layer provision of resources to more than one Grid infrastructure/ VO