AI and Predictive Analytics in Data-Center Environments - - PowerPoint PPT Presentation

▶
ai and predictive analytics in data center environments
SMART_READER_LITE
LIVE PREVIEW

AI and Predictive Analytics in Data-Center Environments - - PowerPoint PPT Presentation

Jan 11, 2024 258 likes •481 views

AI and Predictive Analytics in Data-Center Environments Virtualization & Containers Josep Ll. Berral @BSC Intel Academic Education Mindshare Initiative for AI Introduction Independent experiments better be isolated ...in part because

slide-1
SLIDE 1

AI and Predictive Analytics in Data-Center Environments

Virtualization & Containers

Josep Ll. Berral @BSC

Intel Academic Education Mindshare Initiative for AI

slide-2
SLIDE 2

Introduction

“Independent experiments better be isolated ...in part because we are not alone in the system ...also to have reproducible environments”

slide-3
SLIDE 3

Introduction

  • Isolation/Capsule of experiments
  • Prevent our executions to be bothered by other executions, users,

configurations

A

A

B

B

C

C

CPU Mem Disk

Operating System

slide-4
SLIDE 4

Introduction

  • Isolation/Capsule of experiments

A

A

B

B

C

C

CPU Mem Disk

Operating System

Environment Environment Environment

Resource Manager

VM manager (hypervisor)

  • r

Container manager User 1 User 2 User 3

slide-5
SLIDE 5

Introduction

  • Isolation/Capsule of experiments
  • To deploy our executions, independently of the underlying

infrastructure/platform

CPU Mem Disk

Resource Man.

A

A

CPU Mem Disk

Environment Resource Man.

CPU Mem CPU Mem Disk

Resource Man.

CPU Disk

VM manager (hypervisor)

  • r

Container manager

slide-6
SLIDE 6

Introduction

  • Different ways
  • Virtual Machines: ~ partial or total emulation of a “real machine” as a

running process

  • Containers: ~ separated environments (capsules, “pods”, ...) that share

the “base system”

slide-7
SLIDE 7

Virtual Machines

~ partial or total emulation of a “real machine” as a running process

slide-8
SLIDE 8

Virtualization

  • A “machine” inside your machine

OS Virtual HW App App

Virtual Machine

Hardware Operating System App App App App

Physical Machine

Hardware Operating System App App

OS V-HW

App App

OS V-HW

App App

Apps & OS think they are running in a “real” machine

slide-9
SLIDE 9

Virtual Machines

  • Tailoring Resources

OS Virtual HW App App CPU Mem Disk

Operating System Hypervisor

CPU CPU CPU Mem Mem Mem Disk CPU CPU Mem Mem Disk

X 2 X 16GB X 1TB

CPU Mem Disk

slide-10
SLIDE 10

Virtual Machines

  • Tailoring Resources

OS Virtual HW App App CPU Mem Disk

Operating System Hypervisor

CPU CPU CPU Mem Mem Mem Disk CPU CPU Mem Mem Disk

“Are you a real machine?” “Yes, I am” “[Yes, you are...]”

slide-11
SLIDE 11

Virtualization in Resource Providers

  • Resource providers DO NOT give physical resources, but VMs!

Physical Machines Virtual Machines Apps & Services

App App App App App App

Data-Center

slide-12
SLIDE 12

Resource Providers

An Example

slide-13
SLIDE 13

Our framework, Virtualized

  • Deploy VMs in our local machine, in our cluster, or in the Cloud

Cluster

User1 User2 User3

x2 x3 x4

Physical Machine 1 Physical Machine 2 Physical Machine 3

slide-14
SLIDE 14

Our framework, Virtualized

  • Deploy VMs in our local machine, in our cluster, or in the Cloud

Cluster

User1 User2 User3

x2 x3 x4

Physical Machine 1 Physical Machine 2 Physical Machine 3

slide-15
SLIDE 15

Our framework, Virtualized

  • Deploy VMs in our local machine, in our cluster, or in the Cloud

Cluster

User1 User2 User3

x2 x3 x4

Physical Machine 1 Physical Machine 2 Physical Machine 3

slide-16
SLIDE 16

Our framework, Virtualized

  • Deploy VMs in our local machine, in our cluster, or in the Cloud
  • We can deploy any number of copies of the VM where available
  • We can have VMs from different users running together but isolated

Cluster

User1 User2 User3

x2 x3 x4

Physical Machine 1 Physical Machine 2 Physical Machine 3

slide-17
SLIDE 17

Our framework, Virtualized

  • Deploy VMs in our local machine, in our cluster, or in the Cloud
  • We can move or copy the VM to another machine

Cluster

User1 User3

x2 x4

Physical Machine 1 Physical Machine 2 Physical Machine 3

slide-18
SLIDE 18

Our framework, Virtualized

  • Deploy VMs in our local machine, in our cluster, or in the Cloud
  • We can save the state of the VM, and resume later

Cluster

User1 User2 User3

x2 x1 x4

Physical Machine 1 Physical Machine 2 Physical Machine 3

slide-19
SLIDE 19
  • Virtualization of the “user level”
  • Lightweight version of Vms
  • Part of the OS is shared
  • Own environment and specific software and libraries
  • Apps only see their environment

Containers

Environment App App CPU Mem

Disk

Operating System Container Manager

CPU CPU CPU Mem Mem Mem Disk CPU CPU Mem Mem Disk

Resource quotas

slide-20
SLIDE 20

Summary

  • Virtualization/Containers allow to
  • Execute applications and services in an “independent” environment
  • Deploy executions (almost) independent of the base system
  • Deploy copies of applications along physical machines
  • Migrate executions across machines
  • Cloud providers:
  • Provide users Virtualization/Containers
  • Allow management of physical resources