OpenAFS as Persistent Storage inside Kubernetes using Container - - PowerPoint PPT Presentation

OpenAFS as Persistent Storage inside Kubernetes using Container Storage Interface plugin for OpenAFS

OpenAFS WorkShop 2019 Pittsburgh, US

Yadavendra Yadav T

• dd DeSantis

Agenda

• Application Modernization
• Evolution of Container
• Container Storage
• Container Storage Interface
• OpenAFS CSI Plugin
• Demo

Monolithic

M i c r

• s

e r v i c e

Introduction to Container Introduction to Container

Containers and VMs Solve Different Problems

Containers is more light and better performance:

• Portability: VM (Gigabytes) vs. Container (Megabytes), VMs are

constraint to Hypervisor and hardware-emulation

• Performance: Containers can boot and restart in seconds, compared to

minutes for virtual machines. And no extra overhead of a hypervisor and guest OS makes containers consume less CPU and memory.

• Management cost: Each VM requires a full functional operating system,

and then extra management for them. Standalone executable package of software with no overhead of OS.

Advantage to use containers:

• Workload Isolation (less CPU/memory overhead and faster deployment than

VMs)

• Resource limitations (cgroups can constrain containers’ memory and CPU usage)
• Layered image architecture such that each change to the package is tracked
• Great to use container in DevOps, Batch processing, SaaS, Microservices etc

Host Server

Host Operating System Hypervisor OS Bins/ Libs App1 OS Bins/ Libs App2 OS Bins/ Libs App3

Host Server

Host Operating System Container Engine Bins/ Libs App1 Bins/ Libs App2 Bins/ Libs App3 Virtual Machines Containers

Build once and Run anywhere

Kubernete s Architectu re

Containers are Ephemeral, Storage is Not

Block, File and Object Storage

Block – Traditional storage is managed by OS i.e. LUN, DISK File –Unstructured data is managed with folders i.e. FILE SYSTEMS Object – Higher growth data is unstructured and managed by APPLICATIONS

Which Array/Volume/LUN Which Directory/ Subdirectory/Filer

Container Storage

Local Host Stora ge

Host

Dedicated storage

Storage Applian ce Storage Applian ce

Distribu ted File System Distribu ted File System

Host Distributed storage Hos t

Kubernetes Container Storage

Persistent Volumes: A Persistent Volume (PV) is a piece of storage in the cluster that has been provisioned by an administrator. Persistent Volume Claim: A Persistent Volume Claim (PVC) is a request for storage by a user.

1GB OpenAF S

pvc-72f93482-525d-x-x volume

OpenAFS ( File system)

OpenAFS Dynamic Volume Provisioner ( Create & Mount Volume)

Developer

claim claim

POD

Volume Bound

Create Volume

Provisione r

Mount

Delete Applicati

• n

pvc-72f93482-525d-x-x volume

OpenAFS ( File system)

OpenAFS Dynamic Volume Provisioner ( Unmount & Delete Volume)

Developer

Delete claim

claim

POD

Provisione r

Un-Mount

Volume Lifecycle

Container Storage Plugin

Docker Volume Plugin Mesos Volume Plugin

K8s dynamic Provisioner K8s fmexvolume plugin K8s in-tree plugin

Persi

Container Storage Interface Container Storage Interface

Container Storage Interface

Container Storage Interface

Container Storage Interface

OpenAFS

kubele t kubele t kubele t

Worker Worker Worker Master 1GB OpenAF S User

Provisioner

AFS Plugin

kubectl

OpenAF S Volume AFS Plugin AFS Plugin

watch

1GB OpenAF S

Create Volume

OpenAFS PVC Creation

OpenAFS

kubele t kubele t kubele t

Worker Worker Worker Master User AFS Plugin

kubectl

OpenAF S Volume AFS Plugin AFS Plugin

watch

Mount Volume

POD Creation

Create Pod

POD

OpenAFS

kubele t kubele t kubele t

Worker Worker Worker Master User AFS Plugin

kubectl

OpenAF S Volume AFS Plugin AFS Plugin

watch

Unmount Volume

POD Deletion

Delete Pod

POD

Thank You

27