Archipelago: New Cloud Storage Backend of GRNET Filippos Giannakos - - PowerPoint PPT Presentation

▶
archipelago new cloud storage backend of grnet
SMART_READER_LITE
LIVE PREVIEW

Archipelago: New Cloud Storage Backend of GRNET Filippos Giannakos - - PowerPoint PPT Presentation

Oct 16, 2022 170 likes •387 views

Archipelago: New Cloud Storage Backend of GRNET Filippos Giannakos Chrysostomos Nanakos philipgian@grnet.gr cnanakos@grnet.gr Greek Research and Technology Network (GRNET) S.A. 16 th TF-Storage Meeting February 13, 2015 16 th TF-Storage

slide-1
SLIDE 1

Archipelago: New Cloud Storage Backend of GRNET

Filippos Giannakos philipgian@grnet.gr Chrysostomos Nanakos cnanakos@grnet.gr

Greek Research and Technology Network (GRNET) S.A.

16th TF-Storage Meeting February 13, 2015

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 1 / 21

slide-2
SLIDE 2

Background & Motivation Background

Background

Synnefo

OpenStack compatible cloud platform

Powers:

~okeanos https://okeanos.grnet.gr ~okeanos-global https://okeanos-global.grnet.gr

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 2 / 21

slide-3
SLIDE 3

Background & Motivation Motivation

Motivation

Pithos (Storage Sevice)

Swift API Uploaded Files / Images

Plankton (Image Service)

Glance API Registered Images

Cyclades (Compute/Network/Volume Service)

Nova/Neutron/Cinder API Virtual Disks / Volumes

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 3 / 21

slide-4
SLIDE 4

Background & Motivation Motivation

Unified View of Storage Resources

Files User files, with Dropbox-like syncing. Images Templates for VM creation. Volumes Live disks, as seen from VMs. Snapshots Point in time snapshots of volumes.

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 4 / 21

slide-5
SLIDE 5

Archipelago Features Storage Features

Archipelago

Storage Virtualization System

Powering storage in Synnefo

Decouples storage resources from storage backends

Files / Images / Volumes / Snapshots

Unified way to provision, handle, and present resources Decouples logic from actual physical storage

Software-Defined Storage

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 5 / 21

slide-6
SLIDE 6

Archipelago Features Storage Features

Backend Agnostic

Advantages:

No vendor lock-in Migration from one storage backend to another Possibility of combining backends

~okeanos started with NFS and migrated to RADOS

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 6 / 21

slide-7
SLIDE 7

Archipelago Features Storage Features

Storage Backend for the Cloud

With Archipelago we offer:

Deduplication Syncable File/Image upload with partial upload Image Registration Thin clones Downloadable thin snapshots

with zero data movement.

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 7 / 21

slide-8
SLIDE 8

Archipelago Features Services Overview

Services Overview

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 8 / 21

slide-9
SLIDE 9

Under the Hood Everything is a Resource

How it is Done

Everything is a resource on Archipelago The same resource is exposed as:

A file through the API of the Storage Service (Pithos) An image through the API of the Image Service A live disk / VM volume through the API of the Volume Service A snapshot through the API of the Volume Service

All data remain in one place No copying of data around

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 9 / 21

slide-10
SLIDE 10

Under the Hood Mapfiles

Mapfiles

Mapfile for each resource

Keeps track of the mappings from resource offset to objects Keeps metadata information for each resource

Operates on mapfiles

not on the actual data

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 10 / 21

slide-11
SLIDE 11

Under the Hood Mapfiles

From Mapfiles to Data

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 11 / 21

slide-12
SLIDE 12

Under the Hood Architecture

High Level Architecture

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 12 / 21

slide-13
SLIDE 13

Under the Hood Architecture

Low level Architecture

Same Archipelago software stack on each node Modular/Pluggable architecture Distinct processes

Communicate via requests on a shared memory segment

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 13 / 21

slide-14
SLIDE 14

Under the Hood Architecture

Low level Architecture

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 14 / 21

slide-15
SLIDE 15

Under the Hood Architecture

Core

Volume composer

Composes resource I/O from individual objects

Mapper

Keeps and updates the mappings from resource offsets to individual

  • bjects which actually hold the data

Flexible I/O pipeline

Can be extended with other components offering common functionality

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 15 / 21

slide-16
SLIDE 16

Under the Hood Interfaces

Client Endpoints

Upstream Native QEMU virtio driver

VM interface

Blktap2 driver

Admin/VM interface

Pithos

Web interface / REST API

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 16 / 21

slide-17
SLIDE 17

Under the Hood Interfaces

Backend Drivers

Currently supported backends:

Files (Any FS with POSIX semantics) RADOS (Using native librados interface) GlusterFS (Using native libgfapi interface) S3/SWIFT (Experimental)

General: Anything that can support object semantics

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 17 / 21

slide-18
SLIDE 18

Advantages over other Solutions

Advantages over other Solutions

Allows for resource composition from already existing objects Standalone resources Unified view of all cloud resources Backend agnostic

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 18 / 21

slide-19
SLIDE 19

Experience

Experience from Production

3000 VM volumes ≈2.8M user uploaded files ≈20TB deduplicated data ≈80TB total data before replication 22M actual objects on the storage backend

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 19 / 21

slide-20
SLIDE 20

The Future

Upcoming Features

New mapfile format

More compact Allows for larger volumes with minimal metadata overhead (1PB → 2GB)

Garbage collection

Deferred reference counting Automatic deletion of unused objects

SSD Read-only caching

Lower latency

ISCSI target

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 20 / 21

slide-21
SLIDE 21

Thanks

Thanks

Software lives at:

https://www.synnefo.org

Repository:

https://github.com/grnet/archipelago

Documentation:

https://www.synnefo.org/docs/archipelago/latest

Mailing list:

synnefo@googlegroups.com

  • F. Giannakos, C. Nanakos

Archipelago 16th TF-Storage Meeting 21 / 21