Can Microservices Drive a Renaissance in Workload-Aware Storage - - PowerPoint PPT Presentation

Can Microservices Drive a Renaissance in Workload-Aware Storage Management?

1

12th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage ’20) Pranav Bhandari1, Lukas Rupprecht2, Dimitrios Skourtis2, Ali Anwar2, Deepavali Bhagwat2, Vasily Tarasov2, Avani Wildani1

1Emory University, 2IBM

Microservices

2 Gan, Yu, et al. "An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems." Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). 2019.

➔ Isolation ➔ Flexibility ➔ Productivity ➔ Scalability ➔ Storage?

Storage

3

A B C

Distributed Storage (OpenEBS, Ceph, GPFS, GlusterFS)

STORAGE APP

Microservices

Research

4

Monolithic

A B C

Workload Characterization

Distributed Storage

Auto-tuning

Microservices

Motivation

5

Monolithic

A B C

Monolithic Microservices A heterogeneous mix of workloads from different application components A set of workloads from application components (services) that each perform a simple task Shared storage Each microservice can have its own volume which can be provisioned dynamically DFS

Workload Stability

6

➔ Access pattern based workload metrics

◆ read/write ratio ◆ locality ◆ I/O size distribution

➔ Are these metrics more stable in the workloads of microservices compared to the monolithic workload of functionally similar application?

Storage Auto-tuning

7

➔ Storage parameters

◆ cache (size, write policy, replacement policy, prefetching) ◆ replication ◆ block size ➔ Case study: Cache Size

Setting

8

➔ Isolated I/O cache in host memory

◆ Local in-memory data access ◆ No network request to the storage service ➔ Cache allocated per persistent volume mounted

• n the host

◆ Size cache based on the workload of the persistent volume

Shared vs Isolated Cache

9

Isolated cache performs better than shared cache!

Cache Size Allocation

10

Workload analysis is needed for cache allocation!

Initial Design

11

Thank You!

12

Can Microservices Drive a Renaissance in Workload-Aware Storage Management?

Pranav Bhandari1, Lukas Rupprecht2, Dimitrios Skourtis2, Ali Anwar2, Deepavali Bhagwat2, Vasily Tarasov2, Avani Wildani1

1Emory University, 2IBM

pranav.bhandari@emory.edu