Could Cloud Storage Be Disrupted in the Next Decade? Andromachi - - PowerPoint PPT Presentation

could cloud storage be
SMART_READER_LITE
LIVE PREVIEW

Could Cloud Storage Be Disrupted in the Next Decade? Andromachi - - PowerPoint PPT Presentation

Could Cloud Storage Be Disrupted in the Next Decade? Andromachi Chatzieleftheriou, Ioan Stefanovici , Dushyanth Narayanan Benn Thomsen, Antony Rowstron Microsoft Research Cloud Storage Landscape: Yesterday + Today Storage Technologies $$$$


slide-1
SLIDE 1

Could Cloud Storage Be Disrupted in the Next Decade?

Andromachi Chatzieleftheriou, Ioan Stefanovici, Dushyanth Narayanan Benn Thomsen, Antony Rowstron Microsoft Research

slide-2
SLIDE 2

Capacity

Backup and archive

Azure IoT

Virtual Disks

Cloud Storage Landscape: Yesterday + Today

Hard Disk Flash Tape

Storage Technologies

Hot Data Cold Data Access Rate

2

Premium Storage $$$$ Storage $$ Archive Storage $

slide-3
SLIDE 3

Exponential Growth

  • Storage demand continues to increase at a

staggering pace!

3

  • Cost is paramount in the cloud
  • Exponential demand requires exponential drops in cost ($/GB)
slide-4
SLIDE 4

The S-Curve

Ferment Take off Maturity New Technology Time Metric of Interest (e.g., GB/$ or IOPS/$)

  • Flash
  • Hard Disk Drives
  • Magnetic Tape

Time # Tapes Shipped Time IOPS / TB

Feature Size

P/E Cycle Endurance

4

slide-5
SLIDE 5

Tier Virtualization

Tape

Storage Technology

5

Flash

SLA 1: IOPS: ★★★★★ Cost: $$$$

Hard Disk

SLA 2: IOPS: ★★★ Cost: $$ SLA 3: IOPS: ★ Cost: $

slide-6
SLIDE 6

Tape

6

New Technology (e.g. Silica, DNA)

SLA 3: IOPS: ★ Cost: $

  • E.g.: cold storage

Specialization at Scale

slide-7
SLIDE 7

Specialization at Scale

Storage Technology

7

Flash

SLA 1: IOPS: ★★★★★ Cost: $$$$

Hard Disk

SLA 2: IOPS: ★★★ Cost: $$ SLA 3: IOPS: ★ Cost: $

Tape New Technology (e.g. Silica, DNA)

SLA 4: IOPS: ★★★★ Cost: $$$

Future Technology!

slide-8
SLIDE 8
  • Maximizing component utilization + flexibility is crucial!
  • Disaggregation

Compute Compute Compute Compute Compute Compute Compute Compute …

Storage Server

D E V D E V D E V D E V D E V D E V

… …

Storage Server

D E V D E V D E V D E V D E V D E V

Storage Server

D E V D E V D E V D E V D E V D E V

Infrastructure Hardware

Storage Server

D E V D E V D E V D E V D E V D E V

Storage Server

D E V D E V D E V D E V D E V D E V

D E V D E V D E V D E V D E V D E V

… …

D E V D E V D E V D E V D E V D E V

Cloud-First Storage Design

Full

8

Media Media Media … Media Media Media Media Write Write … Read Read Read Read Read … Read Read

C1

C1 C1 C2

C2 C2 C2

slide-9
SLIDE 9

Cloud-First Storage Design

  • Full Disaggregation
  • Embrace form factor freedom!
  • Cloud-first technologies don’t need to emulate
  • Hardware deployment is rack-level
  • HW/SW co-design for e-2-e tail latency
  • Providers have little insight into workloads
  • Needed compute can ride hardware trends
  • Sustainability (please read paper!)

9

Media Media Media … Media Media Media Media Write Write … Read Read Read Read Read … Read Read

C1

C1 C1 C2

C2 C2 C2

slide-10
SLIDE 10

What’s Next?

  • Today: cloud storage is poised for disruption
  • Tomorrow?

10

Image sources: https://images.anandtech.com/doci/13083/3D-XPoint_678x452.PNG https://www.nature.com/articles/422556a

Something completely new!

slide-11
SLIDE 11

Parting Thoughts

  • Design for a single domain: cloud
  • Avoid “drop-in-replacement” emulation
  • Remove compromises + embrace form factor freedom!
  • Hardware/software co-design from the materials up!
  • Crucial to providing sustainable exponential growth in the cloud
  • Multi-disciplinary teams are key
  • Challenge the conventional “division of labour”
  • Join us!

11

slide-12
SLIDE 12

Thank you!

  • Follow-up contact information:
  • Andromachi Chatzieleftheriou: anchatzi@microsoft.com
  • Ioan Stefanovici: iostefan@microsoft.com

12