Could Cloud Storage Be Disrupted in the Next Decade? Andromachi Chatzieleftheriou, Ioan Stefanovici , Dushyanth Narayanan Benn Thomsen, Antony Rowstron Microsoft Research
Cloud Storage Landscape: Yesterday + Today Storage Technologies $$$$ Premium Storage Flash Hot Data Virtual Disks Access Rate $$ Storage Hard Disk Azure IoT $ Tape Archive Backup and archive Storage Cold Data Capacity 2
Exponential Growth • Storage demand continues to increase at a staggering pace! • Cost is paramount in the cloud • Exponential demand requires exponential drops in cost ($/GB) 3
• Flash The S-Curve P/E Cycle Endurance New Technology Feature Size • Hard Disk Drives Maturity (e.g., GB/$ or IOPS/$) IOPS / TB Metric of Interest Take off Time • Magnetic Tape # Tapes Shipped Ferment Time Time 4
Tier Virtualization Storage Technology SLA 1: IOPS: ★★★★★ Cost: $$$$ Flash SLA 2: IOPS: ★★★ Cost: $$ Hard Disk SLA 3: IOPS: ★ Tape Cost: $ 5
Specialization at Scale • E.g.: cold storage New Technology SLA 3: (e.g. Silica, DNA) IOPS: ★ Cost: $ Tape 6
Specialization at Scale Storage Technology SLA 1: IOPS: ★★★★★ Cost: $$$$ Flash SLA 4: Future IOPS: ★★★★ Technology! Cost: $$$ SLA 2: IOPS: ★★★ Cost: $$ Hard Disk SLA 3: IOPS: ★ New Technology Cost: $ (e.g. Silica, DNA) Tape 7
Cloud-First Storage Design • Maximizing component utilization + flexibility is crucial! • Disaggregation Infrastructure Hardware Full … C2 C2 Compute C2 Storage Server C2 Storage Server … Compute D D D D D D … Read E E E E E E Storage Server Compute V V V V V V … Read Storage Server D D D D D D C1 … Compute C1 E E E E E E C1 Read Media D D D D D D … V V V V V V Compute E E E E E E Media D D D D D D … Read Write V V V V V V E E E E E E Media Compute … … V V V V V V Read Media D D D D D D … Write Compute E E E E E E Media Read Storage Server V V V V V V … … … Media D D D D D D … … D D D D D … D Read E E E E E E Compute E E E E E E Media V V V V V V V V V V V V 8
Cloud-First Storage Design • Full Disaggregation … C2 • Embrace form factor freedom! C2 C2 C2 • Cloud- first technologies don’t need to emulate Read • Hardware deployment is rack-level … Read C1 C1 C1 Media Read Media Read Write • HW/SW co-design for e-2-e tail latency Media … Read Media • Providers have little insight into workloads Write Media Read … Media … Read Media • Needed compute can ride hardware trends • Sustainability (please read paper!) 9
What’s Next? • Today: cloud storage is poised for disruption • Tomorrow? Something completely new! Image sources: 10 https://images.anandtech.com/doci/13083/3D-XPoint_678x452.PNG https://www.nature.com/articles/422556a
Parting Thoughts • Design for a single domain: cloud • Avoid “drop -in- replacement” emulation • Remove compromises + embrace form factor freedom! • Hardware/software co-design from the materials up! • Crucial to providing sustainable exponential growth in the cloud • Multi-disciplinary teams are key • Challenge the conventional “division of labour” • Join us! 11
Thank you! • Follow-up contact information: • Andromachi Chatzieleftheriou: anchatzi@microsoft.com • Ioan Stefanovici: iostefan@microsoft.com 12
Recommend
More recommend
