Seagate's Contribution to Legacy File Systems
SMR in Linux Systems
Adrian Palmer, Drive Development Engineering
SMR in Linux Systems Seagate's Contribution to Legacy File Systems - - PowerPoint PPT Presentation
SMR in Linux Systems Seagate's Contribution to Legacy File Systems Adrian Palmer, Drive Development Engineering SEAGATE combines DIFFERENT TECHNOLOGIES in new ways to SOLVE customer data storage CHALLENGES 2 Shingled Magnetic Recording (SMR)
Seagate's Contribution to Legacy File Systems
SMR in Linux Systems
Adrian Palmer, Drive Development Engineering
SEAGATE combines DIFFERENT TECHNOLOGIES in new ways
to SOLVE customer data storage CHALLENGES
Shingled Magnetic Recording (SMR)
Areal density growth curve – lowest cost/GB
0.1 1 10 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024
TB/in^2
BPMR (Bit Patterned Magnetic Recording) HDMR with BPMR BPMR with SMR HAMR with SMR SMR PMR PMR (Perpendicular Magnetic Recording) SMR (Shingle Magnetic Recording) HAMR (Heat Assisted Magnetic Recording)
Shingled Magnetic Recording (SMR)
Forward-write only: Radial AND Rotational
Drive Managed (DM)
Mimics Traditional drives Backwards compatible Direct Replacement for conventional drives in conventional apps
Host Managed (HM)
Not backwards compatible Host required to manage data ordering for performance mitigation Extensions required in ATA and SCSI command sets
Host Aware (HA)
Combination of DM and HM. Backwards compatible / Able to use extensions in ATA and SCSI
SMR Drive Types
Host Aware
Regular SD drive FS benefits from knowledge of media layout
Drive Managed
No change: regular SD drive
Host Managed
Requires new device & FS
Host Aware: Capacity gains like Drive Managed Performance like Conventional Drive Managed – Compatibility for Today Host Aware – Performance for Tomorrow
Benefits
Provides continued growth in Areal Density. Enables lower cost/GB disc drives Base of new technologies – HAMR
Support Readiness
ZBC/ZAC specifications are nearing completion T10/T13 committees work actively progressing
Availability
Millions of DM drives shipped! Seagate’s 8TB Archive HDD v2 drive is SMR DM in production, HA forthcoming
SMR – Can we avoid it?
ZBC: Zoned Block Commands ZAC: Zoned –device ATA Commands
ZAC/ZBC Standards
streams
file systems
SMR Friendly File System
Requirements Goals
SMRFS -EXT4
architecture changes; only rearrangement of existing data
commercial storage applications
strengths
distros Popular FS Stability Compatible
format Market Acceptance
1. cmd line arguments 2. internal handling changes 3. kernel stack changes 4. IOCTL integrations 5. Algorithm enhancements 6. Utility updates 7. Host Managed Compliance
EXT4 SMRFFS Project Scope Steps
Proposed Stages
Disk SCSI EXT4 Specify mkfs Options for HA
v1
Kernel Stack
v3
v2 v2 v2Internal changes
v2
Kernel Integration
v4
Garbage Collection
v5
Enforce Host Managed
v7
Utilities
v6
v1 v2 v3 v4 v5 v6 v7
V3 - Kernel Stack Changes, V4 Kernel Integration
Proposed Stack Changes
Disk AHCI ATA S-A-T SCSI O_Direct VFS I/O Scheduler Page Cache EXT4 VFS Examine/Enforce I/O Ordering IOCTL √ √
State of project
We’ve done …
Discussion at LSF…
We’ve got to do …
And we need community help!
timothy.r.feldman@seagate.com
For Drive Managed SMR
File System Parameters Influence Performance
60 80 100 120 140 160 180 200
ext4 ext4 flex_bg ext4 dm-cow zfs btrfs ext4 ext4 flex_bg ext4 dm-cow zfs btrfs ext4 ext4 flex_bg ext4 dm-cow zfs btrfs ext4 ext4 flex_bg ext4 dm-cow zfs btrfs Mimic OS Load Mimic DVD Download 5meg files Deep Dir 1meg files Deep Dir Throughput - MB/s
Drive Managed SMR - Performance by FS Parameters, for different Workloads
driveA driveB driveC
Re-arranging file system parameters for CoW to enforce forward-write-
Q&A
Thank You!
Attendees and Partners