SLIDE 1
Hardware Acceleration for RAID5/6, Deduplication & Security for parallel workloads
Vikas Aggarwal Storage Developer Conference Bangalore 2017
Team Members
- Venkatesh Bolla
- Achyutha Krishna
- Anil Reddy
parallel workloads Vikas Aggarwal Storage Developer Conference - - PowerPoint PPT Presentation
parallel workloads Vikas Aggarwal Storage Developer Conference - - PowerPoint PPT Presentation
Hardware Acceleration for RAID5/6, Deduplication & Security for parallel workloads Vikas Aggarwal Storage Developer Conference Bangalore 2017 Team Members Venkatesh Bolla Achyutha Krishna Anil Reddy Responsibilities: Storage
SLIDE 2
SLIDE 3
Outline
- RAID 5/6
- Deduplication
- Security
- Open Source Storage Applications
- OCTEON TX Acceleration blocks
- Accelerated Data Flow
- Observations
SLIDE 4
Offloading CPU intensive
- perations
- RAID6
- XOR
- Galois Field Multiplication
- Deduplication
- Fingerprint Generation
- Fingerprint Lookup
- Security
- Encryption/Decryption of Data Blocks
SLIDE 5
Open Source Storage Software Offload Case Studies
RAID DEDUPLICATION SECURITY MD RAID DM Dedup ecryptfs DM RAID OpenZFS DM Crypt btrFS btrFS OpenDedup
SLIDE 6
Linux MD RAID
- Implements the following:
- RAID 0, 1, 5, 6
- MDRAID can offload following to hardware using
async_tx Linux offload infrastructure:
- memcpy
- XOR
- Galois Field Arithmetic
- Offload benefits the following RAID variants:
- RAID 5, 6
SLIDE 7
Linux DM-dedup
- Implements the following:
- 4KB block fingerprint
- Fingerprint to LBN(logical block number) lookup
- LBN to PBN(physical block number) lookup
- DM Dedup(modified) can offload following to hardware:
- Fingerprint (Digest using MD5, SHA1, SHA2)
- Fingerprint and LBN lookup.
- Offload benefits the following:
- Lookups.
SLIDE 8
Linux eCryptfs
- In-kernel standalone implementation.
- Security gets inherited into incremental backups.
- Cryptographic metadata is stored along with encrypted file.
- Supports all the Linux cryptographic ciphers.
- Utilizes Linux crypto framework
- eCryptfs can offload following to hardware
- AES CBC
- DES3 CBC
- AES XTS
- Offload benefits: Encryption, Decryption.
SLIDE 9
SLIDE 10
Linux MDRAID Offload
SLIDE 11
SLIDE 12
RAID Architecture
SLIDE 13
Dmdedup Architecture
SLIDE 14
DmDedup WRITE Offload
Data Chunk
Compute HASH
DISK
Hash->PBN
DDF Offload Block
LBN->PBN LBN->PBN Dup WR Uniq WR dmdedup code dmdedup code
SLIDE 15
DmDedup READ Offload
Compute LBN DATA
LBN->PBN
DDF Offload Block
Miss Hit
DISK
END dmdedup code
Sector
SLIDE 16
SLIDE 17
Storage Security Offload
SLIDE 18
SLIDE 19
Accelerations Integrated
SLIDE 20
Accelerations Integrated
SLIDE 21
5 10 15 20 25 30 35 4 8 16 24
OCTEON TX-raid-offload(cpu savings)
- No. disks/raid6 grp
RAID offload relative CPU savings
OCTEON TX %cpu idle
SLIDE 22
1 2 3 4 5 6 0GB 40GB 80GB 160GB 200GB
x86_64 OCTEON TX OCTEON TX-offload
Dmdedup offload Ingest rate
OCTEON TX
throughput
5xGain
SLIDE 23
1 2 3 4 5 6 40GB 80GB 160GB 200GB
x86_64 OCTEON TX OCTEON TX-offload
Dmdedup fio WRITE offload latency
OCTEON TX
5xReduction
SLIDE 24
Ecryptfs
10 20 30 40 50 60 70 80 90 100 1 4 8 16 32 48
OCTEON TX OCTEON TX-offload
- No. threads
OCTEON TX
%cpu used
SLIDE 25
Dedup + RAID6, eCryptFS+RAID6
10 20 30 40 50 60 70 80 90 50GB, 4Tx5GB 50GB, 8Tx2GB 100GB, 16Tx2GB
OCTEON TX OCTEON TX-offload
OCTEON TX
%cpu idle
OCTEONTX
throughput Fio WRITE
SLIDE 26
Status
- Status of Work – Preliminary performance results. More
in future summits.
- Upstream the drivers.
- Other Platforms:
- DPDK+SPDK
- ODP
SLIDE 27