SLIDE 1
OpenStack Summit Boston 2017
GETting Science & IT Together at OMRF with Swift
Brad Pazoureck - SysAdmin, IT Stuart Glenn - SysAdmin, ACI Oklahoma Medical Research Foundation
OpenStack Summit Boston 2017
GETting Science & IT Together at OMRF with Swift Brad - - PowerPoint PPT Presentation
GETting Science & IT Together at OMRF with Swift Brad - - PowerPoint PPT Presentation
GETting Science & IT Together at OMRF with Swift Brad Pazoureck - SysAdmin, IT Stuart Glenn - SysAdmin, ACI Oklahoma Medical Research Foundation OpenStack Summit Boston 2017 OpenStack Summit Boston 2017 US vs Them Enterprise IT
SLIDE 2
SLIDE 3
OpenStack Summit Boston 2017
US vs Them
- Enterprise IT
- Availability
- Typical ”Business”
- Science “IT”
- Shadow
- Just Get “IT” Done
SLIDE 4
OpenStack Summit Boston 2017
Usual Enterprise
- Dell Equallogic SAN
- iSCSI/SMB
- Commvault Disk-Disk-Tape
- Offsite tape storage for DR
SLIDE 5
OpenStack Summit Boston 2017
Faking IT
- Scale out NAS, 2x
- ~200-400TiB
- Backups?
- “Separated”
SLIDE 6
OpenStack Summit Boston 2017
SLIDE 7
OpenStack Summit Boston 2017
SLIDE 8
OpenStack Summit Boston 2017
Data
- Up & to the right
- Eternal retention
- Mixed types/sizes/uses
- Funding?
- Protection?
SLIDE 9
OpenStack Summit Boston 2017
Age Old Problems
- Good for one, not the other
- Tape & all its baggage
- Mess
- Dwindling capacity
SLIDE 10
OpenStack Summit Boston 2017
A Swift Solution
- Shadow IT meets Enterprise IT
- Joint project
- Useful to both
- Useable by both
- C_O approval
SLIDE 11
OpenStack Summit Boston 2017
Initial Wins
- Commvault
- Science data archive
- Commodity/consumer drives
- Cost
SLIDE 12
OpenStack Summit Boston 2017
Growing Together
- 2015-08 6 (&1) PACO (250 TiB)
- 2016-02 2 PACO (+100 TiB)
- 2017-02 3 PACO & drives (+50TiB)
- 2016-2017 Adding drives/license (+50TiB)
SLIDE 13
OpenStack Summit Boston 2017
Speeds & Feeds
- 3 Zones, 2 “Regions”
- Mixed O drives, SSD AC drives
- LUKS
- Read/Write affinity
- RR DNS & load balancer
SLIDE 14
OpenStack Summit Boston 2017
DESKTOP 10Gb Client Clients Region OKC Zone-00 PACO-00 PACO-03 PACO-06 PACO-09 Zone-01 PACO-01 PACO-04 PACO-07 PACO-0A Region OUN Zone-03 PACO-02 PACO-05 PACO-08 PACO-0B dark magic
HPC
Controller Commvault OMRF LAN 10Gb REP/ Cluster 10Gb REP/ Cluster
SLIDE 15
OpenStack Summit Boston 2017
SLIDE 16
OpenStack Summit Boston 2017
Easy Swift(Stack)
- Ansible
- SwiftStack
- AD integration
SLIDE 17
OpenStack Summit Boston 2017
Easy Swift(Stack)
SLIDE 18
OpenStack Summit Boston 2017
Easy Swift(Stack)
SLIDE 19
OpenStack Summit Boston 2017
Use the API
- Docker registry
- Hashi Vault
- Customer delivery
- Automated TempUrl Maker
SLIDE 20
OpenStack Summit Boston 2017
Auth Tokens
SLIDE 21
OpenStack Summit Boston 2017
Swift Do
SLIDE 22
OpenStack Summit Boston 2017
Troubles
- Workflow
- User Error
- Offsite
- Growth
SLIDE 23
OpenStack Summit Boston 2017
Still To Do
- NAS tiering or just ProxyFS?
- Metadata search
- WORM middleware?
- Always adding more drives
SLIDE 24
OpenStack Summit Boston 2017
Us & Them
- Availability
- Business Continuity
- Out of shadows, into the light
- PUT & GET data at leisure
- Affordability
SLIDE 25
OpenStack Summit Boston 2017
Take Aways
- ~420TB object data
- We can work together
- OpenStack Swift 👎
- SwiftStack 👎 👎
SLIDE 26
OpenStack Summit Boston 2017
Brad Pazoureck Network & Computer Systems Senior Administrator Information Technology Oklahoma Medical Research Foundation Brad-Pazoureck@omrf.org Stuart Glenn Assistant Director of Infrastructure & Research Computing Arthritis and Clinical Immunology Oklahoma Medical Research Foundation Stuart-Glenn@omrf.org https://github.com/glennsb/swat https://github.com/glennsb/atm
Thank you! Questions, Concerns, Comments?
SLIDE 27
OpenStack Summit Boston 2017