getting science it together at omrf with swift
play

GETting Science & IT Together at OMRF with Swift Brad - PowerPoint PPT Presentation

Jun 15, 2023 •439 likes •729 views

GETting Science & IT Together at OMRF with Swift Brad Pazoureck - SysAdmin, IT Stuart Glenn - SysAdmin, ACI Oklahoma Medical Research Foundation OpenStack Summit Boston 2017 OpenStack Summit Boston 2017 US vs Them Enterprise IT

  1. GETting Science & IT Together at OMRF with Swift Brad Pazoureck - SysAdmin, IT Stuart Glenn - SysAdmin, ACI Oklahoma Medical Research Foundation OpenStack Summit Boston 2017

  2. OpenStack Summit Boston 2017

  3. US vs Them • Enterprise IT • Availability • Typical ” Business” • Science “IT” • Shadow • Just Get “IT” Done OpenStack Summit Boston 2017

  4. Usual Enterprise • Dell Equallogic SAN • iSCSI/SMB • Commvault Disk-Disk-Tape • Offsite tape storage for DR OpenStack Summit Boston 2017

  5. Faking IT • Scale out NAS, 2x • ~200-400TiB • Backups? • “Separated” OpenStack Summit Boston 2017

  6. OpenStack Summit Boston 2017

  7. OpenStack Summit Boston 2017

  8. Data • Up & to the right • Eternal retention • Mixed types/sizes/uses • Funding? • Protection? OpenStack Summit Boston 2017

  9. Age Old Problems • Good for one, not the other • Tape & all its baggage • Mess • Dwindling capacity OpenStack Summit Boston 2017

  10. A Swift Solution • Shadow IT meets Enterprise IT • Joint project • Useful to both • Useable by both • C_O approval OpenStack Summit Boston 2017

  11. Initial Wins • Commvault • Science data archive • Commodity/consumer drives • Cost OpenStack Summit Boston 2017

  12. Growing Together • 2015-08 6 (&1) PACO (250 TiB) • 2016-02 2 PACO (+100 TiB) • 2017-02 3 PACO & drives (+50TiB) • 2016-2017 Adding drives/license (+50TiB) OpenStack Summit Boston 2017

  13. Speeds & Feeds • 3 Zones, 2 “ Regions” • Mixed O drives, SSD AC drives • LUKS • Read/Write affinity • RR DNS & load balancer OpenStack Summit Boston 2017

  14. 10Gb REP/ 10Gb REP/ Cluster Cluster dark magic Region OKC Region OUN Zone-00 Zone-01 Zone-03 PACO-00 PACO-01 PACO-02 PACO-03 PACO-04 PACO-05 Controller PACO-06 PACO-07 PACO-08 PACO-09 PACO-0A PACO-0B 10Gb Client OMRF LAN HPC DESKTOP Clients Commvault OpenStack Summit Boston 2017

  15. OpenStack Summit Boston 2017

  16. Easy Swift(Stack) • Ansible • SwiftStack • AD integration OpenStack Summit Boston 2017

  17. Easy Swift(Stack) OpenStack Summit Boston 2017

  18. Easy Swift(Stack) OpenStack Summit Boston 2017

  19. Use the API • Docker registry • Hashi Vault • Customer delivery • Automated TempUrl Maker OpenStack Summit Boston 2017

  20. Auth Tokens OpenStack Summit Boston 2017

  21. Swift Do OpenStack Summit Boston 2017

  22. Troubles • Workflow • User Error • Offsite • Growth OpenStack Summit Boston 2017

  23. Still To Do • NAS tiering or just ProxyFS? • Metadata search • WORM middleware? • Always adding more drives OpenStack Summit Boston 2017

  24. Us & Them • Availability • Business Continuity • Out of shadows, into the light • PUT & GET data at leisure • Affordability OpenStack Summit Boston 2017

  25. Take Aways • ~420TB object data • We can work together • OpenStack Swift 👎 • SwiftStack 👎 👎 OpenStack Summit Boston 2017

  26. Thank you! Questions, Concerns, Comments? Brad Pazoureck Network & Computer Systems Senior Administrator Information Technology Oklahoma Medical Research Foundation Brad-Pazoureck@omrf.org Stuart Glenn Assistant Director of Infrastructure & Research Computing Arthritis and Clinical Immunology Oklahoma Medical Research Foundation Stuart-Glenn@omrf.org https://github.com/glennsb/swat https://github.com/glennsb/atm OpenStack Summit Boston 2017

  27. OpenStack Summit Boston 2017

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

COMBINING SWIFT AND OBJECTIVE-C AGENDA Using Objective-C from Swift Using Swift from

COMBINING SWIFT AND OBJECTIVE-C AGENDA Using Objective-C from Swift Using Swift from

COMBINING SWIFT AND OBJECTIVE-C AGENDA Using Objective-C from Swift Using Swift from Objective-C Objective-C Behavior in Swift Classes IMPORTING OBJECTIVE-C INTO SWIFT APPLE FRAMEWORKS No additional setup required! import UIKit import

339 views • 22 slides
SWIFT presentation SWIFT for Corporates - Do not share without SWIFT's prior consent 2 Whats

SWIFT presentation SWIFT for Corporates - Do not share without SWIFT's prior consent 2 Whats

SWIFT presentation SWIFT for Corporates - Do not share without SWIFT's prior consent 2 Whats SWIFT? 3 +12k customers connected core values worldwide community innovation +200 excellence countries 3 a cooperative serving the

572 views • 34 slides
Swift Swiftly A quick introduction to the Swift language Oliver Jones Technical Director

Swift Swiftly A quick introduction to the Swift language Oliver Jones Technical Director

Swift Swiftly A quick introduction to the Swift language Oliver Jones Technical Director Disclaimer Learning Swift iBooks The Swift Programming Language Using Swift with Cocoa and Objective-C Apple Developer Documentation

332 views • 32 slides
Swift Follow-Up Observations of s and +GW events Swift follow-up of IceCube

Swift Follow-Up Observations of s and +GW events Swift follow-up of IceCube

Azadeh Keivani Columbia Universi tz AMON Workshop Chiba, Japan May 21, 2019 Swift Follow-Up Observations of s and +GW events Swift follow-up of IceCube neutrinos 2 Swift is a powerful tool to search for transients

811 views • 30 slides
Good Morning SWIFT HI! I'm Marc Prud'hommeaux marc@glimpse.io Swift Public beta: June 2014

Good Morning SWIFT HI! I'm Marc Prud'hommeaux marc@glimpse.io Swift Public beta: June 2014

Good Morning SWIFT HI! I'm Marc Prud'hommeaux marc@glimpse.io Swift Public beta: June 2014 v1.0: September 2014 v1.2: February 2015 POLL: Swift? Agenda 1. Swift Syntax 2. Interesting Stuff 3. Questions (GOTO Guide) // Swift Bank &

1.53k views • 102 slides
Concepts of programming languages Swift Lukas, Anvar, Roald, Bart, Lars [Faculty of Science

Concepts of programming languages Swift Lukas, Anvar, Roald, Bart, Lars [Faculty of Science

Concepts of programming languages Swift Lukas, Anvar, Roald, Bart, Lars [Faculty of Science Information and Computing Sciences] 1 Birth of a new language Swift isnt it beautiful? Developed in secret [Faculty of Science Information

1.11k views • 64 slides
Pippa Leary, CEO SWIFT MEDIA CEO Messages What is Swift? TRANSITIONING TO A STRONGER

Pippa Leary, CEO SWIFT MEDIA CEO Messages What is Swift? TRANSITIONING TO A STRONGER

ASX: SW1 H1 Results February 27, 2020 Pippa Leary, CEO SWIFT MEDIA CEO Messages What is Swift? TRANSITIONING TO A STRONGER FUTURE H1 Update Swift is a specialist media company delivering a high Strategic Progress proportion of

964 views • 16 slides
The Swift Gamma-Ray Burst Mission -- Science and Data Analysis Hans A. Krimm CRESST / USRA /

The Swift Gamma-Ray Burst Mission -- Science and Data Analysis Hans A. Krimm CRESST / USRA /

The Swift Gamma-Ray Burst Mission -- Science and Data Analysis Hans A. Krimm CRESST / USRA / NASA Goddard Space Flight Center July 29, 2008 Urbino 2008: High Energy Astrophysics Summer School Outline The Swift mission

651 views • 54 slides
Distribution Nion Swift Workshop Chris Meyer 2018 October 5 Nion Swift is software for

Distribution Nion Swift Workshop Chris Meyer 2018 October 5 Nion Swift is software for

Nion Swift Plug-in Distribution Nion Swift Workshop Chris Meyer 2018 October 5 Nion Swift is software for integrating instrument control, data acquisition, organization, visualization, and analysis using Python. Nion Swift Plug-in

199 views • 15 slides
Swift Fox By Ruby Stucki Looks The swift fox is a small, light orange-tan fox with large ears,

Swift Fox By Ruby Stucki Looks The swift fox is a small, light orange-tan fox with large ears,

Swift Fox By Ruby Stucki Looks The swift fox is a small, light orange-tan fox with large ears, fur, and a black-tipped tail. It is 5 to 7 pounds when full grown. Where It Lives The swift fox lives in a den on short-grass prairies and

650 views • 8 slides
OpenStack Swift OpenStack Summit Atlanta 2014 Martin Lanner & Hugo Kuo May 15, 2014 Agenda

OpenStack Swift OpenStack Summit Atlanta 2014 Martin Lanner & Hugo Kuo May 15, 2014 Agenda

OpenStack Swift OpenStack Summit Atlanta 2014 Martin Lanner & Hugo Kuo May 15, 2014 Agenda Object Storage & Swift How Swift Works Installing Swift: Hands-on Lab Manual Swift installation (20 minutes)

1.15k views • 59 slides
SWIFT: Administration SWIM Industry Collaboration Workshop #6 SWIM, Services & SWIFT

SWIFT: Administration SWIM Industry Collaboration Workshop #6 SWIM, Services & SWIFT

Federal Aviation SWIFT: Administration SWIM Industry Collaboration Workshop #6 SWIM, Services & SWIFT (SWIM Industry-FAA Team) FAA SWIM Program Communications, Information and Network Programs May 21-22, 2018 SWIFT Collaborative

2.39k views • 140 slides
SWIFT: Administration SWIM Industry Collaboration Workshop #10 SWIM, Services & SWIFT

SWIFT: Administration SWIM Industry Collaboration Workshop #10 SWIM, Services & SWIFT

Federal Aviation SWIFT: Administration SWIM Industry Collaboration Workshop #10 SWIM, Services & SWIFT (SWIM Industry-FAA Team) FAA SWIM Program Communications, Information and Network Programs May 20 th , 2020 SWIFT Collaborative

2.09k views • 91 slides
Developing your own Swift middleware OpenStack Summit Atlanta, May 2014 About me Christian

Developing your own Swift middleware OpenStack Summit Atlanta, May 2014 About me Christian

Developing your own Swift middleware OpenStack Summit Atlanta, May 2014 About me Christian Schwede Developer @ eNovance Mostly working on Swift, testing and automation Started using Swift in 2012 Agenda Using middlewares

552 views • 28 slides
Animations with AL (and stack views) Marin Todorov Swift 2.0 Swift 2.0

Animations with AL (and stack views) Marin Todorov Swift 2.0 Swift 2.0

Animations with AL (and stack views) Marin Todorov Swift 2.0 Swift 2.0 UIView.animateWithDuration(1.0, animations: { redSquare.center.x = 200.0 }) Stack Overflow Q: How to do this one animation thing in my app? A: Include

597 views • 18 slides
Swift/T: Dataflow Composition of Tcl Scripts for Petascale Computing Justin M Wozniak

Swift/T: Dataflow Composition of Tcl Scripts for Petascale Computing Justin M Wozniak

Swift/T: Dataflow Composition of Tcl Scripts for Petascale Computing Justin M Wozniak Argonne National Laboratory and University of Chicago http://swift-lang.org/Swift-T wozniak@mcs.anl.gov Big picture: solutions for scientific scripting

812 views • 57 slides
Engineering Chang Proposal (ECP)2.0 Review Liang Hsia, P.E. Traffic Engineering Systems Section

Engineering Chang Proposal (ECP)2.0 Review Liang Hsia, P.E. Traffic Engineering Systems Section

SunGuide Software SM Engineering Chang Proposal (ECP)2.0 Review Liang Hsia, P.E. Traffic Engineering Systems Section Traffic Engineering and Operations Office December 7, 2005 1 SunGuide Software SM ECP 2.0 Review Voting Item Cost

699 views • 54 slides
Model-driven Development of Self-organizing Control Applications (MODOC) Prof. Dr.-Ing. Torben

Model-driven Development of Self-organizing Control Applications (MODOC) Prof. Dr.-Ing. Torben

Model-driven Development of Self-organizing Control Applications (MODOC) Prof. Dr.-Ing. Torben Weis Dr. Arno Wacker Dipl.-Inform. Sebastian Holzapfel Dipl.-Inform. Christopher Boelmann Universitt Duisburg-Essen Prof. Dr. Hans-Ulrich Hei

355 views • 21 slides
Small Arms Survey 2012 New York, 1-5 June 2015 Small arms, new technologies, and MGE2 Moving

Small Arms Survey 2012 New York, 1-5 June 2015 Small arms, new technologies, and MGE2 Moving

Second Open-ended Meeting of Governmental Experts under the UNPoA Small Arms Survey 2012 New York, 1-5 June 2015 Small arms, new technologies, and MGE2 Moving Targets Glenn McDonald MGE2 (June 2015) SMALL ARMS SURVEY Second Open-ended

547 views • 26 slides
Apprenticeships: converting challenges into opportunities Gary Tovey Suzanne Shutler 18 March

Apprenticeships: converting challenges into opportunities Gary Tovey Suzanne Shutler 18 March

Illustration by Tang Yau Hoong Realising the 2020 vision for Apprenticeships: converting challenges into opportunities Gary Tovey Suzanne Shutler 18 March 2016 Illustration by Kanae Sato Workshop Outline How long have we got? 01 02

441 views • 31 slides
Local history teaching in schools: supporting active learning approaches INTRODUCTION This

Local history teaching in schools: supporting active learning approaches INTRODUCTION This

Local history teaching in schools: supporting active learning approaches INTRODUCTION This lecture, given at the Family Tree Live! conference in May, 2019, begins by commenting on the notion of active learning and then considers three examples of

458 views • 6 slides
Erin OKeefe and Elizabeth Liz Martell Allen Community College Discussion How do we

Erin OKeefe and Elizabeth Liz Martell Allen Community College Discussion How do we

Erin OKeefe and Elizabeth Liz Martell Allen Community College Discussion How do we get students to participate more substantially in the writing of their own essay? Pre-Writing Techniques Free-writing Tape Recorder

507 views • 8 slides
The European adhesive tape network. Educational events. Technical standards. Market trends.

The European adhesive tape network. Educational events. Technical standards. Market trends.

Market trends and statistics based on the 2014 Freedonia global tape study Overview: The global adhesive tape market is estimated at 39.3 billion square metres in sales volume, with an average sales price of $1.03 per square metre The

376 views • 6 slides
AGENDA 1. Welcome and Introductions 2. Site Overview 3. Public & Fiscal Benefit 4.

AGENDA 1. Welcome and Introductions 2. Site Overview 3. Public & Fiscal Benefit 4.

AGENDA 1. Welcome and Introductions 2. Site Overview 3. Public & Fiscal Benefit 4. Current Plan & Key Topics 5. Medtronic Update 6. Questions BRUE BAUKOL CAPITAL PARTNERS | PREPARED BY TRYBA ARCHITECTS OUR TEAM We are a

720 views • 33 slides

More recommend