globus online Simplify big data sharing with Globus Online Steve - - PowerPoint PPT Presentation

▶
globus online
SMART_READER_LITE
LIVE PREVIEW

globus online Simplify big data sharing with Globus Online Steve - - PowerPoint PPT Presentation

Dec 14, 2023 316 likes •460 views

globus online Simplify big data sharing with Globus Online Steve Tuecke Computation Institute University of Chicago and Argonne National Laboratory The Challenge: Moving and Sharing Big Data Easily What should be trivial I need my

slide-1
SLIDE 1

globus online

Simplify big data sharing with Globus Online

Steve Tuecke Computation Institute University of Chicago and Argonne National Laboratory

slide-2
SLIDE 2

www.globusonline.org

  • What should be trivial…

The Challenge: Moving and Sharing Big Data Easily

2

  • … can be tedious, time-consuming and expensive

“I need my data over there – at my _____” ( supercomputing center, campus server, etc.)

My Data Facility

“I need to share my data with …”)

Colleague Transfer S h a r e

! ¡Config ¡issues ¡ ! ¡Unexpected ¡failure ¡ = ¡manual ¡retry ¡

Data Source Data Destination

“GAAAH! %&@#&” ! ¡Firewall ¡issues ¡ ! ¡Accounts ¡& ¡access ¡control ¡

slide-3
SLIDE 3

www.globusonline.org

  • Move, sync, share files

– Easy “fire-and-forget” transfers – Share with any Globus user or group – Automatic fault recovery & high performance – Across multiple security domains – Web, command line, and REST interfaces

  • Minimize IT costs

– Software as a Service (SaaS)

  • No client software installation
  • New features automatically available

– Consolidated support & troubleshooting – Simple endpoint installation with Globus Connect and GridFTP

  • Recommended by EGI, XSEDE, NERSC, ESnet,

ALCF, Blue Waters, NCAR, many Universities

What is Globus Online?

3

slide-4
SLIDE 4

globus online Globus Online Demo

4

slide-5
SLIDE 5

Globus Online PaaS

Research data management Platform as a Service (PaaS)

5

slide-6
SLIDE 6

www.globusonline.org

  • Create custom (web) applications that

leverage Globus Online services

– User identities, profiles, groups (Nexus) – File transfer, synchronization, sharing

  • Integrate via

– REST APIs – Scriptable command line interface – Branded web pages

Globus Online Platform-as-a-Service

6

slide-7
SLIDE 7

www.globusonline.org

Globus Nexus: For when you want to…

7

Manage groups Manage identities Manage profiles

slide-8
SLIDE 8

www.globusonline.org

  • Eliminate data transfer, sharing, and

management challenges

  • Leverage best-practice anal- ysis

pipelines (RNA-Seq, Ex- ome-Seq, ChIP-Seq, etc.)

  • Develop custom pipelines with full

control over algorithms, applications, and parameters

  • Dramatically reduce sequenc- ing

analysis turnaround time

  • Institutionalize bioinformatics expertise
  • Uses Globus Online & Galaxy platforms

Globus Genomics Focus on research, not IT.

slide-9
SLIDE 9

www.globusonline.org

support.globusonline.org

slide-10
SLIDE 10

www.globusonline.org

A platform for integration

slide-11
SLIDE 11

www.globusonline.org

Open Research Exeter data repository

slide-12
SLIDE 12

www.globusonline.org

Earth System Grid – Portal integration

12

  • Outsource ¡data ¡transfer ¡to ¡Globus ¡

– Data ¡download ¡to ¡user ¡machine ¡ from ¡search ¡ – Data ¡transfer ¡to ¡another ¡server ¡ by ¡user ¡ – Replica:on ¡of ¡data ¡between ¡sites ¡ by ¡administrator ¡

  • No ¡ESGF ¡client ¡so?ware ¡needed ¡
slide-13
SLIDE 13

www.globusonline.org

Non-profit Provider Plans

13

… ¡ … ¡ … ¡ … ¡ … ¡ … ¡

¡Planning ¡for ¡

Sustainability ¡

h@ps://www.globusonline.org/provider-­‑plans/ ¡

slide-14
SLIDE 14

www.globusonline.org

  • Visit www.globusonline.org/signup to:

– Get a free account to start moving and sharing files

  • Visit www.globusonline.org for:

– Tutorials, FAQs, Pro Tips, Troubleshooting – Papers, Case Studies

  • Visit support.globusonline.org or

contact support@globusonline.org for:

– Help – Forums

  • Follow us at @globusonline on Twitter

and Globus Online on Facebook

For More Information

14