Cameron Berkley cameron.berkley@fsu.edu 150-B DSL 1 10/12/2016 - - PowerPoint PPT Presentation

▶
cameron berkley cameron berkley fsu edu 150 b dsl
SMART_READER_LITE
LIVE PREVIEW

Cameron Berkley cameron.berkley@fsu.edu 150-B DSL 1 10/12/2016 - - PowerPoint PPT Presentation

Nov 25, 2023 428 likes •643 views

Cameron Berkley cameron.berkley@fsu.edu 150-B DSL 1 10/12/2016 What is Globus? 2 10/12/2016 Managed File T ransfer Ease of Use Reliable, Fire and Forget Parallelism and Concurrency Secure Notifjciations Performance Monitoring

slide-1
SLIDE 1

1

Cameron Berkley cameron.berkley@fsu.edu 150-B DSL

10/12/2016

slide-2
SLIDE 2

2

What is Globus?

10/12/2016

slide-3
SLIDE 3

3

10/12/2016

Managed File T ransfer

Ease of Use Reliable, Fire and Forget Parallelism and Concurrency Secure Notifjciations Performance Monitoring Accountability Can be used behind fjrewall/NAT

slide-4
SLIDE 4

4

10/12/2016

Managed File T ransfer

slide-5
SLIDE 5

5

Globus Web Transfers

10/12/2016

slide-6
SLIDE 6

6

10/12/2016

Sign up for Globus.org

Go to globus.org Click “Log in” Click “Sign up” Fill out information Submit and enter verifjcation code

slide-7
SLIDE 7

7

Globus CLI Transfers

10/12/2016 No need to install software Must confjgure SSH public/private key pair Easily automated

slide-8
SLIDE 8

8

10/12/2016

Setting up CLI Access

$ ssh-keygen -t rsa Enter passphrase (optional) Browse to “Account” -> “manage SSH and X.509 keys” “Add a New Key” Add the contents of ~/.ssh/id_rsa.pub

slide-9
SLIDE 9

9

10/12/2016

Basic CLI Structure

$ ssh <username>@cli.globusonline.org <command> <options> <params>

slide-10
SLIDE 10

10

10/12/2016

Getting Help

$ ssh <username>@cli.globusonline.org <command> help $ ssh <username>@cli.globusonline.org man <command>

slide-11
SLIDE 11

11

10/12/2016

Activating an Endpoint

$ ssh <username>@cli.globusonline.org endpoint-activate <endpoint_name> $ ssh -t workshop-001@cli.globusonline.org endpoint-activate fsurcc#panfs

  • t option prevents passphrase from being echoed to stdout
slide-12
SLIDE 12

12

10/12/2016

Listing Files

$ ssh <username>@cli.globusonline.org ls <endpoint_name>/path $ ssh workshop-001@cli.globusonline.org ls fsurcc#panfs/panfs/storage.local/xsede/home/workshop-001

slide-13
SLIDE 13

13

10/12/2016

Basic T ransfer

$ ssh <username>@cli.globusonline.org transfer

  • - <ep1_name>/path <ep2_name>/path

$ ssh -t workshop-001@cli.globusonline.org transfer -- fsurcc#panfs/panfs/storage.local/xsede/home/workshop-001/testfjle.bin <username>#<endpoint_name>/~/Desktop/testfjle.bin Use –label to label your transfer

slide-14
SLIDE 14

14

10/12/2016

Files to T ransfer as STDIN

$ echo “<ep1#/path> <ep2#path> | ssh <username>@cli.globusonline.org transfer $ echo “fsurcc#panfs/panfs/storage.local/xsede/home/workshop-001/test_fold <username>#<endpoint_name>/~/Desktop/1” | ssh workshop-001@cli.globusonline.org transfer $ cat ./fjles_to_transfer.txt | ssh <username>@cli.globusonline.org transfer

slide-15
SLIDE 15

15

10/12/2016

Syncronization Modes

$ ssh <username>@cli.globusonline.org transfer -- <ep1_name>/path <ep1_name>/path -s <n>

  • s 0 Copy fjles that do not exist at the destination
  • s 1 Copy fjles if the size of the destination does not match the size of the sour
  • s 2 Copy fjles if the destination timestamp is older than the source timestamp
  • s 3 Copy fjles if checksums of source and destination do not match
  • -delete Delete fjles and directories in the destination that are not in the source
  • r Copy a directory recursively
slide-16
SLIDE 16

16

10/12/2016

Encryption

$ ssh <username>@cli.globusonline.org transfer -- <ep1_name>/path <ep1_name>/path --encrypt

slide-17
SLIDE 17

17

10/12/2016

Deadline

$ ssh <username>@cli.globusonline.org transfer -- <ep1_name>/path <ep1_name>/path -d <n>h Deadline to complete transfer in hours

slide-18
SLIDE 18

18

10/12/2016

Monitoring T ransfers

$ ssh <username>@cli.globusonline.org status <job ID> $ ssh <username>@cli.globusonline.org $ status -l <n transfers> -a $ ssh <username>@cli.globusonline.org details <job ID> $ ssh <username>@cli.globusonline.org events <job ID>

slide-19
SLIDE 19

19

10/12/2016

Canceling a Job

$ ssh <username>@cli.globusonline.org cancel <job ID>

slide-20
SLIDE 20

20

10/12/2016

Globus REST API

General Information: https://docs.globus.org/api/transfer/ Python Interface: https://github.com/globusonline/transfer-api-client-python Java Interface: https://github.com/globusonline/transfer-api-client-java

slide-21
SLIDE 21

21

End Of Presentation

10/12/2016

Any Questions?