Access: bwUniCluster, bwForCluster, ForHLR Shamna Shamsudeen, SCC, KIT Steinbuch Centre for Computjng (SCC) www.bwhpc-c5.de Funding:
Outline Introductjon Registratjon Processes bwUniCluster bwForCluster ForHLR Phase I & II First Steps Login File Transfer Questjons 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 2
1. Introductjon 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 3
1.Introductjon 1.Introductjon Introductjon bwUniCluster Tier 3, Baden-Würtuemberg (BW) cluster for general purposes Simple registratjon process bwForCluster (JUSTUS, MLS&WISO, NEMO, BinAC) Tier 3, BW research clusters Architecture optjmized for certain scientjfjc communitjes Access process ensures using the suitable cluster and enhances user support ForHLR I & II Tier 2, natjonal research cluster Access process ensures that applicatjons fulfjll requirements of parallelizatjon 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 4
2. Registratjon 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 5
2. Access 2. Access Registratjon Difgerent clusters → difgerent registratjon processes bwUniCluster bwForCluster ForHLR Phase I & II 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 6
2. Access 2. Access Registratjon Process - bwUniCluster Access only for members of shareholder universitjes. Authentjcatjon with usual university account via bwIDM. Authorizatjon via bwUniCluster entjtlement issued by the universitjes. Step A: Obtainment of bwUniCluster entjtlement Each university has its own entjtlement grantjng policies! Step B: Web registratjon at htups://bwidm.scc.kit.edu/ Login via bwIDM with your account at university 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 7
2. Access 2. Access Registratjon Process - bwForClusters Access for members of Baden-Würtuemberg's universitjes. Step 1: Registratjon at „Central Applicatjon Site (ZAS)“ Approval of Cluster Assignment Team (CAT) Step 2: Obtainment of bwForCluster entjtlement Step 3: Web registratjon at bwForCluster site e.g. htup://bwidm.rz.uni-ulm.de/, bwForCluster JUSTUS (Computatjonal Chemistry) 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 9
2. Access 2. Access Registratjon Process: bwForClusters – Step 1 Rechenvorhaben (RV) RV = planned compute actjvitjes research objectjve, used methods & sofuware packages, .. Resource RV responsible requirements = applicant CPU Hours, memory, disk space, .. Team Team managers, coworker managers, coworker An RV approval is valid for one certain bwForCluster all team members a period of one year afuer the approval 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 11
2. Access 2. Access Registratjon Process: bwForCluster – Step 1a ZAS RV registratjon 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 12
2. Access 2. Access Registratjon Process: bwForClusters – Step 1b ZAS acronym / password RV responsible RV applicatjon ? ? ? ? CAT (Cluster Assignment Team) 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 13
2. Access 2. Access Registratjon Process: bwForClusters Step 1c ZAS RV responsible RV approval acronym / password ! ! ! ! CAT (Cluster Assignment Team) 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 14
2. Access 2. Access Registratjon Process: bwForClusters – Step 1a ZAS „ “ RV responsible Collaboratjon Registratjon via acronym / password 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 15
2. Access 2. Access Registratjon Process: bwForClusters – Step 3 Home University ZAS Automatjc ? ? ✓ (bwForCluster (Approval of RV) Check entjtlement) web registratjon / login bwForCluster: Registratjon server RV team 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 16
2. Access 2. Access Registratjon Process – ForHLR I & II Step 1: Completjon of the „Online Proposal Form“. (htup://www.scc.kit.edu/forschung/4971.php) (Resources to be granted are CPU-tjme and permanent disk space) Step 2: Writjng the extended project descriptjon (3-5 pages). PDF-fjle must be send to forhlr- projects@lists.kit.edu Step 3: Fill out of the ForHLR entjtlement form for each project collaborator. Form must be send to SCC-Service desk or scanned to haefner@kit.edu Step 4: Personal registratjon for ForHLR I & II on website htups://bwidm.scc.kit.edu 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 17
3. First Steps - Login 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 18
3. First Steps 3. First Steps Login (1) General Windows (via PuTTY) Connectjon by ssh Username [<prefix>_]<username> ab1234 (KIT) ho_anfuchs (Hohenheim) Host: uc1.scc.kit.edu justus.uni-ulm.de fh1.scc.kit.edu Linux / Mac OS $ ssh ab1234@uc1.scc.kit.edu ab1234@uc1.scc.kit.edu's password: 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 19
3. First Steps 3. First Steps Login (2) Add host key .. and welcome! 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 20
3. First Steps 3. First Steps Basic commands $ pwd show path of working directory $ mkdir <dirname> make directory $ ls -l list directory contents $ cd change directory $ cp <sourcefile> <targetfile> copy fjle $ mv <sourcefile> <targetfile> move fjle $ rm <filename> remove fjle $ man <command> show command's manual $ vi standard unix editor 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 21
File transfer 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 22
3. First Steps File transfer - Linux 3. First Steps secure copy (remote fjle copy $ scp <sourcefile> <targetfile> program) recursively copy entire $ scp -r <sourcedir> <targetdir> directories $ sftp <targetdir> secure file transfer program $ put|get <sourcefile> upload/download file Example $ scp paket.tar ab1234@uc1.scc.kit.edu:dir/ ab1234@uc1.scc.kit.edu's password: $ sftp ab1234@uc1.scc.kit.edu:dir ab1234@uc1.scc.kit.edu's password: Connected to uc1.scc.kit.edu. Changing to: ${HOME}/dir sftp> put paket.tar 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 23
3. First Steps File transfer - Windows 3. First Steps Windows (via WinSCP) drag&drop source directory target directory 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 24
bwFileStorage 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 25
3. First Steps bwFileStorage/LSDF-DIS 3. First Steps Central storage located at KIT 100GB disk space per user Requirements bwFileStorage entjtlement bwUniCluster ForHLR web registratjon at htups://bwidm.scc.kit.edu bwFile- Storage/ Hosts ... LSDF-DIS ... Via web: htups://bwfjlestorage.lsdf.kit.edu Via ssh: bwfjlestorage-login.lsdf.kit.edu Transfer tools scp, sfup, rsync, htups, ….. bwForCluster bwForCluster rdata @ bwUniCluster, ForHLR 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 26
3. First Steps bwFileStorage: rdata 3. First Steps File system operatjons on „data mover“ nodes Supported commands: cp, rm, ls, rsync, mv, mkdir, ... Environment variables: $BWFS=/bwfjlestorage/ka/ka_scc/ab1234/ Example: $ scp fjle ka_ab1234@bwfjlestorage.lsdf.kit.edu: $ rdata cp fjle $BWFS Performance with a fjle size of 20000 MB: scp : 2min 24s (139 MB/s) rdata cp : 1min 5s (308 MB/s) 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 27
FAQ “I cannot login”, why? Login at registratjon server of your cluster e.g. bwUniCluster → htups://bwidm.scc.kit.edu Check info given at: Registry Check info given at: Registry Info, Index, User Propertjes Info, Index, User Propertjes @ bwUniCluster: Check if you’ve done the questjonnaire within 14 days afuer the registratjon. Errors may look like: 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 28
4. Questjons 06/12/2016 Access: bwUniCluster, bwForClusters, ForHLR / S. Shamsudeen 29
Recommend
More recommend
