UCLA Grid Portal (UGP) A Globus Incubator Project OGF 2007 - - PowerPoint PPT Presentation

Academic Technology Services

UCLA Grid Portal (UGP) A Globus Incubator Project

OGF 2007

Prakashan Korambath Prakashan Korambath & Joan Slottow & Joan Slottow Research Computing Technologies Research Computing Technologies UCLA Academic Technology Services UCLA Academic Technology Services

Documentation at: http://www.ucgrid.org

Academic Technology Services

Academic Technology Services

UGP (UCLA Grid Portal)

• Joins computational clusters into a Grid
• Built on top of:

– Globus Toolkit 4.n – GridSphere Portlet Framework 2.n (production systems) and 3.n (under development) – Zimbra, YUI, and GWT toolkits – Shibboleth – Tomcat – MySQL

Academic Technology Services

Motivation

• Need to share resources among the campus

clusters:

• Diverse cluster ownership and operation
• A number of users have login ids on multiple

clusters

Academic Technology Services

Design Goals: – Do not change the way individually- managed clusters do business. – Web Portal:

• Hide certificates and the complexity of

the Grid from users. –No software for users to install.

• Single sign on.
• Common web interface to all clusters.

Academic Technology Services

Head node

Cluster II

Head node

Cluster I

Single Campus Architecture

ION Visualization Server Storage Server MyProxy Server Grid Portal Grid Appliance Credential mapped to local ID Credential mapped to local ID Grid Appliance https Uniform browser based interface

Academic Technology Services

Demo

1. 2.

Academic Technology Services

Single CA is shared among all campuses

UC Portal UCLA Portal UCSB Portal UCI Portal A A A A A A C C C C C C

All appliances talk to both their campus portal and the UC portal

UCLA MyProxy UCSB MyProxy

UC Grid CA UC User Database UC MyProxy UC Register Service

Storage Server Storage Server Storage Server UCI MyProxy

UC Grid Multi-Campus Architecture

Academic Technology Services

The UC Grid

• Each user of a Campus Grid can also use the

UC Grid Portal

• Users can:

– work with clusters from all the campuses – transfer files across the campuses. – Use pooled resources across the campuses.

Academic Technology Services

Demo

Academic Technology Services

User Types vs. Portals

Portal View U s e r T y p e Campus Portal UC Portal Pool-only User Cluster User

Can submit jobs to the campus pool Can submit jobs to campus and UC pools Can use those clusters on campus he/she can access Can submit jobs to the campus pool Best choice for those with access to clusters

• n different campuses
• - can use all clusters,

UC-wide, he/she can Access Can submit jobs to campus and UC pools

Academic Technology Services

Grid Portal Services and User Interface

• Resource Discovery
• Data Manager (includes editor, visualization,

upload/download, and ftp)

• Grid Development Environment
• Job Services

– Submit Job, view status, process output – Applications vs. Generic jobs – appForm

• Interactive: interactive apps, xterm, ssh
• Other Grids: access to Teragrid

Academic Technology Services

Demo

Academic Technology Services

• UGP:

– Chooses the best cluster for the job – Maps the portal user to a guest user – Generates the proxy certificate for the guest user – Stages the input files to the target cluster – Submits the job to the target cluster – Retrieves the output for downloading Pool Job Submission

Academic Technology Services

Demo

Academic Technology Services

Interactive Applications via VNC

• Pioneers in this area are:

– Purdue University’s nanoHUB – University of Florida’s In-VIGO – University of Texas Advanced Computer Center (TACC)

Academic Technology Services

User Web Browser Portal Web Server Tomcat UGP

Serve Applet Because of Applet security, the Applet can

• nly talk to the

Portal machine

iptables Port forwarding Public Network Private Network VNC Viewer applet Compute Node GUI App Grid Appliance VNC server

Runs Under theUser’s id

Globus

GRAM

Fork Job

SSH Firewall There is 1 Grid Portal One Grid Appliance per cluster Multiple VNC servers can be Running on an Appliance simultaneously iptables Port forwarding

Academic Technology Services

Demo

Academic Technology Services

appForm

• Previous Work

– Purdue/nanoHub Rappture – San Diego Supercomputer Center (SDSC) and National Biomedical Computation Resource (NBCR) Project Gemstone

Academic Technology Services

Academic Technology Services

Files Needed for appForm

app_job.xml rsl.xsl app_form.xml trans.xsl

HTML + JavaScript + YUI for tabbed page

app_job.xml, app_form.xml and app_forrm_input.xsl must be written for each app. Job Parameters Tab Input Generator Tab app_form_input.xsl File.txt Input file for app

Academic Technology Services

Demo

Academic Technology Services

Want to see more? Need more info? Want to try UGP hands on? Come to our talk 5:00-6:30 in Leonesa II UGP (the UCLA GRID Portal Software and the UC System Grid Portals