ADAGE Automatic Deployment of Applications in a Grid Environment - - PowerPoint PPT Presentation
ADAGE Automatic Deployment of Applications in a Grid Environment Key concepts Supports several programming models Generic description of an application High-level description of resources Creates a deployment plan Placement constraints
Supports several programming models Generic description of an application High-level description of resources Creates a deployment plan Placement constraints
Restart with a stable codebase
Adage v1 features File transfer
Component-oriented design Technos : C++ / XMLSchema / Autotools Interfaced with OAR/OARGRID Plugins
Jxta Gfarm MPI Sequence of Jobs Meta
<<Application control>> <<Deployment plan execution>> <<Deployment planning>> Deployment plan Deployment report <<JXTA Plugin conversion>> <<CCM Plugin conversion>> <<MPI Plugin conversion>> Generic application description Resources description Control parameters JXTA application description MPI application description CCM application description
Nodes
<compute_node id="node1" sysprops_id="sysprop" hostname="paraquad01"/> <compute_node id="node2" sysprops_id="sysprop" hostname="paraquad02"/> ....
System Properties
<system_properties id="sysprop"> <node_count>1</node_count> <cpu_count>2</cpu_count> <service command="ssh" type="submission"/> <service command="scp" type="transfer"/> <scratch_dir>/tmp/</scratch_dir> </system_properties>
Resources groups
<res_group id="grp1"> <shared_fs id="nfs" contact_point="any"> <dir>/shared/</dir> </shared_fs> <member id="node1" type="node"/> <member id="grp2" type="group"/> .... </res_group>
Group of processes
independent collective
Process
executable / implementations arguments environment files (config, lib, data)
Launch dependencies
wait acked
Submission method
ssh rsh
Transfer parameters
scp rcp source type destination
Placement constraints
<associate id="pg1" id_type="exact" match_type="pattern" match="cluster1"/> <unassociate id="pg" id_type="pattern" match_type="exact" match="cluster12"/> <collocate id="pg4" with="pg1"/> <separate id="pg3" without="pg2"/>
Plugin parameters
Only one interface : make_plan() Deals with the resourcer Algorithm:
resourcer: load(file/oar) planner: resourcer->search_matching(proc group) resourcer: checks_constraints() resourcer: return list<nodes> (less used first) planner: assign(node,process) (rr-style)
creation() specific_to_generic() pre_configure() specific_deployment() post_configure()
Daemon / persistent mode Agents Handle the lifecycle of the application ? Support new application types Need of smart planners OGF JSDL ? Taktuk ? GAT ?
ml : adage-devel@lists.gforge.inria.fr www : http://adage.gforge.inria.fr/wiki/