WP5 JRA1 Testbed Management Technologies JRA1 Testbed Management - - PowerPoint PPT Presentation

INFSO-RI-223782

WP5

JRA1 Testbed Management Technologies JRA1 Testbed Management Technologies

ETICS2 first Review

Alain Roy

University of Wisconsin-Madison (USA)

Bruxelles 3 April 2009 Bruxelles, 3 April 2009

INFSO-RI-223782

Contents

• Goals
• Major Achievements

Ch ll

• Challenges
• Metrics and Statistics
• Conclusions

Conclusions

2

Bruxelles, 3 April WPX WP name

INFSO-RI-223782

Goals

3

Bruxelles, 3 April WPX WP name

3

INFSO-RI-223782

Goals

• Top-level Goals:
• Designing and implementing solutions for resource and

Designing and implementing solutions for resource and job management across the grid on IPv4 and IPv6 networks.

• Explore existing hardware virtualization techniques

in

• Explore existing hardware virtualization techniques, in
• rder to integrate them into ETICS.
• Deliverables due so far:

J b M t W b S i I t f S ifi ti

1.Job Management Web Service Interface Specification 2.IPv6 Compliance Analysis 3.Integration of Virtualization Technologies (Prototype)

g g ( yp )

• Upcoming Deliverables:

4.Job Management Web Service Implementation 5 Integration of Virtualization Technologies 5.Integration of Virtualization Technologies 6.IPv6 Compliance

• Other:

4

Bruxelles, 3 April WPX WP name

• Support

job submission to non-Condor systems (In support of DSA 2.4)

INFSO-RI-223782

Other Goals

• Cross-Site job submissions

CS

• Ability to share jobs between ETICS instances.

5

Bruxelles, 3 April WPX WP name

INFSO-RI-223782

Major Achievements

6

Bruxelles, 3 April WPX WP name

6

INFSO-RI-223782

Achievements

• DJRA 1.1:

We have completed the specification of the web interface for Metronome.

• DJRA 1 2: We have completed the IPv6 compliance
• DJRA 1.2: We have completed the IPv6 compliance

analysis.

• The analysis was the easy part.
• The compliance is the hard part… More when we discuss

“challenges”

• DJRA 1.3: While this deliverable has been achieved, it

needs considerable refinement and work in order to achieve the full implementation

• Remote job submission: Successfully prototyped and

Remote job submission: Successfully prototyped and nearly in production

7

Bruxelles, 3 April WPX WP name

INFSO-RI-223782

DJRA 1.3: Virtualization Prototype

• Two approaches explored
• Use of Condor’s Virtual Machine Universe

P h t t C d

• Pushes management to Condor
• Upper levels do no need to understand VM instantiation
• Remote bootstrapper
• (Explored at CERN)
• Instrument Metronome to allow startup of virtual machine
• Prototype in progress: complete by May 2009
• Prototype in progress: complete by May 2009

8

Bruxelles, 3 April WPX WP name

INFSO-RI-223782

Metrics and Statistics

9

Bruxelles, 3 April WPX WP name

9

INFSO-RI-223782

Metrics and Statistics

• I’m not sure what I should put here.
• Can someone provide some guidance?

10

Bruxelles, 3 April WPX WP name

INFSO-RI-223782

Challenges

11

Bruxelles, 3 April WPX WP name

11

INFSO-RI-223782

Challenge: Progress on Virtualization

• To date, we have been slow on progress towards use of

virtualization technologies

• We believe that we can accomplish our deliverables

during the ETICS 2 project. g p j

12

Bruxelles, 3 April WPX WP name

INFSO-RI-223782

Challenge: IPv6 Compliance

• We have completed our IPv6 compliance analysis, and

there are two major obstacles to achieving a pure IPv6- ready implementation.

1.

ETICS relies on Metronome, which relies on Condor, and Condor is not IPv6 ready. The Condor project has requested funding for IPv6 compliance and is likely to get it, but it is unlikely to be completed before the end of ETICS 2. (The funding will not be received for a while)

2.

Metronome relies

• n

MySQL which is not IPv6

• compliant. Switching to a new database is feasible but

p g non-trivial. We are not aware of MySQL plans for IPv6 compliance.

• Do we need to rely on a bridge/tunnel solution for now?

Do we need to rely on a bridge/tunnel solution for now?

13

Bruxelles, 3 April WPX WP name

INFSO-RI-223782

Conclusions

14

Bruxelles, 3 April WPX WP name

14

INFSO-RI-223782

Conclusions

• Remote job submission is nearly production-ready
• IPv6 Compliance faces challenges best dealt with by

people outside the project people outside the project

• Virtualization is a bit behind, but we expect to

complete it.

15

Bruxelles, 3 April WPX WP name