The EELA-2 project (before, now and after) Diego Carvalho on - - PowerPoint PPT Presentation

▶
the eela 2 project before now and after
SMART_READER_LITE
LIVE PREVIEW

The EELA-2 project (before, now and after) Diego Carvalho on - - PowerPoint PPT Presentation

Dec 07, 2023 210 likes •673 views

E-science grid facility for Europe and Latin America The EELA-2 project (before, now and after) Diego Carvalho on behalf of the EELA-2 Collaboration SA1 - Grid Infrastructure Manager CEFET-RJ d.carvalho@ieee.org Panel - Grid Infrastructures

slide-1
SLIDE 1

E-science grid facility for Europe and Latin America www.eu-eela.eu

The EELA-2 project (before, now and after)

Diego Carvalho

  • n behalf of the EELA-2 Collaboration

SA1 - Grid Infrastructure Manager

CEFET-RJ d.carvalho@ieee.org

Panel - Grid Infrastructures in Latin America and their Role in Fostering National Grid Initiatives LAGRID’08, Campo Grande

slide-2
SLIDE 2

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

Outline

2

slide-3
SLIDE 3

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

Outline

  • Before EELA
  • EELA Phase I
  • EELA Phase II
  • Beyond EELA

2

slide-4
SLIDE 4

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30 3

EELA Timeline

slide-5
SLIDE 5

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30 3

Pre-eela

EELA Timeline

slide-6
SLIDE 6

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

Pre-EELA Era in LA

4

slide-7
SLIDE 7

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

Pre-EELA Era in LA

4

  • Several middleware research

projects

  • No e-Infrastructure project
  • No dissemination project
  • No concept of facility
  • Major community: High Energy

Physics

slide-8
SLIDE 8

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

Pre-EELA Era in LA

4

  • Several middleware research

projects

  • No e-Infrastructure project
  • No dissemination project
  • No concept of facility
  • Major community: High Energy

Physics Only dark clouds...

slide-9
SLIDE 9

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

Pre-EELA Era in LA

4

  • Several middleware research

projects

  • No e-Infrastructure project
  • No dissemination project
  • No concept of facility
  • Major community: High Energy

Physics Only dark clouds...

So, let’s do something!!!

slide-10
SLIDE 10

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30 5

Pre-eela

EELA Timeline

slide-11
SLIDE 11

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30 5

Pre-eela EELA phase I

EELA Timeline

slide-12
SLIDE 12

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA Project (Phase I - Jan, 2006 - Dec, 2008)

6

slide-13
SLIDE 13

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA Project (Phase I - Jan, 2006 - Dec, 2008)

6

  • Objectives:
  • Build a bridge between consolidated e-Infrastructure initiatives in Europe

and emerging ones in Latin American

  • Create a collaboration network to deploy a large portfolio of scientific

applications on a well supported Pilot Test-bed

  • Care in parallel of the training in grid technologies and of the knowledge

dissemination and outreach

  • Consortium
  • 21 partners (LA: Argentina, Brazil, Chile, Cuba, Mexico, Peru and

Venezuela; EU: Italy, Portugal and Spain; Inter: CLARA and CERN)

  • Co-funded by European Commission
slide-14
SLIDE 14

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA Project (Phase I - Jan, 2006 - Dec, 2008)

6

  • Objectives:
  • Build a bridge between consolidated e-Infrastructure initiatives in Europe

and emerging ones in Latin American

  • Create a collaboration network to deploy a large portfolio of scientific

applications on a well supported Pilot Test-bed

  • Care in parallel of the training in grid technologies and of the knowledge

dissemination and outreach

  • Consortium
  • 21 partners (LA: Argentina, Brazil, Chile, Cuba, Mexico, Peru and

Venezuela; EU: Italy, Portugal and Spain; Inter: CLARA and CERN)

  • Co-funded by European Commission

The infrastructure was led by LA

slide-15
SLIDE 15

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

EELA Achievements

7

slide-16
SLIDE 16

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

EELA Achievements

7

  • PKI in LA
  • 19 Resource Centres (Pilot TB)
  • Knowledge dissemination
  • Tuning of the infrastructure
  • Rio -> Madrid (3 days)
  • Sustained Rate of 300 Mbit/s
  • Peak of 341 Mbit/s
  • ~ 90% job efficiency
slide-17
SLIDE 17

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

EELA Achievements

7

  • PKI in LA
  • 19 Resource Centres (Pilot TB)
  • Knowledge dissemination
  • Tuning of the infrastructure
  • Rio -> Madrid (3 days)
  • Sustained Rate of 300 Mbit/s
  • Peak of 341 Mbit/s
  • ~ 90% job efficiency

LA knows how to use, operate and even build a Grid infrastructure

slide-18
SLIDE 18

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

Infrastructure workload

8

150000 300000 450000 600000 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Project Month

Monthly Cumulative

# of Jobs 1000 2000 3000 4000 1 2 3 4 5 6 7 M01-M07 Zoom (Test-bed Setup)

EU-LAC WISDOM ALICE-DC PHY-EXP

slide-19
SLIDE 19

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

Infrastructure workload

8

150000 300000 450000 600000 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Project Month

Monthly Cumulative

# of Jobs 1000 2000 3000 4000 1 2 3 4 5 6 7 M01-M07 Zoom (Test-bed Setup)

EU-LAC WISDOM ALICE-DC PHY-EXP

510 CPU.years delivered in 2 years

slide-20
SLIDE 20

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30 9

Pre-eela EELA phase I

EELA Timeline

slide-21
SLIDE 21

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30 9

Pre-eela EELA phase I EELA phase II

EELA Timeline

slide-22
SLIDE 22

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA-2 Project (Phase II - April, 2008 - March, 2010)

10

slide-23
SLIDE 23

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA-2 Project (Phase II - April, 2008 - March, 2010)

10

  • Objectives:
  • Provide an empowered Grid Facility with versatile services fulfilling

application requirements

  • Ensure the long term sustainability of the e-Infrastructure beyond the term
  • f the project
  • Expand the current EELA e-Infrastructure
  • Look for new communities outside academia (Industry and Business)
  • Ensure production quality services (PQI)
  • Consortium
  • 54 members (LA: Argentina, Brazil, Chile, Colombia, Cuba, Ecuador,

Mexico, Peru and Venezuela; EU: France, Ireland, Italy, Portugal and Spain; Inter: CLARA)

  • Co-funded by European Commission
slide-24
SLIDE 24

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA-2 Project (Phase II - April, 2008 - March, 2010)

10

  • Objectives:
  • Provide an empowered Grid Facility with versatile services fulfilling

application requirements

  • Ensure the long term sustainability of the e-Infrastructure beyond the term
  • f the project
  • Expand the current EELA e-Infrastructure
  • Look for new communities outside academia (Industry and Business)
  • Ensure production quality services (PQI)
  • Consortium
  • 54 members (LA: Argentina, Brazil, Chile, Colombia, Cuba, Ecuador,

Mexico, Peru and Venezuela; EU: France, Ireland, Italy, Portugal and Spain; Inter: CLARA)

  • Co-funded by European Commission

More ambitious project...

slide-25
SLIDE 25

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA-2 Philosophy

11

slide-26
SLIDE 26

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA-2 Philosophy

  • e-Infrastructure oriented Project
  • Application oriented e-Infrastructure
  • Production quality e-Infrastructure
  • Consortium: 81 candidates, then 54 Members were selected (1 withdrawal)
  • Multi-middleware
  • Open to any new member
  • Consortium Rules:
  • If more than one member in country, then Members federate into a JRU,

One of the Members becomes a Partner that adhered to the Contract EELA-2 “seen” by EC: 16 Partners (starting point for NGI)

  • EELA-2 only pays for “central services”

11 e-infrastructure applications dissemination training

slide-27
SLIDE 27

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA-2 Philosophy

  • e-Infrastructure oriented Project
  • Application oriented e-Infrastructure
  • Production quality e-Infrastructure
  • Consortium: 81 candidates, then 54 Members were selected (1 withdrawal)
  • Multi-middleware
  • Open to any new member
  • Consortium Rules:
  • If more than one member in country, then Members federate into a JRU,

One of the Members becomes a Partner that adhered to the Contract EELA-2 “seen” by EC: 16 Partners (starting point for NGI)

  • EELA-2 only pays for “central services”

11 e-infrastructure applications dissemination training

Keyword: Inclusive

slide-28
SLIDE 28

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

EELA-2 Infrastructure

12

slide-29
SLIDE 29

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

EELA-2 Infrastructure

12

slide-30
SLIDE 30

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

EELA-2 Infrastructure

12

More than 40 resource centres

slide-31
SLIDE 31

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA Applications

  • Applications: Domain breakdown

13

1 1 1 1 1 1 1 3 3 7 7 22

Bio HEP Earth Sciences Engineering Optimization A.I Civil Proctection Data mining e-Learning Environmental Sciences Food Engineering Physics

slide-32
SLIDE 32

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA Applications

  • Applications: Domain breakdown

13

1 1 1 1 1 1 1 3 3 7 7 22

Bio HEP Earth Sciences Engineering Optimization A.I Civil Proctection Data mining e-Learning Environmental Sciences Food Engineering Physics

Challenging !!!

slide-33
SLIDE 33

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA-2 recommendations

14

slide-34
SLIDE 34

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA-2 recommendations

  • No EELA-3 foreseen
  • “Long-term sustainability” is an EELA-2 goal National Grid Initiatives (NGI)

should be created e-Science structures highly desirable

  • New Countries collaborating with / joining EELA-2
  • New Communities using the EELA-2 e-Infrastructure

14

slide-35
SLIDE 35

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

EELA-2 recommendations

  • No EELA-3 foreseen
  • “Long-term sustainability” is an EELA-2 goal National Grid Initiatives (NGI)

should be created e-Science structures highly desirable

  • New Countries collaborating with / joining EELA-2
  • New Communities using the EELA-2 e-Infrastructure

14

“Central Services” We need a sustainable funding

slide-36
SLIDE 36

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30 15

Pre-eela EELA phase I EELA phase II

EELA Timeline

slide-37
SLIDE 37

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30 15

Pre-eela EELA phase I EELA phase II

EELA Timeline

LGI

NGI-I NGI-II NGI-III NGI-IV

slide-38
SLIDE 38

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

Latin American Grid Infrastructure

16

slide-39
SLIDE 39

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

Latin American Grid Infrastructure

16

3 layers: RC, National and LA

slide-40
SLIDE 40

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

National Grid Initiative

17

slide-41
SLIDE 41

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

National Grid Initiative

17

Only one per country and must be inclusive, no matter what (middleware, application domain, etc.)

slide-42
SLIDE 42

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

Latin American Grid Initiative

18

slide-43
SLIDE 43

E-science grid facility for Europe and Latin America www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

Latin American Grid Initiative

18

Again!!! Must be inclusive, no matter what (middleware, application domain, etc.)

slide-44
SLIDE 44

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

Conclusions

19

slide-45
SLIDE 45

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

Conclusions

19

  • EELA and EELA-2:
  • started from scratch
  • boosted / fostered the use of Grid in LA, independently of the Middleware
  • trained / are training skilled people
  • interact strongly with NRENs and CLARA involving them in grid activities
  • are proposing a viable model for LONG-TERM sustainability of GRID

infrastructure

  • strong co-operation with Europe / EGI / DANTE .... and other actors and

Initiatives

slide-46
SLIDE 46

www.eu-eela.eu

Campo Grande, LAGRID’08, 2008-10-30

E-science grid facility for Europe and Latin America

Conclusions

19

  • EELA and EELA-2:
  • started from scratch
  • boosted / fostered the use of Grid in LA, independently of the Middleware
  • trained / are training skilled people
  • interact strongly with NRENs and CLARA involving them in grid activities
  • are proposing a viable model for LONG-TERM sustainability of GRID

infrastructure

  • strong co-operation with Europe / EGI / DANTE .... and other actors and

Initiatives

Thanks for your attention!!! d.carvalho@ieee.org