SEE-GRID-SCI SEE-GRID Infrastructure for Regional eScience - - PowerPoint PPT Presentation

www.see-grid-sci.eu

SEE-GRID-SCI

• Dr. Ognjen Prnjat

European and Regional Grid Management GRNET

SEE-GRID Infrastructure for Regional eScience

International Symposium on Grid Computing (ISGC) Academia Sinica, Taipei, 5-12 March 2010

The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

Outline

South-East European eInfrastructure activities SEE-GRID-SCI project overview Sustainability and policy-level cooperation: SEERA-EI

2

Outline

South-East European eInfrastructure activities SEE-GRID-SCI project overview Sustainability and policy-level cooperation: SEERA-EI

3

Pan-EU e-Infrastructures vision

• The Research Network infrastructure

provides fast interconnection and advanced services among Research and Education institutes of different countries

• The Research Grid infrastructure

provides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware) in order to solve complex application problems

• Integrated networking & grid environment

is called electronic infrastructure (eInfrastructure) allowing new methods

• f global collaborative research - often

referred to as electronic science (eScience)

• The creation of the eInfrastructure is a key
• bjective of the European Research Area

Network Infrastructure e-Science Collaborations

Grid Infrastructure

4

SEE eInfrastructure activities – past 6 years

• SEEREN1/2: establishing the regional inter-NRN interconnectivity and

GEANT links [DGINFSO]

• SEELIGHT: implementation of the lambda facility in the region [Greek

HiperB]

• SEEGRID1/2: building the regional Grid infrastructure within and

beyond EGEE, building NGIs and user communities [DGINFSO]

• SEE-GRID-SCI: eInfrastructure for large-scale environmental science:

meteorology, seismology, env. protection. Inclusion of Caucasus. (BSI: Caucasus region connections) [DGINFSO]

• SEERA-EI: regional programme managers collaboration towards

common eInfrastructure vision and strategy [DGRTD]

• Upcoming: HP-SEE: regional HPC interconnection and 2nd generation

Caucasus link

5

Vision: converged communication and service infrastructure for SEE

6

SEE-LIGHT & BSI & GEANT

Comp ¡physics, ¡ Comp ¡chem, ¡Life ¡sciences ¡ Seismology, ¡ Meteorology, ¡ Environment ¡

HP-SEE

SEE-LIGHT: South-East European Lambda Network Facility for R&E

• Deployment of an advanced regional

network infrastructure (lambda network facility) for R&E, under the Hellenic Plan for the Economic Reconstruction of the Balkans (HiPERB).

• 4 countries committed, others in progress
• SEENet: a management body for

SEELIGHT

Network Sustainability: SEELIGHT

e-IRG workshop, Uppsala, 14-15/10/2009 7

Grid Sustainability

Large infrastructure built

through 3 projects

User community buy-in

secured

National structuring via

NGIs

Kick-off of national-level

projects

All countries joined EGI

e-IRG workshop, Uppsala, 14-15/10/2009

8

8

Outline

South-East European eInfrastructure activities SEE-GRID-SCI project overview Sustainability and policy-level cooperation: SEERA-EI

9

Current project: SEE-GRID-SCI

Contract n°: RI-211338 Project type: I3 Start date: 01/05/2008 Duration: 24 months Total budget: 3 214 690 € Funding from the EC: 2 500 000 € Total funded effort, PMs: 676.5 Web site: www.see-grid-sci.eu Contact person: Dr. Ognjen Prnjat, GRNET

10

The partnership

Contractors

GRNET Greece CERN Switzerland SZTAKI Hungary IPP-BAS Bulgaria ICI Romania TUBITAK Turkey ASA/INIMA Albania UoBL Bosnia-Herzegovina UKIM FYR of Macedonia UOB Serbia UoM Montenegro RENAM Moldova RBI Croatia IIAP-NAS-RA Armenia GRENA Georgia

Third Party / JRU mechanism used

associate universities / research centres

11

Project objectives

Engaging international user communities (meteorology,

seismology, environmental protection) and providing application-specific service extensions

Providing infrastructure for new communities Consolidating actions towards long-term sustainability

and European Grid Initiative inclusion

Strengthening the regional and national human network

12

Grid infrastructure

13

Infrastructure management

14

Overall availability of services >90%

User communities support

• Seismology (6 major applications), meteorology (2) and

environmental protection (8); in satisfactory stages of deployment

• Cross-border user communities and beneficiaries
• Very clear and efficient procedures for support

15

Meteorology VO

• 1. Regional Multi-model, Multi-analysis

Ensemble Prediction System

• BOLAM, MM5, NCEP/Eta, and NCEP/WRF-

NMM

• SEE-wide scale detailed forecasts
• Coordinate, collect and analyze the outputs

from all models for the generation of probabilistic forecasts

• Very complex; very CPU-intensive
• 2. Study of interaction of airflow with

complex terrain

16

Meteorology VO: Ensemble forecasting

GRID DATA Download (Initial Conditions) Pre- Processing Model Run (BOLAM MM5 WRF/NMM NCEP/Eta) Post Processing Probabilistic Forecast HT HTTP UI N.O.M.A.D.S NCEP-GFS (USA) UI

17

Seismology VO

• Seismology VO offers the

researchers:

• Access to seismic data mirrored

from national research centers on a timely basis

• Adequate computing resources close

to the seismology data repositories

• Collaborative working environment

with both regional groups and global organizations

• Core: seismic data server serving

large seismic data sets from sensors (TBs)

• 6 Applications

Size of Continuous Waveform Data ¡ ~ 3 TB ¡

• No. of stations ¡

~ 100 ¡

18

Environmental VO

• Main application domains:
• Environmental protection/response
• Environment-oriented satellite image processing
• Extending to oceanography and climate change modeling
• 8 core applications:
• Modeling System for Emergency Response to the Release
• f Harmful Substances in the Atmosphere
• Multi-scale atmospheric composition modeling (demoed

with JTS JRA1 development)

• Monte Carlo Sensitivity Analysis for Environmental

Systems

• Environment Oriented Satellite Data Processing + related

applications

• Groundwater flow simulation system
• Study of Charges of Environment with Remote Sensing
• Climate Change Impact on Air Quality
• Oceanography

19

Infrastructure usage by communities

SEE-GRID-SCI sites have provided more than 22.5

million Base CPU hours and ~4 million jobs in 20 months of operation

• SEEGRID VOs (seegrid, seismo, environ and meteo)
• National VOs (AEGIS VO, TRGRID VOs)
• Regional VOs (see)

20

1 10 100 1000 10000 100000 1000000 10000000 100000000 SEE-GRID-SCI Vos EGEE Vos Other Vos

Base CPU Time (hours) by VO Group

1 10 100 1000 10000 100000 1000000 10000000 SEE-GRID-SCI Vos EGEE Vos Other Vos

Number of Jobs by VO Group

Dissemination and training

• Large number of dissemination and training events
• Focused and widespread campaign:
• 3 regional dissemination events (meteorology and environmental workshops, user

forum)

• 30+ national level dissemination events
• 3 regional training events (grid administrators; meteorologists, siesmologists)
• 30+ country-level training events (~15 dedicated to Meteorology / Environmental

Science / Seismology communities)

• >500 people trained
• >1500 people attended focused dissemination events
• Other dissemination-related activities: 2 newsletters; disseminations

in public media: TV (3); Press Releases (3); Newspapers (3); E- newspapers (3); scientific papers (30+) and presentations (40+).

Regional event

21

Key results: National Grid Initiatives

Initiating and structuring NGIs

• SEE-GRID pioneer of the NGI concept
• Significant developments in a number of areas: organisational

stability, operational maturity, national-level support

Providing active support for NGI establishment in other

developing regions

Deliverables:

• DNA2.1 - NGI metrics specification (44 detailed metrics, quarterly

reporting and analysis)

• DNA2.2 - NGI cookbook (detailed NGI setup guidelines,

distributed to all other regions)

• DNA2.3a - NGI intermediate assessment (detailed assessment

and recommendations)

22

NGI status

Before SEE-GRID-SCI During SEE-GRID-SCI

23

Crucial sustainability building blocks: National support

National projects National contributions to GEANT / EGI.org EC funding However there is lack of coordination between

programmes and fragmentation of national programmes

A wealth of things to learn between national funding

agencies

The ground is set for common regional vision and

concrete actions

e-IRG workshop, Uppsala, 14-15/10/2009 24

Outline

Case study: South-East European eInfrastructure

activities

SEE-GRID-SCI project overview Sustainability and policy-level cooperation:

SEERA-EI

25

SEERA-EI: the project

Area: "INFRA-2008-3.1: ERA-NET supporting

cooperation for research infrastructures in all S&T fields“

Start: 1 April 2009 Duration: 36 months Total budget: 2 000 000 € Funding from the EC: 1 500 000 € Total funded effort, PMs: 451 Contract n°: RI-228052 Project type: Coordination and support action Contact person: Dr. Ognjen Prnjat, GRNET

e-IRG workshop, Uppsala, 14-15/10/2009 26

SEERA-EI: core objective

Core Objective – Develop and strengthen the

coordination and cooperation of national eInfrastructures programmes in the region of South- East Europe.

• The core objective of the SEERA-EI project is to engage national key

programme owners in the field of Research Infrastructures (eInfrastructures) in SEE in common dialogue and planning, to establish a sustainable and sustained communication platform, and to undertake activities targeting durable cooperation in building the common regional Research Infrastructures vision, strategy and action plan.

e-IRG workshop, Uppsala, 14-15/10/2009 27

SEERA-EI: detailed objectives

• O1 - Enable common dialogue and exchange of information

between national programme owners

• O2 – Analyse state of the art in national programmes
• O3 - Reduce fragmentation and improve coordination across SEE

segment of ERA in field of RI, on the level of national programmes, and avoid creating niches of non-standardised programmes

• O4 - Facilitate efficient set-up and support for national

eInfrastructure programmes, in coordination with common guidelines and regional vision

e-IRG workshop, Uppsala, 14-15/10/2009 28

SEERA-EI: detailed objectives

• O5 - Enable concrete cooperation of programme owners and

common planning and development of join activities, both within project duration and beyond it in long term

• O6 – Establish a long-term platform for sustained dialogue

between programme owners that will extend beyond project lifetime

• O7 – Enable information exchange with rest of ERA, carry out

international collaboration activities, and contribute to EU policy

• n eInfrastructures

e-IRG workshop, Uppsala, 14-15/10/2009 29

Conclusions

South-East European initiatives managed to bring this

unprivileged region to the level of Western European developments within a time span of 3 years

Path towards sustainability laid down through a set of

complementary and coordinated activities

National-level eInfra development (NRN, NGI) crucial

for further regional and international collaborations

• Government support necessary; also engagement by wider

community

Use of regional vehicles is crucial

• EUAsiaGrid, CHAIN

SEE initiatives are open for discussions, feedback,

inputs to other regional initiatives!

30

Conclusion: National and regional vision – SEE and wider context

• Vision:
• Being on the technological par with the world
• Enabling local scientists to use their potential
• Role-model for regional developments
• Leading the way in wider contexts
• Strategic success metrics of regional initiatives:
• not Gbps/sec; cores; TBs of storage
• The initiatives are puzzle pieces of RTD efforts to sustain regional

development

• Increasing the retention of talented scientists in the region
• Pursuing joint R&D efforts among countries in the region
• Making available the benefits of the Information Society for citizens
• Easing the digital divide between the region and rest of EC
• Improvement of regional competitiveness in all market sectors
• Regional political stability and cohesiveness

31