The effective integration of scientific instruments in the Grid - - PowerPoint PPT Presentation

▶
the effective integration of scientific instruments in
SMART_READER_LITE
LIVE PREVIEW

The effective integration of scientific instruments in the Grid - - PowerPoint PPT Presentation

Feb 08, 2024 40 likes •315 views

Terena conference, June 2004, Rhodes, Greece The effective integration of scientific instruments in the Grid Norbert Meyer Norbert Meyer Terena conference, June 2004, Rhodes, Greece High Performance Computing and Visualisation with the SGI

slide-1
SLIDE 1

Terena conference, June 2004, Rhodes, Greece

Norbert Meyer Norbert Meyer

The effective integration of scientific instruments in the Grid

slide-2
SLIDE 2

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

2 Terena conference, June 2004, Rhodes, Greece

High Performance Computing and Visualisation with the SGI Grid for Virtual Laboratory Applications

co-funded by State Committee for Scientific Research and Silicon Graphics

Project Project No. 6 T11 0052 2002 C/05836

  • No. 6 T11 0052 2002 C/05836
slide-3
SLIDE 3

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

3 Terena conference, June 2004, Rhodes, Greece

Project duration:

R&D – December 2002 .. November 2004 Deployment – 1 year

Partners:

ACK CYFRONET AGH (Kraków) – LEAD PARTNER PŁ (Łódź) PSNC (Poznań) TASK (Gdańsk) WCSS (Wrocław) ATM S.A. (Warsaw) Silicon Graphics Institute of Bioorganic Chemistry PAS (Poznań) Institute of Meteorology and Water Management (Warsaw)

slide-4
SLIDE 4

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

4 Terena conference, June 2004, Rhodes, Greece

PIONIER paradigms

VLAB

slide-5
SLIDE 5

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

5 Terena conference, June 2004, Rhodes, Greece

  • Building a nation wide HPC/HPV infrastructure:
  • Connecting the existing infrastructure with the new testbed.
  • Dedicated Application Servers
  • Resource Management, User Account Management, Global Accounting
  • Data access optimisation
  • tape subsystems
  • Access to scientific libraries
  • Checkpoint restart
  • kernel level / IA64 architecture
  • Advanced security system
  • Advanced visualisation
  • Distributed & Remote visualization
  • Programming environment supporting the end user
  • How to simplify the process of making parallel applications

R&D activities

slide-6
SLIDE 6

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

6 Terena conference, June 2004, Rhodes, Greece

Architecture

APPLICATIONS

GRID MIDDLEWARE VIRTUAL LABORATORY HIGH PERFORMANCE

VISUALISATION APPS

EMERGENCY COMPUTING CENTER

ADVANCED NETWORK INFRASRUCTURE (PIONIER) HPC/HPV INFRASTRUCTURE

slide-7
SLIDE 7

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

7 Terena conference, June 2004, Rhodes, Greece

„The Grids that evolve along these lines will need to exhibit all the properties, most importantly, interoperability. In this way a collection of Grids, each providing specialized facilities, will interoperate to form a single Grid at the interface level. We believe that addressing these research priorities (with the representative balance between the pure technical and the social/business oriented issues) in the 2005 to 2010 timeframe will enable Europe to take the global lead in Grid technology and its application in the Information Society of the future” .

Next Generation Grid(s), European Grid Research

European Grid Research 2005 2005 -

  • 2010

2010

Expert Group Report, ftp://ftp.cordis.lu/pub/ist/docs/ngg_eg_final.pdf

Next Generation Grids (NGG)

slide-8
SLIDE 8

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

8 Terena conference, June 2004, Rhodes, Greece

Virtual Laboratory (VLab)

slide-9
SLIDE 9

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

9 Terena conference, June 2004, Rhodes, Greece

virtual virtual, , remote remote, ... , ...Grid Grid-

  • enabled

enabled VERY VERY limited access limited access Main reason Main reason -

  • COSTS

COSTS Main Main GOAL GOAL -

  • to

to make make commonly accessible commonly accessible Added Value Added Value

Why Vlabs ??

slide-10
SLIDE 10

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

10 Terena conference, June 2004, Rhodes, Greece

  • Access via Internet
  • Universal architecture
  • Allows to use the same approach for various types of

instruments

  • To keep the information
  • Experiments, results
  • Publications

Guidelines

slide-11
SLIDE 11

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

11 Terena conference, June 2004, Rhodes, Greece

  • Remote usage of expensive and unique facilities
  • Better utilisation
  • Joint venture and on-line co-operation of scientific teams
  • Shorter deadlines, faster work
  • eScience – closer
  • Equal chances
  • Tele –work, -science

The Goal

slide-12
SLIDE 12

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

12 Terena conference, June 2004, Rhodes, Greece

  • Access various facilities
  • Unique, expensive, universal architecture
  • Choose the best suitable site
  • Define measurement scenarios
  • Digital libraries
  • Collaborative work
  • Accounting issues
  • Enhanced security level
  • On-line progress monitoring
  • Platform independent

Differences between Virtual Laboratory and pure remote access

slide-13
SLIDE 13

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

13 Terena conference, June 2004, Rhodes, Greece

Difference between Virtual Laboratory and pure remote access – CONT.

  • Advanced time reservation
  • Bearing in mind the ‘human factor’
slide-14
SLIDE 14

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

14 Terena conference, June 2004, Rhodes, Greece

Example:

Preprocessing Postprocessing Experiment Visualisation Data Results

  • Allow to flexibly define the measurement scenarios, which

include all experiment parts from pre-processing tasks, through the execution of experiment to post-processing

  • Possibility to add new scenario elements
  • Defining conditions between ‘black boxes’
  • Clearly define the data flow
  • Make simpler the control process

Dynamic Measurement scenarios (DMS)

slide-15
SLIDE 15

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

15 Terena conference, June 2004, Rhodes, Greece

slide-16
SLIDE 16

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

16 Terena conference, June 2004, Rhodes, Greece

In Out

Dynamic Measurement scenarios

slide-17
SLIDE 17

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

17 Terena conference, June 2004, Rhodes, Greece

  • Checking conditions and constrains (earlier defined inside the

‘black box’)

  • Conditions between connections (e.g. OR, AND)
  • Input and Output conditions

Complexity of DNM - connections

slide-18
SLIDE 18

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

18 Terena conference, June 2004, Rhodes, Greece

Complexity of DMS - conversions

  • Made in case the OUTPUT of App1 is incompatible with INPUT
  • f App2
  • Developed several conversion schemas
  • The behaviour of Measurement parts is defined by

DMSL (ang. Dynamic Measurement Scenario Language)

slide-19
SLIDE 19

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

19 Terena conference, June 2004, Rhodes, Greece

Dynamic Measurement scenarios

slide-20
SLIDE 20

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

20 Terena conference, June 2004, Rhodes, Greece

  • Scientific instrument = Grid resource
  • Submitting the jobs to device (e.g. to Spectrometer) as well

as to other computational systems

  • ‘Wider definition’ of Grid Resource

Resources in the Grid

slide-21
SLIDE 21

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

21 Terena conference, June 2004, Rhodes, Greece

  • Defining limits for available resources
  • A reporting system, which takes into consideration the type
  • f laboratory, projects and users
  • Integrated with Grid Accounting

Global Accounting

slide-22
SLIDE 22

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

22 Terena conference, June 2004, Rhodes, Greece

... more than remote access

Testbed infrastructure

  • Vi

Virtual rtual Labora Laboratory o tory of f Nuclea Nuclear r Magne Magnetic tic Resonance Spectroscopy – Resonance Spectroscopy – coopera cooperation tion wi with Ins th Institu titute o te of f Bioorgan Bioorganic ic Che hemist stry PAS ry PAS

  • Vi

Virtual rtual Labora Laboratory o tory of f Radio Radiotelesc elescopy

  • py

– Radioast adioastronomy ronomy Depa epart rtment ment of

  • f

Mikołaj Kopern kołaj Kopernik ik Universi iversity

slide-23
SLIDE 23

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

23 Terena conference, June 2004, Rhodes, Greece

Globus Fabric Layer Vlab Layer (specific services) Middleware Layer Applications Access services

Collaborative work environmentj Measurement Scenarios Data visualizations Labour administration Grid gateway Global Vlab resource broker Local resource broker Authorization Data Management System Monitoring Accounting HPC/HPV systems Scientific instruments Storage GridFTP Grid Information Service GRMS

Virtual Laboratory environment Grid environment

Applications

Application A Networking

slide-24
SLIDE 24

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

24 Terena conference, June 2004, Rhodes, Greece

Jobs management Digital library Communication tools Educational area User profile

Submit new scenario Monitoring Accounting NMR database Radio- astronomy database Publications database Chat Audio Video User information Customizing tools Depends on laboratory profile

User Interface - components

slide-25
SLIDE 25

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

25 Terena conference, June 2004, Rhodes, Greece

Summary

Grid-enabled Universal architecture User-friendly The remote facility becomes a critical resource !!

slide-26
SLIDE 26

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

26 Terena conference, June 2004, Rhodes, Greece

Subcomponents

slide-27
SLIDE 27

Cezary Mazurek, PSNC, Access to Grid and Digital Library Services

27 Terena conference, June 2004, Rhodes, Greece

THANK YOU !

meyer@man.poznan.pl

Poznań Supercomputing and Networking Center http://vlab.psnc.pl http://www.wcss.wroc.pl/pb/sgigrid/

VLAB