The Australian High Energy Physics Data Grid: Supporting the ATLAS - - PowerPoint PPT Presentation

the australian high energy physics data grid supporting
SMART_READER_LITE
LIVE PREVIEW

The Australian High Energy Physics Data Grid: Supporting the ATLAS - - PowerPoint PPT Presentation

The Australian High Energy Physics Data Grid: Supporting the ATLAS and Belle Experiments Glenn Moloney University of Melbourne ISGC Taiwan July 2004 Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 1


slide-1
SLIDE 1

The Australian High Energy Physics Data Grid: Supporting the ATLAS and Belle Experiments

Glenn Moloney University of Melbourne

ISGC Taiwan July 2004 Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 1

slide-2
SLIDE 2

Experimental High Energy Physics in Australia

Close collaboration between:

  • University of Melbourne
  • University of Sydney
  • Hold joint research grants (ARC)

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 2

slide-3
SLIDE 3

Experimental High Energy Physics in Australia

Close collaboration between:

  • University of Melbourne
  • University of Sydney
  • Hold joint research grants (ARC)

The Physicists:

  • 3 Academic Staff
  • 4 Research Fellows
  • 12 PhD Students
  • Technicians - Electronic, Mechanical
  • 2 Programmers

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 2

slide-4
SLIDE 4

Experimental High Energy Physics in Australia

Close collaboration between:

  • University of Melbourne
  • University of Sydney
  • Hold joint research grants (ARC)

The Physicists:

  • 3 Academic Staff
  • 4 Research Fellows
  • 12 PhD Students
  • Technicians - Electronic, Mechanical
  • 2 Programmers

Members of two major HEP experiments..

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 2

slide-5
SLIDE 5

The ATLAS experiment:

To investigate the origins of mass At the Large Hadron Collider, LHC.

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 3

slide-6
SLIDE 6

The BelleExperiment

  • To measure Charge–Parity symmetry violation in the decay of B mesons

3.5 GeV e− 8.0 GeV e+

Located in Tsukuba, Japan.

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 4

slide-7
SLIDE 7

Experimental High Energy Physics in Australia:

Atlas:

  • Members of the ATLAS collaboration since 1995
  • Contribution to the Silicon Charged Tracker (SCT):
  • Facilities in Melbourne/Sydney for assembly, wire-bonding and

testing of Silicon detector modules

  • Electon ID software
  • Participation in ATLAS Data Challenges

Belle:

  • Members of Belle since 1997
  • Assembly, wire-bonding and testing of Silicon Vertex Detector (SVD)

modules for SVD 1.1, 1.2, 1.5 and 2.0

  • Radiation monitoring (Wollongong University)
  • Development of Grid-based Belle Data Analysis

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 5

slide-8
SLIDE 8

Grid Computing Infrastructure in Australia

Network Infrastructure:

  • Australian Aacademic Research Network (AARNET)
  • GrangeNet: 10 gigabit research backbone connecting:
  • Melbourne, Canberra, Sydney, Brisbane
  • Commisioned early 2003

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 6

slide-9
SLIDE 9

Grid Computing Infrastructure in Australia

Network Infrastructure:

  • AARNET3:
  • Delivering 10 gigabit R&E network to the rest of Australia
  • Rolling out in 2004

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 7

slide-10
SLIDE 10

International Links to Australia

Planned upgrades to international research and education links

  • 10Gb to US
  • within 2 months
  • Gigabit to Japan
  • Later
  • 100Mb to Singapore
  • Installed now

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 8

slide-11
SLIDE 11

International Links to Australia

Speculation on the future:

  • Asia Pacific multi gigabit loop

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 9

slide-12
SLIDE 12

Computing Resources for HEP

We have access to shared linux cluster facilities at:

  • Australian Partnership for Advanced Computing

Canberra

  • 150 × 2.66 GHz Pentium 4
  • Petabyte capable mass data store
  • Victorian Partnership for Advanced Computing

Melbourne

  • 97 × dual 2.8 GHz Xeon
  • AC3

Sydney

  • 155 × dual 3.0 GHz Xeon
  • University of Melbourne

Melbourne

  • 48 × dual 2.4 GHz Xeon

These are all members of the Australian Partnership for Advanced Computing, APAC. A good candidate for an Australian National Grid infrastructure

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 10

slide-13
SLIDE 13

The Australian National Grid project

The Australian government has provided AU$29m for stage 2 of APAC: “Providing the advanced computing and grid infrastructure for eresearch”

  • $12.5m for upgrade of peak computing facility

Canberra

  • RFP issued June 30 2004
  • National grid infrastructure projects:
  • Computing infrastructure
  • Information infrastructure (data grid)
  • User Interface and Visualisation
  • Application support projects:
  • Astronomy
  • Computational chemistry
  • Theoretical and experimental high energy physics
  • LatticeGrid, ATLAS, Belle
  • Geosciences
  • Bioinformatics

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 11

slide-14
SLIDE 14

The Australian Experimental HEP Data Grid Team

Who are we?

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 12

slide-15
SLIDE 15

The Australian Experimental HEP Data Grid Team

Who are we?

  • Physicists:
  • Experimental Particle Physics:

University of Melbourne

  • Falkiner High Energy Physics:

University of Sydney

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 12

slide-16
SLIDE 16

The Australian Experimental HEP Data Grid Team

Who are we?

  • Physicists:
  • Experimental Particle Physics:

University of Melbourne

  • Falkiner High Energy Physics:

University of Sydney

  • High Performance Computing:
  • Australian Partnership for Advanced Computing (APAC)
  • University of Melbourne
  • Australian National University (Canberra)
  • Victorian Partnership for Advanced Computing (VPAC)

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 12

slide-17
SLIDE 17

The Australian Experimental HEP Data Grid Team

Who are we?

  • Physicists:
  • Experimental Particle Physics:

University of Melbourne

  • Falkiner High Energy Physics:

University of Sydney

  • High Performance Computing:
  • Australian Partnership for Advanced Computing (APAC)
  • University of Melbourne
  • Australian National University (Canberra)
  • Victorian Partnership for Advanced Computing (VPAC)
  • Computer Scientists:
  • GRIDS Lab:

University of Melbourne

  • Computer Science:

Adelaide University

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 12

slide-18
SLIDE 18

Australian Experimental HEP Grid Activities?

Atlas

  • Participate in ATLAS Data Challenges
  • Participate in the deployment of the LCG tools

across APAC grid facilities in Australia.

  • LCG-2 toolkit
  • ATLAS application layer.
  • Implement an LCG Tier 2 in Australia

Belle

  • Introducing Grid techniques to:
  • Belle physics analysis
  • Monte Carlo generation

Funded by Australian Research Council, APAC and VPAC.

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 13

slide-19
SLIDE 19

Participation in ATLAS data challenges:

  • Data challenges being run by Advanced Research Computing group at

University of Melbourne:

  • Dirk van der Knijff, Robert Sturrock
  • Melbourne is a member of Nordugrid!!

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 14

slide-20
SLIDE 20

Deployment of LCG on Australian Data Grid

We plan to deploy the LCG infrastructure across the APAC national grid:

  • Across APAC, AC3, VPAC and UoM partner facilities.
  • Supported by APAC information infrastructure project
  • Will be used for next round of ATLAS data challenges
  • Build expertise in LCG toolkit amongst Australian grid community
  • Demonstration for future deployment of ATLAS Tier 2 centre

We will also deploy the ATLAS analysis software across these facilities. Establishment of ATLAS Tier 2 data centre Australia plans to host a Tier 2 data centre for ATLAS:

  • We will ask APAC to host and manage the facility:
  • as a reserved chunk of the national facility
  • We will apply to funding body in 2004
  • Considering shared facility with New Zealand CMS.

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 15

slide-21
SLIDE 21

The Belle Experiment

Belle commenced taking data in 1999:

  • Accelerator luminosity has increased continually since then
  • World record luminosity: 1.39 × 1034 fb−1
  • Has accumulated a data set of ≈ 1 Petabyte
  • Data set is increasing by 500 Gigabytes per day

Proposed Belle upgrade

  • Upgrade to 1 × 1035 fb−1
  • Increase data rate ≈ 10 times.

Clear benefits from a Belle data grid

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 16

slide-22
SLIDE 22

Current Australian Belle Grid Activities

Australian Belle Data Grid Testbed:

  • “Simple” Data Grid tools could provide real

benefits for Belle physicists now:

  • Data Catalogue (Replica Catalogue)
  • Network-aware scheduler

Initially (3 years ago), we aimed to:

  • Use standard middleware products wherever possible
  • Develop simple tools to fill the gaps
  • Start real data analysis ASAP

. The Belle Analysis Software: BASF

  • Enable BASF to read and write Grid URIs directly
  • Able to stream data across network
  • A simple solution which reduces need to stage data

Lyle Winton

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 17

slide-23
SLIDE 23

Belle data analysis demonstration at SC2003

The Global Data-Intensive Grid Collaboration http://gridbus.cs.mu.oz.au/sc2003/

  • 1,000,000 events analysed using Grid-enabled BASF
  • Gridbus broker discovered the

catalogued data (lfn:/users/winton/fsimddks/*.mdst) and:

  • decomposed into 100 Grid

jobs

  • nodes in Australia and Japan.
  • Optimised job assignment to

minimise:

  • data transmission time and
  • computation time.

Completed in 20 minutes.

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 18

slide-24
SLIDE 24

Collaboration with Belle and KEK laboratory

  • Recent collaboration between:
  • University of Melbourne
  • Australian National University Supercomputing Facility
  • KEK Computing Research Centre
  • Belle collaboration
  • Aims to provide a distributed data management solution for Belle:
  • Use Storage Resource Broker (SRB) for Belle data management
  • Federation between SRB servers at KEK, ANU SF and Melbourne.
  • Distribution of input and output data for current Belle mass simulated

data production.

  • Utilising computing resources from APAC, VPAC, AC3, UoM, ANU SF

. Running Australian Belle data simulation production now.

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 19

slide-25
SLIDE 25

A Belle Analysis Data Grid

  • We will use the SRB federation as the base for grid based data

processing of Belle data.

  • Collaboration with Bristol UK e-science group:
  • GMCat — RLS interface
  • Development of SRB-aware grid scheduler.
  • Identify location of resources, replicas from SRB Mcat
  • Despatch jobs according to globus hosts according to static network

model.

  • First multi-site test underway now:
  • after resolving firewall problems.

We will use this system for future Belle data simulation and analysis in Australia

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 20

slide-26
SLIDE 26

Future of Australia HEP Data Grid

  • Deploy Belle Monte Carlo production across APAC national data grid
  • Stronger collaboration with Belle colleagues in:
  • KEK, Taiwan, Korea, . . .
  • Evaluate LCG toolkit for Belle data grid
  • Deploy LCG toolkit across APAC national data grid
  • Build partnership to establish LCG Tier 2 site in Australia:
  • collaboration with Japan and Taiwan Tier 1 sites
  • Continue to participate in ATLAS data challenges

Be ready for 2007!

Glenn Moloney The Australian High Energy Physics Data Grid ISGC Taiwan July 2004 21