Status of the Australian Tier 2 Facility and Plans for SC4 Marco La - - PowerPoint PPT Presentation

▶

Feb 26, 2024 350 likes •529 views

Status of the Australian Tier 2 Facility and Plans for SC4 Marco La Rosa School of Physics, The University of Melbourne Melbourne, Australia mlarosa@physics.unimelb.edu.au Experimental High Energy Physics (HEP) in Australia University of

SLIDE 1

Status of the Australian Tier 2 Facility and Plans for SC4

Marco La Rosa

School of Physics, The University of Melbourne Melbourne, Australia

mlarosa@physics.unimelb.edu.au

SLIDE 2

Marco La Rosa ISGC 2006 who we are...

Experimental High Energy Physics (HEP) in Australia University of Melbourne University of Sydney 4 Academic Staff 5 Research Fellows 12 PhD students

Belle: KEK, Japan ATLAS: CERN, Switzerland

SLIDE 3

Marco La Rosa ISGC 2006 who we are...

Australian HEP Data Grid Team Physicists:

High Energy Physics:

University of Melbourne

High Energy Physics:

University of Sydney

Computer Scientists:

GRIDS Lab:

University of Melbourne

Computer Science:

University of Adelaide

High Performance Computing:

Australian Partnership for Advanced Computing (APAC)
Victorian Partnership for Advanced Computing (VPAC)
South Australian Partnership for Advanced Computing (SAPAC)
Advanced Computing and Communications Centre (ac3)
Advanced Research Computing (ARC)
Australian National University Supercomputing Facility (ANUSF)

SLIDE 4

Marco La Rosa ISGC 2006 who we are...

Some of the people...

Advanced Research Computing, The University of Melbourne, Melbourne

Dirk van der Knijff, Bryan Hellyer, Rob Sturrock

Victorian Partnership for Advanced Computing (VPAC), Melbourne

David Bannon, Damon Smith, Chris Samuel, Chris Kendrick, Graham Jenkins,

Brett Pemberton South Australian Partnership for Advanced Computing (SAPAC), Adelaide

Paul Coddington, Gerson Galang, Grant Ward

Australian Partnership for Advanced Computing (APAC), Canberra

Stephen McMahon, Ben Evans, Jason Ozolins, John Smylie

Advanced Computing and Communications Centre (ac3), Sydney

Youzhen Cheng, Frank Crawford

APAC National Grid Program

Rhys Francis, John O'Callaghan, Erica Stojanovich

Australian Advanced Research NETwork (AARNET)

George McLaughlin

SLIDE 5

Marco La Rosa ISGC 2006 Grid experience...

Grid Activities Belle

Introducing Grid techniques to:
Belle Physics analysis
Monte Carlo generation

Atlas

Participated in Atlas Data Challenges
Deploying an LCG Infrastructure in Australia
Preparing for SC4

Australian Partnership for Advanced Computing (APAC)

"Providing the advanced computing and grid infrastructure for eResearch" Infrastructure / Applications

Astronomy, Computational chemistry, Geosciences, Bioinformatics, Earth System Science, High Energy Physics

SLIDE 6

Marco La Rosa ISGC 2006 Grid experience...

Belle Analysis Data Grid

Grid Scheduler: GQSched

Task description, resource modelling, brokering, scheduling, dispatch
Globus 2 gatekeepers, LCG-2 Compute Element
Parametric sweep
Single job description, many job submissions
SRB interface
Belle data available through an SRB federation
Data staging (3 models)
Handled within job during execution (Uni Melb HPC)
Handled by a separate process on another job manager (VPAC)
Handled by a separate process on another PBS queue (SAPAC)

Belle Analysis Software Framework (BASF)

enabled to read / write Grid URIs directly, able to stream data across a network
New IO module for BASF: fpdagrid.so

Belle Testbed

IBM Asia-Pacific - 5 machines: Quad CPU 2.6 GHz, 70 GB disk,
5 sites: Melbourne x 2, Adelaide, Canberra, Sydney

SLIDE 7

Marco La Rosa ISGC 2006 Grid experience...

The Nordugrid Experience

We have participated in ATLAS Data Challenges 1 and 2

As a member of Nordugrid!!
Data challenges were ran by the Advanced Research Computing group at

The University of Melbourne

SLIDE 8

Marco La Rosa ISGC 2006 Grid experience...

Australian LCG Deployment

3 sites on the APAC National Grid Some Deployed as Xen Virtual Machines

LCG-2 Installation Course: KEK Data Grid Workshop, 2005

Prof. Watase, Dr. Iwai: KEK-CC
Prof. Sakamoto: U. Tokyo

SLIDE 9

a modest selected sample of Event Summary Data (ESD)
one third of the available Analysis Object Data (AOD)
a full copy of data TAG sample
Physics Group Derived Physics Data (DPD) samples according

to the groups' interest based on the LCG MoU 2007 2008 2009 2010 2011 2012 Disk (TB) 107 336 566 887 1208 1529 CPU(kSI2k) 243 703 1064 1739 2309 2879

Marco La Rosa ISGC 2006 Tier 2...

Australian Tier 2 – Future Plans

SLIDE 10

Marco La Rosa ISGC 2006 Tier 2...

Australian Tier 2 – Future Plans

Distributed Tier 2

Hardware infrastructure hosted by one of the

HPC facilities in addition to...

LCG (middleware) Infrastructure deployed at

partner computing facilities also contributing resources

SLIDE 11

Marco La Rosa ISGC 2006 Tier 2...

Australian Tier 2 – Initial Contribution

...to begin with, we're building a prototype Tier 2

charm cluster 40 CPUs, 1.6TB

SLIDE 12

Marco La Rosa ISGC 2006 Tier 2...

Australian Tier 2 – Initial Contribution ...but why a prototype?

SLIDE 13

Marco La Rosa ISGC 2006 Tier 2...

Funding and plans Coming to the end of a 5 year round of funding Applying for the next round of funding: do not have funding for the real facility yet

SLIDE 14

Marco La Rosa ISGC 2006 Tier 2...

The Big Bad Internet – at 10 Gb/s!

10 Gb / s

622 Mb / s

SLIDE 15

Marco La Rosa ISGC 2006 Tier 2...

Issues and concerns We understand the technology. We have the skills to deploy and manage it. We know how to use it.

Now we need to apply those skills. We need to develop an understanding of the

ISSUES WE WILL ENCOUNTER

in a real, live, production environment.

SLIDE 16

Marco La Rosa ISGC 2006 Tier 2...

Timeline

NOW

Site Functional Tests ASGCC Min Tsai, Jason Shih, Shuting Liao, Jinny Chien

SLIDE 17

The End

Thank You

Marco La Rosa mlarosa@physics.unimelb.edu.au http://epp.ph.unimelb.edu.au