IN2P3 activities in Worldwide LHC Computing Grid (WLCG) Frdrique - - PowerPoint PPT Presentation

▶
in2p3 activities in worldwide lhc computing grid wlcg
SMART_READER_LITE
LIVE PREVIEW

IN2P3 activities in Worldwide LHC Computing Grid (WLCG) Frdrique - - PowerPoint PPT Presentation

Nov 28, 2022 121 likes •447 views

IN2P3 activities in Worldwide LHC Computing Grid (WLCG) Frdrique Chollet (IN2P3-LAPP, Annecy) on behalf of the LCG-France project Fairouz Malek, Fabio Hernandez LCG-France Scientific and Technical project leaders Dom inique Boutigny IN2P3

slide-1
SLIDE 1

IN2P3 activities in Worldwide LHC Computing Grid (WLCG)

Frédérique Chollet (IN2P3-LAPP, Annecy)

  • n behalf of the LCG-France project

Fairouz Malek, Fabio Hernandez

LCG-France Scientific and Technical project leaders

Dom inique Boutigny IN2P3 Computing Centre Director

ISCG2006, Taipei, May 2006

slide-2
SLIDE 2
  • F. Chollet IN2P3 – LAPP – Annecy, France

2

Contents

  • Context : WLCG and EGEE
  • LCG-France Project
  • LCG-France Contribution
  • Collaborating to EGEE/LCG

activities

  • Future Work
slide-3
SLIDE 3
  • F. Chollet IN2P3 – LAPP – Annecy, France

3

Worldwide LHC Computing Grid

  • Goal : set up the global data storage and analysis infrastructure for the

entire High Energy Physics community

  • Large Hadron Collider (LHC) currently being built at CERN, begins
  • peration in 2007
  • Funding Principle : LHC computing resources

will not be centralised at CERN

  • A data handling problem

15 Petabytes of data /year four–tiered data distribution model Challenge for 100 sites in 20 countries Service hierarchy over

Tier 0 : CERN Tier-1 : Large centres Federation of smaller Tier-2s centres

  • Website : http://lcg.web.cern.ch/LCG/
slide-4
SLIDE 4
  • F. Chollet IN2P3 – LAPP – Annecy, France

4

EGEE

  • EU supported project
  • Goal : build a large-scale production-quality

infrastructure for e-Science

  • EGEE II : Natural continuation of the project’s first

phase

1 April 2006 – 31 March 2008 91 partners in 32 countries 10 applications from 7 scientific domains Sustained 10,000 jobs/day

  • Pilot applications

High-Energy Physics & Biomedical Applications Similar computing and data storage requirements Additional challenge for Biomedical : security & privacy

  • EGEE Website http://www.eu-egee.org
slide-5
SLIDE 5
  • F. Chollet IN2P3 – LAPP – Annecy, France

5

LCG-France Project

  • French Initiative dedicated to LHC computing
  • Partners : High Energy Physics actors
  • Aims :

provide a funded Tier 1 centre and an Analysis facility in CC-IN2P3, Lyon supporting the 4 LHC experiments promote the emergence of Tier 2 centres

With help of Regional funding agencies, Universities…

establish collaboration with others Tier 1 and Tier 2 sites make agreements on International MoU commitments with WLCG project

slide-6
SLIDE 6
  • F. Chollet IN2P3 – LAPP – Annecy, France

6

LCG-France Partners

  • IN2P3: National Institute of

Nuclear Physics and Particle Physics of the National Centre for Scientific Research (CNRS)

  • Mission: promote and

federate research in Particle Physics

  • 2400+ people of whom 800+

permanent scientists

  • 18 laboratories
  • CEA-DAPNIA : Atomic Energy

Commission (CEA)

  • Shared CC-IN2P3 computing

centre in Lyon

slide-7
SLIDE 7
  • F. Chollet IN2P3 – LAPP – Annecy, France

7

LCG-France Organization

Project Management Board Scientific project leader Technical project leader Management representatives

LHC Applications Group LHC Applications Group CC- IN2P3 Director CC- IN2P3 Director LCG Tier-1 Team Grid Operations & Support LCG Tier-1 Team Grid Operations & Support Tier-2 Tier-2

Tier-2 Tier-2

Tier-2 Tier-2 WLCG project Tier 1 centres

CB, POB, MB, GDB

Overview Board

Scientific Projet leader : Fairouz Malek (IN2P3/LPSC) Technical Project Leader : Fabio Hernandez (CC-IN2P3) Technical coordinator for Tier2 and Tier3 : Frédérique Chollet (IN2P3/LAPP)

LCG-France Website http://lcg.in2p3.fr

slide-8
SLIDE 8
  • F. Chollet IN2P3 – LAPP – Annecy, France

8

LCG-France Services Hierarchy

ASCC/Taipei RAL/UK CCIN2P3/FR TRIUMF/CA GridKa/DE CNAF/IT PIC/SP BNL/US Tier Tier-

Tier Tier-

  • 1s

1s

USC Krakow CIEMAT Rome Taipei Canada CSCS UB IFCA IC MSU IN2P3-LPC IFIC

Tier Tier-

  • 2s

2s Tier Tier-

  • 3 Centres

3 Centres

GRIF IN2P3-Subatech

SARA/NL

LAPP CPPM ...

10 Gbit link Optical Private Network General purpose Research Network

slide-9
SLIDE 9
  • F. Chollet IN2P3 – LAPP – Annecy, France

9

LCG France Contribution to Grid Infrastructure

  • LHC Grid Computing relies on the grid infrastructures

provided by EGEE (Europe and Asia Pacific) and Open Science Grid (USA)

T1+AF

T1 + Analysis f acilit y

  • CC-I N2P3, Lyon

T2

  • GRI F, I le de France
  • LPC, Clermont
  • Subat ech, Nant es

T3

  • LAPP – Annecy
  • CPPM – Marseille
slide-10
SLIDE 10
  • F. Chollet IN2P3 – LAPP – Annecy, France

10

LCG-France Network Connectivity

  • Optical circuits Lyon

– Geneva

10 Gb/s Operated by RENATER French NREN Operational since jan 2006

  • Tier-2s connectivity

through RENATER

1 Gb/s

slide-11
SLIDE 11
  • F. Chollet IN2P3 – LAPP – Annecy, France

11

LCG-France T1 Contribution

MSS

90% 10%

Other Tier-1 CC-IN2P3

DISK

88% 12%

CPU

88% 12%

  • Global requested Computing Resources
  • Contribution of the French Tier-1 (CC-IN2P3)

Source: Draft W-LCG Memorandum of Understanding - Nov. 16th 2005

CERN (T0 + AF)

All Tier-1s All Tier-2s Total

CPU (SpecInt2000)

25 M 56 M 61 M 142 M

Disk (PB)

7 31 19 57

Mass Storage (PB)

18 35 53 For all experiments in 2008

slide-12
SLIDE 12
  • F. Chollet IN2P3 – LAPP – Annecy, France

12

LCG-France T1 Contribution (cont.)

  • French Tier-1 contribution per LHC experiment

0% 5% 10% 15% 20% 25% 30% CPU 9% 13% 10% 27% Disk 8% 12% 11% 27% MSS 8% 13% 7% 26% Alice Atlas CMS LHCb

slide-13
SLIDE 13
  • F. Chollet IN2P3 – LAPP – Annecy, France

13

LCG-France T2 Contribution

  • 3 Tier-2s :

GRIF Ile de France LPC Clermont-Ferrand Subatech Nantes

  • Role :

Production of simulated data General end-user analysis (batch and interactive mode) Provision of managed disk storage

GRIF LPC Subatech Total

CPU (SpecInt2000)

1120 k 300 k 200 k 1,62 M 341

Disk (TB)

296 25 20

LHC Experiments

Atlas,LHCb, CMS, Alice Atlas,LHCb, Alice Alice

For all experiments in 2008

slide-14
SLIDE 14
  • F. Chollet IN2P3 – LAPP – Annecy, France

14

LCG-France T2 contribution (cont.)

  • GRIF (Ile de France) Grille de Recherche Ile de France

Scientific Projet leader: J.-P. Meyer

(CEA/DAPNIA)

Technical Project Leader : M. Jouvin

(IN2P3/LAL) Website :http://ww.grif.fr

Tier 2 facility for Paris Region : Federation open to the 4 LHC experiments and other EGEE user communities (VOs) a joint project of several laboratories : DAPNIA (CEA), IPNO (IN2P3, Orsay), LAL (IN2P3, Orsay), LLR (Ecole Polytechnique, Palaiseau) and LPNHE (IN2P3,Paris 6/7) a unique resource distributed over several sites (Global

configuration consistency assumed by Quattor)

Current aggregated resources for LCG: CPUs (120 kSI2k), Disk 32 TB

slide-15
SLIDE 15
  • F. Chollet IN2P3 – LAPP – Annecy, France

15

LCG-France T2 contribution (cont.)

  • LPC (Clermont-Ferrand ) Laboratoire de Physique Corpusculaire

@ Ville de Clermont-Ferrand

Scientific Projet leader: D.Pallin

(IN2P3/LPC)

Technical Project Leader : J.C Chevaleyre

(IN2P3/LPC) Websites : http://clrwww.in2p3.fr - http://www.auvergrid.fr

Very active partner of Biomedical applications within EGEE Success Story : speed up of Malaria drug discovery Support for LHC and Computing Platform for Life Science AuverGrid : Regional Grid in Auvergne around LPC Clermont-Ferrand is also one of the main nodes providing resources to the biomedical virtual organization in EGEE. Current resources for LCG: CPUs (200 kSI2k), Disk 25TB

slide-16
SLIDE 16
  • F. Chollet IN2P3 – LAPP – Annecy, France

16

LCG-France T2 contribution (cont.)

  • Subatech (Nantes ) Laboratoire de Physique Subatomique et des

Technologies Associées

Scientific Projet leader: L. Aphecetche Technical Project Leader : JM. Barbet Tier 2 facility for Alice experiment only

Website : http://www-subatech.in2p3.fr/

Current resources : CPUs (20 kSI2k), Disk 4 TB

slide-17
SLIDE 17
  • F. Chollet IN2P3 – LAPP – Annecy, France

17

Collaborative Activities

  • Validation Program : Series of Service Challenges

for validating

Infrastructure Middleware services Operational procedures Integration of experiment software with generic middleware…

  • Contribution to Global Grid Operations of EGEE

Process Infrastructure

« True collaboration as all Tier-1s, federations and

Regional Operations Centres are involved »

slide-18
SLIDE 18
  • F. Chollet IN2P3 – LAPP – Annecy, France

18

SC4 Validation Program

  • SC4 started 1rst of April 2006

Sustained Data Distribution rates CERN Tier-1s Services ramped up to target levels of reliability and end-to-end performance Full demonstration of experiment offline chain

  • Extension of the service to Tier-2 sites

first step …provision of

managed, grid enabled disk storage (SRM) network connectivity (at least 1GB/s)

But also…exercise the sharing of responsibilities

LCG-France Technical Tier-2s and Tier-3s coordination started on the 1rst of April as well Tier-2s Workshop 12-16 Jun at CERN

  • Jun-Sep 2006 – SC4 – pilot service
slide-19
SLIDE 19
  • F. Chollet IN2P3 – LAPP – Annecy, France

19

SC4 Validation Program

  • Tier0 Tier1 : Disk (CERN) to disk (CC-IN2P3)

Target: 200 MB/sec

slide-20
SLIDE 20
  • F. Chollet IN2P3 – LAPP – Annecy, France

20

SC4 Validation Program

  • Tier0 Tier1 : Disk (CERN) to tape (CC-IN2P3)

Target: 75 MB/sec

slide-21
SLIDE 21
  • F. Chollet IN2P3 – LAPP – Annecy, France

21

EGEE Grid Operations

  • EGEE Operations process &

infrastructure

Started November 2004 There is no “central” operation but 6 teams working in weekly rotation

CERN, IN2P3, CNAF, RAL, Russia,Taipei

Monitoring and alarm management tools developed and hosted at different sites

GOC DB (RAL), SFT (CERN), GStat (Taipei), GGUS (FZK)

  • Putting all together…
slide-22
SLIDE 22
  • F. Chollet IN2P3 – LAPP – Annecy, France

22

LCG-France contribution to EGEE Operations Process & Infrastructure

  • LCG-France sites within the

EGEE Operations Infrastructure

Resource Centres (RC)

1 Tier-1, 3 Tier-2s, 2 Tier-3s for now Non LHC EGEE sites

CC-IN2P3 in Lyon is french Regional Operations Centres (ROC) and Core Infrastructure Center (CIC) or Super ROC

  • CIC Web portal developed

and operated by CC-IN2P3

Integrating all the tools and sources of

  • perations-related information into one

single place : http://cic.in2p3.fr/

slide-23
SLIDE 23
  • F. Chollet IN2P3 – LAPP – Annecy, France

23

Future Work

  • Within LCG-France :

Resources and services

provision and reliable operating

Tier-1 – Tier-2s integration Enhance collaboration between sites experts and experiment representatives

  • Working together with

experiences

Experiment computing models define specific data flows between Tier-1s and Tier-2s

Tier-1 Tier-1 Tier-1 Tier-1

Tier-2 Tier-2 Tier-2 Tier-2

slide-24
SLIDE 24
  • F. Chollet IN2P3 – LAPP – Annecy, France

24

Conclusions

  • LCG-France project managed by IN2P3

Good contributions between partners Tier-1 and Analysis Facility set-up in Lyon is underway Additional resources coming from Tier-2s & even Tier-3 initiatives

Not in competition with Tier-1 funding

  • LCG France is working a National Project driven by

LHC Computing needs

commited to the success on a worldwide scale of WLCG and EGEE

slide-25
SLIDE 25
  • F. Chollet IN2P3 – LAPP – Annecy, France

25

To know more…

  • CC-IN2P3 http://cc.in2p3.fr
  • LCG-France http://lcg.in2p3.fr
  • LCG/EGEE Operations Portal http://cic.in2p3.fr/
slide-26
SLIDE 26
  • F. Chollet IN2P3 – LAPP – Annecy, France

26

Thanks

Thank you for your attention Many thanks to Dr. Simon C.Lin and Academia Sinica for their kind invitation and hospitality

slide-27
SLIDE 27
  • F. Chollet IN2P3 – LAPP – Annecy, France

27

Backup Slides

slide-28
SLIDE 28
  • F. Chollet IN2P3 – LAPP – Annecy, France

28

IN2P3 Computing Centre

  • Data processing facility, not located in an

experimental site

  • Mission
  • mass storage repository
  • high-throughput computing facilities
  • network services for the whole institute
  • consulting and training services for laboratories
  • web hosting, video-conferencing, e-mail

infrastructure, news, …

  • 24x7 service
  • Users
  • 1800+ users from IN2P3 and DSM-CEA

(Atomic Energy Commission) and from abroad

  • 35+ international collaborations in nuclear

physics, particle physics and astrophysics

  • since 2002 serving also bio-medical

applications

  • Human resources
  • 60 people
slide-29
SLIDE 29
  • F. Chollet IN2P3 – LAPP – Annecy, France

29

IN2P3 Computing Centre (cont.)

slide-30
SLIDE 30
  • F. Chollet IN2P3 – LAPP – Annecy, France

30

IN2P3 Computing Centre (cont.)

  • Compute services

1.7M SpecInt2000 (~1600 CPUs) Linux (most), AIX, SunOS 2500+ simultaneous jobs 15.000+ jobs in queue

  • Data storage: disk

~350 TB Not including local disk of compute nodes

  • Data storage: tape

Main scientific data storage medium 36.000 cartridges on-line (6 silos StorageTek automated tape library) mixture of 20GB and 200 GB cartridges

1300+ TB

150.000 cartridges in the vault

slide-31
SLIDE 31
  • F. Chollet IN2P3 – LAPP – Annecy, France

31

IN2P3 Computing Centre (cont.)

  • Compute services

1.7M SpecInt2000 (~1600 CPUs) Linux (most), AIX, SunOS 2500+ simultaneous jobs 15.000+ jobs in queue

  • Data storage: disk

~350 TB Not including local disk of compute nodes

  • Data storage: tape

Main scientific data storage medium 36.000 cartridges on-line (6 silos StorageTek automated tape library) mixture of 20GB and 200 GB cartridges

1300+ TB

150.000 cartridges in the vault