GRID Deployment Status and Plan at KEK ISGC2007 Takashi Sasaki - - PowerPoint PPT Presentation

▶
grid deployment status and plan at kek
SMART_READER_LITE
LIVE PREVIEW

GRID Deployment Status and Plan at KEK ISGC2007 Takashi Sasaki - - PowerPoint PPT Presentation

Apr 09, 2023 440 likes •664 views

GRID Deployment Status and Plan at KEK ISGC2007 Takashi Sasaki KEK Computing Research Center Who we are? KEK (High Energy Accelerator Research Organization) Inter University Research Institute Corporation since 2004 National

slide-1
SLIDE 1

GRID Deployment Status and Plan at KEK

ISGC2007 Takashi Sasaki KEK Computing Research Center

slide-2
SLIDE 2

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 2

Who we are? KEK (High Energy Accelerator Research Organization)

Inter University Research Institute Corporation since 2004

National Institute previously Still 100% funded by the government

Mission

Carry out research related accelerator science Particle Physics, Material Science, Life Science and so on Supporting collaborating universities Universities have a freedom for the choice and they can be independent of us

slide-3
SLIDE 3

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 3

KEK

Nagoya U.

  • U. Tokyo

Tokyo Inst. of Tech. Tsukuba U. Osaka U. ICRR/Tpkyo Kyoto U. JAEA Tokai Waseda U. Hiroshima U Niigata U. Nara Women U. Osaka city U. Shinshu U. RIKEN Okayama U. Kobe U. Kanazawa U. Kamioka SuperSINET nodes SINET nodes

High Energy Physics in Japan

ATLAS at LHC CDF at FNAL KEK BELLE J-PARC KamLand SuperKamiokande

Tohoku U. Tokyo Metropolitan U.

Major High Energy Activities in Japan

Terminated in the JFY2005

K2K Experiment at Kamiokande and KEK

Active Experiments

Belle Experiment at KEK KamLAND at Kamioka CDF at FermiLab/USA

Under construction

J-PARC T2K Experiment at Tokai and Kamioka ATLAS and ALICE at LHC

Future Plan

SuperB Factory International Linear Collider (ILC)

HEPnet-J:

High Energy Physics Network in Japan

KEK provides the network facility, NEPnet-J,

  • n the SINET/SuperSINET (NII)。
slide-4
SLIDE 4

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 4

Tsukuba Tsukuba Tokai

High Energy Accelerator Research Organization High Energy Accelerator Research Organization High Energy Accelerator Research Organization

J J-

  • PARC

PARC B B-

  • Factory

Factory Photon Photon-

  • Factory

Factory LC LC-

  • Test Facility

Test Facility

Narita Airport

slide-5
SLIDE 5

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 5

KEKB e+ e- Collider KEKB e+ e- Collider

e+ source Ares RF cavity SCC RF(HER) ARES (LER)

3.5 GeV

e+

8 GeV

e-

B0J/ψKS B0J/ψKS

Observation of CPV in the B meson system Observation of CPV in the B meson system

Belle Experiment 13 countries, 57 institutes, ~400 collaborators

slide-6
SLIDE 6

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 6

Strategy on GRID deployment Highest priority is support on Belle and ILC

LCG deployment

Help Universities to start over R&D

Preparing for ILC

Japan has strong will to host ILC

NAREGI

Japanese flagship project on developing a GRID middleware May substitute LCG/gLite in the future GRID interoperability is the key

slide-7
SLIDE 7

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 7

LCG at KEK

Computer Systems related

Central Information System since Feb. 20. 2006

Central Computer System

■GRID System ■Mail System, etc.

B Factory Computer System since Mar. 23. 2006

CPU : 45,662 SI2K rate ■ Disk : 1 PB ■ Tape : 3.5 PB

1st Phase KEK Grid CA

approved by APGRID PMA and has been in operation since Jan. 2006. The third official Grid CA in Japan NAREGI CA software was modified to use at KEK. KEK employee and their collaborators are eligible for this service.

LCG and SRB for production usage are available on the GIRD System

not for public usage, but for supporting projects

WN: 36 nodes x 2 =72 CPU Storage: Disk (2TB) + HPSS(~200TB) Supported VO: Belle, APDG, Atlas_J

in operation since May 2006

2nd Phase since Jan. 2007, LCG is going to be deployed in the Belle production.

slide-8
SLIDE 8

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 8

LCG Sites at KEK LCG Sites at KEK

JP-KEK-CRC-01 JP JP-

  • KEK

KEK-

  • CRC

CRC-

  • 01

01

  • since Nov. 2005.

since Nov. 2005.

  • Site Role:

Site Role:

  • Experimental

Experimental

  • Resource and Component:

Resource and Component:

  • SL

SL-

  • 3.0.5 w/ gLite

3.0.5 w/ gLite-

  • 3.0 later

3.0 later

  • CPU: 14, Storage: ~1.5TB

CPU: 14, Storage: ~1.5TB

  • FTS, FTA, RB, MON, BDII, LFC, CE, SE

FTS, FTA, RB, MON, BDII, LFC, CE, SE

  • Supported

Supported VOs VOs: :

  • belle,

belle, apdg apdg, g4med, , g4med, ppj ppj, , dteam dteam, ops and ail , ops and ail

JP-KEK-CRC-02 JP JP-

  • KEK

KEK-

  • CRC

CRC-

  • 02

02

  • since early 2006.

since early 2006.

  • Site Role:

Site Role:

  • Production

Production

  • Resource and Component:

Resource and Component:

  • SL or SLC w/ gLite

SL or SLC w/ gLite-

  • 3.0 later

3.0 later

  • CPU: 48, Storage: ~1TB (w/o HPSS)

CPU: 48, Storage: ~1TB (w/o HPSS)

  • Full components

Full components

  • Supported

Supported VOs VOs: :

  • belle,

belle, apdg apdg, g4med, , g4med, atlasj atlasj, , ppj ppj, , ilc ilc, , dteam dteam, ops and , ops and ail ail

8 8

We depends on services by APROC members in ASGC, Taiwan. We depends on services by APROC We depends on services by APROC members in ASGC, Taiwan. members in ASGC, Taiwan.

slide-9
SLIDE 9

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 9

Belle GRID LCG services are provided by the Central Computer system Only storage system is used in B Factory computer system

Almost the same size of LHC tier-1 centers CPU’s are served in the future

JP-KEK-CRC-02 is the production site

Belle data is exported by SRB-DSI

Very useful to export existing data SRB-SRM is desirable still iRODs?

slide-10
SLIDE 10

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 10

LCG at KEK (2)

Data Trans in Belle Grid

CRC-01 CRC-02 HPSS Disk/HSM AS(Taiwan) Melbourne LCG/gLite LCG/gLite

SRB-DSI

B Factory-system

SRB MCAT

SRB server File servers WS Kracow CPUs SRB files Local files Nagoya Grid files Grid-system

slide-11
SLIDE 11

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 11

11 11

B Factory Computer System B Factory Computer System

‐ ‐ New B Factory Computer System since March 23. 2006 New B Factory Computer System since March 23. 2006 ‐ ‐ History of B Factory Computer System History of B Factory Computer System Moore’s Law: 1.5y=x2.0 4y=x~6.3 5y=x~10

slide-12
SLIDE 12

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 12

Total Number of Jobs at KEK in 2006 Total Number of Jobs at KEK in 2006

12 12

JP-KEK-CRC-01 JP JP-

  • KEK

KEK-

  • CRC

CRC-

  • 01

01 JP-KEK-CRC-02 JP JP-

  • KEK

KEK-

  • CRC

CRC-

  • 02

02

200 200 700 700 400 400 1,000 1,000 1,400 1,400 BELLE BELLE BELLE BELLE BELLE BELLE

slide-13
SLIDE 13

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 13

Total CPU Time at KEK in 2006 Total CPU Time at KEK in 2006 (Normalized by 1kSI2K) (Normalized by 1kSI2K)

13 13

JP-KEK-CRC-01 JP JP-

  • KEK

KEK-

  • CRC

CRC-

  • 01

01 JP-KEK-CRC-02 JP JP-

  • KEK

KEK-

  • CRC

CRC-

  • 02

02

4,000 4,000 3,000 3,000 1,000 [hrs kSI2K] 1,000 [hrs kSI2K] 12,000 12,000 10,000 10,000 4,000 4,000 BELLE BELLE BELLE BELLE BELLE BELLE

slide-14
SLIDE 14

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 14

JLCG Sponsored by the s-Science promotion program of National Institute of Informatics LCG federation among Japanese Universities and KEK

Nagoya: ATLAS, Belle University of Tohoku :ILC, KamLand University of Tsukuba :ATLAS, ILC Kobe University: ATLAS, ILC Hiroshima Institute of Tech.: ATLAS, Information science KEK: Belle, ILC, ATLAS…

KEK behaves as GOC

slide-15
SLIDE 15

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 15

NAREGI at KEK

NAREGI

National Research GRID Initiative

What we expect?

Better quality Better functionality

Job submissions with NAREGI is almost 3times faster than gLite3 now

Better support

We may substitute LCG/gLite with NAREGI if NAREGI works as advertised

GRID interoperability is the key

We are working together with NAREGI for this issue

Support on operation and application adoption is necessary

LCG is very excellent in support on deployment and operations

slide-16
SLIDE 16

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 16

NAREGI at KEK (2)

NAREGI-beta test bed

6nodes+3nodes(DG)

Installation Naregi-beta 1.0 : Nov. 2006 Information, PSE, WFT, GVS Naregi-DG : Feb 2007

Test by Application P152 (Heavy ion) experiment

Data analysis data processing, then stored the results to SRB through SRB-DSI gate way

Belle event simulation

We found several inconvenient differences between gLite and NAREGI ask NAREGI group to improve

nrg05 nrg00 nrg03 nrg01 nrg09 nrg02 nrg04

Portal node: Super Scheduler:SS Inforamtion Server:IS Grid VM Sever:GVM GridVM engine node-1 GridVM engine node-2 User Manag. Serv.: VOMS

nrg10 nrg11

Gfarm FS DG MCS

(Metadata)

DG RMS

(Resource Manag.)

slide-17
SLIDE 17

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 17

GRID at KEK GRID environment at KEK

gLite/ CRC-01 gLite/ CRC-02 HPSS gLite/EGEE gLite/EGEE

SRB-DSI

SRB MCAT

SRB server CPUs SRB files Local files Grid files Naregi-kek 2007.2.9

slide-18
SLIDE 18

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 18

Plan More production use of LCG

Belle

Collaboration with ASGC, National Central Univeristy(Taiwan), U. of Melborne, Krakow and so on

ILC GRID

Collaboration with CC-IN2P3 Start with CALICE

NAREGI-LCG(gLite) interoperability

More tests locally and discussion with NAREGI

Seeking a possible scenario to have a tier-1 center in Japan in the future (2012?)

Good practice for hosting the tier-0 center of ILC

slide-19
SLIDE 19

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 19

Collaboration in Asia Pacific Belle GRID was established by the collaboration of people in Asia Pacific

  • ASGC. KNU Korea, NCU Taiwan and U. of Melbourn

We depends on efforts of ASGC very much for the

  • peration of LCG

We sent our stuffs to ASGC for their training

We seek further collaboration in this region

LCG operation Anyone who has interests in NAREGI deployment? (anybody, not only people in this region)

slide-20
SLIDE 20

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 20

Summary

KEK Grid CA (member of APGRID PMA) LCG

JP-KEK-CRC-01 and 02

Belle Experiment

B Factory Computer System

Size ： Tier1 level

LCG deployment

share the simulation data among the collaborating institutions near future: share the experimental data and mutual job submission

JLCG

Tohoku U. / Tsukuba U./ Kobe U./ Hiroshima Tech. / Nagoya U. / KEK

NAREGI at KEK

NAREGI-beta Test bed Test by the data analysis program Usage of SRB through SRB-DSI Installation of NAREGI-DG in progress

From now on

Test of NAREGI-DG Test of Interoperability between gLite and NAREGI

slide-21
SLIDE 21

ISGC2007 27/MAR/2007 Takashi.Sasaki@kek.jp 21

Acknowledgements We thank ASGC for their great support on the LCG/gLite operation A.E. Chen, Hide Nakazawa (NCU Taiwan), Glenn Moloney, Marco La Rosa (U. of Melbourne), Simon Lin and his stuffs at ASGC helped us for Belle GRID. We appreciate very much for them. We thank people in NAREGI for their supports on us