The Grid in China The Grid in China ISGC 2008 ISGC 2008 Taipei, - - PowerPoint PPT Presentation

▶
the grid in china the grid in china
SMART_READER_LITE
LIVE PREVIEW

The Grid in China The Grid in China ISGC 2008 ISGC 2008 Taipei, - - PowerPoint PPT Presentation

Nov 10, 2022 475 likes •884 views

The Grid in China The Grid in China ISGC 2008 ISGC 2008 Taipei, 10/April/2008 Taipei, 10/April/2008 Gang CHEN Gang CHEN Institute of High Energy Physics Institute of High Energy Physics Chinese Academy of Sciences Chinese Academy of

slide-1
SLIDE 1

The Grid in China The Grid in China

ISGC 2008 ISGC 2008 Taipei, 10/April/2008 Taipei, 10/April/2008 Gang CHEN Gang CHEN

Institute of High Energy Physics Institute of High Energy Physics Chinese Academy of Sciences Chinese Academy of Sciences

slide-2
SLIDE 2

Gang Chen/CC/IHEP 10-April-2008 - 2

Agenda Agenda

  • CNGrid

CNGrid (China National Grid) (China National Grid)

  • ChinaGrid

ChinaGrid (China Education and Research Grid) (China Education and Research Grid)

  • CROWN

CROWN (China Research and development (China Research and development environment Over Wide environment Over Wide-

  • area Network )

area Network )

  • HEP Grid/WLCG

HEP Grid/WLCG

slide-3
SLIDE 3

Gang Chen/CC/IHEP 10-April-2008 - 3

Major Grid Projects in China Major Grid Projects in China

  • China National Grid

China National Grid

  • Supported by the National High

Supported by the National High-

  • tech R&D Program

tech R&D Program

  • ChinaGrid

ChinaGrid

  • Supported by the Ministry of Education

Supported by the Ministry of Education

  • CROWN

CROWN

  • Supported by the National Science Foundation of

Supported by the National Science Foundation of China China

slide-4
SLIDE 4

Gang Chen/CC/IHEP 10-April-2008 - 4

China National Grid ( China National Grid (CNGrid CNGrid) )

slide-5
SLIDE 5

Gang Chen/CC/IHEP 10-April-2008 - 5

Overview of Overview of CNGrid CNGrid

  • Key project supported by the

Key project supported by the National High National High-

  • Tech R&D Program

Tech R&D Program

  • 4

4-

  • year effort

year effort

  • May 2002 to Dec. 2005

May 2002 to Dec. 2005

  • 100 million RMB government funding from the

100 million RMB government funding from the MoST MoST

  • More than 2

More than 2Χ Χ associated funds from local associated funds from local government, application organizations, and government, application organizations, and industry industry

slide-6
SLIDE 6

Gang Chen/CC/IHEP 10-April-2008 - 6

Major tasks of the project Major tasks of the project

  • Developing a test

Developing a test-

  • bed for the new information

bed for the new information infrastructure infrastructure— —China National Grid ( China National Grid (CNGrid CNGrid) )

  • Developing a 4TFlops high performance computer for

Developing a 4TFlops high performance computer for the grid the grid

  • Developing a set of grid software to support grid

Developing a set of grid software to support grid applications and grid operation and management applications and grid operation and management

  • Developing several application grids

Developing several application grids

  • Productive systems

Productive systems

  • Demonstration of the future grid applications

Demonstration of the future grid applications

slide-7
SLIDE 7

Gang Chen/CC/IHEP 10-April-2008 - 7

CNGrid CNGrid infrastructure infrastructure

  • Major nodes:

Major nodes:

  • CNIC, CAS, Beijing

CNIC, CAS, Beijing

  • Shanghai Supercomputer Center, Shanghai

Shanghai Supercomputer Center, Shanghai

  • Standard nodes:

Standard nodes:

  • Tsinghua

Tsinghua University, Beijing University, Beijing

  • Institute of Applied Physics and computational Mathematics,

Institute of Applied Physics and computational Mathematics, Beijing Beijing

  • University of Science and Technology of China,

University of Science and Technology of China, Hefei Hefei

  • Xi

Xi’ ’an an Jiaotong Jiaotong University, University, Xi Xi’ ’an an

  • NUDT,

NUDT, Changsha Changsha

  • Hong Kong University,

Hong Kong University, Hongkong Hongkong

  • CNGrid

CNGrid Operation Center Operation Center

  • The

The CNGrid CNGrid Operation Center, CNIC, CAS Operation Center, CNIC, CAS

slide-8
SLIDE 8

Gang Chen/CC/IHEP 10-April-2008 - 8

CNGrid nodes locations

Hefei Xi’an Beijing Changsha Shanghai Hong Kong

slide-9
SLIDE 9

Gang Chen/CC/IHEP 10-April-2008 - 9

Agora Service GOS Hosting Env. Core Level Services Authorization Engine Grip Service Servlet Based Scalable Grid Portal Engine User Customized Applications Grid Apps Core APIs Core Libraries(Grip, Agora, Router, AC Handling, Core Exception Handling) Agora AA Grip Container Multi-Grained Resource AC Policy Mgmt. User Mgmt. Engine Acct. Authentication Acct. Approve Profile Role Based

  • Acct. Mgmt.

Resource Mgmt. Engine Service Addr. and PortType Mapping Service Info Mgmt.

Service Invocation

Addr. Trans. Grip Ctrl. Structure User Interaction Result Caching Grip State Mgmt.

Service Locating(Global) Service Info. Mgmt. (Local) Java J2SE, J2EE/Microsoft Windows Tomcat (Apache) WebSphere (IBM) WebLogic (BEA) .NET (Microsoft) GT4 (Globus)

Core Exceptions

System and Application Libraries(Core Based Functional APIs and Exception Handling)

Extended System Services Information(MetaX) Services MetaDB Service MetaSys Service

Naming

File AC Mgmt.

Replica Mgmt.

MetaFile Service

Meta Info Mgmt. Quota Mgmt.

etc. Batch Service Workflow Service etc. User APIs System Level Services

App Level Services Proxy Cert.

Build-in Utility Collection Extended Utilities Grid Portal Application Logic by Web Pages

CA& Certificates

  • Mgmt. Service

Base Services Dymaic Deploy Service

System Monitoring Service Logging& Auditing Service

File Service Database Service Messaging Service GIS Service Router Service OMII

CNGrid CNGrid GOS architecture GOS architecture

slide-10
SLIDE 10

Gang Chen/CC/IHEP 10-April-2008 - 10

Support applications Support applications

Bioinfor- matics Geo- survey Manufacture & Simulation Weather forecast

slide-11
SLIDE 11

Gang Chen/CC/IHEP 10-April-2008 - 11

CNGrid CNGrid Applications Applications

  • Applications from selected areas

Applications from selected areas

  • Resource and Environment

Resource and Environment

  • NGG: National Geological Survey Grid

NGG: National Geological Survey Grid

  • DFG:

DFG: Digital Forestry Grid

Digital Forestry Grid

  • SeisGrid

SeisGrid: Petroleum Seismic Exploration : Petroleum Seismic Exploration

  • Research

Research

  • SDG: Scientific Data Grid

SDG: Scientific Data Grid

  • BAGrid

BAGrid: : Bioinformatics

Bioinformatics Applied Grid Applied Grid

  • DDG: Drug Discovery Grid

DDG: Drug Discovery Grid

  • Services

Services

  • CMAG: China Meteorological Application Grid

CMAG: China Meteorological Application Grid

  • TIG: Traffic Information Grid

TIG: Traffic Information Grid

  • Manufacturing

Manufacturing

  • AviGrid

AviGrid: Aviation Grid : Aviation Grid

  • SimGrid

SimGrid

slide-12
SLIDE 12

Gang Chen/CC/IHEP 10-April-2008 - 12

NGG NGG

  • Undertaken by China National Geological

Undertaken by China National Geological Survey Bureau Survey Bureau

  • Nation

Nation-

  • wide productive grid

wide productive grid

  • Data exchange and sharing by services

Data exchange and sharing by services

  • Grid

Grid-

  • enabled resource evaluation

enabled resource evaluation

  • Shorten the evaluation time from 3

Shorten the evaluation time from 3 years to 3 months years to 3 months

  • Achievements

Achievements

  • North China ground water resources evaluation

North China ground water resources evaluation

  • Mineral resources evaluation

Mineral resources evaluation

slide-13
SLIDE 13

Gang Chen/CC/IHEP 10-April-2008 - 13

CNGrid CNGrid (2006 (2006-

  • 2010)

2010)

  • HPC Systems

HPC Systems

  • 100

100 Tflop Tflop/s by 2008, /s by 2008,

  • Pflop

Pflop/s by 2010 /s by 2010

  • Grid Software:

Grid Software: CNGrid CNGrid GOS GOS

  • Merge with international efforts

Merge with international efforts

  • Emphasize

Emphasize matureness matureness

  • CNGrid

CNGrid Environment Environment

  • Nodes, Centers, mgt

Nodes, Centers, mgt

  • Applications

Applications

  • Research

Research

  • Resource & Environment

Resource & Environment

  • Manufacturing

Manufacturing

  • Services

Services

slide-14
SLIDE 14

Gang Chen/CC/IHEP 10-April-2008 - 14

China Education and Research China Education and Research Grid Grid ( (ChinaGrid ChinaGrid) )

slide-15
SLIDE 15

Gang Chen/CC/IHEP 10-April-2008 - 15

ChinaGrid ChinaGrid

  • Funded by Ministry of Education

Funded by Ministry of Education

  • Based on CERNET (China Education and

Based on CERNET (China Education and Research Network) Research Network)

  • First Phase

First Phase

  • 2003

2003-

  • 2005

2005

  • 12 key universities as initiative

12 key universities as initiative

  • More than 6Tflops w/60TB

More than 6Tflops w/60TB

  • 20 key universities by the end of 2004

20 key universities by the end of 2004

slide-16
SLIDE 16

Gang Chen/CC/IHEP 10-April-2008 - 16

ChinaGrid Supporting Platform

slide-17
SLIDE 17

Gang Chen/CC/IHEP 10-April-2008 - 17

Main Research Tasks

  • Campus grid platform
  • Common platform for ChinaGrid
  • Grid application platform and

representative

  • Grid applications
  • Image processing grid
  • Bioinformatics grid
  • Course on-line grid
  • Computational fluid dynamic grid
  • Large scale information processing grid
slide-18
SLIDE 18

Gang Chen/CC/IHEP 10-April-2008 - 18

China Research and China Research and development environment Over development environment Over Wide Wide-

  • area Network

area Network (CROWN) (CROWN)

slide-19
SLIDE 19

Gang Chen/CC/IHEP 10-April-2008 - 19

The Research Program The Research Program

  • NSFC_Grid: (3yrs, 2004

NSFC_Grid: (3yrs, 2004-

  • 2006)

2006)

  • Network

Network-

  • based R&D Environment (E

based R&D Environment (E-

  • Science Project in China)

Science Project in China)

  • Beihang

Beihang U., & ICT,CAS U., & ICT,CAS

  • CROWN:

CROWN: C China hina R Research and Development esearch and Development Environment Environment O Over ver W Wide ide-

  • area

area N Network etwork

  • 2004

2004 – – 2006, National Science Foundation of China (NSFC) 2006, National Science Foundation of China (NSFC)

  • By top 5 universities and institutes in China

By top 5 universities and institutes in China

  • Beihang

Beihang U. is the team leader.

  • U. is the team leader.
  • Goal:

Goal: Providing Grid Providing Grid-

  • enabled research

enabled research environment for scientists environment for scientists

  • Provide a middleware suit for Service

Provide a middleware suit for Service-

  • based Grid computing

based Grid computing

  • Build a

Build a testbed testbed for Grid technologies and Grid researcher for Grid technologies and Grid researcher

  • Provide an easy

Provide an easy-

  • to

to-

  • use Service Repository for E

use Service Repository for E-

  • Science community in

Science community in China China

slide-20
SLIDE 20

Gang Chen/CC/IHEP 10-April-2008 - 20

Basic Idea of CROWN Basic Idea of CROWN

CROWN Portal

Resource Resource Resource Service Service Service Applications Applications Applications Service Service Service Service

Service Overlay Network Security Architecture Quality of Service

Service Provision & Resource Mngt. Overlay-based Service Management Service Composition & Workflow Job Mngt, Matchmaking & Scheduling Trustworthy computing For distributed env. Programming modal & application integration QoS-enabling technology (Reservation and Agreement-based mngt)

slide-21
SLIDE 21

Gang Chen/CC/IHEP 10-April-2008 - 21

CROWN Portal CROWN Portal

  • Portal: A JSP

Portal: A JSP-

  • based Web Interface

based Web Interface

  • User Registration

User Registration

  • Application Integration & User Job Submission

Application Integration & User Job Submission

slide-22
SLIDE 22

Gang Chen/CC/IHEP 10-April-2008 - 22

Testbed Testbed

Beijing Hong Kong Changsha Chongqing

CROWN CROWN Testbed Testbed (2005) (2005)

8 Sites, 4 Cities are connected using existing network 8 Sites, 4 Cities are connected using existing network infrastructure infrastructure

Beihang University CNIC, CAS Peking University Tsinghua University LASG, CAS Chongqing University National University of Defense Technology HKUST: Hong Kong University of Science & Technology

slide-23
SLIDE 23

Gang Chen/CC/IHEP 10-April-2008 - 23

Testbed Testbed

Beijing Hong Kong Changsha Chongqing

Beihang University CNIC, CAS Peking University Tsinghua University LASG, CAS Chongqing University National University of Defense Technology HKUST: Hong Kong University of Science & Technology

CROWN CROWN Testbed Testbed (2006) (2006)

Deploy CROWN onto Deploy CROWN onto CNGRID Nation wide CNGRID Nation wide Testbed Testbed

Xi’an Hefei Shanghai

China University of Science & Technology Shanghai Super Computing Centre Shanghai Jiaotong University Xi’an Jiaotong University

slide-24
SLIDE 24

Gang Chen/CC/IHEP 10-April-2008 - 24

Pilot Applications Pilot Applications

  • Bioinformatics

Bioinformatics: :

  • BLAST: Basic Local Alignment Search Tool

BLAST: Basic Local Alignment Search Tool

  • Cap3:

Cap3: A DNA sequence assembly program A DNA sequence assembly program

  • Genscan

Genscan: Identification of complete gene : Identification of complete gene structures in genomic DNA. structures in genomic DNA.

  • …

…

  • Atmospheric applications

Atmospheric applications

  • Climate simulation for past

Climate simulation for past 1000 years 1000 years

  • AREM

AREM

  • Regional

Regional Eta Eta-

  • coordinate numerical prediction model

coordinate numerical prediction model

  • Rain or storm predication

Rain or storm predication

slide-25
SLIDE 25

Gang Chen/CC/IHEP 10-April-2008 - 25

Rainfall Forecast Rainfall Forecast

slide-26
SLIDE 26

Gang Chen/CC/IHEP 10-April-2008 - 26

Pilot Applications Pilot Applications

  • SDG: Scientific Data Grid

SDG: Scientific Data Grid

  • Share scientific data from all institutes of

Share scientific data from all institutes of CAS with China or even world scientists CAS with China or even world scientists

  • UDMGrid

UDMGrid: University Digital Museum : University Digital Museum Grid Grid

  • Provide an integrated UDM data sharing

Provide an integrated UDM data sharing environment using grid technologies environment using grid technologies

  • Currently 4

Currently 4 UDMs UDMs are integrated are integrated

  • Beihang

Beihang university university

  • Yunnan

Yunnan University University

  • Nanjing

Nanjing University University

  • Shandong

Shandong University University

slide-27
SLIDE 27

Gang Chen/CC/IHEP 10-April-2008 - 27

HEP Grid in China HEP Grid in China

slide-28
SLIDE 28

Gang Chen/CC/IHEP 10-April-2008 - 28

LHC LHC

  • China is involved in all four LHC experiments,

China is involved in all four LHC experiments,

  • IHEP in CMS and ATLAS.

IHEP in CMS and ATLAS.

slide-29
SLIDE 29

Gang Chen/CC/IHEP 10-April-2008 - 29

BEPCII/BESIII BEPCII/BESIII

BEPC: Beijing Electron BEPC: Beijing Electron Positron Positron Collider Collider

  • 2~5GeV/C

2~5GeV/C

  • Being upgraded to

Being upgraded to Dual Dual-

  • Ring,

Ring, (3~10) (3~10)× ×10 1032

32 cm

cm-

  • 2

2s

s-

  • 1

1

  • 27

27 Universities and Universities and Institutes from Institutes from Korea, US, UK, Korea, US, UK, Japan, and China. Japan, and China.

slide-30
SLIDE 30

Gang Chen/CC/IHEP 10-April-2008 - 30

YBJ YBJ-

  • ARGO/AS

ARGO/ASγ

γ

  • Italy,Japan

Italy,Japan-

  • China

China cosmic ray cosmic ray

  • bservatories in
  • bservatories in

Tibet. Tibet.

  • 200TB raw data per

200TB raw data per year. year.

  • Data transferred to

Data transferred to IHEP and processed IHEP and processed with 400 CPUs. with 400 CPUs.

  • Rec. data accessible
  • Rec. data accessible

by collaborators. by collaborators.

slide-31
SLIDE 31

Gang Chen/CC/IHEP 10-April-2008 - 31

More Applications More Applications

Members of International Collaborations: Members of International Collaborations: Huge computing demands. Huge computing demands.

slide-32
SLIDE 32

Gang Chen/CC/IHEP 10-April-2008 - 32

LCG sites in China LCG sites in China

UI CE_torque SE_classicl MON WN1 UI CE_torque SE_dcache BDII PX RB LFC_mysql WN2

SDU SDU VO: ATLAS VO: ATLAS PC farm

UI CE_torque SE_classicl WN1 WN2

PC farm

UI WN1 WN2

PC farm PEK PEK VO: CMS VO: CMS CSTNET\CERNET CNIC CNIC IHEP IHEP

slide-33
SLIDE 33

Gang Chen/CC/IHEP 10-April-2008 - 33

at IHEP at IHEP

slide-34
SLIDE 34

Gang Chen/CC/IHEP 10-April-2008 - 34

Networking Networking -

  • Gloriad

Gloriad

slide-35
SLIDE 35

Gang Chen/CC/IHEP 10-April-2008 - 35

2.5Gbps

ORIENT ORIENT /TEIN2 /TEIN2 connectivity connectivity upgrade upgrade

Networking Networking – – ORIENT/TEIN2 ORIENT/TEIN2

slide-36
SLIDE 36

Gang Chen/CC/IHEP 10-April-2008 - 36

Network Performance Network Performance

slide-37
SLIDE 37

Gang Chen/CC/IHEP 10-April-2008 - 37

Network Performance Network Performance

slide-38
SLIDE 38

Gang Chen/CC/IHEP 10-April-2008 - 38

gLite gLite applications applications

  • LHC, BESIII are running

LHC, BESIII are running

  • Resources for LHC are limited, but ramping up

Resources for LHC are limited, but ramping up

  • Deploying ARGO to LCG

Deploying ARGO to LCG

slide-39
SLIDE 39

Gang Chen/CC/IHEP 10-April-2008 - 39

Conclusion Conclusion

  • Many grid projects

Many grid projects -

  • may be too many!

may be too many!

  • Invited to merge by government

Invited to merge by government

  • Interoperability

Interoperability

  • gLite

gLite-

  • GOS: presentation by

GOS: presentation by Yaodong Yaodong CHENG this afternoon CHENG this afternoon

  • Many applications

Many applications

  • HEP, Astrophysics, Biology, Industry,

HEP, Astrophysics, Biology, Industry,… …

slide-40
SLIDE 40

Gang Chen/CC/IHEP 10-April-2008 - 40

Thank you! Thank you!