ChinaGrid: National Education and ChinaGrid: National Education and - - PowerPoint PPT Presentation

▶
chinagrid national education and chinagrid national
SMART_READER_LITE
LIVE PREVIEW

ChinaGrid: National Education and ChinaGrid: National Education and - - PowerPoint PPT Presentation

Mar 27, 2024 180 likes •595 views

ChinaGrid: National Education and ChinaGrid: National Education and Research Infrastructure in China Research Infrastructure in China Hai Jin Hai Jin Huazhong University of Science and Technology Huazhong University of Science and

slide-1
SLIDE 1

ChinaGrid: National Education and ChinaGrid: National Education and Research Infrastructure in China Research Infrastructure in China

Hai Jin Hai Jin

Huazhong University of Science and Technology Huazhong University of Science and Technology hjin@hust.edu.cn hjin@hust.edu.cn

slide-2
SLIDE 2

2

2

ChinaGrid in a Nutshell

  • China Education and Research Grid
  • Funded by Ministry of Education
  • As the pilot grid application supported by China

National Grid (CNGrid)

  • Based on CERNET (China Education and Research

Network)

  • First Phase

From 2003-2005 12 key universities as initiative 20 key universities now

slide-3
SLIDE 3

3

3

Network Infrastructure of ChinaGrid CERNET-1

To G erm any To C anada To A m eri ca To Japan

Trunk N et w

  • rk

R egi onal N et w

  • rk

Ext ernal Export

C hengD u X i A n W uH an N anJi n B ei Ji ng S henYang G uangZhou S hangH ai To E ngl and

slide-4
SLIDE 4

4

4

ChinaGrid (The First Phase)

slide-5
SLIDE 5

5

5

ChinaGrid ( till now )

slide-6
SLIDE 6

6

6

ChinaGrid Mission

  • Campus grid platform
  • Common platform for ChinaGrid
  • Grid application platform and

representative grid applications

Image processing grid Bioinformatics grid Course on-line grid Computational fluid dynamic grid Large scale information processing grid

slide-7
SLIDE 7

7

7

Architecture of ChinaGrid

slide-8
SLIDE 8

8

8

Campus Grids and their Computing Power and Storage Capacity

  • HUST：0.8Tflops, 5TB
  • THU：1.3Tflops, 20TB
  • PKU：1.5Tflops, 10TB
  • BUAA：0.7Tflops, 10TB
  • SCUT：0.9Tflops, 20TB
  • SJTU：0.5Tflops, 9TB
  • SEU：1.0Tflops, 19TB
  • XJTU：0.1Tflops, 2.5TB
  • NUDT：0.2Tflops, 5TB
  • NEU：0.8Tflops, 5TB
  • ZSU：1.3Tflops, 10TB
  • SDU：1.3Tflops, 18TB
  • NWPU：0.4Tflops, 2TB
  • ZJU：0.6Tflops, 3TB
  • FUDAN：1.8Tflops, 6TB
  • TONGJI：0.2Tflops, 1TB
  • USTC：1.2Tflops, 5TB
  • UESTC：0.3Tflops, 2TB
  • RUC：0.1Tflops, 0.5TB
  • LZU：0.3Tflops, 1TB

ChinaGrid：>15Tflops, >150TB

slide-9
SLIDE 9

9

9

Layered Infrastructure of ChinaGrid

High performance computing environment (campus grid)

ChinaGrid Supporting Platform (CGSP)

NUDT THU HUST ZSU PKU SJTU XJTU NEU SCUT BUAA SEU SDU Remote education grid Image processing grid Fluid dynamics grid Massive information processing grid Bioinformatics grid

slide-10
SLIDE 10

10

1 0

What’s CGSP?

  • ChinaGrid Supporting Platform, a grid middleware

for ChinaGrid

  • Follow the WS-Resource Framework (WSRF) and

Open Grid Service Architecture (OGSA)

  • CGSP 1.0 was released at Jan. 10, 2005
  • CGSP 2.0 (beta) was released at April 25, 2006
  • Developed by the joint working group from HUST,

THU, PKU, BUAA, SJTU, and other universities in ChinaGrid

slide-11
SLIDE 11

11

1 1

Status of CGSP

  • CGSP 1.0 supports four major grid applications of

ChinaGrid

  • Installed in all the ChinaGrid universities as campus

grid environment

  • CGSP 2.0 (beta) download more than 350 times

within 2 days after its release

http://www.chinagrid.edu.cn/CGSP/index.htm

slide-12
SLIDE 12

12

1 2

slide-13
SLIDE 13

13

1 3

CGSP Architecture

slide-14
SLIDE 14

14

1 4

Main Features of CGSP 2.0

  • More powerful

Multi-domain cooperation Support various jobs Integrate more kinds of resources

  • More flexible

Configurable Loose-coupled

  • More stable
  • More open, more international
  • Easy to install
slide-15
SLIDE 15

15

1 5

CGSP 2.0 Container

  • Runtime environment for CGSP
  • Based on GT4 Core

Hot deploy Auto deploy Remote deploy Service Monitoring - CGSV CGSP Security

slide-16
SLIDE 16

16

1 6

CGSP 2.0 Container Architecture

slide-17
SLIDE 17

17

1 7

Information Center

  • A logical center to publish and

discover all kinds of information of resources in all domains

  • Functions

To connect all domains

  • Join/Quit the tree-like topology

To support powerful view of resources

  • all kinds of resources
  • a global view
  • user-related view
slide-18
SLIDE 18

18

1 8

Components of Information Center

  • Domain Information Service (unique in domain)
  • Domain Registry Service (unique in domain)
  • Node Registry Service (in each nodes of the domain)
  • Schema Repository Service (unique in ChinaGrid)
slide-19
SLIDE 19

19

1 9

Execution Management

  • Enables applications to have coordinated access to

underlying resources

  • Support three types of job

Legacy binary program execution – atomic job Service invoking – atomic job Workflow execution – composite job

  • Support four types of job submission

GRS Application Submission (for legacy program) JSDL Submission (for legacy program) Generic Job Submission (for WS/WSRF) Composite Job Submission (for workflow)

slide-20
SLIDE 20

20

2 0

Execution Management

  • Fundamental job management

Job submission , Job monitoring, Job scheduling

  • Uniform interface of job creation and monitoring

WS, WSRF, JSDL, Workflow Service

  • Dynamic WSRF/WS service invocation
  • Distributed workflow engine management and

workflow load balancing

  • Legacy application dynamic deployment and friendly

application user interface

  • PBS and MPI are supported by GRS
slide-21
SLIDE 21

21

2 1

Submission Submission

Job Submitter Job Submitter

Monitor Monitor Control Control Workflow Deployment Workflow Deployment

Job Manager Job Manager Job Executors Job Executors

JMI JMI Workflow Agent Workflow Agent Job Queue Job Queue Monitor/Control Agent Monitor/Control Agent Inter-domain Agent Inter-domain Agent Workflow Manager Workflow Manager Invoking Engine Invoking Engine Load Balancer Load Balancer Database Database State Database State Database BPEL Engine BPEL Engine BPEL Engine BPEL Engine BPEL Engine BPEL Engine General Service Invoker General Service Invoker Workflow Invoker Workflow Invoker JSDL Parser and GRS Invoker JSDL Parser and GRS Invoker CGSP Service Container CGSP Service Container GT4.0.x Java WS Core GT4.0.x Java WS Core CGSP GRS Container CGSP GRS Container Apache Axis1.2.x Container Apache Axis1.2.x Container

ARCHITECTURE

slide-22
SLIDE 22

22

2 2

Execution Management

  • Workflow Support

Follows BPEL4WS 1.1 specification Functionality Workflow execution, control and monitoring Workflow load balancing Dynamic workflow deployment Support orchestrating WSRF services

  • JSDL Support
slide-23
SLIDE 23

23

2 3

Execution Management

  • General Running Service (GRS)

Just a normal WSRF-compliant Web Service, providing computing service Executing any executable program which can be portably transferred for CGSP.

Supporting MPI Programs with PBS supported cluster

Providing Execution Management and Task Scheduling Deployment & Undeployment

Auto-deployment of Legacy program

One GRS per computing node

slide-24
SLIDE 24

24

2 4

Data Management

  • Grid File System

Enable user to have his/her own data space

  • ver Grid

Make/Remove directories Upload/Copy/Remove/Download files Browse/Search files/directories

  • Data Storage & Transfer Support

GRS GridPPI HDB

slide-25
SLIDE 25

25

2 5

Heterogeneous Database

  • Functions

Provide an uniform, flexible and service-based interface to access and integrate distributed, heterogeneous and structurally complex data resources

  • Virtual Table

It is a logic concept, like the concept of view in DBMS It is only a mapping relationship between virtual table and physical table More than one physical tables can register to the same virtual table Users can submit queries performed on virtual table

  • Physical Table

It really exists in counterpart database Map reference columns to corresponding virtual table columns

slide-26
SLIDE 26

26

2 6

GridPPI

  • CGSP Programming Interface

MPI-like API

slide-27
SLIDE 27

27

2 7

AG4ChinaGrid：GridAsia 2005

slide-28
SLIDE 28

28

2 8

http://www.chinagrid.edu.cn

slide-29
SLIDE 29

29

2 9

Bioinformatics Grid

slide-30
SLIDE 30

30

3 0

BioGrid Applications

  • Protein target selection for rice genome
  • Multi-sequence alignment for ganoderma

family

  • Gene joint for white mice
  • Cardiovascular disease research
slide-31
SLIDE 31

31

3 1

Image Processing Grid

slide-32
SLIDE 32

32

3 2

ImageGrid Applications

  • Three-dimension reconstruction of digital

virtual human being (HUST)

  • Medical image diagnosis (ZSU)
  • Remote sensing image processing（NUDT）
slide-33
SLIDE 33

33

3 3

CFD Grid

slide-34
SLIDE 34

34

3 4

Pilot Applications based on CFD Grid

  • Shanhai JiaoTong University: Aircraft genetic
  • ptimization design system
  • Xi’an JiaoTong University: Parallel algorithm for

molecular dynamics

  • Southern China University of Technology: Simulation

and optimization techniques for metal powder figuration process

  • Northeast University: Large scale geological disaster

forecasting system

  • Southeast University: Computational

electromagnetism applications in airplane and automobile design

slide-35
SLIDE 35

35

3 5

Course On-line Grid

slide-36
SLIDE 36

36

3 6

Course Resource Contribution

  • Number of courses:

Number of courses: 233 233； ；Number of hours: Number of hours: 2566 2566

474 117 32 283 251 332 202 332 205 12 213 113 50 100 150 200 250 300 350 400 450 500 PK TS XJ SJ DB SD HN HZ DN HK DZ BH ZS

slide-37
SLIDE 37

37

3 7

User IP distribution（2004/08/27-2005/01/16）

1260541 9370 ZS 71957 696 DN 848936 1358 DB 125083 818 TS 10383 121 BH 640255 2922 BY 10970 264 PK2 5868376 15359 PK1 Total number of HTTP GET Independent IP number Server 64299 598 HZ 705687 387 HN 618136 5101 LD 160240 1318 XB 265055 528 SJ 697464 3981 XJ 1093657 9513 UST 128816 1110 SD Total number of HTTP GET Independent IP number Server

Numbers of independent IPs：25,807；Total number of HTTP GET：12,569,855

Usage Survey

At least so many people use course-

  • nline grid

Total number

  • f access
slide-38
SLIDE 38

38

3 8

Massive Information Processing Grid

slide-39
SLIDE 39

39

3 9

slide-40
SLIDE 40

40

4 0

University Digital Museum Grid (UDMGrid)

slide-41
SLIDE 41

41

4 1

Hai Jin

Huazhong University of Science and Technology Wuhan, 430074, China hjin@hust.edu.cn http://grid.hust.edu.cn/hjin/