Detlef Straeten Executive IT Architect Distinguished Engineer - - PowerPoint PPT Presentation

▶
detlef straeten
SMART_READER_LITE
LIVE PREVIEW

Detlef Straeten Executive IT Architect Distinguished Engineer - - PowerPoint PPT Presentation

Aug 30, 2022 219 likes •519 views

22. April 2004 22. April 2004 DECUS IT Symposium 2004 DECUS IT Symposium 2004 Intro, Trends and Directions Detlef Straeten Executive IT Architect Distinguished Engineer Member IBM Academy of Technology 1 www.decus.de

slide-1
SLIDE 1

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

1

Detlef Straeten

Executive IT Architect Distinguished Engineer Member IBM Academy of Technology

Intro, Trends and Directions

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

slide-2
SLIDE 2

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

2

Agenda

! Evolution of Grid ! Architectural background ! Grid in Customer Projects ! Summary ! Questions

slide-3
SLIDE 3

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

3

Grid Applications: What is in the Press?

SETI Napster

  • Search for extra terrestrial life
  • Today approx. 4 million computer
  • Capacity approx. 100.000 years since intro. in mid 1999.
  • Approx. 2.000 machines get added every day
  • Kids in the US use it as computer "benchmark" ;-)
  • P2P File Sharing network
  • Mainly used for MP3 music file exchange
  • Saved $600M in storage & $6M in bandwidth expenses per month

(according to Bear Stearns Chris Kwak & Robert Fagin)

Note: Often you will find the term "Business GRIDs", to describe business relationships and associated B2B concepts in a grid-like fashion.

slide-4
SLIDE 4

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

4

Grid Applications Today and "Why now ?"

The TeraGrid University of Pennsylvania Butterfly.net On demand gaming National Digital Mammographic Archive Medical and diagnostic content

13.6 trillion floating point

  • perations per second

600 terabytes of data 40 gigabits per second

Most powerful, heterogeneous Grid UK Research Grid Collaborative, scientific research Test bed for utility computing Future commercial applications

  • Moore’s law improvements in computing produce highly functional endsystems
  • The Internet and burgeoning wired and wireless provide universal connectivity
  • Changing modes of working and problem solving emphasize teamwork, computation
  • Network exponentials produce dramatic changes in geometry and geography

Note: Politicians have discovered Grids as the means to increase competitive advantage for their respective economies (EU, Japan,...)!!

slide-5
SLIDE 5

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

5

Let’s recap: Grid Computing Capabilities

!Infrastructure Optimization !Workload Management and Consolidation !Reduced Cycle Times !Increased Access to Data and Collaboration !Federation of Data !Global Distribution !Resilient / Highly Available Infrastructure !Business Continuity !Recovery and Failover !And a pretty cool base for High Performance Computing

slide-6
SLIDE 6

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

6

“Gridified” Infrastructure

Industry Applications

Financial Services

Derivatives Analysis Statistical Analysis Portfolio Risk Analysis Derivatives Analysis Statistical Analysis Portfolio Risk Analysis

Manufacturing

Mechanical/ Electronic Design Process Simulation Finite Element Analysis Failure Analysis Mechanical/ Electronic Design Process Simulation Finite Element Analysis Failure Analysis

LS / Bioinformatics

Cancer Research Drug Discovery Protein Folding Protein Sequencing Cancer Research Drug Discovery Protein Folding Protein Sequencing

Other

Web Applications Weather Analysis Code Breaking/ Simulation Academic Web Applications Weather Analysis Code Breaking/ Simulation Academic

Sources: IDC, 2000 and Bear Stearns- Internet 3.0 - 5/01 Analysis by SAI

Grid Services Market Opportunity 2005

Unique by Industry with Common Characteristics

Energy

Seismic Analysis Reservoir Analysis Seismic Analysis Reservoir Analysis

Entertainment

Digital Rendering Digital Rendering Massive Multi-Player Games Massive Multi-Player Games Streaming Media Streaming Media

slide-7
SLIDE 7

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

7

Uses of Grid Technology

4 Models, Unique Value Propositions

Platform, Entropia, United Devices

Increased

Processing

“Aggregate processing power from a distributed collection of heterogeneous systems”

Partners:

Customer Values:

!Productivity !Flexibility !Resource use !Reliability/ Availability !Complexity !Total cost of

  • wnership

Decreased

slide-8
SLIDE 8

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

8

Platform, Entropia, United Devices

Increased

Processing

“Aggregate processing power from a distributed collection of heterogeneous systems”

Partners:

Avaki, Platform

Data

“Secure access and sharing of distributed data & information in a collaborative fashion”

Partners:

Customer Values:

!Productivity !Flexibility !Resource use !Reliability/ Availability !Complexity !Total cost of

  • wnership

Decreased

Uses of Grid Technology

4 Models, Unique Value Propositions

slide-9
SLIDE 9

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

9

Platform, Entropia, United Devices

Increased

Processing

“Aggregate processing power from a distributed collection of heterogeneous systems”

Partners:

Platform

Resiliency

“Improve the quality

  • f service of

distributed systems, despite unplanned events”

Partners:

Avaki, Platform

Data

“Secure access and sharing of distributed data & information in a collaborative fashion”

Partners:

Customer Values:

!Productivity !Flexibility !Resource use !Reliability/ Availability !Complexity !Total cost of

  • wnership

Decreased

Uses of Grid Technology

4 Models, Unique Value Propositions

slide-10
SLIDE 10

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

10

Platform, Entropia, United Devices

Increased

Processing

“Aggregate processing power from a distributed collection of heterogeneous systems”

Partners:

Platform

Resiliency

“Improve the quality

  • f service of

distributed systems, despite unplanned events”

Partners:

Avaki, Platform

Data

“Secure access and sharing of distributed data & information in a collaborative fashion”

Partners:

Platform, Entropia, United Devices, Avaki

On Demand

“Access data & processing capabilities in a utility-like fashion…….. Make vs. Buy”

Partners:

Client Values:

!Resource use !Flexibility !Productivity !Reliability/ Availability !Complexity !Total cost of

  • wnership

Decreased

Uses of Grid Technology

4 Models, Unique Value Propositions

slide-11
SLIDE 11

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

11

  • 1. Intra-Grids

Grid

NAS/SAN

Grid

NAS/SAN

Grid Deployment Options

A Function of Business Need, Technology and Organizational Flexibility

Note: Execution logic can be "mobile" or "resident".

slide-12
SLIDE 12

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

12

  • 1. Intra-Grids
  • 2. Extra-Grids

Grid Grid

NAS/SAN NAS/SAN

Grid

NAS/SAN

VPN

Grid Deployment Options

A Function of Business Need, Technology and Organizational Flexibility

Note: Execution logic can be "mobile" or "resident".

slide-13
SLIDE 13

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

13

  • 1. Intra-Grids
  • 2. Extra-Grids
  • 3. Inter-Grids

Grid Grid

NAS/SAN NAS/SAN

Grid

NAS/SAN

VPN

Cactus NTG

(SF) Express Project

MFG

Fin. Services

Grid Deployment Options

A Function of Business Need, Technology and Organizational Flexibility

Note: Execution logic can be "mobile" or "resident".

slide-14
SLIDE 14

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

14

Grid Defined

The Grid problem:

! Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations ! The Grid is a system that:

  • coordinates resources that are not subject to centralized control (resources and

users live within different domains (admin, technology,...))

  • therwise: It would be a local management system
  • uses standard, open, general-purpose protocols and interfaces
  • therwise: It would be an application-specific system
  • delivers non-trivial qualities if service (response time, throughput,...)
  • therwise: It would be of limited commercial use

Foster & Kesselman (Nov. 2002)

slide-15
SLIDE 15

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

15 Tooling Network

OGSA Enabled

Storage

OGSA Enabled

Servers

OGSA Enabled

Messaging

OGSA Enabled

Directory

OGSA Enabled

File Systems

OGSA Enabled

Database

OGSA Enabled

Workflow

OGSA Enabled

Security

OGSA Enabled

Web Services

Architecture Framew ork

OGSA Structure

OGSI – Open Grid Services Infrastructure Grid Data Services Grid Core Services Grid Program Execution Services

Domain Specific Services OGSA Architected Services

Applications

Open Grid Services Architecture (OSGA)

Autonomic Capabilities

slide-16
SLIDE 16

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

16

OGSA Structure – OGSI

Architecture Framew ork

Web Services

HandleMap Notification Factory Management Registry

Lifecycle Discovery

OGSI – Open Grid Services Infrastructure Grid Services System Management Services

! Exploits existing web services properties ! Interface abstraction (WSDL) ! Protocol, language, hosting platform independence

! Enhancement to web services

! State Management ! Event Notification ! Referenceable Handles ! Lifecycle Management ! Service Data Extension

slide-17
SLIDE 17

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

17

  • OGSA Services can

be defined and implemented as Web services

  • OSGA can take

advantage of other Web services standards

  • OGSA can be

implemented using standard Web services development tools

  • Grid applications will

NOT require special Web services infrastructure

Network

OGSA Enabled

Storage

OGSA Enabled

Servers

OGSA Enabled

Messaging

OGSA Enabled

Directory

OGSA Enabled

File Systems

OGSA Enabled

Database

OGSA Enabled

Workflow

OGSA Enabled

Security

OGSA Enabled

Web Services OGSI – Open Grid Services Infrastructure

Web Services OGSA Architected Services

Applications

WS-Service Groups WS-Renewable References W S

  • N
  • t

i f i c a t i

  • n

Modeling Stateful Resources with Web Services

W S

  • B

a s e F a u l t s WS-Resource Properties W S

  • R

e s

  • u

r c e L i f e t i m e

WS-Resource Framework & WS-Notification are an evolution of OGSI

slide-18
SLIDE 18

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

18

How these proposals relate to OGSA

WS-BaseFaults Base fault type WS-ServiceGroup ServiceGroup portTypes Treated as a pattern Factory portType WS-Notification Notification portTypes WS-ResourceLifetime GridService lifetime mgmt WS-ResourceProperties Service data defn & access WS-RenewableReferences HandleResolver portType WS-Addressing Endpoint Reference Grid Service Handle WS-Addressing Endpoint Reference Grid Service Reference WSRF OGSI

slide-19
SLIDE 19

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

19

Grid W eb The definition of WSRF means that Grid and Web communities can move forward on a common base W SRF

Started far apart in apps & tech OGSI GT2 GT1 HTTP WSDL, WS-* WSDL 2, WSDM

Have been converging

Grid and Web Services: Convergence

slide-20
SLIDE 20

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

20

Increasing Organization Complexity

Grid Adoption Framew ork

Several Logical Paths to Implementation

Increasing Organization Complexity

Business and IT Play IT Play Intra Grid Extra Grid Inter Grid On Demand Data Resiliency Processing

Increasing IT Complexity

slide-21
SLIDE 21

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

21

Increasing Organization Complexity

Grid Adoption Framew ork

Several Logical Paths to Implementation

Increasing Organization Complexity

Business and IT Play IT Play Intra Grid Extra Grid Inter Grid On Demand Data Resiliency Processing

Increasing IT Complexity

Scientific & Technical Computing Commercial Computing Utility Computing

slide-22
SLIDE 22

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

22

discovery, lifecycle, registry, manageability factory, handlemapper, notification, install

Resource Resource Systems Meta-OS

clustering, policy repository, data replication, security, problem determination, resources instrumentation, logging, basic provisioning

Provisioning Provisioning

eWLM, eAutomation, eServer Mgmt., Distributed Resource Management

e-business eUtility

billing, metering, subscription, identification

Autonomic I/T Resources

Where do Grids play?

Autonomic Management Tooling

Open Grid / Web Services

slide-23
SLIDE 23

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

23

Charles Schw ab

  • Reduced the processing time on an existing wealth

management application, from more than four minutes to fifteen seconds

  • Will allow Charles Schwab to increase customer satisfaction

by responding to inquiries in real time…while the customer is on the phone

Business Analytics Business Analytics

“We believe that Grid computing … has the potential to greatly improve our quality of service and be a truly disruptive technology.”

Oren Leiman, Managing Director, Charles Schwab

  • Schwab is now planning to leverage Grid

computing into other key business areas

slide-24
SLIDE 24

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

24

Royal Bank of Canada Insurance

  • Policy valuation application takes 18 hours to process
  • Job executed across 4 separate NT processors with manual job

scheduling being performed by a highly paid actuary – who spent up to 75% of job being an IT operator

  • With Grid, job runs in 34 minutes, and job scheduling is automated,

freeing up actuaries to focus on their core job

  • Can now run more complex scenarios to reduce risk

Business Analytics Business Analytics

slide-25
SLIDE 25

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

25

IBM’s intraGrid Worldw ide Locations

Charlotte (1) 3 RTP (2) 7 Cambridge (2) 4 Hawthorne (2) 4 Poughkeepsie (4) 4 Somers (1) 1 Southbury (4) 13 Yorktown Heights (7) 28 Markham (2) 14 San Jose (7) 13 San Mateo (2) 7 Hursley (1) 3 London (1) 2 Montpellier (2) 10 Uithorn (1) 2 Boeblingen (2) 2 Zurich (1) 6 Haifa (1) 2 Austin (9) 58 Roanoke (2) 4 Bangalore (1) 1 Chiba (1) 2 Tokyo (2) 2 Taipei (2) 2 Rochester (3) 15 Chicago (1) 1 Sapporo (1) 4 Beijing (2) 7

137 users in 66 projects

slide-26
SLIDE 26

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

26

IBM

Microprocessor Design

  • Continually unlocking infrastructure value by driving utilization

rates above 70%

  • Lower error rates in designs leads to higher quality, reduced

development cycle time and cost avoidance

  • Faster time to market by cutting development time
  • Enabling IBM's leadership in microprocessor technologies

Z Series Design

  • Lower total cost of ownership by using the

Grid for On Demand processing power

  • Increased fault tolerance by reducing the

dependency on a single cluster

  • Isolation of software errors to individual

clusters reduces impacts to a local cluster

Engineering and Design Engineering and Design

slide-27
SLIDE 27

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

27

Grid Application: Grid Application: Grid Application: Grid Application: Functional Verification of Functional Verification of Functional Verification of Functional Verification of zSeries Processor Units zSeries Processor Units zSeries Processor Units zSeries Processor Units

! Random unit simulation, simulation environment/model on AFS (shadowed once a day to participating AFS cells) ! Input data: None (Random start seed) ! Output data, Testcase passed: Statistics, summary, coverage, ~150 kB ! Output data, Testcase failed: Statistics, summary, coverage, debug info, ~1.5 MB ! Testcase runtime determined by clock cycles simulated (130k cycles, <10min runtime, depending on machine)

IBM IBM IBM IBM Boeblingen Boeblingen Boeblingen Boeblingen LabGrid LabGrid LabGrid LabGrid

slide-28
SLIDE 28

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

28

Vaccine Research

What is the Smallpox Research Grid Project? The grid computing project uses many PCs to analyze DNA in the different forms of smallpox virus. By understanding the genetic makeup, scientists can design vaccines and treatments.

slide-29
SLIDE 29

DECUS IT Symposium 2004

  • 22. April 2004

www.decus.de <http://www.decus.de>

29

Questions?