IBM Storage Virtualization for GRID environment Stephen Chu, IT - - PowerPoint PPT Presentation

▶
ibm storage virtualization for grid environment
SMART_READER_LITE
LIVE PREVIEW

IBM Storage Virtualization for GRID environment Stephen Chu, IT - - PowerPoint PPT Presentation

Aug 01, 2023 25 likes •569 views

IBM Storage Virtualization for GRID environment Stephen Chu, IT Infrastructure Solution, STG, GCG, IBM Agenda Why choose IBM for Storage Virtualization How IBM

slide-1
SLIDE 1

Stephen Chu, IT Infrastructure Solution, STG, GCG, IBM

IBM Storage Virtualization for GRID environment

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-2
SLIDE 2 2

Agenda

§Why choose IBM for Storage Virtualization §How IBM Virtualize Storage

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-3
SLIDE 3 3

The right doctor for your IT

Why IBM?

§ IBM- Established in 1896

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-4
SLIDE 4 4

IBM’s Experience §Simpler is Better §Less is more §Reliability §Availability §Serviceability

Choose IBM for Storage Virtualization

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-5
SLIDE 5 5

Why IBM choose to build quality product §Why smart buyer buys high quality product?

Choose IBM for Storage Virtualization

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-6
SLIDE 6 6

IBM Blue Gene – 5 IBM Power Cluster - 2

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-7
SLIDE 7 7 Blue Gene SoC is im plem ented in 0 .1 3 µm technology integrating L1 , L2 , L3 ( 4 MB) cache; quad-w ord m em ory controller; and five netw orks ( torus, tree, interrupt, JTAG, Ethernet) Dual Pow erPC System -on-Chip ( SoC)

Blue Gene

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-8
SLIDE 8 8

Blue Gene system modularity

Blue Gene Rack(s) Up to 1024 Compute Nodes / Rack Up to 128 IO Nodes / Rack Host System Service and Front End Nodes (P5/SLES9), Storage System, Ethernet Switch, Cabling, SuSE SLES9, DB2, XLF/C Compilers

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-9
SLIDE 9 9 וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-10
SLIDE 10 10

Three Walls in HPC

§Memory Wall

– Latency induced performance and bandwidth limitations

§Frequency Wall

– Diminishing returns from deeper and/or wider pipelines (can be negative if power is taken into account)

§Power Wall

– Must improve efficiency and performance equally

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-11
SLIDE 11 11

IBM Cell Strategy

§ Multi-Core Non-Homogeneous Architecture – Attacks Power Wall § 3-level Model of Memory – Main Memory, Local Store, Registers – Attacks Memory Wall § Large Shared Register File & SW Controlled Branching – Allows deeper pipelines – Attacks Frequency Wall

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-12
SLIDE 12 12

Highlight of CELL

§Supercomputer on a chip §Multi-core microprocessor (9 cores) §3 to 4 GHz clock frequency §10x performance for many applications §Digital home to distributed computing

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-13
SLIDE 13 13

Simultaneous multi-threading Single thread

Dynamic power management No power management

Photos taken with thermal sensitive camera while prototype POWER5 chip was undergoing tests

Dynamic Power Management

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-14
SLIDE 14 14

Simplify Virtualize Automat e

How IBM optimize Storage

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-15
SLIDE 15 15

Simplify

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-16
SLIDE 16 16

Data Management Challenge — Data Growth

Source: International Technology Group, Sept 2003 * hardware, software, storage networking, personnel, backup operations, recovery, security

典型的财富500强企业……

Server-based disk storage 50 100 150 200 250 1996 2002 2007 Terabytes ('000) Storage-related expenditures 5 10 15 20 25 1996 2002 2007 Percentage (%) וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-17
SLIDE 17 17 Source: International Technology Group, Sept 2003 * hardware, software, storage networking, personnel, backup operations, recovery, security

典型的财富500强企业……

Server-based disk storage 1996 2002 2007 50 100 150 200 250 Terabytes ('000) Storage-related expenditures 5 10 15 20 25 1996 2002 2007 Percentage (%)

磁盘存储快速增长

存储带来的开销，占IT投资的 百分比不断上升 Free Storage Capacity Effective Data Non-critical Data Replicated Data Older/Isolated Data Log files, dump files

Gain More Deletion Deletion/Sharing Periodic Deletion Periodic Archiving Strengthen data access, achiving & protection

Data, is like your personal effect

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-18
SLIDE 18 18

SAN（Simplification）

Storage Pool

Cleaning your house every morning。

Mr Zhu’s proverb

Storage Pool

Storage Pool

虚拟文件系统 文件系统

Effective Data Free Storage Space Non Critical Data Replicated Data Older, Isolated Data log files, dump files Gain More Deletion Delete/Sharing Periodic Deletion Periodic Archiving Strengthen Data Access, Archiving & Protection

50 100 150 200 250 Terabytes ('000)

Shelf space makes your home more homy。

My wfie’s proverb

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-19
SLIDE 19 19

Simplification Summary

SAN

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-20
SLIDE 20 20

Virtualiz e

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-21
SLIDE 21 21

Virtualize

Storage Device

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-22
SLIDE 22 22

Ecosystem for Information Life Cycle

Enterprise class Mid-range Low-cost WORM WORM WORM Automated Manual

Data Management Replication Management Media Management Offline Archive Management Long Term Archive

Compress? Encrypt? וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-23
SLIDE 23 23

Storage Pool

SAN Volume Controller(SVC)

SAN

HDS DS8000 Virtual Disk Virtual Disk Virtual Disk Virtual Disk

SAN Volume Controller

DS4000 HP EMC Multiple Storage RAID to form a single storage pool Advanced Copy Services Data replication between Storage Pool Centralize Storage Management Change in Storage will not impact application וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-24
SLIDE 24 24

Traditional RAID

RAID controller 2 RAID controller 1

LUN 4 LUN 3 LUN 2 LUN 1

Every Logical Volume map into a physical disk

LUN 4 LUN 3 LUN 2 LUN 1

Physical storage configuration change will impact application & server availability

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-25
SLIDE 25 25

IBM SVC

RAID controller 2 RAID controller 1

LUN 4 LUN 3 LUN 2 LUN 1 LUN 4 LUN 3 LUN 2 LUN 1 MD 4 MD 3 MD 2 MD 1 MD 8 MD 7 MD 6 MD 5 Managed disks SCSI LUNs VD 4 VD 3 VD 2 VD 1 VD 7 VD 6 VD 5 Virtual disks Virtual-to-physical Mapping

SAN Volume Controller

High Perf Low Cost

Managed disks was divided into disk group in order to manage different type of storage device The SAN Volume Controller “Isolate” server from changes in storage

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-26
SLIDE 26 26

MDG1 MDG2 MDG3 Cluster:

  • Max 4 Node-pairs (8

Nodes total) SAN Volume Controllers nodes Managed Disks:

  • Select LUNs from up to 64

physical disk subsystems

  • Max 128 Managed Disk Groups
  • Max 128 LUNs per group

SVC Terminology

I/O Group A I/O Group B Virtual Disks: Max 4096 Vdisks total (16MB – 2TB each) Each virtual disk assigned to:

  • Specific Node-pair
  • Specific Managed Disk Group
וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-27
SLIDE 27 27

3 SVC virtual disk mode

I/O Group A I/O Group B MDG1 MDG2 MDG3 (Image Mode) Virtual Disk = Physical LUN （Sequential Mode） Virtual Disk mapped sequentially to a portion of a managed disk （Striped Mode） Virtual Disk striped across multiple managed disks

A A B B C C C

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-28
SLIDE 28 28 SAN Volume Controller

SVC supported configuration

SAN

Microsoft Windows MSCS IBM AIX HACMP Sun Solaris HP/UX Linux (Intel) IBM BladeCenter Windows/Linux VMWare

SAN

SAN Volume Controller Continuous Copy Synchronous Asynchronous (CNT & Other 3rd party solutions) VMWare Windows / Linux / NetWare guests Point-in-time Copy Full volume Copy on write IBM DS DS6000 & DS8000 series Hitachi Thunder 9200 95xxV HP EVA 3000 5000 Hitachi Lightning 99xxV 9910 9960 HP MA 8000 12000 16000 EMC Symmetrix 8000 Series EMC CLARiiON All CX Models FC4700 IBM ESS F20 750 800 EMC DMX 800/1000 2000 3000 IBM DS DS4000 series SUN StoreEdge וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-29
SLIDE 29 29

Virtualize File System

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-30
SLIDE 30 30

File System Type

integral part of OS NTFS, FAT, JFS LAN File Systems use LAN for data NFS, AFS, DFS, CIFS

Leo Iva Lou File ServerA Leo/Iva files File ServerB Iva/Lou files Leo Iva Lou Leo Leo files

SAN

Leo/Iva/Lou files Storage Subsystem Metadata Server

SAN File Systems use SAN for data SAN FS Local File System

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-31
SLIDE 31 31

Current File System Environment

AIX servers Linux servers Windows servers Solaris servers

AFilesystem SFilesystem WFilesystem LFilesystem

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-32
SLIDE 32 32

SAN File System

Admin Client Centralized Administration W2000 VFS AIX Solaris Shared Storage Devices Load balancing
  • Fail-over processing
  • Scalability
IP Network for SAN FS Cluster and SAN FS Hosts User Storage Pools Metadata Cluster . . . SAN Fabric NFS and CIFS clients VFS Linux VFS IFS System Storage Pools Metadata Server Engines HPQ VFS LDAP Server NIS/ Active Directory Server Master Console LAN וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-33
SLIDE 33 33

Single Name Space

fileset 2 fileset 3 ROOT fileset 1 fileset 4 fileset 5 fileset 6

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-34
SLIDE 34 34

Current SAN

SAN SAN

File System File System File System Meta Data Meta Data Meta Data וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-35
SLIDE 35 35

SAN File System and SAN Volume Controller Synergy

File System

SAN SAN

File System File System Meta Data Meta Data Meta Data Single Pool of Storage Single Pool of Storage

SAN Volume Controller SAN Volume Controller

File System File System File System Meta Data Meta Data Meta Data

SAN File System SAN File System

Meta Data וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-36
SLIDE 36 36

Virtualization Summary

SVC SFS

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-37
SLIDE 37 37

Automatio n

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-38
SLIDE 38 38

§Build a storage ecosystem so cost of storage device can match value of the data it stores. §Migrating data among differing storage devices will not impact application.

Automation – Provisioning

Information Life Cycle Management (ILM)

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-39
SLIDE 39 39

IBM TotalStorage Productivity Center (TPC)

§Knowledge is Power – knowing your data’s behavior §Automate Data Management with centralized tool

– Manage Virtualized and non-virtualized storage device – Manage IBM & non-IBM Storage Device – Provide Single Point of Control to Storage Ecosystem

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-40
SLIDE 40 40

LAN

TotalStorage Productivity Center (TPC) –

Simplify Capacity Management

SAN

Brocade McData CNT Cisco Others… SAN Volume Controller IBM DS8000 Hitachi Thunder HP EVA IBM DS6000 Hitachi Lightning HP EMA EMC DMX EMC CLARiiON IBM DS4000 IBM ESS Virtual Disk Virtual Disk Virtual Disk Virtual Disk Virtual Disk

– SAN Monitor

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-41
SLIDE 41 41

LAN SAN

IBM ESS IBM ESS IBM ESS IBM ESS IBM FAStT IBM FAStT

§ Disk Configuration Monitor

– Grouping Disks – Journaling

TPC

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-42
SLIDE 42 42

SAN LAN SAN

Database Logs

§ Automate Logical Volume mirroring and/or replication § Monitor state of mirroring and/or replication

TPC

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-43
SLIDE 43 43

LAN

TPC – optimize storage capacity

SAN

Brocade McData CNT Cisco Others… SAN Volume Controller Hitachi Thunder HP EVA Hitachi Lightning HP EMA EMC DMX EMC CLARiiON IBM ESS IBM ESS Virtual Disk Virtual Disk Virtual Disk Virtual Disk Virtual Disk IBM ESS IBM ESS

– Manage file system utilization rate – Identify and manage non- critical data

  • Duplicates
  • Old
  • No owners

– Forecast data growth rate with AI.

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-44
SLIDE 44 44

LAN SAN

Brocade McData CNT Cisco Others… SAN Volume Controller Hitachi Thunder HP EVA Hitachi Lightning HP EMA EMC DMX EMC CLARiiON IBM ESS IBM ESS Virtual Disk Virtual Disk Virtual Disk Virtual Disk Virtual Disk IBM ESS IBM ESS

Monitor Storage

§ Device Status § Performance § Alert § Generate events based on error frequency

TPC – optimize storage capacity

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-45
SLIDE 45 45

LAN SAN

Brocade McData CNT Cisco Others… SAN Volume Controller Hitachi Thunder HP EVA Hitachi Lightning HP EMA EMC DMX EMC CLARiiON IBM ESS IBM ESS Virtual Disk Virtual Disk Virtual Disk Virtual Disk Virtual Disk IBM ESS IBM ESS Avail LUN 1 Avail LUN 2 Avail LUN 3 IBM ESS Avail LUN 1 Avail LUN 2 Avail LUN 3 IBM ESS Avail LUN 2

§ Recommend “Best Performing LUN” based

  • n statistics such as :

– Average transfer size – I/O rate (per sec, per GB) – Random or sequential reads/writes – Read cache hits – Write destages

TPC – optimize storage capacity

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-46
SLIDE 46 46

LAN SAN

Brocade McData CNT Cisco Others… SAN Volume Controller IBM DS8000 Hitachi Thunder HP EVA IBM DS6000 Hitachi Lightning HP EMA EMC DMX EMC CLARiiON IBM DS4000 IBM ESS Virtual Disk Virtual Disk Virtual Disk Virtual Disk Virtual Disk

– Real time monitoring – Automatic status report and alert – Integrate with Tivoli System

Management

  • Integrate with 3rd party

management system via SNMP.

– SAN error prediction

TPC – reduce data access failure

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-47
SLIDE 47 47

LAN SAN

Brocade McData CNT Cisco Others… SAN Volume Controller IBM DS8000 Hitachi Thunder HP EVA IBM DS6000 Hitachi Lightning HP EMA EMC DMX EMC CLARiiON IBM ESS IBM ESS Virtual Disk Virtual Disk Virtual Disk Virtual Disk Virtual Disk

l

User defined script invoked by user defined event l Automatic file system expansion

!

Filesystem

TPC – reduce human error caused data access failure

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-48
SLIDE 48 48

LAN SAN

Brocade McData CNT Cisco Others… SAN Volume Controller Hitachi Thunder HP EVA Hitachi Lightning HP EMA EMC DMX EMC CLARiiON IBM ESS IBM FAStT Virtual Disk Virtual Disk Virtual Disk Virtual Disk Virtual Disk IBM ESS IBM ESS

TPC support virtualized storage

Microsoft Windows SQL Server DB2 UDB Oracle / Sybase IBM AIX DB2 UDB Oracle / Sybase Sun Solaris DB2 UDB Oracle / Sybase HP/UX DB2 UDB Oracle / Sybase Linux (Intel) DB2 UDB Oracle / Sybase Novell NetWare TPC for Data Server & Repository TPC for Data Agent Microsoft Windows TPC for Fabric Server & Repository TPC for Fabric Agent TPC for Disk Server & Repository CIMOM CIMOM CIMOM CIMOM וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-49
SLIDE 49 49

Quality of Service Cost per MB Quality of Service Cost per MB

Enterprise-class Disk Mid-range Disk with Fibre Channel Mid-range Disk with S-ATA Virtual Tape Enterprise-class Tape Mid-range Tape

Full Spectrum of Storage Offering

FAStT Storage Server DS6800 DS4800 TotalStorage Serial ATA disks Enterprise Storage Server DS8100/8300 TotalStorage Virtual Tape Server TotalStorage Enterprise and LTO Tape וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-50
SLIDE 50 50

Automation Summary

TPC

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-51
SLIDE 51 51

IBM service help optimize Your storage virtualization

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-52
SLIDE 52 52

We hike because the peak is there. And it is not coming towards us.

GRID

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-53
SLIDE 53 53

Simplify Virtuali ze Automate

IBM optimize Storage to facilitate your GRID project

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ
slide-54
SLIDE 54 54

Thank You

谢谢 谢谢

וֹכּמּף ףץ٪ّ٠מּَِ ٩٭۶ףוֹ٭٩ץף ێ ۖףףףِِ