Storage 2015 Storage Shifts and Software Defined Storage (SDS) - - PowerPoint PPT Presentation

▶
storage
SMART_READER_LITE
LIVE PREVIEW

Storage 2015 Storage Shifts and Software Defined Storage (SDS) - - PowerPoint PPT Presentation

Feb 27, 2023 338 likes •609 views

Storage 2015 Storage Shifts and Software Defined Storage (SDS) MRMUG Chris Walker Solution Architect cwalker@ciber.com Ciber Storage 2015 BIO Ciber Solution Architect 27 years working in IT in an assortment of roles including:

slide-1
SLIDE 1

Ciber

Storage 2015

Storage Shifts and Software Defined Storage (SDS) MRMUG

Chris Walker Solution Architect cwalker@ciber.com

slide-2
SLIDE 2

Storage 2015

BIO Ciber – Solution Architect

  • 27 years working in IT in an assortment of

roles including: Systems Administrator, Programming, Software Engineering, Critical Problem Support, technical Sales, and most currently a Solution Architect for Ciber, Inc.

  • Tennis, Guitar, Jet Skiing(new), going out to

eat!

  • I have lived in many different places but

most recently have lived in the Boston area and moved to Northern Kentucky a little over 3 years back. I am married and have one daughter who recently graduated college and I just bought the farm!

slide-3
SLIDE 3

Storage 2015

Agenda – Presentation Topic Outline

  • The New Storage Directions and Driving Forces
  • Software Defined Storage – What is it?
  • How can it be done?
  • Why do it?
  • An Example of SDS from the IBM portfolio
  • Converged and Hyper-converged IT
  • Q&A
slide-4
SLIDE 4

Storage 2015

60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1

347,000 Tweets 693,800 GB of IP Data is Transferred 571 New Websites Created Over 2 million Google search queries 47,000 Apple Store App downloads 77,244 Wi-Fi connections made on iPhone 217 New Web Mobile Users 600 New Videos on YouTube 60 www Domains Registered 20 New Victims of Identity Theft 1,500 Blog Posts More Than 200 Million E-Mails 510,000 Comments on Facebook More Than 370,000 Minutes of Voice Calls on

Skype

Gone In 60 Seconds

slide-5
SLIDE 5

Storage 2015

Welcome to the world of…. Cloud, Analytics, Mobile and Social

4

2.5 Billion

Gigabytes of data per day

Data Explosion

90%

  • f data

created in last two years

Mobile 95% of mobile

traffic is data

Social 500 million Tweets a day; 7 million apps and websites

integrated with Facebook

Big Data & Analytics

2,500 petabytes of big data are being generated every day

Today’s Business

Cloud 80% of new applications

will include cloud delivery

  • r deployment

CAMS

Data doubling every two years

slide-6
SLIDE 6

Storage 2015

Systems of Interaction

Systems of Interaction

The new era of transforms how companies engage, interact and transact with their customers.

Exploding Data Volumes (Big Data) Diverse Data Types (Big Data) Increasing Value

  • f Information

(Analytics) Mobile and Social Engagement

80%

  • f new data

Block Data = Structured Data (Data Bases, VMs, core business applications) File and Object Data = Unstructured Data (Text, Video, Pictures, Office Docs, Device data, Social and Mobile conversations)

20%

  • f new data

Traditional IT

Mobile/Social

slide-7
SLIDE 7

Storage 2015 Systems of Interaction in Play

Outcome : The Right Car in the Right Place and the Right Time for the Right person

Sales Campaign launch – new C-Class Sales Campaign launch – new C-Class Search information driven from Sales campaign

  • Reviews
  • Colors
  • Options

Locations known for audience!

Big Data (Analytics)

Business Intelligence Tweak the Campaign

Traditional IT

Adjust Inventories, Logistics

Conversations and Social interactions with friends and family around event. Comments on research, word of mouth, etc, all about Mercedes and even their competition.

slide-8
SLIDE 8

Storage 2015

Behind the Scenes is IT supporting this…

If you were to choose .. Which is most important in this list? Lines of Business Driven

LOB accounts for 61% of all IT purchases CMO drives a majority of Mobile/Social/Analytics most often without IT involvement

slide-9
SLIDE 9

Storage 2015 Hybrid Cloud / Public Cloud

IT Need a new storage model that :

  • Frees data from constraints of specialized hardware
  • Lowers overall Costs
  • Provides location independent data services
  • Faster deployment
  • Ease of management and growth
  • Integration with modern APIs and hypervisors
  • Enables Faster time to market!

Business Pressures New Applications Data Growth

Servers are well understood. Storage is exploding Pressure to adapt to a fast and changing business environment

slide-10
SLIDE 10

Storage 2015

What is Software Defined Storage (SDS)?

Key attributes of SDS

  • Runs on commodity hardware: no special hardware or components needed
  • Offers a full suite of storage services: equivalent to traditional hardware specific systems
  • Federates multiple persistent storage resources: internal disk, cloud, other external storage
  • System Leverages:

– Shared nothing architecture – Scale-out model – Virtualization of Storage resources

  • Broadly grouped into three buckets: File-based, Object-based and Block-based

Software-defined storage is any storage software stack that can be installed on any commodity (x86 hardware, hypervisors, or cloud) and/or off-the-shelf computing hardware and used to offer a full suite of storage services and federation between the underlying persistent data placement resources to enable data mobility of its tenants between these resources

slide-11
SLIDE 11

Storage 2015

Software Defined Storage - Basics – Control Plane and Data Plane

Data Plane (Hardware) Control Plane (Software)

Traditional Appliance “Integrated device” Network of Servers with Storage

(Back-End Could be anywhere running

  • n almost anything)

Software Defined Storage

slide-12
SLIDE 12

Storage 2015

Software Defined Storage – Control and Data Planes Concepts

SDS Control Plane (SOFTWARE)

Policy Automation Analytics and Optimization Integration and API Services Backup and Copy Managemen t Storage Virtualization Storage Efficiency

SDS Data Plane (HARDWARE)

Scalable Storage Performance and Capacity

Virtual Storage

Open Common Control Plane to Manage Storage Services for application Workloads

Storage Systems

Provision Service Classes Self- Service Charge back Life Cycle

Monitor and Manage

Storage Interface (GUI)

Security

slide-13
SLIDE 13

Storage 2015

Software Defined Storage – Control and Data Planes How vendors deploy today - Typically

SDS Control Plane (SOFTWARE)

Policy Automation Analytics and Optimization Integration and API Services Backup and Copy Managemen t Storage Virtualization Storage Efficiency

SDS Data Plane (HARDWARE)

Scalable Storage Performance and Capacity Open Common Control Plane to Manage Storage Services for application Workloads

Provision Service Classes Self- Service Charge back Life Cycle

File, Object Unified Block

How we deploy today Tight Coupling

IBM, EMC, NetApp, Hitachi, HP

Specialized, fit to task Hardware Devices “Storage Arrays”

Storage Systems

Security

slide-14
SLIDE 14

Storage 2015

Software Define Storage – Control and Data Planes How the industry is starting to deploy and future direction

SDS Control Plane (SOFTWARE)

Policy Automation Analytics and Optimization Integration and API Services Backup and Copy Services Storage Virtualization Storage Efficiency

SDS Data Plane (HARDWARE)

Scalable Storage Performance and Capacity Open Common Control Plane to Manage Storage Services for the Workloads

Provision Service Classes Self- Service Charge back Life Cycle

File, Block, Object

Customer picks their Deployment Model:

Integrated Appliance (SW+HW), SaaS Cloud, Software Only to deploy on their own hardware platform

Decoupling of HW and SW

Tape Libraries, SSDs, Flash HW appliances, Disks

Security

slide-15
SLIDE 15

Storage 2015

Software Defined Storage – How Does it Work?

  • Most Storage arrays are:
  • Built on Linux, Unix or Windows Kernels - potentially
  • ffering a common code base
  • Most Run on Intel x86 – offering a common hardware

architecture

  • All are based on Server technology at the core – While

delivering advanced data services, most storage products are essentially based on 2 or more servers under the covers.

  • What are the components of a server?
  • CPU and associated architecture
  • Memory
  • Disk Bays (SSD, Hard Drives)
  • PCI BUS- I/O
  • HBAs – Fibre Channel, NICs, SAS
  • Other PCIe cards as needed

IBM V7000 Gen 2 Controller node

slide-16
SLIDE 16

Storage 2015

Software Defined Storage – How Does it work?

  • OK, so storage services are essentially delivered

from a server platform. How does one certify all the possible server platforms out there??

  • Virtualization\Hypervisor – if the server platform is VMware

ESX, Linux KVM, Hyper-V certified it can be certified for use

  • No hardware compatibility lists or expensive testing labs
  • Virtualization vendors have done the interoperability work already
  • Insure required components in the server – software deployed

atop a virtual machine or a virtual appliance should perform basic component checks

  • Does it have the required interfaces? NICs, HBAs
  • Does it have the min amount of memory, drives, CPU cores, etc
  • Is it highly available? i.e. redundancy in components and paths
  • Caution – UPS, Flushing of cache to non-volatile devices
  • Customer responsible for UPS, consistent power

Server 1 Server 2 Server N+1

Data Services

slide-17
SLIDE 17

Storage 2015

Software Defined Storage – Why offer this?

Customer Choice – “Data without Borders”

  • Flexibility of deployment options – no

physical or locational lock-in.

  • Rapid deployment and scaling
  • Standardization on HW - Flat Data Center
  • Repurpose standard servers to storage

services permanently or as needed

  • Can change server vendors without

downtime

  • Reduced Capital Expense- CAPEX
  • Operation Expense models - OPEX
  • Mobility and Manageability between

deployments whether on premise or off, on integrated appliances or your own standardized servers, or choice of cloud

  • Excellent for QA, DEV, TEST, remote
  • ffice, and even DR. Production?

Flat Data Center Economics

  • One server type
  • One element manager
  • Economies of scale
  • Reduced Complexity
slide-18
SLIDE 18

Storage 2015

Software Defined Storage – Customer Choice

Example: IBM XIV

  • Deployment Options
  • IBM Integrated Appliance – pre-built and tested storage arrays

and appliances from IBM. Hardware and Software in an integrated solution.

  • XiV Gen3 – Tier 1 Enterprise Storage offering
  • Software Only Solution – IBM sells XiV storage services as

software (Spectrum Accelerate) to deploy on Virtual machine (ESX and KVM) that the customer chooses.

  • Storage as a Service (SaaS) offer in IBM’s SoftLayer Cloud or
  • ther Clouds – storage services delivered from the cloud.

Installed on Standard Servers deployed in a public cloud. OPEX model. SLA driven.

IBM HW and Software Bundled XiV Gen3 IBM SW deployed on customer’s choice of server HW wherever it may be. IBM XiV data/storage services served from SoftLayer, Amazon, Azure Clouds

as software

All storage is manageable and interoperable between the different deployments models

Lenovo, HP, Dell,

  • r other servers
slide-19
SLIDE 19

Storage 2015

Software Defined Storage – What might this look like?

IBM Spectrum Accelerate – “Data without Borders” IT Data Center Core (HQ)

Integrated Storage Appliance (HW + SW) On Premise

Disaster Recovery CLOUD

Storage Services (SaaS) On Public Cloud

Remote Branch Office

Storage Services on Standard Servers On Premise

  • Same Functionality
  • 100% Interoperable
  • Location independent

storage services

  • Allows for Hybrid

Cloud

The new Customer We need sharable storage that can be deployed quickly, scale as we grow, be installed where we need on our choice

  • f HW with no HW lock-in, and be

location independent. What are our

  • ptions?
slide-20
SLIDE 20

Storage 2015

Converged Infrastructures – SW at the center

Definition

Converged infrastructure is a computing infrastructure that includes two

  • r more computing solutions combined and delivered through joint

collaboration as a unified solution. Converged infrastructure uses a preconfigured computing solution provided by one or more vendors. It is primarily designed to provide centralized management of IT resources, where complete pools of resources are managed through a single control panel. Converged infrastructure is also known as infrastructure in a box.

https://www.techopedia.com/definition/26580/converged-infrastructure

slide-21
SLIDE 21

Storage 2015

Converged (Integrated) Infrastructure

Server, Storage, and Networking in a defined and validated architecture but still separate and distinct components.

  • Cisco UCS
  • Networking

Cisco Nexus Network Cisco MDS

  • Servers

Cisco Rack and Blade models

  • Storage
  • VCE Block (EMC)
  • FlexPod (NetApp)
  • VersaStack (IBM)
  • HP ConvergeSystem portfolio

Software in the solution manages all of the components and provide automation and orchestration.

5 10 15 1 2 3 4 6 7 8 9 11 12 13 14 16 17 22 27 32 37 42 18 19 20 21 23 24 25 26 28 29 30 31 33 34 35 36 38 39 40 41 5 10 15 1 2 3 4 6 7 8 9 11 12 13 14 16 17 22 27 32 37 42 18 19 20 21 23 24 25 26 28 29 30 31 33 34 35 36 38 39 40 41

SR42UB SR42UB

Storwize V7000 Unified Storwize V7000 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Expansion CISCO UCS 6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 STAT ID STS BCN ACT Cisco Nexus 9396PX 1 2 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 STS BCN ACT Cisco Nexus 9396PX 1 2 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 DS-C9148S-K9 P/S FAN STATUS CONSOLE MGMT ETH LINK ACT MDS 9148S 16G Multilayer Fabric Switch 47 48 45 46 43 44 41 42 39 40 37 38 35 36 33 34 31 32 29 30 27 28 25 26 23 24 21 22 19 20 17 18 15 16 13 14 11 12 9 10 7 8 5 6 3 4 1 2 USB CISCO UCS 6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 STAT ID DS-C9148S-K9 P/S FAN STATUS CONSOLE MGMT ETH LINK ACT MDS 9148S 16G Multilayer Fabric Switch 47 48 45 46 43 44 41 42 39 40 37 38 35 36 33 34 31 32 29 30 27 28 25 26 23 24 21 22 19 20 17 18 15 16 13 14 11 12 9 10 7 8 5 6 3 4 1 2 USB 24 1 System Storage Storwize V7000 Unified UCS C220 M3 3 8 2 7 1 6 5 4 CONSOLE ! UCS C220 M3 3 8 2 7 1 6 5 4 CONSOLE ! SLOT 1 SLOT 5 SLOT 3 SLOT 7 SLOT 2 SLOT 6 SLOT 4 SLOT 8 ! UCS 5108 OK FAIL OK FAIL OK FAIL OK FAIL ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 SLOT 1 SLOT 5 SLOT 3 SLOT 7 SLOT 2 SLOT 6 SLOT 4 SLOT 8 ! UCS 5108 OK FAIL OK FAIL OK FAIL OK FAIL ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 ! Reset Console UCS B200 M3 Storwize V7000 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Control Storwize V7000 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Control

Nexus 9396 Switches MDS 9148S FC Switches (OPTION) UCS 6248UP Fabric Interconnects UCS C Series Rack Servers (C-220) UCS 5108 Blade Chassis with M3/M4 B-200 Blades

IBM V7000 Unified

slide-22
SLIDE 22

Storage 2015

Hyper-Converged Infrastructure Server, Storage, and Networking in a defined and validated architecture built on a common x86 server platform. Whole stack integration with servers as the hardware component.

Holistic view and integration of all required system components with simple linear scalability. No more specialty areas, disciplines and skills. X86 Sever Building Blocks

slide-23
SLIDE 23

Storage 2015

SDS Advantages Deployed on standard server hardware from a variety of vendors – Customer Choice. Complements and transforms existing infrastructure to support next generation applications and deployment models Built on and exploiting robust proven virtualization technology and supporting multiple Cloud APIs Customer wins with lower costs with CAPEX and OPEX deployment options, data mobility, and agility to respond to business demands. Flexible and rapid deployment models: on cloud(s), as an integrated appliance, and as software on client’s choice of server hardware

22

slide-24
SLIDE 24

Storage 2015

SDS Cautions Total certainty of underlying HW is not known. Some lack of control Ie. UPS, Battery backup Shift in design of the way things can fail. HA achieved by designing for failure rather than assuming control of it. Newer technology, not performance proven. Being consumed as general purpose storage. Still FUD in play. Supportability – Is it the HW or the SW – Different vendors potentially providing the solution. Political and Organizational Change – Server and Storage groups need to unite. Network as well.

23

slide-25
SLIDE 25

Storage 2015

Thanks!

24

slide-26
SLIDE 26

Storage 2015

What is required to run an Application?

Application Code (Software) runs on:

  • CPU
  • Memory
  • Storage
  • I/O ports for communication
  • Network to communicate between systems and clients

Storage = Persistence Data

  • Disk
  • Flash (NAND)
  • Tape
  • Optical

LAN/SAN

Server