OpenStack Architecture for the Enterprise Keith Tobin Greg Jacobs - - PowerPoint PPT Presentation

openstack architecture for the enterprise
SMART_READER_LITE
LIVE PREVIEW

OpenStack Architecture for the Enterprise Keith Tobin Greg Jacobs - - PowerPoint PPT Presentation

OpenStack Architecture for the Enterprise Keith Tobin Greg Jacobs Cloud Architect Network Architect Speaker Profiles Keith Tobin Greg Jacobs Dell Cloud Architect Dell Network Architect 20 years working as a network Located in


slide-1
SLIDE 1

OpenStack Architecture for the Enterprise

Keith Tobin

Cloud Architect

Greg Jacobs

Network Architect

slide-2
SLIDE 2

2

Services OpenStack Architecture for the Enterprise

Speaker Profiles

  • Dell Cloud Architect
  • Located in the Dell Cloud Center of

Excellence in Dublin, Ireland

  • Over two decades of software,

platform and cloud development

  • Organizer for OpenStack Ireland
  • Loves all things OpenStack and

Cloud

Keith Tobin

  • Dell Network Architect
  • 20 years working as a network

architecture and solutions specialist

  • Network evangelist and packet head

Greg Jacobs

slide-3
SLIDE 3

3

Services OpenStack Architecture for the Enterprise

Design Goals

  • Design an OpenStack architecture to run both enterprise and cloud

applications

  • Meet enterprise performance expectations for VM’s, networking and storage
  • Zero downtime on the control layer
  • No data loss in the event of a single node failure
  • Must be durable, reliable and highly available
  • Must automatically recover after a fault situation has been fixed
  • Minimize management tasks
slide-4
SLIDE 4

4

Services OpenStack Architecture for the Enterprise

Solution Stack

Deployment Storage Networking Physical Layer Servers

R620 R720 C6100 Crowbar

SUSE Linux

SUSE Linux

Security

SecureWorks

Managed

Cloud Services

OpenStack

OpenStack Titanium Force10 SonicWall CEPH on R720 Tested Qualified Solution

Dell Multi-Cloud Manager

Enstratius

Dell Private Managed Cloud Solution

slide-5
SLIDE 5

5

Services OpenStack Architecture for the Enterprise

Deployment With Crowbar

slide-6
SLIDE 6

6

Services OpenStack Architecture for the Enterprise

Deploying OpenStack with Crowbar Is Easy

  • Crowbar boots and installs from ISO on a management node (server)
  • Provides user with web UI for configuration and operations management
  • Discovers all potential targets (servers) automatically
  • Performs hardware configuration

– BIOS configuration – Performs updates to BIOS and firmware

  • Installs OS on targets
  • Deploys OpenStack from a set of configuration modules called barclamps
slide-7
SLIDE 7

7

Services OpenStack Architecture for the Enterprise

Crowbar Deployment

Chef Server Crowbar PXE DHCP

Identity Barclamp Database Barclamp Image Barclamp Networking Barclamp Block storage Barclamp Nova Barclamp Horizon Barclamp Controller Node 01 Controller Node 02 Controller Node 03 Compute Node 01 Compute Node 02 Compute Node 03

OpenStack

slide-8
SLIDE 8

8

Services OpenStack Architecture for the Enterprise

Crowbar 2 Status

slide-9
SLIDE 9

9

Services OpenStack Architecture for the Enterprise

Load Balancer

slide-10
SLIDE 10

10

Services OpenStack Architecture for the Enterprise

Active/Passive (Normal)

Load Balancer 01 (Active) Load Balancer 02 (Passive) Keystone etc… Keystone etc… Keystone etc… KeepaliveD KeepaliveD

VIP

Controller 01 Controller 02

Load Balancer 01 (Inactive) Load Balancer 02 (Active)

Incoming API Requests

slide-11
SLIDE 11

11

Services OpenStack Architecture for the Enterprise

Load Balancer 01 (Active) Load Balancer 02 (Passive) Keystone etc… Keystone etc… Keystone etc… KeepaliveD KeepaliveD

Controller 01 Controller 02

VIP

Load Balancer 01 (Inactive) Load Balancer 02 (Active)

Incoming API Requests

Active/Passive (Fault)

slide-12
SLIDE 12

12

Services OpenStack Architecture for the Enterprise

Single HAProxy Bottleneck

HAProxy Horizon Glance-API Nova- scheduler Nova-API Keystone-API Neutron-API Cinder-API Neutron L2 Neutron L3 Neutron DHCP Glance- registry RabbitMQ MySQL

iVIP eVIP

HAProxy Horizon Glance-API Nova- scheduler Nova-API Keystone-API Neutron-API Cinder-API Neutron L2 Neutron L3 Neutron DHCP Glance- registry RabbitMQ MySQL

Controller 01 (Active LB) Controller 02 Inactive LB

slide-13
SLIDE 13

13

Services OpenStack Architecture for the Enterprise

Dynamic Load Balancing

HAProxy

HAProxy Keystone etc… Keystone etc… Keystone etc… Quagga Quagga

Controller 01 Controller 02

HAProxy Quagga

Controller 03

Network Switch Network Switch

OSPF ECMP Incoming API Traffic

slide-14
SLIDE 14

14

Services OpenStack Architecture for the Enterprise

Neutron

slide-15
SLIDE 15

15

Services OpenStack Architecture for the Enterprise

Neutron (Single Networking Node)

Keystone Glance MySQL etc… Controller 01 Keystone Glance MySQL etc… Controller 02

Nova

Compute 01

Nova

Compute 03 Network 01

OVS Agent L3 Agent DHCP Agent Neutron API

Internet

Nova

Compute 02

Nova

Compute 04

slide-16
SLIDE 16

16

Services OpenStack Architecture for the Enterprise

Neutron (Separate Networking Nodes)

Controller 01 Compute 01

OVS Agent L3 Agent DHCP Agent Neutron API

Internet

Controller 02

Neutron API

Ect…. Controller 03

Neutron API Neutron Scheduler Neutron Scheduler Neutron Scheduler

Compute 02

OVS Agent L3 Agent DHCP Agent

Compute 03

OVS Agent L3 Agent DHCP Agent

Compute 04

OVS Agent L3 Agent DHCP Agent Other OpenStack Services Other OpenStack Services Other OpenStack Services HAProxy HAProxy HAProxy Quagga Quagga Quagga

slide-17
SLIDE 17

17

Services OpenStack Architecture for the Enterprise

RabbitMQ

slide-18
SLIDE 18

18

Services OpenStack Architecture for the Enterprise

RabbitMQ Cluster (With Mirrored Queues)

Controller 01

RabbitMQ

Controller 02

RabbitMQ

Ect…. Controller 03

RabbitMQ Other OpenStack Services Other OpenStack Services Other OpenStack Services HAProxy HAProxy HAProxy Quagga Quagga Quagga

Dynamic Load Balancer

Physical View Logical View

End Point

RabbitMQ 01 RabbitMQ 02 RabbitMQ 03

slide-19
SLIDE 19

19

Services OpenStack Architecture for the Enterprise

MySQL Database

slide-20
SLIDE 20

20

Services Openstack Architecture for the Enterprise

MySQL Single Server (Normal Operation)

DB Server

Data

Application

slide-21
SLIDE 21

21

Services Openstack Architecture for the Enterprise

MySQL Single Server (Failed)

DB Server 1 (Active)

Data

Application

slide-22
SLIDE 22

22

Services Openstack Architecture for the Enterprise

MySQL Single Server (Failed)

DB Server 1 (Active)

Data

Application

  • Disadvantage
  • Single point of failure
slide-23
SLIDE 23

23

Services Openstack Architecture for the Enterprise

MySQL Active/Passive Failover

slide-24
SLIDE 24

24

Services Openstack Architecture for the Enterprise

MySQL Active/Passive Failover (Normal Operation)

DB Server 1 (Active)

Data

DB Server 2 (Passive)

Data

Application

Async Replication

DB Server 1 (Failed)

Data

DB Server 2 (Active)

Data

MySQL Active/Passive Failover (Failed Node)

Disadvantages

  • Inactive Server
  • Limits scale
  • Reduces the potential

workload processing ability of the solution by half

  • Async replication has

potential for data inconsistencies across server nodes in fault situations

slide-25
SLIDE 25

25

Services Openstack Architecture for the Enterprise

MySQL With DRDB

slide-26
SLIDE 26

26

Services Openstack Architecture for the Enterprise

MySQL With DRDB (Normal Operation)

DB Server 1

Data

DB Server 2

Data

Application

Event Event Confirmed

Server Not Available !

Disadvantages

  • Inactive server
  • Limits scale
  • Reduces the potential

workload processing ability of the solution by half

(Failed)

slide-27
SLIDE 27

27

Services Openstack Architecture for the Enterprise

MySQL Multi- Master

slide-28
SLIDE 28

28

Services Openstack Architecture for the Enterprise

MySQL Multi-Master Cluster

DB Server 1

Data

Application 01 DB Server 2

Data

DB Server 3

Data

Load balancer Application 02

slide-29
SLIDE 29

29

Services Openstack Architecture for the Enterprise

MySQL Multi-Master Cluster (Failed Node)

DB Server 1

Data

Application 01 DB Server 2

Data

DB Server 3

Data

Load balancer Application 02

slide-30
SLIDE 30

30

Services Openstack Architecture for the Enterprise

MySQL Async Replication

Server 1

Data

Server N

Data

  • No guarantee that data

will be consistent across all nodes at any point in time

slide-31
SLIDE 31

31

Services Openstack Architecture for the Enterprise

MySQL Single Thread replication

C1 C2 C3 C4 C5 C6 C7 C8

Processor

slide-32
SLIDE 32

32

Services Openstack Architecture for the Enterprise

MySQL Multi-Master Cluster

DB Server 1

Data

Application 01 DB Server 2

Data

DB Server 3

Data

Load balancer Application 02

Disadvantages

  • At any point in time there

is no guarantee that data is in a consistent state within the cluster

  • One thread allocated for

replication tasks

slide-33
SLIDE 33

33

Services Openstack Architecture for the Enterprise

Percona MySQL Cluster

slide-34
SLIDE 34

34

Services Openstack Architecture for the Enterprise

Percona MySQL Cluster

Capability Synchronous Replication Data Consistency Parallel Applying on All Nodes Automatic Node Provisioning Multi-Master

slide-35
SLIDE 35

35

Services Openstack Architecture for the Enterprise

Synchronous Replication

Capability Synchronous Replication Data Consistency Parallel Applying on All Nodes Automatic Node Provisioning

Multi-Master

Controller DB 1

Data

Controller DB 2

Event Event Confirmed

Application 01

Data

slide-36
SLIDE 36

36

Services Openstack Architecture for the Enterprise

Data Consistency

Controller DB 1

Data

Controller DB 2

Data

Server DB 3

Data

Capability Synchronous Replication Data Consistency Parallel Applying on All Nodes Automatic Node Provisioning

Multi-Master

At any point in time data is always consistent across all nodes in the cluster

slide-37
SLIDE 37

37

Services Openstack Architecture for the Enterprise

Parallel Applying on All Nodes

C1 C2 C3 C4 C5 C6 C7 C8

Processor

Capability Synchronous Replication Data Consistency Parallel Applying on All Nodes Automatic Node Provisioning

Multi-Master

slide-38
SLIDE 38

38

Services Openstack Architecture for the Enterprise

Automatic Node Provisioning

Controller DB 4 Data

Join Cluster Join Cluster

Controller DB 1 Data Controller DB 3 Data Controller DB 2 Data

New Node Cluster

Capability Synchronous Replication Data Consistency Parallel Applying on All Nodes Automatic Node Provisioning

Multi-Master

slide-39
SLIDE 39

39

Services Openstack Architecture for the Enterprise

Multi-Master Cluster

Controller DB 1 Data

Application 01

Controller DB 2 Data Controller DB 3 Data

Dynamic Load balancer Application 02

Capability Synchronous Replication Data Consistency Parallel Applying on All Nodes Automatic Node Provisioning

Multi-Master

slide-40
SLIDE 40

40

Services OpenStack Architecture for the Enterprise

Block Storage

slide-41
SLIDE 41

41

Services OpenStack Architecture for the Enterprise

Block Storage

CEPH on R720

slide-42
SLIDE 42

42

Services OpenStack Architecture for the Enterprise

Logical Architecture

slide-43
SLIDE 43

43

Services OpenStack Architecture for the Enterprise

Thank you Chat with Keith and Greg @ the Dell booth

Keith Tobin

Cloud Architect

Greg Jacobs

Network Architect