Beyond Virtualization Derek Collison - Apcera, Inc. @derekcollison - - PowerPoint PPT Presentation

▶
beyond virtualization
SMART_READER_LITE
LIVE PREVIEW

Beyond Virtualization Derek Collison - Apcera, Inc. @derekcollison - - PowerPoint PPT Presentation

Apr 17, 2023 302 likes •829 views

Beyond Virtualization Derek Collison - Apcera, Inc. @derekcollison June 12, 2014 - QCon New York About Derek Collison Architected and built TIBCO Rendezvous and EMS Messaging Systems Co-founded AJAX APIs group

slide-1
SLIDE 1

Derek Collison - Apcera, Inc. @derekcollison

  • June 12, 2014 - QCon New York

Beyond Virtualization

slide-2
SLIDE 2

@derekcollison QCon NY: “Beyond Virtualization”

About

  • Architected and built TIBCO Rendezvous

and EMS Messaging Systems

  • Co-founded AJAX APIs group at Google
  • Designed and built Cloud Foundry
  • Founder and CEO at Apcera
  • Inspiration: Fast Distributed Systems

2

Derek Collison

slide-3
SLIDE 3

@derekcollison QCon NY: “Beyond Virtualization”

The future of enterprise IT lies beyond virtualization

3

slide-4
SLIDE 4

@derekcollison QCon NY: “Beyond Virtualization”

Virtualization ==

4

slide-5
SLIDE 5

@derekcollison QCon NY: “Beyond Virtualization”

EVERYTHING is a distributed system these days

5

slide-6
SLIDE 6

@derekcollison QCon NY: “Beyond Virtualization”

So orchestration and composing systems will define the future

6

slide-7
SLIDE 7

@derekcollison QCon NY: “Beyond Virtualization”

To look into the future Let’s see where we are

7

slide-8
SLIDE 8

@derekcollison QCon NY: “Beyond Virtualization”

IT Today

8

Old school Virtualization IaaS IaaS, SaaS, PaaS Cloud

?

slide-9
SLIDE 9

@derekcollison QCon NY: “Beyond Virtualization”

We care about what’s next

9

?

slide-10
SLIDE 10

@derekcollison QCon NY: “Beyond Virtualization”

Automate undifgerentiated heavy lifting, speed up the mundane

10

slide-11
SLIDE 11

@derekcollison QCon NY: “Beyond Virtualization”

Orchestrate Secure and Compliant Composeable Systems

11

slide-12
SLIDE 12

@derekcollison QCon NY: “Beyond Virtualization”

Align the value to you with the value to your organization

12

slide-13
SLIDE 13

@derekcollison QCon NY: “Beyond Virtualization”

Build what you need..

13

slide-14
SLIDE 14

@derekcollison QCon NY: “Beyond Virtualization”

Assemble the rest

14

slide-15
SLIDE 15

@derekcollison QCon NY: “Beyond Virtualization”

PaaS helps

15

slide-16
SLIDE 16

@derekcollison QCon NY: “Beyond Virtualization”

PaaS Helps

16

  • Tries to speed up deployment
  • Preset, biased approach
  • Only a small piece of the puzzle
  • Enterprises need lifecycle

management, security, compliance, governance, etc.

slide-17
SLIDE 17

@derekcollison QCon NY: “Beyond Virtualization”

PaaS is Not Enough

http://apcera.com/blog/paas-is-not-enough/

17

slide-18
SLIDE 18

@derekcollison QCon NY: “Beyond Virtualization”

Docker helps

18

slide-19
SLIDE 19

@derekcollison QCon NY: “Beyond Virtualization”

Docker Helps

19

  • The dawn of the composeable

enterprise

  • More control over the pieces
  • Great Ecosystem!
slide-20
SLIDE 20

@derekcollison QCon NY: “Beyond Virtualization”

DockerCon Initiatives

20

  • libSwarm
  • libContainer
  • libChan
slide-21
SLIDE 21

@derekcollison QCon NY: “Beyond Virtualization”

Docker The Future

21

  • Identity
  • Authorization
  • Trust
slide-22
SLIDE 22

@derekcollison QCon NY: “Beyond Virtualization”

Docker TBDs

22

  • How to compose and
  • rchestrate the system?
  • etcd? confd?
  • Make it transparent
  • Don’t make me rewrite
  • libSwarm, libChan?
  • What about compliance?
  • Heartbleed?
  • Linux zero-day exploit?
  • Tell me if I am compliant
  • Tell me what is at risk
slide-23
SLIDE 23

@derekcollison QCon NY: “Beyond Virtualization”

We Want Things to Just Work

23

  • Self Service
  • Composeable Systems (legos)
  • Faster Iterative Development
  • Faster Deployments
  • Fault Tolerance
  • High Availability
  • Guaranteed SLAs
slide-24
SLIDE 24

@derekcollison QCon NY: “Beyond Virtualization”

We’re getting there

24

slide-25
SLIDE 25

@derekcollison QCon NY: “Beyond Virtualization”

The Future of IT

25

  • Declarative
  • Composeable
  • Extreme Agility
  • Security and Compliance -

Transparently

  • Fluid and Abstracted

Infrastructure and Services

  • Multiple delivery models in one

system

slide-26
SLIDE 26

@derekcollison QCon NY: “Beyond Virtualization”

Declarative

C C B

26

  • App A needs:
  • X memory and Y CPU
  • N storage
  • I/O SLAs for talking to B and C
  • available URL for trusted

identities

  • run on premise, co-located 


near B

App A B C t a l k s t

  • t

a l k s t

slide-27
SLIDE 27

@derekcollison QCon NY: “Beyond Virtualization”

Intelligent workloads

27

App A

slide-28
SLIDE 28

@derekcollison QCon NY: “Beyond Virtualization”

Intelligent systems

28

App A

slide-29
SLIDE 29

@derekcollison QCon NY: “Beyond Virtualization”

Where do we start?

29

slide-30
SLIDE 30

@derekcollison QCon NY: “Beyond Virtualization”

Required Functionality

30

  • What App A needs
  • Where App A runs
  • How App A finds B and C
  • How others find App A
  • What happens on failures
slide-31
SLIDE 31

@derekcollison QCon NY: “Beyond Virtualization”

Required Functionality

31

  • What App A needs


Packaging & Dependencies

  • Where App A runs

Provisioning & Scheduling

  • How App A finds B and C

Addressing & Discovery

  • How others find App A

External Mapping

  • What happens on failures

Monitoring & Management

slide-32
SLIDE 32

@derekcollison QCon NY: “Beyond Virtualization”

Packaging & Dependencies

32

  • What the job needs to run
  • Changes from Dev to Prod
  • Runtimes, OS, libraries
  • Who defines what these are
  • Whether existing tools are

sufficient for consistency, compliance, auditing

  • SCCS and Chef / Puppet
  • AMIs or VMDKs
  • Docker Images

App A DEV PROD runtimes OS libraries runtimes OS libraries

slide-33
SLIDE 33

@derekcollison QCon NY: “Beyond Virtualization”

Provisioning & Scheduling

33

  • Where workloads run
  • Network perimeter security

models

  • Unit of work: VM, App, Image
  • Automatic, instantaneous and

transparent policy compliance

  • Compliance and deployment

handled independently

  • New tools: Mesos, Fleet, Diego

500ms 10 weeks 2 min. human behavior change

Speed

slide-34
SLIDE 34

@derekcollison QCon NY: “Beyond Virtualization”

Addressing & Discovery

34

  • DNS is insufficient - inside
  • Needs to fit what we have,

without changing apps

  • System reacts as things move
  • Load balancing
  • Scaling up and down

ETCD / CONFD External Internal

X ✓ ✓ ✓ ✓

Router Router

slide-35
SLIDE 35

@derekcollison QCon NY: “Beyond Virtualization”

External Mapping

  • HTTP/TCP connectivity
  • How do you find something?
  • Load balancing
  • Rapid scaling
  • Health monitoring and repair
  • DNS sufficient for external, but

not internal

35

External Internal

X ✓ ✓ ✓ ✓

Router Router

slide-36
SLIDE 36

@derekcollison QCon NY: “Beyond Virtualization”

Monitoring & Management

36

  • What happens when

something fails?

  • Manual or Automatic?
  • Who determines failure and

whether we trust the system

  • Its sick, not dead
  • Latency vs. Chaos monkey
  • Measure the effect of change

beforehand?

  • Extensible & Pluggable

BORG / Omega

Latency Chaos

slide-37
SLIDE 37

@derekcollison QCon NY: “Beyond Virtualization”

Bolt-on is not the way to get there

37

slide-38
SLIDE 38

@derekcollison QCon NY: “Beyond Virtualization”

What we need is a platform OS

38

slide-39
SLIDE 39

@derekcollison QCon NY: “Beyond Virtualization”

Programmable, pluggable, and composeable from the inside

  • ut

39

slide-40
SLIDE 40

@derekcollison QCon NY: “Beyond Virtualization”

The secure, hybrid, trusted platform OS for multi-datacenter

40

slide-41
SLIDE 41

@derekcollison QCon NY: “Beyond Virtualization”

A Platform OS

41

  • All resources in a common pool
  • Real-time networking,

addressing, and discovery

  • Awareness of ontologies AND

communication semantics

  • Contextual security and policy

just work

  • Built for rapid change - all change
  • Policy-compliant resource

isolation, connectivity, and SLAs

C C App A C t a l k s t

  • pattern data

behavior policy

  • n the fly
slide-42
SLIDE 42

@derekcollison QCon NY: “Beyond Virtualization”

We Have the Right Pieces

42

  • Isolation Contexts - Docker
  • SDN - Software-Defined

Networking

  • Management and Resource

Pooling (CMPs)

  • Intelligent and Compliant Job

Scheduling

  • Intelligent Canarying, A/B

rollouts and testing Just not in one place

slide-43
SLIDE 43

@derekcollison QCon NY: “Beyond Virtualization”

Isolation Context

  • Isolation Context: isolated, insulated, autonomous
  • Speed and weight
  • Hypervisors for virtualization
  • LXC, libContainer (containers) - Docker
  • Micro-task virtualization
  • Google chargeback diversion

43

Faster, more lightweight and purpose-built

Virtualization Containerization Micro-task Virtualization

slide-44
SLIDE 44

@derekcollison QCon NY: “Beyond Virtualization”

SDN - Software-Defined Networking

44

  • Network perimeter security
  • Application-level changes
  • Layer 7 semantics
  • How many INSERTS per

second from all of App A?

  • Can I disallow DROP and

DELETE calls between 1-3AM?

  • Compliant and transparent

network

  • It just works, e.g. mobile
slide-45
SLIDE 45

@derekcollison QCon NY: “Beyond Virtualization”

Intelligent, Compliant Job Scheduling

  • Pick the best place to run for a

given job and policy

  • How the system rebalances

and utilizes new resources

  • Centralized or Distributed

algorithms

  • How policy affects decision-

making (e.g., geography)

  • New tools: Mesos, Fleet, Diego

45

slide-46
SLIDE 46

@derekcollison QCon NY: “Beyond Virtualization”

Intelligent Canarying

Prod

  • Measured rollout success
  • A/B testing
  • Blue-green deployments
  • Automated rollout and rollback

46

10% traffic

Dev

90% traffic App A

v1

App A

v2

Rollout Rollback

slide-47
SLIDE 47

@derekcollison QCon NY: “Beyond Virtualization”

Intelligent Canarying

  • A lot of data needed
  • resource utilizations: CPU,

Mem, Storage

  • communication patterns:

cascading effects

  • temporal awareness
  • All data will feed into

automated, anomaly detection services

  • Utilizing unsupervised deep

machine learning

47

slide-48
SLIDE 48

@derekcollison QCon NY: “Beyond Virtualization”

The Future of IT - Platform OS

48

Hardware IaaS Diverse Workloads (e.g., apps, services)

Provisioning Scheduling Health Monitoring Addressing Discovery Governance Compliance Security Automation Orchestration

Internal Services External Services

One Platform

slide-49
SLIDE 49

@derekcollison QCon NY: “Beyond Virtualization”

Summary

49

slide-50
SLIDE 50

@derekcollison QCon NY: “Beyond Virtualization”

Summary

50

  • Composeable platforms
  • Intelligent workloads sans code

changes

  • Policy aware...
  • Packaging and Dependency

Management

  • Job Scheduling and Provisioning
  • Addressing, Discovery, Networking
  • Monitoring and Management
  • Lifecycle Management and

Intelligent Canarying

A POLICY OF INNOVATION

slide-51
SLIDE 51

@derekcollison QCon NY: “Beyond Virtualization”

Resources

51

  • Docker - https://www.docker.io
  • Mesos - http://mesos.apache.org
  • CoreOS - https://coreos.com
  • Fleet, Etcd - https://coreos.com/using-coreos/etcd
  • Consul - http://www.consul.io
  • Continuum - http://apcera.com/continuum
slide-52
SLIDE 52

Derek Collison - Apcera, Inc. @derekcollison

  • June 12, 2014 - QCon New York

Thank You