Cloud Computing with Amazon Web Services and the DevOps Methodology - - PowerPoint PPT Presentation

cloud computing with amazon web services and the devops
SMART_READER_LITE
LIVE PREVIEW

Cloud Computing with Amazon Web Services and the DevOps Methodology - - PowerPoint PPT Presentation

Cloud Computing with Amazon Web Services and the DevOps Methodology www.cloudreach.com Who am I? www.cloudreach.com Cloud Computing with Amazon Web Services and the DevOps Methodology Max Manders @maxmanders Systems Developer at Cloudreach


slide-1
SLIDE 1

Cloud Computing with Amazon Web Services and the DevOps Methodology

www.cloudreach.com

slide-2
SLIDE 2

Who am I?

www.cloudreach.com

slide-3
SLIDE 3

Max Manders @maxmanders Systems Developer at Cloudreach @cloudreach Director / Co-Founder of Whisky Web @whiskyweb

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-4
SLIDE 4

Who are Cloudreach?

www.cloudreach.com

slide-5
SLIDE 5
  • Multi-platform cloud integrator for the

enterprise.

  • Top tier partner with

○ Amazon Web Services ○ Google ○ Heroku ○ SalesForce www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-6
SLIDE 6

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-7
SLIDE 7

What do Cloudreach do?

www.cloudreach.com

slide-8
SLIDE 8
  • Consultancy Services
  • Migration Services

○ Moving platforms to the cloud ○ Migrating business to Google Apps

  • Application Development

○ Mobile development - Android/iOS ○ SalesForce integration

  • Managed Services

○ 24/7 Monitoring ○ Break/Fix ○ Business As Usual / Keeping lights on www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-9
SLIDE 9
  • Amazon Web Services

○ Cloud computing platform

  • Chef

○ Configuration management

  • Splunk

○ Data collection ○ "Big data" Analytics

  • Zenoss

○ Monitoring and alerting

  • Jira

○ "Agile" issue tracker & team management www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-10
SLIDE 10

What is Cloud Computing?

www.cloudreach.com

slide-11
SLIDE 11

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

Paid For Required

  • Traditionally pay for fixed capacity

○ VPS / co-location ○ Not always on ○ Underutilised Variable Utilisation

slide-12
SLIDE 12

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

  • Traditionally pay for fixed capacity

○ Stepwise expansion ○ Underutilised

Paid For Required

Investing in Expected Capacity

slide-13
SLIDE 13

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

  • Traditionally pay for fixed capacity

○ Underprovisioned ■ Lost revenue at peaks ○ Overprovisioned ■ Underutilised Unexpected Peaks Expected Peaks

slide-14
SLIDE 14

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

Wouldn't it be nice if the red line more closely followed the blue line? With the cloud and Amazon Web Services, it can; and you only pay for what you use.

slide-15
SLIDE 15
  • Traditional infrastructure

○ Physical racks in data centres ○ Manually replace faulty hardware ○ Scaling up ■ Provision and install new hardware ○ Scaling down!? www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-16
SLIDE 16
  • Elasticity

○ Scale up in response to spikes ○ Scale down afterwards ○ No CapEx ○ Pay as you go www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-17
SLIDE 17
  • Elasticity

○ Disk space on demand ○ Networking on demand ○ CPU on demand ○ RAM on demand www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-18
SLIDE 18
  • Virtualised infrastructure
  • Abstracted hardware detail
  • Still need physical hardware
  • Managed reliably by someone else

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-19
SLIDE 19
  • Agile

○ Try new things without heavy

investment

○ Scrap ideas without significant

  • verhead.
  • "Just In Time"

○ Expecting increased traffic, spin up

new temporary resource.

  • Typically HTTP API to cloud resources

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-20
SLIDE 20
  • X as a Service

○ Application ○ Infrastructure ○ Platform ○ Network ○ Storage ○ Database ○ Etc. www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-21
SLIDE 21

Amazon Web Services

www.cloudreach.com

slide-22
SLIDE 22
  • Amazon.com not just a retailer
  • Amazon.com built on top of AWS
  • Built to be resilient
  • Geographic diversity

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-23
SLIDE 23
  • Multiple interfaces to API

○ Command line tools ○ HTTP API ○ Web Console ○ SDKs (Ruby, Java, Python etc.) www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-24
SLIDE 24

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

Regions / Availability Zones Compute EC2 Storage S3, EBS, Glacier Network VPC, ELB, Route 53, Autoscaling Groups Database RDS, ElasticCache, DnaymoDB Processing MapReduce CDN CloudFront Communication SNS, SES, SQS Auth IAM, MFA Deployment CloudFormation, Elastic Beanstalk Monitoring CloudWatch Libraries / SDKs Java, .Net, Ruby, Python etc. Command Line Tools AWS-CLI, JQ Web Console, Mobile Apps

slide-25
SLIDE 25
  • Regions

○ us-east-1, us-west-1, us-west-2

  • Availability Zones

○ eu-west-1a, eu-west-1b ○ Diverse network, bandwidth ○ Isolated from other AZs www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-26
SLIDE 26

Elastic Compute Cloud (EC2)

www.cloudreach.com

slide-27
SLIDE 27
  • On demand compute power
  • Basically a Virtual Machine with extras
  • Based on AMIs
  • Different instance sizes

○ Micro ~ 512Mb RAM, 1 CPU ○ Cluster 8 XL ~ 244Gb RAM, 88 CPU

  • Boot a new instance in minutes
  • Public DNS and IP address

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-28
SLIDE 28
  • Choice of OS

○ Linux, Windows, FreeBSD,

OpenSolaris

  • CloudWatch monitoring
  • Snapshots / Backups
  • Build AMIs for VM templates
  • Choice of pricing model

○ On Demand, Reserved, Spot www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-29
SLIDE 29

Storage Solutions (EBS, S3, Glacier)

www.cloudreach.com

slide-30
SLIDE 30
  • Elastic Block Store

○ Analogous to traditional hard disks ○ Commonly used as primary instance

storage

○ Block level device access www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-31
SLIDE 31
  • Simple Storage Service

○ Geographically distributed for

redundancy

○ Can be used in conjunction with

Route 53 to host static sites!

○ Useful for backup purposes ○ Currently > 1.3Tn objects www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-32
SLIDE 32
  • Glacier

○ Very low storage cost ○ Designed for infrequent retrieval ○ Retrieval time of several hours ○ Not for servicing real time requests ○ Long term backup solution e.g. for

data retention compliance

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-33
SLIDE 33

Elastic Load Balancer (ELB)

www.cloudreach.com

slide-34
SLIDE 34
  • Distribute load across many back-end

instances

  • Multiple AZ support
  • Complemented by Autoscale Groups

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-35
SLIDE 35

Demo - AWS Console

www.cloudreach.com

slide-36
SLIDE 36

What is DevOps?

www.cloudreach.com

slide-37
SLIDE 37
  • Buzzword
  • Mindset
  • Social Perspective
  • Technical Perspective

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-38
SLIDE 38

Social Perspective

www.cloudreach.com

slide-39
SLIDE 39
  • Invisible fence between Devs and Ops
  • Both throw things over the fence and

call it a day

  • Not about stable code or stable

infrastructure, but a stable business

  • All on the same team

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-40
SLIDE 40
  • Devs create change
  • Ops enforce stability
  • Fundamentally opposing goals
  • Key is to work together for the benefit of

the whole

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

Dev Ops

Develop Test QA Release Monitor Patch Fix

slide-41
SLIDE 41
  • Continuous delivery

○ Devs don't release to Ops ○ Ops don't release to Devs ○ Devs + Ops release to the business www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-42
SLIDE 42

Technical Perspective

www.cloudreach.com

slide-43
SLIDE 43
  • Humans make mistakes
  • Testing

○ Mitigate risk ○ Don't release broken code

  • Monitoring

○ Know when things go wrong

(because they will!)

  • Automation

○ Address issues quickly and efficiently ○ Only write it once www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-44
SLIDE 44
  • "...If you're not nervous deploying to

production, you haven't understood the gravity of the situation..."

  • Devops done correctly:

○ Confident deployment ○ Confident rollback ○ Confident team www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-45
SLIDE 45
  • Code is in source control, so why not

infrastructure?

  • Define infrastructure as code
  • Rebuild entire infrastructure

○ Infrastructure Code + ○ Application Code + ○ Data www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-46
SLIDE 46

Chef

www.cloudreach.com

slide-47
SLIDE 47
  • Configuration management
  • System integration
  • Infrastructure as code
  • Your estate in an API

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-48
SLIDE 48
  • Clients communicate with Chef Server

and receive their configurations

  • Configurations managed via a Knife

Workstation (also a Client)

  • Clients configure themselves by

executing Ruby and converge to the required state

  • Hierarchical configuration

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-49
SLIDE 49

www.cloudreach.com

Cloud Computing with Amazon Web Services and the DevOps Methodology

slide-50
SLIDE 50

Demo - AWS Bootstrap with Chef

www.cloudreach.com

slide-51
SLIDE 51

Thank you Any questions? http://maxm.eu/hwslides

www.cloudreach.com

slide-52
SLIDE 52

We're recruiting! max.manders@cloudreach.co.uk

www.cloudreach.com