Creating a dynamic software deployment solution using free/libre - - PowerPoint PPT Presentation

▶
creating a dynamic software deployment solution using
SMART_READER_LITE
LIVE PREVIEW

Creating a dynamic software deployment solution using free/libre - - PowerPoint PPT Presentation

Sep 13, 2023 23 likes •538 views

Creating a dynamic software deployment solution using free/libre software LinuxTag 2014 08.05.2014 Mattias Giese Solutions Architect for Systems Management and Monitoring B1 Systems GmbH giese@b1-systems.de B1 Systems GmbH - Linux/Open

slide-1
SLIDE 1

Creating a dynamic software deployment solution using free/libre software

LinuxTag 2014 08.05.2014

Mattias Giese Solutions Architect for Systems Management and Monitoring B1 Systems GmbH giese@b1-systems.de

B1 Systems GmbH - Linux/Open Source Consulting, Training, Support & Development

slide-2
SLIDE 2

Agenda

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 2 / 51

slide-3
SLIDE 3

Agenda

Workflow/Process Overview SCM Hooks Jenkins Open Build Service Spacewalk Puppet/Foreman

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 3 / 51

slide-4
SLIDE 4

Process Overview

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 4 / 51

slide-5
SLIDE 5

What are we trying to accomplish?

Continuous Integration

New features should be merged as quickly as possible Confidence that changes don’t break production Base for test-driven development (TDD)

Continuous Delivery

We don’t want to deploy every revision of our software But would be cool if we could

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 5 / 51

slide-6
SLIDE 6

Process Overview

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 6 / 51

slide-7
SLIDE 7

Code Changes and Commit

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 7 / 51

slide-8
SLIDE 8

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 8 / 51

slide-9
SLIDE 9

Using SCM-Hooks

Hooks → do stuff supported in many SCMs git-hooks may be run at different phases Use Cases:

Syntax check Linter Enforcement of other policy Triggering of other processes

We want to trigger Jenkins!

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 9 / 51

slide-10
SLIDE 10

Using SCM-Hooks

Simple post-receive hook

#!/bin/bash AUTH=’myuser:pass’ JOB=myjob TOKEN=mybuildtoken echo Poking jenkins /usr/bin/curl --user $AUTH -s \ "http://jenkins:8080/job/$JOB/build?token=$TOKEN"

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 10 / 51

slide-11
SLIDE 11

Testing with Jenkins

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 11 / 51

slide-12
SLIDE 12

Testing with Jenkins

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 12 / 51

slide-13
SLIDE 13

Jenkins Overview

The artist formerly known as Hudson The first address for CI can be used as Cron, general Job-Scheduler or Monitor 600+ plugins (nifty) Alternatives: Travis-CI, CruiseControl, Bamboo

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 13 / 51

slide-14
SLIDE 14

Jenkins Overview

Must-Have Plugins Warnings Post-Build Build Pipeline Promoted Builds Git Chuck Norris

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 14 / 51

slide-15
SLIDE 15

Usage in this scenario

Jenkins is triggered through git post-receive hook checks out git-repo (specific branch) runs configured build steps after successful build: trigger packaging process

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 15 / 51

slide-16
SLIDE 16

Jenkins Post-Build

Post-Build Step, complete

#!/bin/bash auth=’obsuser:passwd’ project=’foobar’ main_project=’internal-tools’ git_host=’git.example.com’

  • bs_api=’https://api.obs.example.com’

branch=’development’ service="<services> <service name="tar_scm"> <param name="scm">git</param> <param name="url">git://${git_url}/${project}.git</param> <param name="revision">$GIT_COMMIT</param> </service> [...] </services>" echo $service | curl -u $auth -s -X PUT -T - \ "$obs_api/source/$main_project/$project/_service"

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 16 / 51

slide-17
SLIDE 17

Post-Build Step, Service File

<services> <service name="tar_scm"> <param name="scm">git</param> <param name="url">git://${git_url}/${project}.git</param> <param name="revision">$GIT_COMMIT</param> </service> <service name="recompress"> <param name="file">*$project*.tar</param> <param name="compression">bz2</param> </service> <service name="download_url"> <param name="path">/$project/$branch/${project}.spec</param> <param name="host">$git_host</param> <param name="protocol">https</param> </service> <service name="set_version"> </service> </services>

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 17 / 51

slide-18
SLIDE 18

Jenkins Post-Build

Post-Build Step, the trigger itself

echo $service | curl -u $auth -s -X PUT -T - \ "$obs_api/source/$main_project/$project/_service"

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 18 / 51

slide-19
SLIDE 19

Packaging

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 19 / 51

slide-20
SLIDE 20

Packaging with OBS

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 20 / 51

slide-21
SLIDE 21

Open Build Service Overview

Build Platform for packages or live media (kiwi) builds RPM (SUSE/RHEL), DPKG (Debian/Ubuntu) and Pacman (Archlinux) public reference install at build.opensuse.org Central build platform for openSUSE

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 21 / 51

slide-22
SLIDE 22

Open Build Service Overview

Extensive API (CLI is an API client) can run hooks after successful publishing of a package/project Alternatives: None, koji if all you want is RHEL

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 22 / 51

slide-23
SLIDE 23

Open Build Service Overview

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 23 / 51

slide-24
SLIDE 24

Usage in this scenario

Open Build Service is used to build packages for different distributions/architectures to trigger Spacewalk to sync packages

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 24 / 51

slide-25
SLIDE 25

Open Build Service Overview

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 25 / 51

slide-26
SLIDE 26

OBS should trigger Spacewalk!

OBS published-hook

#!/usr/bin/env python2 import xmlrpclib import sys SPACEWALK_URL = "http://spacewalk.example.com/rpc/api" SPACEWALK_LOGIN = "apiuser" SPACEWALK_PASSWORD = "testing" try: channel = sys.argv[1] client = xmlrpclib.Server(SPACEWALK_URL, verbose=0) key = client.auth.login(SPACEWALK_LOGIN, SPACEWALK_PASSWORD) client.channel.software.syncRepo(key,channel) client.auth.logout(key) except Exception, e: # Gotta catch em all print ’Failed to sync channel: ’, e sys.exit(1)

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 26 / 51

slide-27
SLIDE 27

Publishing

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 27 / 51

slide-28
SLIDE 28

Package Publishing with Spacewalk

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 28 / 51

slide-29
SLIDE 29

Spacewalk Overview

System Lifecycle Management Extensive API runs on RHEL/Fedora and Derivatives supports SUSE/RHEL and Derivatives, Debian somewhat. Base for SUSE Manager and Satellite (changing with 6.x) Alternatives: Pulp, if all you want is RHEL

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 29 / 51

slide-30
SLIDE 30

Usage in this scenario

Provisioning of packages Staging of packages Automatic synchronization of packages in “Development” channel On-Demand/automatic promotion of channel contents to integration/production stages

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 30 / 51

slide-31
SLIDE 31

Delivery

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 31 / 51

slide-32
SLIDE 32

Package Delivery with Puppet/Foreman

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 32 / 51

slide-33
SLIDE 33

Puppet

Configuration Management Tool based on Ruby, easy to learn DSL runs on many platforms (Linux, *nix, Windows) abstracts differences between those platforms is idempotent features Inventory and Reporting on Infrastructure changes Alternatives: CFEngine, Chef, maybe Ansible or SaltStack

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 33 / 51

slide-34
SLIDE 34

Simple Puppet manifest

package{’myapp’: ensure => latest, } file{’/etc/myapp/config’: ensure => file,

  • wner => ’serviceuser’,

group => ’servicegroup’, mode => ’0640’, content => template(’myapp-config.erb’), require => Package[’myapp’], notify => Service[’myapp’], } service{’myapp’: ensure => running, enable => true, require => Package[’myapp’], }

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 34 / 51

slide-35
SLIDE 35

The Foreman

WebApp and API to automate infrastructure integrates well with Puppet can manage DHCP, DNS, TFTP, Puppet, “Clouds" features nice reporting and auditing Alternatives: Provisioning: Cobbler, Razor Management: Puppet Dashboard/Puppet Enterprise Console, Rudder (CFEngine)

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 35 / 51

slide-36
SLIDE 36

Architecture Overview

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 36 / 51

slide-37
SLIDE 37

Usage of Foreman in this setup

Provisioning of new bare-metal or virtual machines Single source of truth for Puppet Reporting and Auditing of Infrastructure Idea: Use Foreman-API to trigger VM provisioning for acceptance tests

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 37 / 51

slide-38
SLIDE 38

System/Acceptance Tests

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 38 / 51

slide-39
SLIDE 39

System/Acceptance Tests

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 39 / 51

slide-40
SLIDE 40

Overview

Vagrant Docker Smoketests Serverspec

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 40 / 51

slide-41
SLIDE 41

Vagrant

Wrapper around different Hypervisors and Provisioners supports VirtualBox (First Class), VMware (commercial), libvirtd (somewhat) and Docker runs on Linux, Mac OS X, Windows Provisioners may be Shell, Puppet, Chef and so on Easy to use:

1

mkdir myvm; cd myvm

2

vagrant init precise64 http://files.vagrantup.com/precise64.box

3

vagrant up

4

vagrant ssh

5

vagrant halt/destroy

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 41 / 51

slide-42
SLIDE 42

Docker

chroot on steroids designed to execute and contain one process uses LXC, cgroups, UnionFS(AUFS) does not need a custom kernel (anymore) runs on many current Linux distributions yep, it also runs on current RHEL6(.5) and SLES12 once released not useful in every scenario (no mounts, modules, init and so on)

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 42 / 51

slide-43
SLIDE 43

VM with no VM overhead

Example: Initialization, Execution, Destruction

$ time docker run -t -i smoketest-suse hostname d20cdb21deb3 real 0m0.230s user 0m0.007s sys 0m0.003s $ time docker run -t -i --rm \ smoketest-suse hostname e1e1b445465d real 0m4.250s user 0m0.000s sys 0m0.010s

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 43 / 51

slide-44
SLIDE 44

Smoketest with Docker

Application of Puppet Manifest: Does it blow up?

$ docker run -t -i smoketest-suse \ bash -c "r10k deploy -p; puppet apply \

  • -detailed-exitcodes --modulepath=/test/modules \
  • e ’include memcached’"

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 44 / 51

slide-45
SLIDE 45

Serverspec

based on RSpec executes tests locally or remotely (ssh) integrates with Vagrant somewhat Supported resources: cgroup, command, cron, default_gateway, file, group, host, iis_app_pool, iis_website, interface, ipfilter, iptables, kernel_module and more

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 45 / 51

slide-46
SLIDE 46

Serverspec - Example Spec

Simple System/Acceptance Test for memcached (excerpt)

describe package(’memcached’) do it { should be_installed } end describe service(’memcached’) do it { should be_enabled } it { should be_running } end describe port(11211) do it { should be_listening.with(’tcp’) } it { should be_listening.with(’udp’) } end

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 46 / 51

slide-47
SLIDE 47

Serverspec – Example Spec

Simple System/Acceptance Test for memcached (excerpt)

describe file(’/etc/sysconfig/memcached’) do it { should be_readable } its(:content) { should match /PORT="11211"/ } end describe command(’echo -e \ "add Test 0 60 11\r\nHello World\r" | nc localhost 11211’) do it { should return_stdout /^STORED$/ } end describe command(’echo -e "get Test\r" | nc localhost 11211’) do it { should return_stdout /^Hello World$/ } end

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 47 / 51

slide-48
SLIDE 48

Serverspec – Example Run

Test Run for memcached, Part 1

$ rake spec SPEC_OPTS="-fd" (in /home/b1user/serverspec) /usr/bin/ruby -S rspec spec/default/memcached_spec.rb Package "memcached" should be installed Service "memcached" should be enabled (FAILED - 1) should be running Port "11211" should be listening should be listening

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 48 / 51

slide-49
SLIDE 49

Test Run for memcached, Part 2

File "/etc/sysconfig/memcached" should be readable content should match /PORT="11211"/ Command "echo -e "add Test 0 60 11\r\nHello World\r" | nc localhost 11211" should return stdout /^STORED$/ Command "echo -e "get Test\r" | nc localhost 11211" should return stdout /^Hello World$/ [...] Failures: 1) Service "memcached" should be enabled Failure/Error: it { should be_enabled } sudo chkconfig --list memcached | grep 3:on expected Service "memcached" to be enabled # ./spec/default/memcached_spec.rb:8 Finished in 11.36 seconds 12 examples, 1 failure [...]

B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 49 / 51

slide-50
SLIDE 50

What’s Next?

After successful acceptance test

1 Promotion of packages from Dev to Test/Integration software

channel (Spacewalk)

2 Integration Test of packages 3 Promotion of packages from Test to Prod 4 Canary Testing → does it blow up in Prod? 5 Profit B1 Systems GmbH Creating a dynamic software deployment solution using free/libre software 50 / 51

slide-51
SLIDE 51

Thank you for your attention!

If you have further questions please contact info@b1-systems.de or call +49 (0)8457 - 931096

B1 Systems GmbH - Linux/Open Source Consulting, Training, Support & Development