Distributed CI and testing for cloudstack in a hybrid community - - PowerPoint PPT Presentation

▶

Apr 12, 2023 392 likes •621 views

Distributed CI and testing for cloudstack in a hybrid community Daan Hoogland Not senior. Not manager. Other job titles apply. daan.hoogland@shapeblue.com +DaanHoogland https://www.slideshare.net/ShapeBlue/cccna17-distributed-ci-

SLIDE 1

The Cloud Specialists

Distributed CI and testing for cloudstack in a hybrid community

Daan Hoogland Not senior. Not manager. Other job titles apply. daan.hoogland@shapeblue.com +DaanHoogland https://www.slideshare.net/ShapeBlue/cccna17-distributed-ci- and-testing-for-cloudstack-in-a-hybrid-community

SLIDE 2

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue

About
You
Me
My employer
Present – what is there at the moment
Goal – a compatibility matrix
Trillian (the shapeblue integration toolkit)

C o n t e n t s

SLIDE 3

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue A b o u t M e

SLIDE 4

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue A b o u t Yo u

New Cloudstack user
Infrastructure VAR or producer
Integrator
Interested in improvement of the platform
Interested in contributing

Quality insurance infrastructure Well tested code

SLIDE 5

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue

“ShapeBlue are expert builders of public & private

clouds. They are the leading global CloudStack

services company.”

A b o u t S h a p e B l u e

SLIDE 6

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue S h a p e B l u e c u s t o m e r s

SLIDE 7

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue S h a p e B l u e c u s t o m e r s

SLIDE 8

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue S h a p e B l u e c u s t o m e r s

SLIDE 9

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue W h a t ’ s i n i t

Endgame (goal)
Tools at the moment
Trillian

and

SLIDE 10

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue e n d g a m e

The goal of the community is to create a

compatibility matrix of what works in CloudStack and in which environment, which will be easily maintainable and clear to users

We have a hybrid community in terms of used

hard- and software infrastructure. Testing everything is a challenge. (British understatement)

SLIDE 11

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue T h e c o m p a t i b i l i t y m a t r i x

The compatibility matrix
There must be a way to report
Compatible
Failing
Unstable
Untested (default)
It must be reported per
ACS version
Feature
Context (whut?)

SLIDE 12

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue Test run for PR 42

Environment Hypervisor Networking Extras Results ShapeBlue 1 vmware advanced Community env 1 xen advanced Cloudops test xen advanced Interoute pre-production vmware advanced Shuberg Philis betacloud KVM advanced sdn/nicira BT test bed vmware basic PcXtreme KVM basic Anamyous coward’s environment KVM Advanced

SLIDE 13

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue To o l s a t t h e m o m e n t

Devcloud4
Bubble (kvm, yay)
Trillian (vmware, but ansible \o/) more later
Github/Gitbox (needs long and extensive explanation that will require an entirely new series of talks
Bots (blueorangutan, cloudmonger)
Upr (https://github.com/cloudops/upr)

SLIDE 14

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue w h y

Many, many, MANY permutations of a CloudStack

deployment….

Basic / Advanced
Local / shared / mixed storage
More than 8 common hypervisor types/versions
4 or 5 Management server OS possiblilities
That’s 144 combinations only looking the basics.
Previous attempts at test automation haven’t been able to get

coverage or capacity.

SLIDE 15

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue Tr i l l i a n

Ability to support multiple concurrent environments
No hardcoding to a specific (our) lab/environment
As few separate components as possible
Separation of ‘code’ and ‘configuration’
Scripted command-line use fully supported
Ability to support as many hypervisors as possible
As flexible as possible
Best ‘performance’ possible
Best utilization of hardware resources possible

SLIDE 16

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue

Trillian
Ansible based environment builder
Multi-tenant (and multiple concurrent environments)
CloudStack builds the Virtual Infrastructure
Hypervisor hosts are CloudStack templates
Supports multiple and mixed hypervisors
Supports Advanced and Basic networks
Open source

SLIDE 17

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue S h a p e b l u e ’ s b o t

Blue Orangutan
Build-bot
Automation endpoint to send build jobs to Jenkins for CentOS

6/7 and Debian packages from CloudStack source

Provides an integrated way to create packages from pull

requests in Github.

Can kick-off Jenkins jobs to build and test environments based
n packages which it builds.

SLIDE 18

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue b l u e o r a n g u t a n

when trilian result finish we use this to build the reports:

https://github.com/shapeblue/Trillian/blob/master/Ansible/roles/marvin/files/xunit-reader.py

we build the reports here:

https://github.com/shapeblue/Trillian/blob/master/Ansible/roles/marvin/templates/smoketests.sh.j2

for posting comments, we use github apis keys etc.
that part's in the secret file some-scheme://some/path/to/blueorangutan/bo.py

SLIDE 19

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue c o n c l u s i o n s

Add upr to bots
Several ways to our ideal
Trillian is there as tool, proper reporting is key
Next we want to orchestrate what test runs where

need

Or behaviour like it

SLIDE 20

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue A v i s i o n

Winston
Test Orchestrator (Future project)
Receives ‘offers’ of test type/capacity from remote test labs
Takes request from Blue Orangutan to test packages and

distributes tests to suitable remote labs.

Offers might include:
Use of local storage
Use of basic vs advanced networks
Use of particular hypervisors/versions

SLIDE 21

C l i c k t o e d i t

The Cloud Specialists

ShapeBlue.com

@ShapeBlue A p a c h e C l o u d s t a c k n e e d s y o u