Quality Assurance Project overview and update What does the QA - - PowerPoint PPT Presentation

▶
quality assurance
SMART_READER_LITE
LIVE PREVIEW

Quality Assurance Project overview and update What does the QA - - PowerPoint PPT Presentation

Sep 30, 2022 17 likes •138 views

05.10.2017 Quality Assurance Project overview and update What does the QA project do? Develop, maintain, and initiate tools and plans to ensure the upstream stability and quality of OpenStack, and its release readiness at any point the

slide-1
SLIDE 1

Quality Assurance

Project overview and update

05.10.2017

slide-2
SLIDE 2

What does the QA project do?

  • Develop, maintain, and initiate tools

and plans to ensure the upstream stability and quality of OpenStack, and its release readiness at any point the release cycle

  • Horizontal team: users are the

OpenStack developers, packagers and operators

slide-3
SLIDE 3

Project background

  • Founded during the Folsom release of OpenStack
  • 198 contributors for the Ocata release

User adoption:

  • Used by most OpenStack projects for CI
  • Implemented with plugin mechanisms for big-tent
  • Many companies use Tempest as an integration test

suite internally

  • QA forum session Thursday morning (May 11th,

9:00-9:40) to get feedback from users

slide-4
SLIDE 4

QA components

  • Tempest: Integration test suite
  • Grenade: Upgrade test suite
  • Patrole: Policy test suite
  • DevStack: Deployment tool for development
  • OpenStack-health, Stackviz: Visualizing test results of CI Jobs
  • Hacking, Bashate, eslint: Coding style check
  • os-testr: Testr wrapper for OpenStack projects
slide-5
SLIDE 5

Pike themes for QA

  • Stability

○ Stable APIs ○ Stable gate

  • Usability
  • Interoperability, backward

compatibility

slide-6
SLIDE 6

New features & enhancements for Pike

➡

Tempest

  • Increase the surface of stable interfaces
  • Micro-versions and schemas
  • Documentation

➡

Devstack

  • Performance tuning
  • Python based devstack tools
  • UCA packages for libvirt
  • Run services via systemd

➡

Patrole

  • Test coverage for “core” projects
  • CI, docs and release

➡

OpenStack Health, Stackviz

  • Contributors are needed!

➡

Upgrade testing

  • Contributors are needed!
slide-7
SLIDE 7

Queens themes for QA

  • Operators community
  • Adjacent communities
  • Streamlining, minimum

maintenance

  • Interoperability
slide-8
SLIDE 8

Possible features & enhancements for Queens

➡

Rolling upgrade testing

➡

HA / Fault Injection

➡

Tempest lib / json schemas

➡

Intelligent, automated log analysis

  • Reduce complexity in gate analysis
  • Discover new issues

➡

Gate stability monitor

  • Memory footprint per service
  • CPU and IO load on test nodes

➡

Community testing

  • Non functional testing on 3rd party premises
  • Cross-community testing (thanks for Zuul v3!)
  • OpenStack QA tools for other communities
slide-9
SLIDE 9

Rocky - Vision for QA

  • Constellations verification
  • Non functional testing in the open
  • Contributors from adjacent communities
  • Interoperability
slide-10
SLIDE 10

References

  • QA Priorities, Pike: https://etherpad.openstack.org/p/pike-qa-priorities
  • Documentation:

○ Tempest docs: https://docs.openstack.org/developer/tempest/ ○ Devstack docs: https://docs.openstack.org/developer/devstack/ ○ Grenade docs: https://docs.openstack.org/developer/grenade/ ○ Patrole docs: https://docs.openstack.org/developer/patrole/ ○ OpenStack Health: http://git.openstack.org/cgit/openstack/openstack-health/tree/README.rst ○ Stackviz docs: https://docs.openstack.org/developer/stackviz/

slide-11
SLIDE 11

How to contact us

  • #openstack-qa in IRC
  • openstack-dev@lists.openstack.org, quota [QA] in the subject
  • Weekly IRC meetings in #openstack-meetings

https://wiki.openstack.org/wiki/Meetings/QATeamMeeting

  • Face to face at the Forum and the PTG
slide-12
SLIDE 12

@OpenStack

THANKS.

Questions?

  • penstack
  • penstack

OpenStackFoundation