Lets focus more on Quality Engineering and less on Testing the - - PowerPoint PPT Presentation

▶
let s focus more on quality engineering and less on
SMART_READER_LITE
LIVE PREVIEW

Lets focus more on Quality Engineering and less on Testing the - - PowerPoint PPT Presentation

Jan 17, 2024 298 likes •780 views

Lets focus more on Quality Engineering and less on Testing the Software Joel Montvelisky PractiTest - Chief Solution Architect - PNSQC 2020 Focus on Quality - not on Testing! #PNSQC2020 1 About Me! QA/Testing (last 22 years) - Tester,

slide-1
SLIDE 1

#PNSQC2020 Focus on Quality - not on Testing!

1

Let’s focus more on Quality Engineering and less on Testing the Software

Joel Montvelisky

PractiTest - Chief Solution Architect

  • PNSQC 2020
slide-2
SLIDE 2

#PNSQC2020 Focus on Quality - not on Testing!

2

About Me!

QA/Testing

(last 22 years)

  • Tester, Lead, Director
  • Consultant, Speaker
  • Blogger, Podcaster

PractiTest

  • Head of Quality
  • Chief Solution Architect

Other Stuff

  • Sate of Testing ™
  • Online Test Conference
  • 1-on-1 Podcast (w/ Rob Lambert)

Joel Montvelisky Follow: @joelmonte

slide-3
SLIDE 3

#PNSQC2020 Focus on Quality - not on Testing!

3

Let’s get stated - with a Question…

slide-4
SLIDE 4

#PNSQC2020 Focus on Quality - not on Testing!

4

What value do you provide to your company?

slide-5
SLIDE 5

#PNSQC2020 Focus on Quality - not on Testing!

5

What value do you provide to your company?

  • What decisions do you help make?
  • How do you change the way your company delivers products?
  • If you were not there, what would be different?
slide-6
SLIDE 6

#PNSQC2020 Focus on Quality - not on Testing!

6

Software development is undergoing a constant evolution

slide-7
SLIDE 7

#PNSQC2020 Focus on Quality - not on Testing!

7

Software development is undergoing a constant evolution

slide-8
SLIDE 8

#PNSQC2020 Focus on Quality - not on Testing!

8

Waterfall – V – W Models

slide-9
SLIDE 9

#PNSQC2020 Focus on Quality - not on Testing!

9

  • Requirements are “ready” and ”complete”
  • Developers & Testing work separately
  • Work based on Cycles converging into a Big Release
  • Products are shipped to “someone” outside the team
  • Feedback comes via 3rd or 4th level sources

Waterfall – V – W Models

slide-10
SLIDE 10

#PNSQC2020 Focus on Quality - not on Testing!

10

Objective of the Testing Team:

Find all the bugs before releasing the product. Ensuring the final product has reached the desired levels of quality and stability

Waterfall – V – W Models

slide-11
SLIDE 11

#PNSQC2020 Focus on Quality - not on Testing!

11

Iterative / “Agile” Models

slide-12
SLIDE 12

#PNSQC2020 Focus on Quality - not on Testing!

12

  • Developers & Testers work as Integrated group
  • User stories are elaborated by the team
  • Developers “should” take a more active part in testing
  • Short sprints, faster delivery and feedback
  • Products are shipped outside the team, feedback comes via 3rd or 4th sources

Iterative / “Agile” Models

slide-13
SLIDE 13

#PNSQC2020 Focus on Quality - not on Testing!

13

Objective of the Testing Team:

Work together with Developers to test and deliver products quickly, receive feedback from the field, and continue the development process

Iterative / “Agile” Models

slide-14
SLIDE 14

#PNSQC2020 Focus on Quality - not on Testing!

14

How we got to DevOps?

slide-15
SLIDE 15

#PNSQC2020 Focus on Quality - not on Testing!

15

slide-16
SLIDE 16

#PNSQC2020 Focus on Quality - not on Testing!

16

Feels a lot like Agile but…

  • We (Developers & Testers) are in charge of deploying and running the

product in our own production environments

  • We do not need to wait or ask other to get feedback on the product –

we can measure it directly from usage

  • Cost of releasing bugs to production is radically reduced

DevOps

slide-17
SLIDE 17

#PNSQC2020 Focus on Quality - not on Testing!

17

Objective of the Testing Team:

Work with Developers to release quickly, enabling stability on the deployment process, engineering fast feedback from production.

DevOps

slide-18
SLIDE 18

#PNSQC2020 Focus on Quality - not on Testing!

18

Back to our constant evolution

slide-19
SLIDE 19

#PNSQC2020 Focus on Quality - not on Testing!

19

Modern Testing

slide-20
SLIDE 20

#PNSQC2020 Focus on Quality - not on Testing!

20

Modern Testing (MT)

Originally defined by Alan Page & Brent Jensen in their AB Testing Podcast http://moderntesting.org

slide-21
SLIDE 21

#PNSQC2020 Focus on Quality - not on Testing!

21

MT – 7 Principles

  • 1. Our Priority is Improving the Business.
  • 2. We accelerate the team, and use models like Lean Thinking and Theory of Constraints to

help identify, prioritize and mitigate bottlenecks from the system.

  • 3. We are a force of continuous improvement, helping the team adapt and optimize in
  • rder to succeed, rather than providing a safety net to catch failures.
  • 4. We care deeply about the quality culture of our team, and we coach, lead and nurture

the team towards a more mature quality culture.

slide-22
SLIDE 22

#PNSQC2020 Focus on Quality - not on Testing!

22

MT – 7 Principles (cont.)

  • 5. We believe that the customer is the only one capable to judge and evaluate the quality
  • f our product.
  • 6. We use data extensively to deeply understand customer usage and then close the gaps

between product hypotheses and business impact

  • 7. We expand testing abilities and knowledge across the team; understanding that this may

reduce (or eliminate) the need for a dedicated testing specialist.

slide-23
SLIDE 23

#PNSQC2020 Focus on Quality - not on Testing!

23

Accelerate the Achievement

  • f Shippable Quality

MT – Missions Statement

Testing Quality Engineering

slide-24
SLIDE 24

#PNSQC2020 Focus on Quality - not on Testing!

24

What does all this mean to me and my team?

slide-25
SLIDE 25

#PNSQC2020 Focus on Quality - not on Testing!

25

Focus on Quality not on Testing!

slide-26
SLIDE 26

#PNSQC2020 Focus on Quality - not on Testing!

26

slide-27
SLIDE 27

#PNSQC2020 Focus on Quality - not on Testing!

27

User Story Validation

slide-28
SLIDE 28

#PNSQC2020 Focus on Quality - not on Testing!

28

User Story validation

  • Generate MVPs – release small & get

validation quickly

  • Define measurable success criteria for

production

  • Define correct instrumentation for

monitoring purposes

slide-29
SLIDE 29

#PNSQC2020 Focus on Quality - not on Testing!

29

User Story validation

  • Detect conflicts and inconsistencies within

the product

  • Ensure usability and accessibility
  • Capture inputs from all other departments

(support, sales, customer success, etc)

slide-30
SLIDE 30

#PNSQC2020 Focus on Quality - not on Testing!

30

Bring “customers” into the Process

slide-31
SLIDE 31

#PNSQC2020 Focus on Quality - not on Testing!

31

Bring customers into the process

  • Take part of calls and visits with support,

services, sales, etc.

  • Create “Personas” for the Development

process

  • When possible, bring data for use in

development and testing

slide-32
SLIDE 32

#PNSQC2020 Focus on Quality - not on Testing!

32

Testing Training and Coaching

slide-33
SLIDE 33

#PNSQC2020 Focus on Quality - not on Testing!

33

Testing training and coaching

  • Test training for New Developers
  • Test process definition
  • Pair testing sessions with developers
  • Test briefings and debriefings with

developers

slide-34
SLIDE 34

#PNSQC2020 Focus on Quality - not on Testing!

34

Test Enablement for Developers

slide-35
SLIDE 35

#PNSQC2020 Focus on Quality - not on Testing!

35

Test enablement for Devs

  • Testing cookbooks
  • Test environment generation
  • Readily available dockers
  • Realistic data and setups
  • Test artifacts development
  • Checklists
  • Heuristics
  • Sanity / Smoke scenarios
slide-36
SLIDE 36

#PNSQC2020 Focus on Quality - not on Testing!

36

Development and Release Process

slide-37
SLIDE 37

#PNSQC2020 Focus on Quality - not on Testing!

37

Deployment and Release process

  • Release risk assessments
  • Staged process and milestones
  • Deployment and rollback design and testing
  • Scheduling and notifications process
slide-38
SLIDE 38

#PNSQC2020 Focus on Quality - not on Testing!

38

Production Analytics

slide-39
SLIDE 39

#PNSQC2020 Focus on Quality - not on Testing!

39

Production Analytics

  • Instrumentation planning and testing
  • Feature-validation analytics
  • Dashboards and alerts generating
  • Product Health dashboards
  • Strategic Customer dashboards
slide-40
SLIDE 40

#PNSQC2020 Focus on Quality - not on Testing!

40

Coordination with External Teams

slide-41
SLIDE 41

#PNSQC2020 Focus on Quality - not on Testing!

41

Coordination with external teams

  • Gather inputs and needs
  • Generate information flows
  • What teams?
  • Program / Project Management
  • Support
  • Docs
  • Services
  • Customer Success
slide-42
SLIDE 42

#PNSQC2020 Focus on Quality - not on Testing!

42

slide-43
SLIDE 43

#PNSQC2020 Focus on Quality - not on Testing!

43

What value($$) do you provide to your company?

slide-44
SLIDE 44

#PNSQC2020 Focus on Quality - not on Testing!

44

What value do you provide to your company?

  • What decisions do you help make?
  • How do you change the way your company delivers products?
  • If you were not there, what would be different?
slide-45
SLIDE 45

#PNSQC2020 Focus on Quality - not on Testing!

45

Focus more on Quality and less on Testing

slide-46
SLIDE 46

#PNSQC2020 Focus on Quality - not on Testing!

46

Thank you!

joel@practitest.com @joelmonte https://qablog.practitest.com