A Tale of Testing the Untestable A Tale of Testing the Untestable - - PowerPoint PPT Presentation

▶
a tale of testing the untestable a tale of testing the
SMART_READER_LITE
LIVE PREVIEW

A Tale of Testing the Untestable A Tale of Testing the Untestable - - PowerPoint PPT Presentation

Nov 21, 2022 153 likes •993 views

A Tale of Testing the Untestable A Tale of Testing the Untestable Angie Jones Senior Developer Advocate, Applitools http://angiejones.tech Director, Test Automation University http://testautomationu.com San Francisco, CA, USA @techgirl1908

slide-1
SLIDE 1

A Tale of Testing the Untestable A Tale of Testing the Untestable

Angie Jones

http://angiejones.tech http://testautomationu.com @techgirl1908 Senior Developer Advocate, Applitools Director, Test Automation University San Francisco, CA, USA
slide-2
SLIDE 2

@tech

slide-3
SLIDE 3
slide-4
SLIDE 4

I need I need a change! a change!

@tech

slide-5
SLIDE 5
slide-6
SLIDE 6
slide-7
SLIDE 7

QA @ Twitter QA @ Twitter

testing as a service

@tech

slide-8
SLIDE 8

Twitter Twitter Ads Ads

@tech

slide-9
SLIDE 9

Advertiser can Advertiser can create a campaign create a campaign that targets users that targets users who meet certain who meet certain criteria. criteria.

Feature Feature

@tech

slide-10
SLIDE 10

What What are we are we

@tech

slide-11
SLIDE 11

@te

slide-12
SLIDE 12

@t

slide-13
SLIDE 13

The test The test

@tech

slide-14
SLIDE 14
slide-15
SLIDE 15

Challenge #1: Challenge #1: Company Company lacks testing lacks testing culture culture

@tech

slide-16
SLIDE 16
slide-17
SLIDE 17

What about What about integration? integration?

@tech

slide-18
SLIDE 18
slide-19
SLIDE 19
slide-20
SLIDE 20

There's There's a gap a gap

@tech

slide-21
SLIDE 21

Challenge #2: Challenge #2: Company lacks Company lacks resources for resources for testing testing

@tech

slide-22
SLIDE 22
slide-23
SLIDE 23

Challenge #3: Challenge #3: Testing in Testing in production production

@tech

slide-24
SLIDE 24
slide-25
SLIDE 25

Too Too expensive! expensive!

@tech

slide-26
SLIDE 26

Challenge #4: Challenge #4: Targeting Targeting test users test users

@tech

slide-27
SLIDE 27

User ID Username Gender Interest 1............. ............. F science 2............. ............. M art 3............. ............. N art 4............. ............. U science 5............. ............. M science 6............. ............. F art 7............. ............. F art

@tech

slide-28
SLIDE 28

@tech

slide-29
SLIDE 29

Challenge #5: Challenge #5: Blocker in Blocker in targeting lists targeting lists

@tech

slide-30
SLIDE 30
slide-31
SLIDE 31

...then how??? ...then how???

@tech

slide-32
SLIDE 32

Challenge #6: Challenge #6: Serving is not Serving is not guaranteed guaranteed

@tech

slide-33
SLIDE 33
slide-34
SLIDE 34

how does this how does this thing work? thing work?

@tech

slide-35
SLIDE 35

Challenge #7: Challenge #7: Going lower Going lower in the stack in the stack

@tech

slide-36
SLIDE 36
slide-37
SLIDE 37

No time! No time!

@techgirl1908

slide-38
SLIDE 38

Challenge #8: Challenge #8: Making time Making time for quality for quality

@tech

slide-39
SLIDE 39

No No happy happy ending ending

@tech

slide-40
SLIDE 40

@tech

slide-41
SLIDE 41

The 10 P's of Testability The 10 P's of Testability

by Rob Meaney

@tech

slide-42
SLIDE 42

Retrospective Retrospective

@tech

slide-43
SLIDE 43

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@tech

slide-44
SLIDE 44

The people in our team possess the mindset, skillset & knowledge set to do great testing and are aligned in their pursuit of quality.

@tech

slide-45
SLIDE 45

The people in our team possess the mindset, skillset & knowledge set to do great testing and are aligned in their pursuit of quality.

@tech

slide-46
SLIDE 46

The people in our team possess the mindset, skillset & knowledge set to do great testing and are aligned in their pursuit of quality.

@tech

slide-47
SLIDE 47

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@tech

slide-48
SLIDE 48

The philosophy of our team encourages whole team responsibility for quality and collaboration across team roles, the business and with the customer.

@tech

slide-49
SLIDE 49

The philosophy of our team encourages whole team responsibility for quality and collaboration across team roles, the business and with the customer.

@tech

slide-50
SLIDE 50

The philosophy of our team encourages whole team responsibility for quality and collaboration across team roles, the business and with the customer.

@tech

slide-51
SLIDE 51

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@tech

slide-52
SLIDE 52

The product is designed to facilitate great exploratory testing and

@tech

slide-53
SLIDE 53

The product is designed to facilitate great exploratory testing and

@tech

slide-54
SLIDE 54

The product is designed to facilitate great exploratory testing and

@tech

slide-55
SLIDE 55

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@techg

slide-56
SLIDE 56

The process helps the team decompose work into small testable chunks and discourages the accumulation of testing debt.

@techg

slide-57
SLIDE 57

The process helps the team decompose work into small testable chunks and discourages the accumulation of testing debt.

@techg

slide-58
SLIDE 58

The process helps the team decompose work into small testable chunks and discourages the accumulation of testing debt.

@techg

slide-59
SLIDE 59

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@techg

slide-60
SLIDE 60

The team has a deep understanding of the problem the product solves for their customer and actively identifies and mitigates risk.

@techg

slide-61
SLIDE 61

The team has a deep understanding of the problem the product solves for their customer and actively identifies and mitigates risk.

@techg

slide-62
SLIDE 62

The team has a deep understanding of the problem the product solves for their customer and actively identifies and mitigates risk.

@techg

slide-63
SLIDE 63

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@techg

slide-64
SLIDE 64

The team is provided the time, resources, space and autonomy to focus & do great

@techg

slide-65
SLIDE 65

The team is provided the time, resources, space and autonomy to focus & do great

@techg

slide-66
SLIDE 66

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@techg

slide-67
SLIDE 67

The team’s pipeline provides fast, reliable, accessible and comprehensive feedback

  • n every change as it

moves towards production.

@techg

slide-68
SLIDE 68

The team’s pipeline provides fast, reliable, accessible and comprehensive feedback

  • n every change as it

moves towards production.

@techg

slide-69
SLIDE 69

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@techg

slide-70
SLIDE 70

For productivity, the team considers and applies the appropriate blend of testing to facilitate continuous feedback and unearth important problems as quickly as possible.

@techg

slide-71
SLIDE 71

For productivity, the team considers and applies the appropriate blend of testing to facilitate continuous feedback and unearth important problems as quickly as possible.

@techg

slide-72
SLIDE 72

For productivity, the team considers and applies the appropriate blend of testing to facilitate continuous feedback and unearth important problems as quickly as possible.

@techg

slide-73
SLIDE 73

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@techg

slide-74
SLIDE 74

The team has very few customer impacting production issues but when they do occur the team can very quickly detect, debug and remediate the issue.

@techg

slide-75
SLIDE 75

The team has very few customer impacting production issues but when they do occur the team can very quickly detect, debug and remediate the issue.

@techg

slide-76
SLIDE 76

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@techg

slide-77
SLIDE 77

The team proactively seeks to continuously improve their test approach, learn from their mistakes and experiment with new tools and techniques.

@techg

slide-78
SLIDE 78

The team proactively seeks to continuously improve their test approach, learn from their mistakes and experiment with new tools and techniques.

@techg

slide-79
SLIDE 79

The team proactively seeks to continuously improve their test approach, learn from their mistakes and experiment with new tools and techniques.

@techg

slide-80
SLIDE 80

People Philosophy Product Process Problem Project Pipeline Productivity Production Issues Proactivity

@techg

slide-81
SLIDE 81
slide-82
SLIDE 82

A Tale of Testing the Untestable A Tale of Testing the Untestable

Angie Jones

http://angiejones.tech http://testautomationu.com @techgirl1908 Senior Developer Advocate, Applitools Director, Test Automation University San Francisco, CA, USA