AI and Machine Learning for Testers Jason Arbon, CEO @Appdiff - - PowerPoint PPT Presentation

▶
ai and machine learning for testers
SMART_READER_LITE
LIVE PREVIEW

AI and Machine Learning for Testers Jason Arbon, CEO @Appdiff - - PowerPoint PPT Presentation

Oct 22, 2023 269 likes •646 views

AI and Machine Learning for Testers Jason Arbon, CEO @Appdiff Relevant Context Testing Neural Net Ranker Personalized Web Search and Chrome Test Automation AI for Mobile Test Automation Ai for Test 2 Automation Agenda AI For Testing

slide-1
SLIDE 1

AI and Machine Learning for Testers

Jason Arbon, CEO @Appdiff

slide-2
SLIDE 2

Ai for Test Automation 2

Relevant Context

Testing Neural Net Ranker

Personalized Web Search and Chrome Test Automation

AI for Mobile Test Automation

slide-3
SLIDE 3

Ai for Test Automation

Agenda

AI For Testing Testing AI Future

slide-4
SLIDE 4

Appdiff Presentation 4

The Real Data Scientists

Joanne Tseng

Data Scientist @appdiff.com

Appdiff mission: Transform app development with automation & insights Francis Iannacci

Lead Data Scientist @appdiff.com

slide-5
SLIDE 5

Testing is much like AI 5

Testing: Apply Inputs, checking outputs.

slide-6
SLIDE 6

https://www.extremetech.com/extreme/215170-artificial-neural-networks-are- changing-the-world-what-are-they 6

AI: Apply Inputs, check outputs

slide-7
SLIDE 7

AI for App Testing

Features Complexity increases exponentially as new features and states interact with existing features Tests Test coverage grows linearly because tests can only be added

  • ne at a time

Time Complexity / Coverage

COVERAGE GAP

7

Testing Needs AI

slide-8
SLIDE 8

Our Story 8

Definition

slide-9
SLIDE 9

When will AI Start Testing?

slide-10
SLIDE 10

Our Story 10

AI for Testing

slide-11
SLIDE 11

What We Do 11

ML : Subjective or complex labels via Humans

slide-12
SLIDE 12

Our Story 12

AI for Testing: Input

Reduce input space 150 actions per page 35 steps -> 150^35 = 10^78 paths #atoms in universe 10^78...

slide-13
SLIDE 13

Our Story 13

AI for Testing

slide-14
SLIDE 14
slide-15
SLIDE 15

Our Story 15

AI for Testing

slide-16
SLIDE 16

Our Story 16

AI Driven Test Flows

slide-17
SLIDE 17

Our Story 17

AI Driven Test Flows

slide-18
SLIDE 18

Our Story 18

AI Driven Test Flows

slide-19
SLIDE 19

Our Story 19

Coverage

slide-20
SLIDE 20

Coverage

slide-21
SLIDE 21

What We Do 21

ML : App Changes Don’t Break Bot Testing!

slide-22
SLIDE 22

Our Story 22

AI bots can test almost any app. 10,000+ apps tested.

slide-23
SLIDE 23

Our Story 23

Testing the Conference App

slide-24
SLIDE 24

Our Story 24

Benchmarked Performance

slide-25
SLIDE 25

portfolio

slide-26
SLIDE 26

AI for Testing 26

Current AI Coverage: ~2/3rds Existing Tests

Long Sequences of Dependant Actions and Verifications Basic Tasks (Login, Search, Create Account, Add items to Card, etc.) Specific Sequences of Events with Specific Input (search for ‘beanie babies’, etc.)

slide-27
SLIDE 27

AI for Testing 27

Automation Coverage: Bots soon 100%

slide-28
SLIDE 28

AI for Testing 28

Automation Coverage: Bots... soon after, 10X

Canonical Tests Learning Tests Cross-app

slide-29
SLIDE 29

Our Story 29

Testing AI: Test Graph Generation and Traversal

slide-30
SLIDE 30

What We Do 30

Testing Flow with AI

slide-31
SLIDE 31

What We Do 31

Abstract Intent Language: AIT

Focus on Intent, not “how” Human Readable App-Independant

slide-32
SLIDE 32

Our Story 32

AI for Testing

slide-33
SLIDE 33

QnA hi@appdiff.com

Jason Arbon, CEO jason@appdiff.com

slide-34
SLIDE 34

Appendix

slide-35
SLIDE 35

What We Do 35

ML: Page Label Training

slide-36
SLIDE 36

Our Story 36

Appdiff Represents the Evolution of Software Quality 1

AD HOC TESTING

Reactively test

2

MANUAL TESTING

Proactively test

3

TEST AUTOMATION

Automate repetition

4

AI-DRIVEN APPROACH

Accelerate coverage

App QA App Automation QA App