SLIDE 1
with a risk based approach
@sammy_lee12
Create compelling tests with a risk based approach @sammy_lee12 A - - PowerPoint PPT Presentation
Create compelling tests with a risk based approach @sammy_lee12 A - - PowerPoint PPT Presentation
Create compelling tests with a risk based approach @sammy_lee12 A bit about Tyro Banking licence Process $8 billion annually $100 million in funding Banking licence Process $8 billion annually $100 million in funding Banking licence
SLIDE 2
SLIDE 3
SLIDE 4
Banking licence Process $8 billion annually $100 million in funding
SLIDE 5
Banking licence Process $8 billion annually $100 million in funding
SLIDE 6
Banking licence Process $8 billion annually $100 million in funding
SLIDE 7
Microservices back end Test Driven Development Pair Programming
SLIDE 8
Microservices back end Test Driven Development Pair Programming
SLIDE 9
Microservices back end Test Driven Development Pair Programming
SLIDE 10
SLIDE 11
Small commits to master Test suit runs before commit Continous integration
SLIDE 12
Small commits to master Test suit runs before commit Continous integration
SLIDE 13
Small commits to master Test suit runs before commit Continous integration
SLIDE 14
Testing: a team responsibility Tester in each team Quality Activist
SLIDE 15
Testing: a team responsibility Tester in each team Quality Activist
SLIDE 16
Testing: a team responsibility Tester in each team Quality Activist
SLIDE 17
Testing: a team responsibility Tester in each team Quality Activist
SLIDE 18
Testing: a team responsibility Tester in each team Product Risk Investigator
SLIDE 19
Let’s get into it
SLIDE 20
Break app into flows
SLIDE 21
1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In
SLIDE 22
1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In
SLIDE 23
1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In
SLIDE 24
1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In
SLIDE 25
1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In
SLIDE 26
1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In
SLIDE 27
Map flows onto a Risk Board
SLIDE 28
Frequency of use
SLIDE 29
Frequency of use
SLIDE 30
Impact if broken Frequency of use
SLIDE 31
Impact if broken Frequency of use
SLIDE 32
Impact if broken Frequency of use
SLIDE 33
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1
SLIDE 34
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2
SLIDE 35
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3
SLIDE 36
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3 4
SLIDE 37
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3 4 5
SLIDE 38
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3 4 5 6
SLIDE 39
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3 4 5 6
SLIDE 40
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3 4 5 6
SLIDE 41
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3 4 5 6
SLIDE 42
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3 4 5 6
SLIDE 43
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3 4 5 6
SLIDE 44
Impact if broken Frequency of use 1.Registration 2.Transfer Funds 3.View Transactions 4.Contact Us 5.Change Pin 6.Log In 1 2 3 4 5 6 Security Impact
SLIDE 45
Here’s one I prepared earlier
Example
SLIDE 46
SLIDE 47
Break flows into tests
SLIDE 48
- 5. Change
Pin
Flow
SLIDE 49
- 5. Change
Registered Device and Logged in
Setup Flow
SLIDE 50
- 5. Change
Click on Hamburger side menu
Setup Test steps and checks Flow
SLIDE 51
- 5. Change
Setup Test steps and checks Flow
See Menu List
SLIDE 52
- 5. Change
Setup Test steps and checks Flow
Click on Change Passcode
SLIDE 53 Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
See change passcode screen
SLIDE 54 See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter correct pin
SLIDE 55 See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter incorrect pin
SLIDE 56 See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter incorrect pinEnter pin after session timeout
SLIDE 57 See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter pin after session timeout Enter incorrect pinEnter phone in aeroplane mode
SLIDE 58 See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter pin after session timeout Enter phone in aeroplane mode Enter incorrect pinPress back button
SLIDE 59 See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter pin after session timeout Enter phone in aeroplane mode Press back button Enter incorrect pin SLIDE 60 See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter pin after session timeout Enter phone in aeroplane mode Press back button Enter incorrect pinSee toast notification
SLIDE 61 See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter pin after session timeout Enter phone in aeroplane mode Press back button Enter incorrect pin See toast notificationEnter incorrect pin 2 more times
SLIDE 62 See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter pin after session timeout Enter phone in aeroplane mode Press back button Enter incorrect pin See toast notification Enter incorrect pin 2 more times- 7. Lock
pin
SLIDE 63 Enter correct pin See change passcode screen Click on Change Passcode
- 5. Change
Setup Test steps and checks Flow
Enter incorrect pin See toast notification SLIDE 64 Enter correct pin See change passcode screen Click on Change Passcode See toast notification
- 5. Change
Setup Test steps and checks Flow
SLIDE 65 See change passcode screen Click on Change Passcode See toast notification
- 5. Change
See create pin screen
Enter incorrect pinSetup Test steps and checks Flow
SLIDE 66 See change passcode screen Click on Change Passcode See toast notification
- 5. Change
Setup Test steps and checks Flow
SLIDE 67 See change passcode screen Click on Change Passcode See toast notification
- 5. Change
Setup Test steps and checks Flow
Key
Enter correct pin SLIDE 68 See change passcode screen Click on Change Passcode See toast notification
- 5. Change
Setup Test steps and checks Flow
Maps to Risk board
Key
Enter correct pin SLIDE 69 See change passcode screen Click on Change Passcode See toast notification
- 5. Change
Setup Test steps and checks Flow
Maps to Risk boardData to set up before/ during test
Key
Enter correct pin SLIDE 70 See change passcode screen Click on Change Passcode See toast notification
- 5. Change
Setup Test steps and checks Flow
Maps to Risk board Data to set up before/ during testUser action
Key
Enter correct pin SLIDE 71 See change passcode screen Click on Change Passcode See toast notification
- 5. Change
Key
Setup Test steps and checks Flow
Maps to Risk board Data to set up before/ during test User actionCheck/ Success indicator
Enter correct pin SLIDE 72
Here’s one I prepared earlier
Example
SLIDE 73
SLIDE 74
Continue creating tests
SLIDE 75 See change passcode screen Click on Change Passcode See toast notification
- 5. Change
Setup Test steps and checks Flow
Enter correct pin SLIDE 76 See change passcode screen Click on Change Passcode See toast notification
- 5. Change
Setup Test steps and checks Flow
Enter correct pinTest 1
SLIDE 77 Smooth scrolling is
- bserved
- 3. View
- 5. Change
Setup Test steps and checks Flow
Enter correct pinTest 2
SLIDE 78 Smooth scrolling is
- bserved
- 10. Logout
- 5. Change
Setup Test steps and checks Flow
Enter correct pinTest 3
- 3. View
SLIDE 79
Here’s one I prepared earlier
Example
SLIDE 80
SLIDE 81
Combine similar tests
SLIDE 82 Smooth scrolling is
- bserved
- 10. Logout
- 5. Change
Setup Test steps and checks Flow
Enter correct pin- 3. View
SLIDE 83 Smooth scrolling is
- bserved
- 10. Logout
- 5. Change
Setup Test steps and checks Flow
Enter correct pinSame data
- 3. View
SLIDE 84 Smooth scrolling is
- bserved
- 10. Logout
- 5. Change
Setup Test steps and checks Flow
Enter correct pin- 3. View
SLIDE 85 Smooth scrolling is
- bserved
- 10. Logout
- 5. Change
Setup Test steps and checks
Flow
Enter correct pin- 3. View
SLIDE 86 Smooth scrolling is
- bserved
- 10. Logout
- 5. Change
Flow
Enter correct pin- 3. View
Test 1
Setup Test steps and checks
SLIDE 87 Smooth scrolling is
- bserved
- 10. Logout
- 5. Change
Setup Test steps and checks Flow
Enter correct pin- 3. View
Test 2
SLIDE 88 Smooth scrolling is
- bserved
- 10. Logout
- 5. Change
Setup Test steps and checks Flow
Enter correct pin- 3. View
Test 3
SLIDE 89 Smooth scrolling is
- bserved
- 10. Logout
- 5. Change
Setup Test steps and checks Flow
Enter correct pin- 3. View
Onboarding
SLIDE 90
Here’s our 35 flows covered by 5 UI tests
Example
SLIDE 91
SLIDE 92
Create UI tests
SLIDE 93
SLIDE 94
Create UI tests - refactor
let app = XCUIApplication() clickOnHamburglarMenu() clickChangePasscode() enterPin(1234) expect(incorrectPinToast.isDisplayed()).to(beTrue()) enterPin(4321) enterPin(4321) expect(changePinToast.isDisplayed()).to(beTrue())
SLIDE 95
Accessibility inspector
SLIDE 96
Summary
Tests that are risk based are compelling
SLIDE 97
Break app into flows Map flows onto a risk board Break flows into tests Create tests Maintain tests
SLIDE 98
Break app into flows Map flows onto a risk board Break flows into tests Create tests Maintain tests
SLIDE 99
Break app into flows Map flows onto a risk board Break flows into tests Create tests Maintain tests
SLIDE 100
Break app into flows Map flows onto a risk board Break flows into tests Create tests Maintain tests
SLIDE 101
Break app into flows Map flows onto a risk board Break flows into tests Create tests Maintain tests
SLIDE 102
Questions?
@sammy_lee12
Recording: https://youtu.be/MU0CIeqwX_I Slides: https://goo.gl/vogX2D Feedback: https://goo.gl/forms/j1s7MhvSjRrcLUCN2
SLIDE 103
Other types of testing
SLIDE 104
Mindmaps
SLIDE 105
SLIDE 106
SLIDE 107
Soap opera & persona testing
SLIDE 108
SLIDE 109
SLIDE 110
Timeline tests
SLIDE 111
SLIDE 112
Nightmare headlines
SLIDE 113
SLIDE 114
State diagrams
SLIDE 115
SLIDE 116
Mindmaps Soap opera & persona testing Timeline tests Nightmare headlines State Diagrams
Other types of testing
SLIDE 117
Mindmaps Soap opera & persona testing Timeline tests Nightmare headlines State Diagrams
Other types of testing
SLIDE 118
Mindmaps Soap opera & persona testing Timeline tests Nightmare headlines State Diagrams
Other types of testing
SLIDE 119
Mindmaps Soap opera & persona testing Timeline tests Nightmare headlines State Diagrams
Other types of testing
SLIDE 120
Mindmaps Soap opera & persona testing Timeline tests Nightmare headlines State Diagrams
Other types of testing
SLIDE 121
- Soap Opera testing
- Blogs
- Book: Explore It!
- Mindmaps: Test Insane
Resources
SLIDE 122
Questions?
@sammy_lee12