SLIDE 1
Finding a holy grail in a haystack
October 7 , 2016 Marjana Shammi, Niels de Keijzer, Arturo Martinez
First Half
- Introduction to IceMobile
- Challenges & Solutions
Q & A Second Half
- Keeping Innovation Alive
Q & A
Finding a holy grail in a haystack October 7 , 2016 Marjana - - PowerPoint PPT Presentation
Finding a holy grail in a haystack October 7 , 2016 Marjana - - PowerPoint PPT Presentation
Finding a holy grail in a haystack October 7 , 2016 Marjana Shammi, Niels de Keijzer, Arturo Martinez Story of today First Half Introduction to IceMobile Challenges & Solutions Q & A Second Half Keeping Innovation Alive
SLIDE 2
SLIDE 3
Founded in 2002
SLIDE 4
T est tool stack
T
- ols we used in the past
SLIDE 5
SLIDE 6
The new tester
SLIDE 7
- knowledge retention & dispersion
- Strategy & Process for Automation
- tooling stack fit for purpose
Simplify
SLIDE 8
Automation Strategy
Client Side Unit Tests Server Side Unit Tests
API Integration checks
System Component checks Exploratory Tests Increase
- f
Automation
Front-end checks ( mocked)
Mocha & Chai Minosse Semele (mobile) Selenium (web)
SLIDE 9
Minosse - API automated checks
https:/ /github.com/icemobilelab/minosse
https:/ /github.com/icemobilelab/gherkin-definitions
Feature File Custom Steps Support Code (js) APIs Common Steps
Minosse
SLIDE 10
- Revise
- Use Native Tooling
- More involvement of developers to keep
code & automation consistent
- Keep a similar language convention
- Reduce dependency of external tooling
- Increase of performance runs
Mobile automation
Previous Struggles
- Use of global names that needed
to be duplicated to make work with both platforms.
- Appium asks for using accessibility
labels that are not mandatory for iOS.
- App code needed to be modified to
work with previous framework Teseo.
- Developers were frustrated to
maintain and didn’t.
- Appium updates were not too
frequent 6 months or so.
Improve
SLIDE 11
Semele - Mobile Automated checks
Feature File Custom Steps Support Code (Espresso XCUITest ) Common Steps Mapping iOS And
Semele
SLIDE 12
Minosse
https:/ /github.com/icemobilelab/minosse
https:/ /github.com/icemobilelab/gherkin-definitions
Feature File Custom Steps Support Code (js) APIs Common Steps
Minosse
Minosse - API automated checks
SLIDE 13
Monitos
A monkey test tool for a mobile app REST API
SLIDE 14
Mobile app landscape
Middle-layer Backend A Backend B Backend C Backend D
SLIDE 15
Oops
SLIDE 16
Search for stores Log in Browse categories Add products to basket Book a collection slot Place order
Steps to reproduce
SLIDE 17
Cowboy style
SLIDE 18
SLIDE 19
Reproducing the issue with SoapUI
SLIDE 20
SLIDE 21
SLIDE 22
Search for stores Log in Browse categories Add products to basket Book a collection slot Place order
The same set of calls, but then in a Node.js script
SLIDE 23
Enter state machines
State diagram of a turnstile
SLIDE 24
Search for stores Log in Browse categories Add products to basket Book a collection slot Place order
More realistic journeys
SLIDE 25
Search for stores Log in Browse categories Add products to basket Book a collection slot Place order
SLIDE 26
Monitos
SLIDE 27
- Monkey testing for the middle-layer
- Find obscure user journeys that lead to errors
- Spawn a couple dozens and let them run for some
time, hopefully catching some bugs in the process
- Reproduction of complex error scenarios
- Smoke test alternative
- Cache warmup mechanism
Current usage
SLIDE 28
SLIDE 29
SLIDE 30
- List of endpoints called
- Achievements
SLIDE 31
SLIDE 32
- State machines meet D&D
- http://npmjs.com/package/monitos
- https://github.com/dunkelheit/monitos
Monitos core library
SLIDE 33
Demo time
SLIDE 34