Finding a holy grail in a haystack October 7 , 2016 Marjana - PowerPoint PPT Presentation

Finding a holy grail in a haystack October 7 , 2016 Marjana Shammi, Niels de Keijzer, Arturo Martinez

Story of today First Half • Introduction to IceMobile • Challenges & Solutions Q & A Second Half • Keeping Innovation Alive Q & A

Founded in 2002

T est tool stack T ools we used in the past

The new tester

Simplify - knowledge retention & dispersion - Strategy & Process for Automation - tooling stack fit for purpose

Automation Strategy Exploratory Tests Selenium (web) System Component Semele (mobile) checks Increase of Automation Minosse Front-end API Integration checks checks ( mocked) Client Side Server Side Mocha & Chai Unit Tests Unit Tests

Minosse - API automated checks Minosse Common Steps Support Code Feature File APIs (js) Custom Steps https:/ /github.com/icemobilelab/minosse https:/ /github.com/icemobilelab/gherkin-definitions

Mobile automation Previous Struggles Improve - Revise - Use of global names that needed to be duplicated to make work - Use Native Tooling with both platforms. - Appium asks for using accessibility - More involvement of developers to keep labels that are not mandatory for code & automation consistent iOS. - Keep a similar language convention - App code needed to be modified to work with previous framework - Reduce dependency of external tooling Teseo. - Increase of performance runs - Developers were frustrated to maintain and didn’t. - Appium updates were not too frequent 6 months or so.

Semele - Mobile Automated checks Semele Common Steps iOS Support Code Feature File Mapping (Espresso XCUITest ) Custom Steps And

Minosse Minosse - API automated checks Minosse Common Steps Support Code Feature File APIs (js) Custom Steps https:/ /github.com/icemobilelab/minosse https:/ /github.com/icemobilelab/gherkin-definitions

Monitos A monkey test tool for a mobile app REST API

Mobile app landscape Backend B Backend C Backend A Backend D Middle-layer

Steps to reproduce Search for Browse Log in stores categories Book a Add products Place order collection slot to basket

Cowboy style

Reproducing the issue with SoapUI

The same set of calls, but then in a Node.js script Search for Browse Log in stores categories Book a Add products Place order collection slot to basket

Enter state machines State diagram of a turnstile

More realistic journeys Search for Browse Log in stores categories Book a Add products Place order collection slot to basket

Search for Browse Log in stores categories Book a Add products Place order collection slot to basket

Monitos

Current usage • Monkey testing for the middle-layer • Find obscure user journeys that lead to errors • Spawn a couple dozens and let them run for some time, hopefully catching some bugs in the process • Reproduction of complex error scenarios • Smoke test alternative • Cache warmup mechanism

• List of endpoints called • Achievements

Monitos core library • State machines meet D&D • http://npmjs.com/package/monitos • https://github.com/dunkelheit/monitos

Demo time

Questions?

Finding a holy grail in a haystack October 7 , 2016 Marjana - PowerPoint PPT Presentation

Finding a holy grail in a haystack October 7 , 2016 Marjana Shammi, Niels de Keijzer, Arturo Martinez Story of today First Half Introduction to IceMobile Challenges & Solutions Q & A Second Half Keeping Innovation Alive

The Holy Grail of The Holy Grail of Advanced Planning Advanced Planning and Scheduling and

SITUATED COGNITION Situated Imagining and the Holy Grail of Moral Philosophy Luke Roelofs

Haystack full of needles. Beaver, D., Kumar, S., Li, H.C., Sobel, J., and Vajgel, P.: Finding

Driving Down Support Calls with Truly Helpful Online Help PRESENTED BY Tony Vinciguerra WHAT IS

FINDING A NEEDLE IN HAYSTACK, FACEBOOKS PHOTO STORAGE Based on: D. Beaver, S. Kumar, H. C. Li,

Finding the Needle in the Haystack Jonzy Data Security Analysis, Sr. Information Security

Increasing Feature Usage with Effective Release Documentation PRESENTED BY Tony Vinciguerra

Finding a Needle in Haystack Presentation by: Neelim Haider Authors (of paper): Doug Beaver,

Finding the Needle in a Haystack: Materials discovery through

The Holy Grail of Sense Definition: The Holy Grail of Sense Definition: Creating a

Audience Segmentation is it the holy grail? Stewart Eldridge, Principal Consultant Head of

Proximity Searching and the Quest for the Holy Grail David M. Mount Department of Computer

Non-Invasive Heart Disease Prediction The Holy Grail of Cardiovascular Medicine SIMPLE |

Sisyphean Task or the Holy Grail? Satisfying Demands of Higher Education through

Hidden Markov Models Bhiksha Raj 10 Nov 2016 11755/18797 1 Prediction : a holy grail

The Quest for the Holy Grail? Emmanuel Lesaffre I-Biostat, K.U.Leuven, Leuven, Belgium EUGMS

Making Drupal Behave Automated Testing with Behat http://bit.ly/1bNyvgo Nice to meet you Howard

Standalone applications testing and automation Desktop QA team Red Hat, Inc. 2014-02-02 Who we

THE LEADER IN DRUPAL PLATFORM DESIGN AND DEVELOPMENT Saturday, February 2, 13 TESTING DRUPAL WITH

Software Engineering I (02161) Testing Assoc. Prof. Hubert Baumeister DTU Compute Technical

Agile SW Development plus Scrum in - depth Slide 1 Plan-driven and agile development

CBRE GROUP, INC. Third Quarter 2013: Earnings Conference Call October 29, 2013 FORWARD-LOOKING

Data publication at AIP Data sets, data curation, tools ASTERICS European Data Provider Forum

Buildings with Unique Design Wooden Gagster House (Archangelsk, Russia) Blur Building,