[PPT] - Ta Taking your Selenium Te Tests for we web and mobile ile PowerPoint Presentation

SLIDE 1

___________________________________________________________________________________________________________________________________________________

Ta Taking your Selenium Te Tests for we web and mobile ile beyond your lo local l Fir Firefox Brows wser

Michael Palotas, Francois Reynaud Element34 Solutions GmbH

SLIDE 2

___________________________________________________________________________________________________________________________________________________ 2

Element34 Solutions GmbH Gerbiweg 2 8853 Lachen, Switzerland http://www.element34.net

Michael Palotas: michael.palotas@element34.net Francois Reynaud: francois.reynaud@element34.net

“W “We co co-cr created Selenium an and in invented the Sel Seleni enium um Box” We are a boutique consulting firm specialized in agile engineering practices and test automation solutions with Selenium. The company founders are key contributors and thought leaders to open source projects such as Selenium, Selendroid and ios-driver. Michael Palotas and Francois Reynaud spent more than a decade working for eBay and were instrumental in bringing software development and test engineering at eBay into the agile age.

SLIDE 3

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

AGENDA

Introduction
Where is Selenium?
What is Selenium?
The problem
The solutions
The problems with the solutions

3

SLIDE 4

___________________________________________________________________________________________________________________________________________________ 4

Test automation is… software development

SLIDE 5

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

A little history

Seleniumwas so named because Huggins, dissatisfiedwith testing tools

n the market, was seeking a name that wouldpositionthe productas

an alternative to Mercury Interactive QuickTestProfessional commercial testingsoftware. The name, Selenium, was selected because seleniummineral supplementsserve as a cure for mercury poisoning, Huggins explained.

SLIDE 6

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Selenium – what is it?

Selenium automates browsers – that’s it Selenium is a HTTP protocol describing user interactions Selenium is becoming a W3C standard: http://www.w3.org/TR/webdriver Supports most browsers Supports most programming languages

6

SLIDE 7

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Selenium – where is it?

7

SLIDE 8

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Selenium„flavors“

Selenium IDE Selenium Selenium GRID

SLIDE 9

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

The problem

9

SLIDE 10

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

The solution - Selenium Grid

10

SELENIUM GRID HUB

TestNG Maven CI CLI

SLIDE 11

___________________________________________________________________________________________________________________________________________________

The problems with the solution

Inhouse

Setup
Operation
Maintenance
Open source version is missing

lots of features for enterprise usage

Cloud

Security
Price
Performance
Control

11

SLIDE 12

___________________________________________________________________________________________________________________________________________________

Selenium Grid - inhouse or cloud?

12

SLIDE 13

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Thoughts to consider

Inhouse or cloud?

Security
Scalability
Performance
Pricing
Reporting and monitoring
Target applications

13

SLIDE 14

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Security

Inhouse: secure
Cloud: potential security concerns. No-go for CH banks J.

14

SLIDE 15

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Scalability

Inhousesolutions scale much better
More tests != more expensive
More parallel tests != more expensive

15

SLIDE 16

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Performance

Widely reported performance issues with cloud providers
No control over performance with cloud solutions
Inhousesolutions should be close to the CI and the application under

test

16

SLIDE 17

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Price

Cloud seems cheap at first BUT
Becomes very expensive when scaling
Self built in-house solutions require 1-2 very good engineers full time

to operate and manage an enterprise grade Selenium Grid + the initial setup cost (6-12 person months)

17

SLIDE 18

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Financials (in-house / self-built Selenium Grid)

18

Building your own Enterprise Scale

Selenium Grid: 3-6 months (1-2 “good” engineers)

Does not include features like video

reporting, live view, extended logging etc.)

Operating costs: 150 – 180K / year

Assumptions:

Cost for building the Selenium Grid are not included
Internal cost / hour: CHF 150
“advanced” customer: Grid nodes don’t need to be

configured seprarately

Browser: Firefox, Chrome, IE/Edge, Safari Mac
Parallel slots: 50

SLIDE 19

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Reporting & Monitoring

Out of the box Selenium Grid does not provide any reporting &

monitoring capabilities

Cloud solutions leave the reporting to the user
Inhousesolutions can be built with custom reporting tailored to the
rganization’s needs

19

SLIDE 20

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Keeping things up to date

Cloud: no problem
In-house: problem

20

SLIDE 21

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Target applications

Web… probably Mobile … very likely

21

SLIDE 22

___________________________________________________________________________________________________________________________________________________

Summary

Inhouse

Fast
Secure
Scalable
Full control
Management + maintenance

effort

Big commitment
$$$$$$$$$

Cloud

Easy access
Security concerns
Does not scale well
No control
Low commitment
$$$$$

22

SLIDE 23

___________________________________________________________________________________________________________________________________________________

One last thing…

23

SELENIUM BOX

SLIDE 24

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

SELENIUM BOX – WHAT IS IT?

Sel Seleni enium um Box Box is a a

secure in-house auto-maintenance auto-scaling Selenium Grid solution for running cross browser and mobile Selenium tests

24

SLIDE 25

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

SELENIUM BOX – WHO IS IT FOR?

Sel Seleni enium um Box Box is des esigned ned for

r or
rgani

anizat ations

ns th

that t re require re

Security and data privacy Scalability and running many tests in a short time A maintenance and worry free Selenium Grid Support for all major browsers (incl. IE/Edge and Mac Safari and older versions) Seamless integration with all common CI systems In-house engineering resources to focus on core competencies rather than building a Selenium Grid and test infrastructure Full control over the Selenium Grid

25

SLIDE 26

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

MORE INFORMATION

http://www.element34.net/seleniumbox FAQ: http://www.element34.net/faq-selenium-box White paper: http://bit.ly/e34-selenium-box-whitepaper

26

SLIDE 27

___________________________________________________________________________________________________________________________________________________ 27

Element34 Solutions GmbH Teichweg 8 8853 Lachen, Switzerland http://www.element34.net contact@element34.net