Ta Taking your Selenium Te Tests for we web and mobile ile - - PowerPoint PPT Presentation

ta taking your selenium te tests for we web and mobile
SMART_READER_LITE
LIVE PREVIEW

Ta Taking your Selenium Te Tests for we web and mobile ile - - PowerPoint PPT Presentation

Ta Taking your Selenium Te Tests for we web and mobile ile beyond your lo local l Fir Firefox Brows wser Michael Palotas, Francois Reynaud Element34 Solutions GmbH


slide-1
SLIDE 1

___________________________________________________________________________________________________________________________________________________

Ta Taking your Selenium Te Tests for we web and mobile ile beyond your lo local l Fir Firefox Brows wser

Michael Palotas, Francois Reynaud Element34 Solutions GmbH

slide-2
SLIDE 2

___________________________________________________________________________________________________________________________________________________ 2

Element34 Solutions GmbH Gerbiweg 2 8853 Lachen, Switzerland http://www.element34.net

Michael Palotas: michael.palotas@element34.net Francois Reynaud: francois.reynaud@element34.net

“W “We co co-cr created Selenium an and in invented the Sel Seleni enium um Box” We are a boutique consulting firm specialized in agile engineering practices and test automation solutions with Selenium. The company founders are key contributors and thought leaders to open source projects such as Selenium, Selendroid and ios-driver. Michael Palotas and Francois Reynaud spent more than a decade working for eBay and were instrumental in bringing software development and test engineering at eBay into the agile age.

slide-3
SLIDE 3

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

AGENDA

  • Introduction
  • Where is Selenium?
  • What is Selenium?
  • The problem
  • The solutions
  • The problems with the solutions

3

slide-4
SLIDE 4

___________________________________________________________________________________________________________________________________________________ 4

Test automation is… software development

slide-5
SLIDE 5

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

A little history

Seleniumwas so named because Huggins, dissatisfiedwith testing tools

  • n the market, was seeking a name that wouldpositionthe productas

an alternative to Mercury Interactive QuickTestProfessional commercial testingsoftware. The name, Selenium, was selected because seleniummineral supplementsserve as a cure for mercury poisoning, Huggins explained.

slide-6
SLIDE 6

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Selenium – what is it?

Selenium automates browsers – that’s it Selenium is a HTTP protocol describing user interactions Selenium is becoming a W3C standard: http://www.w3.org/TR/webdriver Supports most browsers Supports most programming languages

6

slide-7
SLIDE 7

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Selenium – where is it?

7

slide-8
SLIDE 8

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Selenium„flavors“

Selenium IDE Selenium Selenium GRID

slide-9
SLIDE 9

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

The problem

9

slide-10
SLIDE 10

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

The solution - Selenium Grid

10

SELENIUM GRID HUB

TestNG Maven CI CLI

slide-11
SLIDE 11

___________________________________________________________________________________________________________________________________________________

The problems with the solution

Inhouse

  • Setup
  • Operation
  • Maintenance
  • Open source version is missing

lots of features for enterprise usage

Cloud

  • Security
  • Price
  • Performance
  • Control

11

slide-12
SLIDE 12

___________________________________________________________________________________________________________________________________________________

Selenium Grid - inhouse or cloud?

12

slide-13
SLIDE 13

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Thoughts to consider

Inhouse or cloud?

  • Security
  • Scalability
  • Performance
  • Pricing
  • Reporting and monitoring
  • Target applications

13

slide-14
SLIDE 14

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Security

  • Inhouse: secure
  • Cloud: potential security concerns. No-go for CH banks J.

14

slide-15
SLIDE 15

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Scalability

  • Inhousesolutions scale much better
  • More tests != more expensive
  • More parallel tests != more expensive

15

slide-16
SLIDE 16

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Performance

  • Widely reported performance issues with cloud providers
  • No control over performance with cloud solutions
  • Inhousesolutions should be close to the CI and the application under

test

16

slide-17
SLIDE 17

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Price

  • Cloud seems cheap at first BUT
  • Becomes very expensive when scaling
  • Self built in-house solutions require 1-2 very good engineers full time

to operate and manage an enterprise grade Selenium Grid + the initial setup cost (6-12 person months)

17

slide-18
SLIDE 18

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Financials (in-house / self-built Selenium Grid)

18

  • Building your own Enterprise Scale

Selenium Grid: 3-6 months (1-2 “good” engineers)

  • Does not include features like video

reporting, live view, extended logging etc.)

  • Operating costs: 150 – 180K / year

Assumptions:

  • Cost for building the Selenium Grid are not included
  • Internal cost / hour: CHF 150
  • “advanced” customer: Grid nodes don’t need to be

configured seprarately

  • Browser: Firefox, Chrome, IE/Edge, Safari Mac
  • Parallel slots: 50
slide-19
SLIDE 19

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Reporting & Monitoring

  • Out of the box Selenium Grid does not provide any reporting &

monitoring capabilities

  • Cloud solutions leave the reporting to the user
  • Inhousesolutions can be built with custom reporting tailored to the
  • rganization’s needs

19

slide-20
SLIDE 20

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Keeping things up to date

  • Cloud: no problem
  • In-house: problem

20

slide-21
SLIDE 21

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

Target applications

Web… probably Mobile … very likely

21

slide-22
SLIDE 22

___________________________________________________________________________________________________________________________________________________

Summary

Inhouse

  • Fast
  • Secure
  • Scalable
  • Full control
  • Management + maintenance

effort

  • Big commitment
  • $$$$$$$$$

Cloud

  • Easy access
  • Security concerns
  • Does not scale well
  • No control
  • Low commitment
  • $$$$$

22

slide-23
SLIDE 23

___________________________________________________________________________________________________________________________________________________

One last thing…

23

SELENIUM BOX

slide-24
SLIDE 24

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

SELENIUM BOX – WHAT IS IT?

Sel Seleni enium um Box Box is a a

secure in-house auto-maintenance auto-scaling Selenium Grid solution for running cross browser and mobile Selenium tests

24

slide-25
SLIDE 25

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

SELENIUM BOX – WHO IS IT FOR?

Sel Seleni enium um Box Box is des esigned ned for

  • r or
  • rgani

anizat ations

  • ns th

that t re require re

Security and data privacy Scalability and running many tests in a short time A maintenance and worry free Selenium Grid Support for all major browsers (incl. IE/Edge and Mac Safari and older versions) Seamless integration with all common CI systems In-house engineering resources to focus on core competencies rather than building a Selenium Grid and test infrastructure Full control over the Selenium Grid

25

slide-26
SLIDE 26

___________________________________________________________________________________________________________________________________________________

______________________________________________________________________________________________________

MORE INFORMATION

http://www.element34.net/seleniumbox FAQ: http://www.element34.net/faq-selenium-box White paper: http://bit.ly/e34-selenium-box-whitepaper

26

slide-27
SLIDE 27

___________________________________________________________________________________________________________________________________________________ 27

Element34 Solutions GmbH Teichweg 8 8853 Lachen, Switzerland http://www.element34.net contact@element34.net