Writing reliable end to end tests End to end browser tests They take - PowerPoint PPT Presentation

Writing reliable end to end tests

End to end browser tests They take a long time to run. Around 4-12 hours Long feedback cycles Tough to read or modify Flaky Not part of the development life cycle

Unit tests are End to end important but they End to End aren’t “tests” Integration they are part of Integration the development Unit Tests process. Unit tests

Why is end to end testing important? Tests whether the flow of an application is performing as designed from start to finish.

Goal Simulate what a real user scenario looks like from start to finish.

Whit

TLDR; Reasons Solutions

Research

Over Engineering

void test() { driver.get(“google.com”); WebElement element = driver.findElement(By.name(“q”)); element.sendKeys("testing frameworks”); element.submit(); }

void google(String query) { driver.get("google.com"); WebElement element = driver.findElement(By.name("q")); element.sendKeys(query); element.submit(); } void testOne() { google("automated testing"); } void testTwo() { google(“qcon london”); }

class GoogleHomePage { Not so simple Test GoogleHomePage(Webdriver driver) { driver.get("google.com"); this.driver = driver; } void searchFor(String query) { WebElement element = driver.findElement(By.name("q")); Noise element.sendKeys("testing frameworks"); element.submit(); } } void testOne() { GoogleHomePage page = new GoogleHomePage(); page.searchFor("testing frameworks") } void testTwo() { GoogleHomePage page = new GoogleHomePage(); page.searchFor("flying foxes") }

• Page Object Pattern • Advanced Page Object Pattern • Facade Design Pattern • Singleton Design Pattern • Fluent Page Object Pattern • IoC Container and Page Object • Strategy Design Pattern • Advanced Strategy Design Pattern • Observer Design Pattern • Observer Design Pattern via Events and Delegate • Observer Design Pattern via IObservable and IObserver

Tester’s spend close to 50% of the time designing and maintaining test frameworks

class GoogleHomePage { Not so simple Test GoogleHomePage(Webdriver driver) { driver.get("google.com"); this.driver = driver; } void searchFor(String query) { WebElement element = driver.findElement(By.name("q")); element.sendKeys("testing frameworks"); element.submit(); } } void testOne() { GoogleHomePage page = new GoogleHomePage(); page.searchFor("testing frameworks") } void testTwo() { GoogleHomePage page = new GoogleHomePage(); page.searchFor("flying foxes") }

✓ Eliminate design ✓ Think like a user

# Specification ## Scenario * Step

# Specification ## Scenario * Step

# Search the internet ## Search Google * Goto “google.com" * Search for “QCon London” * Verify “Qcon London” on the first page

# Search the internet ## Search Google * Goto “google.com" 
 * Search for “QCon London” 
 * Verify “Qcon London” is on the first page ## Search Duck * Goto “duck.com” 
 * Search for “QCon London” 
 * Verify “Qcon London” is on the first page

@Step("Goto <site>") public void goto(String site) { # Search the internet driver.get(site); } ## Search Google * Goto “google.com” @Step(“Search for <query>”) * Search for “QCon London” public void goto(String query) { WebElement element = driver ## Search Duck .findElement(By.name(“q”)); * Goto “duck.com” 
 element.sendKeys(query); * Search for “QCon London” element.submit(); }

✓ Single binary install ✓ Customisable reports ✓ Data driven tests ✓ Plugins ✓ Parallel execution ✓ Support for all IDE’s and languages

✓ Reduced code ✓ Readability ✓ User empathy ✓ Quick feedback

Flakiness Waits Selectors Implicit Intrusive Driver.findElement(…).click() By.Id(“pressMe”) Explicit wait Source based wait = new WebDriverWait(driver, 20); By.Name(“pressMe”) wait.until(…) Structural Fluent wait new FluentWait(WebDriver reference) By.xpath(“//html/body/button”) .withTimeout(timeout, SECONDS) .pollingEvery(timeout, SECONDS)

Smart Locators click(“PRESS ME”)

Smart Locators write(“Qcon”)

Proximity Selectors click(checkbox(near(“Accept terms and conditions)))


 step(“Go to <website>”, (website) => { goto(website): }); 
 # Search the internet step(“Search for <query>”, (query) => { # Search Google write(query); * Go to "google.com" press(‘Enter’); * Search for “qcon” }); * Verify

gauge.org @getgauge taiko.gauge.org gocd.org

✓ Gauge is not BDD ✓ Non prescriptive syntax 
 ✓ Parallel runs out of the box ✓ Screenshots on failure ✓ First class IDE Support ✓ Data stores, external data


 
 
 Concepts Specification # Book <number> tickets # Search for movies 
 * Pick <number> seats 
 * Set location as "Bangalore" 
 * Login in as "John" 
 * Pay using credit card 
 ## Search for blockbusters 
 * Check ticket * Search for theatres playing "Avengers" 
 * Book "2" tickets ## Search 2017 Oscar winners 
 * Search for theaters playing "The shape of water" * Book "2" tickets