W13 May 14, 2003 3:15 PM B UILDING A F LEXIBLE A UTOMATED T ESTING - - PDF document

▶

Jan 22, 2024 318 likes •545 views

BIO PRESENTATION W13 May 14, 2003 3:15 PM B UILDING A F LEXIBLE A UTOMATED T ESTING A RCHITECTURE Jack Harris Washington Mutual Bank International Conference On Software Testing Analysis & Review May 12-16, 2003 Orlando, FL USA Jack

SLIDE 1

BIO PRESENTATION

International Conference On Software Testing Analysis & Review May 12-16, 2003 Orlando, FL USA

W13

May 14, 2003 3:15 PM

BUILDING A FLEXIBLE AUTOMATED TESTING ARCHITECTURE

Jack Harris Washington Mutual Bank

SLIDE 2

Jack Harris

Jack Harris is currently a Manager in the Technology Solutions Group of Washington Mutual Bank, located in Irvine California. Jack has been with the bank since August of

2001. During that time he has led a dedicated project team of developers and test

analysts in bringing test automation to the Home Loans and Insurance Services group of Washington Mutual. Additionally, he has responsibility for leading the Program Management Office, Test Management, and Technical Services organizations. Prior to 2001 Jack was employed by Epicor Software Corporation (formerly Platinum Software Corporation) also located in Irvine, California. He held many positions over nearly a 7 year period from Test Analyst, Team Lead, Manager and finally Director of Quality Assurance and Documentation for the Corporation. He was responsible for developing an automated testing solution for Epicor while also working with multiple divisions and vendors to improve the quality of their software products. During this period Jack won two President’s awards given annually for his research and development of automated software testing tools. Jack was also selected to participate in the Leadership and Management Program for Technology Professionals (LAMP) at the University of California, at Irvine where he was selected by his peers to be the primary speaker for the graduating class. Previously Jack worked for 30 years for Fortune 500 companies in the Aerospace and Semiconductor industries located in Southern California. Jack held a variety of both Management and Technical positions in the Finance, Accounting, and IT organizations. Jack graduated from Fullerton College.

SLIDE 3

Slide

Optis Test Automation Project

Jack Harris May 14, 2003

SLIDE 4

2 Slide

Optis Test Automation

Test Automation Strategy

– Build test automation engine – Make the testing tools data driven – Segregate test scripts from the data – Build the tools with flexible components – Invest in coding a library of proven functions – Create standard test scripting template to enforce scripting standards – Developers code, SME’s test

SLIDE 5

3 Slide

User Operator Create Test Scripts

Test Execution Engine Error Handling Recovery Application Under Test Optis Applications Under Test

Screen Scraper (VB) Files Reader C++ Files Reader HTML Files Reader Convert to XML XML Application Map Writer XML Application Map Excel Test Script Builder Excel Test Scripts

Results

Library Functions

Script Reader

Test Cycle Manager User Interface Log & Report File Viewer

WinRunner Test Software

Automation Commands

Test Automation Main Repository

Test Script Reader

Test Automation High Level Component Diagram

SLIDE 6

4 Slide

Map Third Party Software

Library

SLIDE 7

5 Slide

Optis Test Automation

Application Map for each Application Under Test

– Batch process – parses code to identify windows, objects – Creates road map of what is being tested (object recognition method) – Produces XML output of each application under test (re-run after each drop)

Applications under Test Screen Scraper PBL (PB) Files Reader HTML Files Reader .FRM (VB) Files Reader Converts to XML

XML Application Map Writer

Application Map Builder

SLIDE 8

6 Slide

Optis Test Automation

Test Script Builder

– Points to Application Map from prior step – Special Excel Workbook with embedded code – Does not require 3rd party tool installed to use – Sheet 1 used to Document Test/Environment – Sheet 2 used for Test Script Creation and data – Sheet 3 used for data creation as needed

works with any ODBC compliant data source

SLIDE 9

7 Slide

Optis Test Automation

SLIDE 10

8 Slide

Optis Test Automation

SLIDE 11

9 Slide

Data Sheet

SLIDE 12

10 Slide

Optis Test Automation

Test Engine

– Compiles Excel based scripts into WinRunner language – Executes action words from scripts for each object in each window from WinRunner library function – Use Excel based scripts as utilities (log on/off etc.) – Same script can execute variable amounts of data – Eliminates need for redundant scripts – Reduces script maintenance

SLIDE 13

11 Slide

Optis Test Automation

Library Functions CheckBox EditBox ListBox Custom Controls Library Functions - Why they are important

SLIDE 14

12 Slide

Optis Test Automation

Benefits of WinRunner Library Routines

– Users can only pick valid actions for objects – Library functions can be tested individually and certified by object type – Object functions rarely change – Eliminates writing a program to test a program – When changes occur you modify function in one place, not every script!

SLIDE 15

13 Slide

Library Routine For EditBox

SLIDE 16

14 Slide

Application Map XML

SLIDE 17

15 Slide

Optis Test Automation

User Interface

SLIDE 18

16 Slide

Automation Test Results

Test Results Log:

--Unique log generated

each time the script is run.

--Generated and stored in

PDF format.

--Summarizes test id,

environment and results data.

SLIDE 19

17 Slide

Automation Test Results

Execution and results of each test step are captured in detail and recorded. Failures are identified with a unique color.

SLIDE 20

18 Slide

Automation Test Results

Print screens capture the visual identification of the failure.

SLIDE 21

19 Slide

Automation Test Results

Summary information is captured and can be used to prepare statistical analysis.