F8 November 8, 2002 11:15 AM A C USTOM A UTOMATION F RAMEWORK AND T - - PDF document

BIO PRESENTATION International Conference On Software Testing Analysis & Review November 4-8, 2002 Anaheim, CA USA

F8

November 8, 2002 11:15 AM

A CUSTOM AUTOMATION FRAMEWORK AND TEST CASE MANAGEMENT SOLUTION

Darin Magoffin, Todd Hovorka, and Rich Wolkins PowerQuest

Darin Magoffin, Todd Hovorka and Rich Wolkins

Darin Magoffin, Todd Hovorka and Rich Wolkins have Software Automation Testing experience totaling more than 30 years combined. Using their skills and background in software testing, they have combined their strengths to create a robust Test Case/Automation Framework that suits the unique challenges of PowerQuest's products. Their experience and skill set have been aquired at companies like WordPerfect, Novell, Corel, PowerQuest, and Gazelle Systems.

A Custom Automation A Custom Automation Framework and Test Case Framework and Test Case Database Database

Automation can be your friend Automation can be your friend

PowerQuest Corporation 2

Overview

• Why did PowerQuest build their own Test Case

and Automation Framework?

• Obstacles overcome and problems solved
• Automation Framework Process Flowchart
• Development Tools used
• Automation Server/Client/Log Manager overview
• See TCA (Test Case Automation) Manager,

Automation Server, Automation Client, Log Manager in a real live, “No smoke and mirrors” demo

• Q/A

PowerQuest Corporation 3

Why did PowerQuest build their own Test Case and Automation Framework?

• We had the expertise in house
• Existing Testing Frameworks, could not address

unique issues that PowerQuest products have

• We needed a tightly integrated Test Case database

with an automation framework

• We had existing automation that could more easily be

“tweaked” to fit into a custom built system than into existing commercial systems

PowerQuest Corporation 4

Obstacles overcome and problems solved

• Manager Buyoff
• Modifying already existing automation technologies to

be integrated into the system

• Metrics at a project level for Test Case results both

manual and automated

• Customizable Test Case matrix to allow for all

combination of Operating Systems, File Systems, and Languages

• Automated submissions (Project Builds and

Automation Jobs)

PowerQuest Corporation 5

Automation Framework Process Flowchart

PowerQuest Corporation 6

Development Tools used

• Delphi 6 – (Automation Server, Automation Client,

Verify Build Notification Client, Log Manager)

• Borland’s C++ Builder 5 – (TCA Manager)
• Microsoft Visual C++ 6 – (Test harness for Calculator

and PartitionMagic 8)

• AppTester – (Automation API tool that integrates with

Microsoft Visual C++. It is used by the test harness to drive the applications being tested)

PowerQuest Corporation 7

Automation Server Overview

• Listens for Automation Client requests
• Monitors Automation Run Queue for Pending Jobs
• Qualifies Jobs to Available Clients
• Farms out Jobs to Qualified Client Machines
• Handles all database requests
• Builds Client Profiles from system information
• Monitors & Displays all Client/Server communications

PowerQuest Corporation 8

Automation Server Overview

PowerQuest Corporation 9

Automation Client Overview

• Gathers systems information for automation

qualification and system analysis purposes

• Listens for, and executes Automation Jobs sent to it

by the Automation Server

PowerQuest Corporation 10

Automation Client Overview

PowerQuest Corporation 11

Log Manager Overview

• Implemented as an NT Service
• Monitors all specified folders for the existence of log

files

• Parses all detected logs for specified tags
• Emails results to specified recipients
• Closes the automation job in the run queue
• Saves automation job results to the database

PowerQuest Corporation 12

See TCA Manager, Automation Server, Automation Client, Log Manager in a real live, “No smoke and mirrors” demo

PowerQuest Corporation 13

Q/A