F8 November 8, 2002 11:15 AM A C USTOM A UTOMATION F RAMEWORK AND T - PDF document

BIO PRESENTATION F8 November 8, 2002 11:15 AM A C USTOM A UTOMATION F RAMEWORK AND T EST C ASE M ANAGEMENT S OLUTION Darin Magoffin, Todd Hovorka, and Rich Wolkins PowerQuest International Conference On Software Testing Analysis & Review November 4-8, 2002 Anaheim, CA USA

Darin Magoffin, Todd Hovorka and Rich Wolkins Darin Magoffin, Todd Hovorka and Rich Wolkins have Software Automation Testing experience totaling more than 30 years combined. Using their skills and background in software testing, they have combined their strengths to create a robust Test Case/Automation Framework that suits the unique challenges of PowerQuest's products. Their experience and skill set have been aquired at companies like WordPerfect, Novell, Corel, PowerQuest, and Gazelle Systems.

A Custom Automation A Custom Automation Framework and Test Case Framework and Test Case Database Database Automation can be your friend Automation can be your friend

Overview • Why did PowerQuest build their own Test Case and Automation Framework? • Obstacles overcome and problems solved • Automation Framework Process Flowchart • Development Tools used • Automation Server/Client/Log Manager overview • See TCA (Test Case Automation) Manager, Automation Server, Automation Client, Log Manager in a real live, “No smoke and mirrors” demo • Q/A PowerQuest Corporation 2

Why did PowerQuest build their own Test Case and Automation Framework? • We had the expertise in house • Existing Testing Frameworks, could not address unique issues that PowerQuest products have • We needed a tightly integrated Test Case database with an automation framework • We had existing automation that could more easily be “tweaked” to fit into a custom built system than into existing commercial systems PowerQuest Corporation 3

Obstacles overcome and problems solved • Manager Buyoff • Modifying already existing automation technologies to be integrated into the system • Metrics at a project level for Test Case results both manual and automated • Customizable Test Case matrix to allow for all combination of Operating Systems, File Systems, and Languages • Automated submissions (Project Builds and Automation Jobs) PowerQuest Corporation 4

Automation Framework Process Flowchart PowerQuest Corporation 5

Development Tools used • Delphi 6 – (Automation Server, Automation Client, Verify Build Notification Client, Log Manager) • Borland’s C++ Builder 5 – (TCA Manager) • Microsoft Visual C++ 6 – (Test harness for Calculator and PartitionMagic 8) • AppTester – (Automation API tool that integrates with Microsoft Visual C++. It is used by the test harness to drive the applications being tested) PowerQuest Corporation 6

Automation Server Overview • Listens for Automation Client requests • Monitors Automation Run Queue for Pending Jobs • Qualifies Jobs to Available Clients • Farms out Jobs to Qualified Client Machines • Handles all database requests • Builds Client Profiles from system information • Monitors & Displays all Client/Server communications PowerQuest Corporation 7

Automation Server Overview PowerQuest Corporation 8

Automation Client Overview • Gathers systems information for automation qualification and system analysis purposes • Listens for, and executes Automation Jobs sent to it by the Automation Server PowerQuest Corporation 9

Automation Client Overview PowerQuest Corporation 10

Log Manager Overview • Implemented as an NT Service • Monitors all specified folders for the existence of log files • Parses all detected logs for specified tags • Emails results to specified recipients • Closes the automation job in the run queue • Saves automation job results to the database PowerQuest Corporation 11

See TCA Manager, Automation Server, Automation Client, Log Manager in a real live, “No smoke and mirrors” demo PowerQuest Corporation 12

Q/A PowerQuest Corporation 13