T12 Thursday, May 18, 2006 1:30PM A UTOMATED S ETUP AND T EAR D OWN - PDF document

BIO PRESENTATION T12 Thursday, May 18, 2006 1:30PM A UTOMATED S ETUP AND T EAR D OWN OF C OMPLEX , M ULTI - TIER T EST C ONFIGURATIONS James Phillips Akimbi Systems International Conference On Software Testing Analysis and Review May 15-19, 2006 Orlando, Florida USA

James Phillips James Phillips brings more than 20 years of software industry experience to Akimbi Systems, which he co-founded in 2004. Prior to founding Akimbi, James was senior vice president of products and marketing at Actional Corporation (acquired by Progress Software) the pioneering leader in the service-oriented systems management software category. Previously, James was vice president of business development and product marketing at Ensim Corporation, where he successfully commercialized the company's technology assets. James has held leadership positions in software engineering, product management, business development and marketing management at Intel, Synopsys, Intuit, Central Point Software and Fifth Generation Systems. He is a popular speaker and writer, and has been featured in a number of industry conferences and publications. James holds a BS in mathematics and earned his MBA, with honors, from the University of Chicago.

Automated Setup and Tear T Down of Complex, Multi-tier 12 Test Configurations James Phillips, Akimbi

Enterprise Software Architecture Evolution Monolithic Client-server 3-tier, n-tier Service-oriented

Resulting Challenges for QA organizations • Server Sprawl – 2-3 machines in application development and test for every server in production (+ storage, networking …) – Server to Staff Ratios exceed 7:1 in some cases • Setup and Provisioning Overhead – Repetitive system setup tasks overwhelming IT and slowing software development cycles – Accounts for more than 50% of time expended in the development and test cycle • Costly System Failures – Difficult to reproduce and resolve software defects before production deployment

Gaps have opened in test automation solution continuum out-of-context unit testing defects can’t be reproduced (interop and proximity) architecture IBM Rational Rose development JUnit Visual Studio Merant PVCS Serena TeamTrack QA Mercury TestDirector Mercury QTP data center operations manual test system configuration application support design develop test deploy support

A virtual lab automation system integrates with existing processes and solutions, filling the gaps architecture IBM Rational Rose development JUnit VLA system Visual Studio VLA system Merant PVCS Serena TeamTrack QA Mercury TestDirector VLA system Mercury QTP data center operations application support design develop test deploy support

Virtual Lab Automation – Shared Resource Pool, Automated Provisioning Shared pool of servers, storage Servers are Provisioned and networking resources From Library Akimbi Slingshot Configuration Library (grouped machine images) Equity Capital Markets Fixed Income Analytics Central QA Support Trading System Developers System Developer in Bangalore, India in New Jersey in New York

Virtual Lab Automation – Architecture VLA System Users New Jersey Dev Facility Vancouver Data Center VLA Server Image Storage Library CIM Application Developer CIM Application Developer Walldorf Dev Facility FP&A Application Developer Bangalore Outsource Partner Virtualized Server Pool QA Automation Engineer

Self-service, instant “check out” from library Akimbi Slingshot Server Image Storage Library 1 2 Application Developer Walldorf Dev Facility 3 Virtualized Server Pool Automated Virtual Lab

Effortless capture of configurations to the library Akimbi Slingshot Server Image Storage Library 2 3 1 Application Developer Walldorf Dev Facility Virtualized Server Pool Automated Virtual Lab

Before Testing – QA creates and snapshots test case configurations QA engineer Test Lab in Palo Alto 1. Create from scratch 2. Clone existing snapshot 3. Clone partial snapshot test server control akimbi control 2 Snapshots saved – virtual single virtual test test servers 1 QA engineer creates test server or a bundle of case configurations: servers for Servers, OS, Data, management as a Application unit.

Testing – Existing test tools provision test configurations using VLA Akimbi Snapshot 3 tier test configuration reanimate test servers: server-OS-app virtual test servers elapsed time for snapshot, clone and reanimation measured in seconds

Testing – Automated test executes as usual 3 tier test configuration t e s t i n p u t s a n d r e s u l t s virtual test servers

Test success - Configuration is removed in preparation for next iteration delete test servers

Test anomaly - Snapshot, create bug report and continue testing 1 anomaly detected 2 “create snapshot” command 3 snapshot taken and stored virtual test servers 4 problem report created with snapshot links

Debugging – Step 1: Developer receives bug report and clicks to restore environment Developer in Austin Test Lab in Palo Alto Test Lab 3 Test server configuration reanimated 1 (following physical cues) Bug report arrives to assigned developer test server control 2 Developer clicks to reanimated reanimate test virtual test servers configuration – before or after the 4 anomaly was detected

Debugging – Step 2: Developer debugs in exact environment in which bug occurred Developer in Austin Test Lab in Palo Alto remote connections 3 tier test configuration test server control akimbi control virtual test servers Test Lab

Virtual Lab Automation - Benefits Akimbi Slingshot Capability Customer Benefit Pool and share server, networking, storage and other • Reduce equipment-related capital and operating expenditures resources between software development, and test teams • Accelerate functional testing and individuals Automatically and rapidly set up and tear down complex, • Shave man-weeks or months off every software development project multi-machine software configurations for use in • Increase the number of certified deployment configurations supported development and test by new software systems • Find and fix more bugs, earlier in the software development lifecycle Give every developer or test engineer the equivalent of • Enable “ real world” unit testing their own fully-equipped data center with dedicated • Slash time and energy wasted begging, stealing, re-configuring and provisioning staff protecting hoarded servers, storage and networking equipment Maintain a comprehensive library of customer and • Eliminate upgrade breakage production system environments • Deliver better support users of a software system • Rapidly troubleshoot customer production problems Suspend and capture “ live” multi-machine configurations • Reproduce bugs reliably and reduce time spent in the debug phase to a shared library • Reduce the number of latent software defects that slip into production Efficiently move configurations between development • Increase communication and productivity across distributed software and test facilities development teams • Enable confident and efficient outsourcing of software development and test activities

Leading organizations in deployment

James Phillips james@akimbi.com (650) 356-4401 direct (408) 832-3066 cell Akimbi Systems 1400 Fashion Island Blvd. Suite 900 San Mateo, CA 94404 (650) 887-2204 fax