[PPT] - Rapid Web Testing in a High-Velocity Environment an introduction to PowerPoint Presentation

SLIDE 1

1

Rapid Web Testing in a High-Velocity Environment

Presented by Greg Paskal an introduction to

SLIDE 2

3

Frequent changes to Web pages

and applications.

Minimal time allowed for sufficient

test coverage.

Expectations of what can be done

in the amount of time given may not be accurate.

The Problem

SLIDE 3

4

Common vs. QA perception of a simple e-mail address change. Common Perception

Is the e-mail link working?

QA Perception

Is the e-mail link working? Does the link launch the e-mail client? Is the e-mail recipient correct? Have other things been impacted by the change? etc…

Example

SLIDE 4

5

The Solution

Minimal Essential Testing Strategy

METS

A strategy to help get the essential testing done within the time frame allowed.

SLIDE 5

6

Preparedness A Strategy of…

METS is…

METS requires preparing for the inevitable product being thrown over the wall.

SLIDE 6

7

METS is…

A Methodology
An Approach
Customizable

Flexible Scaleable Extensible

SLIDE 7

8

METS is not?

Not a silver bullet Not a product Not an automated process

SLIDE 8

9

Foundational METS Concepts

SLIDE 9

10

Objects can be viewed from various perspectives including…

Physical & Functional

1

Foundational METS Concepts

SLIDE 10

11

Foundational METS Concepts

1

Physical

Tires Lights Glass

SLIDE 11

12

Foundational METS Concepts

1

Functional

Acceleration Stopping Lighting Cooling

SLIDE 12

13

Foundational METS Concepts

Actions can be prioritized by importance such as…

Critical
High
Medium
Low

2

SLIDE 13

14

2

Low Medium High Critical

Physical Prioritization

Tires

Four Condition Pressure Balanced

Foundational METS Concepts

SLIDE 14

15

2

Low Medium High Critical

Functional Prioritization

Completely Stops Expected Timeframe Under Wet Conditions Emergency Brake

Stopping

Foundational METS Concepts

SLIDE 15

16

Getting Started in METS

Two preliminary steps

Create a Physical Test Grid

Step One When creating your test grids, identify everything you would like to test if time were not a factor. Step Two

Create a Functional Test Grid

definition: A physical test grid simply contains touchable components of your application such as pages, graphics, forms, links and text. definition: A functional test grid contains business process necessary to utilize aspects of your application. Requirement documents or user guides can help in creating these grids. hint: Create a list of all the touchable components of your application in a spreadsheet. hint: Using your requirement documents or user guide, create a high level list of functional areas such as Product Catalog, Accounts, Search, and so forth.

SLIDE 16

17

Getting Started in METS

Create Physical Test Grid

Create a Physical Test Grid

Step One When creating your test grids, identify everything you would like to test if time were not a factor. Step Two

Create a Functional Test Grid

definition: A physical test grid simply contains touchable components of your application such as pages, graphics, forms, links and text. definition: A functional test grid contains business process necessary to utilize aspects of your application. Requirement documents or user guides can help in creating these grids. hint: Create a list of all the touchable components of your application in a spreadsheet. hint: Using your requirement documents or user guide, create a high level list of functional areas such as Product Catalog, Accounts, Search, and so forth.

SLIDE 17

18

Beginnings of a Physical Test Grid

Think about all the physical types of objects interacted with when using the application. List these under a column labeled “Categories.” METS allows your test grids to grow over time. Simply start with the obvious items for now, knowing you will add to it later.

SLIDE 18

19

Links

Typical Physical Test Grid Objects

Images Buttons Facts Forms

SLIDE 19

20

Building on the Physical Test Grid

Next add a Critical column and write down test for each specific category. Add High, Medium and Low columns and enter appropriate test for each of these columns and categories.

SLIDE 20

21

Sample of a Completed Physical Test Grid

Once in your spreadsheet, the Physical Test Grid will be a valuable tool in your testing arsenal. This is just a partial view of a completed Physical Test Grid containing nearly 100 different test that can be performed.

SLIDE 21

22

Another way to look at it…

Create a second spreadsheet breaking each Physical Test Grid entry into a separate line. Then, add a column for Time Required and Potential Severity and enter this information for each item. The Physical Test Metrics spreadsheet provides invaluable information that will be applied to the creation of the Functional Test Grid.

SLIDE 22

23

Continuing on…

Create Functional Test Grid

Create a Physical Test Grid

Step One When creating your test grids, identify everything you would like to test if time were not a factor. Step Two

Create a Functional Test Grid

definition: A physical test grid simply contains touchable components of your application such as pages, graphics, forms, links and text. definition: A functional test grid contains business process necessary to utilize aspects of your application. Requirement documents or user guides can help in creating these grids. hint: Create a list of all the touchable components of your application in a spreadsheet. hint: Using your requirement documents or user guide, create a high level list of functional areas such as Product Catalog, Accounts, Search, and so forth.

SLIDE 23

24

Now Build the Functional Test Grid

Begin by writing down high-level test categories based upon your requirement documentation or simple observation of the

application. These item will go under the Categories column.

METS allows your test grids to grow over time. Simply start with the obvious items for now, knowing that you will add to it later.

SLIDE 24

25

Sample of a Completed Functional Test Grid

Build the Functional Test Grid using your test cases or requirement documentation as a guide. This will provide interesting insight to testing areas that can be cut back when less an optimal time frames are given This is a partial view of a completed Functional Test Grid. Yours will likely have many more entries.

SLIDE 25

26

Another way to look at it…

Create a second spreadsheet breaking each Functional Test Grid entry into a separate line. Then add columns for Time Required and Potential Severity and enter this information for each column. The Time Required information can be estimated using the Physical Test Metrics spreadsheet. Remember, you have estimated the time it takes to check various physical attributes of your application.

SLIDE 26

27

Advanced METS

There are three areas that will impact the time you have to test.

Breakdown the testing for estimation

1. Direct Testing

Test pertaining to the obvious change or fix.

Example: If the login function was changed, you would obviously test logging in.

2. Related Testing

Test pertaining to areas that may be impacted by the changes made.

Example: If the login function was changed, then you might also test; creating a new user account, changing user account information or requesting a forgotten password.

3. Regression Testing Test you would run on the application regardless of what

has changed.

Example: Accepting an order, accessibility to the online product catalog and store locator function.

SLIDE 27

28

Estimating the time budget

Determine how much time to budget for each of the three types of test categories.

25% Regression Testing 50% Related Testing 25% Direct Testing

Budgeted % Description

Time budgets will vary depending on your development team’s track record of unit testing and catching obvious bugs before given to QA.

SLIDE 28

29

Enhancing the Functional Test Metrics

Columns have been added to the Functional Test Metrics to easily specify which test fall under one of the three test categories and the total time required to complete these test.

SLIDE 29

30

Calculate Actual Time vs. Budgeted Time

By utilizing the calculation functions within your spreadsheet, it’s possible to determine how much time it will take to complete your selected test vs. the amount of time budgeted for them. Continue to add test cases until Time Utilized is the same or close to Time Budgeted.

SLIDE 30

31

Let the Testing Begin!

Everything is now in place to direct your testing in the limited time frame given. Simply execute the test you’ve selected in the Functional Test Metric!

SLIDE 31

32

Lets Review:

SLIDE 32

33

Parting Thoughts…

Remember the following when deciding to incorporate METS into your testing efforts:

METS will only be as effective as the preparation you

put into it.

Begin developing your METS grids with what you

currently know, even if it seems incomplete.

Each of the METS grids will provide valuable insight

into your application and areas for potential testing.

Continue to add and evolve the METS grids,

because testing never ends!

SLIDE 33

34

Taking that First Step

The Physical Test Grid has been the most valuable tool in my arsenal, it’s where METS got it’s start! Much of your quick turn-around testing can be accomplished by simply using the Physical Test Grid as a guide. The Physical Test Grid also can be used to broaden the coverage of your test cases.

SLIDE 34

35

www.GregPaskal.com/METS

On the Web

SLIDE 35

36