CAI Testing Tool CAI Testing Tool Jeff Smith and Mary Dascola The - PowerPoint PPT Presentation

CAI Testing Tool CAI Testing Tool Jeff Smith and Mary Dascola The 11th International Blaise Conference Annapolis, Maryland September 2007

Introduction Introduction The road to standardized testing • Increase the over-all quality of Computer- Assisted Instruments (CAI) Assisted Instruments (CAI) • Reduce the cost of testing • Increase access to information concerning CAI development and de-bugging p gg g Survey Research Center • Institute for Social Research • University of Michigan

Objectives Objectives Develop a generic testing tool that • Can be used by all projects using Blaise CAI • Results in time and cost savings R lt i ti d t i • Allows for critical path testing • Allows for testing data models at various stages of development of development • Is adaptable for multiple environments Survey Research Center • Institute for Social Research • University of Michigan

CTT Components CTT Components Instrument Testing Preload Builder test and enter create and modify Manage Problems problems problems preload preload review and assign (tester) (tester) problems (testing coordinator) Random Case Manage Problems Generator Generator release resolved l l d Instrument Testing I t t T ti Reports problems re-test resolved Admin (programmer) problems (tester) (tester) Survey Research Center • Institute for Social Research • University of Michigan

Preload Builder Preload Builder • Data loaded to Blaise instrument that are used as jump determinants, text fills, etc Survey Research Center • Institute for Social Research • University of Michigan

Instrument Testing Instrument Testing • Problems entered on a per item basis Survey Research Center • Institute for Social Research • University of Michigan

Manage Problems Manage Problems • Review and management of problems Survey Research Center • Institute for Social Research • University of Michigan

Manage Problems Manage Problems • Assign, edit, reprioritize problems Survey Research Center • Institute for Social Research • University of Michigan

Instrument Testing Instrument Testing • Re-testing problems Survey Research Center • Institute for Social Research • University of Michigan

Reports Reports • Detailed Reports: current status of testing Ready to Test Not Fixed Survey Research Center • Institute for Social Research • University of Michigan

Reports Reports • Summary Reports: performance metrics Problems F Found d Survey Research Center • Institute for Social Research • University of Michigan

Random Case Generator Random Case Generator 1. Select preload; p ; specify #cases to be generated 2. Specify fields with constant values a ues Survey Research Center • Institute for Social Research • University of Michigan

Random Case Generator Random Case Generator Survey Research Center • Institute for Social Research • University of Michigan

Admin Admin Administration tasks • Add projects; project setup • Assign testers to projects A i j • Attach priority to problem types p y p yp • Assign access rights • Import master preload Survey Research Center • Institute for Social Research • University of Michigan

Conclusions Conclusions • Testing process streamlined & standardized • Time savings leading to cost reductions • Flexible and easy-to-use tool for projects Fl ibl d l f j and programmers • Reduction in misinformation and miscommunication miscommunication Survey Research Center • Institute for Social Research • University of Michigan

CAI Testing Tool CAI Testing Tool • Thank You Thank You • Questions Q ti Survey Research Center • Institute for Social Research • University of Michigan