CAI Testing Tool CAI Testing Tool Jeff Smith and Mary Dascola The - - PowerPoint PPT Presentation

▶

Feb 26, 2023 229 likes •411 views

CAI Testing Tool CAI Testing Tool Jeff Smith and Mary Dascola The 11th International Blaise Conference Annapolis, Maryland September 2007 Introduction Introduction The road to standardized testing Increase the over-all quality of

SLIDE 1

CAI Testing Tool CAI Testing Tool

Jeff Smith and Mary Dascola The 11th International Blaise Conference Annapolis, Maryland September 2007

SLIDE 2

Introduction Introduction

The road to standardized testing

Increase the over-all quality of Computer-

Assisted Instruments (CAI) Assisted Instruments (CAI)

Reduce the cost of testing
Increase access to information concerning

CAI development and de-bugging p gg g

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 3

Objectives Objectives

Develop a generic testing tool that

Can be used by all projects using Blaise CAI

R lt i ti d t i

Results in time and cost savings
Allows for critical path testing
Allows for testing data models at various stages
f development
f development
Is adaptable for multiple environments

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 4

CTT Components CTT Components

Instrument Testing test and enter problems Preload Builder create and modify preload Manage Problems problems (tester) preload (tester) review and assign problems (testing coordinator) Random Case Generator Manage Problems l l d I t t T ti Reports Generator Admin release resolved problems (programmer) Instrument Testing re-test resolved problems (tester)

Survey Research Center • Institute for Social Research • University of Michigan

(tester)

SLIDE 5

Preload Builder Preload Builder

Data loaded to Blaise instrument that are

used as jump determinants, text fills, etc

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 6

Instrument Testing Instrument Testing

Problems entered on a per item basis

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 7

Manage Problems Manage Problems

Review and management of problems

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 8

Manage Problems Manage Problems

Assign, edit, reprioritize problems

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 9

Instrument Testing Instrument Testing

Re-testing problems

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 10

Reports Reports

Detailed Reports: current status of testing

Ready to Test Not Fixed

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 11

Reports Reports

Summary Reports: performance metrics

Problems F d Found

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 12

Random Case Generator Random Case Generator

1. Select preload;

p ; specify #cases to be generated

2. Specify fields

with constant values

Survey Research Center • Institute for Social Research • University of Michigan

a ues

SLIDE 13

Random Case Generator Random Case Generator

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 14

Admin Admin

Administration tasks

Add projects; project setup

A i j

Assign testers to projects
Attach priority to problem types

p y p yp

Assign access rights
Import master preload

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 15

Conclusions Conclusions

Testing process streamlined & standardized
Time savings leading to cost reductions

Fl ibl d l f j

Flexible and easy-to-use tool for projects

and programmers

Reduction in misinformation and

miscommunication miscommunication

Survey Research Center • Institute for Social Research • University of Michigan

SLIDE 16

CAI Testing Tool CAI Testing Tool

Thank You

Thank You Q ti

Questions

Survey Research Center • Institute for Social Research • University of Michigan