Questionnaire Specifications Database (QSD) i i ifi i b ( ) - - PowerPoint PPT Presentation

questionnaire specifications database qsd i i ifi i b for
SMART_READER_LITE
LIVE PREVIEW

Questionnaire Specifications Database (QSD) i i ifi i b ( ) - - PowerPoint PPT Presentation

Questionnaire Specifications Database (QSD) i i ifi i b ( ) for Blaise Surveys Lilia Filippenko, Joe Nofziger and Valentina Grouverman September 2007 September, 2007 September, 2007 RTI International is a trade name of Research


slide-1
SLIDE 1

i i ifi i b ( ) Questionnaire Specifications Database (QSD) for Blaise Surveys

Lilia Filippenko, Joe Nofziger and Valentina Grouverman

September 2007 September, 2007

September, 2007

RTI International is a trade name of Research Triangle Institute

3040 Cornwallis Road ■ PO Box 12194 ■ Research Triangle Park North Carolina USA 27709

1

3040 Cornwallis Road ■ P.O. Box 12194 ■ Research Triangle Park, North Carolina, USA 27709 Phone 919-541-6717 e-mail lfilippenko@rti.org Fax 919-541-6178

slide-2
SLIDE 2

Introduction Introduction

Questionnaire Specifications Database (QSD) Questionnaire Specifications Database (QSD)

  • Streamlines the process of creating Blaise instruments
  • Allows iterative changes at any point in development

g y p p

  • Produces specification documents
  • Supports Audio Computer Assisted Self-Interview (ACASI )
  • Tracks changes

September, 2007 2

slide-3
SLIDE 3

Changing Requirements Changing Requirements

September, 2007 3

slide-4
SLIDE 4

Overview of QSD Overview of QSD

  • User interface and business rules database
  • Back end relational database
  • Each survey team uses a dedicated instance of QSD
  • User Levels

St d d Standard user Questionnaire spec writer Questionnaire programmer Questionnaire programmer

September, 2007 4

slide-5
SLIDE 5

User Interactions User Interactions

  • Spec writers and translators make iterative changes to the

specifications

  • Programmers load specs from a document and automatically

Programmers load specs from a document and automatically create files with modules, types, and fills

  • Programmers export the changes into the Blaise code
  • Programmers create scripts for audio files and generate Blaise

code to play them All t ff it h d d i d l t f th Bl i

  • All staff monitor changes made during development of the Blaise

survey

September, 2007 5

slide-6
SLIDE 6

System flow System flow

September, 2007 6

slide-7
SLIDE 7

Logging Changes Logging Changes

E h i l d i h d i Each entry is logged with a username and timestamp

  • Add new question
  • Delete question

Delete question

  • Change text (question, response option, fill)
  • Change skip logic
  • Problems and comments

Info about skip logic changes Request to add new response option or fill Request to add new response option or fill Problem found in testing

September, 2007 7

slide-8
SLIDE 8

Quality Assurance Quality Assurance

Verifying Changes

Item level M d l l l Module level

Version Control

Version the Blaise instrument Label in source control (Blaise code) Version the exported specifications document Version the exported specifications document

September, 2007 8

slide-9
SLIDE 9

Login to QSD Login to QSD

September, 2007 9

slide-10
SLIDE 10

QSD Main Screen QSD Main Screen

September, 2007 10

slide-11
SLIDE 11

Preview Specs for Module Preview Specs for Module

September, 2007 11

slide-12
SLIDE 12

Edit Questionnaire Edit Questionnaire

September, 2007 12

slide-13
SLIDE 13

Test Audio Files Test Audio Files

September, 2007 13

slide-14
SLIDE 14

QSD for Programmers QSD for Programmers

September, 2007 14

slide-15
SLIDE 15

Update Fields in Blaise DB Update Fields in Blaise DB

September, 2007 15

slide-16
SLIDE 16

QSD at RTI International QSD at RTI International

In use for over two years y

  • More than 10,000 questions among 26 instruments across several

studies

  • Case Study: 442 changes logged in a single day - new version was

10752 12000

y g gg g y ready for testing the same evening

  • Change distribution

2982 2000 4000 6000 8000 10000 908 2000 Total Questions Total Text Changes Skip Logic Changes

Data log from four recent bilingual studies

September, 2007 16

Data log from four recent bilingual studies

slide-17
SLIDE 17

Conclusion Conclusion

Advantages of QSD

  • Specs-Instrument synchronization
  • Programmers focus on logic rather than question wording
  • Addition of a second language without programmer intervention

E tensi e s pport for ACASI

  • Extensive support for ACASI

Future development

W b i t f

  • Web interface
  • Optional use of SQL Server for the back end database

September, 2007 17

slide-18
SLIDE 18

Acknowledgement Acknowledgement

We would like to thank members of the Research Computing Division and Survey Research Division at RTI International for y their use of QSD, as well as for their invaluable comments and suggestions related to its further improvement. For additional information, please contact Lilia Filippenko: lfilippenko@rti.org Joe Nofziger : jmn@rti.org Valentina Grouverman : vgrouverman@rti.org

September, 2007 18