Computer Audio Recorded Interviewing (CARI): Experience Implementing - - PowerPoint PPT Presentation

computer audio recorded interviewing cari experience
SMART_READER_LITE
LIVE PREVIEW

Computer Audio Recorded Interviewing (CARI): Experience Implementing - - PowerPoint PPT Presentation

Computer Audio Recorded Interviewing (CARI): Experience Implementing the New Blaise Capability Rick Dulaney and Wendy Hicks, Westat y y CARI: What and Why CARI: What and Why CARI Elements CARI Elements Collection Management


slide-1
SLIDE 1

Computer Audio Recorded Interviewing (CARI): Experience Implementing the New Blaise Capability

Rick Dulaney and Wendy Hicks, Westat y y

slide-2
SLIDE 2

CARI: What and Why CARI: What and Why

CARI Elements CARI Elements

  • Collection
  • Management
  • Coding

Present in the moment Present in the moment

slide-3
SLIDE 3

CARI Impact on Survey Processes – 1 CARI Impact on Survey Processes – 1

  • Direct observation
  • Interviewer validation
  • Data quality
slide-4
SLIDE 4

CARI Impact on Survey Processes – 2 CARI Impact on Survey Processes – 2

  • Editing
  • Open-ended responses
  • Consent
  • Training
slide-5
SLIDE 5

CARI Implementation Requirements CARI Implementation Requirements

  • Leverage existing hardware
  • Leverage existing hardware
  • Unobtrusive
  • Flexible
  • Integrate with existing data collection
  • Highly usable data
  • CONFIDENTIAL

CONFIDENTIAL

slide-6
SLIDE 6

Recording: Past Recording: Past…

  • Westat-developed recording capability
  • Westat-developed recording capability
  • Overlaid Audit.dll
  • INI file determined details

INI file determined details

  • Considerations
  • Re-engineer to Blaise releases

Re engineer to Blaise releases

  • Issues with navigation
  • No screenshots
slide-7
SLIDE 7

Recording: Present Recording: …Present …

Blaise 4.8.2 CARI Specification Tool

S d fil d h t

  • Sound files and screenshots
  • “Chance” sampling
  • File naming

e a g

  • Consent
  • Logging
  • Many other sound file features
slide-8
SLIDE 8

Recording: Advantages of Blaise CARI Recording: Advantages of Blaise CARI

  • Tightly integrated
  • Maintenance made easy
  • Screenshots
slide-9
SLIDE 9

CARI and Field Management: Challenges CARI and Field Management: Challenges

  • Confidentiality
  • Sound file considerations
  • Very large files
slide-10
SLIDE 10

Coding Sound Files: CARICode Coding Sound Files: CARICode

As CARI data increases As CARI data increases…

  • Replace networked applications with web-based
  • Distribute coding across field staff based on

function

  • Role-based access
  • Paradata is paramount
slide-11
SLIDE 11
slide-12
SLIDE 12

CARICode Functions CARICode Functions

  • Interviewer validation
  • Interviewer validation
  • field supervisors, QA staff
  • Question assessment
  • Question assessment
  • designers, methodologists
  • Interviewer performance
  • Interviewer performance
  • field supervisors
  • Survey data capture
  • Survey data capture
  • coders, editors
slide-13
SLIDE 13

CARI: Implementation Overview CARI: Implementation Overview

  • Design and specification
  • Design and specification
  • Items, probabilities, functions
  • CARICode configuration
  • CARICode configuration
  • Items, coding & verification rates, paradata
  • Testing
  • Testing
  • Unit, integration
  • Production & Reporting
  • Production & Reporting
slide-14
SLIDE 14

Blaise CARI Blaise CARI

Questions or comments welcome

…or: RickDulaney@westat.com