Results of a Pilot Test: Smartphone- Enabled, Full-Probability Panel - - PowerPoint PPT Presentation

▶
results of a pilot test smartphone enabled full
SMART_READER_LITE
LIVE PREVIEW

Results of a Pilot Test: Smartphone- Enabled, Full-Probability Panel - - PowerPoint PPT Presentation

Feb 23, 2024 241 likes •531 views

Results of a Pilot Test: Smartphone- Enabled, Full-Probability Panel Craig A. Hill, PhD BLS Data Capture Technology Forum March 2010 RTI International is a trade name of Research Triangle Institute 1 2 Full-probability panel with Smartphones

slide-1
SLIDE 1

1

RTI International is a trade name of Research Triangle Institute

Results of a Pilot Test: Smartphone- Enabled, Full-Probability Panel

Craig A. Hill, PhD

BLS Data Capture Technology Forum March 2010

slide-2
SLIDE 2

2

slide-3
SLIDE 3

3

Full-probability panel with Smartphones

  • 2007: The problem
  • A potential solution
  • How will we know if it works?
slide-4
SLIDE 4

4

A potential solution

slide-5
SLIDE 5

5

slide-6
SLIDE 6

6

A potential solution

  • Feasibility test
  • Internal (R&D) funding
  • Full area-prob sample
  • Blackjack devices
  • 6 interviewers recruited/trained
  • 92 panellists enrolled
  • Data collection: Jun – Nov 07
slide-7
SLIDE 7

7

Data Collection

  • 19 weekly waves
  • Jul – Nov
  • Email w/ hotlink, plus text reminder
  • 3 SMS surveys
  • National/local issues; health; leisure

activities; device usability

slide-8
SLIDE 8

8

Evaluation

  • Viability of the platform for different

question types, formats, and lengths

  • Develop and test interviewer training program for recruitment and

support

  • Develop and test panel recruitment strategies, and incentive

packages/related materials

  • contact (screening) rate
  • acceptance (recruitment) rate
  • response rate (over time)
  • attrition (retention) rate
slide-9
SLIDE 9

9

Experiments

  • Screen “real estate”
  • SMS (“texting”)
  • Pix
slide-10
SLIDE 10

10

Evaluation: Real Estate

slide-11
SLIDE 11

11

Evaluation: Real Estate

slide-12
SLIDE 12

12

Evaluation: Real Estate

slide-13
SLIDE 13

13

Evaluation: Real Estate

slide-14
SLIDE 14

14

Evaluation: Real Estate

slide-15
SLIDE 15

15

Evaluation: Real Estate

slide-16
SLIDE 16

16

Evaluation: Real Estate

slide-17
SLIDE 17

17

Published Results

Experiments in Mobile Web Survey Design: Similarities to Other Modes and Unique Considerations Andy Peytchev and Craig A. Hill

Social Science Computer Review 000(00) 1-17-2009 http://sscr.sagepub.com Social Science Computer Review OnlineFirst, published on December 8, 2009 as doi:10.1177/0894439309353037

slide-18
SLIDE 18

18

Experiments

  • Screen “real estate”
  • SMS (“texting”)
  • Pix
slide-19
SLIDE 19

19

Evaluation: SMS/Texting

slide-20
SLIDE 20

20

Experiments

  • Screen “real estate”
  • SMS (“texting”)
  • Pix
slide-21
SLIDE 21

21

Evaluation: Pictures

slide-22
SLIDE 22

22

Evaluation: Pictures

slide-23
SLIDE 23

23

Evaluation: Pictures

slide-24
SLIDE 24

24

Evaluation

  • Viability of the platform for different question types, formats, and

lengths

  • Develop and test interviewer training

program for recruitment and support

  • Develop and test panel recruitment strategies, and incentive

packages/related materials

  • contact (screening) rate
  • acceptance (recruitment) rate
  • response rate (over time)
  • attrition (retention) rate
slide-25
SLIDE 25

25

Interviewer Training

  • Sales, not interviewing
  • In-home training: 2-3x as long
  • Email set-up difficulty
  • Provide device to FRs in advance
slide-26
SLIDE 26

26

Evaluation

  • Viability of the platform for different question types,

formats, and lengths

  • Develop and test interviewer training program for

recruitment and support

  • Develop and test panel recruitment strategies, and incentive

packages/related materials

  • contact (screening) rate
  • acceptance (recruitment) rate
  • response rate (over time)
  • attrition (retention) rate
slide-27
SLIDE 27

27

slide-28
SLIDE 28

28

Thank you!

For more information:

  • Craig A. Hill, RTI International
  • chill@rti.org
  • Or, via smartphone