Management of CAPI and CATI Management of CAPI and CATI at the - PowerPoint PPT Presentation

Management of CAPI and CATI Management of CAPI and CATI at the Labor Force Survey at the Labor Force Survey Zipora Radian Zipora Radian Central Bureau of Statistics, Israel Central Bureau of Statistics, Israel 1

Outline Outline LFS - Data collection methods The computerized data collection system Data collection procedure Transition to a new procedure p Summary and conclusion Future plans p

LFS LFS – Data collection methods Data collection methods A quarterly panel survey 12,000 dwellings sampled each year 4 investigations for each panel: Wave 1 - CAPI interview Wave 2 - CATI interview Wave 3 - CATI interview Wave 4 - CAPI interview 4 CA i i 3

LFS LFS LFS – Data collection methods LFS D t D t Data collection methods (Contd.) ll ll ti ti th d th d (Contd.) (Contd.) (Contd.) All four investigations are conducted in parallel every quarter The survey is carried out every week, continuously, for the entire three months of the survey The investigation period for each case is one predetermined week plus 3 weeks for predetermined week, plus 3 weeks for unresolved cases 4

Facilities Facilities of of the computerized the computerized data collection data collection Questionnaire Questionnaire - Blaise 4.6 Blaise 4 6 The interviewer's management - Maniplus The supervisor ’ s management system - .Net ’ Th i t t N t The overall management - .Net CATI M CATI Management - Blaise CATI Management t Bl i CATI M t The questionnaire ’ s data is stored in the Blaise d t b database, and the survey management data is d th t d t i stored in an SQL2005 server 5

The main functions of the The main functions of the computerized data collection system computerized data collection system t t i i d d t d d t ll ll ti ti t t A i Assignment of cases to CAPI or CATI t f t CAPI CATI Transmission of data Keeping track of non-response cases Moving cases from CAPI to CATI and vice versa Managing the response status for each case Producing follow-up reports

The need for a multi The need for a multi- -mode method mode method b t b t between between waves waves Face to Face interview in the 1st wave: F t F i t i i th 1 t Correct identification of the dwelling Exclusion of ineligible cases Finding solutions for tracing problems The need to verify personal demographic data Reducing refusals Developing rapport with respondents 7

The need for a multi The need for a multi- -mode method mode method b t b t between between waves waves (Contd.) (Contd.) (Contd.) (Contd.) Face to Face interview in the 4 th wave: th 4 th F t F i t i i This wave includes a supplementary income survey and requires the respondent to present survey and requires the respondent to present various documents such as salary slips Telephone interviewing in the 2 nd and 3 rd waves Reduction of costs Reduction of costs 8

The need for a multi The need for a multi- -mode method mode method within within waves ithi ithi waves 1 st and 4 th waves are mainly face-to-face interviews: In case of S it h t Switch to L Lack of time k f ti Telephone Remote places interview Shortage of interviewers Shortage of interviewers 2 nd and 3 rd waves are mainly telephone interviews: y p In case of Switch to No telephone n o Face to face i t interview i 9

D t D t Data collection procedure Data collection procedure – ll ll ti ti d d – First wave First wave Fi Fi t t Before transition Before transition 1. Assignment of cases to three regional centers 2. CAPI supervisor assigns cases to interviewer 3. CAPI interviewer makes personal visits 4. Data of visits is recorded in the questionnaire 5. CAPI interviewer transmits data each night g 6. Supervisor authorizes contact by phone 10

Why change procedure? Why change procedure? Why change procedure? Why change procedure? Limited time for field interviewer Administrative details are less reliable Not possible to monitor the interviews in real time The use of the management system

D t D t Data collection procedures Data collection procedures – ll ll ti ti d d – First wave Fi First wave Fi t t Before transition 1. Assignment of cases to three regional centers 2. CAPI supervisor assigns cases to interviewer 3. CAPI interviewer makes personal visits 4. Data of visits is recorded in the questionnaire 5. CAPI interviewer transmits data each night 6. Supervisor authorizes contact by phone After transition 1-5 Same as before 6 6. The CAPI supervisor verifies the existence of a valid telephone The CAPI supervisor verifies the existence of a valid telephone number 7. The CAPI supervisor indicates the case as suitable to move to CATI 8. The overall management system creates new questionnaires g y q 9. The new questionnaires are included in the "day batch" 12

Ad Ad Advantages of the new procedure Advantages of the new procedure t t f th f th d d The investigations are conducted from one The investigations are conducted from one central collection center The interviewers use an automatic call The interviewers use an automatic call scheduler Assigning special cases to appropriate interviewers Monitoring by supervisors online The CATI management system tracks administrative information 13

Di Di Disadvantages of the new procedure Disadvantages of the new procedure d d t t f th f th d d The responsibility for some of the cases is Th ibilit f f th i divided between CAPI interviewers and CATI interviewers interviewers Insufficient information from CAPI interviewers interviewers 14

S S Special considerations Special considerations i l i l id id ti ti Keeping detailed information provided by Keeping detailed information provided by CAPI interviewers Presenting CAPI recorded information in Presenting CAPI recorded information in CATI investigation Time table considerations Time table considerations Determining final status Developing monitoring tools Developing monitoring tools 15

S S Summary and conclusions Summary and conclusions d d l l i i The new procedure is advantageous i The overall management system allows the g y implementation of the change The transition has been successful The transition has been successful Encountered problems of staff adjustment and flow of information flow of information 16

F t F t Future plans Future plans l l Making improvements  Training for the new procedure to overcome g p adjustment problems  Better ways to use information  Better ways to use information Towards moving to monthly survey 2012:  Change to monthly survey using Blaise 4.8  Employing the new procedure in first wave  Employing the new procedure in first wave 17

Thank you THE END THE END THE END THE END k 18 Th

19