Multinational cognitive interviewing project evaluating UNICEF - - PowerPoint PPT Presentation

▶
multinational cognitive interviewing project
SMART_READER_LITE
LIVE PREVIEW

Multinational cognitive interviewing project evaluating UNICEF - - PowerPoint PPT Presentation

Aug 18, 2022 155 likes •325 views

Multinational cognitive interviewing project evaluating UNICEF questionnaire J. Brent Vickers, PhD Behavioral Scientist, National Center for Health Statistics (NCHS) Collaborating Center for Question Design and Evaluation Research (CCQDER) DC

slide-1
SLIDE 1

Multinational cognitive interviewing project evaluating UNICEF questionnaire

  • J. Brent Vickers, PhD

Behavioral Scientist, National Center for Health Statistics (NCHS) Collaborating Center for Question Design and Evaluation Research (CCQDER)

DC AAPOR July 12, 2019

slide-2
SLIDE 2

Cambodia Kazakhstan

UNICEF Module for Inclusive Education

slide-3
SLIDE 3

UNICEF Module for Inclusive Education

  • Universal, one set of questions for translation
  • 3 domains
  • General attitudes (all respondents)
  • School Environment (respondents with children in school)
  • Out-of-school barriers (respondents with children out of school)
slide-4
SLIDE 4

Cambodia

  • Country
  • Respondents
  • In-School
  • Out-of-School
  • Cambodia
  • 69
  • 46
  • 23
  • Kazakhstan
  • 57
  • 39
  • 18

Country Respondents School-Environ. Out-of-School

Cambodia 69 46 23

slide-5
SLIDE 5

Kazakhstan

Country Respondents School Environ. Out-of-School Cambodia 69 46 23

Kazakhstan 57 39 18

slide-6
SLIDE 6

Issue 1: Confusing Question Structures

ATTITUDES

I WOULD LIKE TO ASK YOU SOME QUESTIONS ABOUT SCHOOLING.

  • AT1. DO YOU BELIEVE THAT ALL CHILDREN HAVE THE

RIGHT TO GO TO SCHOOL?

Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9

  • AT2. UNDER WHICH OF THE FOLLOWING CONDITIONS DO

YOU THINK IT IS ACCEPTABLE FOR A CHILD TO NOT ATTEND SCHOOL?

Yes No The child may be physically harmed

  • r teased at school or on the way to/from

school……………………………………..1 2 The child may physically harm or tease

  • ther children at school……………….…1 2

The child needs to work or help at home………………………………………1 2 The child is married/is getting married ..1 2 The child is too old……………………….1 2 The child has physical or learning needs that the school cannot meet………….…1 2 The child is unable to learn…………......1 2 Education is too costly………….……….1 2 Other………………………………….…...1 2

  • AT3. DO YOU THINK THAT CHILDREN WITH DISABILITIES

SHOULD ONLY GO TO SPECIAL SCHOOLS FOR THOSE WITH DISABILITIES?

Yes............................................................... 1 It depends .................................................... 2 No ................................................................ 3 DK ................................................................ 9 3  SE1 9  SE1

  • 1. 2 Questions per question
  • 2. Question in negative

manner

slide-7
SLIDE 7

Confused Respondents

  • This does happen to children

AT2-2 UNDER WHICH OF THE FOLLOWING CONDITIONS DO YOU THINK IT IS ACCEPTABLE FOR A CHILD TO NOT ATTEND SCHOOL? The child may physically harm or tease other children at school Answer: YES Notes: Ch said that kids may have quarrel or fighting with their classmates

slide-8
SLIDE 8

Confused Respondents

  • This happens to MY child

AT2-2 UNDER WHICH OF THE FOLLOWING CONDITIONS DO YOU THINK IT IS ACCEPTABLE FOR A CHILD TO NOT ATTEND SCHOOL? The child may physically harmed or teased by children at school or on the way to or from school Answer : NO Notes: H says, " the school is 2 Km away from her home."

slide-9
SLIDE 9

Revised Questions: Kazakhstan

Direct and conversational Single question structure Positive manner

DO YOU THINK IT WOULD BE OK TO KEEP A CHILD FROM

GOING TO SCHOOL…

  • AT2. IF A CHILD MAY BE HARMED OR TEASED AT

SCHOOL?

Yes .............................................................. 1 No ................................................................ 2 DK / Not sure .............................................. 9

  • AT3. HOW ABOUT IF A CHILD MAY HARM OR TEASE

OTHER CHILDREN AT SCHOOL?

Yes .............................................................. 1 No ................................................................ 2 DK / Not sure .............................................. 9

  • AT4. WHAT ABOUT IF A CHILD NEEDS TO WORK OR HELP

AT HOME?

Yes .............................................................. 1 No ................................................................ 2 DK / Not sure .............................................. 9 DO YOU THINK IT WOULD BE OK TO KEEP A CHILD FROM

GOING TO SCHOOL…

  • AT5. IF A CHILD IS MARRIED OR GETTING MARRIED?

Yes .............................................................. 1 No ................................................................ 2 DK / Not sure .............................................. 9

  • AT6. HOW ABOUT IF A CHILD IS TOO OLD?

Yes .............................................................. 1 No ................................................................ 2 DK / Not sure .............................................. 9

  • AT7. WHAT ABOUT IF A CHILD IS UNABLE TO LEARN?

Yes .............................................................. 1 No ................................................................ 2 DK / Not sure .............................................. 9

slide-10
SLIDE 10

Issue 2: Community-specific questions

  • OS4. IT IS UNSAFE FOR (name) TO BE IN SCHOOL

Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9

  • OS5. SCHOOL IS TOO FAR AWAY

Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9

  • OS6. NO ONE AVAILABLE TO TRAVEL WITH (name)

TO/FROM SCHOOL

Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9

  • OS7. TRANSPORT SERVICES ARE INADEQUATE

Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9

  • OS8. THE SCHOOL DID NOT HAVE CAPACITY TO ACCEPT

MORE STUDENTS BECAUSE IT WAS FULL

Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9

  • OS9. SCHOOL’S APPROACH CONFLICTS WITH OUR

BELIEFS

Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9

  • OS10. THERE ARE NO FEMALE TEACHERS AT SCHOOL

Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9

  • OS11. WE CANNOT SEND (name) TO SCHOOL DUE TO

SOCIAL UNREST/INSTABILITY

Yes............................................................... 1 No ................................................................ 2 DK ................................................................ 9

slide-11
SLIDE 11

Confused Respondents

  • OS9. School’s approach conflicts with our beliefs

Answer: Yes Notes: "Teachers don't pay much attention to the children. Some students transfer to other schools; some children fight each other. However, it is good to study at Preahdak primary school as there are many students studying there. One of my younger sister's child has just transferred to this school too." Answer: Yes Notes: It is strange what I believe with school because in that school beliefs with Buddhism.

slide-12
SLIDE 12

Confused Respondents

Answer: No Notes: She said that teachers come to school in the morning and afternoon so there is no instability. Answer: DK Notes: She said that she does not know because she cannot take her kid to school every day Answer: Yes Notes: She answered "yes" but gave the explanation that her granddaughter is lazy, and that she cannot catch up with lessons. She did not relate this question to society unrest.

  • OS11. We cannot send (name) to school due to social unrest/instability
slide-13
SLIDE 13

Revisions: Kazakhstan

  • OS1. IS THERE ENOUGH MONEY TO PAY THE COSTS OF

(name)’S SCHOOLING? Yes .............................................................. 1 No ................................................................ 2 DK ............................................................... 9

  • OS2. DOES (name) NEED TO WORK, EARN MONEY OR

HELP OUT AT HOME?

Yes .............................................................. 1 No ................................................................ 2 DK ............................................................... 9

  • OS3. IT IS SAFE FOR (name) TO TRAVEL TO/FROM

SCHOOL?

Yes .............................................................. 1 No ................................................................ 2 DK ............................................................... 9

  • OS4. IT IS SAFE FOR (name) TO BE IN SCHOOL?

Yes .............................................................. 1 No ................................................................ 2 DK ............................................................... 9

  • OS5. IS SCHOOL TOO FAR AWAY?

Yes .............................................................. 1 No ................................................................ 2 DK ............................................................... 9

  • OS6. IS SOMEONE AVAILABLE TO TRAVEL WITH (name)

TO/FROM SCHOOL?

Yes .............................................................. 1 No ................................................................ 2 DK ............................................................... 9

  • OS7. ARE TRANSPORT SERVICES TO SCHOOL

ADEQUATE?

Yes .............................................................. 1 No ................................................................ 2 DK ............................................................... 9

Eliminated community- specific questions Conversational style Single question structure Positive manner

slide-14
SLIDE 14

Findings:

  • Simple, conversational style is best
  • Community-specific questions cause confusion outside those

communities

Testing again soon:

  • Priority is low-education communities with out-of-school children

Future Research

slide-15
SLIDE 15

For more information, contact CDC 1-800-CDC-INFO (232-4636) TTY: 1-888-232-6348 www.cdc.gov The findings and conclusions in this report are those of the authors and do not necessarily represent the

  • fficial position of the Centers for Disease Control and Prevention.

https://www.cdc.gov/nchs/CCQDER/ Q-Bank: https://wwwn.cdc.gov/qbank/ Got reports? qbank@cdc.gov