questionnaire design ii
play

Questionnaire Design II Department of Political Science and - PowerPoint PPT Presentation

Apr 26, 2023 •246 likes •638 views

Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Questionnaire Design II Department of Political Science and Government Aarhus University October 6, 2014 Construct Validity Recall-type Questions Sensitive

  1. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Questionnaire Design II Department of Political Science and Government Aarhus University October 6, 2014

  2. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Construct Validity 1 Recall-type Questions 2 Sensitive Topics 3 Preview of Next Time 4

  3. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Construct Validity 1 Recall-type Questions 2 Sensitive Topics 3 Preview of Next Time 4

  4. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Construct Validity Definition?

  5. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Construct Validity Definition? How do we know if a survey response is “true”?

  6. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Validation studies 1 Some survey responses can be validated 2 Easy for some behavioral constructs 3 Direct observation, registry data, etc.

  7. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Questions about construct validity?

  8. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Construct Validity 1 Recall-type Questions 2 Sensitive Topics 3 Preview of Next Time 4

  9. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Recall-type Questions Knowledge Behavior Events

  10. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Recalling Knowledge Factual items with “true” responses Examples Political knowledge Knowledge about products/services General knowledge Knowledge varies widely across individuals

  11. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Recalling Knowledge How do we deal with “don’t know” responses? Genuine expression of lack of knowledge? Insufficient time to think? Question was unclear/ambiguous?

  12. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Recalling Knowledge How do we deal with “don’t know” responses? Genuine expression of lack of knowledge? Insufficient time to think? Question was unclear/ambiguous? Huge debate about this

  13. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Recalling Behaviors Things respondent did in the past Examples Media use Eating/dietary habits Past voting Challenging to measure accurately Can be easily validated

  14. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Measuring Behaviors Provide counts for a given reference period Provide a rate within a reference period List specific behavioral events Allows follow-up questioning

  15. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Recalling Events Things that happened as specific points in time Examples Events in the news Crime victimization Time when you felt angry Same problems as with other types of recall

  16. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time What affects responses to recall questions? Question misunderstanding Vague concepts Confusing or long wording

  17. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time What affects responses to recall questions? Question misunderstanding Vague concepts Confusing or long wording Forgetting

  18. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time What affects responses to recall questions? Question misunderstanding Vague concepts Confusing or long wording Forgetting Recency/primacy biases among responses

  19. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time What affects responses to recall questions? Question misunderstanding Vague concepts Confusing or long wording Forgetting Recency/primacy biases among responses Motivated misreporting

  20. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time What affects responses to recall questions? Question misunderstanding Vague concepts Confusing or long wording Forgetting Recency/primacy biases among responses Motivated misreporting Reference period ambiguity

  21. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time What affects responses to recall questions? Question misunderstanding Vague concepts Confusing or long wording Forgetting Recency/primacy biases among responses Motivated misreporting Reference period ambiguity Rare events

  22. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time What affects responses to recall questions? Question misunderstanding Vague concepts Confusing or long wording Forgetting Recency/primacy biases among responses Motivated misreporting Reference period ambiguity Rare events True “don’t know” responses

  23. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Motivated misreporting Intentionally giving an incorrect response Applies to recall and evaluative questions

  24. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Motivated misreporting Intentionally giving an incorrect response Applies to recall and evaluative questions Examples?

  25. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Motivated misreporting Intentionally giving an incorrect response Applies to recall and evaluative questions Examples? Several common biases Social desirability bias Positivity bias Acquiescence bias Demand characteristics

  26. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Questions about recall questions?

  27. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Construct Validity 1 Recall-type Questions 2 Sensitive Topics 3 Preview of Next Time 4

  28. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Sensitive Questions Definition: Topics “seen as intrusive or embarrassing” Examples?

  29. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Sensitive Questions Definition: Topics “seen as intrusive or embarrassing” Examples? Factors affecting topic sensitivity Individual differences Mode Interviewer Survey context Survey sponsorship Perceived privacy

  30. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Sensitive Questions Definition: Topics “seen as intrusive or embarrassing” Examples? Factors affecting topic sensitivity Individual differences Mode Interviewer Survey context Survey sponsorship Perceived privacy Why do we care?

  31. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Activity: Answering Sensitive Questions 1 Pair Activity “Role play” interviewer and respondent Do NOT answer the questions Record your thoughts/feelings/reactions to each question 2 Individual Activity Complete questionnaire on your own Do NOT answer the questions Record your thoughts/feelings/reactions to each question 3 Then we will discuss together

  32. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Questions about sensitive topics?

  33. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Eliciting Answers to Sensitive Questions Ensure privacy, anonymity, or confidentiality Change modes Indirect measures “List experiment” Provide population rates Placement in survey instrument

  34. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Activity: Writing Sensitive Questions 1 Work in groups 2 Select a potentially sensitive topic 3 Write 2–3 survey questions on that topic 4 Present to the class how your approach eases sensitivity

  35. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Construct Validity 1 Recall-type Questions 2 Sensitive Topics 3 Preview of Next Time 4

  36. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Agenda for next class No meeting next week (Week 42) Mode of interview Budgets Mode comparisons

  37. Construct Validity Recall-type Questions Sensitive Topics Preview of Next Time Assignment for next week Draft of your questionnaire! With remaining time: Discuss this week’s assignment Discuss strategies for question writing

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Questionnaire Design Research Methods. Questionnaire Design 1 1 Objectives To understand:

Questionnaire Design Research Methods. Questionnaire Design 1 1 Objectives To understand:

Questionnaire Design Research Methods. Questionnaire Design 1 1 Objectives To understand: Objectives of questionnaires Advantages and disadvantages Design of questionnaires Type of questions used Common problems and

1.03k views • 99 slides
SIG ECI Questionnaire for ECI Questionnaire Questionnaire for Early Career Investigators ready

SIG ECI Questionnaire for ECI Questionnaire Questionnaire for Early Career Investigators ready

COST ACTION CA15137 MC meeting, Podgorica, 7 - 8 March 2019 SIG ECI Questionnaire for ECI Questionnaire Questionnaire for Early Career Investigators ready Draws from interviews of SIG ECI Stphani e and Karolina: first draft

721 views • 6 slides
Sampling Techniques and Questionnaire Design Department of Political Science and Government

Sampling Techniques and Questionnaire Design Department of Political Science and Government

Stratified Sampling Cluster Sampling Questionnaire Design Preview of Next Week Sampling Techniques and Questionnaire Design Department of Political Science and Government Aarhus University September 29, 2014 Stratified Sampling Cluster

1.35k views • 70 slides
Conceptual / Background Questionnaire (Students Questionnaire) CAMBODIA OVERVIEWS Country

Conceptual / Background Questionnaire (Students Questionnaire) CAMBODIA OVERVIEWS Country

10 13 September, 2018, Penang, Malaysia Capacity development workshop Conceptualization, Measurement and Use of Contextual Data Knowledge and Experience Sharing by Cambodia Conceptual / Background Questionnaire (Students Questionnaire)

226 views • 18 slides
FAIRMODE Spatial representativeness feasibility study: State of the art Questionnaire design and

FAIRMODE Spatial representativeness feasibility study: State of the art Questionnaire design and

FAIRMODE Spatial representativeness feasibility study: State of the art Questionnaire design and replies Jos Lus Santiago, Fernando Martn, Laura Garca CIEMAT, SPAIN Oliver Kracht, Michel Gerboles JRC, ITALY 25/06/2015 FAIRMODE

965 views • 31 slides
OCCUPATIONAL WAGES SURVEY FOR TRINIDAD AND TOBAGO INSTRUCTION SHEET Questionnaire Questionnaire

OCCUPATIONAL WAGES SURVEY FOR TRINIDAD AND TOBAGO INSTRUCTION SHEET Questionnaire Questionnaire

OCCUPATIONAL WAGES SURVEY FOR TRINIDAD AND TOBAGO INSTRUCTION SHEET Questionnaire Questionnaire I NSTRUCTION AND E XPLANATIONS Section Item B 12. The contact person should be someone who has either filled out the return, supervised someone

606 views • 4 slides
How Does Questionnaire Design Affect Party ID? Kyley McGeeney Senior Director of Survey Methods

How Does Questionnaire Design Affect Party ID? Kyley McGeeney Senior Director of Survey Methods

How Does Questionnaire Design Affect Party ID? Kyley McGeeney Senior Director of Survey Methods Jennifer Miller-Gonzalez, Haley Tran PRIVILEGED AND CONFIDENTIAL 1 Background What were looking at and why Background Introduction Lots of

598 views • 15 slides
1) Overview 2) Questionnaire i. Questionnaire Definition ii. Objectives of

1) Overview 2) Questionnaire i. Questionnaire Definition ii. Objectives of

1)

614 views • 34 slides
Introduction to the CHRODIS Questionnaire Current landscape in relation to health promotion and

Introduction to the CHRODIS Questionnaire Current landscape in relation to health promotion and

Draft Scoping Questionnaire Good Practice in the Field of Health Promotion and Primary Prevention for leading chronic conditions Cardiovascular disease, stroke and diabetes Introduction to the CHRODIS Questionnaire Current landscape in

484 views • 10 slides
Good practices in CITI-VAL - Results of the questionnaire - Based research Content I.

Good practices in CITI-VAL - Results of the questionnaire - Based research Content I.

Good practices in CITI-VAL - Results of the questionnaire - Based research Content I. Introduction 1. the project 2. the questionnaire aspects, goals, basics II. Evaluation 1. facts basic information: country-wise, number of

1.3k views • 22 slides
International Labour Office Department of Statistics Methodological questionnaire Statistics of

International Labour Office Department of Statistics Methodological questionnaire Statistics of

International Labour Office Department of Statistics Methodological questionnaire Statistics of employment, wages and hours of work derived from establishment surveys The objective of this questionnaire is to obtain information about the most

191 views • 16 slides
Multinational cognitive interviewing project evaluating UNICEF questionnaire J. Brent Vickers,

Multinational cognitive interviewing project evaluating UNICEF questionnaire J. Brent Vickers,

Multinational cognitive interviewing project evaluating UNICEF questionnaire J. Brent Vickers, PhD Behavioral Scientist, National Center for Health Statistics (NCHS) Collaborating Center for Question Design and Evaluation Research (CCQDER) DC

323 views • 15 slides
Questionnaire December 20914 and Presentation To Residents January 2015 WE FACE A ONCE IN A

Questionnaire December 20914 and Presentation To Residents January 2015 WE FACE A ONCE IN A

Village Questionnaire December 2014 Avon Dassett Community Benefit Society Limited Questionnaire December 20914 and Presentation To Residents January 2015 WE FACE A ONCE IN A LIFETIME OPPORTUNITY. Not only to save our pub, but to make it the

503 views • 37 slides
? Q&A Questionnaire Purpose & Target Audience Purpose Target Audience Opportunity for

? Q&A Questionnaire Purpose & Target Audience Purpose Target Audience Opportunity for

Questionnaire Info Promotion/ Participation Results ? Q&A Questionnaire Purpose & Target Audience Purpose Target Audience Opportunity for our community to rank and share its top PARENTS priorities for the Districts Boundary

401 views • 13 slides
________________________________________________________________________________________ 8. In what

________________________________________________________________________________________ 8. In what

Questionnaire about hygiene and disease control in livestock Information and instructions This questionnaire is aimed for farm owners and farm workers who handle cattle, pigs, sheep, goats or poultry. We are interested in responses from farms of

302 views • 19 slides
Maintaining and further development of HELCOM AIS The outcome from Helcom questionnaire 2019

Maintaining and further development of HELCOM AIS The outcome from Helcom questionnaire 2019

Maintaining and further development of HELCOM AIS The outcome from Helcom questionnaire 2019 Agenda Item 4 Questionnaire on the status of national AIS Background Distributed to the HELCOM RS participating States in May 2019 Replied

652 views • 9 slides
The Price of Forgetting in Parallel Routing Jonatha Anselmi & Bruno Gaujal INRIA Aussois

The Price of Forgetting in Parallel Routing Jonatha Anselmi & Bruno Gaujal INRIA Aussois

The Price of Forgetting in Parallel Routing Jonatha Anselmi & Bruno Gaujal INRIA Aussois June, 2011 (INRIA ) 1 / 21 Introduction Goal of my talk : explore different types of routing policies (selfish/social, with/without memory) in a

312 views • 28 slides
Bit attacks D. J. Bernstein University of Illinois at Chicago From: andr...@ise... Date: 11 Feb

Bit attacks D. J. Bernstein University of Illinois at Chicago From: andr...@ise... Date: 11 Feb

Bit attacks D. J. Bernstein University of Illinois at Chicago From: andr...@ise... Date: 11 Feb 2009 14:48 Subject: Question Running CubeHash8/1 with 64 bit output over 2 different datasets give me the same hash under Visual Studio. Using

394 views • 13 slides
Week 4 Video 7 Memory Algorithms Is future correctness enough? Up until this point weve

Week 4 Video 7 Memory Algorithms Is future correctness enough? Up until this point weve

Week 4 Video 7 Memory Algorithms Is future correctness enough? Up until this point weve been talking about predicting future correctness But what if you forget it tomorrow? Another way to look at knowledge is how long will you

404 views • 15 slides
1 Optimization in decision graphs Unfolding to decision tree Only option until Shachter

1 Optimization in decision graphs Unfolding to decision tree Only option until Shachter

Decision graphs II Influence Diagrams Advanced Herd Management Anders Ringgaard Kristensen Slide 1 Outline Optimization methods Decision tree Strong junction tree Single Policy Updating Decision node ordering Advantages and

467 views • 10 slides
Not that I have already obtained this or am already perfect, but I press on to make it my own,

Not that I have already obtained this or am already perfect, but I press on to make it my own,

Philippians 3:12-16 (ESV) Not that I have already obtained this or am already perfect, but I press on to make it my own, because Christ Jesus has made me his own. 13 Brothers, I do not consider that I have made it my own. But one thing I do:

299 views • 11 slides
A Personalized Interest-Forgetting Markov Model for Recommendations Jun Chen , Chaokun Wang,

A Personalized Interest-Forgetting Markov Model for Recommendations Jun Chen , Chaokun Wang,

A Personalized Interest-Forgetting Markov Model for Recommendations Jun Chen , Chaokun Wang, Jianmin Wang Tsinghua University, China chenjun14@mails.tsinghua.edu.cn, {chaokun, jimwang}@tsinghua.edu.cn AAAI-15 28-Jan-15 1 Review on

366 views • 19 slides
Building Your Own WAF as a Service and Forgetting about False Positives 1 Building Your Own WAF

Building Your Own WAF as a Service and Forgetting about False Positives 1 Building Your Own WAF

Building Your Own WAF as a Service and Forgetting about False Positives 1 Building Your Own WAF as a Service and Forgetting about False Positives Juan Berner Juan Berner @89berner Lead security developer @Booking.com Blog:

694 views • 58 slides
Federal student loans First, take inventory Private Check to see if you have federal or

Federal student loans First, take inventory Private Check to see if you have federal or

2/18/2016 Public Service Loan Forgiveness and the new Revised Pay As You Earn (REPAYE) Todays Plan Which loans are which and why it matters Put private student loans in their place Evaluating federal student loan repayment

296 views • 7 slides

More recommend