research designs for causal inference
play

Research Designs for Causal Inference Department of Political - PowerPoint PPT Presentation

Apr 21, 2023 •457 likes •1.7k views

Background IV RDD ITS DID Research Designs for Causal Inference Department of Political Science and Government Aarhus University March 10, 2015 Background IV RDD ITS DID 1 Background 2 Instrumental Variables 3 Regression Discontinuity

  1. Background IV RDD ITS DID Finding Instruments Forward, not backward, causal inference Most instruments are not things we care about Weather, disasters Geography, borders, climate Lotteries A good instrument is one that satisfies both of our conditions, so we need: A good story about exogeneity Evidence that instrument is strong

  2. Background IV RDD ITS DID Instrumental Variables Activity Read each scenario Assess exogeneity and relevance Discuss with the person sitting next to you

  3. Background IV RDD ITS DID Questions about IV?

  4. Background IV RDD ITS DID 1 Background 2 Instrumental Variables 3 Regression Discontinuity Designs 4 Interrupted Time-Series 5 Difference-In-Differences

  5. Background IV RDD ITS DID Example: Maimonides’ Rule

  6. Background IV RDD ITS DID Example: Maimonides’ Rule 1 What is Maimonides’ Rule?

  7. Background IV RDD ITS DID Example: Maimonides’ Rule 1 What is Maimonides’ Rule? 2 Why is it a valid (credible) instrument? (Or why isn’t it?)

  8. Background IV RDD ITS DID Example: Maimonides’ Rule 1 What is Maimonides’ Rule? 2 Why is it a valid (credible) instrument? (Or why isn’t it?) 3 How does it differ from a randomized experiment?

  9. Background IV RDD ITS DID Z Class Size Test Scores Grade Size

  10. Background IV RDD ITS DID How RDD Works 1 Find a consequential threshold Examples? 2 Causal inference is about comparisons In an experiment, X is randomly assigned In matching or regression, we compare units that differ only in X but are similar in Z 3 In RDD, X is not randomly assigned and there is no covariate overlap W causally determines X , so units with different values of X also differ in their value of W compare units that are as similar as possible

  11. Background IV RDD ITS DID Regression Discontinuity Y X

  12. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X

  13. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X

  14. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  15. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  16. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  17. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  18. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  19. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  20. Background IV RDD ITS DID Regression Discontinuity Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  21. Background IV RDD ITS DID Is There A Discontinuity? Y X

  22. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X

  23. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  24. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  25. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  26. Background IV RDD ITS DID Is There A Discontinuity? • • Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  27. Background IV RDD ITS DID “Sharp” and “Fuzzy” RDD If a threshold perfectly causes X , then it produces a sharp discontinuity Potentially analyze as an experiment

  28. Background IV RDD ITS DID “Sharp” and “Fuzzy” RDD If a threshold perfectly causes X , then it produces a sharp discontinuity Potentially analyze as an experiment If a threshold imperfectly (probabilistically) causes X , then it produces a fuzzy discontinuity  1 , if X > threshold   W = 0 , if X < threshold  

  29. Background IV RDD ITS DID “Sharp” and “Fuzzy” RDD If a threshold perfectly causes X , then it produces a sharp discontinuity Potentially analyze as an experiment If a threshold imperfectly (probabilistically) causes X , then it produces a fuzzy discontinuity Analyze using Instrumental Variables  1 , if X > threshold   W = 0 , if X < threshold   Examples?

  30. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  31. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  32. Background IV RDD ITS DID Modelling RDD Sharp: Treat threshold as an experiment Fuzzy: Treat the threshold as an instrument Not all cases above threshold are treated Not all cases below threshold are untreated Effect is estimated at point of discontinuity, which may not reflect effect X → Y over the entire domain of X Need to choose bandwidths

  33. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  34. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  35. Background IV RDD ITS DID Sharp vs. Fuzzy RDD Y • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • X Intervention

  36. Background IV RDD ITS DID Modelling RDD Use bandwidths to subset the data Regress Y on X , interacted with W Often use polynomial terms: Y = β 0 + β 1 X + β 2 X 2 + ... + β 3 Z + β 4 XZ + β 5 X 2 Z + ...

  37. Background IV RDD ITS DID Problems with Discontinuities Campbell’s Law : The more any quantitative social indicator (or even some qualitative indicator) is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.

  38. Background IV RDD ITS DID Problems with Discontinuities Campbell’s Law : The more any quantitative social indicator (or even some qualitative indicator) is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor. Discontinuities are exploitable

  39. Background IV RDD ITS DID Problems with Discontinuities Campbell’s Law : The more any quantitative social indicator (or even some qualitative indicator) is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor. Discontinuities are exploitable Compensatory rivalry and equalization

  40. Background IV RDD ITS DID Questions about RDD?

  41. Background IV RDD ITS DID 1 Background 2 Instrumental Variables 3 Regression Discontinuity Designs 4 Interrupted Time-Series 5 Difference-In-Differences

  42. Background IV RDD ITS DID How ITS Works Identify an exogenous shock in X that might affect Y Look at Y before ( t ) and after ( t + 1) the shock We only observe one manifest outcome at each point in time

  43. Background IV RDD ITS DID time Intervention

  44. Background IV RDD ITS DID time Intervention

  45. Background IV RDD ITS DID How ITS Works Identify an exogenous shock in X that might affect Y Look at Y before ( t ) and after ( t + 1) the shock We only observe one manifest outcome at each point in time

  46. Background IV RDD ITS DID How ITS Works Identify an exogenous shock in X that might affect Y Look at Y before ( t ) and after ( t + 1) the shock We only observe one manifest outcome at each point in time To make a causal inference, we need: Y 0 , t and Y 1 , t , or Y 0 , t + 1 and Y 1 , t + 1 Use pre-post comparisons to infer the value of unobserved potential outcomes

  47. Background IV RDD ITS DID time Intervention

  48. Background IV RDD ITS DID • • time Intervention

  49. Background IV RDD ITS DID • • time Intervention

  50. Background IV RDD ITS DID • Effect? • time Intervention

  51. Background IV RDD ITS DID • Effect? • time Intervention

  52. Background IV RDD ITS DID • • time Intervention

  53. Background IV RDD ITS DID Effect? • • time Intervention

  54. Background IV RDD ITS DID Threats to Inference Campbell and Ross talk about six “threats to validity” (i.e., threats to causal inference) related to time-series analysis What are those threats?

  55. Background IV RDD ITS DID ITS Considerations Changes in level and/or slope Effects can be delayed

  56. Background IV RDD ITS DID time Intervention

  57. Background IV RDD ITS DID ITS Considerations Changes in level and/or slope Effects can be delayed

  58. Background IV RDD ITS DID ITS Considerations Changes in level and/or slope Effects can be delayed Improving the design (easiest to hardest):

  59. Background IV RDD ITS DID ITS Considerations Changes in level and/or slope Effects can be delayed Improving the design (easiest to hardest): Multiple outcome measures

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Gov 2002 - Causal Inference III: Regression Discontinuity Designs Matthew Blackwell Arthur

Gov 2002 - Causal Inference III: Regression Discontinuity Designs Matthew Blackwell Arthur

Gov 2002 - Causal Inference III: Regression Discontinuity Designs Matthew Blackwell Arthur Spirling October 16th, 2014 Introduction Causal for us so far: selection of observables, instrumental variables for when this doesnt hold

2.07k views • 179 slides
Causal Inference An introduction based on S. Wagers course on Causal Inference (OIT 661) Imke

Causal Inference An introduction based on S. Wagers course on Causal Inference (OIT 661) Imke

Causal Inference An introduction based on S. Wagers course on Causal Inference (OIT 661) Imke Mayer November 23, 2018 Group Meeting, CMAP Outline 1. Treatment effect estimation in randomized experiments 2. Beyond a single randomized

1.48k views • 47 slides
Causal Inference and Response Surface Modeling Inference and

Causal Inference and Response Surface Modeling Inference and

Causal Inference and Response Surface Modeling Inference and Representa6on DS-GA-1005 Fall 2015 Guest lecturer: Uri Shalit What is Causal Inference?

503 views • 48 slides
Introduction to Causal Inference Lan Liu University of Minnesota at Twin Cities liux3771@umn.edu

Introduction to Causal Inference Lan Liu University of Minnesota at Twin Cities liux3771@umn.edu

Introduction to Causal Inference Lan Liu University of Minnesota at Twin Cities liux3771@umn.edu 1 Table of contents Causal ... or not? How Topics in Causal Inference Tools we use... Causal Inference in Industry 2 The Danger of Ice Cream

961 views • 52 slides
Modes of Statistical Inference for Causal Efgects Plus an overview of the testing based approach

Modes of Statistical Inference for Causal Efgects Plus an overview of the testing based approach

Modes of Statistical Inference for Causal Efgects Plus an overview of the testing based approach to causal inference for experiments on networks CSBS Causal Inference Workshop @ Illinois Jake Bowers Political Science &amp; Statistics

1k views • 88 slides
{ a) policy evaluation (treatment effects ) Old b) attribution but for gems

{ a) policy evaluation (treatment effects ) Old b) attribution but for gems

JSM-2016 presented: 8.1.16 OUTLINE CAUSAL INFERENCE IN STATISTICS: 1. The causal revolution from statistics to policy intervention to counterfactuals 2. The fundamental laws of causal inference A Gentle Introduction 3. From

369 views • 12 slides
Causal inference Gary Goertz Kroc Institute for International Peace Studies University of Notre

Causal inference Gary Goertz Kroc Institute for International Peace Studies University of Notre

Causal inference Gary Goertz Kroc Institute for International Peace Studies University of Notre Dame ggoertz@nd.edu Spring 2018 Experiments are the gold standard for causal inference Strategies of causal inference are satisfactory (with

318 views • 11 slides
A Brief Introduction to Causal Inference Brady Neal causalcourse.com What is causal inference?

A Brief Introduction to Causal Inference Brady Neal causalcourse.com What is causal inference?

A Brief Introduction to Causal Inference Brady Neal causalcourse.com What is causal inference? Inferring the effects of any treatment/policy/intervention/etc. 2 / 28 Brady Neal What is causal inference? Inferring the effects of any

2.8k views • 102 slides
Causal Inference Theory and Applications Dr. Matthias Uflacker, Johannes Huegle, Christopher

Causal Inference Theory and Applications Dr. Matthias Uflacker, Johannes Huegle, Christopher

Causal Inference Theory and Applications Dr. Matthias Uflacker, Johannes Huegle, Christopher Schmidt April 24, 2018 Agenda April 24, 2018 Jupyter Notebook Causal Inference in Application Recap Causal Inference in a Nutshell

520 views • 33 slides
Political Science 209 - Fall 2018 Causal Inference Florian Hollenbach 7th September 2018 Causal

Political Science 209 - Fall 2018 Causal Inference Florian Hollenbach 7th September 2018 Causal

Political Science 209 - Fall 2018 Causal Inference Florian Hollenbach 7th September 2018 Causal Inference What do you think is causal inference? Florian Hollenbach 1 Causal Inference causal: relationship between things where one causes

759 views • 47 slides
Causal Inference By: Miguel A. Hern an and James M. Robins Part I: Causal inference without

Causal Inference By: Miguel A. Hern an and James M. Robins Part I: Causal inference without

Causal Inference By: Miguel A. Hern an and James M. Robins Part I: Causal inference without models Chapter 1: A definition of causal effect 27 th November, 2013 27 th November, 2013 Chapter 1 (Hern an &amp; Robins) Definition of causal

491 views • 13 slides
Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs Causation Causal inference Why/when causality matters Hurdles to causal inference &amp; strategies to overcome them Correlation Vs Causation

457 views • 26 slides
Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs Causation Causal inference Why/when causality matters Hurdles to causal inference &amp; strategies to overcome them Correlation Vs Causation

741 views • 45 slides
Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs

Geographic Data Science - Lecture IX Causal Inference Dani Arribas-Bel Today Correlation Vs Causation Causal inference Why/when causality matters Hurdles to causal inference &amp; strategies to overcome them Correlation Vs Causation

626 views • 45 slides
Causal reasoning and inference with causal Bayes nets Alexander Gebharter Duesseldorf Center for

Causal reasoning and inference with causal Bayes nets Alexander Gebharter Duesseldorf Center for

Causal reasoning and inference with causal Bayes nets Alexander Gebharter Duesseldorf Center for Logic and Philosophy of Science Heinrich Heine University Duesseldorf 28.04.2016 Alexander Gebharter (DCLPS) Reasoning &amp; inference with CBNs

1.09k views • 106 slides
Contents 1 Causal Inference and Predictive Comparison 2 1.1 How Predictive Comparison Can

Contents 1 Causal Inference and Predictive Comparison 2 1.1 How Predictive Comparison Can

Causal Inference in Observational Studies Contents 1 Causal Inference and Predictive Comparison 2 1.1 How Predictive Comparison Can Mislead . . . . . . . . . . . . . 2 1.2 Adding Predictors as a Solution . . . . . . . . . . . . . . . . . .

274 views • 14 slides
rts t t

rts t t

rts t t tr rtt t ts r Prssr

805 views • 36 slides
Non-Stationary Time Series and Unit Root Tests Heino Bohn Nielsen 1 of 24 Outline of the

Non-Stationary Time Series and Unit Root Tests Heino Bohn Nielsen 1 of 24 Outline of the

Econometrics 2 Fall 2004 Non-Stationary Time Series and Unit Root Tests Heino Bohn Nielsen 1 of 24 Outline of the Lecture (1) Introduction. (2) Trend stationarity. (3) Unit root processes. (4) Unit root tests. (5) Dickey-Fuller test. (6)

941 views • 12 slides
for Flux Reconstruction Will Trojak Scope Why Shock Capturing? Invariance Preserving

for Flux Reconstruction Will Trojak Scope Why Shock Capturing? Invariance Preserving

Shock Capturing Methods for Flux Reconstruction Will Trojak Scope Why Shock Capturing? Invariance Preserving Methodology Preliminary Results Summary and Future Developments Why Shock Capturing? More Physics Currently

774 views • 17 slides
Testing Shock Absorbers: How This Problem Is . . . Towards a Faster Need for Parallelization

Testing Shock Absorbers: How This Problem Is . . . Towards a Faster Need for Parallelization

How to Describe . . . Need to Take . . . Formulation of the . . . Case of Fuzzy Uncertainty Testing Shock Absorbers: How This Problem Is . . . Towards a Faster Need for Parallelization Analysis of the . . . Parallelizable Algorithm

556 views • 22 slides
Perfect foresight models St ephane Adjemian stephane.adjemian@univ-lemans.fr March, 2016 cba

Perfect foresight models St ephane Adjemian stephane.adjemian@univ-lemans.fr March, 2016 cba

Perfect foresight models St ephane Adjemian stephane.adjemian@univ-lemans.fr March, 2016 cba Introduction We abstract from the effects of future uncertainty by assuming that the agents can form perfect foresights. For instance, if

1.03k views • 70 slides
A training study to enhance verbal short- term memory performance in individuals with Down

A training study to enhance verbal short- term memory performance in individuals with Down

A training study to enhance verbal short- term memory performance in individuals with Down syndrome Liz Smith &amp; Chris Jarrold University of Bristol Down syndrome Down syndrome (DS) is the most prevalent genetic developmental disorder

769 views • 44 slides
Objectives RNNs are trained only for limited timesteps Can they form long term memories?

Objectives RNNs are trained only for limited timesteps Can they form long term memories?

Understanding and Controlling Memory in RNN D. Haviv, A. Rivkind, O. Barak Network Biology Research Laboratories Technion Israel Institute of Technology Objectives RNNs are trained only for limited timesteps Can they form long term

242 views • 10 slides
Neural Machine Translation Philipp Koehn 6 October 2020 Philipp Koehn Machine Translation:

Neural Machine Translation Philipp Koehn 6 October 2020 Philipp Koehn Machine Translation:

Neural Machine Translation Philipp Koehn 6 October 2020 Philipp Koehn Machine Translation: Neural Machine Translation 6 October 2020 Language Models 1 Modeling variants feed-forward neural network recurrent neural network long

485 views • 36 slides

More recommend