Instrumental Variables

Size: px
Start display at page:

Download "Instrumental Variables"

Transcription

1 Instrumental Variables Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

2 Instrumental Variables From randomized encouragement design to general instrumental variabes approach: U Y Z T Instruments in the nature natural experiments 1 random assignment of Z 2 no direct effect of Z on Y Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

3 Classical Instrumental Variables Estimator Linear model (in matrix notation): Y = Xβ + ɛ where E(ɛ) = 0 n and X is n K Endogeneity: E(ɛ i X) 0 Instruments Z is n L 1 Exogeneity: E(ɛ i Z) = 0 2 Exclusion restriction: Z i does not belong to the outcome model 3 Rank condition: Z X and Z Z have full rank Experimental setting: X i = the treatment and pre-treatment covariates Z i = the randomized encouragement and pre-treatment covariates Identification 1 K = L: just-identified 2 K < L: over-identified 3 K > L: under-identified Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

4 Geometry of Instrumental Variables Projection matrix (onto S(Z)): P Z = Z(Z Z) 1 Z Purge endogeneity: X = P Z X Since P Z = P Z and P ZP Z = P Z, we have ˆβ IV = ( X X) 1 X Y = (X Z(Z Z) 1 Z X) 1 X Z(Z Z) 1 Z Y Two stage least squares: 1 Regress X on Z and obtain the fitted values X 2 Regress Y on X We do not assume the linearity of X in Z Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

5 Asymptotic Inference Estimation error: ˆβ IV β = (X Z(Z Z) 1 Z X) 1 X Z(Z Z) 1 Z ɛ ( ) ( ) 1 ( ) 1 n = X i Z 1 n i Z i Z 1 n i Z i X i n n n ( 1 n i=1 n X i Z i i=1 ) ( 1 n i=1 n Z i Z i i=1 p Thus, ˆβ IV β Under the homoskedasticity, V(ɛ Z) = σ 2 I n : ) 1 ( 1 n i=1 ) n Z i ɛ i n( ˆβIV β) d N (0, σ 2 [E(X i Z i ){E(Z i Z i )} 1 E(Z i X i )] 1 ) i=1 1 Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

6 Residuals and Robust Standard Error ˆɛ = Y X ˆβ IV and not ˆɛ Y X ˆβ IV Under homoskedasticity: ˆσ 2 = ˆɛ 2 n K p σ 2 V( ˆβ IV ) = ˆσ 2 {X Z(Z Z) 1 Z X} 1 = ˆσ 2 ( X X) 1 Sandwich heteroskedasticity consistent estimator: bread = {X Z(Z Z) 1 Z X} 1 X Z(Z Z) 1 ( ) n meat = Z diag(ˆɛ 2 i )Z = ˆɛ 2 i Z iz i bread meat bread = ( X X) 1 X diag(ˆɛ 2 i ) X( X X) 1 Robust standard errors for clustering, auto-correlation, etc. i=1 Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

7 Multi-valued Treatment (Angirst and Imbens J. Am. Stat. Assoc) Two stage least squares regression: Y i = α + βt i + η i, T i = δ + γz i + ɛ i Binary encouragement and binary treatment, ˆβ = ĈATE (no covariate) ˆβ p CATE (with covariates) Binary encouragement multi-valued treatment Monotonicity: T i (1) T i (0) Exclusion restriction: Y i (1, t) = Y i (0, t) for each t = 0, 1,..., K Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

8 Estimator ˆβ TSLS p Cov(Y i, Z i ) Cov(T i, Z i ) = E(Y i(1) Y i (0)) E(T i (1) T i (0)) K K ( Yi (1) Y i (0) ) = w jk E T i (1) = j, T i (0) = k j k k=0 j=k+1 where w jk is the weight, which sums up to one, defined as, w jk = (j k) Pr(T i (1) = j, T i (0) = k) K k =0 K j =k +1 (j k ) Pr(T i (1) = j, T i (0) = k ). Easy interpretation under the constant additive effect assumption for every complier type Assume encouragement induces at most only one additional dose Then, w k = Pr(T i (1) = k, T i (0) = k 1) Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

9 Quarter of Birth (Angrist and Krueger Q. J. Econ.) Instrument for educational attainment to address ability bias Outcome: men s log weekly earnings in 1980 Compulsory education law in US: students must attend school until they reach age 16 Those born in the third or fourth quarter typically finish tenth grade before reaching age 16 Instrument at most decreases years of education by one year Weak instrument: first quarter vs. 2nd to 4th quarter 1920s cohorts: est. = 0.126, s.e. (HC) = 0.016, corr = s cohorts: est. = 0.109, s.e. (HC) = 0.013, corr = Wald estimates: 1920 cohorts: est. = 0.072, s.e. (HC) = cohorts: est. = 0.102, s.e. (HC) = OLS estimates: 1920 cohorts: est. = 0.080, s.e. (HC) = cohorts: est. = 0.071, s.e. (HC) = Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

10 CDFs for First and Fourth Quarter of Birth C D F I. n YEARS OF SCHOOLING Figure 2. Schooling CDF by Quarter of Birth (Men Born ; Data From the 1980 Census). Quarter of birth:, first; - -, fourth. Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

11 Analysis of Weak Instruments Recall the Wald estimator: ˆβ IV = Cov(Y i, Z i ) Cov(T i, Z i ) ˆβ IV does not exist if the instrument is irrelevant Consider the following model: Y i = α + βt i + ɛ i, T i = γ Z }{{} i + η i, where E(ɛ i Z i ) = E(η i Z i ) = 0 0 where (ɛ i, η i ) follows a bivariate normal with mean zero. Then, n i=1 ɛ iz i d n i=1 η Corr(ɛi, η i ) iz i ˆβ iv β Asymptotic analysis for weak instruments V(ɛ i ) V(η i ) + W i }{{} Cauchy Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

12 Simulated Instruments (Bound et al J. Am. Stat. Assoc) Simulation exercise: 1 Simulate Z i from Bernoulli with success probability equal to its empirical estimate 2 Compute the Wald estimate as before 1920s cohorts: Estimates: min = , 1st Qu. = 0.093, median = , 3rd Qu. = 0.260, max = Std. Errors: min = 0.057, 1st Qu. = 0.185, median = 0.393, 3rd Qu. = 1.467, max = s cohorts: Estimates: min = , 1st Qu. = 0.117, median = 0.078, 3rd Qu. = 0.284, max = Std. Errors: min = 0.064, 1st Qu. = 0.197, median = 0.421, 3rd Qu. = 1.814, max = Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

13 Randomization Inference (Imbens and Rosenbaum J. R. Stat. Soc. A.) Constant additive treatment effect model for the QoB example: Randomization test: Y i (t) = Y i (0) + β t for t = 0, 1,... 1 Null hypothesis: H 0 : β = β 0 2 Test statistic: S i = f (Y i β 0 T i, Z i ) 3 Assume Z i Bernoulli(Z n ) to obtain the reference distribution Application: S i = N i=1 Z i rank(y i β 0 T i ) 95% confidence intervals: 1920 cohorts: [0.036, 0.106], [0.028, 0.115] (Wald) 1930 cohorts: [0.049, 0.122], [0.055, 0.149] (Wald) Simulation (rejection rates of 0.05 level tests with 1000 simulations): 1920 cohorts: 0.048, (Wald) 1930 cohorts: 0.051, (Wald) Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

14 Violations of IV Assumptions 1 Violation of exclusion restriction: bias = ITT noncomplier Pr(noncomplier) Pr(complier) Weak encouragement (instruments) Direct effects of encouragement; failure of randomization, alternative causal paths 2 Violation of monotonicity: bias = {CATE + ITT defier} Pr(defier) Pr(complier) Pr(defier) Proportion of defiers Heterogeneity of causal effects Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

15 Bounding the Average Treatment Effect (Manski. (1990). Am. Econ. Rev.) Instrumental variable estimator does not point-identify the ATE Partial identification (Manski Identification Problems in the Social Sciences. Harvard UP) Consider a binary outcome with the randomized encouragement and exclusion restriction: Pr(Y i (1) = 1) = Pr(Y i (1) = 1 Z i = 1) = µ 11 π 1 + Pr(Y i (1) = 1 D i = 0, Z i = 1)(1 π 1 ) Pr(Y i (0) = 1) = µ 00 (1 π 0 ) + Pr(Y i (0) = 1 D i = 1, Z i = 0)π 0 where µ dz = Pr(Y i = 1 D i = d, Z i = z), π z = Pr(D i = 1 Z i = z) Bounds on the ATE: µ 11 π 1 µ 00 (1 π 0 ) π 0 τ µ 11 π 1 µ 00 (1 π 0 ) + 1 π 1 where the width equals 1 (π 1 π 0 ) Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

16 Sharp Bounds (Balke and Pearl J. Am. Stat. Assoc) The previous bounds are not sharp: only consider four latent types based on mapping from Z to D there are four additional mappings from D to Y a total of 16 latent types: (D i (1), D i (0), Y i (1), Y i (0)) equal to Manki s bounds under monotonicity Linear programming problem: maximize/minimize u Pr(Y i (d) = 1 U i = u) Pr(U i = u) subject to Pr(Y i = y, D i = d Z i = z) = Pr(Y i (d) = y D i = d, U i = u) Pr(D i = d Z i = z, U i = u) Pr(Z i = z) Pr(U i = u) A general strategy for a discrete potential outcome case Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

17 Revisiting the Habitual Voting Example Effect of voting in 2006 election on the turnout in the 2008 election: est = 0.128, s.e. = Potential bias of estimated CATE due to exclusion restriction: ITT noncomplier = ITT noncomplier Inference for the Average Treatment Effect exclusion restriction + monotonicity: [ 0.315, 0.602] exclusion restriction alone: [ 0.315, 0.602] Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

18 Summary Instrumental variables as a general strategy for coping with selection bias randomization of instruments monotonicity exclusion restriction Extensions to multi-valued treatment Weak instruments and randomization inference ATE vs. CATE partial identification, method of bounds Suggested readings: IMBENS AND RUBIN. Chapter 25 ANGRIST AND PISCHKE. Chapter 4 Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall / 18

Noncompliance in Randomized Experiments

Noncompliance in Randomized Experiments Noncompliance in Randomized Experiments Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall 2018 1 / 15 Encouragement

More information

Simple Linear Regression

Simple Linear Regression Simple Linear Regression Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Simple Linear Regression Stat186/Gov2002 Fall 2018 1 / 18 Linear Regression and

More information

Statistical Analysis of Randomized Experiments with Nonignorable Missing Binary Outcomes

Statistical Analysis of Randomized Experiments with Nonignorable Missing Binary Outcomes Statistical Analysis of Randomized Experiments with Nonignorable Missing Binary Outcomes Kosuke Imai Department of Politics Princeton University July 31 2007 Kosuke Imai (Princeton University) Nonignorable

More information

Instrumental Variables

Instrumental Variables Instrumental Variables Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 Noncompliance in Randomized Experiments Often we cannot force subjects to take specific treatments Units

More information

Regression Discontinuity Designs

Regression Discontinuity Designs Regression Discontinuity Designs Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Regression Discontinuity Design Stat186/Gov2002 Fall 2018 1 / 1 Observational

More information

150C Causal Inference

150C Causal Inference 150C Causal Inference Instrumental Variables: Modern Perspective with Heterogeneous Treatment Effects Jonathan Mummolo May 22, 2017 Jonathan Mummolo 150C Causal Inference May 22, 2017 1 / 26 Two Views

More information

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors Laura Mayoral IAE, Barcelona GSE and University of Gothenburg Gothenburg, May 2015 Roadmap Deviations from the standard

More information

Econometrics of causal inference. Throughout, we consider the simplest case of a linear outcome equation, and homogeneous

Econometrics of causal inference. Throughout, we consider the simplest case of a linear outcome equation, and homogeneous Econometrics of causal inference Throughout, we consider the simplest case of a linear outcome equation, and homogeneous effects: y = βx + ɛ (1) where y is some outcome, x is an explanatory variable, and

More information

Imbens, Lecture Notes 2, Local Average Treatment Effects, IEN, Miami, Oct 10 1

Imbens, Lecture Notes 2, Local Average Treatment Effects, IEN, Miami, Oct 10 1 Imbens, Lecture Notes 2, Local Average Treatment Effects, IEN, Miami, Oct 10 1 Lectures on Evaluation Methods Guido Imbens Impact Evaluation Network October 2010, Miami Methods for Estimating Treatment

More information

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data?

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data? When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data? Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton University Joint

More information

Introduction to Causal Inference. Solutions to Quiz 4

Introduction to Causal Inference. Solutions to Quiz 4 Introduction to Causal Inference Solutions to Quiz 4 Teppei Yamamoto Tuesday, July 9 206 Instructions: Write your name in the space provided below before you begin. You have 20 minutes to complete the

More information

Causal Inference with General Treatment Regimes: Generalizing the Propensity Score

Causal Inference with General Treatment Regimes: Generalizing the Propensity Score Causal Inference with General Treatment Regimes: Generalizing the Propensity Score David van Dyk Department of Statistics, University of California, Irvine vandyk@stat.harvard.edu Joint work with Kosuke

More information

Identification Analysis for Randomized Experiments with Noncompliance and Truncation-by-Death

Identification Analysis for Randomized Experiments with Noncompliance and Truncation-by-Death Identification Analysis for Randomized Experiments with Noncompliance and Truncation-by-Death Kosuke Imai First Draft: January 19, 2007 This Draft: August 24, 2007 Abstract Zhang and Rubin 2003) derives

More information

A Course in Applied Econometrics. Lecture 5. Instrumental Variables with Treatment Effect. Heterogeneity: Local Average Treatment Effects.

A Course in Applied Econometrics. Lecture 5. Instrumental Variables with Treatment Effect. Heterogeneity: Local Average Treatment Effects. A Course in Applied Econometrics Lecture 5 Outline. Introduction 2. Basics Instrumental Variables with Treatment Effect Heterogeneity: Local Average Treatment Effects 3. Local Average Treatment Effects

More information

On Variance Estimation for 2SLS When Instruments Identify Different LATEs

On Variance Estimation for 2SLS When Instruments Identify Different LATEs On Variance Estimation for 2SLS When Instruments Identify Different LATEs Seojeong Lee June 30, 2014 Abstract Under treatment effect heterogeneity, an instrument identifies the instrumentspecific local

More information

Sensitivity checks for the local average treatment effect

Sensitivity checks for the local average treatment effect Sensitivity checks for the local average treatment effect Martin Huber March 13, 2014 University of St. Gallen, Dept. of Economics Abstract: The nonparametric identification of the local average treatment

More information

What s New in Econometrics. Lecture 13

What s New in Econometrics. Lecture 13 What s New in Econometrics Lecture 13 Weak Instruments and Many Instruments Guido Imbens NBER Summer Institute, 2007 Outline 1. Introduction 2. Motivation 3. Weak Instruments 4. Many Weak) Instruments

More information

Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies

Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Kosuke Imai Department of Politics Princeton University November 13, 2013 So far, we have essentially assumed

More information

Lecture 8. Roy Model, IV with essential heterogeneity, MTE

Lecture 8. Roy Model, IV with essential heterogeneity, MTE Lecture 8. Roy Model, IV with essential heterogeneity, MTE Economics 2123 George Washington University Instructor: Prof. Ben Williams Heterogeneity When we talk about heterogeneity, usually we mean heterogeneity

More information

PSC 504: Instrumental Variables

PSC 504: Instrumental Variables PSC 504: Instrumental Variables Matthew Blackwell 3/28/2013 Instrumental Variables and Structural Equation Modeling Setup e basic idea behind instrumental variables is that we have a treatment with unmeasured

More information

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton University

More information

Stratified Randomized Experiments

Stratified Randomized Experiments Stratified Randomized Experiments Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Stratified Randomized Experiments Stat186/Gov2002 Fall 2018 1 / 13 Blocking

More information

Inference for Average Treatment Effects

Inference for Average Treatment Effects Inference for Average Treatment Effects Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Average Treatment Effects Stat186/Gov2002 Fall 2018 1 / 15 Social

More information

Instrumental Variables in Action: Sometimes You get What You Need

Instrumental Variables in Action: Sometimes You get What You Need Instrumental Variables in Action: Sometimes You get What You Need Joshua D. Angrist MIT and NBER May 2011 Introduction Our Causal Framework A dummy causal variable of interest, i, is called a treatment,

More information

Imbens/Wooldridge, Lecture Notes 13, Summer 07 1

Imbens/Wooldridge, Lecture Notes 13, Summer 07 1 Imbens/Wooldridge, Lecture Notes 13, Summer 07 1 What s New in Econometrics NBER, Summer 2007 Lecture 13, Wednesday, Aug 1st, 2.00-3.00pm Weak Instruments and Many Instruments 1. Introduction In recent

More information

The Problem of Causality in the Analysis of Educational Choices and Labor Market Outcomes Slides for Lectures

The Problem of Causality in the Analysis of Educational Choices and Labor Market Outcomes Slides for Lectures The Problem of Causality in the Analysis of Educational Choices and Labor Market Outcomes Slides for Lectures Andrea Ichino (European University Institute and CEPR) February 28, 2006 Abstract This course

More information

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? Kosuke Imai Princeton University Asian Political Methodology Conference University of Sydney Joint

More information

Instrumental Variables

Instrumental Variables Instrumental Variables Yona Rubinstein July 2016 Yona Rubinstein (LSE) Instrumental Variables 07/16 1 / 31 The Limitation of Panel Data So far we learned how to account for selection on time invariant

More information

Econ 2148, fall 2017 Instrumental variables I, origins and binary treatment case

Econ 2148, fall 2017 Instrumental variables I, origins and binary treatment case Econ 2148, fall 2017 Instrumental variables I, origins and binary treatment case Maximilian Kasy Department of Economics, Harvard University 1 / 40 Agenda instrumental variables part I Origins of instrumental

More information

Identification and Inference in Causal Mediation Analysis

Identification and Inference in Causal Mediation Analysis Identification and Inference in Causal Mediation Analysis Kosuke Imai Luke Keele Teppei Yamamoto Princeton University Ohio State University November 12, 2008 Kosuke Imai (Princeton) Causal Mediation Analysis

More information

On the Use of Linear Fixed Effects Regression Models for Causal Inference

On the Use of Linear Fixed Effects Regression Models for Causal Inference On the Use of Linear Fixed Effects Regression Models for ausal Inference Kosuke Imai Department of Politics Princeton University Joint work with In Song Kim Atlantic ausal Inference onference Johns Hopkins

More information

Causal Inference Lecture Notes: Selection Bias in Observational Studies

Causal Inference Lecture Notes: Selection Bias in Observational Studies Causal Inference Lecture Notes: Selection Bias in Observational Studies Kosuke Imai Department of Politics Princeton University April 7, 2008 So far, we have studied how to analyze randomized experiments.

More information

ECON Introductory Econometrics. Lecture 16: Instrumental variables

ECON Introductory Econometrics. Lecture 16: Instrumental variables ECON4150 - Introductory Econometrics Lecture 16: Instrumental variables Monique de Haan (moniqued@econ.uio.no) Stock and Watson Chapter 12 Lecture outline 2 OLS assumptions and when they are violated Instrumental

More information

Weighting Methods. Harvard University STAT186/GOV2002 CAUSAL INFERENCE. Fall Kosuke Imai

Weighting Methods. Harvard University STAT186/GOV2002 CAUSAL INFERENCE. Fall Kosuke Imai Weighting Methods Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Weighting Methods Stat186/Gov2002 Fall 2018 1 / 13 Motivation Matching methods for improving

More information

AGEC 661 Note Fourteen

AGEC 661 Note Fourteen AGEC 661 Note Fourteen Ximing Wu 1 Selection bias 1.1 Heckman s two-step model Consider the model in Heckman (1979) Y i = X iβ + ε i, D i = I {Z iγ + η i > 0}. For a random sample from the population,

More information

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors Laura Mayoral, IAE, Barcelona GSE and University of Gothenburg U. of Gothenburg, May 2015 Roadmap Testing for deviations

More information

Flexible Estimation of Treatment Effect Parameters

Flexible Estimation of Treatment Effect Parameters Flexible Estimation of Treatment Effect Parameters Thomas MaCurdy a and Xiaohong Chen b and Han Hong c Introduction Many empirical studies of program evaluations are complicated by the presence of both

More information

IV Estimation WS 2014/15 SS Alexander Spermann. IV Estimation

IV Estimation WS 2014/15 SS Alexander Spermann. IV Estimation SS 2010 WS 2014/15 Alexander Spermann Evaluation With Non-Experimental Approaches Selection on Unobservables Natural Experiment (exogenous variation in a variable) DiD Example: Card/Krueger (1994) Minimum

More information

The Essential Role of Pair Matching in. Cluster-Randomized Experiments. with Application to the Mexican Universal Health Insurance Evaluation

The Essential Role of Pair Matching in. Cluster-Randomized Experiments. with Application to the Mexican Universal Health Insurance Evaluation The Essential Role of Pair Matching in Cluster-Randomized Experiments, with Application to the Mexican Universal Health Insurance Evaluation Kosuke Imai Princeton University Gary King Clayton Nall Harvard

More information

Empirical Methods in Applied Economics

Empirical Methods in Applied Economics Empirical Methods in Applied Economics Jörn-Ste en Pischke LSE October 2007 1 Instrumental Variables 1.1 Basics A good baseline for thinking about the estimation of causal e ects is often the randomized

More information

Statistical Models for Causal Analysis

Statistical Models for Causal Analysis Statistical Models for Causal Analysis Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 Three Modes of Statistical Inference 1. Descriptive Inference: summarizing and exploring

More information

The Simple Linear Regression Model

The Simple Linear Regression Model The Simple Linear Regression Model Lesson 3 Ryan Safner 1 1 Department of Economics Hood College ECON 480 - Econometrics Fall 2017 Ryan Safner (Hood College) ECON 480 - Lesson 3 Fall 2017 1 / 77 Bivariate

More information

Introduction to causal identification. Nidhiya Menon IGC Summer School, New Delhi, July 2015

Introduction to causal identification. Nidhiya Menon IGC Summer School, New Delhi, July 2015 Introduction to causal identification Nidhiya Menon IGC Summer School, New Delhi, July 2015 Outline 1. Micro-empirical methods 2. Rubin causal model 3. More on Instrumental Variables (IV) Estimating causal

More information

The returns to schooling, ability bias, and regression

The returns to schooling, ability bias, and regression The returns to schooling, ability bias, and regression Jörn-Steffen Pischke LSE October 4, 2016 Pischke (LSE) Griliches 1977 October 4, 2016 1 / 44 Counterfactual outcomes Scholing for individual i is

More information

Ordinary Least Squares Regression

Ordinary Least Squares Regression Ordinary Least Squares Regression Goals for this unit More on notation and terminology OLS scalar versus matrix derivation Some Preliminaries In this class we will be learning to analyze Cross Section

More information

Prediction and causal inference, in a nutshell

Prediction and causal inference, in a nutshell Prediction and causal inference, in a nutshell 1 Prediction (Source: Amemiya, ch. 4) Best Linear Predictor: a motivation for linear univariate regression Consider two random variables X and Y. What is

More information

1 Motivation for Instrumental Variable (IV) Regression

1 Motivation for Instrumental Variable (IV) Regression ECON 370: IV & 2SLS 1 Instrumental Variables Estimation and Two Stage Least Squares Econometric Methods, ECON 370 Let s get back to the thiking in terms of cross sectional (or pooled cross sectional) data

More information

Methods to Estimate Causal Effects Theory and Applications. Prof. Dr. Sascha O. Becker U Stirling, Ifo, CESifo and IZA

Methods to Estimate Causal Effects Theory and Applications. Prof. Dr. Sascha O. Becker U Stirling, Ifo, CESifo and IZA Methods to Estimate Causal Effects Theory and Applications Prof. Dr. Sascha O. Becker U Stirling, Ifo, CESifo and IZA last update: 21 August 2009 Preliminaries Address Prof. Dr. Sascha O. Becker Stirling

More information

Groupe de lecture. Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings. Abadie, Angrist, Imbens

Groupe de lecture. Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings. Abadie, Angrist, Imbens Groupe de lecture Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings Abadie, Angrist, Imbens Econometrica (2002) 02 décembre 2010 Objectives Using

More information

Economics 241B Estimation with Instruments

Economics 241B Estimation with Instruments Economics 241B Estimation with Instruments Measurement Error Measurement error is de ned as the error resulting from the measurement of a variable. At some level, every variable is measured with error.

More information

High Dimensional Propensity Score Estimation via Covariate Balancing

High Dimensional Propensity Score Estimation via Covariate Balancing High Dimensional Propensity Score Estimation via Covariate Balancing Kosuke Imai Princeton University Talk at Columbia University May 13, 2017 Joint work with Yang Ning and Sida Peng Kosuke Imai (Princeton)

More information

Econometrics. Week 8. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague

Econometrics. Week 8. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Econometrics Week 8 Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Fall 2012 1 / 25 Recommended Reading For the today Instrumental Variables Estimation and Two Stage

More information

Notes on causal effects

Notes on causal effects Notes on causal effects Johan A. Elkink March 4, 2013 1 Decomposing bias terms Deriving Eq. 2.12 in Morgan and Winship (2007: 46): { Y1i if T Potential outcome = i = 1 Y 0i if T i = 0 Using shortcut E

More information

A Consistent Variance Estimator for 2SLS When Instruments Identify Different LATEs

A Consistent Variance Estimator for 2SLS When Instruments Identify Different LATEs A Consistent Variance Estimator for 2SLS When Instruments Identify Different LATEs Seojeong (Jay) Lee September 28, 2015 Abstract Under treatment effect heterogeneity, an instrument identifies the instrumentspecific

More information

Selection on Observables: Propensity Score Matching.

Selection on Observables: Propensity Score Matching. Selection on Observables: Propensity Score Matching. Department of Economics and Management Irene Brunetti ireneb@ec.unipi.it 24/10/2017 I. Brunetti Labour Economics in an European Perspective 24/10/2017

More information

WISE MA/PhD Programs Econometrics Instructor: Brett Graham Spring Semester, Academic Year Exam Version: A

WISE MA/PhD Programs Econometrics Instructor: Brett Graham Spring Semester, Academic Year Exam Version: A WISE MA/PhD Programs Econometrics Instructor: Brett Graham Spring Semester, 2016-17 Academic Year Exam Version: A INSTRUCTIONS TO STUDENTS 1 The time allowed for this examination paper is 2 hours. 2 This

More information

Applied Econometrics (MSc.) Lecture 3 Instrumental Variables

Applied Econometrics (MSc.) Lecture 3 Instrumental Variables Applied Econometrics (MSc.) Lecture 3 Instrumental Variables Estimation - Theory Department of Economics University of Gothenburg December 4, 2014 1/28 Why IV estimation? So far, in OLS, we assumed independence.

More information

Implementing Matching Estimators for. Average Treatment Effects in STATA. Guido W. Imbens - Harvard University Stata User Group Meeting, Boston

Implementing Matching Estimators for. Average Treatment Effects in STATA. Guido W. Imbens - Harvard University Stata User Group Meeting, Boston Implementing Matching Estimators for Average Treatment Effects in STATA Guido W. Imbens - Harvard University Stata User Group Meeting, Boston July 26th, 2006 General Motivation Estimation of average effect

More information

What s New in Econometrics. Lecture 1

What s New in Econometrics. Lecture 1 What s New in Econometrics Lecture 1 Estimation of Average Treatment Effects Under Unconfoundedness Guido Imbens NBER Summer Institute, 2007 Outline 1. Introduction 2. Potential Outcomes 3. Estimands and

More information

Topics in Applied Econometrics and Development - Spring 2014

Topics in Applied Econometrics and Development - Spring 2014 Topic 2: Topics in Applied Econometrics and Development - Spring 2014 Single-Equation Linear Model The population model is linear in its parameters: y = β 0 + β 1 x 1 + β 2 x 2 +... + β K x K + u - y,

More information

Online Appendix to Yes, But What s the Mechanism? (Don t Expect an Easy Answer) John G. Bullock, Donald P. Green, and Shang E. Ha

Online Appendix to Yes, But What s the Mechanism? (Don t Expect an Easy Answer) John G. Bullock, Donald P. Green, and Shang E. Ha Online Appendix to Yes, But What s the Mechanism? (Don t Expect an Easy Answer) John G. Bullock, Donald P. Green, and Shang E. Ha January 18, 2010 A2 This appendix has six parts: 1. Proof that ab = c d

More information

A New Paradigm: A Joint Test of Structural and Correlation Parameters in Instrumental Variables Regression When Perfect Exogeneity is Violated

A New Paradigm: A Joint Test of Structural and Correlation Parameters in Instrumental Variables Regression When Perfect Exogeneity is Violated A New Paradigm: A Joint Test of Structural and Correlation Parameters in Instrumental Variables Regression When Perfect Exogeneity is Violated By Mehmet Caner and Melinda Sandler Morrill September 22,

More information

Linear models and their mathematical foundations: Simple linear regression

Linear models and their mathematical foundations: Simple linear regression Linear models and their mathematical foundations: Simple linear regression Steffen Unkel Department of Medical Statistics University Medical Center Göttingen, Germany Winter term 2018/19 1/21 Introduction

More information

Testing the validity of the sibling sex ratio instrument

Testing the validity of the sibling sex ratio instrument Testing the validity of the sibling sex ratio instrument Martin Huber September 1, 2014 University of Fribourg, Dept. of Economics Abstract: We test the validity of the sibling sex ratio instrument in

More information

Chapter 8. Quantile Regression and Quantile Treatment Effects

Chapter 8. Quantile Regression and Quantile Treatment Effects Chapter 8. Quantile Regression and Quantile Treatment Effects By Joan Llull Quantitative & Statistical Methods II Barcelona GSE. Winter 2018 I. Introduction A. Motivation As in most of the economics literature,

More information

Statistical Analysis of Causal Mechanisms

Statistical Analysis of Causal Mechanisms Statistical Analysis of Causal Mechanisms Kosuke Imai Princeton University November 17, 2008 Joint work with Luke Keele (Ohio State) and Teppei Yamamoto (Princeton) Kosuke Imai (Princeton) Causal Mechanisms

More information

Implementing Matching Estimators for. Average Treatment Effects in STATA

Implementing Matching Estimators for. Average Treatment Effects in STATA Implementing Matching Estimators for Average Treatment Effects in STATA Guido W. Imbens - Harvard University West Coast Stata Users Group meeting, Los Angeles October 26th, 2007 General Motivation Estimation

More information

WISE International Masters

WISE International Masters WISE International Masters ECONOMETRICS Instructor: Brett Graham INSTRUCTIONS TO STUDENTS 1 The time allowed for this examination paper is 2 hours. 2 This examination paper contains 32 questions. You are

More information

Testing for Rank Invariance or Similarity in Program Evaluation: The Effect of Training on Earnings Revisited

Testing for Rank Invariance or Similarity in Program Evaluation: The Effect of Training on Earnings Revisited Testing for Rank Invariance or Similarity in Program Evaluation: The Effect of Training on Earnings Revisited Yingying Dong and Shu Shen UC Irvine and UC Davis Sept 2015 @ Chicago 1 / 37 Dong, Shen Testing

More information

ECON 5350 Class Notes Functional Form and Structural Change

ECON 5350 Class Notes Functional Form and Structural Change ECON 5350 Class Notes Functional Form and Structural Change 1 Introduction Although OLS is considered a linear estimator, it does not mean that the relationship between Y and X needs to be linear. In this

More information

Lecture 11 Roy model, MTE, PRTE

Lecture 11 Roy model, MTE, PRTE Lecture 11 Roy model, MTE, PRTE Economics 2123 George Washington University Instructor: Prof. Ben Williams Roy Model Motivation The standard textbook example of simultaneity is a supply and demand system

More information

On the Sensitivity of Return to Schooling Estimates to Estimation Methods, Model Specification, and Influential Outliers If Identification Is Weak

On the Sensitivity of Return to Schooling Estimates to Estimation Methods, Model Specification, and Influential Outliers If Identification Is Weak DISCUSSION PAPER SERIES IZA DP No. 3961 On the Sensitivity of Return to Schooling Estimates to Estimation Methods, Model Specification, and Influential Outliers If Identification Is Weak David A. Jaeger

More information

WISE MA/PhD Programs Econometrics Instructor: Brett Graham Spring Semester, Academic Year Exam Version: A

WISE MA/PhD Programs Econometrics Instructor: Brett Graham Spring Semester, Academic Year Exam Version: A WISE MA/PhD Programs Econometrics Instructor: Brett Graham Spring Semester, 2016-17 Academic Year Exam Version: A INSTRUCTIONS TO STUDENTS 1 The time allowed for this examination paper is 2 hours. 2 This

More information

The propensity score with continuous treatments

The propensity score with continuous treatments 7 The propensity score with continuous treatments Keisuke Hirano and Guido W. Imbens 1 7.1 Introduction Much of the work on propensity score analysis has focused on the case in which the treatment is binary.

More information

Unbiased Instrumental Variables Estimation Under Known First-Stage Sign

Unbiased Instrumental Variables Estimation Under Known First-Stage Sign Unbiased Instrumental Variables Estimation Under Known First-Stage Sign Isaiah Andrews Harvard Society of Fellows Timothy B. Armstrong Yale University April 9, 2016 Abstract We derive mean-unbiased estimators

More information

Simple Linear Regression

Simple Linear Regression Simple Linear Regression ST 430/514 Recall: A regression model describes how a dependent variable (or response) Y is affected, on average, by one or more independent variables (or factors, or covariates)

More information

The problem of causality in microeconometrics.

The problem of causality in microeconometrics. The problem of causality in microeconometrics. Andrea Ichino European University Institute April 15, 2014 Contents 1 The Problem of Causality 1 1.1 A formal framework to think about causality....................................

More information

ESTIMATION OF TREATMENT EFFECTS VIA MATCHING

ESTIMATION OF TREATMENT EFFECTS VIA MATCHING ESTIMATION OF TREATMENT EFFECTS VIA MATCHING AAEC 56 INSTRUCTOR: KLAUS MOELTNER Textbooks: R scripts: Wooldridge (00), Ch.; Greene (0), Ch.9; Angrist and Pischke (00), Ch. 3 mod5s3 General Approach The

More information

Identification in Triangular Systems using Control Functions

Identification in Triangular Systems using Control Functions Identification in Triangular Systems using Control Functions Maximilian Kasy Department of Economics, UC Berkeley Maximilian Kasy (UC Berkeley) Control Functions 1 / 19 Introduction Introduction There

More information

ExtrapoLATE-ing: External Validity and Overidentification in the LATE framework. March 2011

ExtrapoLATE-ing: External Validity and Overidentification in the LATE framework. March 2011 ExtrapoLATE-ing: External Validity and Overidentification in the LATE framework Josh Angrist MIT Iván Fernández-Val BU March 2011 Instrumental Variables and External Validity Local Average Treatment Effects

More information

Final Exam. Economics 835: Econometrics. Fall 2010

Final Exam. Economics 835: Econometrics. Fall 2010 Final Exam Economics 835: Econometrics Fall 2010 Please answer the question I ask - no more and no less - and remember that the correct answer is often short and simple. 1 Some short questions a) For each

More information

Supplementary material to: Tolerating deance? Local average treatment eects without monotonicity.

Supplementary material to: Tolerating deance? Local average treatment eects without monotonicity. Supplementary material to: Tolerating deance? Local average treatment eects without monotonicity. Clément de Chaisemartin September 1, 2016 Abstract This paper gathers the supplementary material to de

More information

8. Instrumental variables regression

8. Instrumental variables regression 8. Instrumental variables regression Recall: In Section 5 we analyzed five sources of estimation bias arising because the regressor is correlated with the error term Violation of the first OLS assumption

More information

Sharp IV bounds on average treatment effects on the treated and other populations under endogeneity and noncompliance

Sharp IV bounds on average treatment effects on the treated and other populations under endogeneity and noncompliance Sharp IV bounds on average treatment effects on the treated and other populations under endogeneity and noncompliance Martin Huber 1, Lukas Laffers 2, and Giovanni Mellace 3 1 University of Fribourg, Dept.

More information

Covariate Balancing Propensity Score for General Treatment Regimes

Covariate Balancing Propensity Score for General Treatment Regimes Covariate Balancing Propensity Score for General Treatment Regimes Kosuke Imai Princeton University October 14, 2014 Talk at the Department of Psychiatry, Columbia University Joint work with Christian

More information

Questions and Answers on Unit Roots, Cointegration, VARs and VECMs

Questions and Answers on Unit Roots, Cointegration, VARs and VECMs Questions and Answers on Unit Roots, Cointegration, VARs and VECMs L. Magee Winter, 2012 1. Let ɛ t, t = 1,..., T be a series of independent draws from a N[0,1] distribution. Let w t, t = 1,..., T, be

More information

Clustering as a Design Problem

Clustering as a Design Problem Clustering as a Design Problem Alberto Abadie, Susan Athey, Guido Imbens, & Jeffrey Wooldridge Harvard-MIT Econometrics Seminar Cambridge, February 4, 2016 Adjusting standard errors for clustering is common

More information

Review of Econometrics

Review of Econometrics Review of Econometrics Zheng Tian June 5th, 2017 1 The Essence of the OLS Estimation Multiple regression model involves the models as follows Y i = β 0 + β 1 X 1i + β 2 X 2i + + β k X ki + u i, i = 1,...,

More information

An Alternative Assumption to Identify LATE in Regression Discontinuity Design

An Alternative Assumption to Identify LATE in Regression Discontinuity Design An Alternative Assumption to Identify LATE in Regression Discontinuity Design Yingying Dong University of California Irvine May 2014 Abstract One key assumption Imbens and Angrist (1994) use to identify

More information

Randomization Inference with An Instrumental Variable: Two Examples and Some Theory

Randomization Inference with An Instrumental Variable: Two Examples and Some Theory Randomization Inference with An Instrumental Variable: Two Examples and Some Theory Paul R. Rosenbaum, Department of Statistics, Wharton School University of Pennsylvania, Philadelphia, PA 19104-6340 US

More information

4.8 Instrumental Variables

4.8 Instrumental Variables 4.8. INSTRUMENTAL VARIABLES 35 4.8 Instrumental Variables A major complication that is emphasized in microeconometrics is the possibility of inconsistent parameter estimation due to endogenous regressors.

More information

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors Laura Mayoral IAE, Barcelona GSE and University of Gothenburg Gothenburg, May 2015 Roadmap of the course Introduction.

More information

Small-sample cluster-robust variance estimators for two-stage least squares models

Small-sample cluster-robust variance estimators for two-stage least squares models Small-sample cluster-robust variance estimators for two-stage least squares models ames E. Pustejovsky The University of Texas at Austin Context In randomized field trials of educational interventions,

More information

AN EVALUATION OF PARAMETRIC AND NONPARAMETRIC VARIANCE ESTIMATORS IN COMPLETELY RANDOMIZED EXPERIMENTS. Stanley A. Lubanski. and. Peter M.

AN EVALUATION OF PARAMETRIC AND NONPARAMETRIC VARIANCE ESTIMATORS IN COMPLETELY RANDOMIZED EXPERIMENTS. Stanley A. Lubanski. and. Peter M. AN EVALUATION OF PARAMETRIC AND NONPARAMETRIC VARIANCE ESTIMATORS IN COMPLETELY RANDOMIZED EXPERIMENTS by Stanley A. Lubanski and Peter M. Steiner UNIVERSITY OF WISCONSIN-MADISON 018 Background To make

More information

Causal Inference with Interference and Noncompliance in Two-Stage Randomized Experiments

Causal Inference with Interference and Noncompliance in Two-Stage Randomized Experiments Causal Inference with Interference and Noncompliance in Two-Stage Randomized Experiments Kosuke Imai Zhichao Jiang Anup Malani First Draft: April 9, 08 This Draft: June 5, 08 Abstract In many social science

More information

Introduction to Regression Analysis. Dr. Devlina Chatterjee 11 th August, 2017

Introduction to Regression Analysis. Dr. Devlina Chatterjee 11 th August, 2017 Introduction to Regression Analysis Dr. Devlina Chatterjee 11 th August, 2017 What is regression analysis? Regression analysis is a statistical technique for studying linear relationships. One dependent

More information

Discussion of Identifiability and Estimation of Causal Effects in Randomized. Trials with Noncompliance and Completely Non-ignorable Missing Data

Discussion of Identifiability and Estimation of Causal Effects in Randomized. Trials with Noncompliance and Completely Non-ignorable Missing Data Biometrics 000, 000 000 DOI: 000 000 0000 Discussion of Identifiability and Estimation of Causal Effects in Randomized Trials with Noncompliance and Completely Non-ignorable Missing Data Dylan S. Small

More information

Statistical Analysis of List Experiments

Statistical Analysis of List Experiments Statistical Analysis of List Experiments Graeme Blair Kosuke Imai Princeton University December 17, 2010 Blair and Imai (Princeton) List Experiments Political Methodology Seminar 1 / 32 Motivation Surveys

More information

Gov 2002: 4. Observational Studies and Confounding

Gov 2002: 4. Observational Studies and Confounding Gov 2002: 4. Observational Studies and Confounding Matthew Blackwell September 10, 2015 Where are we? Where are we going? Last two weeks: randomized experiments. From here on: observational studies. What

More information

Randomized Experiments

Randomized Experiments Randomized Experiments Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 1 Introduction 2 Identification 3 Basic Inference 4 Covariate Adjustment 5 Threats to Validity 6 Advanced

More information