Causal Interaction in Factorial Experiments: Application to Conjoint Analysis

Size: px
Start display at page:

Download "Causal Interaction in Factorial Experiments: Application to Conjoint Analysis"

Transcription

1 Causal Interaction in Factorial Experiments: Application to Conjoint Analysis Naoki Egami Kosuke Imai Princeton University Talk at the Institute for Mathematics and Its Applications University of Minnesota September 15, 2017 Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 1 / 16

2 Causal Heterogeneity and Interaction Effects 1 Moderation: How does the effect of a treatment vary across individuals? Interaction between the treatment variable and pre-treatment covariates 2 Causal interaction: What combination of treatments is efficacious? Interaction among multiple treatment variables Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 2 / 16

3 Conjoint Analysis Survey experiments with a factorial design Respondents evaluate several pairs of randomly selected profiles defined by multiple factors Social scientists use it to analyze multidimensional preferences Example: Immigration preference (Hopkins and Hainmueller 2014) representative sample of 1,407 American adults each respondent evaluates 5 pairs of immigrant profiles gender 2, education 7, origin 10, experience 4, plan 4, language 4, profession 11, application reason 3, prior trips 5 What combinations of immigrant characteristics do Americans prefer? High dimension: over 1 million treatment combinations Methodological challenges: Many interaction effects false positives, difficulty of interpretation Very few applied researchers study interaction Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 3 / 16

4 Factorial Experiments with Two Treatments Two factorial treatments (e.g., gender and race): A A = {a 0, a 1,..., a LA 1} B B = {b 0, b 1,..., b LB 1} Assumption: Full factorial design 1 Randomization of treatment assignment {Y (a l, b m )} al A,b m B {A, B} 2 Non-zero probability for all treatment combination Pr(A = a l, B = b m ) > 0 for all a l A and b m B Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 4 / 16

5 Main Causal Estimands in Factorial Experiments 1 Average Combination Effect (ACE): Average effect of treatment combination (A, B) = (a l, b m ) relative to the baseline condition (A, B) = (a 0, b 0 ) τ AB (a l, b m ; a 0, b 0 ) = E{Y (a l, b m ) Y (a 0, b 0 )} Effect of being Asian male 2 Average Marginal Effect (AME; Hainmueller et al. 2014; Dasgupta et al. 2015): Average effect of treatment A = a l relative to the baseline condition A = a 0 averaging over the other treatment B ψ A (a l, a 0 ) = E{Y (a l, B) Y (a 0, B)}dF (B) Effect of being male averaging over race Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 5 / 16

6 The New Causal Interaction Effect Average Marginal Interaction Effect (AMIE): π AB (a l, b m ; a 0, b 0 ) = τ AB (a l, b m ; a 0, b 0 ) ψ }{{} A (a l, a 0 ) ψ }{{} B (b m, b 0 ) }{{} ACE of (a l, b m) AME of a l AME of b m Interpretation: additional effect induced by A = a l and B = b m together beyond the separate effect of A = a l and that of B = b m Additional effect of being Asian male beyond the sum of separate effects for being male and being Asian Decomposition of ACE: τ AB = ψ A + ψ B + π AB Invariance: Unlike the standard interaction effect, the relative magnitude of AMIE doesn t depend on the choice of baseline condition AMIEs depend on the distribution of treatment assignment: 1 specified by one s experimental design 2 motivated by a target population Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 6 / 16

7 Higher-order Causal Interaction J factorial treatments with L j levels each: T = (T 1,..., T J ) Assumptions: 1 Full factorial design Y (t) T and Pr(T = t) > 0 for all t 2 Independent treatment assignment T j T j for all j Assumption 2 is not necessary for identification but considerably simplifies estimation We are interested in the K-way interaction where K J We extend all the results for the 2-way interaction to this general case Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 7 / 16

8 Higher-order Average Marginal Interaction Effect General definition: the difference between ACE and the sum of all lower-order AMIEs (first-order AMIE = AME) Example: 3-way AMIE, π 1:3 (t 1, t 2, t 3 ; t 01, t 02, t 03 ), equals τ 1:3 (t 1, t 2, t 3 ; t 01, t 02, t 03 ) }{{} ACE { π 1:2 (t 1, t 2 ; t 01, t 02 ) + π 2:3 (t 2, t 3 ; t 02, t 03 ) + π 1:3 (t 1, t 3 ; t 01, t 03 ) } }{{} sum of all 2-way AMIEs { ψ(t 1 ; t 01 ) + ψ(t 2 ; t 02 ) + ψ(t 3 ; t 03 ) } }{{} sum of AMEs Properties: 1 K-way ACE = the sum of all K-way and lower-order AMIEs 2 Invariance to the baseline condition Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 8 / 16

9 Nonparametric Estimation of AMIE 1 Difference-in-means estimator estimate ACE and AMEs using the difference-in-means estimators estimate AMIE as ˆπ AB = ˆτ AB ˆψ A ˆψ B higher-order AMIEs can be estimated sequentially uses the empirical treatment assignment distribution 2 ANOVA based estimator saturated ANOVA include all interactions up to the Jth order weighted zero-sum constraints: for all factors and levels, L A 1 l=0 L B 1 m=0 Pr(A i = a l )β A l = 0, Pr(B i = b m)β B m = 0, L A 1 l=0 L B 1 m=0 AMIEs are differences of coefficients: Pr(A i = a l )β AB lm = 0, Pr(B i = b m)β AB lm = 0, and so on E( ˆβ A l ˆβ A 0 ) = ψ A (a l ; a 0 ), E( ˆβ AB lm ˆβ AB 00 ) = π AB (a l, b m ; a 0, b 0 ) can use any marginal treatment assignment distribution of choice Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 9 / 16

10 Conjoint Analysis of Ethnic Voting in Africa Ethnic voting and accountability: Carlson (2015, World Politics) Do voters prefer candidates of same ethnicity regardless of their prior performance? Do ethnicity and performance interact? Conjoint analysis in Uganda: 547 voters from 32 villages Each voter evaluates 3 pairs of hypothetical candidates 5 factors: Coethnicity 2, Prior record 2, Prior office 4, Platform 3, Education 8 Prior record = No if Prior office = businessman combine these two factors into a single factor with 7 levels Collapse Education into 2 levels: relevant degrees (MA in business, law, economics, development) and other degrees Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 10 / 16

11 A Statistical Model of Preference Differentials ANOVA regression with one-way and two-way effects: Y i (T i ) = µ + L J j 1 β j l 1{T ij = l} + L j 1 j j j=1 l=0 l=0 L j 1 m=0 β jj lm 1{T ij = l, T ij = m} + ɛ i with appropriate weighted zero-sum constraints In conjoint analysis, we observe the sign of preference differentials Linear probability model of preference differential: Pr(Y i (T i ) > Y i (T i ) T i, T i ) L J j 1 = µ + β j l (1{T ij = l} 1{Tij = l}) + j j j=1 L j 1 l=0 l=0 L j 1 m=0 β jj lm (1{T ij = l, T ij = m} 1{Tij = l, T ij = m}) where µ = 0.5 if the position of profile does not matter We apply regularized ANOVA method (Post and Bondell) Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 11 / 16

12 Ranges of Estimated AMEs and AMIEs Selection Range prob. AME Record Coethnicity Platform Degree AMIE Coethnicity Record Record Platform Platform Coethnic Coethnicity Degree Platform Degree Record Degree Factor selection probability based on bootstrap Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 12 / 16

13 Close Look at the Estimated AMEs Selection Factor AME prob. Record Yes/Village Yes/District Yes/MP No/Village No/District No/MP { No/Businessman Platform { Jobs Clinic base base { Education Coethnicity Degree Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 13 / 16

14 Effect of Regularization on AMIEs Yes/Village Yes/District Yes/MP No/Village No/District No/MP No/Business Yes/Village Yes/District Yes/MP No/Village No/District No/MP No/Business Platform Coethnicity Yes/Village Yes/District Yes/MP No/Village No/District No/MP No/Business Record Yes/Village Yes/District Yes/MP No/Village No/District No/MP No/Business Record Without Regularization With Regularization Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 14 / 16

15 Decomposition and Conditional Effects Decomposition of ACE (Coethnicity Record interaction): τ(coethnic, No/Business; Non-coethnic, No/MP) }{{} 2.4 = ψ(coethnic; Non-coethnic) + ψ(no/business; No/MP) }{{}}{{} π(coethnic, No/Business; Non-coethnic, No/MP) }{{} 3.1 Conditional effects (Platform Record interaction): AMIE: π(education, No/MP}; {Job, No/MP}) = 2.3 Conditional effect of Education relative to Job for No/MP is approximately zero AME: ψ(education; Job) = 2.3 Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 15 / 16

16 Concluding Remarks Interaction effects play an essential role in causal heterogeneity 1 moderation 2 causal interaction Randomized experiments with a factorial design 1 useful for testing multiple treatments and their interactions 2 social science applications: audit studies, conjoint analysis 3 challenge: estimation and interpretation in high dimension Average Marginal Interaction Effect (AMIE) 1 invariant to baseline condition 2 straightforward interpretation even for high order interaction 3 enables effect decomposition 4 enables regularization through ANOVA Egami and Imai (Princeton) Causal Interaction UM-IMA (Sept. 15, 2017) 16 / 16

Causal Interaction in Factorial Experiments: Application to Conjoint Analysis

Causal Interaction in Factorial Experiments: Application to Conjoint Analysis Causal Interaction in Factorial Experiments: Application to Conjoint Analysis Naoki Egami Kosuke Imai Princeton University Talk at the University of Macau June 16, 2017 Egami and Imai (Princeton) Causal

More information

Causal Interaction in Factorial Experiments: Application to Conjoint Analysis

Causal Interaction in Factorial Experiments: Application to Conjoint Analysis Causal Interaction in Factorial Experiments: Application to Conjoint Analysis Kosuke Imai Department of Government Department of Statistics Harvard University Talk at the Harvard Data Science Initiative

More information

Causal Interaction in High Dimension

Causal Interaction in High Dimension Causal Interaction in High Dimension Naoki Egami Kosuke Imai Princeton University Annual Summer Meeting The Society for Political Methodology University of Rochester July 23, 2015 Egami and Imai (Princeton)

More information

Interaction Effects and Causal Heterogeneity

Interaction Effects and Causal Heterogeneity Interaction Effects and Causal Heterogeneity Kosuke Imai Princeton University Winter Conference in Statistics Borgafjäll, Sweden March 11, 2015 Joint work with Naoki Egami and Marc Ratkovic Kosuke Imai

More information

Item Response Theory for Conjoint Survey Experiments

Item Response Theory for Conjoint Survey Experiments Item Response Theory for Conjoint Survey Experiments Devin Caughey Hiroto Katsumata Teppei Yamamoto Massachusetts Institute of Technology PolMeth XXXV @ Brigham Young University July 21, 2018 Conjoint

More information

An Experimental Evaluation of High-Dimensional Multi-Armed Bandits

An Experimental Evaluation of High-Dimensional Multi-Armed Bandits An Experimental Evaluation of High-Dimensional Multi-Armed Bandits Naoki Egami Romain Ferrali Kosuke Imai Princeton University Talk at Political Data Science Conference Washington University, St. Louis

More information

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Princeton University Joint work with Keele (Ohio State), Tingley (Harvard), Yamamoto (Princeton)

More information

Experimental Designs for Identifying Causal Mechanisms

Experimental Designs for Identifying Causal Mechanisms Experimental Designs for Identifying Causal Mechanisms Kosuke Imai Princeton University October 18, 2011 PSMG Meeting Kosuke Imai (Princeton) Causal Mechanisms October 18, 2011 1 / 25 Project Reference

More information

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Princeton University February 23, 2012 Joint work with L. Keele (Penn State)

More information

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Princeton University January 23, 2012 Joint work with L. Keele (Penn State)

More information

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton University

More information

Causal Mediation Analysis in R. Quantitative Methodology and Causal Mechanisms

Causal Mediation Analysis in R. Quantitative Methodology and Causal Mechanisms Causal Mediation Analysis in R Kosuke Imai Princeton University June 18, 2009 Joint work with Luke Keele (Ohio State) Dustin Tingley and Teppei Yamamoto (Princeton) Kosuke Imai (Princeton) Causal Mediation

More information

Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies

Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Kosuke Imai Department of Politics Princeton University November 13, 2013 So far, we have essentially assumed

More information

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? Kosuke Imai Princeton University Asian Political Methodology Conference University of Sydney Joint

More information

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Princeton University September 14, 2010 Institute of Statistical Mathematics Project Reference

More information

Statistical Analysis of List Experiments

Statistical Analysis of List Experiments Statistical Analysis of List Experiments Graeme Blair Kosuke Imai Princeton University December 17, 2010 Blair and Imai (Princeton) List Experiments Political Methodology Seminar 1 / 32 Motivation Surveys

More information

Statistical Analysis of Causal Mechanisms

Statistical Analysis of Causal Mechanisms Statistical Analysis of Causal Mechanisms Kosuke Imai Princeton University November 17, 2008 Joint work with Luke Keele (Ohio State) and Teppei Yamamoto (Princeton) Kosuke Imai (Princeton) Causal Mechanisms

More information

Statistical Analysis of the Item Count Technique

Statistical Analysis of the Item Count Technique Statistical Analysis of the Item Count Technique Kosuke Imai Department of Politics Princeton University Joint work with Graeme Blair May 4, 2011 Kosuke Imai (Princeton) Item Count Technique UCI (Statistics)

More information

Use of Matching Methods for Causal Inference in Experimental and Observational Studies. This Talk Draws on the Following Papers:

Use of Matching Methods for Causal Inference in Experimental and Observational Studies. This Talk Draws on the Following Papers: Use of Matching Methods for Causal Inference in Experimental and Observational Studies Kosuke Imai Department of Politics Princeton University April 27, 2007 Kosuke Imai (Princeton University) Matching

More information

Identification and Inference in Causal Mediation Analysis

Identification and Inference in Causal Mediation Analysis Identification and Inference in Causal Mediation Analysis Kosuke Imai Luke Keele Teppei Yamamoto Princeton University Ohio State University November 12, 2008 Kosuke Imai (Princeton) Causal Mediation Analysis

More information

1. Capitalize all surnames and attempt to match with Census list. 3. Split double-barreled names apart, and attempt to match first half of name.

1. Capitalize all surnames and attempt to match with Census list. 3. Split double-barreled names apart, and attempt to match first half of name. Supplementary Appendix: Imai, Kosuke and Kabir Kahnna. (2016). Improving Ecological Inference by Predicting Individual Ethnicity from Voter Registration Records. Political Analysis doi: 10.1093/pan/mpw001

More information

High Dimensional Propensity Score Estimation via Covariate Balancing

High Dimensional Propensity Score Estimation via Covariate Balancing High Dimensional Propensity Score Estimation via Covariate Balancing Kosuke Imai Princeton University Talk at Columbia University May 13, 2017 Joint work with Yang Ning and Sida Peng Kosuke Imai (Princeton)

More information

Introduction to Statistical Inference

Introduction to Statistical Inference Introduction to Statistical Inference Kosuke Imai Princeton University January 31, 2010 Kosuke Imai (Princeton) Introduction to Statistical Inference January 31, 2010 1 / 21 What is Statistics? Statistics

More information

Robust Estimation of Inverse Probability Weights for Marginal Structural Models

Robust Estimation of Inverse Probability Weights for Marginal Structural Models Robust Estimation of Inverse Probability Weights for Marginal Structural Models Kosuke IMAI and Marc RATKOVIC Marginal structural models (MSMs) are becoming increasingly popular as a tool for causal inference

More information

Statistical Analysis of Randomized Experiments with Nonignorable Missing Binary Outcomes

Statistical Analysis of Randomized Experiments with Nonignorable Missing Binary Outcomes Statistical Analysis of Randomized Experiments with Nonignorable Missing Binary Outcomes Kosuke Imai Department of Politics Princeton University July 31 2007 Kosuke Imai (Princeton University) Nonignorable

More information

Statistical Analysis of Causal Mechanisms

Statistical Analysis of Causal Mechanisms Statistical Analysis of Causal Mechanisms Kosuke Imai Luke Keele Dustin Tingley Teppei Yamamoto Princeton University Ohio State University July 25, 2009 Summer Political Methodology Conference Imai, Keele,

More information

Statistical Analysis of Causal Mechanisms

Statistical Analysis of Causal Mechanisms Statistical Analysis of Causal Mechanisms Kosuke Imai Princeton University April 13, 2009 Kosuke Imai (Princeton) Causal Mechanisms April 13, 2009 1 / 26 Papers and Software Collaborators: Luke Keele,

More information

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data?

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data? When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data? Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton University Joint

More information

Regression Discontinuity Designs

Regression Discontinuity Designs Regression Discontinuity Designs Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Regression Discontinuity Design Stat186/Gov2002 Fall 2018 1 / 1 Observational

More information

Uncovering Heterogeneous Treatment Effects

Uncovering Heterogeneous Treatment Effects Uncovering Heterogeneous Treatment Effects Yuki Shiraito This Version: October 22, 2016 Abstract Many social scientists believe that effects of policies or interventions vary for one individual to another.

More information

Use of Matching Methods for Causal Inference in Experimental and Observational Studies. This Talk Draws on the Following Papers:

Use of Matching Methods for Causal Inference in Experimental and Observational Studies. This Talk Draws on the Following Papers: Use of Matching Methods for Causal Inference in Experimental and Observational Studies Kosuke Imai Department of Politics Princeton University April 13, 2009 Kosuke Imai (Princeton University) Matching

More information

Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton

More information

Inference for Average Treatment Effects

Inference for Average Treatment Effects Inference for Average Treatment Effects Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Average Treatment Effects Stat186/Gov2002 Fall 2018 1 / 15 Social

More information

The Essential Role of Pair Matching in. Cluster-Randomized Experiments. with Application to the Mexican Universal Health Insurance Evaluation

The Essential Role of Pair Matching in. Cluster-Randomized Experiments. with Application to the Mexican Universal Health Insurance Evaluation The Essential Role of Pair Matching in Cluster-Randomized Experiments, with Application to the Mexican Universal Health Insurance Evaluation Kosuke Imai Princeton University Gary King Clayton Nall Harvard

More information

Simple Linear Regression

Simple Linear Regression Simple Linear Regression Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Simple Linear Regression Stat186/Gov2002 Fall 2018 1 / 18 Linear Regression and

More information

Causal Mechanisms Short Course Part II:

Causal Mechanisms Short Course Part II: Causal Mechanisms Short Course Part II: Analyzing Mechanisms with Experimental and Observational Data Teppei Yamamoto Massachusetts Institute of Technology March 24, 2012 Frontiers in the Analysis of Causal

More information

Econometric Causality

Econometric Causality Econometric (2008) International Statistical Review, 76(1):1-27 James J. Heckman Spencer/INET Conference University of Chicago Econometric The econometric approach to causality develops explicit models

More information

Statistical Models for Causal Analysis

Statistical Models for Causal Analysis Statistical Models for Causal Analysis Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 Three Modes of Statistical Inference 1. Descriptive Inference: summarizing and exploring

More information

Statistical Analysis of Causal Mechanisms for Randomized Experiments

Statistical Analysis of Causal Mechanisms for Randomized Experiments Statistical Analysis of Causal Mechanisms for Randomized Experiments Kosuke Imai Department of Politics Princeton University November 22, 2008 Graduate Student Conference on Experiments in Interactive

More information

PSC 504: Differences-in-differeces estimators

PSC 504: Differences-in-differeces estimators PSC 504: Differences-in-differeces estimators Matthew Blackwell 3/22/2013 Basic differences-in-differences model Setup e basic idea behind a differences-in-differences model (shorthand: diff-in-diff, DID,

More information

Stratified Randomized Experiments

Stratified Randomized Experiments Stratified Randomized Experiments Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Stratified Randomized Experiments Stat186/Gov2002 Fall 2018 1 / 13 Blocking

More information

Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Princeton University Talk at the Center for Lifespan Psychology Max Planck

More information

Covariate Balancing Propensity Score for General Treatment Regimes

Covariate Balancing Propensity Score for General Treatment Regimes Covariate Balancing Propensity Score for General Treatment Regimes Kosuke Imai Princeton University October 14, 2014 Talk at the Department of Psychiatry, Columbia University Joint work with Christian

More information

Difference-in-Differences Methods

Difference-in-Differences Methods Difference-in-Differences Methods Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 1 Introduction: A Motivating Example 2 Identification 3 Estimation and Inference 4 Diagnostics

More information

A Mixture Modeling Approach for Empirical Testing of Competing Theories

A Mixture Modeling Approach for Empirical Testing of Competing Theories A Mixture Modeling Approach for Empirical Testing of Competing Theories Kosuke Imai Dustin Tingley Princeton University January 8, 2010 Imai and Tingley (Princeton) Mixture Modeling Gakusyuin 2010 1 /

More information

Distribution-free ROC Analysis Using Binary Regression Techniques

Distribution-free ROC Analysis Using Binary Regression Techniques Distribution-free Analysis Using Binary Techniques Todd A. Alonzo and Margaret S. Pepe As interpreted by: Andrew J. Spieker University of Washington Dept. of Biostatistics Introductory Talk No, not that!

More information

Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments

Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments Kosuke Imai Teppei Yamamoto First Draft: May 17, 2011 This Draft: January 10, 2012 Abstract

More information

Telescope Matching: A Flexible Approach to Estimating Direct Effects

Telescope Matching: A Flexible Approach to Estimating Direct Effects Telescope Matching: A Flexible Approach to Estimating Direct Effects Matthew Blackwell and Anton Strezhnev International Methods Colloquium October 12, 2018 direct effect direct effect effect of treatment

More information

Instrumental Variables

Instrumental Variables Instrumental Variables Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall 2018 1 / 18 Instrumental Variables

More information

Chapter 4: Factor Analysis

Chapter 4: Factor Analysis Chapter 4: Factor Analysis In many studies, we may not be able to measure directly the variables of interest. We can merely collect data on other variables which may be related to the variables of interest.

More information

PSC 504: Dynamic Causal Inference

PSC 504: Dynamic Causal Inference PSC 504: Dynamic Causal Inference Matthew Blackwell 4/8/203 e problem Let s go back to a problem that we faced earlier, which is how to estimate causal effects with treatments that vary over time. We could

More information

Supplemental Appendix to "Alternative Assumptions to Identify LATE in Fuzzy Regression Discontinuity Designs"

Supplemental Appendix to Alternative Assumptions to Identify LATE in Fuzzy Regression Discontinuity Designs Supplemental Appendix to "Alternative Assumptions to Identify LATE in Fuzzy Regression Discontinuity Designs" Yingying Dong University of California Irvine February 2018 Abstract This document provides

More information

Dynamics in Social Networks and Causality

Dynamics in Social Networks and Causality Web Science & Technologies University of Koblenz Landau, Germany Dynamics in Social Networks and Causality JProf. Dr. University Koblenz Landau GESIS Leibniz Institute for the Social Sciences Last Time:

More information

Individualized Treatment Effects with Censored Data via Nonparametric Accelerated Failure Time Models

Individualized Treatment Effects with Censored Data via Nonparametric Accelerated Failure Time Models Individualized Treatment Effects with Censored Data via Nonparametric Accelerated Failure Time Models Nicholas C. Henderson Thomas A. Louis Gary Rosner Ravi Varadhan Johns Hopkins University July 31, 2018

More information

Advanced Quantitative Research Methodology, Lecture Notes: Research Designs for Causal Inference 1

Advanced Quantitative Research Methodology, Lecture Notes: Research Designs for Causal Inference 1 Advanced Quantitative Research Methodology, Lecture Notes: Research Designs for Causal Inference 1 Gary King GaryKing.org April 13, 2014 1 c Copyright 2014 Gary King, All Rights Reserved. Gary King ()

More information

When Should We Use Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

When Should We Use Fixed Effects Regression Models for Causal Inference with Longitudinal Data? When Should We Use Fixed Effects Regression Models for Causal Inference with Longitudinal Data? Kosuke Imai In Song Kim First Draft: July 1, 2014 This Draft: December 19, 2017 Abstract Many researchers

More information

An Introduction to Causal Analysis on Observational Data using Propensity Scores

An Introduction to Causal Analysis on Observational Data using Propensity Scores An Introduction to Causal Analysis on Observational Data using Propensity Scores Margie Rosenberg*, PhD, FSA Brian Hartman**, PhD, ASA Shannon Lane* *University of Wisconsin Madison **University of Connecticut

More information

Applied Statistics Lecture Notes

Applied Statistics Lecture Notes Applied Statistics Lecture Notes Kosuke Imai Department of Politics Princeton University February 2, 2008 Making statistical inferences means to learn about what you do not observe, which is called parameters,

More information

Covariate Selection for Generalizing Experimental Results

Covariate Selection for Generalizing Experimental Results Covariate Selection for Generalizing Experimental Results Naoki Egami Erin Hartman July 19, 2018 Abstract Social and biomedical scientists are often interested in generalizing the average treatment effect

More information

Discussion of Papers on the Extensions of Propensity Score

Discussion of Papers on the Extensions of Propensity Score Discussion of Papers on the Extensions of Propensity Score Kosuke Imai Princeton University August 3, 2010 Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 1 / 11 The Theme and

More information

Causal Inference Lecture Notes: Selection Bias in Observational Studies

Causal Inference Lecture Notes: Selection Bias in Observational Studies Causal Inference Lecture Notes: Selection Bias in Observational Studies Kosuke Imai Department of Politics Princeton University April 7, 2008 So far, we have studied how to analyze randomized experiments.

More information

Potential Outcomes Model (POM)

Potential Outcomes Model (POM) Potential Outcomes Model (POM) Relationship Between Counterfactual States Causality Empirical Strategies in Labor Economics, Angrist Krueger (1999): The most challenging empirical questions in economics

More information

On the Use of Linear Fixed Effects Regression Models for Causal Inference

On the Use of Linear Fixed Effects Regression Models for Causal Inference On the Use of Linear Fixed Effects Regression Models for ausal Inference Kosuke Imai Department of Politics Princeton University Joint work with In Song Kim Atlantic ausal Inference onference Johns Hopkins

More information

What s New in Econometrics. Lecture 1

What s New in Econometrics. Lecture 1 What s New in Econometrics Lecture 1 Estimation of Average Treatment Effects Under Unconfoundedness Guido Imbens NBER Summer Institute, 2007 Outline 1. Introduction 2. Potential Outcomes 3. Estimands and

More information

Sensitivity checks for the local average treatment effect

Sensitivity checks for the local average treatment effect Sensitivity checks for the local average treatment effect Martin Huber March 13, 2014 University of St. Gallen, Dept. of Economics Abstract: The nonparametric identification of the local average treatment

More information

Three-Level Modeling for Factorial Experiments With Experimentally Induced Clustering

Three-Level Modeling for Factorial Experiments With Experimentally Induced Clustering Three-Level Modeling for Factorial Experiments With Experimentally Induced Clustering John J. Dziak The Pennsylvania State University Inbal Nahum-Shani The University of Michigan Copyright 016, Penn State.

More information

Achieving Optimal Covariate Balance Under General Treatment Regimes

Achieving Optimal Covariate Balance Under General Treatment Regimes Achieving Under General Treatment Regimes Marc Ratkovic Princeton University May 24, 2012 Motivation For many questions of interest in the social sciences, experiments are not possible Possible bias in

More information

Supporting Information. Controlling the Airwaves: Incumbency Advantage and. Community Radio in Brazil

Supporting Information. Controlling the Airwaves: Incumbency Advantage and. Community Radio in Brazil Supporting Information Controlling the Airwaves: Incumbency Advantage and Community Radio in Brazil Taylor C. Boas F. Daniel Hidalgo May 7, 2011 1 1 Descriptive Statistics Descriptive statistics for the

More information

Estimating Optimal Dynamic Treatment Regimes from Clustered Data

Estimating Optimal Dynamic Treatment Regimes from Clustered Data Estimating Optimal Dynamic Treatment Regimes from Clustered Data Bibhas Chakraborty Department of Biostatistics, Columbia University bc2425@columbia.edu Society for Clinical Trials Annual Meetings Boston,

More information

Deductive Derivation and Computerization of Semiparametric Efficient Estimation

Deductive Derivation and Computerization of Semiparametric Efficient Estimation Deductive Derivation and Computerization of Semiparametric Efficient Estimation Constantine Frangakis, Tianchen Qian, Zhenke Wu, and Ivan Diaz Department of Biostatistics Johns Hopkins Bloomberg School

More information

Weighting Methods. Harvard University STAT186/GOV2002 CAUSAL INFERENCE. Fall Kosuke Imai

Weighting Methods. Harvard University STAT186/GOV2002 CAUSAL INFERENCE. Fall Kosuke Imai Weighting Methods Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Weighting Methods Stat186/Gov2002 Fall 2018 1 / 13 Motivation Matching methods for improving

More information

GALLUP NEWS SERVICE JUNE WAVE 1

GALLUP NEWS SERVICE JUNE WAVE 1 GALLUP NEWS SERVICE JUNE WAVE 1 -- FINAL TOPLINE -- Timberline: 937008 IS: 392 Princeton Job #: 15-06-006 Jeff Jones, Lydia Saad June 2-7, 2015 Results are based on telephone interviews conducted June

More information

Causal Inference with General Treatment Regimes: Generalizing the Propensity Score

Causal Inference with General Treatment Regimes: Generalizing the Propensity Score Causal Inference with General Treatment Regimes: Generalizing the Propensity Score David van Dyk Department of Statistics, University of California, Irvine vandyk@stat.harvard.edu Joint work with Kosuke

More information

Investigating mediation when counterfactuals are not metaphysical: Does sunlight exposure mediate the effect of eye-glasses on cataracts?

Investigating mediation when counterfactuals are not metaphysical: Does sunlight exposure mediate the effect of eye-glasses on cataracts? Investigating mediation when counterfactuals are not metaphysical: Does sunlight exposure mediate the effect of eye-glasses on cataracts? Brian Egleston Fox Chase Cancer Center Collaborators: Daniel Scharfstein,

More information

Empirical Bayes Moderation of Asymptotically Linear Parameters

Empirical Bayes Moderation of Asymptotically Linear Parameters Empirical Bayes Moderation of Asymptotically Linear Parameters Nima Hejazi Division of Biostatistics University of California, Berkeley stat.berkeley.edu/~nhejazi nimahejazi.org twitter/@nshejazi github/nhejazi

More information

Identification, Inference, and Sensitivity Analysis for Causal Mediation Effects

Identification, Inference, and Sensitivity Analysis for Causal Mediation Effects Identification, Inference, and Sensitivity Analysis for Causal Mediation Effects Kosuke Imai Luke Keele Teppei Yamamoto First Draft: November 4, 2008 This Draft: January 15, 2009 Abstract Causal mediation

More information

Identification Analysis for Randomized Experiments with Noncompliance and Truncation-by-Death

Identification Analysis for Randomized Experiments with Noncompliance and Truncation-by-Death Identification Analysis for Randomized Experiments with Noncompliance and Truncation-by-Death Kosuke Imai First Draft: January 19, 2007 This Draft: August 24, 2007 Abstract Zhang and Rubin 2003) derives

More information

POLI 7050 Spring 2008 February 27, 2008 Unordered Response Models I

POLI 7050 Spring 2008 February 27, 2008 Unordered Response Models I POLI 7050 Spring 2008 February 27, 2008 Unordered Response Models I Introduction For the next couple weeks we ll be talking about unordered, polychotomous dependent variables. Examples include: Voter choice

More information

Model Selection in Bayesian Survival Analysis for a Multi-country Cluster Randomized Trial

Model Selection in Bayesian Survival Analysis for a Multi-country Cluster Randomized Trial Model Selection in Bayesian Survival Analysis for a Multi-country Cluster Randomized Trial Jin Kyung Park International Vaccine Institute Min Woo Chae Seoul National University R. Leon Ochiai International

More information

Supplemental Material for Policy Deliberation and Voter Persuasion: Experimental Evidence from an Election in the Philippines

Supplemental Material for Policy Deliberation and Voter Persuasion: Experimental Evidence from an Election in the Philippines Supplemental Material for Policy Deliberation and Voter Persuasion: Experimental Evidence from an Election in the Philippines March 17, 2017 1 Accounting for Deviations in the Randomization Protocol In

More information

Empirical Likelihood Methods for Two-sample Problems with Data Missing-by-Design

Empirical Likelihood Methods for Two-sample Problems with Data Missing-by-Design 1 / 32 Empirical Likelihood Methods for Two-sample Problems with Data Missing-by-Design Changbao Wu Department of Statistics and Actuarial Science University of Waterloo (Joint work with Min Chen and Mary

More information

Redistricting Simulation through Markov Chain Monte Carlo

Redistricting Simulation through Markov Chain Monte Carlo Redistricting Simulation through Markov Chain Monte Carlo Kosuke Imai Department of Government Department of Statistics Institute for Quantitative Social Science Harvard University SAMSI Quantifying Gerrymandering

More information

Discussion: Can We Get More Out of Experiments?

Discussion: Can We Get More Out of Experiments? Discussion: Can We Get More Out of Experiments? Kosuke Imai Princeton University September 4, 2010 Kosuke Imai (Princeton) Discussion APSA 2010 (Washington D.C.) 1 / 9 Keele, McConnaughy, and White Question:

More information

arxiv: v3 [stat.me] 4 Apr 2018

arxiv: v3 [stat.me] 4 Apr 2018 Comparative Causal Mediation and Relaxing the Assumption of No Mediator-Outcome Confounding: An Application to International Law and Audience Costs arxiv:1612.08699v3 [stat.me] 4 Apr 2018 Kirk Bansak April

More information

Estimating the Dynamic Effects of a Job Training Program with M. Program with Multiple Alternatives

Estimating the Dynamic Effects of a Job Training Program with M. Program with Multiple Alternatives Estimating the Dynamic Effects of a Job Training Program with Multiple Alternatives Kai Liu 1, Antonio Dalla-Zuanna 2 1 University of Cambridge 2 Norwegian School of Economics June 19, 2018 Introduction

More information

The Causal Inference Problem and the Rubin Causal Model

The Causal Inference Problem and the Rubin Causal Model The Causal Inference Problem and the Rubin Causal Model Lecture 2 Rebecca B. Morton NYU Exp Class Lectures R B Morton (NYU) EPS Lecture 2 Exp Class Lectures 1 / 23 Variables in Modeling the E ects of a

More information

BIOS 2083: Linear Models

BIOS 2083: Linear Models BIOS 2083: Linear Models Abdus S Wahed September 2, 2009 Chapter 0 2 Chapter 1 Introduction to linear models 1.1 Linear Models: Definition and Examples Example 1.1.1. Estimating the mean of a N(μ, σ 2

More information

Causal Directed Acyclic Graphs

Causal Directed Acyclic Graphs Causal Directed Acyclic Graphs Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Causal DAGs Stat186/Gov2002 Fall 2018 1 / 15 Elements of DAGs (Pearl. 2000.

More information

Structural Nested Mean Models for Assessing Time-Varying Effect Moderation. Daniel Almirall

Structural Nested Mean Models for Assessing Time-Varying Effect Moderation. Daniel Almirall 1 Structural Nested Mean Models for Assessing Time-Varying Effect Moderation Daniel Almirall Center for Health Services Research, Durham VAMC & Dept. of Biostatistics, Duke University Medical Joint work

More information

Combining multiple observational data sources to estimate causal eects

Combining multiple observational data sources to estimate causal eects Department of Statistics, North Carolina State University Combining multiple observational data sources to estimate causal eects Shu Yang* syang24@ncsuedu Joint work with Peng Ding UC Berkeley May 23,

More information

Eliciting Truthful Answers to Sensitive Survey Questions: New Statistical Methods for List and Endorsement Experiments

Eliciting Truthful Answers to Sensitive Survey Questions: New Statistical Methods for List and Endorsement Experiments Eliciting Truthful Answers to Sensitive Survey Questions: New Statistical Methods for List and Endorsement Experiments Kosuke Imai Princeton University July 5, 2010 Kosuke Imai (Princeton) Sensitive Survey

More information

Sources of Inequality: Additive Decomposition of the Gini Coefficient.

Sources of Inequality: Additive Decomposition of the Gini Coefficient. Sources of Inequality: Additive Decomposition of the Gini Coefficient. Carlos Hurtado Econometrics Seminar Department of Economics University of Illinois at Urbana-Champaign hrtdmrt2@illinois.edu Feb 24th,

More information

A Bayesian Nonparametric Approach to Causal Inference for Semi-competing risks

A Bayesian Nonparametric Approach to Causal Inference for Semi-competing risks A Bayesian Nonparametric Approach to Causal Inference for Semi-competing risks Y. Xu, D. Scharfstein, P. Mueller, M. Daniels Johns Hopkins, Johns Hopkins, UT-Austin, UF JSM 2018, Vancouver 1 What are semi-competing

More information

Gov 2002: 13. Dynamic Causal Inference

Gov 2002: 13. Dynamic Causal Inference Gov 2002: 13. Dynamic Causal Inference Matthew Blackwell December 19, 2015 1 / 33 1. Time-varying treatments 2. Marginal structural models 2 / 33 1/ Time-varying treatments 3 / 33 Time-varying treatments

More information

Gov 2002: 9. Differences in Differences

Gov 2002: 9. Differences in Differences Gov 2002: 9. Differences in Differences Matthew Blackwell October 30, 2015 1 / 40 1. Basic differences-in-differences model 2. Conditional DID 3. Standard error issues 4. Other DID approaches 2 / 40 Where

More information

Extending causal inferences from a randomized trial to a target population

Extending causal inferences from a randomized trial to a target population Extending causal inferences from a randomized trial to a target population Issa Dahabreh Center for Evidence Synthesis in Health, Brown University issa dahabreh@brown.edu January 16, 2019 Issa Dahabreh

More information

Experimental Designs for Identifying Causal Mechanisms

Experimental Designs for Identifying Causal Mechanisms Experimental Designs for Identifying Causal Mechanisms Kosuke Imai Dustin Tingley Teppei Yamamoto Forthcoming in Journal of the Royal Statistical Society, Series A (with discussions) Abstract Experimentation

More information

GROWING APART: THE CHANGING FIRM-SIZE WAGE PREMIUM AND ITS INEQUALITY CONSEQUENCES ONLINE APPENDIX

GROWING APART: THE CHANGING FIRM-SIZE WAGE PREMIUM AND ITS INEQUALITY CONSEQUENCES ONLINE APPENDIX GROWING APART: THE CHANGING FIRM-SIZE WAGE PREMIUM AND ITS INEQUALITY CONSEQUENCES ONLINE APPENDIX The following document is the online appendix for the paper, Growing Apart: The Changing Firm-Size Wage

More information

Causal Inference with Interference and Noncompliance in Two-Stage Randomized Experiments

Causal Inference with Interference and Noncompliance in Two-Stage Randomized Experiments Causal Inference with Interference and Noncompliance in Two-Stage Randomized Experiments Kosuke Imai Zhichao Jiang Anup Malani First Draft: April 9, 08 This Draft: June 5, 08 Abstract In many social science

More information

Treatment Effects. Christopher Taber. September 6, Department of Economics University of Wisconsin-Madison

Treatment Effects. Christopher Taber. September 6, Department of Economics University of Wisconsin-Madison Treatment Effects Christopher Taber Department of Economics University of Wisconsin-Madison September 6, 2017 Notation First a word on notation I like to use i subscripts on random variables to be clear

More information