Discussion of Papers on the Extensions of Propensity Score

Similar documents
Covariate Balancing Propensity Score for General Treatment Regimes

Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies

Statistical Analysis of Causal Mechanisms

Statistical Analysis of Causal Mechanisms

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Identification and Inference in Causal Mediation Analysis

Statistical Analysis of Causal Mechanisms for Randomized Experiments

Causal Inference with General Treatment Regimes: Generalizing the Propensity Score

Use of Matching Methods for Causal Inference in Experimental and Observational Studies. This Talk Draws on the Following Papers:

Causal Inference in Observational Studies with Non-Binary Treatments. David A. van Dyk

An Introduction to Causal Mediation Analysis. Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016

Ratio of Mediator Probability Weighting for Estimating Natural Direct and Indirect Effects

Causal Mechanisms Short Course Part II:

Statistical Analysis of Causal Mechanisms

Comparison of Three Approaches to Causal Mediation Analysis. Donna L. Coffman David P. MacKinnon Yeying Zhu Debashis Ghosh

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data?

Flexible Estimation of Treatment Effect Parameters

Causal Mediation Analysis in R. Quantitative Methodology and Causal Mechanisms

An Introduction to Causal Analysis on Observational Data using Propensity Scores

Causal Inference with a Continuous Treatment and Outcome: Alternative Estimators for Parametric Dose-Response Functions

Use of Matching Methods for Causal Inference in Experimental and Observational Studies. This Talk Draws on the Following Papers:

Gov 2002: 13. Dynamic Causal Inference

Weighting Methods. Harvard University STAT186/GOV2002 CAUSAL INFERENCE. Fall Kosuke Imai

Propensity-Score Based Methods for Causal Inference in Observational Studies with Fixed Non-Binary Treatments

PSC 504: Dynamic Causal Inference

Robust Estimation of Inverse Probability Weights for Marginal Structural Models

Propensity-Score Based Methods for Causal Inference in Observational Studies with Fixed Non-Binary Treatments

Causal mediation analysis: Definition of effects and common identification assumptions

Casual Mediation Analysis

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

Propensity Score Matching

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

Experimental Designs for Identifying Causal Mechanisms

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies

ANALYTIC COMPARISON. Pearl and Rubin CAUSAL FRAMEWORKS

Introduction to Statistical Inference

Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments

High Dimensional Propensity Score Estimation via Covariate Balancing

Primal-dual Covariate Balance and Minimal Double Robustness via Entropy Balancing

Parametric and Non-Parametric Weighting Methods for Mediation Analysis: An Application to the National Evaluation of Welfare-to-Work Strategies

Statistical Analysis of Randomized Experiments with Nonignorable Missing Binary Outcomes

Causal Inference Basics

Discussion: Can We Get More Out of Experiments?

Methods for inferring short- and long-term effects of exposures on outcomes, using longitudinal data on both measures

Help! Statistics! Mediation Analysis

Estimating the Marginal Odds Ratio in Observational Studies

Bayesian Inference for Sequential Treatments under Latent Sequential Ignorability. June 19, 2017

Telescope Matching: A Flexible Approach to Estimating Direct Effects

Identification, Inference, and Sensitivity Analysis for Causal Mediation Effects

Achieving Optimal Covariate Balance Under General Treatment Regimes

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies

A Bayesian Nonparametric Approach to Causal Inference for Semi-competing risks

Ignoring the matching variables in cohort studies - when is it valid, and why?

Revision list for Pearl s THE FOUNDATIONS OF CAUSAL INFERENCE

Propensity Score Methods for Causal Inference

On the Use of Linear Fixed Effects Regression Models for Causal Inference

arxiv: v1 [stat.me] 15 May 2011

Dynamics in Social Networks and Causality

Front-Door Adjustment

Introduction to Causal Inference. Solutions to Quiz 4

Causal Inference Lecture Notes: Selection Bias in Observational Studies

Estimation of Optimal Treatment Regimes Via Machine Learning. Marie Davidian

When Should We Use Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

A Sampling of IMPACT Research:

Gov 2002: 4. Observational Studies and Confounding

A Unification of Mediation and Interaction. A 4-Way Decomposition. Tyler J. VanderWeele

Comparative effectiveness of dynamic treatment regimes

Assess Assumptions and Sensitivity Analysis. Fan Li March 26, 2014

Ratio-of-Mediator-Probability Weighting for Causal Mediation Analysis. in the Presence of Treatment-by-Mediator Interaction

The propensity score with continuous treatments

Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Telescope Matching: A Flexible Approach to Estimating Direct Effects *

Difference-in-Differences Methods

University of California, Berkeley

Advanced Quantitative Research Methodology, Lecture Notes: Research Designs for Causal Inference 1

Statistical Analysis of List Experiments

Marginal versus conditional effects: does it make a difference? Mireille Schnitzer, PhD Université de Montréal

Supplementary Materials for Residual Balancing: A Method of Constructing Weights for Marginal Structural Models

13.1 Causal effects with continuous mediator and. predictors in their equations. The definitions for the direct, total indirect,

The decision theoretic approach to causal inference OR Rethinking the paradigms of causal modelling

Causal Directed Acyclic Graphs

Inference for Average Treatment Effects

Experimental Designs for Identifying Causal Mechanisms

Harvard University. A Note on the Control Function Approach with an Instrumental Variable and a Binary Outcome. Eric Tchetgen Tchetgen

ESTIMATION OF TREATMENT EFFECTS VIA MATCHING

Summary and discussion of The central role of the propensity score in observational studies for causal effects

Combining Difference-in-difference and Matching for Panel Data Analysis

Identification and Estimation of Causal Mediation Effects with Treatment Noncompliance

Propensity score modelling in observational studies using dimension reduction methods

The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters

Marginal Screening and Post-Selection Inference

A Decision Theoretic Approach to Causality

Covariate Balancing Propensity Score for a Continuous Treatment: Application to the Efficacy of Political Advertisements

Combining multiple observational data sources to estimate causal eects

Conceptual overview: Techniques for establishing causal pathways in programs and policies

Harvard University. Harvard University Biostatistics Working Paper Series. Semiparametric Estimation of Models for Natural Direct and Indirect Effects

Nonparametric Identication of a Binary Random Factor in Cross Section Data and

Geoffrey T. Wodtke. University of Toronto. Daniel Almirall. University of Michigan. Population Studies Center Research Report July 2015

Bounding the Probability of Causation in Mediation Analysis

Transcription:

Discussion of Papers on the Extensions of Propensity Score Kosuke Imai Princeton University August 3, 2010 Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 1 / 11 The Theme and Papers of this Panel Theme: Extensions of the Propensity Score Method Wang: Extend propensity score to continuous treatment regimes Huang: Extend propensity score to mismeasured covariates Hong: Extend propensity score to causal mediation analysis Hansen: Provide a theoretical justification for some propensity score matching methods Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 2 / 11

The Wang Paper Extend propensity score to continuous treatment regimes Imai and van Dyk (JASA, 2004) Parametric model for conditional probability of treatment: p ψ (A X) Generalized propensity function: e( X) = p ψ ( X) Suppose θ uniquely represents e( θ ψ (X)) e( X) depends on X only through θ ψ (X) Two main theoretical results: 1 Propensity function as balancing score 2 Ignorable treatment assignment given propensity function Practical implications: Causal effects estimation: 1 Estimate the propensity function p ψ (A X) 2 Subclassify on ˆθ(X) 3 Estimate causal effects within each subclass and aggregate Model diagnostics: check independence between A and X after conditioning on ˆθ(X) Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 3 / 11 The Wang Paper (continued) Main theoretical results: 1 Depending on the outcome model, one can further reduce the dimension of the propensity function 2 If the interactions between treatment and some covariates exist in the outcome model, these covariates need to be adjusted in addition to the propensity function Two main advantages of the propensity score method: 1 Robustness: when the knowledge of outcome model is lacking 2 Diagnostics: when the knowledge of propensity model is lacking What are the practical implications of these two theoretical results in light of these advantages? 1 How do these results help analysts if they do not possess the knowledge of outcome model? 2 Do these results suggest new diagnostics about propensity or outcome model specification? 3 Models with interactions: Don t we know the propensity model is incorrect if covariates aren t balanced? Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 4 / 11

The Huang Paper Use of propensity score with mismeasured covariates Some existing works on mismeasured treatments (e.g., Lewbel; Imai and Yamamoto) but little is done on mismeasured covariates Non-differential measurement error: conditionally independent of potential outcomes given (true) covariates In addition, measurement error is assumed to be independent of treatment status These are reasonable assumptions Nonparametric identification analysis in a simple situation (e.g., binary treatment, covariate, and outcome) may be illuminating Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 5 / 11 The Huang Paper (continued) Theorem 2: true propensity score balances true covariates and measurement error as well as mismeasured covariates Identification via the restriction on propensity model How can we diagnose propensity model specification? Is balancing mismeasured covariates sufficient? Finite mixture model that combines outcome model, propensity model, measurement error model This is nice but how does one conduct diagnostics within this approach? Are there additional advantages for simultaneously modeling propensity score and exposure effect? Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 6 / 11

The Hong Paper Use of propensity score in causal mediation analysis Exploration of causal mechanisms require the estimation of natural direct and indirect effects Under standard designs, the mediator is not randomized Under sequential ignorability, natural direct/indirect effects are nonparametrically identified (Imai et al. Stat. Sci. 2010): {Y i (t, m), M i (t)} T i X i = x, Y i (t, m) M i (t) T i = t, X i = x, Nonlinear structural estimation: Imai et al. (Psy. Meth. in-press) and Pearl (Working paper, 2010) Marginal structural estimation: VanderWeele (Epidemiology, 2009) Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 7 / 11 The Hong Paper (continued) A new approach based on propensity score weighting that can handle post-treatment confounders Treatment-by-mediator interaction effects are also handled but this is not a problem for existing methods so long as post-treatment confounders do not exist The outcome model is nonparametric Robins no-interaction effect assumption in the presence of post-treatment confounder is difficult to justify What are the key identifying assumptions in this paper? And how they should be interpreted by substantive researchers? Y i (t, m) M i (t) T i = t, X i = x, L i (t) = l Y i (t, m) M i (t ) T i = t, X i = x, L i (t) = l L i (t) M i (t ) T i = t, X i = x Need for empirical and simulation examples: what happens if mediator is continuous and/or has skewed distributions? Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 8 / 11

The Hansen Paper Novel analytical results: even if one cannot match exactly on propensity score, in a large sample correct inference can be made so long as covariate balance is good enough Formal definitions of informally used concepts; adjustability, crude balance Formal results showing the conditions under which matching can be justified What are the implications for practice? Conduct balance test and then estimate causal effects? Can balance tests be used to diagnose the misspecification of propensity score model? If so, how? The possibility of multiple testing? If two different matching methods give the same result in terms of balance tests, which one should one choose? Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 9 / 11 The Hansen Paper (continued) A different perspective for the purpose of discussion (Imai et al. JRSSA; Ho et. al. Pol. Anal.) balance tests are often conducted on different matched samples to diagnose the misspecification of propensity model multiple testing, different sample size can be problematic balance should be maximized without limit for better inference the gold standard is the experiment with matched-pair design rather than the experiment with simple randomization matching with pre-determined balance matching with fine balance coarsened exact matching maximum entropy matching matching as nonparametric preprocessing for making parametric inference robust Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 10 / 11

Concluding Remarks A great set of papers extending the propensity score methods to various situations of practical importance Common challenges: 1 Development of diagnostics for propensity model specification 2 Connecting interesting theoretical results to practice Look forward to seeing future versions of the papers Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 11 / 11