PANEL ON MEDIATION AND OTHER MIRACLES OF THE 21 ST CENTURY

Size: px
Start display at page:

Download "PANEL ON MEDIATION AND OTHER MIRACLES OF THE 21 ST CENTURY"

Transcription

1 PANEL ON EDIAION AND OHER IRACLES OF HE 21 S CENUR Judea Pearl UCLA With Kosuke Imai and many others HE QUESION OF EDIAION (direct vs. indirect effects) 1. Why decompose effects? 2. What is the definition of direct and indirect effects? 3. What are the policy implications of direct and indirect effects? 4. When can direct and indirect effect be estimated consistently from experimental and nonexperimental data? 2 WH DECOPOSE EFFECS? 1. o understand how Nature works (Gender) LEGAL IPLICAIONS OF DIREC EFFEC Can data prove an employer guilty of hiring discrimination? (Qualifications) 2. o comply with legal requirements 3. o predict the effects of new type of interventions: Signal re-routing and mechanism deactivating, rather than variable fixing 3 (Hiring) What is the direct effect of on? CDE = E( do(x 1 ),do(m)) E( do(x 0 ),do(m)) (m-dependent) Adjust for? No! No! CDE identification is completely solved (ian et al. 2002) 4 NAURAL INERPREAION OF AVERAGE DIREC EFFECS DEFINIION OF INDIREC EFFECS Robins and Greenland (1992) Pearl (2001) m = f (x, u) y = g (x, m, u) Natural Direct Effect of on : DE(x 0, x 1 ; ) he expected change in, when we change from x 0 to x 1 and, for each u, we keep constant at whatever value it attained before the change. E[ x1 x x 0 0 ] Note the 3-way symbiosis 5 m = f (x, u) y = g (x, m, u) Indirect Effect of on : IE( x0, x1; ) he expected change in when we keep constant, say at x 0, and let change to whatever value it would have attained had changed to x 1. E[ x0 x 1 x 0 ] In linear models, IE = E - DE No controlled indirect effect 6 1

2 POLIC IPLICAIONS OF INDIREC EFFECS What is the indirect effect of on? he effect of Gender on Hiring if sex discrimination is eliminated. GENDER IGNORE f HIRING QUALIFICAION Deactivating a link a new type of intervention 7 HE EDIAION FORULAS IN UNCONFOUNDED ODELS m = f (x, u 1 ) y = g (x, m, u 2 ) u 1 independent of u 2 DE = [E( x 1,m) E( x 0,m)]P(m x 0 ) m IE = [E( x 0,m)[P(m x 1 ) P(m x 0 )] m E = E( x 1 ) E( x 0 ) E DE + IE IE = Fraction of responses explained by mediation (sufficient) E DE = Fraction of responses owed to mediation (necessary) NONPARAERIC IDENIFICAION (Natural mediation is a solved problem) WHEN CAN WE IDENIF EDIAED EFFECS? he nonparametric estimability of natural (and controlled) direct and indirect effects can be determined in polynomial time given any causal graph G with both measured and unmeasured variables. If NDE (or NIE) is estimable, then its estimand can be derived in polynomial time. he algorithm is complete and was extended to any path-specific effects (Shpitser, 2013). (d) (e) (c) (f) W 1 WHEN CAN WE IDENIF EDIAED EFFECS? WHA CAN EDIAION FORULA DO FOR PARAERIC ANALSS? (d) (e) (c) (f) W 1 α W γ 2 β 4 γ 1 β 1 β 3 β 2 ulti-mediators non-linear model y = β 1 m + β 2 x + β 3 xm + β 4 w + u 1 m = γ 1 x + γ 2 w + u 2 w = αx + u 3 What combination of parameters gives the effect mediated by? IE( ) = β 1 (γ 1 + αγ 2 ) What combination of parameters gives the effect owed to? E DE( ) = (β 1 + β 3 )(γ 1 + αγ 2 ) 2

3 IGNORABILI CONDIIONS FOR NDE IDENIFICAION (Sequential Ignorability) (Imai et al (2010)) No confounding W (confounder) here exists a set W of measured covariates such that: SI-1 x xm (,W ) SI-2 ( xm, x ) W WEAKER AND RANSPAREN CONDIIONS FOR NDE IDENIFICAION No confounding here exists a set W such that: A-1 No member of W is a descendant of. A-2 W blocks all back-door paths from to, disregarding the one through. A-3 he W -specific effect of on is identifiable. P(m do(x),w) A-4 he W specific effect of {, } on is identifiable. P(y do(x,m),w) W (confounder) FRIENDL ECHANGE CONCERNING IGNORABILI VS. GRAPHICAL ASSUPIONS Psychological ethods (2014) Imai et al. proved that graphical and ignorability assumptions are identical for randomized treatments. Concensus achieved regarding transparency of graphical assumptions. Semi-concensus regarding other aspects of the graphical vs. ignorability languages. DAGS VS. POENIAL COUCOES AN UNBIASED PERSPECIVE 1. Semantic Equivalence 2. Both are abstractions of Structural Equation odels (SE). x (u) = x (u) y = f (x,z,u) x (u) = All factors that affect when is held constant at =x. FORULAING A PROBLE IN HREE LANGUAGES 1. English: Smoking (), Cancer (), ar (Z), Genotypes (U) U FORULAING A PROBLE IN HREE LANGUAGES 1. English: Smoking (), Cancer (), ar (Z), Genotypes (U) U Z 2. Counterfactuals: Z x (u) = Z yx (u), y (u) = zy (u) = z (u) = (u), z (u) = zx (u), Z x { z, } Not too friendly: Consistent?, complete?, redundant?, plausible?, testable? Z 2. Counterfactuals: Z x (u) = Z yx (u), y (u) = zy (u) = z (u) = (u), z (u) = zx (u), Z x { z, } 3. Structural: U x = f 1 (u,ε 1 ) y = f 3 (z,u,ε 3 ) Z z = f 2 (x,ε 2 ) ε 1 ε 2 ε 3 3

4 HE SRUCURAL-COUNERFACUAL SBIOSIS 1. Express theoretical assumptions in structural language. 2. Express queries in counterfactual language. 3. ranslate (1) into (2) for algebraic analysis, Or (2) into (1) for graphical analysis. 4. Use either graphical or algebraic machinery to answer the query in (2). hank you JON S QUESIONS O PANEL 1. Do you think an experiment has any value without mediational analysis? 2. Is a separate study directly manipulating the mediator useful? How is the second study any different from the first one? 3. Imai's correlated residuals test seems valuable for distinguishing fake from genuine mediation. Is that so? 4. Why isn't it easy to test whether participants who show the largest increases in the posited mediator show the largest changes in the outcome? 1 0 = f m (Z 0 Z 1 ) f m monotonic 5. Why is mediational analysis any worse than any other method of investigation? CHRISIAN S QUESIONS O PANEL 1. Can we go beyond if assumptions, then conclusions? es, testable implications, experimental evidence, other studies. 2. How your framework would use the results of one mediation analysis to inform the setup of a second, new mediation analysis? It is not a question of framework but of information HE EDIAION FALLAC OR HOW RADIIONALISS CONFUSED AN ENIRE CENUR HE EDIAION FALAC OR HOW RADIIONALISS CONFUSED AN ENIRE CENUR L L A A Standard model DE = Whatever changes we see in when we vary and hold constant Holding constant controlling for Statistics has no operator for holding constant Controlling for leads to fallacies in the presence of unobserved confounders A B B Conditioning on creates dependency between and though DE = 0 C Fixing correctly shows DE = 0 No dependence C 4

5 DIVIDE AND CONQUER AKES A DIFFERENCE DIVIDE AND CONQUER AKES A DIFFERENCE deconfounds deconfounds {, } confounds wo separate sets can accomplish what their union can t. wo separate sets can accomplish what their union can t. o identify NDE, we must condition on and separately. SEQUENIAL IGNORABILI IS NO NEEDED Z W = 0 No set can deconfound. easuring Z permits the identification of P ( = m do(x)) through the front-door formula. NDE is identified. 5

OUTLINE CAUSAL INFERENCE: LOGICAL FOUNDATION AND NEW RESULTS. Judea Pearl University of California Los Angeles (www.cs.ucla.

OUTLINE CAUSAL INFERENCE: LOGICAL FOUNDATION AND NEW RESULTS. Judea Pearl University of California Los Angeles (www.cs.ucla. OUTLINE CAUSAL INFERENCE: LOGICAL FOUNDATION AND NEW RESULTS Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/) Statistical vs. Causal vs. Counterfactual inference: syntax and semantics

More information

CAUSAL INFERENCE IN THE EMPIRICAL SCIENCES. Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea)

CAUSAL INFERENCE IN THE EMPIRICAL SCIENCES. Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea) CAUSAL INFERENCE IN THE EMPIRICAL SCIENCES Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea) OUTLINE Inference: Statistical vs. Causal distinctions and mental barriers Formal semantics

More information

OUTLINE THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS. Judea Pearl University of California Los Angeles (www.cs.ucla.

OUTLINE THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS. Judea Pearl University of California Los Angeles (www.cs.ucla. THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea) OUTLINE Modeling: Statistical vs. Causal Causal Models and Identifiability to

More information

CAUSAL INFERENCE IN STATISTICS. A Gentle Introduction. Judea Pearl University of California Los Angeles (www.cs.ucla.

CAUSAL INFERENCE IN STATISTICS. A Gentle Introduction. Judea Pearl University of California Los Angeles (www.cs.ucla. CAUSAL INFERENCE IN STATISTICS A Gentle Introduction Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/jsm12) OUTLINE Inference: Statistical vs. Causal, distinctions, and mental

More information

CAUSES AND COUNTERFACTUALS: CONCEPTS, PRINCIPLES AND TOOLS

CAUSES AND COUNTERFACTUALS: CONCEPTS, PRINCIPLES AND TOOLS CAUSES AND COUNTERFACTUALS: CONCEPTS, PRINCIPLES AND TOOLS Judea Pearl Elias Bareinboim University of California, Los Angeles {judea, eb}@cs.ucla.edu NIPS 2013 Tutorial OUTLINE! Concepts: * Causal inference

More information

CAUSAL INFERENCE AS COMPUTATIONAL LEARNING. Judea Pearl University of California Los Angeles (

CAUSAL INFERENCE AS COMPUTATIONAL LEARNING. Judea Pearl University of California Los Angeles ( CAUSAL INFERENCE AS COMUTATIONAL LEARNING Judea earl University of California Los Angeles www.cs.ucla.edu/~judea OUTLINE Inference: Statistical vs. Causal distinctions and mental barriers Formal semantics

More information

The Do-Calculus Revisited Judea Pearl Keynote Lecture, August 17, 2012 UAI-2012 Conference, Catalina, CA

The Do-Calculus Revisited Judea Pearl Keynote Lecture, August 17, 2012 UAI-2012 Conference, Catalina, CA The Do-Calculus Revisited Judea Pearl Keynote Lecture, August 17, 2012 UAI-2012 Conference, Catalina, CA Abstract The do-calculus was developed in 1995 to facilitate the identification of causal effects

More information

OUTLINE CAUSES AND COUNTERFACTUALS IN THE EMPIRICAL SCIENCES. Judea Pearl University of California Los Angeles (www.cs.ucla.

OUTLINE CAUSES AND COUNTERFACTUALS IN THE EMPIRICAL SCIENCES. Judea Pearl University of California Los Angeles (www.cs.ucla. CAUE AND COUNTERFACTUAL IN THE EMPIRICAL CIENCE Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/jsm9) OUTLINE Inference: tatistical vs. Causal, distinctions, and mental barriers

More information

From Causality, Second edition, Contents

From Causality, Second edition, Contents From Causality, Second edition, 2009. Preface to the First Edition Preface to the Second Edition page xv xix 1 Introduction to Probabilities, Graphs, and Causal Models 1 1.1 Introduction to Probability

More information

THE SCIENCE OF CAUSE AND EFFECT

THE SCIENCE OF CAUSE AND EFFECT HE CIENCE OF CAUE AND EFFEC Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/) OULINE 1. he causal revolution from associations to intervention to counterfactuals 2. he two fundamental

More information

OF CAUSAL INFERENCE THE MATHEMATICS IN STATISTICS. Department of Computer Science. Judea Pearl UCLA

OF CAUSAL INFERENCE THE MATHEMATICS IN STATISTICS. Department of Computer Science. Judea Pearl UCLA THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS Judea earl Department of Computer Science UCLA OUTLINE Statistical vs. Causal Modeling: distinction and mental barriers N-R vs. structural model: strengths

More information

CAUSALITY. Models, Reasoning, and Inference 1 CAMBRIDGE UNIVERSITY PRESS. Judea Pearl. University of California, Los Angeles

CAUSALITY. Models, Reasoning, and Inference 1 CAMBRIDGE UNIVERSITY PRESS. Judea Pearl. University of California, Los Angeles CAUSALITY Models, Reasoning, and Inference Judea Pearl University of California, Los Angeles 1 CAMBRIDGE UNIVERSITY PRESS Preface page xiii 1 Introduction to Probabilities, Graphs, and Causal Models 1

More information

The Mathematics of Causal Inference

The Mathematics of Causal Inference In Joint Statistical Meetings Proceedings, Alexandria, VA: American Statistical Association, 2515-2529, 2013. JSM 2013 - Section on Statistical Education TECHNICAL REPORT R-416 September 2013 The Mathematics

More information

CAUSALITY CORRECTIONS IMPLEMENTED IN 2nd PRINTING

CAUSALITY CORRECTIONS IMPLEMENTED IN 2nd PRINTING 1 CAUSALITY CORRECTIONS IMPLEMENTED IN 2nd PRINTING Updated 9/26/00 page v *insert* TO RUTH centered in middle of page page xv *insert* in second paragraph David Galles after Dechter page 2 *replace* 2000

More information

Causal Directed Acyclic Graphs

Causal Directed Acyclic Graphs Causal Directed Acyclic Graphs Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Causal DAGs Stat186/Gov2002 Fall 2018 1 / 15 Elements of DAGs (Pearl. 2000.

More information

ANALYTIC COMPARISON. Pearl and Rubin CAUSAL FRAMEWORKS

ANALYTIC COMPARISON. Pearl and Rubin CAUSAL FRAMEWORKS ANALYTIC COMPARISON of Pearl and Rubin CAUSAL FRAMEWORKS Content Page Part I. General Considerations Chapter 1. What is the question? 16 Introduction 16 1. Randomization 17 1.1 An Example of Randomization

More information

A Decision Theoretic Approach to Causality

A Decision Theoretic Approach to Causality A Decision Theoretic Approach to Causality Vanessa Didelez School of Mathematics University of Bristol (based on joint work with Philip Dawid) Bordeaux, June 2011 Based on: Dawid & Didelez (2010). Identifying

More information

Taming the challenge of extrapolation: From multiple experiments and observations to valid causal conclusions. Judea Pearl and Elias Bareinboim, UCLA

Taming the challenge of extrapolation: From multiple experiments and observations to valid causal conclusions. Judea Pearl and Elias Bareinboim, UCLA Taming the challenge of extrapolation: From multiple experiments and observations to valid causal conclusions Judea Pearl and Elias Bareinboim, UCLA One distinct feature of big data applications, setting

More information

Causal mediation analysis: Definition of effects and common identification assumptions

Causal mediation analysis: Definition of effects and common identification assumptions Causal mediation analysis: Definition of effects and common identification assumptions Trang Quynh Nguyen Seminar on Statistical Methods for Mental Health Research Johns Hopkins Bloomberg School of Public

More information

Revision list for Pearl s THE FOUNDATIONS OF CAUSAL INFERENCE

Revision list for Pearl s THE FOUNDATIONS OF CAUSAL INFERENCE Revision list for Pearl s THE FOUNDATIONS OF CAUSAL INFERENCE insert p. 90: in graphical terms or plain causal language. The mediation problem of Section 6 illustrates how such symbiosis clarifies the

More information

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Princeton University February 23, 2012 Joint work with L. Keele (Penn State)

More information

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black-Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Princeton University January 23, 2012 Joint work with L. Keele (Penn State)

More information

Introduction to Causal Calculus

Introduction to Causal Calculus Introduction to Causal Calculus Sanna Tyrväinen University of British Columbia August 1, 2017 1 / 1 2 / 1 Bayesian network Bayesian networks are Directed Acyclic Graphs (DAGs) whose nodes represent random

More information

Casual Mediation Analysis

Casual Mediation Analysis Casual Mediation Analysis Tyler J. VanderWeele, Ph.D. Upcoming Seminar: April 21-22, 2017, Philadelphia, Pennsylvania OXFORD UNIVERSITY PRESS Explanation in Causal Inference Methods for Mediation and Interaction

More information

A Linear Microscope for Interventions and Counterfactuals

A Linear Microscope for Interventions and Counterfactuals Forthcoming, Journal of Causal Inference (Causal, Casual, and Curious Section). TECHNICAL REPORT R-459 March 2017 A Linear Microscope for Interventions and Counterfactuals Judea Pearl University of California,

More information

The International Journal of Biostatistics

The International Journal of Biostatistics The International Journal of Biostatistics Volume 7, Issue 1 2011 Article 16 A Complete Graphical Criterion for the Adjustment Formula in Mediation Analysis Ilya Shpitser, Harvard University Tyler J. VanderWeele,

More information

Causality II: How does causal inference fit into public health and what it is the role of statistics?

Causality II: How does causal inference fit into public health and what it is the role of statistics? Causality II: How does causal inference fit into public health and what it is the role of statistics? Statistics for Psychosocial Research II November 13, 2006 1 Outline Potential Outcomes / Counterfactual

More information

Causal Mechanisms Short Course Part II:

Causal Mechanisms Short Course Part II: Causal Mechanisms Short Course Part II: Analyzing Mechanisms with Experimental and Observational Data Teppei Yamamoto Massachusetts Institute of Technology March 24, 2012 Frontiers in the Analysis of Causal

More information

Gov 2002: 4. Observational Studies and Confounding

Gov 2002: 4. Observational Studies and Confounding Gov 2002: 4. Observational Studies and Confounding Matthew Blackwell September 10, 2015 Where are we? Where are we going? Last two weeks: randomized experiments. From here on: observational studies. What

More information

Causality in the Sciences

Causality in the Sciences Causality in the Sciences Phyllis McKay Illari University of Kent Federica Russo Université catholique de Louvain, University of Kent Jon Williamson University of Kent CLARENDON PRESS. OXFORD 2009 1 THE

More information

Front-Door Adjustment

Front-Door Adjustment Front-Door Adjustment Ethan Fosse Princeton University Fall 2016 Ethan Fosse Princeton University Front-Door Adjustment Fall 2016 1 / 38 1 Preliminaries 2 Examples of Mechanisms in Sociology 3 Bias Formulas

More information

The Effects of Interventions

The Effects of Interventions 3 The Effects of Interventions 3.1 Interventions The ultimate aim of many statistical studies is to predict the effects of interventions. When we collect data on factors associated with wildfires in the

More information

Identification and Estimation of Causal Effects from Dependent Data

Identification and Estimation of Causal Effects from Dependent Data Identification and Estimation of Causal Effects from Dependent Data Eli Sherman esherman@jhu.edu with Ilya Shpitser Johns Hopkins Computer Science 12/6/2018 Eli Sherman Identification and Estimation of

More information

An Introduction to Causal Mediation Analysis. Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016

An Introduction to Causal Mediation Analysis. Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016 An Introduction to Causal Mediation Analysis Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016 1 Causality In the applications of statistics, many central questions

More information

Help! Statistics! Mediation Analysis

Help! Statistics! Mediation Analysis Help! Statistics! Lunch time lectures Help! Statistics! Mediation Analysis What? Frequently used statistical methods and questions in a manageable timeframe for all researchers at the UMCG. No knowledge

More information

Ignoring the matching variables in cohort studies - when is it valid, and why?

Ignoring the matching variables in cohort studies - when is it valid, and why? Ignoring the matching variables in cohort studies - when is it valid, and why? Arvid Sjölander Abstract In observational studies of the effect of an exposure on an outcome, the exposure-outcome association

More information

Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies

Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Kosuke Imai Department of Politics Princeton University November 13, 2013 So far, we have essentially assumed

More information

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Princeton University Joint work with Keele (Ohio State), Tingley (Harvard), Yamamoto (Princeton)

More information

Confounding Equivalence in Causal Inference

Confounding Equivalence in Causal Inference Revised and submitted, October 2013. TECHNICAL REPORT R-343w October 2013 Confounding Equivalence in Causal Inference Judea Pearl Cognitive Systems Laboratory Computer Science Department University of

More information

Estimating direct effects in cohort and case-control studies

Estimating direct effects in cohort and case-control studies Estimating direct effects in cohort and case-control studies, Ghent University Direct effects Introduction Motivation The problem of standard approaches Controlled direct effect models In many research

More information

Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments

Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments Kosuke Imai Teppei Yamamoto First Draft: May 17, 2011 This Draft: January 10, 2012 Abstract

More information

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data?

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data? When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data? Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton University Joint

More information

A Linear Microscope for Interventions and Counterfactuals

A Linear Microscope for Interventions and Counterfactuals Journal of Causal Inference, 5(1):March2017. (Errata marked; pages 2 and 6.) J. Causal Infer. 2017; 20170003 TECHNICAL REPORT R-459 March 2017 Causal, Casual and Curious Judea Pearl A Linear Microscope

More information

Single World Intervention Graphs (SWIGs):

Single World Intervention Graphs (SWIGs): Single World Intervention Graphs (SWIGs): Unifying the Counterfactual and Graphical Approaches to Causality Thomas Richardson Department of Statistics University of Washington Joint work with James Robins

More information

Discussion of Papers on the Extensions of Propensity Score

Discussion of Papers on the Extensions of Propensity Score Discussion of Papers on the Extensions of Propensity Score Kosuke Imai Princeton University August 3, 2010 Kosuke Imai (Princeton) Generalized Propensity Score 2010 JSM (Vancouver) 1 / 11 The Theme and

More information

Statistical Models for Causal Analysis

Statistical Models for Causal Analysis Statistical Models for Causal Analysis Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 Three Modes of Statistical Inference 1. Descriptive Inference: summarizing and exploring

More information

Causal and Counterfactual Inference

Causal and Counterfactual Inference Forthcoming section in The Handbook of Rationality, MIT press. TECHNICAL REPORT R-485 October 2018 Causal and Counterfactual Inference Judea Pearl University of California, Los Angeles Computer Science

More information

Identification and Estimation of Causal Mediation Effects with Treatment Noncompliance

Identification and Estimation of Causal Mediation Effects with Treatment Noncompliance Identification and Estimation of Causal Mediation Effects with Treatment Noncompliance Teppei Yamamoto First Draft: May 10, 2013 This Draft: March 26, 2014 Abstract Treatment noncompliance, a common problem

More information

A Unification of Mediation and Interaction. A 4-Way Decomposition. Tyler J. VanderWeele

A Unification of Mediation and Interaction. A 4-Way Decomposition. Tyler J. VanderWeele Original Article A Unification of Mediation and Interaction A 4-Way Decomposition Tyler J. VanderWeele Abstract: The overall effect of an exposure on an outcome, in the presence of a mediator with which

More information

Statistical Analysis of Causal Mechanisms

Statistical Analysis of Causal Mechanisms Statistical Analysis of Causal Mechanisms Kosuke Imai Princeton University April 13, 2009 Kosuke Imai (Princeton) Causal Mechanisms April 13, 2009 1 / 26 Papers and Software Collaborators: Luke Keele,

More information

THE MATHEMATICS OF CAUSAL INFERENCE With reflections on machine learning and the logic of science. Judea Pearl UCLA

THE MATHEMATICS OF CAUSAL INFERENCE With reflections on machine learning and the logic of science. Judea Pearl UCLA THE MATHEMATICS OF CAUSAL INFERENCE With reflections on machine learning and the logic of science Judea Pearl UCLA OUTLINE 1. The causal revolution from statistics to counterfactuals from Babylon to Athens

More information

The Mediation Formula: A guide to the assessment of causal pathways in nonlinear models

The Mediation Formula: A guide to the assessment of causal pathways in nonlinear models To appear in C. Berzuini, P. Dawid, and L. Bernardinelli (Eds.), Causality: Statistical Perspectives and Applications. Forthcoming, 2011. TECHNICAL REPORT R-363 October 2011 The Mediation Formula: A guide

More information

LEARNING CAUSAL EFFECTS: BRIDGING INSTRUMENTS AND BACKDOORS

LEARNING CAUSAL EFFECTS: BRIDGING INSTRUMENTS AND BACKDOORS LEARNING CAUSAL EFFECTS: BRIDGING INSTRUMENTS AND BACKDOORS Ricardo Silva Department of Statistical Science and Centre for Computational Statistics and Machine Learning, UCL Fellow, Alan Turing Institute

More information

Causal Analysis After Haavelmo

Causal Analysis After Haavelmo After Haavelmo University College London UCL Department Seminar September 3, 2013 Economics has forgotten its own past. (Judea Pearl, 2012) Haavemo s Contributions to Causality: Two seminal papers (1943,

More information

Experimental Designs for Identifying Causal Mechanisms

Experimental Designs for Identifying Causal Mechanisms Experimental Designs for Identifying Causal Mechanisms Kosuke Imai Princeton University October 18, 2011 PSMG Meeting Kosuke Imai (Princeton) Causal Mechanisms October 18, 2011 1 / 25 Project Reference

More information

DAGS. f V f V 3 V 1, V 2 f V 2 V 0 f V 1 V 0 f V 0 (V 0, f V. f V m pa m pa m are the parents of V m. Statistical Dag: Example.

DAGS. f V f V 3 V 1, V 2 f V 2 V 0 f V 1 V 0 f V 0 (V 0, f V. f V m pa m pa m are the parents of V m. Statistical Dag: Example. DAGS (V 0, 0,, V 1,,,V M ) V 0 V 1 V 2 V 3 Statistical Dag: f V Example M m 1 f V m pa m pa m are the parents of V m f V f V 3 V 1, V 2 f V 2 V 0 f V 1 V 0 f V 0 15 DAGS (V 0, 0,, V 1,,,V M ) V 0 V 1 V

More information

Comparison of Three Approaches to Causal Mediation Analysis. Donna L. Coffman David P. MacKinnon Yeying Zhu Debashis Ghosh

Comparison of Three Approaches to Causal Mediation Analysis. Donna L. Coffman David P. MacKinnon Yeying Zhu Debashis Ghosh Comparison of Three Approaches to Causal Mediation Analysis Donna L. Coffman David P. MacKinnon Yeying Zhu Debashis Ghosh Introduction Mediation defined using the potential outcomes framework natural effects

More information

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black-Box: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Princeton University September 14, 2010 Institute of Statistical Mathematics Project Reference

More information

The Science and Ethics of Causal Modeling

The Science and Ethics of Causal Modeling you said to post r347 on publications page. should i add: To appear as chapter in A.T. Panter and Sonya Serba (Eds.), Handbook of Ethics in Quantitative Methodology, Taylor & Francis Group, 2009. r347

More information

Graphical Representation of Causal Effects. November 10, 2016

Graphical Representation of Causal Effects. November 10, 2016 Graphical Representation of Causal Effects November 10, 2016 Lord s Paradox: Observed Data Units: Students; Covariates: Sex, September Weight; Potential Outcomes: June Weight under Treatment and Control;

More information

Causal inference in statistics: An overview

Causal inference in statistics: An overview Statistics Surveys Vol. 3 (2009) 96 146 ISSN: 1935-7516 DOI: 10.1214/09-SS057 Causal inference in statistics: An overview Judea Pearl Computer Science Department University of California, Los Angeles,

More information

On Identifying Causal Effects

On Identifying Causal Effects 29 1 Introduction This paper deals with the problem of inferring cause-effect relationships from a combination of data and theoretical assumptions. This problem arises in diverse fields such as artificial

More information

Single World Intervention Graphs (SWIGs): A Unification of the Counterfactual and Graphical Approaches to Causality

Single World Intervention Graphs (SWIGs): A Unification of the Counterfactual and Graphical Approaches to Causality Single World Intervention Graphs (SWIGs): A Unification of the Counterfactual and Graphical Approaches to Causality Thomas S. Richardson University of Washington James M. Robins Harvard University Working

More information

Confounding Equivalence in Causal Inference

Confounding Equivalence in Causal Inference In Proceedings of UAI, 2010. In P. Grunwald and P. Spirtes, editors, Proceedings of UAI, 433--441. AUAI, Corvallis, OR, 2010. TECHNICAL REPORT R-343 July 2010 Confounding Equivalence in Causal Inference

More information

The Causal Mediation Formula A Guide to the Assessment of Pathways and Mechanisms

The Causal Mediation Formula A Guide to the Assessment of Pathways and Mechanisms Online, Prevention Science, 13:426 436, 2012. (DOI: 10.1007/s11121-011-0270-1) TECHNICAL REPORT R-379 October 2011 The Causal Mediation Formula A Guide to the Assessment of Pathways and Mechanisms Judea

More information

On the Identification of Causal Effects

On the Identification of Causal Effects On the Identification of Causal Effects Jin Tian Department of Computer Science 226 Atanasoff Hall Iowa State University Ames, IA 50011 jtian@csiastateedu Judea Pearl Cognitive Systems Laboratory Computer

More information

Bounds on Direct Effects in the Presence of Confounded Intermediate Variables

Bounds on Direct Effects in the Presence of Confounded Intermediate Variables Bounds on Direct Effects in the Presence of Confounded Intermediate Variables Zhihong Cai, 1, Manabu Kuroki, 2 Judea Pearl 3 and Jin Tian 4 1 Department of Biostatistics, Kyoto University Yoshida-Konoe-cho,

More information

Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies

Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Unpacking the Black Box of Causality: Learning about Causal Mechanisms from Experimental and Observational Studies Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton

More information

An Introduction to Causal Inference

An Introduction to Causal Inference To be published in The International Journal of Biostatistics, 2009. TECHNICAL REPORT R-354 February 2010 An Introduction to Causal Inference Judea Pearl University of California, Los Angeles Computer

More information

Experimental Designs for Identifying Causal Mechanisms

Experimental Designs for Identifying Causal Mechanisms Experimental Designs for Identifying Causal Mechanisms Kosuke Imai Dustin Tingley Teppei Yamamoto Forthcoming in Journal of the Royal Statistical Society, Series A (with discussions) Abstract Experimentation

More information

Causal Analysis After Haavelmo James Heckman Rodrigo Pinto

Causal Analysis After Haavelmo James Heckman Rodrigo Pinto James Heckman Rodrigo Pinto The University of Chicago September 9, 2013 James Heckman is the Henry Schultz Distinguished Service Professor of Economics and Public Policy at the University of Chicago; Professor

More information

The Causal Mediation Formula A Guide to the Assessment of Pathways and Mechanisms

The Causal Mediation Formula A Guide to the Assessment of Pathways and Mechanisms Forthcoming, Preventive Science. TECHNICAL REPORT R-379 April 2011 The Causal Mediation Formula A Guide to the Assessment of Pathways and Mechanisms Judea Pearl University of California, Los Angeles Computer

More information

arxiv: v2 [math.st] 4 Mar 2013

arxiv: v2 [math.st] 4 Mar 2013 Running head:: LONGITUDINAL MEDIATION ANALYSIS 1 arxiv:1205.0241v2 [math.st] 4 Mar 2013 Counterfactual Graphical Models for Longitudinal Mediation Analysis with Unobserved Confounding Ilya Shpitser School

More information

Statistical Methods for Causal Mediation Analysis

Statistical Methods for Causal Mediation Analysis Statistical Methods for Causal Mediation Analysis The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters. Citation Accessed Citable

More information

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? Kosuke Imai Princeton University Asian Political Methodology Conference University of Sydney Joint

More information

Causal Mediation Analysis in R. Quantitative Methodology and Causal Mechanisms

Causal Mediation Analysis in R. Quantitative Methodology and Causal Mechanisms Causal Mediation Analysis in R Kosuke Imai Princeton University June 18, 2009 Joint work with Luke Keele (Ohio State) Dustin Tingley and Teppei Yamamoto (Princeton) Kosuke Imai (Princeton) Causal Mediation

More information

Single World Intervention Graphs (SWIGs):

Single World Intervention Graphs (SWIGs): Single World Intervention Graphs (SWIGs): Unifying the Counterfactual and Graphical Approaches to Causality Thomas Richardson Department of Statistics University of Washington Joint work with James Robins

More information

A Distinction between Causal Effects in Structural and Rubin Causal Models

A Distinction between Causal Effects in Structural and Rubin Causal Models A istinction between Causal Effects in Structural and Rubin Causal Models ionissi Aliprantis April 28, 2017 Abstract: Unspecified mediators play different roles in the outcome equations of Structural Causal

More information

arxiv: v1 [math.st] 28 Nov 2017

arxiv: v1 [math.st] 28 Nov 2017 Sensitivity analysis for unobserved confounding of direct and indirect effects using uncertainty intervals Anita Lindmark a, Xavier de Luna a and Marie Eriksson a arxiv:1711.10265v1 [math.st] 28 Nov 2017

More information

Identification and Overidentification of Linear Structural Equation Models

Identification and Overidentification of Linear Structural Equation Models In D. D. Lee and M. Sugiyama and U. V. Luxburg and I. Guyon and R. Garnett (Eds.), Advances in Neural Information Processing Systems 29, pre-preceedings 2016. TECHNICAL REPORT R-444 October 2016 Identification

More information

Identification of Conditional Interventional Distributions

Identification of Conditional Interventional Distributions Identification of Conditional Interventional Distributions Ilya Shpitser and Judea Pearl Cognitive Systems Laboratory Department of Computer Science University of California, Los Angeles Los Angeles, CA.

More information

Online Appendix to Yes, But What s the Mechanism? (Don t Expect an Easy Answer) John G. Bullock, Donald P. Green, and Shang E. Ha

Online Appendix to Yes, But What s the Mechanism? (Don t Expect an Easy Answer) John G. Bullock, Donald P. Green, and Shang E. Ha Online Appendix to Yes, But What s the Mechanism? (Don t Expect an Easy Answer) John G. Bullock, Donald P. Green, and Shang E. Ha January 18, 2010 A2 This appendix has six parts: 1. Proof that ab = c d

More information

5.3 Graphs and Identifiability

5.3 Graphs and Identifiability 218CHAPTER 5. CAUSALIT AND STRUCTURAL MODELS IN SOCIAL SCIENCE AND ECONOMICS.83 AFFECT.65.23 BEHAVIOR COGNITION Figure 5.5: Untestable model displaying quantitative causal information derived. method elucidates

More information

Identification and Inference in Causal Mediation Analysis

Identification and Inference in Causal Mediation Analysis Identification and Inference in Causal Mediation Analysis Kosuke Imai Luke Keele Teppei Yamamoto Princeton University Ohio State University November 12, 2008 Kosuke Imai (Princeton) Causal Mediation Analysis

More information

Path analysis for discrete variables: The role of education in social mobility

Path analysis for discrete variables: The role of education in social mobility Path analysis for discrete variables: The role of education in social mobility Jouni Kuha 1 John Goldthorpe 2 1 London School of Economics and Political Science 2 Nuffield College, Oxford ESRC Research

More information

An Introduction to Causal Analysis on Observational Data using Propensity Scores

An Introduction to Causal Analysis on Observational Data using Propensity Scores An Introduction to Causal Analysis on Observational Data using Propensity Scores Margie Rosenberg*, PhD, FSA Brian Hartman**, PhD, ASA Shannon Lane* *University of Wisconsin Madison **University of Connecticut

More information

Stability of causal inference: Open problems

Stability of causal inference: Open problems Stability of causal inference: Open problems Leonard J. Schulman & Piyush Srivastava California Institute of Technology UAI 2016 Workshop on Causality Interventions without experiments [Pearl, 1995] Genetic

More information

The Foundations of Causal Inference

The Foundations of Causal Inference The Foundations of Causal Inference Judea Pearl University of California, Los Angeles Computer Science Department Los Angeles, CA, 90095-1596, USA judea@cs.ucla.edu May 12, 2010 Abstract This paper reviews

More information

ASA Section on Health Policy Statistics

ASA Section on Health Policy Statistics Direct and Indirect Eects Judea Pearl UCLA, Computer Science Department, Cognitive Systems Laboratory Abstract The direct eect of one event on another can be dened and measured by holding constant all

More information

ESTIMATING AVERAGE TREATMENT EFFECTS: REGRESSION DISCONTINUITY DESIGNS Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics

ESTIMATING AVERAGE TREATMENT EFFECTS: REGRESSION DISCONTINUITY DESIGNS Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics ESTIMATING AVERAGE TREATMENT EFFECTS: REGRESSION DISCONTINUITY DESIGNS Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics July 2009 1. Introduction 2. The Sharp RD Design 3.

More information

arxiv: v1 [stat.me] 18 Jan 2018

arxiv: v1 [stat.me] 18 Jan 2018 Graphical models for mediation analysis Johan Steen Department of Intensive Care edicine, Ghent University Hospital arxiv:1801.06069v1 [stat.e] 18 Jan 2018 Stijn Vansteelandt Department of Applied athematics,

More information

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data?

When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Longitudinal Data? Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton University

More information

Causal Models with Hidden Variables

Causal Models with Hidden Variables Causal Models with Hidden Variables Robin J. Evans www.stats.ox.ac.uk/ evans Department of Statistics, University of Oxford Quantum Networks, Oxford August 2017 1 / 44 Correlation does not imply causation

More information

Estimating complex causal effects from incomplete observational data

Estimating complex causal effects from incomplete observational data Estimating complex causal effects from incomplete observational data arxiv:1403.1124v2 [stat.me] 2 Jul 2014 Abstract Juha Karvanen Department of Mathematics and Statistics, University of Jyväskylä, Jyväskylä,

More information

Difference-in-Differences Methods

Difference-in-Differences Methods Difference-in-Differences Methods Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 1 Introduction: A Motivating Example 2 Identification 3 Estimation and Inference 4 Diagnostics

More information

19 Effect Heterogeneity and Bias in Main-Effects-Only Regression Models

19 Effect Heterogeneity and Bias in Main-Effects-Only Regression Models 19 Effect Heterogeneity and Bias in Main-Effects-Only Regression Models FELIX ELWERT AND CHRISTOPHER WINSHIP 1 Introduction The overwhelming majority of OLS regression models estimated in the social sciences,

More information

Structural Nested Mean Models for Assessing Time-Varying Effect Moderation. Daniel Almirall

Structural Nested Mean Models for Assessing Time-Varying Effect Moderation. Daniel Almirall 1 Structural Nested Mean Models for Assessing Time-Varying Effect Moderation Daniel Almirall Center for Health Services Research, Durham VAMC & Dept. of Biostatistics, Duke University Medical Joint work

More information

Identifying Linear Causal Effects

Identifying Linear Causal Effects Identifying Linear Causal Effects Jin Tian Department of Computer Science Iowa State University Ames, IA 50011 jtian@cs.iastate.edu Abstract This paper concerns the assessment of linear cause-effect relationships

More information

Statistical Analysis of Causal Mechanisms

Statistical Analysis of Causal Mechanisms Statistical Analysis of Causal Mechanisms Kosuke Imai Luke Keele Dustin Tingley Teppei Yamamoto Princeton University Ohio State University July 25, 2009 Summer Political Methodology Conference Imai, Keele,

More information

Guanglei Hong. University of Chicago. Presentation at the 2012 Atlantic Causal Inference Conference

Guanglei Hong. University of Chicago. Presentation at the 2012 Atlantic Causal Inference Conference Guanglei Hong University of Chicago Presentation at the 2012 Atlantic Causal Inference Conference 2 Philosophical Question: To be or not to be if treated ; or if untreated Statistics appreciates uncertainties

More information