OUTLINE CAUSAL INFERENCE: LOGICAL FOUNDATION AND NEW RESULTS. Judea Pearl University of California Los Angeles (
|
|
- Rosaline Cooper
- 6 years ago
- Views:
Transcription
1 OUTLINE CAUSAL INFERENCE: LOGICAL FOUNDATION AND NEW RESULTS Judea Pearl University of California Los Angeles ( Statistical vs. Causal vs. Counterfactual inference: syntax and semantics The logical equivalence of Structural Equation Models (SEM) and potential outcomes (Neyman-Rubin) Where do they differ? 1. Define, 2. Assume, 3. identif 4. Estimate, 5. Test Which covariates should be measured? Causation without manipulation The Mediation Formula and its ramifications Measurement bias and effect restoration LEVEL HIERARCH OF CAUSAL MODELS TRADITIONAL STATISTICAL INFERENCE PARADIGM 1. Probabilistic Knowledge y x) Bayesian networks, graphical models P Q(P) (Aspects of P) 2. Interventional Knowledge y do(x)) Causal Bayesian Networks (CBN) (Agnostic graphs, manipulation graphs) Inference 3. Counterfactual Knowledge x = x =y ) Structural equation models, physics, functional graphs, Treatment assignment mechanism 3 e.g., Infer whether customers who bought product A would also buy product B. Q = B A) 4 FROM STATISTICAL TO CAUSAL ANALSIS: 1. THE DIFFERENCES Probability and statistics deal with static relations P change Inference P Q(P ) (Aspects of P ) What happens when P changes? e.g., Infer whether customers who bought product A would still buy A if we were to double the price. 5 FROM STATISTICAL TO CAUSAL ANALSIS: 1. THE DIFFERENCES What remains invariant when P changes sa to satisfy P (price=2)=1 P change P Inference Note: P (v) P (v price = 2) P does not tell us how it ought to change Causal knowledge: what remains invariant Q(P ) (Aspects of P ) 6 1
2 FROM STATISTICAL TO CAUSAL ANALSIS: 1. THE DIFFERENCES (CONT) 1. Causal and statistical concepts do not mix. CAUSAL STATISTICAL Spurious correlation Regression Randomiation / Intervention Association / Independence Confounding / Effect Controlling for / Conditioning Instrumental variable Odd and risk ratios Exogeneity / Ignorability Collapsibility / Granger causality Mediation Propensity score FROM STATISTICAL TO CAUSAL ANALSIS: 2. MENTAL BARRIERS 1. Causal and statistical concepts do not mix. CAUSAL STATISTICAL Spurious correlation Regression Randomiation / Intervention Association / Independence Confounding / Effect Controlling for / Conditioning Instrumental variable Odd and risk ratios Exogeneity / Ignorability Collapsibility / Granger causality Mediation Propensity score 2. No causes in no causes out (Cartwright, 1989) statistical assumptions + data causal assumptions causal conclusions 3. Causal assumptions cannot be expressed in the mathematical language of standard statistics. 4. } 7 8 FROM STATISTICAL TO CAUSAL ANALSIS: 2. MENTAL BARRIERS BAESIAN NETWORKS 1. Causal and statistical concepts do not mix. CAUSAL STATISTICAL Spurious correlation Regression Randomiation / Intervention Association / Independence Confounding / Effect Controlling for / Conditioning Instrumental variable Odd and risk ratios Exogeneity / Ignorability Collapsibility / Granger causality Mediation Propensity score 2. No causes in no causes out (Cartwright, 1989) statistical assumptions + data causal assumptions causal conclusions 3. Causal assumptions cannot be expressed in the mathematical language of standard statistics. 4. Non-standard mathematics: a) Structural equation models (Wright, 1920; Simon, 1960) b) Counterfactuals (Neyman-Rubin ( x ), Lewis (x )) } 9 Definition P is Markov relative to G iff: V i NDi PAi Algebraic Representation P ( vi,..., vn) = vi pai ) i Graphical Representation PA i ( ) G ( ) P ( d - separation conditional independence) V i G 10 CAUSAL BAESIAN NETWORK (CBN) (Agnostic graphs, manipulation graphs) Definition Let P x (v) stand for v do(=x)), and x arbitrary G is a CBN relative to P x * iff: i. P x (v) is Markov relative to G; ii. P x (v i )=1 for all V i if v i agrees with =x. iii. P x( vi pai ) = vi pai ) for all V i whenever pa i agrees with = i.e., each v i pa i ) remains INVARIANT to interventions not involving V i. Algebraic representation Px ( v) = vi pai ) for all v consistent with x. { i V i } (Truncated product, G-computation, manipulation theorem) Graphical representation Surgery: remove incoming arrows to THE STRUCTURAL MODEL PARADIGM Inference Generating Model M Q(M) (Aspects of M) M Invariant strategy (mechanism, recipe, law, protocol) by which Nature assigns values to variables in the analysis. Think Nature, not experiment! 2
3 STRUCTURAL CAUSAL MODELS Definition: A structural causal model is a 4-tuple V,U, F,, where V = {V 1,...,V n } are endogeneas variables U ={U 1,...,U m } are background variables F = {f 1,..., f n } are functions determining V, v i = f i (v, e.g., y = α + βx + u is a distribution over U and F induce a distribution v) over observable variables CAUSAL MODELS AND COUNTERFACTUALS Definition: The sentence: would be y (in unit, had been denoted x ( = means: The solution for in a mutilated model M x, (i.e., the equations for replaced by = x) with input U=u, is equal to y. ( U M ( = x U M x ( CAUSAL MODELS AND COUNTERFACTUALS Definition: The sentence: would be y (in unit, had been denoted x ( = means: The solution for in a mutilated model M x, (i.e., the equations for replaced by = x) with input U=u, is equal to y. The Fundamental Equation of Counterfactuals: x ( = M ( x 15 CAUSAL MODELS AND COUNTERFACTUALS Definition: The sentence: would be y (in situation, had been denoted x ( = means: The solution for in a mutilated model M x, (i.e., the equations for replaced by = x) with input U=u, is equal to y. probabilities of counterfactuals: x = w = = u: x ( = w( = In particular: y do(x) ) Δ = x = = u: x ( = y PN( x' = y' = u u: x ' ( = y' 16 TWO PARADIGMS FOR CAUSAL INFERENCE Observed:,,,...) Conclusions needed: x =, y =x =... ARE THE TWO PARADIGMS EQUIVALENT? es (Galles and Pearl, 1998; Halpern 1998) How do we connect observables,,,, to counterfactuals x,, y,? N-R model Counterfactuals are primitives, new variables Super-distribution P *(,,...,,...),, constrain... Structural model Counterfactuals are derived quantities Subscripts modify the model and distribution x = = PM ( = x 17 In the N-R paradigm, x is defined by consistency: = x1 + ( 1 x) 0 In SCM, consistency is a theorem. Moreover, a theorem in one approach is a theorem in the other. 18 3
4 THE FIVE NECESSAR STEPS OF CAUSAL ANALSIS THE FIVE NECESSAR STEPS FOR EFFECT ESTIMATION Define: Express the target quantity Q as a function Q(M) that can be computed from any model M. Assume: Formulate causal assumptions A using some formal language. Identify: Determine if Q is identifiable given A. Estimate: Estimate Q if it is identifiable; approximate it, if it is not. Test: Test the testable implications of A (if an. 19 Define: Express the target quantity Q as a function Q(M) that can be computed from any model M. ATE Δ = E( do( x1)) do( x0)) Assume: Formulate causal assumptions A using some formal language. Identify: Determine if Q is identifiable given A. Estimate: Estimate Q if it is identifiable; approximate it, if it is not. Test: Test the testable implications of A (if an. 20 FORMULATING ASSUMPTIONS THREE LANGUAGES IDENTIFING CAUSAL EFFECTS IN POTENTIAL-OUTCOME FRAMEWORK 1. English: Smoking (), Cancer (), Tar (), Genotypes (U) 2. Counterfactuals: Not too friendly: x consistent? complete? redundant? arguable? 3. Structural: x( = yx(, y( = y( = ( = (, ( = x(, {, } 21 Define: Assume: Identify: Estimate: Express the target quantity Q as a counterfactual formula, e.g., E((1) (0)) Formulate causal assumptions using the distribution: P * =,, (1), (0)) Determine if Q is identifiable using P* and =x (1) + (1 x) (0). Estimate Q if it is identifiable; approximate it, if it is not. 22 GRAPHICAL COUNTERFACTUALS SMBIOSIS Every causal graph expresses counterfactuals assumptions, e.g., 1. Missing arrows x, ( = x( 2. Missing arcs x y consistent, and readable from the graph. IDENTIFICATION IN SCM Find the effect of on, y do(x)), given the causal assumptions shown in G, where 1,..., k are auxiliary variables G 2 5 Express assumption in graphs Derive estimands by graphical or algebraic methods 23 6 Can y do(x)) be estimated if only a subset,, can be measured? 24 4
5 ELIMINATING CONFOUNDING BIAS THE BACK-DOOR CRITERION y do(x)) is estimable if there is a set of variables such that d-separates from in G x. 1 G 2 1 G x 2 EFFECT OF WARM-UP ON INJUR (After Shrier & Platt, 2008) Watch out! Front??? Door Moreover, y do( x)) = y = ( adjusting for ) Ignorability x 25 No, no! Warm-up Exercises () Injury () 26 CONFOUNDING EQUIVALENCE EQUALL VALUABLE CONFOUNDING EQUIVALENCE EQUALL VALUABLE L W 1 W 4 T W 2 W 3 V 1 V 2? T 27 Definition: T and are c-equivalent if P ( y t) t) = y y t Definition (Markov boundar: Markov boundary S m of S (relative to ) is the minimal subset of S that d-separates from all other members of S. Theorem (Pearl and Pa, 2009) and T are c-equivalent iff 1. m =T m, or 2. and T are admissible (i.e., satisfy the back-door condition) 28 CONFOUNDING EQUIVALENCE EQUALL VALUABLE CONFOUNDING EQUIVALENCE EQUALL VALUABLE L W 1 W 4 T W 1 W 4 T W 2 W 3 T W 2 W 3 T V 1 V 2 V 1 V
6 CONFOUNDING EQUIVALENCE EQUALL VALUABLE BIAS AMPLIFICATION B INSTRUMENTAL VARIABLES T W 2 W 1 W 1 W 4 W 1 {W 1, W 2 } W 2 W 3 T U V 1 V 2 31 Adding W 2 to Propensity Score increases bias (if such exists) (Wooldridge, 2009) In linear systems always In non-linear systems almost always (Pearl, 2010) Outcome predictors are safer than treatment predictors 32 EFFECT DECOMPOSITION (direct vs. indirect effects) WH DECOMPOSE EFFECTS? 1. Why decompose effects? 2. What is the definition of direct and indirect effects? 3. What are the policy implications of direct and indirect effects? 4. When can direct and indirect effect be estimated consistently from experimental and nonexperimental data? To understand how Nature works 2. To comply with legal requirements 3. To predict the effects of new type of interventions: Signal routing, rather than variable fixing 34 (Gender) LEGAL IMPLICATIONS OF DIRECT EFFECT Can data prove an employer guilty of hiring discrimination? (Hiring) What is the direct effect of on? (Qualifications) E ( do( x1 ), do( ) do( x0), do( ) (averaged over Adjust for? No! No! 35 NATURAL INTERPRETATION OF AVERAGE DIRECT EFFECTS Robins and Greenland (1992) Pure = f ( y = g (, Natural Direct Effect of on : DE( x0, x1; ) The expected change in, when we change from x 0 to x 1 and, for each u, we keep constant at whatever value it attained before the change. E[ x ] 1 x x 0 0 In linear models, DE = Controlled Direct Effect = β ( x1 x0 ) 36 6
7 DEFINITION OF INDIRECT EFFECTS POLIC IMPLICATIONS OF INDIRECT EFFECTS = f ( y = g (, Indirect Effect of on : IE( x0, x1; ) The expected change in when we keep constant, say at x 0, and let change to whatever value it would have attained had changed to x 1. E[ x ] 0 x1 x0 In linear models, IE = TE - DE 37 What is the indirect effect of on? The effect of Gender on Hiring if sex discrimination is eliminated. GENDER IGNORE f HIRING QUALIFICATION Deactivating a link a new type of intervention 38 MEDIATION FORMULAS 1. The natural direct and indirect effects are identifiable in Markovian models (no confounding), 2. And are given by: DE = [ E( do( x1, ) do( x0, )] do( x0)). IE = E( do( x0, )[ do( x1 )) do( x0))] 3. Applicable to linear and non-linear models, continuous and discrete variables, regardless of distributional form. 39 MEDIATION FORMULAS IN UNCONFOUNDED MODELS DE = [ E( x1, x0, ] x0) IE = [ E( x0, [ x1) x0)] TE = E( x1) x0) TE DE = Fraction of responses owed to mediation IE = Fraction of responses explained by mediation 40 n n n n n n n n COMPUTING THE MEDIATION FORMULA E( =g x n2 = g00 n1 + n2 n4 = g01 n3 + n4 n6 = g10 n5 + n6 n8 = g11 n7 + n8 E( x)=h x n3 + n4 = h0 n1 + n2 + n3 + n4 n7 + n8 = h1 n5 + n6 + n7 + n8 DE = ( g10 g00)(1 h0 ) + ( g11 g01) h0 IE = ( h1 h0 )( g01 g00) 41 RAMIFICATION OF THE MEDIATION FORMULA DE should be averaged over mediator levels, IE should NOT be averaged over exposure levels. TE-DE need not equal IE TE-DE = proportion for whom mediation is necessary IE = proportion for whom mediation is sufficient TE-DE informs interventions on indirect pathways IE informs intervention on direct pathways. 42 7
8 MEASUREMENT BIAS AND EFFECT RESTORATION Unobserved w y do(x)) is identifiable from measurement of W, if w is given (Selen, 1986; Greenland W & Lash, 2008) w = w (local independence) w) =, w) = w = w P ( = I(, w) w) w 43 W EFFECT RESTORATION IN BINAR MODELS 1 To cell ( = 0) 1 undefined undefined w 1 W = 0 = 1) = ε δ To cell 1 ε ( = 1) 1 W = 1 = 0) = δ w 1 1 ( ) ( ( )) 1 ) P x P y do x 1 ( 1 ) δ P x w w1 w1 ) w + 0 ) 1 1 x) 1 0 ) ε x w w0 w0 ) Weight distribution from cell (W = 1) 44 EFFECT RESTORATION IN LINEAR MODELS c 1 c c 2 3 W c 0 (a) c 1 c c c W V c 0 cov( ) cov( V ) cov( W ) cov( WV ) c0 = cov( V ) var( ) cov( W ) cov( WV ) (b) σ xy σ xwσ yw / k c k c 2 0 = = 3 σ σ xxσ 2 xw / k CONCLUSIONS I He TOLD is wise OU who CAUSALIT bases causal IS inference SIMPLE on an explicit causal structure that is Formal basis for causal and counterfactual defensible on scientific grounds. inference (complete) Unification of the graphical, potential-outcome and structural equation approaches Friendly and formal solutions to From Charlie Poole (Aristotle B.C.) century-old problems and confusions. Correlated proxies (Cai & Kuroki, 2008) QUESTIONS??? They will be answered 47 8
OUTLINE THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS. Judea Pearl University of California Los Angeles (www.cs.ucla.
THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea) OUTLINE Modeling: Statistical vs. Causal Causal Models and Identifiability to
More informationCAUSAL INFERENCE IN THE EMPIRICAL SCIENCES. Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea)
CAUSAL INFERENCE IN THE EMPIRICAL SCIENCES Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea) OUTLINE Inference: Statistical vs. Causal distinctions and mental barriers Formal semantics
More informationCAUSAL INFERENCE IN STATISTICS. A Gentle Introduction. Judea Pearl University of California Los Angeles (www.cs.ucla.
CAUSAL INFERENCE IN STATISTICS A Gentle Introduction Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/jsm12) OUTLINE Inference: Statistical vs. Causal, distinctions, and mental
More informationOUTLINE CAUSES AND COUNTERFACTUALS IN THE EMPIRICAL SCIENCES. Judea Pearl University of California Los Angeles (www.cs.ucla.
CAUE AND COUNTERFACTUAL IN THE EMPIRICAL CIENCE Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/jsm9) OUTLINE Inference: tatistical vs. Causal, distinctions, and mental barriers
More informationOF CAUSAL INFERENCE THE MATHEMATICS IN STATISTICS. Department of Computer Science. Judea Pearl UCLA
THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS Judea earl Department of Computer Science UCLA OUTLINE Statistical vs. Causal Modeling: distinction and mental barriers N-R vs. structural model: strengths
More informationCAUSAL INFERENCE AS COMPUTATIONAL LEARNING. Judea Pearl University of California Los Angeles (
CAUSAL INFERENCE AS COMUTATIONAL LEARNING Judea earl University of California Los Angeles www.cs.ucla.edu/~judea OUTLINE Inference: Statistical vs. Causal distinctions and mental barriers Formal semantics
More informationPANEL ON MEDIATION AND OTHER MIRACLES OF THE 21 ST CENTURY
PANEL ON EDIAION AND OHER IRACLES OF HE 21 S CENUR Judea Pearl UCLA With Kosuke Imai and many others HE QUESION OF EDIAION (direct vs. indirect effects) 1. Why decompose effects? 2. What is the definition
More informationCAUSES AND COUNTERFACTUALS: CONCEPTS, PRINCIPLES AND TOOLS
CAUSES AND COUNTERFACTUALS: CONCEPTS, PRINCIPLES AND TOOLS Judea Pearl Elias Bareinboim University of California, Los Angeles {judea, eb}@cs.ucla.edu NIPS 2013 Tutorial OUTLINE! Concepts: * Causal inference
More informationFrom Causality, Second edition, Contents
From Causality, Second edition, 2009. Preface to the First Edition Preface to the Second Edition page xv xix 1 Introduction to Probabilities, Graphs, and Causal Models 1 1.1 Introduction to Probability
More informationCAUSALITY. Models, Reasoning, and Inference 1 CAMBRIDGE UNIVERSITY PRESS. Judea Pearl. University of California, Los Angeles
CAUSALITY Models, Reasoning, and Inference Judea Pearl University of California, Los Angeles 1 CAMBRIDGE UNIVERSITY PRESS Preface page xiii 1 Introduction to Probabilities, Graphs, and Causal Models 1
More informationANALYTIC COMPARISON. Pearl and Rubin CAUSAL FRAMEWORKS
ANALYTIC COMPARISON of Pearl and Rubin CAUSAL FRAMEWORKS Content Page Part I. General Considerations Chapter 1. What is the question? 16 Introduction 16 1. Randomization 17 1.1 An Example of Randomization
More informationTHE MATHEMATICS OF CAUSAL INFERENCE With reflections on machine learning and the logic of science. Judea Pearl UCLA
THE MATHEMATICS OF CAUSAL INFERENCE With reflections on machine learning and the logic of science Judea Pearl UCLA OUTLINE 1. The causal revolution from statistics to counterfactuals from Babylon to Athens
More informationCAUSALITY CORRECTIONS IMPLEMENTED IN 2nd PRINTING
1 CAUSALITY CORRECTIONS IMPLEMENTED IN 2nd PRINTING Updated 9/26/00 page v *insert* TO RUTH centered in middle of page page xv *insert* in second paragraph David Galles after Dechter page 2 *replace* 2000
More informationGov 2002: 4. Observational Studies and Confounding
Gov 2002: 4. Observational Studies and Confounding Matthew Blackwell September 10, 2015 Where are we? Where are we going? Last two weeks: randomized experiments. From here on: observational studies. What
More informationIntroduction to Causal Calculus
Introduction to Causal Calculus Sanna Tyrväinen University of British Columbia August 1, 2017 1 / 1 2 / 1 Bayesian network Bayesian networks are Directed Acyclic Graphs (DAGs) whose nodes represent random
More informationStatistical Models for Causal Analysis
Statistical Models for Causal Analysis Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 Three Modes of Statistical Inference 1. Descriptive Inference: summarizing and exploring
More informationCausality II: How does causal inference fit into public health and what it is the role of statistics?
Causality II: How does causal inference fit into public health and what it is the role of statistics? Statistics for Psychosocial Research II November 13, 2006 1 Outline Potential Outcomes / Counterfactual
More informationCausal inference in statistics: An overview
Statistics Surveys Vol. 3 (2009) 96 146 ISSN: 1935-7516 DOI: 10.1214/09-SS057 Causal inference in statistics: An overview Judea Pearl Computer Science Department University of California, Los Angeles,
More informationAn Introduction to Causal Inference
To be published in The International Journal of Biostatistics, 2009. TECHNICAL REPORT R-354 February 2010 An Introduction to Causal Inference Judea Pearl University of California, Los Angeles Computer
More informationCausality in the Sciences
Causality in the Sciences Phyllis McKay Illari University of Kent Federica Russo Université catholique de Louvain, University of Kent Jon Williamson University of Kent CLARENDON PRESS. OXFORD 2009 1 THE
More informationThe Effects of Interventions
3 The Effects of Interventions 3.1 Interventions The ultimate aim of many statistical studies is to predict the effects of interventions. When we collect data on factors associated with wildfires in the
More informationA Decision Theoretic Approach to Causality
A Decision Theoretic Approach to Causality Vanessa Didelez School of Mathematics University of Bristol (based on joint work with Philip Dawid) Bordeaux, June 2011 Based on: Dawid & Didelez (2010). Identifying
More informationThe Mathematics of Causal Inference
In Joint Statistical Meetings Proceedings, Alexandria, VA: American Statistical Association, 2515-2529, 2013. JSM 2013 - Section on Statistical Education TECHNICAL REPORT R-416 September 2013 The Mathematics
More informationThe Foundations of Causal Inference
The Foundations of Causal Inference Judea Pearl University of California, Los Angeles Computer Science Department Los Angeles, CA, 90095-1596, USA judea@cs.ucla.edu May 12, 2010 Abstract This paper reviews
More informationConfounding Equivalence in Causal Inference
In Proceedings of UAI, 2010. In P. Grunwald and P. Spirtes, editors, Proceedings of UAI, 433--441. AUAI, Corvallis, OR, 2010. TECHNICAL REPORT R-343 July 2010 Confounding Equivalence in Causal Inference
More informationIgnoring the matching variables in cohort studies - when is it valid, and why?
Ignoring the matching variables in cohort studies - when is it valid, and why? Arvid Sjölander Abstract In observational studies of the effect of an exposure on an outcome, the exposure-outcome association
More informationUCLA Department of Statistics Papers
UCLA Department of Statistics Papers Title Comment on `Causal inference, probability theory, and graphical insights' (by Stuart G. Baker) Permalink https://escholarship.org/uc/item/9863n6gg Journal Statistics
More informationComments on The Role of Large Scale Assessments in Research on Educational Effectiveness and School Development by Eckhard Klieme, Ph.D.
Comments on The Role of Large Scale Assessments in Research on Educational Effectiveness and School Development by Eckhard Klieme, Ph.D. David Kaplan Department of Educational Psychology The General Theme
More informationTaming the challenge of extrapolation: From multiple experiments and observations to valid causal conclusions. Judea Pearl and Elias Bareinboim, UCLA
Taming the challenge of extrapolation: From multiple experiments and observations to valid causal conclusions Judea Pearl and Elias Bareinboim, UCLA One distinct feature of big data applications, setting
More informationLocal Characterizations of Causal Bayesian Networks
In M. Croitoru, S. Rudolph, N. Wilson, J. Howse, and O. Corby (Eds.), GKR 2011, LNAI 7205, Berlin Heidelberg: Springer-Verlag, pp. 1-17, 2012. TECHNICAL REPORT R-384 May 2011 Local Characterizations of
More information5.3 Graphs and Identifiability
218CHAPTER 5. CAUSALIT AND STRUCTURAL MODELS IN SOCIAL SCIENCE AND ECONOMICS.83 AFFECT.65.23 BEHAVIOR COGNITION Figure 5.5: Untestable model displaying quantitative causal information derived. method elucidates
More informationTechnical Track Session I: Causal Inference
Impact Evaluation Technical Track Session I: Causal Inference Human Development Human Network Development Network Middle East and North Africa Region World Bank Institute Spanish Impact Evaluation Fund
More informationCausal and Counterfactual Inference
Forthcoming section in The Handbook of Rationality, MIT press. TECHNICAL REPORT R-485 October 2018 Causal and Counterfactual Inference Judea Pearl University of California, Los Angeles Computer Science
More informationRecovering Causal Effects from Selection Bias
In Sven Koenig and Blai Bonet (Eds.), Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Palo Alto, CA: AAAI Press, 2015, forthcoming. TECHNICAL REPORT R-445 DECEMBER 2014 Recovering
More informationJob Training Partnership Act (JTPA)
Causal inference Part I.b: randomized experiments, matching and regression (this lecture starts with other slides on randomized experiments) Frank Venmans Example of a randomized experiment: Job Training
More informationThe International Journal of Biostatistics
The International Journal of Biostatistics Volume 7, Issue 1 2011 Article 16 A Complete Graphical Criterion for the Adjustment Formula in Mediation Analysis Ilya Shpitser, Harvard University Tyler J. VanderWeele,
More informationThe Science and Ethics of Causal Modeling
you said to post r347 on publications page. should i add: To appear as chapter in A.T. Panter and Sonya Serba (Eds.), Handbook of Ethics in Quantitative Methodology, Taylor & Francis Group, 2009. r347
More informationLecture Discussion. Confounding, Non-Collapsibility, Precision, and Power Statistics Statistical Methods II. Presented February 27, 2018
, Non-, Precision, and Power Statistics 211 - Statistical Methods II Presented February 27, 2018 Dan Gillen Department of Statistics University of California, Irvine Discussion.1 Various definitions of
More informationMarginal versus conditional effects: does it make a difference? Mireille Schnitzer, PhD Université de Montréal
Marginal versus conditional effects: does it make a difference? Mireille Schnitzer, PhD Université de Montréal Overview In observational and experimental studies, the goal may be to estimate the effect
More informationIdentification of Conditional Interventional Distributions
Identification of Conditional Interventional Distributions Ilya Shpitser and Judea Pearl Cognitive Systems Laboratory Department of Computer Science University of California, Los Angeles Los Angeles, CA.
More information6.3 How the Associational Criterion Fails
6.3. HOW THE ASSOCIATIONAL CRITERION FAILS 271 is randomized. We recall that this probability can be calculated from a causal model M either directly, by simulating the intervention do( = x), or (if P
More informationcausal inference at hulu
causal inference at hulu Allen Tran July 17, 2016 Hulu Introduction Most interesting business questions at Hulu are causal Business: what would happen if we did x instead of y? dropped prices for risky
More informationFront-Door Adjustment
Front-Door Adjustment Ethan Fosse Princeton University Fall 2016 Ethan Fosse Princeton University Front-Door Adjustment Fall 2016 1 / 38 1 Preliminaries 2 Examples of Mechanisms in Sociology 3 Bias Formulas
More informationA Unification of Mediation and Interaction. A 4-Way Decomposition. Tyler J. VanderWeele
Original Article A Unification of Mediation and Interaction A 4-Way Decomposition Tyler J. VanderWeele Abstract: The overall effect of an exposure on an outcome, in the presence of a mediator with which
More informationOn the Identification of Causal Effects
On the Identification of Causal Effects Jin Tian Department of Computer Science 226 Atanasoff Hall Iowa State University Ames, IA 50011 jtian@csiastateedu Judea Pearl Cognitive Systems Laboratory Computer
More informationWhen Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data?
When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data? Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton University Joint
More informationCounterfactual Reasoning in Algorithmic Fairness
Counterfactual Reasoning in Algorithmic Fairness Ricardo Silva University College London and The Alan Turing Institute Joint work with Matt Kusner (Warwick/Turing), Chris Russell (Sussex/Turing), and Joshua
More informationIntroduction. Abstract
Identification of Joint Interventional Distributions in Recursive Semi-Markovian Causal Models Ilya Shpitser, Judea Pearl Cognitive Systems Laboratory Department of Computer Science University of California,
More informationConfounding Equivalence in Causal Inference
Revised and submitted, October 2013. TECHNICAL REPORT R-343w October 2013 Confounding Equivalence in Causal Inference Judea Pearl Cognitive Systems Laboratory Computer Science Department University of
More informationTHE FOUNDATIONS OF CAUSAL INFERENCE
TECHNICAL REPORT R-355 August 2010 3 THE FOUNDATIONS OF CAUSAL INFERENCE Judea Pearl* This paper reviews recent advances in the foundations of causal inference and introduces a systematic methodology for
More informationProbabilities of causation: Bounds and identification
Annals of Mathematics and Artificial Intelligence 28 (2000) 287 313 287 Probabilities of causation: Bounds and identification Jin Tian and Judea Pearl Cognitive Systems Laboratory, Computer Science Department,
More informationOn Measurement Bias in Causal Inference
On Measurement Bias in Causal Inference Judea Pearl Cognitive Systems Laboratory Computer Science Department University of California, Los Angeles, CA 90024 USA judea@cs.ucla.edu Abstract This paper addresses
More informationMediation for the 21st Century
Mediation for the 21st Century Ross Boylan ross@biostat.ucsf.edu Center for Aids Prevention Studies and Division of Biostatistics University of California, San Francisco Mediation for the 21st Century
More informationA Linear Microscope for Interventions and Counterfactuals
Forthcoming, Journal of Causal Inference (Causal, Casual, and Curious Section). TECHNICAL REPORT R-459 March 2017 A Linear Microscope for Interventions and Counterfactuals Judea Pearl University of California,
More informationAn Introduction to Causal Analysis on Observational Data using Propensity Scores
An Introduction to Causal Analysis on Observational Data using Propensity Scores Margie Rosenberg*, PhD, FSA Brian Hartman**, PhD, ASA Shannon Lane* *University of Wisconsin Madison **University of Connecticut
More informationSingle World Intervention Graphs (SWIGs): A Unification of the Counterfactual and Graphical Approaches to Causality
Single World Intervention Graphs (SWIGs): A Unification of the Counterfactual and Graphical Approaches to Causality Thomas S. Richardson University of Washington James M. Robins Harvard University Working
More informationRevision list for Pearl s THE FOUNDATIONS OF CAUSAL INFERENCE
Revision list for Pearl s THE FOUNDATIONS OF CAUSAL INFERENCE insert p. 90: in graphical terms or plain causal language. The mediation problem of Section 6 illustrates how such symbiosis clarifies the
More informationComplete Identification Methods for the Causal Hierarchy
Journal of Machine Learning Research 9 (2008) 1941-1979 Submitted 6/07; Revised 2/08; Published 9/08 Complete Identification Methods for the Causal Hierarchy Ilya Shpitser Judea Pearl Cognitive Systems
More informationPEARL VS RUBIN (GELMAN)
PEARL VS RUBIN (GELMAN) AN EPIC battle between the Rubin Causal Model school (Gelman et al) AND the Structural Causal Model school (Pearl et al) a cursory overview Dokyun Lee WHO ARE THEY? Judea Pearl
More informationCausal Analysis After Haavelmo
After Haavelmo University College London UCL Department Seminar September 3, 2013 Economics has forgotten its own past. (Judea Pearl, 2012) Haavemo s Contributions to Causality: Two seminal papers (1943,
More informationCasual Mediation Analysis
Casual Mediation Analysis Tyler J. VanderWeele, Ph.D. Upcoming Seminar: April 21-22, 2017, Philadelphia, Pennsylvania OXFORD UNIVERSITY PRESS Explanation in Causal Inference Methods for Mediation and Interaction
More informationLecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16)
Lecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16) 1 2 Model Consider a system of two regressions y 1 = β 1 y 2 + u 1 (1) y 2 = β 2 y 1 + u 2 (2) This is a simultaneous equation model
More informationIdentification and Overidentification of Linear Structural Equation Models
In D. D. Lee and M. Sugiyama and U. V. Luxburg and I. Guyon and R. Garnett (Eds.), Advances in Neural Information Processing Systems 29, pre-preceedings 2016. TECHNICAL REPORT R-444 October 2016 Identification
More informationEffect Modification and Interaction
By Sander Greenland Keywords: antagonism, causal coaction, effect-measure modification, effect modification, heterogeneity of effect, interaction, synergism Abstract: This article discusses definitions
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 3 Linear
More informationBounding the Probability of Causation in Mediation Analysis
arxiv:1411.2636v1 [math.st] 10 Nov 2014 Bounding the Probability of Causation in Mediation Analysis A. P. Dawid R. Murtas M. Musio February 16, 2018 Abstract Given empirical evidence for the dependence
More informationarxiv: v2 [cs.ai] 26 Sep 2018
A Survey of Learning Causality with Data: Problems and Methods arxiv:1809.09337v2 [cs.ai] 26 Sep 2018 RUOCHENG GUO, Computer Science and Engineering, Arizona State University LU CHENG, Computer Science
More informationInformally, the consistency rule states that an individual s
BRIEF REPORT TECHNICAL REPORT R-358 August 2010 On the Consistency Rule in Causal Inference Axiom, Definition, Assumption, or Theorem? Judea Pearl Abstract: In 2 recent communications, Cole and Frangakis
More informationThe Do-Calculus Revisited Judea Pearl Keynote Lecture, August 17, 2012 UAI-2012 Conference, Catalina, CA
The Do-Calculus Revisited Judea Pearl Keynote Lecture, August 17, 2012 UAI-2012 Conference, Catalina, CA Abstract The do-calculus was developed in 1995 to facilitate the identification of causal effects
More informationCausal Analysis After Haavelmo: Definitions and a Unified Analysis of Identification of Recursive Causal Models
Causal Inference in the Social Sciences University of Michigan December 12, 2012 This draft, December 15, 2012 James Heckman and Rodrigo Pinto Causal Analysis After Haavelmo, December 15, 2012 1 / 157
More informationCausal analysis after Haavelmo. 8th/last Lecture - Hedibert Lopes
Causal analysis after Haavelmo 8th/last Lecture - Hedibert Lopes Insper - Institute of Education and Research December 1st, 2015 Hedibert Lopes (Insper) Heckman & Pinto (2014) December 1st, 2015 1 / 39
More informationCausal Directed Acyclic Graphs
Causal Directed Acyclic Graphs Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Causal DAGs Stat186/Gov2002 Fall 2018 1 / 15 Elements of DAGs (Pearl. 2000.
More informationEstimating direct effects in cohort and case-control studies
Estimating direct effects in cohort and case-control studies, Ghent University Direct effects Introduction Motivation The problem of standard approaches Controlled direct effect models In many research
More informationReflections, Elaborations, and Discussions with Readers
CHAPTER ELEVEN Reflections, Elaborations, and Discussions with Readers As X-rays are to the surgeon, graphs are for causation. The author In this chapter, I reflect back on the material covered in Chapters
More informationEconometric Causality
Econometric (2008) International Statistical Review, 76(1):1-27 James J. Heckman Spencer/INET Conference University of Chicago Econometric The econometric approach to causality develops explicit models
More informationIntroduction to causal identification. Nidhiya Menon IGC Summer School, New Delhi, July 2015
Introduction to causal identification Nidhiya Menon IGC Summer School, New Delhi, July 2015 Outline 1. Micro-empirical methods 2. Rubin causal model 3. More on Instrumental Variables (IV) Estimating causal
More informationA Linear Microscope for Interventions and Counterfactuals
Journal of Causal Inference, 5(1):March2017. (Errata marked; pages 2 and 6.) J. Causal Infer. 2017; 20170003 TECHNICAL REPORT R-459 March 2017 Causal, Casual and Curious Judea Pearl A Linear Microscope
More informationModels of Causality. Roy Dong. University of California, Berkeley
Models of Causality Roy Dong University of California, Berkeley Correlation is not the same as causation. 2 Conditioning is not the same as imputing. 3 Stylized example Suppose, amongst the population,
More informationCausal Mechanisms Short Course Part II:
Causal Mechanisms Short Course Part II: Analyzing Mechanisms with Experimental and Observational Data Teppei Yamamoto Massachusetts Institute of Technology March 24, 2012 Frontiers in the Analysis of Causal
More informationEmpirical approaches in public economics
Empirical approaches in public economics ECON4624 Empirical Public Economics Fall 2016 Gaute Torsvik Outline for today The canonical problem Basic concepts of causal inference Randomized experiments Non-experimental
More informationOn Identifying Causal Effects
29 1 Introduction This paper deals with the problem of inferring cause-effect relationships from a combination of data and theoretical assumptions. This problem arises in diverse fields such as artificial
More informationAn Introduction to Causal Mediation Analysis. Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016
An Introduction to Causal Mediation Analysis Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016 1 Causality In the applications of statistics, many central questions
More informationSingle World Intervention Graphs (SWIGs):
Single World Intervention Graphs (SWIGs): Unifying the Counterfactual and Graphical Approaches to Causality Thomas Richardson Department of Statistics University of Washington Joint work with James Robins
More informationNaïve Bayes Classifiers
Naïve Bayes Classifiers Example: PlayTennis (6.9.1) Given a new instance, e.g. (Outlook = sunny, Temperature = cool, Humidity = high, Wind = strong ), we want to compute the most likely hypothesis: v NB
More informationUsing Descendants as Instrumental Variables for the Identification of Direct Causal Effects in Linear SEMs
Using Descendants as Instrumental Variables for the Identification of Direct Causal Effects in Linear SEMs Hei Chan Institute of Statistical Mathematics, 10-3 Midori-cho, Tachikawa, Tokyo 190-8562, Japan
More informationCausal Analysis in Social Research
Causal Analysis in Social Research Walter R Davis National Institute of Applied Statistics Research Australia University of Wollongong Frontiers in Social Statistics Metholodogy 8 February 2017 Walter
More informationMediation analysis for different types of Causal questions: Effect of Cause and Cause of Effect
Università degli Studi di Cagliari Dipartimento di Matematica e Informatica Dottorato di Ricerca in Matematica e Calcolo Scientifico Ciclo XXVIII Ph.D. Thesis Mediation analysis for different types of
More informationEstimating the Marginal Odds Ratio in Observational Studies
Estimating the Marginal Odds Ratio in Observational Studies Travis Loux Christiana Drake Department of Statistics University of California, Davis June 20, 2011 Outline The Counterfactual Model Odds Ratios
More informationCausal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies
Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Kosuke Imai Department of Politics Princeton University November 13, 2013 So far, we have essentially assumed
More informationGraphical Representation of Causal Effects. November 10, 2016
Graphical Representation of Causal Effects November 10, 2016 Lord s Paradox: Observed Data Units: Students; Covariates: Sex, September Weight; Potential Outcomes: June Weight under Treatment and Control;
More informationWhat Counterfactuals Can Be Tested
hat Counterfactuals Can Be Tested Ilya Shpitser, Judea Pearl Cognitive Systems Laboratory Department of Computer Science niversity of California, Los Angeles Los Angeles, CA. 90095 {ilyas, judea}@cs.ucla.edu
More informationCausal Discovery. Beware of the DAG! OK??? Seeing and Doing SEEING. Properties of CI. Association. Conditional Independence
eware of the DG! Philip Dawid niversity of Cambridge Causal Discovery Gather observational data on system Infer conditional independence properties of joint distribution Fit a DIRECTED CCLIC GRPH model
More informationControlling for Time Invariant Heterogeneity
Controlling for Time Invariant Heterogeneity Yona Rubinstein July 2016 Yona Rubinstein (LSE) Controlling for Time Invariant Heterogeneity 07/16 1 / 19 Observables and Unobservables Confounding Factors
More informationAdvances in Cyclic Structural Causal Models
Advances in Cyclic Structural Causal Models Joris Mooij j.m.mooij@uva.nl June 1st, 2018 Joris Mooij (UvA) Rotterdam 2018 2018-06-01 1 / 41 Part I Introduction to Causality Joris Mooij (UvA) Rotterdam 2018
More informationStructural Nested Mean Models for Assessing Time-Varying Effect Moderation. Daniel Almirall
1 Structural Nested Mean Models for Assessing Time-Varying Effect Moderation Daniel Almirall Center for Health Services Research, Durham VAMC & Dept. of Biostatistics, Duke University Medical Joint work
More informationAssess Assumptions and Sensitivity Analysis. Fan Li March 26, 2014
Assess Assumptions and Sensitivity Analysis Fan Li March 26, 2014 Two Key Assumptions 1. Overlap: 0
More informationCausal mediation analysis: Definition of effects and common identification assumptions
Causal mediation analysis: Definition of effects and common identification assumptions Trang Quynh Nguyen Seminar on Statistical Methods for Mental Health Research Johns Hopkins Bloomberg School of Public
More informationThe decision theoretic approach to causal inference OR Rethinking the paradigms of causal modelling
The decision theoretic approach to causal inference OR Rethinking the paradigms of causal modelling A.P.Dawid 1 and S.Geneletti 2 1 University of Cambridge, Statistical Laboratory 2 Imperial College Department
More informationIdentifying Linear Causal Effects
Identifying Linear Causal Effects Jin Tian Department of Computer Science Iowa State University Ames, IA 50011 jtian@cs.iastate.edu Abstract This paper concerns the assessment of linear cause-effect relationships
More informationResearch Design: Causal inference and counterfactuals
Research Design: Causal inference and counterfactuals University College Dublin 8 March 2013 1 2 3 4 Outline 1 2 3 4 Inference In regression analysis we look at the relationship between (a set of) independent
More information