OUTLINE THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS. Judea Pearl University of California Los Angeles (
|
|
- Baldric Holt
- 6 years ago
- Views:
Transcription
1 THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS Judea Pearl University of California Los Angeles ( OUTLINE Modeling: Statistical vs. Causal Causal Models and Identifiability to three types of claims: 1. Effects of potential interventions 2. Claims about attribution (responsibilit 3. Claims about direct and indirect effects TRADITIONAL STATISTICAL INFERENCE PARADIGM P Q(P) (Aspects of P) e.g., Infer whether customers who bought product A would also buy product B. Q = B A) FROM STATISTICAL TO CAUSAL ANALSIS: 1. THE DIFFERENCES Probability and statistics deal with static relations P change P Q(P ) (Aspects of P ) What happens when P changes? e.g., Infer whether customers who bought product A would still buy A if we were to double the price. FROM STATISTICAL TO CAUSAL ANALSIS: 1. THE DIFFERENCES What remains invariant when P changes say, to satisfy P (price=2)=1 P change P Note: P (v) P (v price = 2) P does not tell us how it ought to change e.g. Curing symptoms vs. curing diseases e.g. Analogy: mechanical deformation Q(P ) (Aspects of P ) FROM STATISTICAL TO CAUSAL ANALSIS: 1. THE DIFFERENCES (CONT) 1. Causal and statistical concepts do not mix. CAUSAL STATISTICAL Spurious correlation Regression Randomization Association / Independence Confounding / Effect Controlling for / Conditioning Instrument Odd and risk ratios Holding constant Collapsibility Explanatory variables Propensity score
2 FROM STATISTICAL TO CAUSAL ANALSIS: 1. THE DIFFERENCES (CONT) 1. Causal and statistical concepts do not mix. CAUSAL STATISTICAL Spurious correlation Regression Randomization Association / Independence Confounding / Effect Controlling for / Conditioning Instrument Odd and risk ratios Holding constant Collapsibility Explanatory variables Propensity score 2. No causes in no causes out (Cartwright, 1989) statistical assumptions + data causal assumptions causal conclusions 3. Causal assumptions cannot be expressed in the mathematical language of standard statistics. 4. } FROM STATISTICAL TO CAUSAL ANALSIS: 1. THE DIFFERENCES (CONT) 1. Causal and statistical concepts do not mix. CAUSAL STATISTICAL Spurious correlation Regression Randomization Association / Independence Confounding / Effect Controlling for / Conditioning Instrument Odd and risk ratios Holding constant Collapsibility Explanatory variables Propensity score 2. No causes in no causes out (Cartwright, 1989) statistical assumptions + data causal assumptions causal conclusions 3. Causal assumptions cannot be expressed in the mathematical language of standard statistics. 4. Non-standard mathematics: a) Structural equation models (Wright, 1920; Simon, 1960) b) Counterfactuals (Neyman-Rubin ( x ), Lewis (x )) } WH CAUSALIT NEEDS SPECIAL MATHEMATICS FROM STATISTICAL TO CAUSAL ANALSIS: 2. THE MENTAL BARRIERS SEM Equations are Non-algebraic: = 2 = 1 Process information Had been 3, would be 6. If we raise to 3, would be 6. Must wipe out = 1. = 1 = 2 Static information 1. Every exercise of causal analysis must rest on untested, judgmental causal assumptions. 2. Every exercise of causal analysis must invoke non-standard mathematical notation. TWO PARADIGMS FOR CAUSAL INFERENCE Observed:,,,...) Conclusions needed: x =, y =x =z)... How do we connect observables,,,, to counterfactuals x, z, y,? THE STRUCTURAL MODEL PARADIGM Generating Model Q(M) (Aspects of M) N-R model Counterfactuals are primitives, new variables Super-distribution P*(,,, x, z, ),, constrain x, y, Structural model Counterfactuals are derived quantities Subscripts modify a data-generating model M Oracle for computing answers to Q s. e.g., Infer whether customers who bought product A would still buy A if we were to double the price. 2
3 FAMILIAR CAUSAL MODEL ORACLE FOR MANIPILATION STRUCTURAL CAUSAL MODELS INPUT OUTPUT Definition: A structural causal model is a 4-tuple V,U, F,, where V = {V 1,...,V n } are observable variables U ={U 1,...,U m } are background variables F = {f 1,..., f n } are functions determining V, v i = f i (v, is a distribution over U and F induce a distribution v) over observable variables CAUSAL MODELS AND COUNTERFACTUALS Definition: The sentence: would be y (in situation, had been x, denoted x ( = y, means: The solution for in a mutilated model M x, (i.e., the equations for replaced by = x) with input U=u, is equal to y. probabilities of counterfactuals: x = y, w = z) = u: x( = y, w( = z The super-distribution P* is derived from M. Parsimonious, consistent, and transparent APPLICATIONS 1. Predicting effects of actions and policies 2. Learning causal relationships from assumptions and data 3. Troubleshooting physical systems and plans 4. Finding explanations for reported events 5. Generating verbal explanations 6. Understanding causal talk 7. Formulating theories of causal thinking AIOMS OF CAUSAL COUNTERFACTUALS x ( = y : would be y, had been x (in state U = 1. Definiteness x s. t. y ( = x 2. Uniqueness ( y ( = x) & ( y( = x') x = x' 3. Effectiveness xw ( = x 4. Composition W x ( = w xw( = x( 5. Reversibility ( xw ( = y & ( Wxy( = w) x( = y RULES OF CAUSAL CALCULUS Rule 1: Ignoring observations y do{x}, z, w) = y do{x}, w) if (,W ) G Rule 2: Action/observation exchange y do{x}, do{z}, w) = y do{x},z,w) if (,W ) Rule 3: Ignoring actions y do{x}, do{z}, w) = y do{x}, w) G if (,W ) G (W) 3
4 DERIVATION IN CAUSAL CALCULUS Genotype (Unobserved) Smoking Tar Cancer P (c do{s}) = Σ t P (c do{s}, t) P (t do{s}) Probability Axioms = Σ t P (c do{s}, do{t}) P (t do{s}) = Σ t P (c do{s}, do{t}) P (t s) = Σ t P (c do{t}) P (t s) Rule 2 Rule 2 Rule 3 = Σ s Σ t P (c do{t}, s ) P (s do{t}) t s) Probability Axioms = Σ s Σ t P (c t, s ) P (s do{t}) t s) Rule 2 = Σ s Σ t P (c t, s ) P (s ) t s) Rule 3 THE BACK-DOOR CRITERION Graphical test of identification y do(x)) is identifiable in G if there is a set of variables such that d-separates from in G x G Moreover, y do(x)) = y x,z) z) z ( adjusting for ) G x 2 5 RECENT RESULTS ON IDENTIFICATION do-calculus is complete DETERMINING THE CAUSES OF EFFECTS (The Attribution Problem) our Honor! My client (Mr. A) died BECAUSE he used that drug. Complete graphical criterion for identifying causal effects (Shpitser and Pearl, 2006). Complete graphical criterion for empirical testability of counterfactuals (Shpitser and Pearl, 2007). DETERMINING THE CAUSES OF EFFECTS (The Attribution Problem) our Honor! My client (Mr. A) died BECAUSE he used that drug. Semantical Problem: THE PROBLEM 1. What is the meaning of PN(x,: Probability that event y would not have occurred if it were not for event x, given that x and y did in fact occur. Court to decide if it is MORE PROBABLE THAN NOT that A would be alive BUT FOR the drug! PN =? A is dead, took the drug) >
5 Semantical Problem: THE PROBLEM 1. What is the meaning of PN(x,: Probability that event y would not have occurred if it were not for event x, given that x and y did in fact occur. Answer: Computable from M PN( x, = x ' = y' x, Semantical Problem: THE PROBLEM 1. What is the meaning of PN(x,: Probability that event y would not have occurred if it were not for event x, given that x and y did in fact occur. Analytical Problem: 2. Under what condition can PN(x, be learned from statistical data, i.e., observational, experimental and combined. TPICAL THEOREMS (Tian and Pearl, 2000) Bounds given combined nonexperimental and experimental data 0 1 y ) ( ) max x' P y' PN min x' x, x, Identifiability under monotonicity (Combined data) y x) y x' ) y x' ) y ) PN = + x' y x) x, corrected Excess-Risk-Ratio CAN FREQUENC DATA DECIDE LEGAL RESPONSIBILIT? Experimental Nonexperimental do(x) do(x ) x x Deaths ( Survivals (y ) ,000 1,000 1,000 1,000 Nonexperimental data: drug usage predicts longer life Experimental data: drug has negligible effect on survival Plaintiff: Mr. A is special. 1. He actually died 2. He used the drug by choice Court to decide (given both data): Is it more probable than not that A would be alive but for the drug? PN Δ = x' = y' x, > 0.50 SOLUTION TO THE ATTRIBUTION PROBLEM EFFECT DECOMPOSITION What is the semantics of direct and indirect effects? What are their policy-making implications? WITH PROBABILIT ONE 1 y x x, 1 Combined data tell more that each study alone Can we estimate them from data? Experimental data? 5
6 WH DECOMPOSE EFFECTS? 1. Direct (or indirect) effect may be more transportable. 2. Indirect effects may be prevented or controlled. Pill Pregnancy + + Thrombosis 3. Direct (or indirect) effect may be forbidden Gender Hiring Qualification SEMANTICS BECOMES NONTRIVIAL IN NONLINEAR MODELS (even when the model is completely specified) TE Δ = E( do( x)) x DE Δ = E( do( x), do( z)) x IE Δ =???? z = f (x, ε 1 ) y = g (x, z, ε 2 ) Dependent on z? Void of operational meaning? THE OPERATIONAL MEANING OF DIRECT EFFECTS THE OPERATIONAL MEANING OF INDIRECT EFFECTS z = f (x, ε 1 ) y = g (x, z, ε 2 ) z = f (x, ε 1 ) y = g (x, z, ε 2 ) Natural Direct Effect of on : The expected change in per unit change of, when we keep constant at whatever value it attains before the change. E[ x ] 1 x x 0 0 In linear models, NDE = Controlled Direct Effect Natural Indirect Effect of on : The expected change in when we keep constant, say at x 0, and let change to whatever value it would have under a unit change in. E[ x ] 0 x1 x0 In linear models, NIE = TE - DE POLIC IMPLICATIONS OF INDIRECT EFFECTS indirect What is the direct effect of on? The effect of Gender on Hiring if sex discrimination is eliminated. GENDER IGNORE f HIRING QUALIFICATION SEMANTICS AND IDENTIFICATION OF NESTED COUNTERFACTUALS Consider the quantity Q Δ = Eu [ x ( ] x*( Given M,, Q is well defined Given u, x* ( is the solution for in M x*, call it z x x ( ) is the solution for in M * ( u xz experimental Can Q be estimated from data? nonexperimental 6
7 W GENERAL PATH-SPECIFIC EFFECTS (Def.) z * = x* ( Form a new model, M g *, specific to active subgraph g fi * ( pai, u; g) = fi( pai( g), pai*( g ), u ) Definition: g-specific effect Nonidentifiable even in Markovian models W x * E g ( x, x* ; ) M = TE( x, x* ; ) M * g EFFECT DECOMPOSITION SUMMAR Graphical conditions for estimability from experimental / nonexperimental data. Graphical conditions hold in Markovian models Useful in answering new type of policy questions involving mechanism blocking instead of variable fixing. CONCLUSIONS Structural-model semantics, enriched with logic and graphs, provides: Complete formal basis for causal reasoning Powerful and friendly causal calculus Lays the foundations for asking more difficult questions: What is an action? What is free will? Should robots be programmed to have this illusion? 7
CAUSAL INFERENCE IN THE EMPIRICAL SCIENCES. Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea)
CAUSAL INFERENCE IN THE EMPIRICAL SCIENCES Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea) OUTLINE Inference: Statistical vs. Causal distinctions and mental barriers Formal semantics
More informationOF CAUSAL INFERENCE THE MATHEMATICS IN STATISTICS. Department of Computer Science. Judea Pearl UCLA
THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS Judea earl Department of Computer Science UCLA OUTLINE Statistical vs. Causal Modeling: distinction and mental barriers N-R vs. structural model: strengths
More informationCAUSAL INFERENCE AS COMPUTATIONAL LEARNING. Judea Pearl University of California Los Angeles (
CAUSAL INFERENCE AS COMUTATIONAL LEARNING Judea earl University of California Los Angeles www.cs.ucla.edu/~judea OUTLINE Inference: Statistical vs. Causal distinctions and mental barriers Formal semantics
More informationOUTLINE CAUSAL INFERENCE: LOGICAL FOUNDATION AND NEW RESULTS. Judea Pearl University of California Los Angeles (www.cs.ucla.
OUTLINE CAUSAL INFERENCE: LOGICAL FOUNDATION AND NEW RESULTS Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/) Statistical vs. Causal vs. Counterfactual inference: syntax and semantics
More informationCAUSAL INFERENCE IN STATISTICS. A Gentle Introduction. Judea Pearl University of California Los Angeles (www.cs.ucla.
CAUSAL INFERENCE IN STATISTICS A Gentle Introduction Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/jsm12) OUTLINE Inference: Statistical vs. Causal, distinctions, and mental
More informationOUTLINE CAUSES AND COUNTERFACTUALS IN THE EMPIRICAL SCIENCES. Judea Pearl University of California Los Angeles (www.cs.ucla.
CAUE AND COUNTERFACTUAL IN THE EMPIRICAL CIENCE Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/jsm9) OUTLINE Inference: tatistical vs. Causal, distinctions, and mental barriers
More informationFrom Causality, Second edition, Contents
From Causality, Second edition, 2009. Preface to the First Edition Preface to the Second Edition page xv xix 1 Introduction to Probabilities, Graphs, and Causal Models 1 1.1 Introduction to Probability
More informationCAUSES AND COUNTERFACTUALS: CONCEPTS, PRINCIPLES AND TOOLS
CAUSES AND COUNTERFACTUALS: CONCEPTS, PRINCIPLES AND TOOLS Judea Pearl Elias Bareinboim University of California, Los Angeles {judea, eb}@cs.ucla.edu NIPS 2013 Tutorial OUTLINE! Concepts: * Causal inference
More informationCAUSALITY. Models, Reasoning, and Inference 1 CAMBRIDGE UNIVERSITY PRESS. Judea Pearl. University of California, Los Angeles
CAUSALITY Models, Reasoning, and Inference Judea Pearl University of California, Los Angeles 1 CAMBRIDGE UNIVERSITY PRESS Preface page xiii 1 Introduction to Probabilities, Graphs, and Causal Models 1
More informationPANEL ON MEDIATION AND OTHER MIRACLES OF THE 21 ST CENTURY
PANEL ON EDIAION AND OHER IRACLES OF HE 21 S CENUR Judea Pearl UCLA With Kosuke Imai and many others HE QUESION OF EDIAION (direct vs. indirect effects) 1. Why decompose effects? 2. What is the definition
More informationTHE MATHEMATICS OF CAUSAL INFERENCE With reflections on machine learning and the logic of science. Judea Pearl UCLA
THE MATHEMATICS OF CAUSAL INFERENCE With reflections on machine learning and the logic of science Judea Pearl UCLA OUTLINE 1. The causal revolution from statistics to counterfactuals from Babylon to Athens
More informationANALYTIC COMPARISON. Pearl and Rubin CAUSAL FRAMEWORKS
ANALYTIC COMPARISON of Pearl and Rubin CAUSAL FRAMEWORKS Content Page Part I. General Considerations Chapter 1. What is the question? 16 Introduction 16 1. Randomization 17 1.1 An Example of Randomization
More informationIntroduction to Causal Calculus
Introduction to Causal Calculus Sanna Tyrväinen University of British Columbia August 1, 2017 1 / 1 2 / 1 Bayesian network Bayesian networks are Directed Acyclic Graphs (DAGs) whose nodes represent random
More informationCausality in the Sciences
Causality in the Sciences Phyllis McKay Illari University of Kent Federica Russo Université catholique de Louvain, University of Kent Jon Williamson University of Kent CLARENDON PRESS. OXFORD 2009 1 THE
More informationCausality II: How does causal inference fit into public health and what it is the role of statistics?
Causality II: How does causal inference fit into public health and what it is the role of statistics? Statistics for Psychosocial Research II November 13, 2006 1 Outline Potential Outcomes / Counterfactual
More informationTaming the challenge of extrapolation: From multiple experiments and observations to valid causal conclusions. Judea Pearl and Elias Bareinboim, UCLA
Taming the challenge of extrapolation: From multiple experiments and observations to valid causal conclusions Judea Pearl and Elias Bareinboim, UCLA One distinct feature of big data applications, setting
More informationBounding the Probability of Causation in Mediation Analysis
arxiv:1411.2636v1 [math.st] 10 Nov 2014 Bounding the Probability of Causation in Mediation Analysis A. P. Dawid R. Murtas M. Musio February 16, 2018 Abstract Given empirical evidence for the dependence
More informationCausal inference in statistics: An overview
Statistics Surveys Vol. 3 (2009) 96 146 ISSN: 1935-7516 DOI: 10.1214/09-SS057 Causal inference in statistics: An overview Judea Pearl Computer Science Department University of California, Los Angeles,
More informationThe Foundations of Causal Inference
The Foundations of Causal Inference Judea Pearl University of California, Los Angeles Computer Science Department Los Angeles, CA, 90095-1596, USA judea@cs.ucla.edu May 12, 2010 Abstract This paper reviews
More informationTechnical Track Session I: Causal Inference
Impact Evaluation Technical Track Session I: Causal Inference Human Development Human Network Development Network Middle East and North Africa Region World Bank Institute Spanish Impact Evaluation Fund
More informationThe Mathematics of Causal Inference
In Joint Statistical Meetings Proceedings, Alexandria, VA: American Statistical Association, 2515-2529, 2013. JSM 2013 - Section on Statistical Education TECHNICAL REPORT R-416 September 2013 The Mathematics
More informationThe Effects of Interventions
3 The Effects of Interventions 3.1 Interventions The ultimate aim of many statistical studies is to predict the effects of interventions. When we collect data on factors associated with wildfires in the
More informationThe Science and Ethics of Causal Modeling
you said to post r347 on publications page. should i add: To appear as chapter in A.T. Panter and Sonya Serba (Eds.), Handbook of Ethics in Quantitative Methodology, Taylor & Francis Group, 2009. r347
More informationProbabilities of causation: Bounds and identification
Annals of Mathematics and Artificial Intelligence 28 (2000) 287 313 287 Probabilities of causation: Bounds and identification Jin Tian and Judea Pearl Cognitive Systems Laboratory, Computer Science Department,
More informationAn Introduction to Causal Inference
To be published in The International Journal of Biostatistics, 2009. TECHNICAL REPORT R-354 February 2010 An Introduction to Causal Inference Judea Pearl University of California, Los Angeles Computer
More informationA Decision Theoretic Approach to Causality
A Decision Theoretic Approach to Causality Vanessa Didelez School of Mathematics University of Bristol (based on joint work with Philip Dawid) Bordeaux, June 2011 Based on: Dawid & Didelez (2010). Identifying
More informationGov 2002: 4. Observational Studies and Confounding
Gov 2002: 4. Observational Studies and Confounding Matthew Blackwell September 10, 2015 Where are we? Where are we going? Last two weeks: randomized experiments. From here on: observational studies. What
More informationIdentification of Conditional Interventional Distributions
Identification of Conditional Interventional Distributions Ilya Shpitser and Judea Pearl Cognitive Systems Laboratory Department of Computer Science University of California, Los Angeles Los Angeles, CA.
More informationIntroduction. Abstract
Identification of Joint Interventional Distributions in Recursive Semi-Markovian Causal Models Ilya Shpitser, Judea Pearl Cognitive Systems Laboratory Department of Computer Science University of California,
More informationCausal Analysis After Haavelmo
After Haavelmo University of Oslo Haavelmo Lecture December 13, 2013 Oslo is the cradle of rigorous causal inference. Two Giants Ragnar Frisch Trygve Haavelmo Haavelmo s Research Program (a) Specify an
More informationCAUSALITY CORRECTIONS IMPLEMENTED IN 2nd PRINTING
1 CAUSALITY CORRECTIONS IMPLEMENTED IN 2nd PRINTING Updated 9/26/00 page v *insert* TO RUTH centered in middle of page page xv *insert* in second paragraph David Galles after Dechter page 2 *replace* 2000
More informationCausal Analysis After Haavelmo
After Haavelmo University College London UCL Department Seminar September 3, 2013 Economics has forgotten its own past. (Judea Pearl, 2012) Haavemo s Contributions to Causality: Two seminal papers (1943,
More informationReflections, Elaborations, and Discussions with Readers
CHAPTER ELEVEN Reflections, Elaborations, and Discussions with Readers As X-rays are to the surgeon, graphs are for causation. The author In this chapter, I reflect back on the material covered in Chapters
More informationCounterfactual Reasoning in Algorithmic Fairness
Counterfactual Reasoning in Algorithmic Fairness Ricardo Silva University College London and The Alan Turing Institute Joint work with Matt Kusner (Warwick/Turing), Chris Russell (Sussex/Turing), and Joshua
More informationTHE FOUNDATIONS OF CAUSAL INFERENCE
TECHNICAL REPORT R-355 August 2010 3 THE FOUNDATIONS OF CAUSAL INFERENCE Judea Pearl* This paper reviews recent advances in the foundations of causal inference and introduces a systematic methodology for
More informationRevision list for Pearl s THE FOUNDATIONS OF CAUSAL INFERENCE
Revision list for Pearl s THE FOUNDATIONS OF CAUSAL INFERENCE insert p. 90: in graphical terms or plain causal language. The mediation problem of Section 6 illustrates how such symbiosis clarifies the
More informationStability of causal inference: Open problems
Stability of causal inference: Open problems Leonard J. Schulman & Piyush Srivastava California Institute of Technology UAI 2016 Workshop on Causality Interventions without experiments [Pearl, 1995] Genetic
More informationComplete Identification Methods for the Causal Hierarchy
Journal of Machine Learning Research 9 (2008) 1941-1979 Submitted 6/07; Revised 2/08; Published 9/08 Complete Identification Methods for the Causal Hierarchy Ilya Shpitser Judea Pearl Cognitive Systems
More information5.3 Graphs and Identifiability
218CHAPTER 5. CAUSALIT AND STRUCTURAL MODELS IN SOCIAL SCIENCE AND ECONOMICS.83 AFFECT.65.23 BEHAVIOR COGNITION Figure 5.5: Untestable model displaying quantitative causal information derived. method elucidates
More informationExternal Validity and Transportability: A Formal Approach
Int. tatistical Inst.: Proc. 58th World tatistical Congress, 2011, Dublin (ession IP024) p.335 External Validity and Transportability: A Formal Approach Pearl, Judea University of California, Los Angeles,
More informationCausal and Counterfactual Inference
Forthcoming section in The Handbook of Rationality, MIT press. TECHNICAL REPORT R-485 October 2018 Causal and Counterfactual Inference Judea Pearl University of California, Los Angeles Computer Science
More informationIdentification and Overidentification of Linear Structural Equation Models
In D. D. Lee and M. Sugiyama and U. V. Luxburg and I. Guyon and R. Garnett (Eds.), Advances in Neural Information Processing Systems 29, pre-preceedings 2016. TECHNICAL REPORT R-444 October 2016 Identification
More informationUCLA Department of Statistics Papers
UCLA Department of Statistics Papers Title Comment on `Causal inference, probability theory, and graphical insights' (by Stuart G. Baker) Permalink https://escholarship.org/uc/item/9863n6gg Journal Statistics
More information1 Introduction The research questions that motivate most studies in statistics-based sciences are causal in nature. For example, what is the ecacy of
NEW PAPER TECHNICAL REPORT R-299 February 2002 Causal Inference in Statistics: An Introduction Judea Pearl Cognitive Systems Laboratory Computer Science Department University of California, Los Angeles,
More informationCasual Mediation Analysis
Casual Mediation Analysis Tyler J. VanderWeele, Ph.D. Upcoming Seminar: April 21-22, 2017, Philadelphia, Pennsylvania OXFORD UNIVERSITY PRESS Explanation in Causal Inference Methods for Mediation and Interaction
More informationAn Introduction to Causal Mediation Analysis. Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016
An Introduction to Causal Mediation Analysis Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016 1 Causality In the applications of statistics, many central questions
More informationCausality. Pedro A. Ortega. 18th February Computational & Biological Learning Lab University of Cambridge
Causality Pedro A. Ortega Computational & Biological Learning Lab University of Cambridge 18th February 2010 Why is causality important? The future of machine learning is to control (the world). Examples
More informationhere called \descriptive" (see Section 2.2), which concerns the action of causal forces under natural, rather than experimental conditions, and provid
In Proceedings of the Seventeenth Conference on Uncertainy in Articial Intelligence, San Francisco, CA: Morgan Kaufmann, 411{20, 2001. TECHNICAL REPORT R-273-UAI June 2001 Direct and Indirect Eects Judea
More informationMediation for the 21st Century
Mediation for the 21st Century Ross Boylan ross@biostat.ucsf.edu Center for Aids Prevention Studies and Division of Biostatistics University of California, San Francisco Mediation for the 21st Century
More informationBounds on Direct Effects in the Presence of Confounded Intermediate Variables
Bounds on Direct Effects in the Presence of Confounded Intermediate Variables Zhihong Cai, 1, Manabu Kuroki, 2 Judea Pearl 3 and Jin Tian 4 1 Department of Biostatistics, Kyoto University Yoshida-Konoe-cho,
More informationREASONING WITH CAUSE AND EFFECT
REASONING WITH CAUSE AND EFFECT Judea Pearl University of California Los Angeles The subject of my lecture this evening is CAUSALITY. It is not an easy topic to speak about, but it is a fun topic to speak
More informationTHE SCIENCE OF CAUSE AND EFFECT
HE CIENCE OF CAUE AND EFFEC Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/) OULINE 1. he causal revolution from associations to intervention to counterfactuals 2. he two fundamental
More informationEstimating complex causal effects from incomplete observational data
Estimating complex causal effects from incomplete observational data arxiv:1403.1124v2 [stat.me] 2 Jul 2014 Abstract Juha Karvanen Department of Mathematics and Statistics, University of Jyväskylä, Jyväskylä,
More informationarxiv: v2 [math.st] 4 Mar 2013
Running head:: LONGITUDINAL MEDIATION ANALYSIS 1 arxiv:1205.0241v2 [math.st] 4 Mar 2013 Counterfactual Graphical Models for Longitudinal Mediation Analysis with Unobserved Confounding Ilya Shpitser School
More informationcausal inference at hulu
causal inference at hulu Allen Tran July 17, 2016 Hulu Introduction Most interesting business questions at Hulu are causal Business: what would happen if we did x instead of y? dropped prices for risky
More informationStatistical Models for Causal Analysis
Statistical Models for Causal Analysis Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 Three Modes of Statistical Inference 1. Descriptive Inference: summarizing and exploring
More informationComments on The Role of Large Scale Assessments in Research on Educational Effectiveness and School Development by Eckhard Klieme, Ph.D.
Comments on The Role of Large Scale Assessments in Research on Educational Effectiveness and School Development by Eckhard Klieme, Ph.D. David Kaplan Department of Educational Psychology The General Theme
More informationASA Section on Health Policy Statistics
Direct and Indirect Eects Judea Pearl UCLA, Computer Science Department, Cognitive Systems Laboratory Abstract The direct eect of one event on another can be dened and measured by holding constant all
More informationLocal Characterizations of Causal Bayesian Networks
In M. Croitoru, S. Rudolph, N. Wilson, J. Howse, and O. Corby (Eds.), GKR 2011, LNAI 7205, Berlin Heidelberg: Springer-Verlag, pp. 1-17, 2012. TECHNICAL REPORT R-384 May 2011 Local Characterizations of
More information(or death). This paper deals with the question of estimating the probability of causation from statistical data. Causation has two faces, necessary an
In Annals of Mathematics and Articial Intelligence, Vol. 28, 287{313, 2000. TECHNICAL REPORT R-271-A February 2000 Probabilities of Causation: Bounds and Identication Jin Tian and Judea Pearl Cognitive
More informationCausal Effect Evaluation and Causal Network Learning
and Peking University, China June 25, 2014 and Outline 1 Yule-Simpson paradox Causal effects Surrogate and surrogate paradox 2 and Outline Yule-Simpson paradox Causal effects Surrogate and surrogate paradox
More informationCauses of Effects and Effects of Causes
Short version forthcoming, Journal of Sociological Methods and Research. TECHNICAL REPORT R-431-L October 2014 Causes of Effects and Effects of Causes Judea Pearl University of California, Los Angeles
More informationWhat Counterfactuals Can Be Tested
hat Counterfactuals Can Be Tested Ilya Shpitser, Judea Pearl Cognitive Systems Laboratory Department of Computer Science niversity of California, Los Angeles Los Angeles, CA. 90095 {ilyas, judea}@cs.ucla.edu
More informationThe decision theoretic approach to causal inference OR Rethinking the paradigms of causal modelling
The decision theoretic approach to causal inference OR Rethinking the paradigms of causal modelling A.P.Dawid 1 and S.Geneletti 2 1 University of Cambridge, Statistical Laboratory 2 Imperial College Department
More informationBiometrics Section. x = v y = x + u β β
The Mathematics of Causal Inference in Statistics Judea Pearl UCLA Computer Science Department Los Angeles, CA 90095 USA Abstract The \potential outcome," or Neyman-Rubin (NR) model through which statisticians
More informationTechnical Track Session I:
Impact Evaluation Technical Track Session I: Click to edit Master title style Causal Inference Damien de Walque Amman, Jordan March 8-12, 2009 Click to edit Master subtitle style Human Development Human
More informationIdentifiability in Causal Bayesian Networks: A Gentle Introduction
Identifiability in Causal Bayesian Networks: A Gentle Introduction Marco Valtorta mgv@cse.sc.edu Yimin Huang huang6@cse.sc.edu Department of Computer Science and Engineering University of South Carolina
More informationMediation analysis for different types of Causal questions: Effect of Cause and Cause of Effect
Università degli Studi di Cagliari Dipartimento di Matematica e Informatica Dottorato di Ricerca in Matematica e Calcolo Scientifico Ciclo XXVIII Ph.D. Thesis Mediation analysis for different types of
More informationIdentifiability in Causal Bayesian Networks: A Sound and Complete Algorithm
Identifiability in Causal Bayesian Networks: A Sound and Complete Algorithm Yimin Huang and Marco Valtorta {huang6,mgv}@cse.sc.edu Department of Computer Science and Engineering University of South Carolina
More informationFront-Door Adjustment
Front-Door Adjustment Ethan Fosse Princeton University Fall 2016 Ethan Fosse Princeton University Front-Door Adjustment Fall 2016 1 / 38 1 Preliminaries 2 Examples of Mechanisms in Sociology 3 Bias Formulas
More informationOn Identifying Causal Effects
29 1 Introduction This paper deals with the problem of inferring cause-effect relationships from a combination of data and theoretical assumptions. This problem arises in diverse fields such as artificial
More informationIdentification and Estimation of Causal Effects from Dependent Data
Identification and Estimation of Causal Effects from Dependent Data Eli Sherman esherman@jhu.edu with Ilya Shpitser Johns Hopkins Computer Science 12/6/2018 Eli Sherman Identification and Estimation of
More informationConfounding Equivalence in Causal Inference
In Proceedings of UAI, 2010. In P. Grunwald and P. Spirtes, editors, Proceedings of UAI, 433--441. AUAI, Corvallis, OR, 2010. TECHNICAL REPORT R-343 July 2010 Confounding Equivalence in Causal Inference
More informationInstructor: Sudeepa Roy
CompSci 590.6 Understanding Data: Theory and Applications Lecture 15 Causality in AI Instructor: Sudeepa Roy Email: sudeepa@cs.duke.edu 1 Today s Reading 1. Causes and Explanations: A Structural- Model
More informationCausal Effect Identification in Alternative Acyclic Directed Mixed Graphs
Proceedings of Machine Learning Research vol 73:21-32, 2017 AMBN 2017 Causal Effect Identification in Alternative Acyclic Directed Mixed Graphs Jose M. Peña Linköping University Linköping (Sweden) jose.m.pena@liu.se
More informationCausal Analysis in Social Research
Causal Analysis in Social Research Walter R Davis National Institute of Applied Statistics Research Australia University of Wollongong Frontiers in Social Statistics Metholodogy 8 February 2017 Walter
More informationCausal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies
Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Kosuke Imai Department of Politics Princeton University November 13, 2013 So far, we have essentially assumed
More informationGeneralized Do-Calculus with Testable Causal Assumptions
eneralized Do-Calculus with Testable Causal Assumptions Jiji Zhang Division of Humanities and Social Sciences California nstitute of Technology Pasadena CA 91125 jiji@hss.caltech.edu Abstract A primary
More informationSingle World Intervention Graphs (SWIGs):
Single World Intervention Graphs (SWIGs): Unifying the Counterfactual and Graphical Approaches to Causality Thomas Richardson Department of Statistics University of Washington Joint work with James Robins
More informationThe Doubly-Modifiable Structural Model (DMSM) The Modifiable Structural Model (MSM)
unified theory of counterfactual reasoning hristopher G. Lucas cglucas@cmu.edu Department of Psychology arnegie Mellon University harles Kemp ckemp@cmu.edu Department of Psychology arnegie Mellon University
More informationDirect and Indirect Effects
UAI2001 PEARL 41 1 Direct and Indirect Effects Judea Pearl Cognitive Sstems Laborator Computer Science Department Universit of California, Los Angeles, CA 90024 judea@cs. ucla. edu Abstract The direct
More informationThe cover page of the Encyclopedia of Health Economics (2014) Introduction to Econometric Application in Health Economics
PHPM110062 Teaching Demo The cover page of the Encyclopedia of Health Economics (2014) Introduction to Econometric Application in Health Economics Instructor: Mengcen Qian School of Public Health What
More informationTutorial: Causal Model Search
Tutorial: Causal Model Search Richard Scheines Carnegie Mellon University Peter Spirtes, Clark Glymour, Joe Ramsey, others 1 Goals 1) Convey rudiments of graphical causal models 2) Basic working knowledge
More informationSEM REX B KLINE CONCORDIA D. MODERATION, MEDIATION
ADVANCED SEM REX B KLINE CONCORDIA D1 D. MODERATION, MEDIATION X 1 DY Y DM 1 M D2 topics moderation mmr mpa D3 topics cpm mod. mediation med. moderation D4 topics cma cause mediator most general D5 MMR
More informationTransportability of Causal and Statistical Relations: A Formal Approach
In Proceedings of the 25th AAAI Conference on Artificial Intelligence, August 7 11, 2011, an Francisco, CA. AAAI Press, Menlo Park, CA, pp. 247-254. TECHNICAL REPORT R-372-A August 2011 Transportability
More informationIgnoring the matching variables in cohort studies - when is it valid, and why?
Ignoring the matching variables in cohort studies - when is it valid, and why? Arvid Sjölander Abstract In observational studies of the effect of an exposure on an outcome, the exposure-outcome association
More informationGeneralized Quantifiers Logical and Linguistic Aspects
Generalized Quantifiers Logical and Linguistic Aspects Lecture 1: Formal Semantics and Generalized Quantifiers Dag Westerståhl University of Gothenburg SELLC 2010 Institute for Logic and Cognition, Sun
More informationA Unification of Mediation and Interaction. A 4-Way Decomposition. Tyler J. VanderWeele
Original Article A Unification of Mediation and Interaction A 4-Way Decomposition Tyler J. VanderWeele Abstract: The overall effect of an exposure on an outcome, in the presence of a mediator with which
More informationApplications of Exponential Functions Group Activity 7 STEM Project Week #10
Applications of Exponential Functions Group Activity 7 STEM Project Week #10 In the last activity we looked at exponential functions. We looked at an example of a population growing at a certain rate.
More informationA Linear Microscope for Interventions and Counterfactuals
Forthcoming, Journal of Causal Inference (Causal, Casual, and Curious Section). TECHNICAL REPORT R-459 March 2017 A Linear Microscope for Interventions and Counterfactuals Judea Pearl University of California,
More informationComputational Systems Biology: Biology X
Bud Mishra Room 1002, 715 Broadway, Courant Institute, NYU, New York, USA L#7:(Mar-23-2010) Genome Wide Association Studies 1 The law of causality... is a relic of a bygone age, surviving, like the monarchy,
More informationIntroduction to causal identification. Nidhiya Menon IGC Summer School, New Delhi, July 2015
Introduction to causal identification Nidhiya Menon IGC Summer School, New Delhi, July 2015 Outline 1. Micro-empirical methods 2. Rubin causal model 3. More on Instrumental Variables (IV) Estimating causal
More informationOn the Identification of a Class of Linear Models
On the Identification of a Class of Linear Models Jin Tian Department of Computer Science Iowa State University Ames, IA 50011 jtian@cs.iastate.edu Abstract This paper deals with the problem of identifying
More informationModels of Causality. Roy Dong. University of California, Berkeley
Models of Causality Roy Dong University of California, Berkeley Correlation is not the same as causation. 2 Conditioning is not the same as imputing. 3 Stylized example Suppose, amongst the population,
More informationPath analysis for discrete variables: The role of education in social mobility
Path analysis for discrete variables: The role of education in social mobility Jouni Kuha 1 John Goldthorpe 2 1 London School of Economics and Political Science 2 Nuffield College, Oxford ESRC Research
More informationIdentifying Linear Causal Effects
Identifying Linear Causal Effects Jin Tian Department of Computer Science Iowa State University Ames, IA 50011 jtian@cs.iastate.edu Abstract This paper concerns the assessment of linear cause-effect relationships
More informationCausal Structure Learning and Inference: A Selective Review
Vol. 11, No. 1, pp. 3-21, 2014 ICAQM 2014 Causal Structure Learning and Inference: A Selective Review Markus Kalisch * and Peter Bühlmann Seminar for Statistics, ETH Zürich, CH-8092 Zürich, Switzerland
More informationHelp! Statistics! Mediation Analysis
Help! Statistics! Lunch time lectures Help! Statistics! Mediation Analysis What? Frequently used statistical methods and questions in a manageable timeframe for all researchers at the UMCG. No knowledge
More informationMediation analyses. Advanced Psychometrics Methods in Cognitive Aging Research Workshop. June 6, 2016
Mediation analyses Advanced Psychometrics Methods in Cognitive Aging Research Workshop June 6, 2016 1 / 40 1 2 3 4 5 2 / 40 Goals for today Motivate mediation analysis Survey rapidly developing field in
More informationSingle World Intervention Graphs (SWIGs): A Unification of the Counterfactual and Graphical Approaches to Causality
Single World Intervention Graphs (SWIGs): A Unification of the Counterfactual and Graphical Approaches to Causality Thomas S. Richardson University of Washington James M. Robins Harvard University Working
More information