Causality challenge #2: Pot-Luck
|
|
- Bruno Thornton
- 5 years ago
- Views:
Transcription
1 Causality challenge #2: Pot-Luck Isabelle Guyon, Clopinet Constantin Aliferis and Alexander Statnikov, Vanderbilt Univ. André Elisseeff and Jean-Philippe Pellet, IBM Zürich Gregory F. Cooper, Pittsburg University Peter Spirtes, Carnegie Mellon 1
2 * Motivations * Learning causal structure * * Cross-sectional studies * from experiments * without experiments * Equivalent MB * * Longitudinal studies * Bring your own problem(s) * Motivations 2
3 Causality Workbench February 2007: Project starts. Initial funding of the EU Pascal network. August 15, 2007: Two-year grant from the US National Science Foundation. December 15, 2007: Workbench made alive. First causality challenge: causation an prediction. June 3-4, 2008: WCCI 2008, workshop to discuss the results of the first challenge. September 15, 2008: Start pot-luck challenge. Target: NIPS Fall, 2008: Start developing an interactive workbench. 3
4 Why a new challenge? Causality challenge #1 Favor depth Single well defined task Rigor of performance assessment Causality challenge #2 Favor breadth Many different tasks Encourage creativity 4
5 5 5
6 Pot-Luck challenge CYTO: Causal Protein-Signaling Networks in human T cells. Learn a protein signaling network from multicolor flow cytometry data. N=11 proteins, P~800 samples per experimental condition. E=9 conditions. LOCANET: LOcal CAusal NETwork. Find the local causal structure around a given target variable (depth 3 network) in REGED, CINA, SIDO, MARTI. PROMO: Simulated marketing task. Time series of 1000 promotion variables and 100 product sales. Predict a 1000x100 boolean influence matrix, indicating for each (i,j) element whether the i th promotion has a causal influence of the sales of the j th product. Data is provided as time series, with a daily value for each variable for three years. SIGNET: Abscisic Acid Signaling Network. Determine the set of 43 boolean rules that describe the interactions of the nodes within a plant signaling network. 300 separate Boolean pseudodynamic simulations of the true rules. Model inspired by a true biological system. TIED: Target Information Equivalent Dataset. Illustrates a case in which there are many equivalent Markov boundaries. Find them all. real self eval 6 real artif artif self eval artif artif
7 * Motivations * Learning causal structure * * Cross-sectional studies * from experiments * without experiments * Equivalent MB * * Longitudinal studies * Bring your own problem(s) * Learning causal structure 7
8 What is causality? Many definitions. Pragmatic (engineering) view: predicting the consequences of ACTIONS. Distinct from making predictions in a stationary environment. Canonical methodology: designed experiments. Causal discovery from observational data. 8
9 The language of causal Bayesian networks Bayesian network: Graph with random variables X 1, X 2, X n as nodes. Dependencies represented by edges. Allow us to compute P(X 1, X 2, X n ) as Π i P( X i Parents(X i ) ). Edge directions have no meaning. Causal Bayesian network: egde directions indicate causality. 9
10 Small example Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder LUCAS0: natural Coughing Markov boundary Fatigue Car Accident 10
11 Arrows indicate mechanisms If Lung Cancer (LC) is determined by Smoking (S) and Genetics (G), In the language of BN, use the data table: P(LC=1 S=1, G=1)=, P(LC=0 S=1, G=1)= P(LC=1 S=1, G=0)=, P(LC=0 S=1, G=0)= P(LC=1 S=0, G=1)=, P(LC=0 S=0, G=1)= P(LC=1 S=0, G=0)=, P(LC=0 S=0, G=0)= In the language of Structural Equation Models (SEM), use: LC = f(s, G) + noise where usually f is a linear function. 11
12 Common simplifications Assume a Markov process Assume a DAG Assume causal sufficiency (no hidden common cause) Assume stability or faithfulness (no particular parameterization implying dependencies not reflected by the structure) Assume linearity of relationships Assume Gaussianity of PDF s Discard relationships of low statistical significance Focus on a local neighborhood of a target variable Learn unoriented or partially oriented graphs Assume uniqueness of the Markov boundary 12
13 How about time? Cross-sectional study 13
14 14 How about time? Cross-sectional study Longitudinal study
15 * Motivations * Learning causal structure * * Cross-sectional studies * from experiments * without experiments * Equivalent MB * * Longitudinal studies * Bring your own problem(s) * Learning causal structure from cross-sectional studies: CYTO LOCANET TIED 15
16 Causal models as particular generative models Imagine we have prior knowledge about a few alternative plausible causal models (we basically know the architecture). Fit the parameters of the model to data. Select the model based on goodness of fit (score), perhaps penalizing higher complexity models. Could two models have identical scores? 16
17 Key types of causal relationships 1 Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder Coughing Fatigue Direct cause Car Accident 17
18 Key types of causal relationships 2 Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder Coughing Fatigue Indirect cause (chain) AN LC S Car Accident 18
19 Key types of causal relationships 3 Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder Coughing Fatigue Confounder (fork) YF LC S Car Accident 19
20 How this might look in data Lung cancer Yellow Fingers 20
21 How this might look in data Lung cancer Non-smoking Smoking Simpson s paradox YF LC S Yellow Fingers 21
22 Markov equivalence X 1 Y X 2 X 1 P(X 1, X 2, Y) X 2 Y = P(X 1 X 2, Y) P(Y X 2 ) P(X 2 ) X 1 X 2 Y P(X 1, X 2, Y) = P(Y X 2, X 1 ) P(X 2 X 1 ) P(X 1 ) X 1 X 2 Y P(X 1, X 2, Y) = P(X 1 X 2, Y) P(X 2 Y) P(Y) 22
23 Key types of causal relationships 4 Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder Coughing Fatigue Collider (V-structure) AL LC C Car Accident 23
24 How this might look in data Lung cancer Allergy 24
25 How this might look in data Lung cancer Coughing=1 Coughing=0 Allergy 25
26 No Markov equivalence Colliders (V-structures) : X 1 Y X 2 X 1 Y X 2 P(X 1, X 2, Y) = P(X 2 X 1,Y) P(X 1 ) P(Y) 26
27 Structural methods 1. Build unoriented graph (using conditional independencies). 2. Orient colliders. 3. Add more arrows by constraint propagation without creating new colliders
28 * Motivations * Learning causal structure * * Cross-sectional studies * from experiments * without experiments * Equivalent MB * * Longitudinal studies * Bring your own problem(s) * towards CYTO: using experiments to learn the causal structure 28
29 Manipulating a single variable 1 Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder Coughing Fatigue Direct cause Car Accident Smoking manipulated (disconnected from its direct causes): remains predictive of LC. 29
30 Manipulating a single variable 2 Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder Coughing Fatigue Indirect cause Car Accident Anxiety manipulated: remains predictive of Lung Cancer. 30
31 Manipulating a single variable 3 Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Consequence of common cause (correlated, but not cause) Allergy Coughing Lung Cancer Fatigue Attention Disorder Car Accident Yellow Fingers manipulated: no longer predictive of LC. 31
32 Manipulating a single variable 4 Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics? Allergy Lung Cancer Attention Disorder Coughing Fatigue Direct cause Car Accident Genetics manipulated: remains predictive of LC and AD. 32
33 Manipulating a single variable 5 Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder Coughing Fatigue Direct cause Car Accident Attention disorder manipulated: no longer predictive of Genetics. 33
34 The CYTO problem CD CD28 LFA-1 Zap70 L A LckT VAV SLP-76 PI3K 10 6 RAS PKC 4 Cytohesin JAB-1 Activators PLCg PIP3 Akt 1. a-cd3 2. a-cd28 3. ICAM-2 4. PMA 8 PIP2 7 PKA 5 Raf 5. b2camp Inhibitors 6. G AKT inh MAPKKK MEK4/7 MAPKKK MEK3/6 Mek1/2 Erk1/ Psitect 9. U LY JNK p38 34 Karen Sachs et al
35 * Motivations * Learning causal structure * * Cross-sectional studies * from experiments * without experiments * Equivalent MB * * Longitudinal studies * Bring your own problem(s) * towards LOCANET: learning the causal structure without experiments to predict the consequences of future actions. 35
36 What if we cannot experiment? Experiments may be infeasible, costly or unethical Using only observations we may want to predict the effect of new policies. Policies may consist in manipulating several variables. 36
37 Manipulating a few variables Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder LUCAS1: manipulated Coughing Markov boundary Fatigue Car Accident 37
38 Manipulating all variables Anxiety Peer Pressure Born an Even Day Yellow Fingers Smoking Genetics Allergy Lung Cancer Attention Disorder LUCAS2: manipulated Coughing Markov boundary Fatigue Car Accident 38
39 Causality challenge #1: causation and prediction Task: Predict the target (e.g., Lung cancer) in unmanipulated or manipulated test data. Goals: Introduce ML people to causal discovery problems. Investigate ties between causation and prediction. Findings: Participants used either causal or non-causal feature selection. Good causal discovery (feature set containing the manipulated MB) correlated with good predictions. However, some participants using non-causal feature selection obtained good prediction results. 39
40 Causality challenge #2: The LOCANET problem Task: Find the local causal structure around a given target variable (depth 3 network) in REGED, CINA, SIDO, MARTI. Goal: Analyze more finely to which extent causal discovery methods recover the causal structure and how this affects predicting the target values. 40
41 * Motivations * Learning causal structure * * Cross-sectional studies * from experiments * without experiments * Equivalent MB * * Longitudinal studies * Bring your own problem(s) * TIED Equivalent Markov boundaries 41
42 Equivalent Markov boundaries Y Markov boundary Many almost identical measurements of the same (hidden) variable can lead to many statistically undistinguishable Markov boundaries. 42
43 Target Information Equivalence (TIE) Two disjoint subsets of variables V 1 and V 2 are Target Information Equivalent (TIE) with respect to target Y iff: V 1 Y V 2 Y V 1 Y V 2 V 2 Y V 1 Alexander Statnikov & Constantin Aliferis 43
44 TIE Data (TIED) Exact equivalence X 1 X 2 X 3 X 11 Y Small example of the type of relationships implemented in TIED. The following TIE relations hold in the data: TIE Y (X 1, X 2 ) TIE Y (X 1, X 3 ) TIE Y (X 1, X 11 ) TIE Y (X 2, X 3 ) TIE Y (X 2, X 11 ) TIE Y (X 3, X 11 ) TIE X11 (X 1, X 2 ) TIE X11 (X 1, X 3 ) TIE X11 (X 2, X 3 ) Notice that variables X 1, X 2, X 3, X 11, and Y are not deterministically related. Alexander Statnikov & Constantin Aliferis 44
45 * Motivations * Learning causal structure * * Cross-sectional studies * from experiments * without experiments * Equivalent MB * * Longitudinal studies * Bring your own problem(s) * Learning causal structure from longitudinal studies: SIGNET PROMO 45
46 SIGNET: a plant signaling network Plants loose water and take in carbone dioxide through microscopic pores. During drought, plant hormone abiscisic acid (ABA) inhibits pore opening (important for the genetic engineering of new drought resistant plants). Unraveling the ABA signal transduction network took years of research. A recent dynamic model synthesizes many findings (Li, Assmann, Albert, PLOS, 2006). The model is used by Jenkins and Soni to generate artificial data. The problem is to reconstruct the network from the data. 46
47 Abscisic Acid Signaling Network Li, Assmann, Albert, PLOS,
48 SIGNET: sample data time Boolean model; asynchronous updates - 43 nodes simulations Example of asynchronous updates for a 4-node network: 48
49 PROMO: simulated marketing task 100 products 1000 promotions 3 years of daily data Goal: quantify the effect of promotions on sales Jean-Philippe Pellet products 49 promotions
50 PROMO: schematically The difficulties include: - non iid samples - seasonal effects - promotions are binary, sales are continuous - the problem is more quantifying the relationships than determining the causal skeleton 1000 other
51 * Motivations * Learning causal structure * * Cross-sectional studies * from experiments * without experiments * Equivalent MB * * Longitudinal studies * Bring your own problem * Pot-luck challenge: Bring your own problem 51
52 From NIPS 2006 workshop 1. Predict the consequences of a manipulation (similar to a usual predictive modeling task, but the test data is no longer distributed in the same way as the training data; the system undergoes a manipulation to produce the test data). 2. Determine what manipulations are needed to reach a desired system state with maximum probability (e.g., select variables and propose values to achieve a certain value of a response/target variable, with perhaps a cost per variable). 3. Propose system queries to acquire more training data, i.e. design experiments, with perhaps an associated cost per variable and per sample and perhaps with constraints on variables, which cannot be controllable. 4. Determine all causal relationships between variables. 5. Determine a local causal region around a response/target variable (causal adjacency). 6. Determine the source cause(s) for a response/target variable. 7. Determine for all variables whether they are, with respect to a response/target variable: cause, effect, consequence of a common cause, cause of a common effect, or unrelated. 8. Predict the existence of unmeasured variables (not part of the set of variables provided in the data), which are potential confounders (are common causes of an observed variable and the target). 9. Predict which variables called relevant by feature selection algorithms are potentially causally irrelevant because their correlation to the target is the result of an experimental artifact (e.g., sampling bias or systematic error). 10. Determine a causal order of all variables. 11. Determine a causal direction in time series data in which one variable is causing the other. 12. Determine the direction of time in a time series (mostly of fundamental rather than practical interest). 13. Incorporate prior knowledge in causal discovery. 14. Predict counterfactuals. 52
53 September 15, 2008: challenge start. October 15, 2008: deadline for (optional) submission of milestone challenge results. October 24, 2008: workshop abstracts due. November 12, 2008: challenge ends (last day to submit challenge results). November 21, 2008: JMLR proceedings paper submission deadline. December 12, 2008: challenge results publicly released; workshop. 53
54 Prizes Four prizes (free NIPS workshop entrance or $200). Best solution to one or more problems: 3 prizes. Best problem:1 prize. All competitors must submit a 6-page paper. Criteria: performance/usefulness, novelty/originality, sanity, insight, reproducibility, clarity. 54
Automatic Causal Discovery
Automatic Causal Discovery Richard Scheines Peter Spirtes, Clark Glymour Dept. of Philosophy & CALD Carnegie Mellon 1 Outline 1. Motivation 2. Representation 3. Discovery 4. Using Regression for Causal
More informationInferring Protein-Signaling Networks II
Inferring Protein-Signaling Networks II Lectures 15 Nov 16, 2011 CSE 527 Computational Biology, Fall 2011 Instructor: Su-In Lee TA: Christopher Miles Monday & Wednesday 12:00-1:20 Johnson Hall (JHN) 022
More informationCausality: Objectives and Assessment Challenges in Machine Learning, Volume 4
Causality: Objectives and Assessment Challenges in Machine Learning, Volume 4 Causality: Objectives and Assessment Challenges in Machine Learning, Volume 4 Isabelle Guyon, Dominik Janzing, and Bernhard
More informationCausal Discovery. Richard Scheines. Peter Spirtes, Clark Glymour, and many others. Dept. of Philosophy & CALD Carnegie Mellon
Causal Discovery Richard Scheines Peter Spirtes, Clark Glymour, and many others Dept. of Philosophy & CALD Carnegie Mellon Graphical Models --11/30/05 1 Outline 1. Motivation 2. Representation 3. Connecting
More informationCausality: Objectives and Assessment
JMLR Workshop and Conference Proceedings 6:1 38 NIPS 2008 workshop on causality Isabelle Guyon Clopinet, California, USA Causality: Objectives and Assessment ISABELLE@CLOPINET.COM Dominik Janzing DOMINIK.JANZING@TUEBINGEN.MPG.DE
More informationBayesian Network Modelling
Bayesian Network Modelling with Examples scutari@stats.ox.ac.uk Department of Statistics November 28, 2016 What Are Bayesian Networks? What Are Bayesian Networks? A Graph and a Probability Distribution
More informationGraphical models and causality: Directed acyclic graphs (DAGs) and conditional (in)dependence
Graphical models and causality: Directed acyclic graphs (DAGs) and conditional (in)dependence General overview Introduction Directed acyclic graphs (DAGs) and conditional independence DAGs and causal effects
More informationCarnegie Mellon Pittsburgh, Pennsylvania 15213
A Tutorial On Causal Inference Peter Spirtes August 4, 2009 Technical Report No. CMU-PHIL-183 Philosophy Methodology Logic Carnegie Mellon Pittsburgh, Pennsylvania 15213 1. Introduction A Tutorial On Causal
More informationIntroduction to Causal Calculus
Introduction to Causal Calculus Sanna Tyrväinen University of British Columbia August 1, 2017 1 / 1 2 / 1 Bayesian network Bayesian networks are Directed Acyclic Graphs (DAGs) whose nodes represent random
More informationCausal Inference & Reasoning with Causal Bayesian Networks
Causal Inference & Reasoning with Causal Bayesian Networks Neyman-Rubin Framework Potential Outcome Framework: for each unit k and each treatment i, there is a potential outcome on an attribute U, U ik,
More informationProbabilistic Causal Models
Probabilistic Causal Models A Short Introduction Robin J. Evans www.stat.washington.edu/ rje42 ACMS Seminar, University of Washington 24th February 2011 1/26 Acknowledgements This work is joint with Thomas
More informationCausal Bayesian networks. Peter Antal
Causal Bayesian networks Peter Antal antal@mit.bme.hu A.I. 4/8/2015 1 Can we represent exactly (in)dependencies by a BN? From a causal model? Suff.&nec.? Can we interpret edges as causal relations with
More informationSupplementary material to Structure Learning of Linear Gaussian Structural Equation Models with Weak Edges
Supplementary material to Structure Learning of Linear Gaussian Structural Equation Models with Weak Edges 1 PRELIMINARIES Two vertices X i and X j are adjacent if there is an edge between them. A path
More informationBayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2014
Bayesian Networks: Construction, Inference, Learning and Causal Interpretation Volker Tresp Summer 2014 1 Introduction So far we were mostly concerned with supervised learning: we predicted one or several
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 3 Linear
More informationBayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2016
Bayesian Networks: Construction, Inference, Learning and Causal Interpretation Volker Tresp Summer 2016 1 Introduction So far we were mostly concerned with supervised learning: we predicted one or several
More informationLocal Structure Discovery in Bayesian Networks
1 / 45 HELSINGIN YLIOPISTO HELSINGFORS UNIVERSITET UNIVERSITY OF HELSINKI Local Structure Discovery in Bayesian Networks Teppo Niinimäki, Pekka Parviainen August 18, 2012 University of Helsinki Department
More informationDistinguishing between Cause and Effect: Estimation of Causal Graphs with two Variables
Distinguishing between Cause and Effect: Estimation of Causal Graphs with two Variables Jonas Peters ETH Zürich Tutorial NIPS 2013 Workshop on Causality 9th December 2013 F. H. Messerli: Chocolate Consumption,
More informationPDF hosted at the Radboud Repository of the Radboud University Nijmegen
PDF hosted at the Radboud Repository of the Radboud University Nijmegen The following full text is a preprint version which may differ from the publisher's version. For additional information about this
More informationChallenges (& Some Solutions) and Making Connections
Challenges (& Some Solutions) and Making Connections Real-life Search All search algorithm theorems have form: If the world behaves like, then (probability 1) the algorithm will recover the true structure
More informationLearning in Bayesian Networks
Learning in Bayesian Networks Florian Markowetz Max-Planck-Institute for Molecular Genetics Computational Molecular Biology Berlin Berlin: 20.06.2002 1 Overview 1. Bayesian Networks Stochastic Networks
More informationAdvances in Causal Structure Learning
Advances in Causal Structure Learning Theory and Algorithms Constantin Aliferis, Gregory Cooper, Andre Elisseeff, Isabelle Guyon, and Peter Spirtes (Eds.) Challenges in Machine Learning, Volume 8 2014
More informationTutorial: Causal Model Search
Tutorial: Causal Model Search Richard Scheines Carnegie Mellon University Peter Spirtes, Clark Glymour, Joe Ramsey, others 1 Goals 1) Convey rudiments of graphical causal models 2) Basic working knowledge
More informationBayesian networks as causal models. Peter Antal
Bayesian networks as causal models Peter Antal antal@mit.bme.hu A.I. 3/20/2018 1 Can we represent exactly (in)dependencies by a BN? From a causal model? Suff.&nec.? Can we interpret edges as causal relations
More informationArrowhead completeness from minimal conditional independencies
Arrowhead completeness from minimal conditional independencies Tom Claassen, Tom Heskes Radboud University Nijmegen The Netherlands {tomc,tomh}@cs.ru.nl Abstract We present two inference rules, based on
More informationMachine Learning Summer School
Machine Learning Summer School Lecture 3: Learning parameters and structure Zoubin Ghahramani zoubin@eng.cam.ac.uk http://learning.eng.cam.ac.uk/zoubin/ Department of Engineering University of Cambridge,
More informationLearning of Causal Relations
Learning of Causal Relations John A. Quinn 1 and Joris Mooij 2 and Tom Heskes 2 and Michael Biehl 3 1 Faculty of Computing & IT, Makerere University P.O. Box 7062, Kampala, Uganda 2 Institute for Computing
More informationChris Bishop s PRML Ch. 8: Graphical Models
Chris Bishop s PRML Ch. 8: Graphical Models January 24, 2008 Introduction Visualize the structure of a probabilistic model Design and motivate new models Insights into the model s properties, in particular
More informationCausal Associative Classification
Causal Associative Classification 1 Department of Computer Science Hefei University of Technology Hefei, 230009, China Kui Yu 1, Xindong Wu 1,2, Wei Ding 3, Hao Wang 1, and Hongliang Yao 1 2 Department
More informationUndirected Graphical Models
Outline Hong Chang Institute of Computing Technology, Chinese Academy of Sciences Machine Learning Methods (Fall 2012) Outline Outline I 1 Introduction 2 Properties Properties 3 Generative vs. Conditional
More informationStructure Learning in Causal Cyclic Networks
JMLR Workshop and Conference Proceedings 6:165 176 NIPS 2008 workshop on causality Structure Learning in Causal Cyclic Networks Sleiman Itani * 77 Massachusetts Ave, 32-D760 Cambridge, MA, 02139, USA Mesrob
More informationarxiv: v2 [cs.lg] 9 Mar 2017
Journal of Machine Learning Research? (????)??-?? Submitted?/??; Published?/?? Joint Causal Inference from Observational and Experimental Datasets arxiv:1611.10351v2 [cs.lg] 9 Mar 2017 Sara Magliacane
More informationCausal Discovery Methods Using Causal Probabilistic Networks
ausal iscovery Methods Using ausal Probabilistic Networks MINFO 2004, T02: Machine Learning Methods for ecision Support and iscovery onstantin F. liferis & Ioannis Tsamardinos iscovery Systems Laboratory
More informationBayesian Networks Introduction to Machine Learning. Matt Gormley Lecture 24 April 9, 2018
10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University Bayesian Networks Matt Gormley Lecture 24 April 9, 2018 1 Homework 7: HMMs Reminders
More informationAbstract. Three Methods and Their Limitations. N-1 Experiments Suffice to Determine the Causal Relations Among N Variables
N-1 Experiments Suffice to Determine the Causal Relations Among N Variables Frederick Eberhardt Clark Glymour 1 Richard Scheines Carnegie Mellon University Abstract By combining experimental interventions
More informationA Decision Theoretic Approach to Causality
A Decision Theoretic Approach to Causality Vanessa Didelez School of Mathematics University of Bristol (based on joint work with Philip Dawid) Bordeaux, June 2011 Based on: Dawid & Didelez (2010). Identifying
More informationReview: Bayesian learning and inference
Review: Bayesian learning and inference Suppose the agent has to make decisions about the value of an unobserved query variable X based on the values of an observed evidence variable E Inference problem:
More informationInferring Causal Phenotype Networks from Segregating Populat
Inferring Causal Phenotype Networks from Segregating Populations Elias Chaibub Neto chaibub@stat.wisc.edu Statistics Department, University of Wisconsin - Madison July 15, 2008 Overview Introduction Description
More informationTowards an extension of the PC algorithm to local context-specific independencies detection
Towards an extension of the PC algorithm to local context-specific independencies detection Feb-09-2016 Outline Background: Bayesian Networks The PC algorithm Context-specific independence: from DAGs to
More informationInferring the Causal Decomposition under the Presence of Deterministic Relations.
Inferring the Causal Decomposition under the Presence of Deterministic Relations. Jan Lemeire 1,2, Stijn Meganck 1,2, Francesco Cartella 1, Tingting Liu 1 and Alexander Statnikov 3 1-ETRO Department, Vrije
More informationOn Causal Explanations of Quantum Correlations
On Causal Explanations of Quantum Correlations Rob Spekkens Perimeter Institute From XKCD comics Quantum Information and Foundations of Quantum Mechanics workshop Vancouver, July 2, 2013 Simpson s Paradox
More informationarxiv: v1 [stat.ml] 13 Mar 2018
SAM: Structural Agnostic Model, Causal Discovery and Penalized Adversarial Learning arxiv:1803.04929v1 [stat.ml] 13 Mar 2018 Diviyan Kalainathan 1, Olivier Goudet 1, Isabelle Guyon 1, David Lopez-Paz 2,
More informationCausal Effect Evaluation and Causal Network Learning
and Peking University, China June 25, 2014 and Outline 1 Yule-Simpson paradox Causal effects Surrogate and surrogate paradox 2 and Outline Yule-Simpson paradox Causal effects Surrogate and surrogate paradox
More informationBN Semantics 3 Now it s personal!
Readings: K&F: 3.3, 3.4 BN Semantics 3 Now it s personal! Graphical Models 10708 Carlos Guestrin Carnegie Mellon University September 22 nd, 2008 10-708 Carlos Guestrin 2006-2008 1 Independencies encoded
More informationBayesian Networks (Part II)
10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University Bayesian Networks (Part II) Graphical Model Readings: Murphy 10 10.2.1 Bishop 8.1,
More informationProbabilistic Reasoning. (Mostly using Bayesian Networks)
Probabilistic Reasoning (Mostly using Bayesian Networks) Introduction: Why probabilistic reasoning? The world is not deterministic. (Usually because information is limited.) Ways of coping with uncertainty
More informationLecture 15: MCMC Sanjeev Arora Elad Hazan. COS 402 Machine Learning and Artificial Intelligence Fall 2016
Lecture 15: MCMC Sanjeev Arora Elad Hazan COS 402 Machine Learning and Artificial Intelligence Fall 2016 Course progress Learning from examples Definition + fundamental theorem of statistical learning,
More informationSTAT 598L Probabilistic Graphical Models. Instructor: Sergey Kirshner. Bayesian Networks
STAT 598L Probabilistic Graphical Models Instructor: Sergey Kirshner Bayesian Networks Representing Joint Probability Distributions 2 n -1 free parameters Reducing Number of Parameters: Conditional Independence
More informationLecture 6: Graphical Models: Learning
Lecture 6: Graphical Models: Learning 4F13: Machine Learning Zoubin Ghahramani and Carl Edward Rasmussen Department of Engineering, University of Cambridge February 3rd, 2010 Ghahramani & Rasmussen (CUED)
More informationLearning Causal Bayesian Network Structures from. Experimental Data
Learning Causal Bayesian Network Structures from Experimental Data Byron Ellis Baxter Labs in Genetic Pharmacology Stanford University Medical School Stanford University, Stanford, CA 94305 email: bcellis@stanford.edu
More informationANALYTIC COMPARISON. Pearl and Rubin CAUSAL FRAMEWORKS
ANALYTIC COMPARISON of Pearl and Rubin CAUSAL FRAMEWORKS Content Page Part I. General Considerations Chapter 1. What is the question? 16 Introduction 16 1. Randomization 17 1.1 An Example of Randomization
More informationarxiv: v3 [cs.lg] 26 Jan 2017
Ancestral Causal Inference Sara Magliacane VU Amsterdam & University of Amsterdam sara.magliacane@gmail.com Tom Claassen Radboud University Nijmegen tomc@cs.ru.nl arxiv:606.07035v3 [cs.lg] 26 Jan 207 Joris
More informationCausal Discovery by Computer
Causal Discovery by Computer Clark Glymour Carnegie Mellon University 1 Outline 1. A century of mistakes about causation and discovery: 1. Fisher 2. Yule 3. Spearman/Thurstone 2. Search for causes is statistical
More informationDistinguishing Causes from Effects using Nonlinear Acyclic Causal Models
JMLR Workshop and Conference Proceedings 6:17 164 NIPS 28 workshop on causality Distinguishing Causes from Effects using Nonlinear Acyclic Causal Models Kun Zhang Dept of Computer Science and HIIT University
More informationBayesian Networks. Motivation
Bayesian Networks Computer Sciences 760 Spring 2014 http://pages.cs.wisc.edu/~dpage/cs760/ Motivation Assume we have five Boolean variables,,,, The joint probability is,,,, How many state configurations
More informationBelief net structure learning from uncertain interventions
Journal of Machine Learning Research (2) -48 Submitted 4/; Published / Belief net structure learning from uncertain interventions Daniel Eaton Kevin Murphy University of British Columbia Department of
More informationInferring Protein-Signaling Networks
Inferring Protein-Signaling Networks Lectures 14 Nov 14, 2011 CSE 527 Computational Biology, Fall 2011 Instructor: Su-In Lee TA: Christopher Miles Monday & Wednesday 12:00-1:20 Johnson Hall (JHN) 022 1
More informationGraphical Model Selection
May 6, 2013 Trevor Hastie, Stanford Statistics 1 Graphical Model Selection Trevor Hastie Stanford University joint work with Jerome Friedman, Rob Tibshirani, Rahul Mazumder and Jason Lee May 6, 2013 Trevor
More informationCombining Experiments to Discover Linear Cyclic Models with Latent Variables
Combining Experiments to Discover Linear Cyclic Models with Latent Variables Frederick Eberhardt Patrik O. Hoyer Richard Scheines Department of Philosophy CSAIL, MIT Department of Philosophy Washington
More informationSimplicity of Additive Noise Models
Simplicity of Additive Noise Models Jonas Peters ETH Zürich - Marie Curie (IEF) Workshop on Simplicity and Causal Discovery Carnegie Mellon University 7th June 2014 contains joint work with... ETH Zürich:
More informationarxiv: v2 [cs.lg] 11 Nov 2016
Ancestral Causal Inference Sara Magliacane VU Amsterdam, University of Amsterdam sara.magliacane@gmail.com Tom Claassen Radboud University Nijmegen tomc@cs.ru.nl arxiv:606.07035v2 [cs.lg] Nov 206 Joris
More informationFrom Causality, Second edition, Contents
From Causality, Second edition, 2009. Preface to the First Edition Preface to the Second Edition page xv xix 1 Introduction to Probabilities, Graphs, and Causal Models 1 1.1 Introduction to Probability
More informationCOMP538: Introduction to Bayesian Networks
COMP538: Introduction to Bayesian Networks Lecture 9: Optimal Structure Learning Nevin L. Zhang lzhang@cse.ust.hk Department of Computer Science and Engineering Hong Kong University of Science and Technology
More informationEE562 ARTIFICIAL INTELLIGENCE FOR ENGINEERS
EE562 ARTIFICIAL INTELLIGENCE FOR ENGINEERS Lecture 16, 6/1/2005 University of Washington, Department of Electrical Engineering Spring 2005 Instructor: Professor Jeff A. Bilmes Uncertainty & Bayesian Networks
More informationAnother look at Bayesian. inference
Another look at Bayesian A general scenario: - Query variables: X inference - Evidence (observed) variables and their values: E = e - Unobserved variables: Y Inference problem: answer questions about the
More informationIntroduction to Artificial Intelligence. Unit # 11
Introduction to Artificial Intelligence Unit # 11 1 Course Outline Overview of Artificial Intelligence State Space Representation Search Techniques Machine Learning Logic Probabilistic Reasoning/Bayesian
More informationCausality in Time Series Challenges in Machine Learning, Volume 5
Causality in Time Series Challenges in Machine Learning, Volume 5 Causality in Time Series Challenges in Machine Learning, Volume 5 Florin Popescu and Isabelle Guyon, editors Nicola Talbot, production
More informationA graph contains a set of nodes (vertices) connected by links (edges or arcs)
BOLTZMANN MACHINES Generative Models Graphical Models A graph contains a set of nodes (vertices) connected by links (edges or arcs) In a probabilistic graphical model, each node represents a random variable,
More informationThe Origin of Deep Learning. Lili Mou Jan, 2015
The Origin of Deep Learning Lili Mou Jan, 2015 Acknowledgment Most of the materials come from G. E. Hinton s online course. Outline Introduction Preliminary Boltzmann Machines and RBMs Deep Belief Nets
More informationLearning With Bayesian Networks. Markus Kalisch ETH Zürich
Learning With Bayesian Networks Markus Kalisch ETH Zürich Inference in BNs - Review P(Burglary JohnCalls=TRUE, MaryCalls=TRUE) Exact Inference: P(b j,m) = c Sum e Sum a P(b)P(e)P(a b,e)p(j a)p(m a) Deal
More informationMachine Learning Summer School
Machine Learning Summer School Lecture 1: Introduction to Graphical Models Zoubin Ghahramani zoubin@eng.cam.ac.uk http://learning.eng.cam.ac.uk/zoubin/ epartment of ngineering University of ambridge, UK
More informationThe TETRAD Project: Constraint Based Aids to Causal Model Specification
The TETRAD Project: Constraint Based Aids to Causal Model Specification Richard Scheines, Peter Spirtes, Clark Glymour, Christopher Meek and Thomas Richardson Department of Philosophy, Carnegie Mellon
More informationCausal Bayesian networks. Peter Antal
Causal Bayesian networks Peter Antal antal@mit.bme.hu A.I. 11/25/2015 1 Can we represent exactly (in)dependencies by a BN? From a causal model? Suff.&nec.? Can we interpret edges as causal relations with
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 11 Project
More informationLearning Causal Bayesian Networks from Observations and Experiments: A Decision Theoretic Approach
Learning Causal Bayesian Networks from Observations and Experiments: A Decision Theoretic Approach Stijn Meganck 1, Philippe Leray 2, and Bernard Manderick 1 1 Vrije Universiteit Brussel, Pleinlaan 2,
More informationConditional Independence
Conditional Independence Sargur Srihari srihari@cedar.buffalo.edu 1 Conditional Independence Topics 1. What is Conditional Independence? Factorization of probability distribution into marginals 2. Why
More informationCausal Modeling with Generative Neural Networks
Causal Modeling with Generative Neural Networks Michele Sebag TAO, CNRS INRIA LRI Université Paris-Sud Joint work: D. Kalainathan, O. Goudet, I. Guyon, M. Hajaiej, A. Decelle, C. Furtlehner https://arxiv.org/abs/1709.05321
More informationAdvances in Cyclic Structural Causal Models
Advances in Cyclic Structural Causal Models Joris Mooij j.m.mooij@uva.nl June 1st, 2018 Joris Mooij (UvA) Rotterdam 2018 2018-06-01 1 / 41 Part I Introduction to Causality Joris Mooij (UvA) Rotterdam 2018
More informationSTA 414/2104: Machine Learning
STA 414/2104: Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistics! rsalakhu@cs.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 9 Sequential Data So far
More informationCausality II: How does causal inference fit into public health and what it is the role of statistics?
Causality II: How does causal inference fit into public health and what it is the role of statistics? Statistics for Psychosocial Research II November 13, 2006 1 Outline Potential Outcomes / Counterfactual
More informationCAUSALITY. Models, Reasoning, and Inference 1 CAMBRIDGE UNIVERSITY PRESS. Judea Pearl. University of California, Los Angeles
CAUSALITY Models, Reasoning, and Inference Judea Pearl University of California, Los Angeles 1 CAMBRIDGE UNIVERSITY PRESS Preface page xiii 1 Introduction to Probabilities, Graphs, and Causal Models 1
More informationCausal Structure Learning and Inference: A Selective Review
Vol. 11, No. 1, pp. 3-21, 2014 ICAQM 2014 Causal Structure Learning and Inference: A Selective Review Markus Kalisch * and Peter Bühlmann Seminar for Statistics, ETH Zürich, CH-8092 Zürich, Switzerland
More informationDirected Graphical Models or Bayesian Networks
Directed Graphical Models or Bayesian Networks Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Bayesian Networks One of the most exciting recent advancements in statistical AI Compact
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 7 Approximate
More informationIntroduction to Probabilistic Graphical Models
Introduction to Probabilistic Graphical Models Kyu-Baek Hwang and Byoung-Tak Zhang Biointelligence Lab School of Computer Science and Engineering Seoul National University Seoul 151-742 Korea E-mail: kbhwang@bi.snu.ac.kr
More informationPDF hosted at the Radboud Repository of the Radboud University Nijmegen
PDF hosted at the Radboud Repository of the Radboud University Nijmegen The following full text is an author's version which may differ from the publisher's version. For additional information about this
More informationMeasurement Error and Causal Discovery
Measurement Error and Causal Discovery Richard Scheines & Joseph Ramsey Department of Philosophy Carnegie Mellon University Pittsburgh, PA 15217, USA 1 Introduction Algorithms for causal discovery emerged
More informationCenter for Causal Discovery: Summer Workshop
Center for Causal Discovery: Summer Workshop - 2015 June 8-11, 2015 Carnegie Mellon University 1 Goals 1) Working knowledge of graphical causal models 2) Basic working knowledge of Tetrad V 3) Basic understanding
More informationLearning causal network structure from multiple (in)dependence models
Learning causal network structure from multiple (in)dependence models Tom Claassen Radboud University, Nijmegen tomc@cs.ru.nl Abstract Tom Heskes Radboud University, Nijmegen tomh@cs.ru.nl We tackle the
More informationJOINT PROBABILISTIC INFERENCE OF CAUSAL STRUCTURE
JOINT PROBABILISTIC INFERENCE OF CAUSAL STRUCTURE Dhanya Sridhar Lise Getoor U.C. Santa Cruz KDD Workshop on Causal Discovery August 14 th, 2016 1 Outline Motivation Problem Formulation Our Approach Preliminary
More informationComputational Genomics. Systems biology. Putting it together: Data integration using graphical models
02-710 Computational Genomics Systems biology Putting it together: Data integration using graphical models High throughput data So far in this class we discussed several different types of high throughput
More informationBayesian Networks. Marcello Cirillo PhD Student 11 th of May, 2007
Bayesian Networks Marcello Cirillo PhD Student 11 th of May, 2007 Outline General Overview Full Joint Distributions Bayes' Rule Bayesian Network An Example Network Everything has a cost Learning with Bayesian
More informationLEARNING CAUSAL EFFECTS: BRIDGING INSTRUMENTS AND BACKDOORS
LEARNING CAUSAL EFFECTS: BRIDGING INSTRUMENTS AND BACKDOORS Ricardo Silva Department of Statistical Science and Centre for Computational Statistics and Machine Learning, UCL Fellow, Alan Turing Institute
More informationMACHINE LEARNING FOR CAUSE-EFFECT PAIRS DETECTION. Mehreen Saeed CLE Seminar 11 February, 2014.
MACHINE LEARNING FOR CAUSE-EFFECT PAIRS DETECTION Mehreen Saeed CLE Seminar 11 February, 214. WHY CAUSALITY. Polio drops can cause polio epidemics (The Nation, January 214) A supernova explosion causes
More informationGLOBEX Bioinformatics (Summer 2015) Genetic networks and gene expression data
GLOBEX Bioinformatics (Summer 2015) Genetic networks and gene expression data 1 Gene Networks Definition: A gene network is a set of molecular components, such as genes and proteins, and interactions between
More informationALGORITHMS FOR DISCOVERY OF MULTIPLE MARKOV BOUNDARIES: APPLICATION TO THE MOLECULAR SIGNATURE MULTIPLICITY PROBLEM. Alexander Romanovich Statnikov
ALGORITHMS FOR DISCOVERY OF MULTIPLE MARKOV BOUNDARIES: APPLICATION TO THE MOLECULAR SIGNATURE MULTIPLICITY PROBLEM By Alexander Romanovich Statnikov Dissertation Submitted to the Faculty of the Graduate
More informationCS839: Probabilistic Graphical Models. Lecture 7: Learning Fully Observed BNs. Theo Rekatsinas
CS839: Probabilistic Graphical Models Lecture 7: Learning Fully Observed BNs Theo Rekatsinas 1 Exponential family: a basic building block For a numeric random variable X p(x ) =h(x)exp T T (x) A( ) = 1
More informationCausality in Econometrics (3)
Graphical Causal Models References Causality in Econometrics (3) Alessio Moneta Max Planck Institute of Economics Jena moneta@econ.mpg.de 26 April 2011 GSBC Lecture Friedrich-Schiller-Universität Jena
More informationCausal Directed Acyclic Graphs
Causal Directed Acyclic Graphs Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Causal DAGs Stat186/Gov2002 Fall 2018 1 / 15 Elements of DAGs (Pearl. 2000.
More informationAn Improved IAMB Algorithm for Markov Blanket Discovery
JOURNAL OF COMPUTERS, VOL. 5, NO., NOVEMBER 00 755 An Improved IAMB Algorithm for Markov Blanket Discovery Yishi Zhang School of Software Engineering, Huazhong University of Science and Technology, Wuhan,
More information