Comments on The Role of Large Scale Assessments in Research on Educational Effectiveness and School Development by Eckhard Klieme, Ph.D.
|
|
- Bartholomew Hunter
- 6 years ago
- Views:
Transcription
1 Comments on The Role of Large Scale Assessments in Research on Educational Effectiveness and School Development by Eckhard Klieme, Ph.D. David Kaplan Department of Educational Psychology
2 The General Theme Definition of Condition for This paper addresses a large number of important issues that go well beyond Eckhard s presentation: 1. The paper presents a very nice and succinct history of I. 2. The paper raises important issues around problems of causal inference in the context of I. 3. The paper presents some empirical findings that address what can be learned from I and how I can be improved for educational effectiveness studies. In the time I have, I would like to focus on issues raised in this paper regarding causal inference in I. ILSA /18
3 Important Features of I Definition of Condition for Among the many uses of I that Eckhard articulates, an important use is that I can establish a knowledge base regarding educational effectiveness. We come to understand educational effectiveness by unpacking the inputs, processes and outputs of the educational system. But inputs, processes, and outputs exist, as Eckhard notes, within contexts. This leads to the CIPO model which we find underlies our work on PISA of which Eckhard and others has made substantial contributions. Unpacking the CIPO model also requires accounting for the fact that these processes are, by definition, mediators, and hence structural specifications are required. The CIPO model, as Eckhard points out, is also multilevel, and therefore multilevel specifications are required. Finally, the CIPO model implies an underlying dynamic, and this needs to be considered as well. ILSA /18
4 Issues of Causal Definition of Condition for Eckhard then goes on to raise issues regarding the limitations of I for effectiveness studies, and for drawing causal inferences in particular. Naturally all data collection and design paradigms have limitations (e.g. generalizability of RCTs), and those that are raised by Eckhard are important to note. However, I am not as pessimistic about using I for causal inference as Eckhard seems to be, and I would like to attend to certain issues that I think might have a solution along the lines of the enhancements to I raised by Eckhard. Of course, there is always the chance that I am a naive optimist. But first...my biases. ILSA /18
5 Definition of Condition for My orientation is toward a structural approach to causal inference, but I am a pluralist in the sense of the philosopher Nancy Cartwright (assuming I understood her). I believe that there are many ways to get at how interventions might lead to change. I also believe that the limitations of design constrain how we might assess causal effects. Sometimes RCTs are needed, sometimes I are available and should be exploited. I also believe that a distinction can be made between studying the effects of causes versus the causes of effects (Holland, 1986). Whereas the focus in education effectiveness (at least in the US) has been on the former via RCTs, I believe that I are very well suited for the latter. Despite my pluralism, I accept that the potential outcomes framework of Neyman and Rubin is the strongest conceptual framework for causal inference. ILSA /18
6 Definition of Condition for To fully realize the utility of I for examining the causes of effects, we need to worry about some issues that Eckard raises, but not others. Focusing on PISA, Eckhard understandably worries that I can t be used for causal inference because prior achievement is not obtained. However, as PISA is a yield study and not an achievement test, it is unclear what prior yield would mean in this context. Of course, longitudinal data would be ideal, but then yield would indicate a school or classroom effect, changing, perhaps, the meaning the goals of PISA. Eckhard is also concerned that ANCOVA or propensity score balancing might not be successful because prior achievement variable is not available. However, as nice as having prior achievement would be, we know (e.g. Steiner, et al., 2010) that we can achieve very good balance with a judicious choice of covariates, reliably measured and relevant to the selection mechanism. QEGs need to consider this carefully. ILSA /18
7 Definition of Condition for It is this judicious choice of covariates that Eckhard raises as the most important limitation of I and I agree. Regardless of whether one desires to use I to study a particular quasi-experimental effect or (but not in opposition to) specifying a large multilevel structural model, the choice of covariates and how they are measured is of utmost importance. The issue of how the inputs and processes are measured allows one to consider the counterfactual/potential outcomes theory of causal inference more seriously in the ILSA context. My view, which I have shared with Eckhard, examines how I can be used within the counterfactual/potential outcomes framework, rooted in Mackie s (1980) idea of the INUS condition, Woodward s (2003) ideas of manipulability, and Hoover s (e.g. 2001) structural econometric perspective. ILSA /18
8 The Counterfactual Definition of Definition of Condition for To keep things simple, what does it mean to say x causes y? Based on Hume s (second) definition of causality, the counterfactual definition of causation is If x occurs then y occurs, and y would not have occurred if x had not This is the operating definition underlying potential outcomes literature (e.g. Neyman, 1923, Rubin, 1974)....if x had not is the counterfactual. Under potential outcomes, we must imagine the possibility of an individual causal effect δ i = y 1 i y 0 i (1) where δ i is the treatment effect for individual i under the treatment condition and the control condition. ILSA /18
9 Mackie and the INUS Condition for Definition of Condition for This definition is too strong, because y can occur if x had not. We need to understand the context under which x occurred Let A, B, C..., etc, be a list of factors that lead to some effect whenever some conjunction of the factors occurs. For example, take three conditions under which reading development can take place: incoming phonemic awareness; teacher competency; parental reading activities. A conjunction of events may be ABC or DEF or JKL, etc. This allows for the possibility that ABC might be a cause or DEF might be a cause, etc. Assume the set is finite. Then factors (ABC or DEF or JKL) isa condition that is both necessary and sufficient for the effect to occur. Each specific conjunction, such as ABC, is sufficient but not necessary for the effect. ILSA /18
10 Mackie (cont d) Definition of Condition for For example: ABC is a minimal sufficient condition insofar as none of its conjuncts are redundant. AB is not sufficient for the effect. A itself is neither a necessary nor sufficient condition for the effect. However, the single factor A, is related to the effect in an important fashion - viz. [I]t is an insufficient but non-redundant part of an unnecessary but sufficient condition: it will be convenient to call this... an inus condition. (pg. 62) If that is confusing, consider calling it a Necessary Element of a Sufficient Set. ILSA / 18
11 Mackie (cont d) Definition of Condition for But what about remaining relevant causes? According to Mackie, these remaining causes are relegated to the causal field which includes what we recognize as the disturbance term. Hoover argues that the notion of a causal field has to be expanded for Mackie s ideas to be relevant to indeterministic problems. If parameters of a causal question are truly constant or mostly stable, then they can be relegated to the causal field without too much worry. Prior cycles of PISA, say, would help determine this. The causal field is a background of standing conditions and, within the boundaries of validity claimed for the causal relation, must be invariant to exercises of controlling the consequent by means of the particular causal relation (INUS condition) of interest (Hoover, 2001, pg. 222) ILSA / 18
12 Definition of Condition for The INUS condition should be an attractive idea to those of us working on the development and application of I to support causal inferences because it focuses our attention on some aspect of the causal problem without having to be concerned directly with knowing every minimal sufficient subset of the full cause of the event. In fact, I would argue that a fruitful collaboration of content area expert groups (REG, MEG, SEG) along with the QEG, with focused attention on instantiating INUS causal variables, could lead to I being more productively used for educational effectiveness studies. ILSA / 18
13 Woodward and the Definition of Condition for In many situations, the goal is to change x i.e. intervene on x to change y. In practice, we may want to engage in model-based simulations involving a hypothetical change in x as a precursor to an experiment or to gain insights into potential problems when scaling up an intervention. Intervention on x requires that x be measured so as to support a counterfactual proposition. Recently, a manipulability theory of causation was put forth by Woodward (2003) as an attempt to provide a firmer foundation for causal explanation. For Woodward a causal explanation is an explanation that provides information for purposes of manipulation and control. An important aspect of Woodward s theory involves clarifying the problem of intervention and invariance. ILSA / 18
14 Invariance Definition of Condition for Intervention relates to the notion of an ideal experimental manipulation of a variable, x, with the goal of determining if this ideal manipulation changes y, and that no change in y would have occurred without the change in x. For Woodward, a necessary and sufficient condition for the description of a causal relationship is that it be invariant under some appropriate set of interventions. If a purported causal relationship is not invariant under a set of interventions, it is not, in fact, a causal relationship and indeed might only describe a correlation. Statistically, invariance concerns the extent to which the parameters of the conditional distribution do not change when there are changes in the parameters of the marginal distribution. This leads to the problem exogeneity. ILSA / 18
15 Definition of Condition for How might we conceive of this invariance and exogeneity problem in the context of I? Over cycles of PISA (for example), we can examine statistical relationships among variables that have been repeatedly measured, say for trend. Examining these relationships with an eye toward major country-level policy shifts, we could then examine if these relationships have remained somewhat stable. Given the careful nature of PISA sampling (particular because of its need to preserve trend), any clear change in relationships of interest might signal super-exogenous changes in policy that has led to problems of parameter invariance. Careful linkages with system level data provided by the OECD could give insights into the nature of these changes. ILSA / 18
16 What does this have to Definition of Condition for In my view I provide the data collection framework to measure variables that can be used to help define the causal field in which interventions take place. This is the C in the CIPO model that Eckhard discusses. I can be enhanced to ask specific questions regarding the inputs and processes of schooling. Here, Eckhard and I are in complete agreement and Eckhard s paper does a nice job of pointing out possible enhancements. However, these questions should be measured in such a way as to support a hypothetical manipulability question of the sort what if things were different? I m less concerned about outputs. I such as PISA deal with them very well. ILSA / 18
17 What about Definition of Condition for For an analytic framework to support these ideas, I believe that multilevel structural modeling within a Bayesian perspective is most useful. Why? 1. Multilevel SEM (Muthen & Satorra, 1995; Kaplan & Kreisman, 2000) can address mediating and moderating effects within a multilevel framework (ala Levin). 2. The Bayesian perspective of multilevel SEM (Kaplan & Depaoli, in press) allows one to incorporate prior information into model estimation via careful elicitation (e.g. from prior cycles of PISA; consultation with PISA expert groups, etc.). 3. Bayesian multilevel SEM directs us away from some of the internal inconsistencies of null hypothesis testing and toward model selection based on predictive capacity. 4. Bayesian multilevel SEM (and conventional SEM for that matter) can allow for model-based simulations of counterfactuals within varying context settings. This can direct us toward evolutionary knowledge development within the CIPO framework of schooling. ILSA / 18
18 Conclusion Definition of Condition for Although I might not share Eckhard s pessimism regarding the use of I for causal inference, his paper gives us a great deal to think about, and is well worth reading. It is extremely important to consider the enhancements he suggests. But I also believe we have the methodologies and philosophical underpinnings in place to engage in bold modeling efforts. The issues raised in his paper need to be taken very seriously if we are to move forward in developing I to support an evolutionary knowledge base of research on educational effectiveness and school development in an international context. ILSA / 18
External validity, causal interaction and randomised trials
External validity, causal interaction and randomised trials Seán M. Muller University of Cape Town Evidence and Causality in the Sciences Conference University of Kent (Canterbury) 5 September 2012 Overview
More informationCausal inference. Gary Goertz Kroc Institute for International Peace Studies University of Notre Dame Spring 2018
Causal inference Gary Goertz Kroc Institute for International Peace Studies University of Notre Dame ggoertz@nd.edu Spring 2018 Experiments are the gold standard for causal inference Strategies of causal
More informationTools for causal analysis and philosophical theories of causation. Isabelle Drouet (IHPST)
Tools for causal analysis and philosophical theories of causation Isabelle Drouet (IHPST) 1 What is philosophy of causation? 1. What is causation? What characterizes these relations that we label "causal"?
More informationControlling for latent confounding by confirmatory factor analysis (CFA) Blinded Blinded
Controlling for latent confounding by confirmatory factor analysis (CFA) Blinded Blinded 1 Background Latent confounder is common in social and behavioral science in which most of cases the selection mechanism
More informationEconometric Causality
Econometric (2008) International Statistical Review, 76(1):1-27 James J. Heckman Spencer/INET Conference University of Chicago Econometric The econometric approach to causality develops explicit models
More informationFrom Causality, Second edition, Contents
From Causality, Second edition, 2009. Preface to the First Edition Preface to the Second Edition page xv xix 1 Introduction to Probabilities, Graphs, and Causal Models 1 1.1 Introduction to Probability
More informationAppendix A Lewis s Counterfactuals
Appendix A Lewis s Counterfactuals I will briefly describe David Lewis s possible world semantics of counterfactual conditionals (1973, p. 13). Let us understand a possible world simply as a way things
More informationCommentary on Guarini
University of Windsor Scholarship at UWindsor OSSA Conference Archive OSSA 5 May 14th, 9:00 AM - May 17th, 5:00 PM Commentary on Guarini Andrew Bailey Follow this and additional works at: http://scholar.uwindsor.ca/ossaarchive
More informationCausality II: How does causal inference fit into public health and what it is the role of statistics?
Causality II: How does causal inference fit into public health and what it is the role of statistics? Statistics for Psychosocial Research II November 13, 2006 1 Outline Potential Outcomes / Counterfactual
More informationOUTLINE CAUSAL INFERENCE: LOGICAL FOUNDATION AND NEW RESULTS. Judea Pearl University of California Los Angeles (www.cs.ucla.
OUTLINE CAUSAL INFERENCE: LOGICAL FOUNDATION AND NEW RESULTS Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea/) Statistical vs. Causal vs. Counterfactual inference: syntax and semantics
More informationDEALING WITH MULTIVARIATE OUTCOMES IN STUDIES FOR CAUSAL EFFECTS
DEALING WITH MULTIVARIATE OUTCOMES IN STUDIES FOR CAUSAL EFFECTS Donald B. Rubin Harvard University 1 Oxford Street, 7th Floor Cambridge, MA 02138 USA Tel: 617-495-5496; Fax: 617-496-8057 email: rubin@stat.harvard.edu
More informationStatistical Models for Causal Analysis
Statistical Models for Causal Analysis Teppei Yamamoto Keio University Introduction to Causal Inference Spring 2016 Three Modes of Statistical Inference 1. Descriptive Inference: summarizing and exploring
More informationANALYTIC COMPARISON. Pearl and Rubin CAUSAL FRAMEWORKS
ANALYTIC COMPARISON of Pearl and Rubin CAUSAL FRAMEWORKS Content Page Part I. General Considerations Chapter 1. What is the question? 16 Introduction 16 1. Randomization 17 1.1 An Example of Randomization
More informationLecture 34 Woodward on Manipulation and Causation
Lecture 34 Woodward on Manipulation and Causation Patrick Maher Philosophy 270 Spring 2010 The book This book defends what I call a manipulationist or interventionist account of explanation and causation.
More informationMINIMAL SUFFICIENT CAUSATION AND DIRECTED ACYCLIC GRAPHS. By Tyler J. VanderWeele and James M. Robins University of Chicago and Harvard University
Submitted to the Annals of Statistics MINIMAL SUFFICIENT CAUSATION AND DIRECTED ACYCLIC GRAPHS By Tyler J. VanderWeele and James M. Robins University of Chicago and Harvard University Notions of minimal
More informationLECTURE FOUR MICHAELMAS 2017 Dr Maarten Steenhagen Causation
LECTURE FOUR MICHAELMAS 2017 Dr Maarten Steenhagen ms2416@cam.ac.uk http://msteenhagen.github.io/teaching/ Causation These lectures Lecture 1: The very idea of a cause Lecture 2: Regularity theories Lecture
More informationCAUSALITY. Models, Reasoning, and Inference 1 CAMBRIDGE UNIVERSITY PRESS. Judea Pearl. University of California, Los Angeles
CAUSALITY Models, Reasoning, and Inference Judea Pearl University of California, Los Angeles 1 CAMBRIDGE UNIVERSITY PRESS Preface page xiii 1 Introduction to Probabilities, Graphs, and Causal Models 1
More informationComments on Best Quasi- Experimental Practice
Comments on Best Quasi- Experimental Practice Larry V. Hedges Northwestern University Presented at the Future of Implementation Evaluation, National Science Foundation, Arlington, VA, October 28, 2013
More informationA Distinction between Causal Effects in Structural and Rubin Causal Models
A istinction between Causal Effects in Structural and Rubin Causal Models ionissi Aliprantis April 28, 2017 Abstract: Unspecified mediators play different roles in the outcome equations of Structural Causal
More information1 Correlation and Inference from Regression
1 Correlation and Inference from Regression Reading: Kennedy (1998) A Guide to Econometrics, Chapters 4 and 6 Maddala, G.S. (1992) Introduction to Econometrics p. 170-177 Moore and McCabe, chapter 12 is
More informationWORKSHOP ON PRINCIPAL STRATIFICATION STANFORD UNIVERSITY, Luke W. Miratrix (Harvard University) Lindsay C. Page (University of Pittsburgh)
WORKSHOP ON PRINCIPAL STRATIFICATION STANFORD UNIVERSITY, 2016 Luke W. Miratrix (Harvard University) Lindsay C. Page (University of Pittsburgh) Our team! 2 Avi Feller (Berkeley) Jane Furey (Abt Associates)
More informationResearch Note: A more powerful test statistic for reasoning about interference between units
Research Note: A more powerful test statistic for reasoning about interference between units Jake Bowers Mark Fredrickson Peter M. Aronow August 26, 2015 Abstract Bowers, Fredrickson and Panagopoulos (2012)
More informationComparing Change Scores with Lagged Dependent Variables in Models of the Effects of Parents Actions to Modify Children's Problem Behavior
Comparing Change Scores with Lagged Dependent Variables in Models of the Effects of Parents Actions to Modify Children's Problem Behavior David R. Johnson Department of Sociology and Haskell Sie Department
More informationTechnical Track Session I: Causal Inference
Impact Evaluation Technical Track Session I: Causal Inference Human Development Human Network Development Network Middle East and North Africa Region World Bank Institute Spanish Impact Evaluation Fund
More informationCounterfactual Reasoning in Algorithmic Fairness
Counterfactual Reasoning in Algorithmic Fairness Ricardo Silva University College London and The Alan Turing Institute Joint work with Matt Kusner (Warwick/Turing), Chris Russell (Sussex/Turing), and Joshua
More informationCausal Inference. Prediction and causation are very different. Typical questions are:
Causal Inference Prediction and causation are very different. Typical questions are: Prediction: Predict Y after observing X = x Causation: Predict Y after setting X = x. Causation involves predicting
More informationMediation for the 21st Century
Mediation for the 21st Century Ross Boylan ross@biostat.ucsf.edu Center for Aids Prevention Studies and Division of Biostatistics University of California, San Francisco Mediation for the 21st Century
More informationStructure learning in human causal induction
Structure learning in human causal induction Joshua B. Tenenbaum & Thomas L. Griffiths Department of Psychology Stanford University, Stanford, CA 94305 jbt,gruffydd @psych.stanford.edu Abstract We use
More informationConceivability and Modal Knowledge
1 3 Conceivability and Modal Knowledge Christopher Hill ( 2006 ) provides an account of modal knowledge that is set in a broader context of arguing against the view that conceivability provides epistemic
More informationProbability and Inference. POLI 205 Doing Research in Politics. Populations and Samples. Probability. Fall 2015
Fall 2015 Population versus Sample Population: data for every possible relevant case Sample: a subset of cases that is drawn from an underlying population Inference Parameters and Statistics A parameter
More informationCausal Inference with Big Data Sets
Causal Inference with Big Data Sets Marcelo Coca Perraillon University of Colorado AMC November 2016 1 / 1 Outlone Outline Big data Causal inference in economics and statistics Regression discontinuity
More informationCartwright on Economics Lawrence Boland Simon Fraser University, Burnaby, B.C.
Review Essay Cartwright on Economics Lawrence Boland Simon Fraser University, Burnaby, B.C. Cartwright, Nancy. (2007). Hunting Causes and Using Them: Approaches in Philosophy and Economics. New York: Cambridge
More informationOverview. Overview. Overview. Specific Examples. General Examples. Bivariate Regression & Correlation
Bivariate Regression & Correlation Overview The Scatter Diagram Two Examples: Education & Prestige Correlation Coefficient Bivariate Linear Regression Line SPSS Output Interpretation Covariance ou already
More informationOUTLINE THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS. Judea Pearl University of California Los Angeles (www.cs.ucla.
THE MATHEMATICS OF CAUSAL INFERENCE IN STATISTICS Judea Pearl University of California Los Angeles (www.cs.ucla.edu/~judea) OUTLINE Modeling: Statistical vs. Causal Causal Models and Identifiability to
More informationAnalysis of Panel Data: Introduction and Causal Inference with Panel Data
Analysis of Panel Data: Introduction and Causal Inference with Panel Data Session 1: 15 June 2015 Steven Finkel, PhD Daniel Wallace Professor of Political Science University of Pittsburgh USA Course presents
More informationAssociation Between Variables Measured at the Ordinal Level
Last week: Examining associations. Is the association significant? (chi square test) Strength of the association (with at least one variable nominal) maximum difference approach chi/cramer s v/lambda Nature
More informationTechnical and Practical Considerations in applying Value Added Models to estimate teacher effects
Technical and Practical Considerations in applying Value Added Models to estimate teacher effects Pete Goldschmidt, Ph.D. Educational Psychology and Counseling, Development Learning and Instruction Purpose
More informationMINIMAL SUFFICIENT CAUSATION AND DIRECTED ACYCLIC GRAPHS 1. By Tyler J. VanderWeele and James M. Robins. University of Chicago and Harvard University
MINIMAL SUFFICIENT CAUSATION AND DIRECTED ACYCLIC GRAPHS 1 By Tyler J. VanderWeele and James M. Robins University of Chicago and Harvard University Summary. Notions of minimal su cient causation are incorporated
More information3 The Semantics of the Propositional Calculus
3 The Semantics of the Propositional Calculus 1. Interpretations Formulas of the propositional calculus express statement forms. In chapter two, we gave informal descriptions of the meanings of the logical
More informationEmpirical approaches in public economics
Empirical approaches in public economics ECON4624 Empirical Public Economics Fall 2016 Gaute Torsvik Outline for today The canonical problem Basic concepts of causal inference Randomized experiments Non-experimental
More informationWhen Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data?
When Should We Use Linear Fixed Effects Regression Models for Causal Inference with Panel Data? Kosuke Imai Department of Politics Center for Statistics and Machine Learning Princeton University Joint
More informationSocial Science Counterfactuals. Julian Reiss, Durham University
Social Science Counterfactuals Julian Reiss, Durham University Social Science Counterfactuals Julian Reiss, Durham University Counterfactuals in Social Science Stand-ins for causal claims about singular
More informationBackground on Coherent Systems
2 Background on Coherent Systems 2.1 Basic Ideas We will use the term system quite freely and regularly, even though it will remain an undefined term throughout this monograph. As we all have some experience
More information2) There should be uncertainty as to which outcome will occur before the procedure takes place.
robability Numbers For many statisticians the concept of the probability that an event occurs is ultimately rooted in the interpretation of an event as an outcome of an experiment, others would interpret
More informationLecture 12: Arguments for the absolutist and relationist views of space
12.1 432018 PHILOSOPHY OF PHYSICS (Spring 2002) Lecture 12: Arguments for the absolutist and relationist views of space Preliminary reading: Sklar, pp. 19-25. Now that we have seen Newton s and Leibniz
More information1 Motivation for Instrumental Variable (IV) Regression
ECON 370: IV & 2SLS 1 Instrumental Variables Estimation and Two Stage Least Squares Econometric Methods, ECON 370 Let s get back to the thiking in terms of cross sectional (or pooled cross sectional) data
More informationDISCUSSION CENSORED VISION. Bruce Le Catt
Australasian Journal of Philosophy Vol. 60, No. 2; June 1982 DISCUSSION CENSORED VISION Bruce Le Catt When we see in the normal way, the scene before the eyes causes matching visual experience. And it
More informationA proof of Bell s inequality in quantum mechanics using causal interactions
A proof of Bell s inequality in quantum mechanics using causal interactions James M. Robins, Tyler J. VanderWeele Departments of Epidemiology and Biostatistics, Harvard School of Public Health Richard
More informationAn Introduction to Causal Mediation Analysis. Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016
An Introduction to Causal Mediation Analysis Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016 1 Causality In the applications of statistics, many central questions
More informationToward a Mechanistic Interpretation of Probability
Toward a Mechanistic Interpretation of Probability DRAFT (Please contact me before quoting this version.) Marshall Abrams Department of Philosophy University of Alabama at Birmingham June 10, 2009 Abstract
More informationAdvanced Statistical Methods for Observational Studies L E C T U R E 0 1
Advanced Statistical Methods for Observational Studies L E C T U R E 0 1 introduction this class Website Expectations Questions observational studies The world of observational studies is kind of hard
More informationMeasurement Independence, Parameter Independence and Non-locality
Measurement Independence, Parameter Independence and Non-locality Iñaki San Pedro Department of Logic and Philosophy of Science University of the Basque Country, UPV/EHU inaki.sanpedro@ehu.es Abstract
More informationExperimental Designs for Identifying Causal Mechanisms
Experimental Designs for Identifying Causal Mechanisms Kosuke Imai Princeton University October 18, 2011 PSMG Meeting Kosuke Imai (Princeton) Causal Mechanisms October 18, 2011 1 / 25 Project Reference
More informationAdvising on Research Methods: A consultant's companion. Herman J. Ader Gideon J. Mellenbergh with contributions by David J. Hand
Advising on Research Methods: A consultant's companion Herman J. Ader Gideon J. Mellenbergh with contributions by David J. Hand Contents Preface 13 I Preliminaries 19 1 Giving advice on research methods
More informationCausal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies
Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Kosuke Imai Department of Politics Princeton University November 13, 2013 So far, we have essentially assumed
More informationSC705: Advanced Statistics Instructor: Natasha Sarkisian Class notes: Introduction to Structural Equation Modeling (SEM)
SC705: Advanced Statistics Instructor: Natasha Sarkisian Class notes: Introduction to Structural Equation Modeling (SEM) SEM is a family of statistical techniques which builds upon multiple regression,
More informationSelection on Observables: Propensity Score Matching.
Selection on Observables: Propensity Score Matching. Department of Economics and Management Irene Brunetti ireneb@ec.unipi.it 24/10/2017 I. Brunetti Labour Economics in an European Perspective 24/10/2017
More informationEMERGING MARKETS - Lecture 2: Methodology refresher
EMERGING MARKETS - Lecture 2: Methodology refresher Maria Perrotta April 4, 2013 SITE http://www.hhs.se/site/pages/default.aspx My contact: maria.perrotta@hhs.se Aim of this class There are many different
More informationRigorous Science - Based on a probability value? The linkage between Popperian science and statistical analysis
Rigorous Science - Based on a probability value? The linkage between Popperian science and statistical analysis The Philosophy of science: the scientific Method - from a Popperian perspective Philosophy
More informationTHE ROLE OF COMPUTER BASED TECHNOLOGY IN DEVELOPING UNDERSTANDING OF THE CONCEPT OF SAMPLING DISTRIBUTION
THE ROLE OF COMPUTER BASED TECHNOLOGY IN DEVELOPING UNDERSTANDING OF THE CONCEPT OF SAMPLING DISTRIBUTION Kay Lipson Swinburne University of Technology Australia Traditionally, the concept of sampling
More informationCommentary. Regression toward the mean: a fresh look at an old story
Regression toward the mean: a fresh look at an old story Back in time, when I took a statistics course from Professor G., I encountered regression toward the mean for the first time. a I did not understand
More informationIntroduction to causal identification. Nidhiya Menon IGC Summer School, New Delhi, July 2015
Introduction to causal identification Nidhiya Menon IGC Summer School, New Delhi, July 2015 Outline 1. Micro-empirical methods 2. Rubin causal model 3. More on Instrumental Variables (IV) Estimating causal
More informationNGSS Example Bundles. Page 1 of 23
High School Conceptual Progressions Model III Bundle 2 Evolution of Life This is the second bundle of the High School Conceptual Progressions Model Course III. Each bundle has connections to the other
More informationModeling Mediation: Causes, Markers, and Mechanisms
Modeling Mediation: Causes, Markers, and Mechanisms Stephen W. Raudenbush University of Chicago Address at the Society for Resesarch on Educational Effectiveness,Washington, DC, March 3, 2011. Many thanks
More informationQuantitative Economics for the Evaluation of the European Policy
Quantitative Economics for the Evaluation of the European Policy Dipartimento di Economia e Management Irene Brunetti Davide Fiaschi Angela Parenti 1 25th of September, 2017 1 ireneb@ec.unipi.it, davide.fiaschi@unipi.it,
More informationUCLA Department of Statistics Papers
UCLA Department of Statistics Papers Title Comment on `Causal inference, probability theory, and graphical insights' (by Stuart G. Baker) Permalink https://escholarship.org/uc/item/9863n6gg Journal Statistics
More informationOnline Appendix to Yes, But What s the Mechanism? (Don t Expect an Easy Answer) John G. Bullock, Donald P. Green, and Shang E. Ha
Online Appendix to Yes, But What s the Mechanism? (Don t Expect an Easy Answer) John G. Bullock, Donald P. Green, and Shang E. Ha January 18, 2010 A2 This appendix has six parts: 1. Proof that ab = c d
More informationTHE DESIGN (VERSUS THE ANALYSIS) OF EVALUATIONS FROM OBSERVATIONAL STUDIES: PARALLELS WITH THE DESIGN OF RANDOMIZED EXPERIMENTS DONALD B.
THE DESIGN (VERSUS THE ANALYSIS) OF EVALUATIONS FROM OBSERVATIONAL STUDIES: PARALLELS WITH THE DESIGN OF RANDOMIZED EXPERIMENTS DONALD B. RUBIN My perspective on inference for causal effects: In randomized
More informationCEPA Working Paper No
CEPA Working Paper No. 15-06 Identification based on Difference-in-Differences Approaches with Multiple Treatments AUTHORS Hans Fricke Stanford University ABSTRACT This paper discusses identification based
More informationAll instruction should be three-dimensional. Page 1 of 9
High School Conceptual Progressions Model Course II Bundle 5 Inheritance of Genetic Variation This is the fifth bundle of the High School Conceptual Progressions Model Course II. Each bundle has connections
More informationIgnoring the matching variables in cohort studies - when is it valid, and why?
Ignoring the matching variables in cohort studies - when is it valid, and why? Arvid Sjölander Abstract In observational studies of the effect of an exposure on an outcome, the exposure-outcome association
More informationDo not copy, post, or distribute
14 CORRELATION ANALYSIS AND LINEAR REGRESSION Assessing the Covariability of Two Quantitative Properties 14.0 LEARNING OBJECTIVES In this chapter, we discuss two related techniques for assessing a possible
More informationA Measure of Robustness to Misspecification
A Measure of Robustness to Misspecification Susan Athey Guido W. Imbens December 2014 Graduate School of Business, Stanford University, and NBER. Electronic correspondence: athey@stanford.edu. Graduate
More informationChapter 9: Association Between Variables Measured at the Ordinal Level
Chapter 9: Association Between Variables Measured at the Ordinal Level After this week s class: SHOULD BE ABLE TO COMPLETE ALL APLIA ASSIGNMENTS DUE END OF THIS WEEK: APLIA ASSIGNMENTS 5-7 DUE: Friday
More informationCAUSATION CAUSATION. Chapter 10. Non-Humean Reductionism
CAUSATION CAUSATION Chapter 10 Non-Humean Reductionism Humean states of affairs were characterized recursively in chapter 2, the basic idea being that distinct Humean states of affairs cannot stand in
More informationMaking Sense. Tom Carter. tom/sfi-csss. April 2, 2009
Making Sense Tom Carter http://astarte.csustan.edu/ tom/sfi-csss April 2, 2009 1 Making Sense Introduction / theme / structure 3 Language and meaning 6 Language and meaning (ex)............... 7 Theories,
More informationResearch Design: Causal inference and counterfactuals
Research Design: Causal inference and counterfactuals University College Dublin 8 March 2013 1 2 3 4 Outline 1 2 3 4 Inference In regression analysis we look at the relationship between (a set of) independent
More informationConceptual overview: Techniques for establishing causal pathways in programs and policies
Conceptual overview: Techniques for establishing causal pathways in programs and policies Antonio A. Morgan-Lopez, Ph.D. OPRE/ACF Meeting on Unpacking the Black Box of Programs and Policies 4 September
More informationDesire-as-belief revisited
Desire-as-belief revisited Richard Bradley and Christian List June 30, 2008 1 Introduction On Hume s account of motivation, beliefs and desires are very di erent kinds of propositional attitudes. Beliefs
More informationRigorous Science - Based on a probability value? The linkage between Popperian science and statistical analysis
/3/26 Rigorous Science - Based on a probability value? The linkage between Popperian science and statistical analysis The Philosophy of science: the scientific Method - from a Popperian perspective Philosophy
More informationTechnical Track Session I:
Impact Evaluation Technical Track Session I: Click to edit Master title style Causal Inference Damien de Walque Amman, Jordan March 8-12, 2009 Click to edit Master subtitle style Human Development Human
More informationThe decision theoretic approach to causal inference OR Rethinking the paradigms of causal modelling
The decision theoretic approach to causal inference OR Rethinking the paradigms of causal modelling A.P.Dawid 1 and S.Geneletti 2 1 University of Cambridge, Statistical Laboratory 2 Imperial College Department
More informationModeling Log Data from an Intelligent Tutor Experiment
Modeling Log Data from an Intelligent Tutor Experiment Adam Sales 1 joint work with John Pane & Asa Wilks College of Education University of Texas, Austin RAND Corporation Pittsburgh, PA & Santa Monica,
More informationLocal Cognitive Theory for Coordinate Systems. Components of Understanding:
Local Cognitive Theory for Coordinate Systems Components of Understanding: Student difficulties: Students do not naturally consider any basis beyond the natural (standard) basis. Students do not understand
More informationOn the Use of Linear Fixed Effects Regression Models for Causal Inference
On the Use of Linear Fixed Effects Regression Models for ausal Inference Kosuke Imai Department of Politics Princeton University Joint work with In Song Kim Atlantic ausal Inference onference Johns Hopkins
More informationAnalysis of propensity score approaches in difference-in-differences designs
Author: Diego A. Luna Bazaldua Institution: Lynch School of Education, Boston College Contact email: diego.lunabazaldua@bc.edu Conference section: Research methods Analysis of propensity score approaches
More informationProbability and Statistics
Probability and Statistics Kristel Van Steen, PhD 2 Montefiore Institute - Systems and Modeling GIGA - Bioinformatics ULg kristel.vansteen@ulg.ac.be CHAPTER 4: IT IS ALL ABOUT DATA 4a - 1 CHAPTER 4: IT
More informationCAUSALITY CORRECTIONS IMPLEMENTED IN 2nd PRINTING
1 CAUSALITY CORRECTIONS IMPLEMENTED IN 2nd PRINTING Updated 9/26/00 page v *insert* TO RUTH centered in middle of page page xv *insert* in second paragraph David Galles after Dechter page 2 *replace* 2000
More informationCorrelation and Linear Regression
Correlation and Linear Regression Correlation: Relationships between Variables So far, nearly all of our discussion of inferential statistics has focused on testing for differences between group means
More informationMarginal versus conditional effects: does it make a difference? Mireille Schnitzer, PhD Université de Montréal
Marginal versus conditional effects: does it make a difference? Mireille Schnitzer, PhD Université de Montréal Overview In observational and experimental studies, the goal may be to estimate the effect
More informationThe Causal Inference Problem and the Rubin Causal Model
The Causal Inference Problem and the Rubin Causal Model Lecture 2 Rebecca B. Morton NYU Exp Class Lectures R B Morton (NYU) EPS Lecture 2 Exp Class Lectures 1 / 23 Variables in Modeling the E ects of a
More informationSTRUCTURAL EQUATION MODELING. Khaled Bedair Statistics Department Virginia Tech LISA, Summer 2013
STRUCTURAL EQUATION MODELING Khaled Bedair Statistics Department Virginia Tech LISA, Summer 2013 Introduction: Path analysis Path Analysis is used to estimate a system of equations in which all of the
More informationMetric spaces and metrizability
1 Motivation Metric spaces and metrizability By this point in the course, this section should not need much in the way of motivation. From the very beginning, we have talked about R n usual and how relatively
More informationPhilosophy 5340 Epistemology. Topic 3: Analysis, Analytically Basic Concepts, Direct Acquaintance, and Theoretical Terms. Part 2: Theoretical Terms
Philosophy 5340 Epistemology Topic 3: Analysis, Analytically Basic Concepts, Direct Acquaintance, and Theoretical Terms Part 2: Theoretical Terms 1. What Apparatus Is Available for Carrying out Analyses?
More informationDan Graham Professor of Statistical Modelling. Centre for Transport Studies
Quantifying the effects of urban road capacity expansions on network performance and productivity via a mixed model generalised propensity score estimator Dan Graham Professor of Statistical Modelling
More informationConditional probabilities and graphical models
Conditional probabilities and graphical models Thomas Mailund Bioinformatics Research Centre (BiRC), Aarhus University Probability theory allows us to describe uncertainty in the processes we model within
More informationCourse Evaluation, FYTN04 Theoretical Particle. Particle Physics, Fall 11, Department of Astronomy and Theoretical Physics
1 of 16 03/07/2012 03:41 PM Course Evaluation, FYTN04 Theoretical Particle Physics, Fall 11, Department of Astronomy and Theoretical Physics Course Evaluation, FYTN04 Theoretical Particle Physics, Fall
More informationAssessing Studies Based on Multiple Regression
Assessing Studies Based on Multiple Regression Outline 1. Internal and External Validity 2. Threats to Internal Validity a. Omitted variable bias b. Functional form misspecification c. Errors-in-variables
More informationInferential statistics
Inferential statistics Inference involves making a Generalization about a larger group of individuals on the basis of a subset or sample. Ahmed-Refat-ZU Null and alternative hypotheses In hypotheses testing,
More informationELEMENTARY NUMBER THEORY AND METHODS OF PROOF
CHAPTER 4 ELEMENTARY NUMBER THEORY AND METHODS OF PROOF Copyright Cengage Learning. All rights reserved. SECTION 4.6 Indirect Argument: Contradiction and Contraposition Copyright Cengage Learning. All
More information