Structural Uncertainty in Health Economic Decision Models
|
|
- Calvin Fields
- 5 years ago
- Views:
Transcription
1 Structural Uncertainty in Health Economic Decision Models Mark Strong 1, Hazel Pilgrim 1, Jeremy Oakley 2, Jim Chilcott 1 December School of Health and Related Research, University of Sheffield, UK 2. Department of Probability and Statistics, University of Sheffield, UK Address for correspondence: Dr Mark Strong, School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK. m.strong@sheffield.ac.uk Strong M, Pilgrim H, Oakley J, Chilcott J. (2009) Structural uncertainty in health economic decision models. ScHARR Occasional Paper. ISBN
2 Structural Uncertainty in Health Economic Decision Models 2 Summary Within a health economic decision model there are multiple sources of uncertainty. These uncertainties must be properly accounted for if a decision maker is to have confidence in the model result. Structural uncertainty is present when we are uncertain about the model output because we are uncertain about the functional form of the model. We are not certain that our model adequately reflects reality, and we are therefore not certain that our result would be correct, even if the true values of all input parameters were known. Two broad approaches have been proposed for resolving the problem of structural uncertainty: the model averaging approach and the model discrepancy approach. In the model averaging approach we weight a set of plausible models by some measure of model adequacy, whereas in the discrepancy approach we focus on quantifying our judgements about the difference between the model output and the true value of the target quantity we are modelling. Both these approaches run into difficulties when applied in the health economics context. Model averaging implies that we have built a set of models, one of which we believe to be correct (we just don t know which one). This is a strong assumption given that models are in general only approximations of reality. Current model discrepancy approaches avoid having to make this assumption, but at the cost of having to make meaningful, direct judgements about the discrepancy between the model output and reality. This may simply not be feasible. In order to address this problem we propose a development of the discrepancy modelling approach whereby a model is first decomposed into a series of sub-units, revealing a set of intermediate parameters. We feel that it may be more fruitful to attempt to make useful judgements about the discrepancy between the modelled value and its true counterpart at the level of the intermediate parameters, than at the level of the model output. These judgements, once made, could then be combined with all other recognised sources of uncertainty within a coherent Bayesian framework.
3 Structural Uncertainty in Health Economic Decision Models 3 1 Introduction Within a health economic decision model there are inevitably multiple sources of uncertainty. These uncertainties must be fully accounted for in the output of the model if we are to truly acknowledge the limits of our knowledge. Only when a decision maker has a proper understanding of the range of model outputs that are consistent with the evidence can they make a properly informed decision. There is no single schema for characterising uncertainty within a health economic decision model. One suggestion is to think of uncertainty as being either parametric, methodological or structural (Briggs, 2000). Methods for assessing parametric and methodological uncertainty are well developed. Typically, a probabilistic sensitivity analysis is undertaken to quantify parametric uncertainty, and methodological uncertainties (for example, choices about how health outcomes are valued, or how time preference is incorporated) are, at least partially, dealt with by the increasing use of a reference case. Methods for quantifying structural uncertainty are rather less well described. Structural uncertainty, in broad terms, relates to whether or not all relevant processes are represented in the model; does the model adequately reflect reality? Standard probabilistic sensitivity analysis will not take into account any structural uncertainty that may be present, potentially leading to a spuriously precise estimate of the model output parameter. Moreover, structural uncertainty may well have a greater impact on the model results than either parameter or methodological uncertainty, yet methodologies for handling this source of uncertainty are relatively underdeveloped. This paper sets out some initial research on structural uncertainty currently being undertaken within The Centre for Bayesian Statistics in Health Economics (CHEBS) at the University of Sheffield
4 Structural Uncertainty in Health Economic Decision Models 4 2 What is structural model uncertainty? In the context of health economics we often wish to predict the value of the population expected incremental cost effectiveness ratio (or the population expected net benefit) of choosing one course of action over an alternative. We take a Bayesian perspective and view the target entity as an uncertain quantity about which we seek to make probabilistic statements In order to predict this unknown, but in principle observable target quantity we build a deterministic model y = η(x). Our model is simply a function (possibly a highly complicated one), η(.), that takes a vector of input parameters x and generates an output y. (We assume here that y is scalar, but our conclusions are generalisable to vector model outputs). We usually consider our model input parameters, X, to be uncertain, and it is common practice to acknowledge this uncertainty in some form of uncertainty analysis. For example, in a probabilistic sensitivity analysis we would sample x 1,..., x n from p(x), and evaluate η(x 1 ),..., η(x n ) in order to get a sample from p(y ). This would quantify our uncertainty in Y due to our parameter uncertainty, but it would not tell us anything about our uncertainty in η(.). Imagine, however, that we do learn the true value of our input parameters X. Does our value of Y = η(x) represent the true target value, Ỹ? If we do not believe that this is the case, then we are acknowledging structural error, i.e. that η(.) is incorrect. There is model structural uncertainty if we are uncertain about Ỹ due to uncertainty about η(.). Finally, we note that if we do manage to specify a perfect model η(.) our evaluation of η(x) represents the mean of the target output parameter. The realised value in the population will not necessarily be equal to the mean due to random sampling variation (often known as first-order uncertainty). However, in this paper we are not concerned with this source of error, but instead in the error in the mean output value arising from the mis-specification of η(.).
5 Structural Uncertainty in Health Economic Decision Models 5 3 The M-open versus M-closed analysis of model uncertainty There is a rich statistical literature on model uncertainty motivated by the problem of choosing an optimal model from a set of stochastic models, conditional on some observed data (for example Draper (1995) and associated discussion). Although we generally build only a single health economic decision model, we can usually envisage building a number of other plausible models. Further models are plausible either because we are uncertain about the true structure our model should take (we don t fully understand the system), or because we have made pragmatic choices in order to simplify an otherwise complex model. We denote our notional set of buildable models as {M i, i I}, with M i = {η i (x (i) ), p i (X (i) )}. We draw here on Bernardo & Smith s (1994) notion of describing a set of possible models as M closed or M open. A set of models, {M i, i I}, is described as M closed if we believe that one of the models in {M i, i I} is true, but we do not know which. Conversely, a set of models is described as M open if we do not believe that one of the models in {M i, i I} is correct. 4 Two current approaches to resolving structural uncertainty We discuss two approaches that have been proposed for resolving the problem of model structural uncertainty, the model averaging approach and the model discrepancy approach. 4.1 Model averaging - taking an M closed view In the model averaging approach to structural uncertainty we consider that our models {M i, i I} represent a set of plausible models, and that our best approximation of the true value of the target parameter, Ỹ, is some weighted mean value of the individual model outputs. The weighting process could simply consist of
6 Structural Uncertainty in Health Economic Decision Models 6 choosing the model from the set that we believe is best while discarding the rest, effectively placing all the weight on a single model. Or, we may want to more formally assess our beliefs about how likely the different models are, and weight the outputs by these probabilities. If we have data, D, and can calculate some measure of the adequacy of the model, given the data, then we could weight the model outputs by (some function of) the adequacy measure. Within a Bayesian framework we would specify prior model probabilities, p(m i ), and calculate the posterior probabilities via p(m i D) = p(d M i )p(m i ) i I p(d M i)p(m i ), leading to a weighted mean output p(ỹ D) = i I p(ỹ M i, D)p(M i D). See Kadane and Lazar (2004) for a general discussion on this topic and Jackson et al (2009) for a more focussed discussion with respect to health economic decision model uncertainty. We recognise two problems with this approach. Firstly, the adequacy measure we construct relates only to the fit of the stochastic model elements of the economic model to the data; there is no assessment of the adequacy of the remaining structure of the model. Secondly, we may wish to consider competing models in the absence of data that would inform the choice between them. In this latter case we are left with just our prior model probabilities p(m i ), and our beliefs about Ỹ are simply p(ỹ ) = p(ỹ M i)p(m i ). i I Learning about p(m i ) might now be considered to be an expert elicitation problem, the extreme example being that of a modeller choosing a single model because they believe it to be best. Expert elicitation of prior model probabilities is not, however, a trivial problem. For example, how would an expert decide how much probability to place on two competing Markov models, one with three health states, and one with four?
7 Structural Uncertainty in Health Economic Decision Models 7 In a variation on the model averaging approach, Bojke et al (2009) have proposed a method in which the uncertainty in model structure is explicitly parameterised. A single general model is constructed in such a way that the models in {M i, i I} are just special cases of this general model. The parameters in the general model that reflect the structural modelling choices are considered to be just additional uncertain quantities along with other unknown inputs. Averaging over the distributions on the whole set of uncertain parameters is equivalent to model averaging as described above, but Bojke et al s approach does allow for more straightforward analysis of the value of reducing structural uncertainty. If we are prepared to believe the distribution on our averaged output value p(ỹ ), then we are implicitly claiming a M closed view of the problem. If this is not a realistic assumption, then we might be unwise in accepting p(ỹ ). 4.2 Model discrepancy - taking an M open view In the model discrepancy approach to structural uncertainty we assume that none of the models in our set {M i, i I} is correct. Each model is only an approximation of reality, and we focus on the discrepancy, δ, between the output of a model and the true target value Ỹ = η(x) + δ. We view the set of models as M open and it no longer makes sense to specify p(m i ). So, instead of trying to meaningfully specify model weights, the key question is now: can we usefully say anything about p(δ)? Much of the literature relating to model discrepancy has been in fields relating to the computer modelling of complex physical systems (for examples and discussions see Kennedy and O Hagan (2001) and Craig et al (2001)). In the context of modelling physical systems it often makes sense to partition the target model output Y = {Y o, Y u } into a portion for which we have (noisy) observations z on Y o, and a portion for which we have no observations. For example, we may have historic observations on the output variable, and wish to predict future observations (forecasting), or we may have observations at a set of points in
8 Structural Uncertainty in Health Economic Decision Models 8 space and wish to predict values at locations in between (interpolation). Kennedy and O Hagan (2001) propose a method for fully accounting for the uncertainty in Ỹ, given z and uncertain inputs X, within a Bayesian framework. The method relies on the existence of the observations z against which to calibrate the model. The model itself is considered as just a black box, the internal structure of which is not examined. A more advanced approach to modelling discrepancy is presented in Goldstein and Rougier (2009) within the context of what the authors term reified modelling. This involves eliciting expert judgements about the possible effects of improvements to a model, for example by including additional inputs or modifying the model structure. An example is given involving a model of the Atlantic Ocean, in which judgements are made about the effects of enhancing the structure of the model by increasing the number of compartments used to represent the ocean. Although the resulting reified model is never actually built, judgements regarding the difference between the built model and the reified model are used to inform beliefs about the discrepancy between the built model and reality. The difficulty in health economics with the discrepancy approach as described above is the lack of observations on the output Y. We do not directly measure incremental cost effectiveness ratios or net benefits; calibration of the model output against data is usually not possible. 5 Discussion and future direction We have identified problems in both the model averaging and model discrepancy approaches to resolving the problem of structural uncertainty within health economic models. In this section we outline one possible future direction for research. Firstly, we take the view that in the health economic context it is not safe to assume that one of our buildable models is necessarily correct. We therefore must, at least sometimes, take an M open view of the problem. Apart from in well understood and well defined problems, model averaging will not lead to p(ỹ ) that accurately reflects our true structural uncertainty.
9 Structural Uncertainty in Health Economic Decision Models 9 Secondly, we accept that we will almost never have adequate data against which to calibrate the output of a health economic decision model. In theory, a potential solution to this deficiency in data would be to elicit the views of a range of experts on the nature of the discrepancy Ỹ η(x). However, we think that it is unlikely that experts would have anything but a very qualitative sense of this. One possible direction for resolving the problem would be to retain an M open perspective, but instead of viewing the model as a black box and specifying the discrepancy at the level of the model output, open up the box and utilise the information contained within. If we can first decompose the model into a series of linked sub-units, we may be able to usefully specify discrepancy at the sub-unit level. Decomposing the model into sub-units exposes a set of intermediate parameters, W = (W 1,..., W n ) which, under certain decompositions will have clear real-world interpretations. If we have data relating to some subset of the intermediate parameters then we can partition W into observed and unobserved, W = {W o, W u }. Conditional on the observations z on W o, inference about the true output Ỹ could then be based on the joint distribution of {X, W o, W u, Ỹ }. Under many circumstances these calibration data will be absent, but it may still be possible to learn about the discrepancies between the modelled intermediate parameter values and their true values through elicitation. An expert may be able to meaningfully state their beliefs about the (joint distribution of the) discrepancies, δ i = W i W i, (i = 1,..., n), even if they cannot say anything about the discrepancy in the output Ỹ η(x). We will describe the proposed method in detail and present a case study in a future paper.
10 Structural Uncertainty in Health Economic Decision Models 10 References Bernardo, J. M. and Smith, A. F. M. (1994) Bayesian Theory. Chichester, John Wiley. Bojke, L., Claxton, K., Sculpher, M. and Palmer, S. (2009) Characterizing Structural Uncertainty in Decision Analytic Models: A Review and Application of Methods. Value in Health, 12, Briggs, A. (2000) Handling Uncertainty in Cost-Effectiveness Models. Pharmacoeconomics, 17, Craig, P. S., Goldstein, M., Rougier, J. C. and Seheult, A. H. (2001) Bayesian forecasting for complex systems using computer simulators. Journal of the American Statistical Association, 96, Draper, D. (1995) Assessment and propagation of model uncertainty (with discussion). Journal of the Royal Statistical Society, Series B, 57, Goldstein, M. and Rougier, J. C. (2009) Reified Bayesian modelling and inference for physical systems (with discussion and rejoinder). Journal of Statistical Planning and Inference, 139(3), Jackson, C. H., Thompson, S. G. and Sharples, L. D. (2009) Accounting for uncertainty in health economic decision models by using model averaging. Journal of the Royal Statistical Society, Series A, 172(2), Kadane, J. B. and Lazar, N. A. (2004) Methods and criteria for model selection. Journal of the American Statistical Association, 99, Kennedy, M. and O Hagan, A. (2001) Bayesian calibration of computer models (with discussion). Journal of the Royal Statistical Society, Series B, 63,
Gaussian Processes for Computer Experiments
Gaussian Processes for Computer Experiments Jeremy Oakley School of Mathematics and Statistics, University of Sheffield www.jeremy-oakley.staff.shef.ac.uk 1 / 43 Computer models Computer model represented
More informationvar D (B) = var(b? E D (B)) = var(b)? cov(b; D)(var(D))?1 cov(d; B) (2) Stone [14], and Hartigan [9] are among the rst to discuss the role of such ass
BAYES LINEAR ANALYSIS [This article appears in the Encyclopaedia of Statistical Sciences, Update volume 3, 1998, Wiley.] The Bayes linear approach is concerned with problems in which we want to combine
More informationProfessor David B. Stephenson
rand Challenges in Probabilistic Climate Prediction Professor David B. Stephenson Isaac Newton Workshop on Probabilistic Climate Prediction D. Stephenson, M. Collins, J. Rougier, and R. Chandler University
More informationUncertainty analysis for computer models.
Uncertainty analysis for computer models. Michael Goldstein Durham University Thanks to EPSRC, NERC, MRc, Leverhulme, for funding. Thanks to Ian Vernon for pictures. Energy systems work with Antony Lawson,
More informationLecture : Probabilistic Machine Learning
Lecture : Probabilistic Machine Learning Riashat Islam Reasoning and Learning Lab McGill University September 11, 2018 ML : Many Methods with Many Links Modelling Views of Machine Learning Machine Learning
More informationCommon Knowledge and Sequential Team Problems
Common Knowledge and Sequential Team Problems Authors: Ashutosh Nayyar and Demosthenis Teneketzis Computer Engineering Technical Report Number CENG-2018-02 Ming Hsieh Department of Electrical Engineering
More informationThe structure function for system reliability as predictive (imprecise) probability
The structure function for system reliability as predictive (imprecise) probability Frank P.A. Coolen 1a, Tahani Coolen-Maturi 2 1 Department of Mathematical Sciences, Durham University, UK 2 Durham University
More informationCS 188: Artificial Intelligence Fall 2008
CS 188: Artificial Intelligence Fall 2008 Lecture 14: Bayes Nets 10/14/2008 Dan Klein UC Berkeley 1 1 Announcements Midterm 10/21! One page note sheet Review sessions Friday and Sunday (similar) OHs on
More informationPressure matching for hydrocarbon reservoirs: a case study in the use of Bayes linear strategies for large computer experiments
This is page 1 Printer: Opaque this Pressure matching for hydrocarbon reservoirs: a case study in the use of Bayes linear strategies for large computer experiments Peter S. Craig Michael Goldstein Allan
More informationDevelopment of Stochastic Artificial Neural Networks for Hydrological Prediction
Development of Stochastic Artificial Neural Networks for Hydrological Prediction G. B. Kingston, M. F. Lambert and H. R. Maier Centre for Applied Modelling in Water Engineering, School of Civil and Environmental
More informationPractical implementation of possibilistic probability mass functions
Soft Computing manuscript No. (will be inserted by the editor) Practical implementation of possibilistic probability mass functions Leen Gilbert, Gert de Cooman 1, Etienne E. Kerre 2 1 Universiteit Gent,
More informationCS 188: Artificial Intelligence Fall 2009
CS 188: Artificial Intelligence Fall 2009 Lecture 14: Bayes Nets 10/13/2009 Dan Klein UC Berkeley Announcements Assignments P3 due yesterday W2 due Thursday W1 returned in front (after lecture) Midterm
More informationLearning about physical parameters: The importance of model discrepancy
Learning about physical parameters: The importance of model discrepancy Jenný Brynjarsdóttir 1 and Anthony O Hagan 2 June 9, 2014 Abstract Science-based simulation models are widely used to predict the
More informationProbabilistic Graphical Models
Probabilistic Graphical Models Introduction. Basic Probability and Bayes Volkan Cevher, Matthias Seeger Ecole Polytechnique Fédérale de Lausanne 26/9/2011 (EPFL) Graphical Models 26/9/2011 1 / 28 Outline
More informationProbabilistic Models
Bayes Nets 1 Probabilistic Models Models describe how (a portion of) the world works Models are always simplifications May not account for every variable May not account for all interactions between variables
More informationClassification and Regression Trees
Classification and Regression Trees Ryan P Adams So far, we have primarily examined linear classifiers and regressors, and considered several different ways to train them When we ve found the linearity
More informationBayesian vs frequentist techniques for the analysis of binary outcome data
1 Bayesian vs frequentist techniques for the analysis of binary outcome data By M. Stapleton Abstract We compare Bayesian and frequentist techniques for analysing binary outcome data. Such data are commonly
More informationSTAT 499/962 Topics in Statistics Bayesian Inference and Decision Theory Jan 2018, Handout 01
STAT 499/962 Topics in Statistics Bayesian Inference and Decision Theory Jan 2018, Handout 01 Nasser Sadeghkhani a.sadeghkhani@queensu.ca There are two main schools to statistical inference: 1-frequentist
More informationShould all Machine Learning be Bayesian? Should all Bayesian models be non-parametric?
Should all Machine Learning be Bayesian? Should all Bayesian models be non-parametric? Zoubin Ghahramani Department of Engineering University of Cambridge, UK zoubin@eng.cam.ac.uk http://learning.eng.cam.ac.uk/zoubin/
More informationPractical implementation of possibilistic probability mass functions
Practical implementation of possibilistic probability mass functions Leen Gilbert Gert de Cooman Etienne E. Kerre October 12, 2000 Abstract Probability assessments of events are often linguistic in nature.
More informationContents. Decision Making under Uncertainty 1. Meanings of uncertainty. Classical interpretation
Contents Decision Making under Uncertainty 1 elearning resources Prof. Ahti Salo Helsinki University of Technology http://www.dm.hut.fi Meanings of uncertainty Interpretations of probability Biases in
More informationMODULE -4 BAYEIAN LEARNING
MODULE -4 BAYEIAN LEARNING CONTENT Introduction Bayes theorem Bayes theorem and concept learning Maximum likelihood and Least Squared Error Hypothesis Maximum likelihood Hypotheses for predicting probabilities
More informationIntroduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak
Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak 1 Introduction. Random variables During the course we are interested in reasoning about considered phenomenon. In other words,
More informationBayesian Model Specification: Toward a Theory of Applied Statistics
Bayesian Model Specification: Toward a Theory of Applied Statistics David Draper Department of Applied Mathematics and Statistics University of California, Santa Cruz draper@ams.ucsc.edu www.ams.ucsc.edu/
More informationBayes Linear Analysis for Complex Physical Systems Modeled by Computer Simulators
Bayes Linear Analysis for Complex Physical Systems Modeled by Computer Simulators Michael Goldstein Department of Mathematical Sciences, Durham University Durham, United Kingdom Abstract. Most large and
More informationCS 5522: Artificial Intelligence II
CS 5522: Artificial Intelligence II Bayes Nets Instructor: Alan Ritter Ohio State University [These slides were adapted from CS188 Intro to AI at UC Berkeley. All materials available at http://ai.berkeley.edu.]
More informationBayesian Reliability Demonstration
Bayesian Reliability Demonstration F.P.A. Coolen and P. Coolen-Schrijner Department of Mathematical Sciences, Durham University Durham DH1 3LE, UK Abstract This paper presents several main aspects of Bayesian
More informationPlanning With Information States: A Survey Term Project for cs397sml Spring 2002
Planning With Information States: A Survey Term Project for cs397sml Spring 2002 Jason O Kane jokane@uiuc.edu April 18, 2003 1 Introduction Classical planning generally depends on the assumption that the
More information9/12/17. Types of learning. Modeling data. Supervised learning: Classification. Supervised learning: Regression. Unsupervised learning: Clustering
Types of learning Modeling data Supervised: we know input and targets Goal is to learn a model that, given input data, accurately predicts target data Unsupervised: we know the input only and want to make
More informationProbability and Information Theory. Sargur N. Srihari
Probability and Information Theory Sargur N. srihari@cedar.buffalo.edu 1 Topics in Probability and Information Theory Overview 1. Why Probability? 2. Random Variables 3. Probability Distributions 4. Marginal
More informationUncertainty in energy system models
Uncertainty in energy system models Amy Wilson Durham University May 2015 Table of Contents 1 Model uncertainty 2 3 Example - generation investment 4 Conclusion Model uncertainty Contents 1 Model uncertainty
More informationProbability theory basics
Probability theory basics Michael Franke Basics of probability theory: axiomatic definition, interpretation, joint distributions, marginalization, conditional probability & Bayes rule. Random variables:
More informationBayesian Statistical Methods. Jeff Gill. Department of Political Science, University of Florida
Bayesian Statistical Methods Jeff Gill Department of Political Science, University of Florida 234 Anderson Hall, PO Box 117325, Gainesville, FL 32611-7325 Voice: 352-392-0262x272, Fax: 352-392-8127, Email:
More informationCS 343: Artificial Intelligence
CS 343: Artificial Intelligence Bayes Nets Prof. Scott Niekum The University of Texas at Austin [These slides based on those of Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All CS188
More informationNet-to-gross from Seismic P and S Impedances: Estimation and Uncertainty Analysis using Bayesian Statistics
Net-to-gross from Seismic P and S Impedances: Estimation and Uncertainty Analysis using Bayesian Statistics Summary Madhumita Sengupta*, Ran Bachrach, Niranjan Banik, esterngeco. Net-to-gross (N/G ) is
More informationStochastic Processes
qmc082.tex. Version of 30 September 2010. Lecture Notes on Quantum Mechanics No. 8 R. B. Griffiths References: Stochastic Processes CQT = R. B. Griffiths, Consistent Quantum Theory (Cambridge, 2002) DeGroot
More informationLearning Gaussian Process Models from Uncertain Data
Learning Gaussian Process Models from Uncertain Data Patrick Dallaire, Camille Besse, and Brahim Chaib-draa DAMAS Laboratory, Computer Science & Software Engineering Department, Laval University, Canada
More informationBayesian model selection for computer model validation via mixture model estimation
Bayesian model selection for computer model validation via mixture model estimation Kaniav Kamary ATER, CNAM Joint work with É. Parent, P. Barbillon, M. Keller and N. Bousquet Outline Computer model validation
More informationPredictive Engineering and Computational Sciences. Research Challenges in VUQ. Robert Moser. The University of Texas at Austin.
PECOS Predictive Engineering and Computational Sciences Research Challenges in VUQ Robert Moser The University of Texas at Austin March 2012 Robert Moser 1 / 9 Justifying Extrapolitive Predictions Need
More informationProbability and Statistics
Probability and Statistics Kristel Van Steen, PhD 2 Montefiore Institute - Systems and Modeling GIGA - Bioinformatics ULg kristel.vansteen@ulg.ac.be CHAPTER 4: IT IS ALL ABOUT DATA 4a - 1 CHAPTER 4: IT
More informationWhy a Bayesian researcher might prefer observational data
Why a Bayesian researcher might prefer observational data Macartan Humphreys May 2, 206 Abstract I give an illustration of a simple problem in which a Bayesian researcher can choose between random assignment
More informationBayes Linear Calibrated Prediction for. Complex Systems
Bayes Linear Calibrated Prediction for Complex Systems Michael Goldstein and Jonathan Rougier Department of Mathematical Sciences University of Durham, U.K. Abstract A calibration-based approach is developed
More informationUncertainty quantification and calibration of computer models. February 5th, 2014
Uncertainty quantification and calibration of computer models February 5th, 2014 Physical model Physical model is defined by a set of differential equations. Now, they are usually described by computer
More informationBayesian analysis in nuclear physics
Bayesian analysis in nuclear physics Ken Hanson T-16, Nuclear Physics; Theoretical Division Los Alamos National Laboratory Tutorials presented at LANSCE Los Alamos Neutron Scattering Center July 25 August
More informationL applicazione dei metodi Bayesiani nella Farmacoeconomia
L applicazione dei metodi Bayesiani nella Farmacoeconomia Gianluca Baio Department of Statistical Science, University College London (UK) Department of Statistics, University of Milano Bicocca (Italy)
More informationPredicting AGI: What can we say when we know so little?
Predicting AGI: What can we say when we know so little? Fallenstein, Benja Mennen, Alex December 2, 2013 (Working Paper) 1 Time to taxi Our situation now looks fairly similar to our situation 20 years
More informationREASONING UNDER UNCERTAINTY: CERTAINTY THEORY
REASONING UNDER UNCERTAINTY: CERTAINTY THEORY Table of Content Introduction Certainty Theory Definition Certainty Theory: Values Interpretation Certainty Theory: Representation Certainty Factor Propagation
More informationBounding the Probability of Causation in Mediation Analysis
arxiv:1411.2636v1 [math.st] 10 Nov 2014 Bounding the Probability of Causation in Mediation Analysis A. P. Dawid R. Murtas M. Musio February 16, 2018 Abstract Given empirical evidence for the dependence
More informationA new Approach to Drawing Conclusions from Data A Rough Set Perspective
Motto: Let the data speak for themselves R.A. Fisher A new Approach to Drawing Conclusions from Data A Rough et Perspective Zdzisław Pawlak Institute for Theoretical and Applied Informatics Polish Academy
More informationIntroduction to Bayesian Inference
Introduction to Bayesian Inference p. 1/2 Introduction to Bayesian Inference September 15th, 2010 Reading: Hoff Chapter 1-2 Introduction to Bayesian Inference p. 2/2 Probability: Measurement of Uncertainty
More information1 Basic Analysis of Forward-Looking Decision Making
1 Basic Analysis of Forward-Looking Decision Making Individuals and families make the key decisions that determine the future of the economy. The decisions involve balancing current sacrifice against future
More informationProbabilistic Reasoning. (Mostly using Bayesian Networks)
Probabilistic Reasoning (Mostly using Bayesian Networks) Introduction: Why probabilistic reasoning? The world is not deterministic. (Usually because information is limited.) Ways of coping with uncertainty
More informationFundamentals of Data Assimila1on
014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University
More informationProbabilistic Models. Models describe how (a portion of) the world works
Probabilistic Models Models describe how (a portion of) the world works Models are always simplifications May not account for every variable May not account for all interactions between variables All models
More informationStatistical Modelling for Energy Systems Integration
Statistical Modelling for Energy Systems Integration Chris Dent chris.dent@durham.ac.uk ESI 101 NREL, Golden, CO 25 July 2014 Particular thanks to Stan Zachary (Heriot-Watt University), Amy Wilson, Michael
More informationBayesian model selection: methodology, computation and applications
Bayesian model selection: methodology, computation and applications David Nott Department of Statistics and Applied Probability National University of Singapore Statistical Genomics Summer School Program
More informationPROBLEMS OF CAUSAL ANALYSIS IN THE SOCIAL SCIENCES
Patrick Suppes PROBLEMS OF CAUSAL ANALYSIS IN THE SOCIAL SCIENCES This article is concerned with the prospects and problems of causal analysis in the social sciences. On the one hand, over the past 40
More informationNotes on Discriminant Functions and Optimal Classification
Notes on Discriminant Functions and Optimal Classification Padhraic Smyth, Department of Computer Science University of California, Irvine c 2017 1 Discriminant Functions Consider a classification problem
More informationConditional probabilities and graphical models
Conditional probabilities and graphical models Thomas Mailund Bioinformatics Research Centre (BiRC), Aarhus University Probability theory allows us to describe uncertainty in the processes we model within
More informationDecision-making, inference, and learning theory. ECE 830 & CS 761, Spring 2016
Decision-making, inference, and learning theory ECE 830 & CS 761, Spring 2016 1 / 22 What do we have here? Given measurements or observations of some physical process, we ask the simple question what do
More informationA Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling
A Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling G. B. Kingston, H. R. Maier and M. F. Lambert Centre for Applied Modelling in Water Engineering, School
More informationTHE ROLE OF COMPUTER BASED TECHNOLOGY IN DEVELOPING UNDERSTANDING OF THE CONCEPT OF SAMPLING DISTRIBUTION
THE ROLE OF COMPUTER BASED TECHNOLOGY IN DEVELOPING UNDERSTANDING OF THE CONCEPT OF SAMPLING DISTRIBUTION Kay Lipson Swinburne University of Technology Australia Traditionally, the concept of sampling
More information6.867 Machine learning, lecture 23 (Jaakkola)
Lecture topics: Markov Random Fields Probabilistic inference Markov Random Fields We will briefly go over undirected graphical models or Markov Random Fields (MRFs) as they will be needed in the context
More informationUnit 19 Formulating Hypotheses and Making Decisions
Unit 19 Formulating Hypotheses and Making Decisions Objectives: To formulate a null hypothesis and an alternative hypothesis, and to choose a significance level To identify the Type I error and the Type
More informationBayesian Estimation of Input Output Tables for Russia
Bayesian Estimation of Input Output Tables for Russia Oleg Lugovoy (EDF, RANE) Andrey Polbin (RANE) Vladimir Potashnikov (RANE) WIOD Conference April 24, 2012 Groningen Outline Motivation Objectives Bayesian
More informationStatistical Methods in Particle Physics Lecture 1: Bayesian methods
Statistical Methods in Particle Physics Lecture 1: Bayesian methods SUSSP65 St Andrews 16 29 August 2009 Glen Cowan Physics Department Royal Holloway, University of London g.cowan@rhul.ac.uk www.pp.rhul.ac.uk/~cowan
More informationReasoning with Uncertainty
Reasoning with Uncertainty Representing Uncertainty Manfred Huber 2005 1 Reasoning with Uncertainty The goal of reasoning is usually to: Determine the state of the world Determine what actions to take
More informationBased on slides by Richard Zemel
CSC 412/2506 Winter 2018 Probabilistic Learning and Reasoning Lecture 3: Directed Graphical Models and Latent Variables Based on slides by Richard Zemel Learning outcomes What aspects of a model can we
More informationIntroduction to Algorithms / Algorithms I Lecturer: Michael Dinitz Topic: Intro to Learning Theory Date: 12/8/16
600.463 Introduction to Algorithms / Algorithms I Lecturer: Michael Dinitz Topic: Intro to Learning Theory Date: 12/8/16 25.1 Introduction Today we re going to talk about machine learning, but from an
More informationReview: Statistical Model
Review: Statistical Model { f θ :θ Ω} A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced the data. The statistical model
More informationAlexina Mason. Department of Epidemiology and Biostatistics Imperial College, London. 16 February 2010
Strategy for modelling non-random missing data mechanisms in longitudinal studies using Bayesian methods: application to income data from the Millennium Cohort Study Alexina Mason Department of Epidemiology
More informationGaussian processes. Chuong B. Do (updated by Honglak Lee) November 22, 2008
Gaussian processes Chuong B Do (updated by Honglak Lee) November 22, 2008 Many of the classical machine learning algorithms that we talked about during the first half of this course fit the following pattern:
More informationDecision theory. 1 We may also consider randomized decision rules, where δ maps observed data D to a probability distribution over
Point estimation Suppose we are interested in the value of a parameter θ, for example the unknown bias of a coin. We have already seen how one may use the Bayesian method to reason about θ; namely, we
More informationEstimating percentiles of uncertain computer code outputs
Appl. Statist. (2004) 53, Part 1, pp. 83 93 Estimating percentiles of uncertain computer code outputs Jeremy Oakley University of Sheffield, UK [Received June 2001. Final revision June 2003] Summary. A
More informationPrior information, but no MCMC:
Physikalisch-Technische Bundesanstalt Braunschweig and Berlin National Metrology Institute Prior information, but no MCMC: A Bayesian Normal linear regression case study K. Klauenberg, G. Wübbeler, B.
More informationProbability & statistics for linguists Class 2: more probability. D. Lassiter (h/t: R. Levy)
Probability & statistics for linguists Class 2: more probability D. Lassiter (h/t: R. Levy) conditional probability P (A B) = when in doubt about meaning: draw pictures. P (A \ B) P (B) keep B- consistent
More informationPublished in: Tenth Tbilisi Symposium on Language, Logic and Computation: Gudauri, Georgia, September 2013
UvA-DARE (Digital Academic Repository) Estimating the Impact of Variables in Bayesian Belief Networks van Gosliga, S.P.; Groen, F.C.A. Published in: Tenth Tbilisi Symposium on Language, Logic and Computation:
More informationChapter 1. Introduction. 1.1 Background
Chapter 1 Introduction Science is facts; just as houses are made of stones, so is science made of facts; but a pile of stones is not a house and a collection of facts is not necessarily science. Henri
More informationCS491/691: Introduction to Aerial Robotics
CS491/691: Introduction to Aerial Robotics Topic: State Estimation Dr. Kostas Alexis (CSE) World state (or system state) Belief state: Our belief/estimate of the world state World state: Real state of
More informationChapter 5. Bayesian Statistics
Chapter 5. Bayesian Statistics Principles of Bayesian Statistics Anything unknown is given a probability distribution, representing degrees of belief [subjective probability]. Degrees of belief [subjective
More informationLiquid-in-glass thermometer
Liquid-in-glass thermometer Objectives The objective of this experiment is to introduce some basic concepts in measurement, and to develop good measurement habits. In the first section, we will develop
More informationA primer on Bayesian statistics, with an application to mortality rate estimation
A primer on Bayesian statistics, with an application to mortality rate estimation Peter off University of Washington Outline Subjective probability Practical aspects Application to mortality rate estimation
More informationSTAT J535: Introduction
David B. Hitchcock E-Mail: hitchcock@stat.sc.edu Spring 2012 Chapter 1: Introduction to Bayesian Data Analysis Bayesian statistical inference uses Bayes Law (Bayes Theorem) to combine prior information
More informationLecture Notes 1: Decisions and Data. In these notes, I describe some basic ideas in decision theory. theory is constructed from
Topics in Data Analysis Steven N. Durlauf University of Wisconsin Lecture Notes : Decisions and Data In these notes, I describe some basic ideas in decision theory. theory is constructed from The Data:
More informationBasic Probabilistic Reasoning SEG
Basic Probabilistic Reasoning SEG 7450 1 Introduction Reasoning under uncertainty using probability theory Dealing with uncertainty is one of the main advantages of an expert system over a simple decision
More informationECO 317 Economics of Uncertainty Fall Term 2009 Notes for lectures 1. Reminder and Review of Probability Concepts
ECO 317 Economics of Uncertainty Fall Term 2009 Notes for lectures 1. Reminder and Review of Probability Concepts 1 States and Events In an uncertain situation, any one of several possible outcomes may
More informationProbabilistic Independence of Causal Influences
Probabilistic Independence of Causal Influences Adam Zagorecki Engineering Systems Department Defence Academy of the UK Cranfield University Shrivenham, UK Abstract Marek Druzdzel Decision Systems Laboratory
More informationAn Embedded Implementation of Bayesian Network Robot Programming Methods
1 An Embedded Implementation of Bayesian Network Robot Programming Methods By Mark A. Post Lecturer, Space Mechatronic Systems Technology Laboratory. Department of Design, Manufacture and Engineering Management.
More informationCS 188: Artificial Intelligence Spring Today
CS 188: Artificial Intelligence Spring 2006 Lecture 9: Naïve Bayes 2/14/2006 Dan Klein UC Berkeley Many slides from either Stuart Russell or Andrew Moore Bayes rule Today Expectations and utilities Naïve
More informationMiscellany : Long Run Behavior of Bayesian Methods; Bayesian Experimental Design (Lecture 4)
Miscellany : Long Run Behavior of Bayesian Methods; Bayesian Experimental Design (Lecture 4) Tom Loredo Dept. of Astronomy, Cornell University http://www.astro.cornell.edu/staff/loredo/bayes/ Bayesian
More informationPlease bring the task to your first physics lesson and hand it to the teacher.
Pre-enrolment task for 2014 entry Physics Why do I need to complete a pre-enrolment task? This bridging pack serves a number of purposes. It gives you practice in some of the important skills you will
More informationStatistical modelling for energy system planning
Statistical modelling for energy system planning Chris Dent chris.dent@durham.ac.uk DTU Compute Seminar 11 May 2015 Particular thanks to Stan Zachary (Heriot-Watt University), Antony Lawson, Amy Wilson,
More informationThe Island Problem Revisited
The Island Problem Revisited Halvor Mehlum 1 Department of Economics, University of Oslo, Norway E-mail: halvormehlum@econuiono March 10, 2009 1 While carrying out this research, the author has been associated
More informationConfidence Distribution
Confidence Distribution Xie and Singh (2013): Confidence distribution, the frequentist distribution estimator of a parameter: A Review Céline Cunen, 15/09/2014 Outline of Article Introduction The concept
More informationBayesian inference. Fredrik Ronquist and Peter Beerli. October 3, 2007
Bayesian inference Fredrik Ronquist and Peter Beerli October 3, 2007 1 Introduction The last few decades has seen a growing interest in Bayesian inference, an alternative approach to statistical inference.
More informationCombining Forecasts: The End of the Beginning or the Beginning of the End? *
Published in International Journal of Forecasting (1989), 5, 585-588 Combining Forecasts: The End of the Beginning or the Beginning of the End? * Abstract J. Scott Armstrong The Wharton School, University
More informationSTATISTICAL METHODS IN AI/ML Vibhav Gogate The University of Texas at Dallas. Bayesian networks: Representation
STATISTICAL METHODS IN AI/ML Vibhav Gogate The University of Texas at Dallas Bayesian networks: Representation Motivation Explicit representation of the joint distribution is unmanageable Computationally:
More informationOutline. CSE 573: Artificial Intelligence Autumn Agent. Partial Observability. Markov Decision Process (MDP) 10/31/2012
CSE 573: Artificial Intelligence Autumn 2012 Reasoning about Uncertainty & Hidden Markov Models Daniel Weld Many slides adapted from Dan Klein, Stuart Russell, Andrew Moore & Luke Zettlemoyer 1 Outline
More informationIntroducing Proof 1. hsn.uk.net. Contents
Contents 1 1 Introduction 1 What is proof? 1 Statements, Definitions and Euler Diagrams 1 Statements 1 Definitions Our first proof Euler diagrams 4 3 Logical Connectives 5 Negation 6 Conjunction 7 Disjunction
More informationBayesian Model Comparison and Validation John Geweke, University of Iowa December 22, 2006 Models are the venue for much of the
Bayesian Model Comparison and Validation John Geweke, University of Iowa john-geweke@uiowa.edu December 22, 2006 Models are the venue for much of the work of the economics profession. We use them to express,
More information