Introduction to Statistical Methods for Understanding Prediction Uncertainty in Simulation Models
|
|
- Jack Shields
- 5 years ago
- Views:
Transcription
1 LA-UR Introduction to Statistical Methods for Understanding Prediction Uncertainty in Simulation Models Michael D. McKay formerly of the Statistical Sciences Group Los Alamos National Laboratory Presented at the 6 th International Topical Meeting on Nuclear Reactor Thermal Hydraulics, Operations and Safety (NUTHOS-6), October 4-8, 2004, Nara, JAPAN
2 Lecture purpose: Introduce statistical theory and methods of analysis of prediction uncertainty in simulation models. I. Introduction II. Mathematical background Quantifying uncertainty Uncertainty importance and the correlation ratio Estimating the correlation ratio by R 2 III. Application to an environmental pathways model A computer experiment Features of model output Interpreting R 2 s Understanding R 2 s through data plots Cautions IV. Final thoughts and Acknowledgements
3 Prediction uncertainty for a discrete event simulation model Output is Cumulative Tons of Cargo Delivered Inputs are Use Rate, Fuel Flow, (8 in total). Tons of Cargo Day 15 high Prediction for Day 15 Best estimate calculation and design bounds. Given all the uncertainties, will the delivered cargo fall within the design bounds? low
4 Model predictions when inputs range over plausible values high Prediction for Day 15 low
5 It s about connecting-- Connecting physical and mathematical worlds Physical experiment System response w Physical conditions u Nature determines w = M(u). Computer experiment Model prediction y Inputs x Calculation determines y = m(x). System response is a complex quantity W for which y predicts features w = Γ(W). u may not be precisely known (or knowable). Conditions in addition to u might be responsible for w.
6 Prediction-uncertainty bands and important inputs All 8 inputs vary 1 input fixed at nominal 2 inputs fixed at 2 X 2 = 4 values Full predictionuncertainty band Reduced (conditional) uncertainty bands We want to find inputs that control spread.
7 Uncertainty due to model inputs D x x m y D y Plausible x values in generate region for y. Small perturbation of x generates perturbation of y. GLOBAL: Probability function over. D x Dx D x Dy f x ( x ) ( ) LOCAL: D y provides uncertainty weighting Probability function f y y induced by model m defines corresponding uncertainty over. D y
8 Why statistical methods? D x The space of possibilities that generate uncertainties is too big to be enumerated. Suppose uncertainties are due to plausible alternative values of p inputs defined on sets (intervals) characterized by I values (low, high, etc.) p inputs I values # points in input space inputs means there are 435 distinct pairs, 4060 triples, etc., as candidate important subsets of inputs.
9 Quantifying uncertainty Estimate where y is likely to be and characteristics of its probability distribution, for example: ˆ y 2 D, mean value, variance. µ y Tolerance bounds ( aˆ, b ˆ ) that have probability content p with confidence level 1 α 100%. Histogram or density function and empirical distribution function Fˆ t = Est. Pr y t. y σ y ( ) ( ) { }
10 Uncertainty importance (McKay 1997 Reliability Engineering and System Safety) Full model prediction using (all) x: y x = m x with x ~ f x ( ) ( ) ( ) s s Partition x = x U x where s {1,2, L, p} selects a subset (1 or more) of input variables. s Best restricted prediction using only x : ( s ) ( s ) s with ~ ( s = ) s y% x E y x x f x x = m x f x x dx ( ) ( ) s x s s s
11 Uncertainty importance (continued) s How does knowing x reduce uncertainty, or How close is y% to y (on average)? s Measuring uncertainty importance of x by how well it alone, compared to all x, predicts: E y% y y y% 2 ( ) = Var( ) Var( ) leads to the Pearson (1903) correlation ratio 2 η = Var( y% ) / Var( y) which is estimated (by R 2 ) from a sample of runs.
12 Linking formulas and data All 8 inputs vary 1 input fixed at nominal 2 inputs fixed at 2 X 2 = 4 values Var [ y] [ y % ] ( ) 2 Var h = Var y Var [ y% ]
13 Estimating the correlation ratio from an appropriate sample of runs s s s Let { x1, L, x n } be n values of x. s s s s For each x, let { x be r values of. i 1, L, x r } x Let { yij i = 1, L, n; j = 1, L, r} be the associated N = n r values from the model computer runs. Then, n r 1 y y estimates E y, r j = 1 = åå nr i = 1 j = 1 ij ( ) r 1 ( s s estimates E ) = ( s y ) i = å yi j y x = xi y % xi,
14 Estimating the correlation ratio (continued) n 2 åå( y ) ij - y nr [ y] SST = estimates Var, n i= 1 j= 1 r i= 1 j= 1 r 2 SSB = åå( ) estimates Var ( s y E ) i - y nr é y x ù ê ú. ë û y% Finally, Var é ( s ) 2 SSB E y x ù estimates 2 ê ú R = h = ë û. SST Var ( y) Of course, quality (validity) of estimates depends on a proper sampling plan / experimental design.
15 Experimental designs for estimating R 2 Replicated Latin hypercube sampling (rlhs) for subset size 1. Range of each input is divided into n equal probability intervals. Each interval is (conditionally) sampled once. Values are combined at random across input variables r times for N = n x r design points (r LHSs). Orthogonal array sampling (OAS) for subset size > 1. Like a rlhs but the values are combined in particular patterns, not at random. Usually, small n and larger r.
16 Application: model of environmental pathways 0. COMPARTMENTS 1. Vegetation surface 2. Vegetation interior 3. Terrestrial invertebrates 4. Small herbivores 5. Large herbivores 6. Insectivores 7. Predators 8. Litter 84 MODEL INPUTS Input Lower Upper Nominal X X
17 Experimental design for computer experiment p = 84 continuous model inputs discretized at 7 values or levels N = 343 of the possible 7 84 points in D x chosen using orthogonal array sampling (OAS) Note: In some examples that follow, there are 50 or 100 inputs and rlhs instead of OAS was used.
18 Output of pathways model for Compartment 3 when inputs range over plausible values Concentration Time in days
19 Candidates for analysis of pathways model output Scalar outputs: Equilibrium concentration (how high): Y 1 = C max Time to Equilibrium (how fast): Y 2 = t max = 0.9 C max Time dependent outputs: C(t) Normalized: C(t) / C max where C max = C(t max ) Standard time: C * (u) = C(u x t max ) / C max, 0 u 1
20 In the best of worlds: Pattern of ordered R 2 s for C max for 100 inputs from a sample of size 5000 R 2 Pattern suggests 4 groups of indistinguishable inputs Inputs ordered by R 2
21 What inputs do: Patterns of y% (average y) for top 9 inputs Average output level
22 In the not-so-best of worlds: Pattern of ordered R 2 s for C max for 100 inputs from a sample of size 10 R 2 Pattern suggests 1 group of indistinguishable inputs Inputs ordered by R 2
23 In a real world: R 2 s for the two scalar outputs with N = 343 R 2 s for t max R 2 s for C max Inputs ordered by R 2
24 Histogram of values of tmax
25 Values of t max plotted by values of inputs
26 In a real world: R 2 s for the two scalar outputs with N = 343 R 2 s for t max R 2 s for C max Inputs ordered by R 2
27 Histogram of values of Cmax
28 Values of C max plotted by value of inputs
29 Joint R 2 s for C max and Aliasing with OAS
30 R 2 s for Concentration as a function of time X24 R 2 X63 Time in days
31 Some main points Uncertainty quantification requires connecting physical and mathematical worlds. In the mathematical world, variation in inputs x is propagated by the simulation model to variation in outputs y. Variance of y is a measure of prediction uncertainty induced by inputs. Uncertainty importance of a subset of inputs refers to their contribution to prediction uncertainty.
32 Acknowledgements DECOMPOSITIONS H. H. Panjer (1973), On the Decomposition of Moments by Conditional Moments, The American Statistician, 27, CORRELATION RATIO R. L. Iman and S. C. Hora (1990), A Robust Measure of Uncertainty Importance for Use in Fault Tree System Analysis, Risk Analysis, 10, 3, B. Krzykacz (1990), SAMOS: A Computer Program for the Derivation of Empirical Sensitivity Measures of Results from Large Computer Models., GRS-A-1700, Gesellschaft fur Reaktorsicherheit (GRS) mbh, Garching, Republic of Germany. K. Pearson (1903), Mathematical Contributions to the Theory of Evolution, Proceedings of the Royal Society of London, 71, SAMPLING PLANS M. D. McKay, W. J. Conover and R. J. Beckman (1979), A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code, Technometrics, 21, 2, (Latin hypercube sampling) Art B. Owen (1992), Orthogonal Arrays for Computer Integration and Visualization, Statistica Sinica, 2, 2, GENERAL REFERENCES M. D. McKay (1995), Evaluating Prediction Uncertainty, NUREG/CR-6311, U.S. Nuclear Regulatory Commission and Los Alamos National Laboratory Report. M. D. McKay, J. D. Morrison, S. C. Upton (1999), Evaluating Prediction Uncertainty in Simulation Models, Computer Physics Communications, 117, A. Saltelli, K. Chan, E.M. Scott (Eds.), Sensitivity Analysis, John Wiley and Sons, Ltd. (2000).
Evaluating prediction uncertainty in simulation models
Submitted to Computer Physics Communications LA-UR-98 1362 Evaluating prediction uncertainty in simulation models Michael D. McKay, 1 John D. Morrison, Stephen C. Upton Los Alamos National Laboratory Los
More informationSensitivity Analysis When Model Outputs Are Functions
LAUR-04-1991 Sensitivity Analysis When Model Outputs Are Functions Michael D. McKay and Katherine Campbell formerly of the Statistical Sciences Group Los Alamos National Laboratory Presented at the Fourth
More informationJ. Beckman, TSA-1 Morrison, TSA-5. May 11-14, m4s
LA-UR- a Title: Author@): Submitfed to: EVALUATNG UNCERTANTY N SMULATON MODELS Michael Richard John D. Stephen D. McKay TSA-1 J. Beckman TSA-1 Morrison TSA-5 C. Upton TSA-5 Predictability: Quantifying
More informationUsing Orthogonal Arrays in the Sensitivity Analysis of Computer Models
. Using Orthogonal Arrays in the Sensitivity Analysis of Computer Models Max D. Morris Department of Statistics, and Department of Industrial and Manufacturing Systems Engineering Iowa State University
More informationPolynomial chaos expansions for sensitivity analysis
c DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for sensitivity analysis B. Sudret Chair of Risk, Safety & Uncertainty
More informationEvaluating Prediction Uncertainty
NUREG/CR-6311 LA-12915-MS Evaluating Prediction Uncertainty Prepared by M.D. McKay Los Alamos National Laboratory Prepared for U.S. Nuclear Regulatory Commission AVAILABILITY NOTICE Availability of Reference
More information18Ï È² 7( &: ÄuANOVAp.O`û5 571 Based on this ANOVA model representation, Sobol (1993) proposed global sensitivity index, S i1...i s = D i1...i s /D, w
A^VÇÚO 1 Êò 18Ï 2013c12 Chinese Journal of Applied Probability and Statistics Vol.29 No.6 Dec. 2013 Optimal Properties of Orthogonal Arrays Based on ANOVA High-Dimensional Model Representation Chen Xueping
More informationIntroduction to emulators - the what, the when, the why
School of Earth and Environment INSTITUTE FOR CLIMATE & ATMOSPHERIC SCIENCE Introduction to emulators - the what, the when, the why Dr Lindsay Lee 1 What is a simulator? A simulator is a computer code
More informationProbing the covariance matrix
Probing the covariance matrix Kenneth M. Hanson Los Alamos National Laboratory (ret.) BIE Users Group Meeting, September 24, 2013 This presentation available at http://kmh-lanl.hansonhub.com/ LA-UR-06-5241
More informationA CENTRAL LIMIT THEOREM FOR NESTED OR SLICED LATIN HYPERCUBE DESIGNS
Statistica Sinica 26 (2016), 1117-1128 doi:http://dx.doi.org/10.5705/ss.202015.0240 A CENTRAL LIMIT THEOREM FOR NESTED OR SLICED LATIN HYPERCUBE DESIGNS Xu He and Peter Z. G. Qian Chinese Academy of Sciences
More informationAnale. Seria Informatică. Vol. XIII fasc Annals. Computer Science Series. 13 th Tome 1 st Fasc. 2015
24 CONSTRUCTION OF ORTHOGONAL ARRAY-BASED LATIN HYPERCUBE DESIGNS FOR DETERMINISTIC COMPUTER EXPERIMENTS Kazeem A. Osuolale, Waheed B. Yahya, Babatunde L. Adeleke Department of Statistics, University of
More informationMultiple Predictor Smoothing Methods for Sensitivity Analysis: Example Results
Date: 8/10/006 Multiple Predictor Smoothing Methods for Sensitivity Analysis: Example Results Curtis B. Storlie a and Jon C. Helton b a Department of Statistics, North Carolina State University, Raleigh,
More informationStat 890 Design of computer experiments
Stat 890 Design of computer experiments Will introduce design concepts for computer experiments Will look at more elaborate constructions next day Experiment design In computer experiments, as in many
More informationSome methods for sensitivity analysis of systems / networks
Article Some methods for sensitivity analysis of systems / networks WenJun Zhang School of Life Sciences, Sun Yat-sen University, Guangzhou 510275, China; International Academy of Ecology and Environmental
More informationMinimizing the Number of Function Evaluations to Estimate Sobol Indices Using Quasi-Monte Carlo
Minimizing the Number of Function Evaluations to Estimate Sobol Indices Using Quasi-Monte Carlo Lluís Antoni Jiménez Rugama Joint work with: Fred J Hickernell (IIT), Clémentine Prieur (Univ Grenoble),
More informationGaussian Process Regression and Emulation
Gaussian Process Regression and Emulation STAT8810, Fall 2017 M.T. Pratola September 22, 2017 Today Experimental Design; Sensitivity Analysis Designing Your Experiment If you will run a simulator model,
More informationKullback-Leibler Designs
Kullback-Leibler Designs Astrid JOURDAN Jessica FRANCO Contents Contents Introduction Kullback-Leibler divergence Estimation by a Monte-Carlo method Design comparison Conclusion 2 Introduction Computer
More informationA comparison of global sensitivity techniques and sampling method
22nd International Congress on Modelling and Simulation, Hobart, Tasmania, Australia, 3 to 8 December 2017 mssanz.org.au/modsim2017 A comparison of global sensitivity techniques and sampling method X.
More informationAN UNCERTAINTY ASSESSMENT METHODOLOGY FOR MATERIALS BEHAVIOUR IN ADVANCED FAST REACTORS
AN UNCERTAINTY ASSESSMENT METHODOLOGY FOR MATERIALS BEHAVIOUR IN ADVANCED FAST REACTORS D. Blanchet, K. Mikityuk, P. Coddington and R. Chawla Paul Scherrer Institut, Switzerland Abstract The current study
More informationConcepts in Global Sensitivity Analysis IMA UQ Short Course, June 23, 2015
Concepts in Global Sensitivity Analysis IMA UQ Short Course, June 23, 2015 A good reference is Global Sensitivity Analysis: The Primer. Saltelli, et al. (2008) Paul Constantine Colorado School of Mines
More informationLatin Hypercube Sampling with Multidimensional Uniformity
Latin Hypercube Sampling with Multidimensional Uniformity Jared L. Deutsch and Clayton V. Deutsch Complex geostatistical models can only be realized a limited number of times due to large computational
More informationAuthors : Eric CHOJNACKI IRSN/DPAM/SEMIC Jean-Pierre BENOIT IRSN/DSR/ST3C. IRSN : Institut de Radioprotection et de Sûreté Nucléaire
WORKSHOP ON THE EVALUATION OF UNCERTAINTIES IN RELATION TO SEVERE ACCIDENTS AND LEVEL II PROBABILISTIC SAFETY ANALYSIS CADARACHE, FRANCE, 7-9 NOVEMBER 2005 TITLE The use of Monte-Carlo simulation and order
More informationLectures. Variance-based sensitivity analysis in the presence of correlated input variables. Thomas Most. Source:
Lectures Variance-based sensitivity analysis in the presence of correlated input variables Thomas Most Source: www.dynardo.de/en/library Variance-based sensitivity analysis in the presence of correlated
More informationBAYESIAN DECISION THEORY
Last updated: September 17, 2012 BAYESIAN DECISION THEORY Problems 2 The following problems from the textbook are relevant: 2.1 2.9, 2.11, 2.17 For this week, please at least solve Problem 2.3. We will
More informationSensitivity analysis using the Metamodel of Optimal Prognosis. Lectures. Thomas Most & Johannes Will
Lectures Sensitivity analysis using the Metamodel of Optimal Prognosis Thomas Most & Johannes Will presented at the Weimar Optimization and Stochastic Days 2011 Source: www.dynardo.de/en/library Sensitivity
More informationA Polynomial Chaos Approach to Robust Multiobjective Optimization
A Polynomial Chaos Approach to Robust Multiobjective Optimization Silvia Poles 1, Alberto Lovison 2 1 EnginSoft S.p.A., Optimization Consulting Via Giambellino, 7 35129 Padova, Italy s.poles@enginsoft.it
More informationEfficient geostatistical simulation for spatial uncertainty propagation
Efficient geostatistical simulation for spatial uncertainty propagation Stelios Liodakis University of the Aegean University Hill Mytilene, Greece stelioslio@geo.aegean.gr Phaedon Kyriakidis Cyprus University
More informationA GENERAL THEORY FOR ORTHOGONAL ARRAY BASED LATIN HYPERCUBE SAMPLING
Statistica Sinica 26 (2016), 761-777 doi:http://dx.doi.org/10.5705/ss.202015.0029 A GENERAL THEORY FOR ORTHOGONAL ARRAY BASED LATIN HYPERCUBE SAMPLING Mingyao Ai, Xiangshun Kong and Kang Li Peking University
More informationEfficient sensitivity analysis for virtual prototyping. Lectures. Thomas Most & Johannes Will
Lectures Efficient sensitivity analysis for virtual prototyping Thomas Most & Johannes Will presented at the ECCOMAS Conference 2012 Source: www.dynardo.de/en/library European Congress on Computational
More informationarxiv: v1 [math.st] 23 Sep 2014
The Annals of Statistics 2014, Vol. 42, No. 5, 1725 1750 DOI: 10.1214/14-AOS1231 c Institute of Mathematical Statistics, 2014 arxiv:1409.6495v1 [math.st] 23 Sep 2014 A CENTRAL LIMIT THEOREM FOR GENERAL
More informationTreatment of Implicit Effects with XSUSA.
Treatment of Implicit Effects with Friederike Bostelmann 1,2, Andreas Pautz 2, Winfried Zwermann 1 1 Gesellschaft für Anlagen- und Reaktorsicherheit (GRS) ggmbh, Boltzmannstraße 14, 85748 Garching, Germany
More informationStatistical Methods for Astronomy
Statistical Methods for Astronomy Probability (Lecture 1) Statistics (Lecture 2) Why do we need statistics? Useful Statistics Definitions Error Analysis Probability distributions Error Propagation Binomial
More informationInterpreting Regression Results
Interpreting Regression Results Carlo Favero Favero () Interpreting Regression Results 1 / 42 Interpreting Regression Results Interpreting regression results is not a simple exercise. We propose to split
More informationAndrew Ford Program in Environmental Science and Regional Planning, Washington State University, USA
SENSITIVITY ANALYSIS Andrew Ford Program in Environmental Science and Regional Planning, Washington State University, USA Keywords: computer simulation, sensitivity analysis, statistical analysis, sample
More informationHowever, reliability analysis is not limited to calculation of the probability of failure.
Probabilistic Analysis probabilistic analysis methods, including the first and second-order reliability methods, Monte Carlo simulation, Importance sampling, Latin Hypercube sampling, and stochastic expansions
More informationLocal and Global Sensitivity Analysis
Omar 1,2 1 Duke University Department of Mechanical Engineering & Materials Science omar.knio@duke.edu 2 KAUST Division of Computer, Electrical, Mathematical Science & Engineering omar.knio@kaust.edu.sa
More informationUncertainty of the Level 2 PSA for NPP Paks. Gábor Lajtha, VEIKI Institute for Electric Power Research, Budapest, Hungary
Uncertainty of the Level 2 PSA for NPP Paks Gábor Lajtha, VEIKI Institute for Electric Power Research, Budapest, Hungary Attila Bareith, Előd Holló, Zoltán Karsa, Péter Siklóssy, Zsolt Téchy VEIKI Institute
More informationSemidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization
Semidefinite and Second Order Cone Programming Seminar Fall 2012 Project: Robust Optimization and its Application of Robust Portfolio Optimization Instructor: Farid Alizadeh Author: Ai Kagawa 12/12/2012
More informationProbability and statistics; Rehearsal for pattern recognition
Probability and statistics; Rehearsal for pattern recognition Václav Hlaváč Czech Technical University in Prague Czech Institute of Informatics, Robotics and Cybernetics 166 36 Prague 6, Jugoslávských
More informationAdvanced Simulation Methods for the Reliability Analysis of Nuclear Passive Systems
Advanced Simulation Methods for the Reliability Analysis of Nuclear Passive Systems Francesco Di Maio, Nicola Pedroni, Enrico Zio* Politecnico di Milano, Department of Energy, Nuclear Division *Chaire
More informationSobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis
Sobol-Hoeffding decomposition Application to Global SA Computation of the SI Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Olivier Le Maître with Colleague & Friend Omar
More informationSequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process
Applied Mathematical Sciences, Vol. 4, 2010, no. 62, 3083-3093 Sequential Procedure for Testing Hypothesis about Mean of Latent Gaussian Process Julia Bondarenko Helmut-Schmidt University Hamburg University
More informationSensitivity analysis and calibration of a global aerosol model
School of Earth and Environment Sensitivity analysis and calibration of a global aerosol model Lindsay Lee l.a.lee@leeds.ac.uk Ken Carslaw 1, Carly Reddington 1, Kirsty Pringle 1, Jeff Pierce 3, Graham
More informationProceedings of the 2014 Winter Simulation Conference A. Tolk, S. Y. Diallo, I. O. Ryzhov, L. Yilmaz, S. Buckley, and J. A. Miller, eds.
Proceedings of the 2014 Winter Simulation Conference A. Tolk, S. Y. Diallo, I. O. Ryzhov, L. Yilmaz, S. Buckley, and J. A. Miller, eds. CONSTRUCTING CONFIDENCE INTERVALS FOR A QUANTILE USING BATCHING AND
More informationSimple Linear Regression: The Model
Simple Linear Regression: The Model task: quantifying the effect of change X in X on Y, with some constant β 1 : Y = β 1 X, linear relationship between X and Y, however, relationship subject to a random
More informationExperimental Space-Filling Designs For Complicated Simulation Outpts
Experimental Space-Filling Designs For Complicated Simulation Outpts LTC Alex MacCalman PhD Student Candidate Modeling, Virtual Environments, and Simulations (MOVES) Institute Naval Postgraduate School
More informationKeywords: Sonic boom analysis, Atmospheric uncertainties, Uncertainty quantification, Monte Carlo method, Polynomial chaos method.
Blucher Mechanical Engineering Proceedings May 2014, vol. 1, num. 1 www.proceedings.blucher.com.br/evento/10wccm SONIC BOOM ANALYSIS UNDER ATMOSPHERIC UNCERTAINTIES BY A NON-INTRUSIVE POLYNOMIAL CHAOS
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
nalysis of Variance and Design of Experiment-I MODULE V LECTURE - 9 FCTORIL EXPERIMENTS Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Sums of squares Suppose
More informationSensitivity Analysis of a Nuclear Reactor System Finite Element Model
Westinghouse Non-Proprietary Class 3 Sensitivity Analysis of a Nuclear Reactor System Finite Element Model 2018 ASME Verification & Validation Symposium VVS2018-9306 Gregory A. Banyay, P.E. Stephen D.
More informationOikos. Appendix A1. o20830
1 Oikos o20830 Valdovinos, F. S., Moisset de Espanés, P., Flores, J. D. and Ramos-Jiliberto, R. 2013. Adaptive foraging allows the maintenance of biodiversity of pollination networks. Oikos 122: 907 917.
More informationInstrumentation (cont.) Statistics vs. Parameters. Descriptive Statistics. Types of Numerical Data
Norm-Referenced vs. Criterion- Referenced Instruments Instrumentation (cont.) October 1, 2007 Note: Measurement Plan Due Next Week All derived scores give meaning to individual scores by comparing them
More informationOne-at-a-Time Designs for Estimating Elementary Effects of Simulator Experiments with Non-rectangular Input Regions
Statistics and Applications Volume 11, Nos. 1&2, 2013 (New Series), pp. 15-32 One-at-a-Time Designs for Estimating Elementary Effects of Simulator Experiments with Non-rectangular Input Regions Fangfang
More informationMultivariate Distributions
IEOR E4602: Quantitative Risk Management Spring 2016 c 2016 by Martin Haugh Multivariate Distributions We will study multivariate distributions in these notes, focusing 1 in particular on multivariate
More informationMachine learning for pervasive systems Classification in high-dimensional spaces
Machine learning for pervasive systems Classification in high-dimensional spaces Department of Communications and Networking Aalto University, School of Electrical Engineering stephan.sigg@aalto.fi Version
More informationHANDBOOK OF APPLICABLE MATHEMATICS
HANDBOOK OF APPLICABLE MATHEMATICS Chief Editor: Walter Ledermann Volume VI: Statistics PART A Edited by Emlyn Lloyd University of Lancaster A Wiley-Interscience Publication JOHN WILEY & SONS Chichester
More informationCONSTRUCTION OF NESTED (NEARLY) ORTHOGONAL DESIGNS FOR COMPUTER EXPERIMENTS
Statistica Sinica 23 (2013), 451-466 doi:http://dx.doi.org/10.5705/ss.2011.092 CONSTRUCTION OF NESTED (NEARLY) ORTHOGONAL DESIGNS FOR COMPUTER EXPERIMENTS Jun Li and Peter Z. G. Qian Opera Solutions and
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationBasics of Uncertainty Analysis
Basics of Uncertainty Analysis Chapter Six Basics of Uncertainty Analysis 6.1 Introduction As shown in Fig. 6.1, analysis models are used to predict the performances or behaviors of a product under design.
More informationSensitivity analysis in linear and nonlinear models: A review. Introduction
Sensitivity analysis in linear and nonlinear models: A review Caren Marzban Applied Physics Lab. and Department of Statistics Univ. of Washington, Seattle, WA, USA 98195 Consider: Introduction Question:
More informationMODIFIED MONTE CARLO WITH LATIN HYPERCUBE METHOD
MODIFIED MONTE CARLO WITH LATIN HYPERCUBE METHOD Latin hypercube sampling (LHS) was introduced by McKay, Conover and Beckman as a solution to increase the efficiency of computer simulations. This technique
More informationSequential Importance Sampling for Rare Event Estimation with Computer Experiments
Sequential Importance Sampling for Rare Event Estimation with Computer Experiments Brian Williams and Rick Picard LA-UR-12-22467 Statistical Sciences Group, Los Alamos National Laboratory Abstract Importance
More informationReview of the role of uncertainties in room acoustics
Review of the role of uncertainties in room acoustics Ralph T. Muehleisen, Ph.D. PE, FASA, INCE Board Certified Principal Building Scientist and BEDTR Technical Lead Division of Decision and Information
More informationA Short Course in Basic Statistics
A Short Course in Basic Statistics Ian Schindler November 5, 2017 Creative commons license share and share alike BY: C 1 Descriptive Statistics 1.1 Presenting statistical data Definition 1 A statistical
More informationWorst-case design of structures using stopping rules in k-adaptive random sampling approach
10 th World Congress on Structural and Multidisciplinary Optimization May 19-4, 013, Orlando, Florida, USA Worst-case design of structures using stopping rules in k-adaptive random sampling approach Makoto
More informationBEST ESTIMATE PLUS UNCERTAINTY SAFETY STUDIES AT THE CONCEPTUAL DESIGN PHASE OF THE ASTRID DEMONSTRATOR
BEST ESTIMATE PLUS UNCERTAINTY SAFETY STUDIES AT THE CONCEPTUAL DESIGN PHASE OF THE ASTRID DEMONSTRATOR M. Marquès CEA, DEN, DER F-13108, Saint-Paul-lez-Durance, France Advanced simulation in support to
More informationConflicts of Interest
Analysis of Dependent Variables: Correlation and Simple Regression Zacariah Labby, PhD, DABR Asst. Prof. (CHS), Dept. of Human Oncology University of Wisconsin Madison Conflicts of Interest None to disclose
More informationUncertainty Propagation and Global Sensitivity Analysis in Hybrid Simulation using Polynomial Chaos Expansion
Uncertainty Propagation and Global Sensitivity Analysis in Hybrid Simulation using Polynomial Chaos Expansion EU-US-Asia workshop on hybrid testing Ispra, 5-6 October 2015 G. Abbiati, S. Marelli, O.S.
More informationResearch the applicability of DOE about optimizing manufacturing process parameters
3rd International Conference on Machinery, Materials and Information Technology Applications (ICMMITA 2015) Research the applicability of DOE about optimizing manufacturing process parameters XinHu Zhang1,
More informationReliability analysis of geotechnical risks
Reliability analysis of geotechnical risks Lazhar Belabed*, Hacene Benyaghla* * Department of Civil Engineering and Hydraulics, University of Guelma, Algeria Abstract The evaluation of safety or reliability
More informationInference in VARs with Conditional Heteroskedasticity of Unknown Form
Inference in VARs with Conditional Heteroskedasticity of Unknown Form Ralf Brüggemann a Carsten Jentsch b Carsten Trenkler c University of Konstanz University of Mannheim University of Mannheim IAB Nuremberg
More informationA construction method for orthogonal Latin hypercube designs
Biometrika (2006), 93, 2, pp. 279 288 2006 Biometrika Trust Printed in Great Britain A construction method for orthogonal Latin hypercube designs BY DAVID M. STEINBERG Department of Statistics and Operations
More informationIncreasing precision by partitioning the error sum of squares: Blocking: SSE (CRD) à SSB + SSE (RCBD) Contrasts: SST à (t 1) orthogonal contrasts
Lecture 13 Topic 9: Factorial treatment structures (Part II) Increasing precision by partitioning the error sum of squares: s MST F = = MSE 2 among = s 2 within SST df trt SSE df e Blocking: SSE (CRD)
More informationLocal Polynomial Estimation for Sensitivity Analysis on Models With Correlated Inputs
Local Polynomial Estimation for Sensitivity Analysis on Models With Correlated Inputs Sébastien Da Veiga, François Wahl, Fabrice Gamboa To cite this version: Sébastien Da Veiga, François Wahl, Fabrice
More informationCONSTRUCTION OF NESTED ORTHOGONAL LATIN HYPERCUBE DESIGNS
Statistica Sinica 24 (2014), 211-219 doi:http://dx.doi.org/10.5705/ss.2012.139 CONSTRUCTION OF NESTED ORTHOGONAL LATIN HYPERCUBE DESIGNS Jinyu Yang 1, Min-Qian Liu 1 and Dennis K. J. Lin 2 1 Nankai University
More informationStatistical Methods for Astronomy
Statistical Methods for Astronomy If your experiment needs statistics, you ought to have done a better experiment. -Ernest Rutherford Lecture 1 Lecture 2 Why do we need statistics? Definitions Statistical
More informationMeasurement error as missing data: the case of epidemiologic assays. Roderick J. Little
Measurement error as missing data: the case of epidemiologic assays Roderick J. Little Outline Discuss two related calibration topics where classical methods are deficient (A) Limit of quantification methods
More informationPart III: Unstructured Data. Lecture timetable. Analysis of data. Data Retrieval: III.1 Unstructured data and data retrieval
Inf1-DA 2010 20 III: 28 / 89 Part III Unstructured Data Data Retrieval: III.1 Unstructured data and data retrieval Statistical Analysis of Data: III.2 Data scales and summary statistics III.3 Hypothesis
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationTotal interaction index: A variance-based sensitivity index for second-order interaction screening
Total interaction index: A variance-based sensitivity index for second-order interaction screening J. Fruth a, O. Roustant b, S. Kuhnt a,c a Faculty of Statistics, TU Dortmund University, Vogelpothsweg
More informationSome optimal criteria of model-robustness for two-level non-regular fractional factorial designs
Some optimal criteria of model-robustness for two-level non-regular fractional factorial designs arxiv:0907.052v stat.me 3 Jul 2009 Satoshi Aoki July, 2009 Abstract We present some optimal criteria to
More informationA New MCNPX PTRAC Coincidence Capture File Capability: A Tool for Neutron Detector Design
Abstract A New MCNPX PTRAC Coincidence Capture File Capability: A Tool for Neutron Detector Design L. G. Evans, M.A. Schear, J. S. Hendricks, M.T. Swinhoe, S.J. Tobin and S. Croft Los Alamos National Laboratory
More informationExpert Judgment Elicitation Methods and Tools
CREATE Research Archive Research Project Summaries 2009 Expert Judgment Elicitation Methods and Tools Stephen C. Hora University of Southern California, hora@usc.edu Follow this and additional works at:
More informationSAMPLING IN FIELD EXPERIMENTS
SAMPLING IN FIELD EXPERIMENTS Rajender Parsad I.A.S.R.I., Library Avenue, New Delhi-0 0 rajender@iasri.res.in In field experiments, the plot size for experimentation is selected for achieving a prescribed
More informationWeighted space-filling designs
Weighted space-filling designs Dave Woods D.Woods@southampton.ac.uk www.southampton.ac.uk/ davew Joint work with Veronica Bowman (Dstl) Supported by the Defence Threat Reduction Agency 1 / 34 Outline Motivation
More informationCS 5014: Research Methods in Computer Science. Experimental Design. Potential Pitfalls. One-Factor (Again) Clifford A. Shaffer.
Department of Computer Science Virginia Tech Blacksburg, Virginia Copyright c 2015 by Clifford A. Shaffer Computer Science Title page Computer Science Clifford A. Shaffer Fall 2015 Clifford A. Shaffer
More informationDesign for Reliability and Robustness through probabilistic Methods in COMSOL Multiphysics with OptiY
Presented at the COMSOL Conference 2008 Hannover Multidisciplinary Analysis and Optimization In1 Design for Reliability and Robustness through probabilistic Methods in COMSOL Multiphysics with OptiY In2
More informationClasses of Second-Order Split-Plot Designs
Classes of Second-Order Split-Plot Designs DATAWorks 2018 Springfield, VA Luis A. Cortés, Ph.D. The MITRE Corporation James R. Simpson, Ph.D. JK Analytics, Inc. Peter Parker, Ph.D. NASA 22 March 2018 Outline
More informationLinear Algebra in Computer Vision. Lecture2: Basic Linear Algebra & Probability. Vector. Vector Operations
Linear Algebra in Computer Vision CSED441:Introduction to Computer Vision (2017F Lecture2: Basic Linear Algebra & Probability Bohyung Han CSE, POSTECH bhhan@postech.ac.kr Mathematics in vector space Linear
More informationData analysis and Geostatistics - lecture VII
Data analysis and Geostatistics - lecture VII t-tests, ANOVA and goodness-of-fit Statistical testing - significance of r Testing the significance of the correlation coefficient: t = r n - 2 1 - r 2 with
More informationEFFICIENT SHAPE OPTIMIZATION USING POLYNOMIAL CHAOS EXPANSION AND LOCAL SENSITIVITIES
9 th ASCE Specialty Conference on Probabilistic Mechanics and Structural Reliability EFFICIENT SHAPE OPTIMIZATION USING POLYNOMIAL CHAOS EXPANSION AND LOCAL SENSITIVITIES Nam H. Kim and Haoyu Wang University
More informationCorrelation and Regression
Correlation and Regression October 25, 2017 STAT 151 Class 9 Slide 1 Outline of Topics 1 Associations 2 Scatter plot 3 Correlation 4 Regression 5 Testing and estimation 6 Goodness-of-fit STAT 151 Class
More informationLECTURE 2 LINEAR REGRESSION MODEL AND OLS
SEPTEMBER 29, 2014 LECTURE 2 LINEAR REGRESSION MODEL AND OLS Definitions A common question in econometrics is to study the effect of one group of variables X i, usually called the regressors, on another
More informationIGD-TP Exchange Forum n 5 WG1 Safety Case: Handling of uncertainties October th 2014, Kalmar, Sweden
IGD-TP Exchange Forum n 5 WG1 Safety Case: Handling of uncertainties October 28-30 th 2014, Kalmar, Sweden Comparison of probabilistic and alternative evidence theoretical methods for the handling of parameter
More informationBayesian tsunami fragility modeling considering input data uncertainty
Bayesian tsunami fragility modeling considering input data uncertainty Raffaele De Risi Research Associate University of Bristol United Kingdom De Risi, R., Goda, K., Mori, N., & Yasuda, T. (2016). Bayesian
More informationIntroduction to Basic Statistics Version 2
Introduction to Basic Statistics Version 2 Pat Hammett, Ph.D. University of Michigan 2014 Instructor Comments: This document contains a brief overview of basic statistics and core terminology/concepts
More informationClaims Reserving under Solvency II
Claims Reserving under Solvency II Mario V. Wüthrich RiskLab, ETH Zurich Swiss Finance Institute Professor joint work with Michael Merz (University of Hamburg) April 21, 2016 European Congress of Actuaries,
More informationUncertainty Quantification of EBR-II Loss of Heat Sink Simulations with SAS4A/SASSYS-1 and DAKOTA
1 IAEA-CN245-023 Uncertainty Quantification of EBR-II Loss of Heat Sink Simulations with SAS4A/SASSYS-1 and DAKOTA G. Zhang 1, T. Sumner 1, T. Fanning 1 1 Argonne National Laboratory, Argonne, IL, USA
More informationTAGUCHI METHOD for DYNAMIC PROBLEMS
TAGUCHI METHOD for DYNAMIC PROBLEMS Dr. P. R. Apte IIT Bombay SIGNAL - TO - NOISE RATIO 8Feb-1Mar 01 P.R. Apte : 3-Day Taguchi Method Workshop at UNIMAP S/N ratio (Dynamic) - Dyn S/N Ratio - 1 NOISE X
More informationLos Alamos NATIONAL LABORATORY
Validation of Engineering Applications at LANL (*) Thomas A. Butler Scott W. Doebling François M. Hemez John F. Schultze Hoon Sohn Group National Laboratory, New Mexico, U.S.A. National Laboratory Uncertainty
More informationJournal of Statistical Planning and Inference
Journal of Statistical Planning and Inference 42 (22) 763 772 Contents lists available at SciVerse ScienceDirect Journal of Statistical Planning and Inference journal homepage: www.elsevier.com/locate/jspi
More information