Challenges In Uncertainty, Calibration, Validation and Predictability of Engineering Analysis Models
|
|
- Eugenia Merritt
- 5 years ago
- Views:
Transcription
1 Challenges In Uncertainty, Calibration, Validation and Predictability of Engineering Analysis Models Dr. Liping Wang GE Global Research Manager, Probabilistics Lab Niskayuna, NY 2011 UQ Workshop University of Minnesota, MN June 02, 2011 Team Members GE Global Research: Arun Subramaniyan, Nataraj Chennimalai, Xingjie Fang, Giridhar Jothiprasad, Martha Gardner, Amit Kale GE Aviation: Don Beeson, Gene Wiggs, and John Nelson 1
2 Outline Motivation History of Development How far are we along the path? GE capabilities Technical Challenges & Solutions Future Direction Summary 2
3 ... Motivation Why Model Calibration, Validation, Prediction & Uncertainty Quantification? What has been accomplished? Literature Review GE Eperience Input Factors Xs Possible technical solutions and future direction X 1 X2 Uncertainty Quantification UQ Input Factors Xs Etc. X1 X2 Etc. Deterministic Simulation Model parameters Model discrepancy Output Factors Ys Etc. θ δ Output Factors Ys Y2 Etc. Uncertainty: Aleatory Random and usually modeled by probability distributions. Methods include probability theory and classical statistics Epistemic Lack of knowledge. Methods include fuzzy logic or evidence/possibility theory Y1 3
4 History of Development How far are we along the path? One task at a time calibration, validation, prediction & uncertainty quantification - since the 1980s Calibration - data matching, or inverse problems, or parameter estimation - applied to heat transfer, fluid mechanics, solid mechanics, etc. Verification & Validation V&V - introduced by DoD, AIAA, ASME, National Labs Prediction - well-established physics models, calibrated empirical models, and meta-models Response Surface, Kriging, Gaussian Process, Radial Basis Function, etc Uncertainty quantification - Monte Carlo, First Order Second Moment, moments based, polynomial chaos, etc All tasks simultaneously - first introduced by Kennedy and O Hagan in 2001 Bayesian framework 4
5 Kennedy & O Hagan 2001 What is Bayesian Statistics? f θ y f y θ f θ f θ y = f y θ f θ L θ = f y θ Given data Kennedy & O Hagan Hybrid Model Formulation: f θ pdf Prior Likelihood function y i = η i, θ δ i ε i, i=1,2,,n θ θ pdf Posterior θ Observations from the physical system Output of a simulator, with design inputs and calibration parameters θ Discrepancy between the simulator and the physical system Observation measurement system error Build & calibrate Gaussian Process GP models for both η and δ... Specify beliefs about θ, δ through prior probability distributions Use Markov Chain Monte Carlo MCMC to obtain parameter estimates Similar approaches by Higdon et al. and Liu et al. Most implementations are for single output 5
6 Multiple Outputs Implementation by Los Alamos National Lab LANL - Higdon, William et al. Principal Components Analysis PCA for dimension reduction & efficiency improvements Correlated outputs η, θ = k w1, θ... k, 1 p p θ δ = d1v1... d p v p 1, k2 k pη and d, 1 d2,..., d pδ are the principal components k,..., w & v are the GP models for simulator and model correction δ δ η w η More Applicable to Real Problems with LANL Implementation 6
7 Maimum Likelihood Estimation MLE Alternative approach to Bayesian Xiong, Chen, Tsui and Apley Investigated three possible formulations y, Θ = η, θ ε y, Θ = η, θ δ ε y, Θ = η, θ δ ε best Implementation only for single output Sensitivity analysis prior to MLE optimization to avoid numerical instability 7
8 Model Inadequacy Correction & Prediction No Calibration Capture model inadequacy with no model calibration Wang et al. and Chen et al. y = η δ ε Closed form Bayesian posterior Solve GP hyper-parameters using MLE Improved efficiency for high dimensional design space Useful for well established physical models where calibration is not necessary or performed previously 8
9 V&V and Model Validation Metrics Current and desired state of validation metrics Oberkampf et al Quantitative Metrics using classical hypothesis testing, Bayes factor, frequentist s metrics, and area metrics Quantitative Metrics using Kennedy & O Hagan Bayesian Framework Chen et al. Preliminary elements of model validation Paez, Swiler, Mayes, Miller, et al International Modal Analysis Conference, Orlando, FL Epistemic uncertainty Paez & Swiler, Paez Most Common Desired State Customers Stakeholders Analysis Modelers Validation Analysts Eperimentalists 9
10 GE Capabilities Deterministic Inverse modeling since 2003 Methods development and implementation Efficient transient data matching using PCA based hybrid metamodels & zoning techniques Partial probabilistic data matching to update standard deviations Widely used across GE businesses Transient Analysis and Performance Heat Transfer and Fluid Systems GE90 78Xs GP Xs GEn 29 Xs Materials Design Acceleration Material Modeling 23 Xs, 35 TCs simultaneously Others: Transient cycle models 3D transient clearances Undercowl heat transfer Empirical model tuning Analysis time savings >50% Data mismatch reduced by half 10
11 11 Probabilistic Inverse modeling Bayesian Hybrid Modeling since 2006 Built on Kennedy & O Hagan Bayesian Method and LANL Implementation Efficiency improvement ~2X, fleibility, robustness Investigated possible formulations Key drivers of model inadequacy & insight to possible model improvements Validated with multiple benchmark problems GE Capabilities ε θ η ε δ η δ η η = = = =, y y y y ε δ θ η ε δ θ η ε δ θ η ε δ θ η = = = =,,,,, y y y y Kennedy & O Hagan
12 GE Capabilities Demonstration with challenging engineering problems P T _ ra tio Test data : y Test data uncertainty: ε BRM model: η,θ Design parameters: Model parameters: θ Missing vertical parts of high speed lines θ calibrated Hybrid Modeling Mean= Std= Test HM Mean 90% CI Confidence Bounds Performance Maps at Speed = 105% Model Discrepancy & Updating 1.6 Test 1.58 Hybrid Modeling Calibrated Simulator only 1.56 δ Corrected flow Corrected flow PT_ratio 105% speed-line δ % 2 Speed Lines 3 Speed Lines 105% 1.75 Test 1.7 Calibrated Simulator only Hybrid Modeling % 105% Mean= Std= Test 1.45 Calibrated Simulator only 1.4 Hybrid Modeling % Matches Test Data Well for Single & Multiple Speed Lines 12
13 GE Capabilities Transient AIR Model Benchmark problem 6 calibration parameters 9 Outputs Ys 52 time points in each transient > 3000 DoE points Only 52 DoE simulation points used for Hybrid modeling Calibrated Model ηt, θ Calibrated & Discrepancy Adjusted Model yt= ηt, θ δt δt Discrepancy BHM calibrates transient model accurately with very little data 13 13
14 GE Capabilities Demonstration with challenging engineering problems IPE Status Match TOW Uncertainty Improved calibration results by capturing model discrepancy More confidence in solution with probabilistic estimation Cycle Deck Characterizing model discrepancy and uncertainty in severity models Main effects able to point high thrust severity for improvement of current models Calibrated calibrated Simulator simulator discrepancy-adjusted Discrepancy-Adjusted discrepancy Discrepancy ZT49 Ehaust Gas Temperature ZPCN12 Fan Speed Histogram Counts Posterior Distribution of HPT Efficiency θ DE42DD Demonstration with IPE Status Match, TOW Uncertainty Severity Modeling, Cycle Deck Performance 14
15 GE Capabilities Etension to Model Validation GE90 Fan Blade Row Model Xs θs Combustion Dynamics Acoustic fluctuations p δ ε Calibrated Simulator Model Discrepancy δ Flame heat release fluctuations q δ at tested points δ at untested points Freq1 θ calibrated Computation v. Eperiment δ Enabler for Probabilistic Validation Metrics at Tested & Untested Points 15
16 GE Capabilities Going-forward Continue improving MCMC speed issues for high dimensional >100Xs and solving challenging engineering data matching applications Model Validation for All Engineering Models 3-year program Fleible to all models based on data availability, affordable & accurate, account for all types of uncertainty, probabilistic quantitative metrics co m b ustor e it T T PT Vr Vth K ω X s 2011 Hot Gas Path Heat Transfer 2012 Combustion Dynamics 2013 All Engineering Models g eom etry tip cleara n ce, c ore shift, film hole drilling Xs θs Acoustic fluctuations p θsε δ ε Aero purge flow δ = y η ε Flame heat release fluctuations q δ = y η, θ ε Mechanical δ = y η, θ ε Complicated Physics, Unknown Uncertainty, High Dimension Challenges Remain! 16
17 Technical Challenges and Solutions Curse of dimensionality Large number of calibration parameters. MCMC speed issues. Transient data matching PCA/Sensitivity, sparse matri inversion, adaptive convergence criteria for MCMC, sequential MC or other optimization techniques Source of Uncertainty Epistemic & Aleatory uncertainty. Probability, statistics, fuzzy logic or evidence/possibility theory Model inadequacy, uncertainty and characterization Identifiability of parameter calibration and model inadequacy Use as much knowledge as you can on the prior. Carefully choose the range. Uncertainty quantification of eperiments. Better understand model inadequacy and key drivers Post-processing to model discrepancy terms. Bayesian model comparison for possible suggestion to model improvement 17
18 Technical Challenges and Solutions Lack of data and etrapolation Limited test & simulation data No overlap between simulation & test data etrapolation Scientific knowledge, designer s belief prior Confounding Effects High-dimensionality coupled with lack of data Challenging mathematical issues Scientific knowledge, designer s belief prior Model validation and quantitative metrics Account for all source of uncertainty epistemic & aleatory Fleible for all analysis models - empirical, physics no calibration & metamodels based on data availability complete, partial and etrapolation Affordable & accurate Confidence and probabilistic metrics 18
19 Technical Challenges and Solutions Multiple sets of eperimental data Mied datasets multiple speed lines, multiple engine data Multiple modes of posterior distributions Numerical and speed issues Measurement error and uncertainty Uncertainty quantification for both epistemic and aleatory uncertainty Statistical analysis Outlier detection sensor failure Multi-physics & multi-fidelity models Direct simulations are prohibitively epensive Vast scale difference among the lowest atomic to the highest macroscopic scale Difficult to establish criteria & strategies when switching design space from one scale to another 19
20 Summary Advancements in model calibration, validation, prediction and uncertainty quantification in the past three decades Much research and many publications from industry, government, academia GE has been very active Technical challenges remain and are being worked 20
Validating Expensive Simulations with Expensive Experiments: A Bayesian Approach
Validating Expensive Simulations with Expensive Experiments: A Bayesian Approach Dr. Arun Subramaniyan GE Global Research Center Niskayuna, NY 2012 ASME V& V Symposium Team: GE GRC: Liping Wang, Natarajan
More informationBayesian Regression Linear and Logistic Regression
When we want more than point estimates Bayesian Regression Linear and Logistic Regression Nicole Beckage Ordinary Least Squares Regression and Lasso Regression return only point estimates But what if we
More informationUncertainty Management and Quantification in Industrial Analysis and Design
Uncertainty Management and Quantification in Industrial Analysis and Design www.numeca.com Charles Hirsch Professor, em. Vrije Universiteit Brussel President, NUMECA International The Role of Uncertainties
More informationThe Role of Uncertainty Quantification in Model Verification and Validation. Part 6 NESSUS Exercise Review and Model Calibration
The Role of Uncertainty Quantification in Model Verification and Validation Part 6 NESSUS Exercise Review and Model Calibration 1 Supersolvus Problem Statement 2 Probabilistic Analysis Definition 3 CDF
More informationSURROGATE PREPOSTERIOR ANALYSES FOR PREDICTING AND ENHANCING IDENTIFIABILITY IN MODEL CALIBRATION
International Journal for Uncertainty Quantification, ():xxx xxx, 0 SURROGATE PREPOSTERIOR ANALYSES FOR PREDICTING AND ENHANCING IDENTIFIABILITY IN MODEL CALIBRATION Zhen Jiang, Daniel W. Apley, & Wei
More informationCROSS-SCALE, CROSS-DOMAIN MODEL VALIDATION BASED ON GENERALIZED HIDDEN MARKOV MODEL AND GENERALIZED INTERVAL BAYES RULE
CROSS-SCALE, CROSS-DOMAIN MODEL VALIDATION BASED ON GENERALIZED HIDDEN MARKOV MODEL AND GENERALIZED INTERVAL BAYES RULE Yan Wang 1, David L. McDowell 1, Aaron E. Tallman 1 1 Georgia Institute of Technology
More informationConcepts and Practice of Verification, Validation, and Uncertainty Quantification
Concepts and Practice of Verification, Validation, and Uncertainty Quantification William L. Oberkampf Sandia National Laboratories (retired) Consulting Engineer wloconsulting@gmail.com Austin, Texas Exploratory
More informationAn introduction to Bayesian statistics and model calibration and a host of related topics
An introduction to Bayesian statistics and model calibration and a host of related topics Derek Bingham Statistics and Actuarial Science Simon Fraser University Cast of thousands have participated in the
More informationSuggestions for Making Useful the Uncertainty Quantification Results from CFD Applications
Suggestions for Making Useful the Uncertainty Quantification Results from CFD Applications Thomas A. Zang tzandmands@wildblue.net Aug. 8, 2012 CFD Futures Conference: Zang 1 Context The focus of this presentation
More informationOverview. Bayesian assimilation of experimental data into simulation (for Goland wing flutter) Why not uncertainty quantification?
Delft University of Technology Overview Bayesian assimilation of experimental data into simulation (for Goland wing flutter), Simao Marques 1. Why not uncertainty quantification? 2. Why uncertainty quantification?
More informationEstimating functional uncertainty using polynomial chaos and adjoint equations
0. Estimating functional uncertainty using polynomial chaos and adjoint equations February 24, 2011 1 Florida State University, Tallahassee, Florida, Usa 2 Moscow Institute of Physics and Technology, Moscow,
More informationEfficiency and Reliability of Bayesian Calibration of Energy Supply System Models
Efficiency and Reliability of Bayesian Calibration of Energy Supply System Models Kathrin Menberg 1,2, Yeonsook Heo 2, Ruchi Choudhary 1 1 University of Cambridge, Department of Engineering, Cambridge,
More informationBayesian analysis in nuclear physics
Bayesian analysis in nuclear physics Ken Hanson T-16, Nuclear Physics; Theoretical Division Los Alamos National Laboratory Tutorials presented at LANSCE Los Alamos Neutron Scattering Center July 25 August
More informationSequential Importance Sampling for Rare Event Estimation with Computer Experiments
Sequential Importance Sampling for Rare Event Estimation with Computer Experiments Brian Williams and Rick Picard LA-UR-12-22467 Statistical Sciences Group, Los Alamos National Laboratory Abstract Importance
More informationComputer Model Calibration: Bayesian Methods for Combining Simulations and Experiments for Inference and Prediction
Computer Model Calibration: Bayesian Methods for Combining Simulations and Experiments for Inference and Prediction Example The Lyon-Fedder-Mobary (LFM) model simulates the interaction of solar wind plasma
More informationStatistical Methods in Particle Physics Lecture 1: Bayesian methods
Statistical Methods in Particle Physics Lecture 1: Bayesian methods SUSSP65 St Andrews 16 29 August 2009 Glen Cowan Physics Department Royal Holloway, University of London g.cowan@rhul.ac.uk www.pp.rhul.ac.uk/~cowan
More informationState Space and Hidden Markov Models
State Space and Hidden Markov Models Kunsch H.R. State Space and Hidden Markov Models. ETH- Zurich Zurich; Aliaksandr Hubin Oslo 2014 Contents 1. Introduction 2. Markov Chains 3. Hidden Markov and State
More informationReview. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Review DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing with
More informationLecture 5. G. Cowan Lectures on Statistical Data Analysis Lecture 5 page 1
Lecture 5 1 Probability (90 min.) Definition, Bayes theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests (90 min.) general concepts, test statistics,
More informationEstimation of reliability parameters from Experimental data (Parte 2) Prof. Enrico Zio
Estimation of reliability parameters from Experimental data (Parte 2) This lecture Life test (t 1,t 2,...,t n ) Estimate θ of f T t θ For example: λ of f T (t)= λe - λt Classical approach (frequentist
More informationRisk Estimation and Uncertainty Quantification by Markov Chain Monte Carlo Methods
Risk Estimation and Uncertainty Quantification by Markov Chain Monte Carlo Methods Konstantin Zuev Institute for Risk and Uncertainty University of Liverpool http://www.liv.ac.uk/risk-and-uncertainty/staff/k-zuev/
More informationUncertainty Quantification in Viscous Hypersonic Flows using Gradient Information and Surrogate Modeling
Uncertainty Quantification in Viscous Hypersonic Flows using Gradient Information and Surrogate Modeling Brian A. Lockwood, Markus P. Rumpfkeil, Wataru Yamazaki and Dimitri J. Mavriplis Mechanical Engineering
More informationUncertainty Quantification and Validation Using RAVEN. A. Alfonsi, C. Rabiti. Risk-Informed Safety Margin Characterization. https://lwrs.inl.
Risk-Informed Safety Margin Characterization Uncertainty Quantification and Validation Using RAVEN https://lwrs.inl.gov A. Alfonsi, C. Rabiti North Carolina State University, Raleigh 06/28/2017 Assumptions
More informationUncertainty Quantification in Performance Evaluation of Manufacturing Processes
Uncertainty Quantification in Performance Evaluation of Manufacturing Processes Manufacturing Systems October 27, 2014 Saideep Nannapaneni, Sankaran Mahadevan Vanderbilt University, Nashville, TN Acknowledgement
More informationBayesian Inference. Chapter 1. Introduction and basic concepts
Bayesian Inference Chapter 1. Introduction and basic concepts M. Concepción Ausín Department of Statistics Universidad Carlos III de Madrid Master in Business Administration and Quantitative Methods Master
More informationMulti-fidelity sensitivity analysis
Multi-fidelity sensitivity analysis Loic Le Gratiet 1,2, Claire Cannamela 2 & Bertrand Iooss 3 1 Université Denis-Diderot, Paris, France 2 CEA, DAM, DIF, F-91297 Arpajon, France 3 EDF R&D, 6 quai Watier,
More informationAt A Glance. UQ16 Mobile App.
At A Glance UQ16 Mobile App Scan the QR code with any QR reader and download the TripBuilder EventMobile app to your iphone, ipad, itouch or Android mobile device. To access the app or the HTML 5 version,
More informationWhen using physical experimental data to adjust, or calibrate, computer simulation models, two general
A Preposterior Analysis to Predict Identifiability in Experimental Calibration of Computer Models Paul D. Arendt Northwestern University, Department of Mechanical Engineering 2145 Sheridan Road Room B214
More informationDynamic Data Modeling, Recognition, and Synthesis. Rui Zhao Thesis Defense Advisor: Professor Qiang Ji
Dynamic Data Modeling, Recognition, and Synthesis Rui Zhao Thesis Defense Advisor: Professor Qiang Ji Contents Introduction Related Work Dynamic Data Modeling & Analysis Temporal localization Insufficient
More informationA Probabilistic Framework for solving Inverse Problems. Lambros S. Katafygiotis, Ph.D.
A Probabilistic Framework for solving Inverse Problems Lambros S. Katafygiotis, Ph.D. OUTLINE Introduction to basic concepts of Bayesian Statistics Inverse Problems in Civil Engineering Probabilistic Model
More informationBayesian Methods for Machine Learning
Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),
More informationBayesian Calibration of Simulators with Structured Discretization Uncertainty
Bayesian Calibration of Simulators with Structured Discretization Uncertainty Oksana A. Chkrebtii Department of Statistics, The Ohio State University Joint work with Matthew T. Pratola (Statistics, The
More informationBayesian Estimation of Input Output Tables for Russia
Bayesian Estimation of Input Output Tables for Russia Oleg Lugovoy (EDF, RANE) Andrey Polbin (RANE) Vladimir Potashnikov (RANE) WIOD Conference April 24, 2012 Groningen Outline Motivation Objectives Bayesian
More informationPrinciples of Bayesian Inference
Principles of Bayesian Inference Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department
More informationSTA 4273H: Sta-s-cal Machine Learning
STA 4273H: Sta-s-cal Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 2 In our
More informationarxiv: v1 [stat.co] 23 Apr 2018
Bayesian Updating and Uncertainty Quantification using Sequential Tempered MCMC with the Rank-One Modified Metropolis Algorithm Thomas A. Catanach and James L. Beck arxiv:1804.08738v1 [stat.co] 23 Apr
More informationQuantile POD for Hit-Miss Data
Quantile POD for Hit-Miss Data Yew-Meng Koh a and William Q. Meeker a a Center for Nondestructive Evaluation, Department of Statistics, Iowa State niversity, Ames, Iowa 50010 Abstract. Probability of detection
More informationParameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn
Parameter estimation and forecasting Cristiano Porciani AIfA, Uni-Bonn Questions? C. Porciani Estimation & forecasting 2 Temperature fluctuations Variance at multipole l (angle ~180o/l) C. Porciani Estimation
More informationPolynomial chaos expansions for structural reliability analysis
DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for structural reliability analysis B. Sudret & S. Marelli Incl.
More informationNon-Parametric Bayes
Non-Parametric Bayes Mark Schmidt UBC Machine Learning Reading Group January 2016 Current Hot Topics in Machine Learning Bayesian learning includes: Gaussian processes. Approximate inference. Bayesian
More informationPART I INTRODUCTION The meaning of probability Basic definitions for frequentist statistics and Bayesian inference Bayesian inference Combinatorics
Table of Preface page xi PART I INTRODUCTION 1 1 The meaning of probability 3 1.1 Classical definition of probability 3 1.2 Statistical definition of probability 9 1.3 Bayesian understanding of probability
More informationMachine Learning using Bayesian Approaches
Machine Learning using Bayesian Approaches Sargur N. Srihari University at Buffalo, State University of New York 1 Outline 1. Progress in ML and PR 2. Fully Bayesian Approach 1. Probability theory Bayes
More informationDinesh Kumar, Mehrdad Raisee and Chris Lacor
Dinesh Kumar, Mehrdad Raisee and Chris Lacor Fluid Mechanics and Thermodynamics Research Group Vrije Universiteit Brussel, BELGIUM dkumar@vub.ac.be; m_raisee@yahoo.com; chris.lacor@vub.ac.be October, 2014
More informationReducing uncertainties in a wind-tunnel experiment using Bayesian updating
Reducing uncertainties in a wind-tunnel experiment using Bayesian updating D.J. Boon, R.P. Dwight, J.J.H.M. Sterenborg, and H. Bijl Aerodynamics Group, Delft University of Technology, The Netherlands We
More informationBayesian Dynamic Linear Modelling for. Complex Computer Models
Bayesian Dynamic Linear Modelling for Complex Computer Models Fei Liu, Liang Zhang, Mike West Abstract Computer models may have functional outputs. With no loss of generality, we assume that a single computer
More informationPrinciples of Bayesian Inference
Principles of Bayesian Inference Sudipto Banerjee University of Minnesota July 20th, 2008 1 Bayesian Principles Classical statistics: model parameters are fixed and unknown. A Bayesian thinks of parameters
More informationRobotics. Lecture 4: Probabilistic Robotics. See course website for up to date information.
Robotics Lecture 4: Probabilistic Robotics See course website http://www.doc.ic.ac.uk/~ajd/robotics/ for up to date information. Andrew Davison Department of Computing Imperial College London Review: Sensors
More informationFast Likelihood-Free Inference via Bayesian Optimization
Fast Likelihood-Free Inference via Bayesian Optimization Michael Gutmann https://sites.google.com/site/michaelgutmann University of Helsinki Aalto University Helsinki Institute for Information Technology
More informationThe Role of Uncertainty Quantification in Model Verification and Validation. Part 2 Model Verification and Validation Plan and Process
The Role of Uncertainty Quantification in Model Verification and Validation Part 2 Model Verification and Validation Plan and Process 1 Case Study: Ni Superalloy Yield Strength Model 2 3 What is to be
More informationGaussian processes for uncertainty quantification in computer experiments
Gaussian processes for uncertainty quantification in computer experiments Richard Wilkinson University of Nottingham Gaussian process summer school, Sheffield 2013 Richard Wilkinson (Nottingham) GPs for
More informationBayesian Inference and MCMC
Bayesian Inference and MCMC Aryan Arbabi Partly based on MCMC slides from CSC412 Fall 2018 1 / 18 Bayesian Inference - Motivation Consider we have a data set D = {x 1,..., x n }. E.g each x i can be the
More informationBayesian System Identification based on Hierarchical Sparse Bayesian Learning and Gibbs Sampling with Application to Structural Damage Assessment
Bayesian System Identification based on Hierarchical Sparse Bayesian Learning and Gibbs Sampling with Application to Structural Damage Assessment Yong Huang a,b, James L. Beck b,* and Hui Li a a Key Lab
More informationECE295, Data Assimila0on and Inverse Problems, Spring 2015
ECE295, Data Assimila0on and Inverse Problems, Spring 2015 1 April, Intro; Linear discrete Inverse problems (Aster Ch 1 and 2) Slides 8 April, SVD (Aster ch 2 and 3) Slides 15 April, RegularizaFon (ch
More informationSupplementary Note on Bayesian analysis
Supplementary Note on Bayesian analysis Structured variability of muscle activations supports the minimal intervention principle of motor control Francisco J. Valero-Cuevas 1,2,3, Madhusudhan Venkadesan
More information2D Image Processing (Extended) Kalman and particle filter
2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz
More informationA Comparison of Particle Filters for Personal Positioning
VI Hotine-Marussi Symposium of Theoretical and Computational Geodesy May 9-June 6. A Comparison of Particle Filters for Personal Positioning D. Petrovich and R. Piché Institute of Mathematics Tampere University
More informationUncertainty quantification and calibration of computer models. February 5th, 2014
Uncertainty quantification and calibration of computer models February 5th, 2014 Physical model Physical model is defined by a set of differential equations. Now, they are usually described by computer
More informationStatistics: Learning models from data
DS-GA 1002 Lecture notes 5 October 19, 2015 Statistics: Learning models from data Learning models from data that are assumed to be generated probabilistically from a certain unknown distribution is a crucial
More informationLecture 5: Bayes pt. 1
Lecture 5: Bayes pt. 1 D. Jason Koskinen koskinen@nbi.ku.dk Photo by Howard Jackman University of Copenhagen Advanced Methods in Applied Statistics Feb - Apr 2016 Niels Bohr Institute 2 Bayes Probabilities
More informationIJMGE Int. J. Min. & Geo-Eng. Vol.49, No.1, June 2015, pp
IJMGE Int. J. Min. & Geo-Eng. Vol.49, No.1, June 2015, pp.131-142 Joint Bayesian Stochastic Inversion of Well Logs and Seismic Data for Volumetric Uncertainty Analysis Moslem Moradi 1, Omid Asghari 1,
More informationPrinciples of Bayesian Inference
Principles of Bayesian Inference Sudipto Banerjee and Andrew O. Finley 2 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department
More information1 Bayesian Linear Regression (BLR)
Statistical Techniques in Robotics (STR, S15) Lecture#10 (Wednesday, February 11) Lecturer: Byron Boots Gaussian Properties, Bayesian Linear Regression 1 Bayesian Linear Regression (BLR) In linear regression,
More informationParameter Estimation Method Using Bayesian Statistics Considering Uncertainty of Information for RBDO
th World Congress on Structural and Multidisciplinary Optimization 7 th - 2 th, June 205, Sydney Australia Parameter Estimation Method Using Bayesian Statistics Considering Uncertainty of Information for
More informationData Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University
Data Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Why uncertainty? Why should data mining care about uncertainty? We
More informationBayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems
Bayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems John Bardsley, University of Montana Collaborators: H. Haario, J. Kaipio, M. Laine, Y. Marzouk, A. Seppänen, A. Solonen, Z.
More informationROBOTICS 01PEEQW. Basilio Bona DAUIN Politecnico di Torino
ROBOTICS 01PEEQW Basilio Bona DAUIN Politecnico di Torino Probabilistic Fundamentals in Robotics Gaussian Filters Course Outline Basic mathematical framework Probabilistic models of mobile robots Mobile
More informationNonlinear Model Reduction for Uncertainty Quantification in Large-Scale Inverse Problems
Nonlinear Model Reduction for Uncertainty Quantification in Large-Scale Inverse Problems Krzysztof Fidkowski, David Galbally*, Karen Willcox* (*MIT) Computational Aerospace Sciences Seminar Aerospace Engineering
More informationSTAT 499/962 Topics in Statistics Bayesian Inference and Decision Theory Jan 2018, Handout 01
STAT 499/962 Topics in Statistics Bayesian Inference and Decision Theory Jan 2018, Handout 01 Nasser Sadeghkhani a.sadeghkhani@queensu.ca There are two main schools to statistical inference: 1-frequentist
More informationPart 1: Expectation Propagation
Chalmers Machine Learning Summer School Approximate message passing and biomedicine Part 1: Expectation Propagation Tom Heskes Machine Learning Group, Institute for Computing and Information Sciences Radboud
More informationIntroduction to Machine Learning
Introduction to Machine Learning Linear Regression Varun Chandola Computer Science & Engineering State University of New York at Buffalo Buffalo, NY, USA chandola@buffalo.edu Chandola@UB CSE 474/574 1
More informationUncertainty Aggregation Variability, Statistical Uncertainty, and Model Uncertainty
Uncertainty Aggregation Variability, Statistical Uncertainty, and Model Uncertainty Sankaran Mahadevan Vanderbilt University, Nashville, TN, USA ETICS 2018 Roscoff, France; June 4, 2018 Sankaran Mahadevan
More informationAssessment of uncertainty in computer experiments: from Universal Kriging to Bayesian Kriging. Céline Helbert, Delphine Dupuy and Laurent Carraro
Assessment of uncertainty in computer experiments: from Universal Kriging to Bayesian Kriging., Delphine Dupuy and Laurent Carraro Historical context First introduced in the field of geostatistics (Matheron,
More informationMarkov chain Monte Carlo methods for visual tracking
Markov chain Monte Carlo methods for visual tracking Ray Luo rluo@cory.eecs.berkeley.edu Department of Electrical Engineering and Computer Sciences University of California, Berkeley Berkeley, CA 94720
More informationData Analysis and Uncertainty Part 2: Estimation
Data Analysis and Uncertainty Part 2: Estimation Instructor: Sargur N. University at Buffalo The State University of New York srihari@cedar.buffalo.edu 1 Topics in Estimation 1. Estimation 2. Desirable
More informationGaussian Processes for Computer Experiments
Gaussian Processes for Computer Experiments Jeremy Oakley School of Mathematics and Statistics, University of Sheffield www.jeremy-oakley.staff.shef.ac.uk 1 / 43 Computer models Computer model represented
More informationParametric Models. Dr. Shuang LIANG. School of Software Engineering TongJi University Fall, 2012
Parametric Models Dr. Shuang LIANG School of Software Engineering TongJi University Fall, 2012 Today s Topics Maximum Likelihood Estimation Bayesian Density Estimation Today s Topics Maximum Likelihood
More informationBayesian Inverse Problems
Bayesian Inverse Problems Jonas Latz Input/Output: www.latz.io Technical University of Munich Department of Mathematics, Chair for Numerical Analysis Email: jonas.latz@tum.de Garching, July 10 2018 Guest
More informationBayesian Social Learning with Random Decision Making in Sequential Systems
Bayesian Social Learning with Random Decision Making in Sequential Systems Yunlong Wang supervised by Petar M. Djurić Department of Electrical and Computer Engineering Stony Brook University Stony Brook,
More informationError analysis for efficiency
Glen Cowan RHUL Physics 28 July, 2008 Error analysis for efficiency To estimate a selection efficiency using Monte Carlo one typically takes the number of events selected m divided by the number generated
More informationMODEL VALIDATION AND DESIGN UNDER UNCERTAINTY. Ramesh Rebba. Dissertation DOCTOR OF PHILOSOPHY
MODEL VALIDATION AND DESIGN UNDER UNCERTAINTY By Ramesh Rebba Dissertation Submitted to the Faculty of the Graduate School of Vanderbilt University in partial fulfillment of the requirements for the degree
More informationConsistent Downscaling of Seismic Inversions to Cornerpoint Flow Models SPE
Consistent Downscaling of Seismic Inversions to Cornerpoint Flow Models SPE 103268 Subhash Kalla LSU Christopher D. White LSU James S. Gunning CSIRO Michael E. Glinsky BHP-Billiton Contents Method overview
More informationHigh-dimensional Problems in Finance and Economics. Thomas M. Mertens
High-dimensional Problems in Finance and Economics Thomas M. Mertens NYU Stern Risk Economics Lab April 17, 2012 1 / 78 Motivation Many problems in finance and economics are high dimensional. Dynamic Optimization:
More informationDevelopment of Stochastic Artificial Neural Networks for Hydrological Prediction
Development of Stochastic Artificial Neural Networks for Hydrological Prediction G. B. Kingston, M. F. Lambert and H. R. Maier Centre for Applied Modelling in Water Engineering, School of Civil and Environmental
More informationPILCO: A Model-Based and Data-Efficient Approach to Policy Search
PILCO: A Model-Based and Data-Efficient Approach to Policy Search (M.P. Deisenroth and C.E. Rasmussen) CSC2541 November 4, 2016 PILCO Graphical Model PILCO Probabilistic Inference for Learning COntrol
More informationStochastic Collocation Methods for Polynomial Chaos: Analysis and Applications
Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535
More informationCALIFORNIA INSTITUTE OF TECHNOLOGY
CALIFORNIA INSTITUTE OF TECHNOLOGY EARTHQUAKE ENGINEERING RESEARCH LABORATORY NEW BAYESIAN UPDATING METHODOLOGY FOR MODEL VALIDATION AND ROBUST PREDICTIONS BASED ON DATA FROM HIERARCHICAL SUBSYSTEM TESTS
More informationSensitivity Analysis of a Nuclear Reactor System Finite Element Model
Westinghouse Non-Proprietary Class 3 Sensitivity Analysis of a Nuclear Reactor System Finite Element Model 2018 ASME Verification & Validation Symposium VVS2018-9306 Gregory A. Banyay, P.E. Stephen D.
More informationAppendix U. Evaluation of stochastic & statistic methods for spacecraft thermal analysis. Jean-Paul Dudon (Thales Alenia Space, France)
319 Appendix U Evaluation of stochastic & statistic methods for spacecraft thermal analysis Jean-Paul Dudon (Thales Alenia Space, France) Hélène-Marie Pasquier (CNES, France) 320 Evaluation of stochastic
More informationA novel determination of the local dark matter density. Riccardo Catena. Institut für Theoretische Physik, Heidelberg
A novel determination of the local dark matter density Riccardo Catena Institut für Theoretische Physik, Heidelberg 28.04.2010 R. Catena and P. Ullio, arxiv:0907.0018 [astro-ph.co]. Riccardo Catena (ITP)
More informationConfidence Distribution
Confidence Distribution Xie and Singh (2013): Confidence distribution, the frequentist distribution estimator of a parameter: A Review Céline Cunen, 15/09/2014 Outline of Article Introduction The concept
More informationIntroduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak
Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak 1 Introduction. Random variables During the course we are interested in reasoning about considered phenomenon. In other words,
More informationClimate Change: the Uncertainty of Certainty
Climate Change: the Uncertainty of Certainty Reinhard Furrer, UZH JSS, Geneva Oct. 30, 2009 Collaboration with: Stephan Sain - NCAR Reto Knutti - ETHZ Claudia Tebaldi - Climate Central Ryan Ford, Doug
More informationPart IV: Monte Carlo and nonparametric Bayes
Part IV: Monte Carlo and nonparametric Bayes Outline Monte Carlo methods Nonparametric Bayesian models Outline Monte Carlo methods Nonparametric Bayesian models The Monte Carlo principle The expectation
More informationLecture : Probabilistic Machine Learning
Lecture : Probabilistic Machine Learning Riashat Islam Reasoning and Learning Lab McGill University September 11, 2018 ML : Many Methods with Many Links Modelling Views of Machine Learning Machine Learning
More informationBayesian Semi-supervised Learning with Deep Generative Models
Bayesian Semi-supervised Learning with Deep Generative Models Jonathan Gordon Department of Engineering Cambridge University jg801@cam.ac.uk José Miguel Hernández-Lobato Department of Engineering Cambridge
More informationA Bayesian Approach to Phylogenetics
A Bayesian Approach to Phylogenetics Niklas Wahlberg Based largely on slides by Paul Lewis (www.eeb.uconn.edu) An Introduction to Bayesian Phylogenetics Bayesian inference in general Markov chain Monte
More informationInverse Uncertainty Quantification using the Modular Bayesian Approach based on Gaussian Process, Part 2: Application to TRACE
Inverse Uncertainty Quantification using the Modular Bayesian Approach based on Gaussian Process, Part 2: Application to TRACE Xu Wu a,*, Tomasz Kozlowski a, Hadi Meidani b and Koroush Shirvan c a Department
More informationIntroduction to Gaussian Processes
Introduction to Gaussian Processes 1 Objectives to express prior knowledge/beliefs about model outputs using Gaussian process (GP) to sample functions from the probability measure defined by GP to build
More informationAn example to illustrate frequentist and Bayesian approches
Frequentist_Bayesian_Eample An eample to illustrate frequentist and Bayesian approches This is a trivial eample that illustrates the fundamentally different points of view of the frequentist and Bayesian
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing
More information