Source Term Estimation for Hazardous Releases

Size: px
Start display at page:

Download "Source Term Estimation for Hazardous Releases"

Transcription

1 Source Term Estimation for Hazardous Releases Fukushima Workshop NCAR, 22 nd 23 rd February 2012 Dstl/DOC61790 Dr. Gareth Brown

2 Presentation Outline Dstl s approach to Source Term Estimation Recent developments Spatially and temporally gridded urban met object Processing of deposition measurements Toy example Application to Fukushima

3 Source Term Estimation Monte Carlo Bayesian Data Fusion (MCBDF) MCBDF provides a set of likely source terms for calculating probabilistic hazards Accounts for uncertainty in source, meteorology, sensor performance & human reporting P. Robins, V. Rapley, N. Green, Realtime Sequential Inference of Static Ministry Parameters of Defence with Expensive Likelihood Calculations (2009)

4 Bayes Theorem p( θ y) p( yθ) p( θ) Posterior probability density of hypothesis θ given the data y Likelihood probability density of the data y conditional on the hypotheses θ Prior probability density of θ based on prior knowledge Iterative update of belief in a hypothesis Likelihood calculation particularly costly Necessary to run dispersion model for sensor data Sensor likelihood function complex

5 MCBDF: Bayesian data fusion MCBDF uses Bayesian inference over a sample set of hypothesized source-terms and Met. variables θ 1 = * x * y L 0 Source term Met ( xytmdau,,,,,,, u,,ln z, DP, ) ( ) Model The dimensionality of problem depends on its complexity Complex source terms Gridded meteorology in time and space Urban dispersion

6 Physics Modelling Dispersion is a turbulent process θ ( x, t, t ) 1 Impossible to model accurately Use ensemble puff dispersion models SPRINT model optimised for STE Implements SCIPUFF closure relations 2 2 ccc, dispersion 2 p χχχ, 2 χd χd, χ d

7 MCBDF: Example Prior

8 Sensor Likelihood Calculations When CB sensor measurements are passed to MCBDF the likelihood is calculated as ( 2) ( ) ( 2 µσ µσ ) py, = pyc pc, dc y Sensor measurement 0 measurement concentration density density µ Mean mass-concentration from dispersion simulation 2 σ Mass concentration variance from dispersion simulation c Unobserved ground-truth concentration

9 MCBDF: Upon Receipt of a Detection

10 Estimating the Posterior Distribution ( θ y) ( θ) ( θ) p p y p i Calculated as the product of the individual likelihoods and the prior Posterior estimated by sampling lots of hypotheses MCBDF uses Differential Evolution Markov Chain (DEMC) Monte Carlo to generate new hypotheses i

11 Calculating Hazard Areas The Hazard Calculator obtains the probability of exceeding a specified threshold dosage A weighted sum of these gridded probabilities is used to define the probable hazard area Release location Sensor network Red: ground truth; green: predicted

12

13 Recent Developments MCBDF initially developed for rapid warning of chemical attacks based on input from sensor networks Short effective duration approximates to spatially and temporally invariant meteorology However STE for Bio and Rad releases in major cities requires Fast dispersion models accounting for urban areas Much longer temporal windows Efficient methods to compute long duration dosage / deposition Spatially varying meteorology for large scale dispersion

14 Meteorological Inference Urban capability Gridded urban meteorological model defined Wind flow components gridded in 2D space and time Surface properties gridded in 2D space Atmospheric stability gridded in time extra dimensions in parameter space MCMC techniques still efficient if converged Much more difficult to achieve convergence f Sykes et al, SCIPUFF Tech Doc ( zh,, α ) = exp α 1 c c c c Canopy height z h c Canopy flow parameter

15 Toy Problem Example Single, short duration release Single isotope Quantitative deposition measurements Spatially gridded, but temporally invariant meteorology No transport due to rain run-off before measurements taken

16 Deposition data Likelihood model for quantitative measurement of deposited material Assume local detection only, alpha, beta, not longrange gamma Uncertainty per measurement, not fixed Time taken to collect Poisson count statistics Energy spectrum uncertainty on which isotope is being measured Naturally occurring background (with uncertainty) subtracted Simple, normally distributed measurement error model Lower limit and saturation can be input

17 Sample Points 88 points 20km exclusion zone shown Release point known No met data

18 Hazard Plot First measurement above background Close to source Huge met uncertainty

19 Hazard Plot First 3 rings of data Less uncertainty close to source

20 Hazard Plot 4 rings of data

21 Hazard Plot 6 rings of data

22 Hazard Plot All data More time for convergence

23 Problems to solve for Fukushima Parameters to infer: Mass released in each hour over the last year Gridded meteorology for each hour over the last year 10km spatial resolution Modelling: Gamma sensors pick up spatially averaged dose Function of range needs integrating 1/r 2, attenuation through air, scatter build up factors Longer range second order closure dispersion model needed SCIPUFF Other? Further transport of deposited material due to water run-off

24 Backup

25 The Concentration Sensor Likelihood Model Critical to the performance of MCBDF is an accurate probabilistic description of the detector s response 2 σ e L L ( 2, σ ) e Φ Lc y= L ( ) ( 2 p yc = φ yc, σ ) e L< y< L ( 2 1 Φ Lc, σ ) = e y L Measurement error variance Sensor saturation point Sensor limit of detection normal distribution CDF

26 Deposition modelling Improved physics improves consistency of sensor data likelihood modelling More accurate source term estimation in presence of deposition Amount of deposition inferred from data and/or uncertainty correctly passed to hazard calculations 17 February 2012

27 Deposition data Likelihood model for detection of deposited material already in place Biological hazards Similar to a probit model Extended to include: Probability of false alarm Probability of false negative Integrate out unobserved true amount of deposited material 17 February 2012

28 Prelim. deposition results (simulated met. constant) Collectors + Identifiers (dosage) + Survey ID (deposition) 20km 10km 10km 5km 1 detection, 8 nulls 17 February 2012

29 Burn In and Convergence Initial hypotheses may be far from the peak of the posterior But rapid answers are required Data continually changing the posterior limited time for new sample weights to make the old ones insignificant Limited time for samples to spread out and capture true uncertainty Detection of non-convergence delays message processing Re-weight Re-sample 17 February 2012

30 Hazard Calculation Probit slope model S used to indicate uncertainty in appropriate value for χ d 50 1 S 1 log 2 2 ( χd ) = + erf 10 p Hazard χd χ d 50 (, 2 ) (, 2 ) ( ) p Hazard χ χ = p χ χ χ p Hazard χ dχ d d d d d d d 0 Average over 1000 release/met samples from posterior. 17 February 2012

31 Deposition data likelihood (clipped normal) 2 ( χd, σe ) 2 (, ) 2 ( χd σe ) Φ L y = L p( y χd) = φ y χd σe L< y< L 1 Φ L, y = L 2 2 ( χ, ) unclipped (, d χ d µ N σn) ( L χd, σ ) e ( 0 µ N, σn) δ ( χd) φ( χ d µ N, σ ) Φ Φ + N dχd y = L p( y µ N, σn) = φ( y χd, σ e ) ( 0 µ N, σn) δ ( χd) φ( χ d µ N, σn) Φ + dχd L< y< L ( 1 ( L χd, σ e )) ( 0 µ N, σn) δ ( χd) φ( χ d µ N, σn) Φ Φ + dχd y = L 0 L Φ( L 0, σ e ) Φ ( 0 µ N, σ N) + k( y) 1 ( 0 µ ( y), σ ( y) ) Φ dy y = L p( y µ N, σn) = φ( y 0, σ e ) Φ ( 0 µ N, σ N) + k( y) 1 Φ ( 0 µ ( y), σ ( y) ) L< y< L Φ( L 0, σ e ) Φ ( 0 µ N, σ N) + k( y) 1 Φ ( 0 µ ( y), σ ( y) ) dy y = L L 2 2 ( x, ) ( x, ) φ µσ φ µ σ σ σσ = 2 2 σ1 + σ2 2 µ 1 µ 2 µ σ = + σ σ 2 k ( x, 2 ) ( x, 2 ) k ( x, 2 ) φ µ σ φ µ σ φ µ σ σ = σσ e π µ 1 µ 2 µ σ1 σ2 σ Romberg (closed and semi-infinite) numerical integration 17 February 2012

32 Deposition data likelihood (clipped gamma) 2 ( χd, σe ) 2 (, ) 2 ( χd σe ) Φ L y = L p( y χd) = φ y χd σe L< y< L 1 Φ L, y = L 2 * ( χ, ) (,, d χ d sk λ) Romberg (closed and semi-infinite) numerical integration χd + λ * k 1 exp 2 χd λ s + Φ ( L χd, σ ) e + (1 γδχ ) ( ) * d dχd y = L s s ( k ) 0 Γ χd λ + * k 1 exp 2 2 χd λ s + p( y µ N, σn) = φ( y χd, σ e ) (1 γδχ ) ( ) + * d dχd L< y< L s s ( k ) 0 Γ χd + λ * k 1 exp 2 χd + λ s ( 1 Φ( L χd, σe )) + (1 γδχ ) ( ) * d dχd y = L s 0 sγ( k ) χd + λ * k 1 exp 2 2 χd λ s + Φ( L 0, σe )( 1 γ) + Φ( L χd 0, σ ) e dc y = L * ( ) 0 s sγ k χd λ + * k 1 exp χd λ s + p ( y µ N, σn) = φ( y 0, σe )( 1 γ) φ( y χd, σ + e ) dc L < y < L * s s ( k ) 0 Γ χd + λ k 2 2 ( 1 Φ( L 0, σe ))( 1 γ) + ( 1 Φ( L χd 0, σe )) * 1 exp χd λ s + dc x = L * s sγ( k ) 0 17 February 2012

33 Urban meteorology Displacement height Canopy blending Mean wind vector Shifted wind vector z ( h, α ) = 0.7 hf( α ) d c c c c c ( α ) 2 c Fc( αc) = 1 exp α c u ' ( xyzt,,, ) = gxyz (,, ) u( xyzt,,, ) ' ' fsl ( z, z0, L) ux(, xyzt,,) = u* x(, xyt,) k ' ' fsl ( z, z0, L) uy(, xyzt,,) = u* y(, xyt,) k u(, xyzt,,) = 0 ' z ( hc < zs + zd) and ( z < hc) h ( c s d) c zd if or h z + z z zd if ( hc < zs + zd) and ( hc z < zs + zd) (,, ) = zs if ( hc < zs + zd) and ( z zs + zd) ' z xyz Surface layer profile Canopy layer profile Blending function z z fsl ( zz, 0, L) = ln + 1 Ψm( ) z0 L z fc( zh, c, αc) = exp αc 1 hc gxyz (,, ) = F( α ) f( zh,, α ) + (1 F( α )) c c c c c c c fsl (, zz0, L) f ( h, z, L) sl c 0 17 February 2012

34 Wind vector spatial derivatives Calculated by chain rule, e.g.: gxyz (,, ) αc gxyz (,, ) hc + αc xi hc xi if z < h gxyz (,, ) gxyz (,, ) gxyz (,, ) z = + + xi z0 xi z xi if z h 0 hc < zs + z z0 d hc zs + zd gxyz (,, ) = x i gxyz (,, ) αc gxyz (,, ) hc + α x h x c i c i gxyz (,, ) z gxyz (,, ) z < s + z0 xi z xi c c if z z z gxyz (,, s + zd) αc gxyz (,, s + zd) hc + αc xi hc xi gxyz (,, s + zd) z0 + if z zs + zd z0 xi gxyz (,, s + zd) zd αc zd h c + + z αc xi hc xi d 17 February 2012

35 Hypotheses Temporal gridding Spatial gridding θ 1 ( ) ( d) x y L ( ) ( c) ( αc) = 1 2 * * 0 Source-term Meteorology ( l, l, t, m,ln d,ln v, a, u, u,,ln z,ln h,ln, DP ) Model Location Time Mass Duration Deposition velocity Agent Friction velocity components Reciprocal Monin Obukhov length Surface roughness Canopy Height Canopy Flow Dispersion model Dispersion model output PDF Floating point values used to index discrete values 17 February 2012

36 Accuracy Compared to ATP45 Concentration sensor network Meteorology sensor Shear LIDAR SODAR Multiple anenometers Probability of hazard effect Ground Truth Inferred 17 February 2012

37 Uncertainty Compared to ATP45 Single prompt alarm Forecast meteorology Probability of hazard effect Ground Truth Inferred 17 February 2012

38 Processing dynamic sensor data MCBDF performs sourceterm estimation in realtime A time window is maintained - typically 30 minutes into the past for chem, 2 days for bio On receipt of new data, old hypotheses and old data will become obsolete and are removed as they exit the current time window Total likelihood housekeeping Remaining hypothesis weights are modified by the likelihood of new data 17 February 2012

39 Exam Question Source term means to an end How much material is in the soil Can the land be used for habitation or farming. 17 February 2012

40 Summary Deposition survey data as a data source appears effective Modelling/inference extensions required 17 February 2012

Biological Source Term Estimation Using Particle Counters and Immunoassay Sensors

Biological Source Term Estimation Using Particle Counters and Immunoassay Sensors Biological Source Term Estimation Using Particle Counters and Immunoassay Sensors P. Robins Hazard Assessment, Simulation and Prediction Dstl Porton Down, UK probins@dstl.gov.uk V. E. Rapley Hazard Assessment,

More information

Assessing Atmospheric Releases of Hazardous Materials

Assessing Atmospheric Releases of Hazardous Materials Assessing Atmospheric Releases of Hazardous Materials Nathan Platt and Jeffry Urban The Problem Atmospheric transport and dispersion (AT&D) models play an important role in the Department of Defense because

More information

Bayesian Regression Linear and Logistic Regression

Bayesian Regression Linear and Logistic Regression When we want more than point estimates Bayesian Regression Linear and Logistic Regression Nicole Beckage Ordinary Least Squares Regression and Lasso Regression return only point estimates But what if we

More information

Monte Carlo Simulation. CWR 6536 Stochastic Subsurface Hydrology

Monte Carlo Simulation. CWR 6536 Stochastic Subsurface Hydrology Monte Carlo Simulation CWR 6536 Stochastic Subsurface Hydrology Steps in Monte Carlo Simulation Create input sample space with known distribution, e.g. ensemble of all possible combinations of v, D, q,

More information

Risk Estimation and Uncertainty Quantification by Markov Chain Monte Carlo Methods

Risk Estimation and Uncertainty Quantification by Markov Chain Monte Carlo Methods Risk Estimation and Uncertainty Quantification by Markov Chain Monte Carlo Methods Konstantin Zuev Institute for Risk and Uncertainty University of Liverpool http://www.liv.ac.uk/risk-and-uncertainty/staff/k-zuev/

More information

Statistical Methods in Particle Physics Lecture 1: Bayesian methods

Statistical Methods in Particle Physics Lecture 1: Bayesian methods Statistical Methods in Particle Physics Lecture 1: Bayesian methods SUSSP65 St Andrews 16 29 August 2009 Glen Cowan Physics Department Royal Holloway, University of London g.cowan@rhul.ac.uk www.pp.rhul.ac.uk/~cowan

More information

STONY BROOK UNIVERSITY. CEAS Technical Report 829

STONY BROOK UNIVERSITY. CEAS Technical Report 829 1 STONY BROOK UNIVERSITY CEAS Technical Report 829 Variable and Multiple Target Tracking by Particle Filtering and Maximum Likelihood Monte Carlo Method Jaechan Lim January 4, 2006 2 Abstract In most applications

More information

Lecture 5. G. Cowan Lectures on Statistical Data Analysis Lecture 5 page 1

Lecture 5. G. Cowan Lectures on Statistical Data Analysis Lecture 5 page 1 Lecture 5 1 Probability (90 min.) Definition, Bayes theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests (90 min.) general concepts, test statistics,

More information

Application of a Bayesian Inference Method to Reconstruct Short-Range Atmospheric Dispersion Events

Application of a Bayesian Inference Method to Reconstruct Short-Range Atmospheric Dispersion Events Boise State University ScholarWorks Mechanical and Biomedical Engineering Faculty Publications and Presentations Department of Mechanical and Biomedical Engineering 7-4-010 Application of a Bayesian Inference

More information

Bayesian Methods for Machine Learning

Bayesian Methods for Machine Learning Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),

More information

PIER HLM Course July 30, 2011 Howard Seltman. Discussion Guide for Bayes and BUGS

PIER HLM Course July 30, 2011 Howard Seltman. Discussion Guide for Bayes and BUGS PIER HLM Course July 30, 2011 Howard Seltman Discussion Guide for Bayes and BUGS 1. Classical Statistics is based on parameters as fixed unknown values. a. The standard approach is to try to discover,

More information

Parameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn

Parameter estimation and forecasting. Cristiano Porciani AIfA, Uni-Bonn Parameter estimation and forecasting Cristiano Porciani AIfA, Uni-Bonn Questions? C. Porciani Estimation & forecasting 2 Temperature fluctuations Variance at multipole l (angle ~180o/l) C. Porciani Estimation

More information

USING METEOROLOGICAL ENSEMBLES FOR ATMOSPHERIC DISPERSION MODELLING OF THE FUKUSHIMA NUCLEAR ACCIDENT

USING METEOROLOGICAL ENSEMBLES FOR ATMOSPHERIC DISPERSION MODELLING OF THE FUKUSHIMA NUCLEAR ACCIDENT USING METEOROLOGICAL ENSEMBLES FOR ATMOSPHERIC DISPERSION MODELLING OF THE FUKUSHIMA NUCLEAR ACCIDENT 17th International Conference on Harmonisation within Atmospheric Dispersion Modelling for Regulatory

More information

PMR Learning as Inference

PMR Learning as Inference Outline PMR Learning as Inference Probabilistic Modelling and Reasoning Amos Storkey Modelling 2 The Exponential Family 3 Bayesian Sets School of Informatics, University of Edinburgh Amos Storkey PMR Learning

More information

27 : Distributed Monte Carlo Markov Chain. 1 Recap of MCMC and Naive Parallel Gibbs Sampling

27 : Distributed Monte Carlo Markov Chain. 1 Recap of MCMC and Naive Parallel Gibbs Sampling 10-708: Probabilistic Graphical Models 10-708, Spring 2014 27 : Distributed Monte Carlo Markov Chain Lecturer: Eric P. Xing Scribes: Pengtao Xie, Khoa Luu In this scribe, we are going to review the Parallel

More information

Data Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University

Data Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Data Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Why uncertainty? Why should data mining care about uncertainty? We

More information

Bayesian analysis in nuclear physics

Bayesian analysis in nuclear physics Bayesian analysis in nuclear physics Ken Hanson T-16, Nuclear Physics; Theoretical Division Los Alamos National Laboratory Tutorials presented at LANSCE Los Alamos Neutron Scattering Center July 25 August

More information

Short tutorial on data assimilation

Short tutorial on data assimilation Mitglied der Helmholtz-Gemeinschaft Short tutorial on data assimilation 23 June 2015 Wolfgang Kurtz & Harrie-Jan Hendricks Franssen Institute of Bio- and Geosciences IBG-3 (Agrosphere), Forschungszentrum

More information

Bayesian Networks BY: MOHAMAD ALSABBAGH

Bayesian Networks BY: MOHAMAD ALSABBAGH Bayesian Networks BY: MOHAMAD ALSABBAGH Outlines Introduction Bayes Rule Bayesian Networks (BN) Representation Size of a Bayesian Network Inference via BN BN Learning Dynamic BN Introduction Conditional

More information

Bayesian Calibration of Simulators with Structured Discretization Uncertainty

Bayesian Calibration of Simulators with Structured Discretization Uncertainty Bayesian Calibration of Simulators with Structured Discretization Uncertainty Oksana A. Chkrebtii Department of Statistics, The Ohio State University Joint work with Matthew T. Pratola (Statistics, The

More information

Detection theory. H 0 : x[n] = w[n]

Detection theory. H 0 : x[n] = w[n] Detection Theory Detection theory A the last topic of the course, we will briefly consider detection theory. The methods are based on estimation theory and attempt to answer questions such as Is a signal

More information

Introduction to Bayes

Introduction to Bayes Introduction to Bayes Alan Heavens September 3, 2018 ICIC Data Analysis Workshop Alan Heavens Introduction to Bayes September 3, 2018 1 / 35 Overview 1 Inverse Problems 2 The meaning of probability Probability

More information

(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis

(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis Summarizing a posterior Given the data and prior the posterior is determined Summarizing the posterior gives parameter estimates, intervals, and hypothesis tests Most of these computations are integrals

More information

Statistics and Data Analysis

Statistics and Data Analysis Statistics and Data Analysis The Crash Course Physics 226, Fall 2013 "There are three kinds of lies: lies, damned lies, and statistics. Mark Twain, allegedly after Benjamin Disraeli Statistics and Data

More information

Assessing Reliability Using Developmental and Operational Test Data

Assessing Reliability Using Developmental and Operational Test Data Assessing Reliability Using Developmental and Operational Test Data Martin Wayne, PhD, U.S. AMSAA Mohammad Modarres, PhD, University of Maryland, College Park Presented at the RAMS-04 Symposium Colorado

More information

CPSC 540: Machine Learning

CPSC 540: Machine Learning CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is

More information

Nowcasting and Urban Interactive Modeling Using Robotic and Remotely Sensed Data James Cogan, Robert Dumais, and Yansen Wang

Nowcasting and Urban Interactive Modeling Using Robotic and Remotely Sensed Data James Cogan, Robert Dumais, and Yansen Wang Nowcasting and Urban Interactive Modeling Using Robotic and Remotely Sensed Data James Cogan, Robert Dumais, and Yansen Wang Meteorological Modeling Branch Battlefield Environment Division Computational

More information

Primer on statistics:

Primer on statistics: Primer on statistics: MLE, Confidence Intervals, and Hypothesis Testing ryan.reece@gmail.com http://rreece.github.io/ Insight Data Science - AI Fellows Workshop Feb 16, 018 Outline 1. Maximum likelihood

More information

Systematic uncertainties in statistical data analysis for particle physics. DESY Seminar Hamburg, 31 March, 2009

Systematic uncertainties in statistical data analysis for particle physics. DESY Seminar Hamburg, 31 March, 2009 Systematic uncertainties in statistical data analysis for particle physics DESY Seminar Hamburg, 31 March, 2009 Glen Cowan Physics Department Royal Holloway, University of London g.cowan@rhul.ac.uk www.pp.rhul.ac.uk/~cowan

More information

Linear Regression. Data Model. β, σ 2. Process Model. ,V β. ,s 2. s 1. Parameter Model

Linear Regression. Data Model. β, σ 2. Process Model. ,V β. ,s 2. s 1. Parameter Model Regression: Part II Linear Regression y~n X, 2 X Y Data Model β, σ 2 Process Model Β 0,V β s 1,s 2 Parameter Model Assumptions of Linear Model Homoskedasticity No error in X variables Error in Y variables

More information

36-463/663: Hierarchical Linear Models

36-463/663: Hierarchical Linear Models 36-463/663: Hierarchical Linear Models Taste of MCMC / Bayes for 3 or more levels Brian Junker 132E Baker Hall brian@stat.cmu.edu 1 Outline Practical Bayes Mastery Learning Example A brief taste of JAGS

More information

Statistics & Data Sciences: First Year Prelim Exam May 2018

Statistics & Data Sciences: First Year Prelim Exam May 2018 Statistics & Data Sciences: First Year Prelim Exam May 2018 Instructions: 1. Do not turn this page until instructed to do so. 2. Start each new question on a new sheet of paper. 3. This is a closed book

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein

Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein Kalman filtering and friends: Inference in time series models Herke van Hoof slides mostly by Michael Rubinstein Problem overview Goal Estimate most probable state at time k using measurement up to time

More information

Biol 206/306 Advanced Biostatistics Lab 12 Bayesian Inference

Biol 206/306 Advanced Biostatistics Lab 12 Bayesian Inference Biol 206/306 Advanced Biostatistics Lab 12 Bayesian Inference By Philip J. Bergmann 0. Laboratory Objectives 1. Learn what Bayes Theorem and Bayesian Inference are 2. Reinforce the properties of Bayesian

More information

STA 4273H: Sta-s-cal Machine Learning

STA 4273H: Sta-s-cal Machine Learning STA 4273H: Sta-s-cal Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 2 In our

More information

MODELING FOR ENVIRONMENTAL RADIATION DOSE RECONSTRUCTION. Bruce Napier 23 May 2011

MODELING FOR ENVIRONMENTAL RADIATION DOSE RECONSTRUCTION. Bruce Napier 23 May 2011 MODELING FOR ENVIRONMENTAL RADIATION DOSE RECONSTRUCTION Bruce Napier 23 May 2011 1 Topics NCRP Report No. 163 Atmospheric dispersion modeling Reconstruction of dose from releases of iodines and noble

More information

Dynamic Multipath Estimation by Sequential Monte Carlo Methods

Dynamic Multipath Estimation by Sequential Monte Carlo Methods Dynamic Multipath Estimation by Sequential Monte Carlo Methods M. Lentmaier, B. Krach, P. Robertson, and T. Thiasiriphet German Aerospace Center (DLR) Slide 1 Outline Multipath problem and signal model

More information

Markov Chain Monte Carlo methods

Markov Chain Monte Carlo methods Markov Chain Monte Carlo methods By Oleg Makhnin 1 Introduction a b c M = d e f g h i 0 f(x)dx 1.1 Motivation 1.1.1 Just here Supresses numbering 1.1.2 After this 1.2 Literature 2 Method 2.1 New math As

More information

Approximate Bayesian Computation

Approximate Bayesian Computation Approximate Bayesian Computation Michael Gutmann https://sites.google.com/site/michaelgutmann University of Helsinki and Aalto University 1st December 2015 Content Two parts: 1. The basics of approximate

More information

Applied Probability. School of Mathematics and Statistics, University of Sheffield. (University of Sheffield) Applied Probability / 8

Applied Probability. School of Mathematics and Statistics, University of Sheffield. (University of Sheffield) Applied Probability / 8 Applied Probability School of Mathematics and Statistics, University of Sheffield 2018 19 (University of Sheffield) Applied Probability 2018 19 1 / 8 Introduction You will have seen probability models.

More information

Statistics 360/601 Modern Bayesian Theory

Statistics 360/601 Modern Bayesian Theory Statistics 360/601 Modern Bayesian Theory Alexander Volfovsky Lecture 8 - Sept 25, 2018 Monte Carlo 1 2 Monte Carlo approximation Want to compute Z E[ y] = p( y)d without worrying about actual integration...

More information

An introduction to Bayesian reasoning in particle physics

An introduction to Bayesian reasoning in particle physics An introduction to Bayesian reasoning in particle physics Graduiertenkolleg seminar, May 15th 2013 Overview Overview A concrete example Scientific reasoning Probability and the Bayesian interpretation

More information

Forward Problems and their Inverse Solutions

Forward Problems and their Inverse Solutions Forward Problems and their Inverse Solutions Sarah Zedler 1,2 1 King Abdullah University of Science and Technology 2 University of Texas at Austin February, 2013 Outline 1 Forward Problem Example Weather

More information

Bayesian Inference for DSGE Models. Lawrence J. Christiano

Bayesian Inference for DSGE Models. Lawrence J. Christiano Bayesian Inference for DSGE Models Lawrence J. Christiano Outline State space-observer form. convenient for model estimation and many other things. Bayesian inference Bayes rule. Monte Carlo integation.

More information

(a) (3 points) Construct a 95% confidence interval for β 2 in Equation 1.

(a) (3 points) Construct a 95% confidence interval for β 2 in Equation 1. Problem 1 (21 points) An economist runs the regression y i = β 0 + x 1i β 1 + x 2i β 2 + x 3i β 3 + ε i (1) The results are summarized in the following table: Equation 1. Variable Coefficient Std. Error

More information

Fast Likelihood-Free Inference via Bayesian Optimization

Fast Likelihood-Free Inference via Bayesian Optimization Fast Likelihood-Free Inference via Bayesian Optimization Michael Gutmann https://sites.google.com/site/michaelgutmann University of Helsinki Aalto University Helsinki Institute for Information Technology

More information

Reminder of some Markov Chain properties:

Reminder of some Markov Chain properties: Reminder of some Markov Chain properties: 1. a transition from one state to another occurs probabilistically 2. only state that matters is where you currently are (i.e. given present, future is independent

More information

Statistical Methods in Particle Physics

Statistical Methods in Particle Physics Statistical Methods in Particle Physics Lecture 11 January 7, 2013 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline How to communicate the statistical uncertainty

More information

ST 740: Model Selection

ST 740: Model Selection ST 740: Model Selection Alyson Wilson Department of Statistics North Carolina State University November 25, 2013 A. Wilson (NCSU Statistics) Model Selection November 25, 2013 1 / 29 Formal Bayesian Model

More information

Session: Probabilistic methods in avalanche hazard assessment. Session moderator: Marco Uzielli Norwegian Geotechnical Institute

Session: Probabilistic methods in avalanche hazard assessment. Session moderator: Marco Uzielli Norwegian Geotechnical Institute Session: Probabilistic methods in avalanche hazard assessment Session moderator: Marco Uzielli Norwegian Geotechnical Institute Session plan Title Presenter Affiliation A probabilistic framework for avalanche

More information

Statistical learning. Chapter 20, Sections 1 4 1

Statistical learning. Chapter 20, Sections 1 4 1 Statistical learning Chapter 20, Sections 1 4 Chapter 20, Sections 1 4 1 Outline Bayesian learning Maximum a posteriori and maximum likelihood learning Bayes net learning ML parameter learning with complete

More information

Data Analysis I. Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK. 10 lectures, beginning October 2006

Data Analysis I. Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK. 10 lectures, beginning October 2006 Astronomical p( y x, I) p( x, I) p ( x y, I) = p( y, I) Data Analysis I Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK 10 lectures, beginning October 2006 4. Monte Carlo Methods

More information

A Probabilistic Framework for solving Inverse Problems. Lambros S. Katafygiotis, Ph.D.

A Probabilistic Framework for solving Inverse Problems. Lambros S. Katafygiotis, Ph.D. A Probabilistic Framework for solving Inverse Problems Lambros S. Katafygiotis, Ph.D. OUTLINE Introduction to basic concepts of Bayesian Statistics Inverse Problems in Civil Engineering Probabilistic Model

More information

Accounting for Calibration Uncertainty in Spectral Analysis. David A. van Dyk

Accounting for Calibration Uncertainty in Spectral Analysis. David A. van Dyk Accounting for in Spectral Analysis David A van Dyk Statistics Section, Imperial College London Joint work with Vinay Kashyap, Jin Xu, Alanna Connors, and Aneta Siegminowska IACHEC March 2013 David A van

More information

The Bayesian Choice. Christian P. Robert. From Decision-Theoretic Foundations to Computational Implementation. Second Edition.

The Bayesian Choice. Christian P. Robert. From Decision-Theoretic Foundations to Computational Implementation. Second Edition. Christian P. Robert The Bayesian Choice From Decision-Theoretic Foundations to Computational Implementation Second Edition With 23 Illustrations ^Springer" Contents Preface to the Second Edition Preface

More information

Lecture 3. G. Cowan. Lecture 3 page 1. Lectures on Statistical Data Analysis

Lecture 3. G. Cowan. Lecture 3 page 1. Lectures on Statistical Data Analysis Lecture 3 1 Probability (90 min.) Definition, Bayes theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests (90 min.) general concepts, test statistics,

More information

Bayesian rules of probability as principles of logic [Cox] Notation: pr(x I) is the probability (or pdf) of x being true given information I

Bayesian rules of probability as principles of logic [Cox] Notation: pr(x I) is the probability (or pdf) of x being true given information I Bayesian rules of probability as principles of logic [Cox] Notation: pr(x I) is the probability (or pdf) of x being true given information I 1 Sum rule: If set {x i } is exhaustive and exclusive, pr(x

More information

Bayesian phylogenetics. the one true tree? Bayesian phylogenetics

Bayesian phylogenetics. the one true tree? Bayesian phylogenetics Bayesian phylogenetics the one true tree? the methods we ve learned so far try to get a single tree that best describes the data however, they admit that they don t search everywhere, and that it is difficult

More information

Bayesian statistics and modelling in ecology

Bayesian statistics and modelling in ecology Bayesian statistics and modelling in ecology Prof Paul Blackwell University of Sheffield, UK February 2011 Bayesian statistics Bayesian statistics: the systematic use of probability to express uncertainty

More information

Stat 451 Lecture Notes Numerical Integration

Stat 451 Lecture Notes Numerical Integration Stat 451 Lecture Notes 03 12 Numerical Integration Ryan Martin UIC www.math.uic.edu/~rgmartin 1 Based on Chapter 5 in Givens & Hoeting, and Chapters 4 & 18 of Lange 2 Updated: February 11, 2016 1 / 29

More information

Introduction to Artificial Intelligence (AI)

Introduction to Artificial Intelligence (AI) Introduction to Artificial Intelligence (AI) Computer Science cpsc502, Lecture 9 Oct, 11, 2011 Slide credit Approx. Inference : S. Thrun, P, Norvig, D. Klein CPSC 502, Lecture 9 Slide 1 Today Oct 11 Bayesian

More information

Bayesian RL Seminar. Chris Mansley September 9, 2008

Bayesian RL Seminar. Chris Mansley September 9, 2008 Bayesian RL Seminar Chris Mansley September 9, 2008 Bayes Basic Probability One of the basic principles of probability theory, the chain rule, will allow us to derive most of the background material in

More information

Linear Dynamical Systems

Linear Dynamical Systems Linear Dynamical Systems Sargur N. srihari@cedar.buffalo.edu Machine Learning Course: http://www.cedar.buffalo.edu/~srihari/cse574/index.html Two Models Described by Same Graph Latent variables Observations

More information

Climate Change: the Uncertainty of Certainty

Climate Change: the Uncertainty of Certainty Climate Change: the Uncertainty of Certainty Reinhard Furrer, UZH JSS, Geneva Oct. 30, 2009 Collaboration with: Stephan Sain - NCAR Reto Knutti - ETHZ Claudia Tebaldi - Climate Central Ryan Ford, Doug

More information

Statistical Methods for Particle Physics Lecture 1: parameter estimation, statistical tests

Statistical Methods for Particle Physics Lecture 1: parameter estimation, statistical tests Statistical Methods for Particle Physics Lecture 1: parameter estimation, statistical tests http://benasque.org/2018tae/cgi-bin/talks/allprint.pl TAE 2018 Benasque, Spain 3-15 Sept 2018 Glen Cowan Physics

More information

Introduction to Bayesian Methods. Introduction to Bayesian Methods p.1/??

Introduction to Bayesian Methods. Introduction to Bayesian Methods p.1/?? to Bayesian Methods Introduction to Bayesian Methods p.1/?? We develop the Bayesian paradigm for parametric inference. To this end, suppose we conduct (or wish to design) a study, in which the parameter

More information

Stat 535 C - Statistical Computing & Monte Carlo Methods. Arnaud Doucet.

Stat 535 C - Statistical Computing & Monte Carlo Methods. Arnaud Doucet. Stat 535 C - Statistical Computing & Monte Carlo Methods Arnaud Doucet Email: arnaud@cs.ubc.ca 1 CS students: don t forget to re-register in CS-535D. Even if you just audit this course, please do register.

More information

I.Classical probabilities

I.Classical probabilities I.Classical probabilities I.4 Markov chains Markov chains? 2 Andrei A. Markov Russian mathematician 856-922 3 Markov chains as pedagogic, analytical and prognostic tool. Helps us understand probabilities

More information

Variational Methods in Bayesian Deconvolution

Variational Methods in Bayesian Deconvolution PHYSTAT, SLAC, Stanford, California, September 8-, Variational Methods in Bayesian Deconvolution K. Zarb Adami Cavendish Laboratory, University of Cambridge, UK This paper gives an introduction to the

More information

Biol 206/306 Advanced Biostatistics Lab 12 Bayesian Inference Fall 2016

Biol 206/306 Advanced Biostatistics Lab 12 Bayesian Inference Fall 2016 Biol 206/306 Advanced Biostatistics Lab 12 Bayesian Inference Fall 2016 By Philip J. Bergmann 0. Laboratory Objectives 1. Learn what Bayes Theorem and Bayesian Inference are 2. Reinforce the properties

More information

Density Estimation. Seungjin Choi

Density Estimation. Seungjin Choi Density Estimation Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr http://mlg.postech.ac.kr/

More information

Answers and expectations

Answers and expectations Answers and expectations For a function f(x) and distribution P(x), the expectation of f with respect to P is The expectation is the average of f, when x is drawn from the probability distribution P E

More information

Big model configuration with Bayesian quadrature. David Duvenaud, Roman Garnett, Tom Gunter, Philipp Hennig, Michael A Osborne and Stephen Roberts.

Big model configuration with Bayesian quadrature. David Duvenaud, Roman Garnett, Tom Gunter, Philipp Hennig, Michael A Osborne and Stephen Roberts. Big model configuration with Bayesian quadrature David Duvenaud, Roman Garnett, Tom Gunter, Philipp Hennig, Michael A Osborne and Stephen Roberts. This talk will develop Bayesian quadrature approaches

More information

Probability and Estimation. Alan Moses

Probability and Estimation. Alan Moses Probability and Estimation Alan Moses Random variables and probability A random variable is like a variable in algebra (e.g., y=e x ), but where at least part of the variability is taken to be stochastic.

More information

Bayesian Graphical Models

Bayesian Graphical Models Graphical Models and Inference, Lecture 16, Michaelmas Term 2009 December 4, 2009 Parameter θ, data X = x, likelihood L(θ x) p(x θ). Express knowledge about θ through prior distribution π on θ. Inference

More information

Bayesian Inference. Anders Gorm Pedersen. Molecular Evolution Group Center for Biological Sequence Analysis Technical University of Denmark (DTU)

Bayesian Inference. Anders Gorm Pedersen. Molecular Evolution Group Center for Biological Sequence Analysis Technical University of Denmark (DTU) Bayesian Inference Anders Gorm Pedersen Molecular Evolution Group Center for Biological Sequence Analysis Technical University of Denmark (DTU) Background: Conditional probability A P (B A) = A,B P (A,

More information

Spring Semester 2011 March 1, 2011

Spring Semester 2011 March 1, 2011 METR 130: Lecture 3 - Atmospheric Surface Layer (SL - Neutral Stratification (Log-law wind profile - Stable/Unstable Stratification (Monin-Obukhov Similarity Theory Spring Semester 011 March 1, 011 Reading

More information

Forecasting Wind Ramps

Forecasting Wind Ramps Forecasting Wind Ramps Erin Summers and Anand Subramanian Jan 5, 20 Introduction The recent increase in the number of wind power producers has necessitated changes in the methods power system operators

More information

Computing urban wind fields

Computing urban wind fields Combining mesoscale, nowcast, and CFD model output in near real-time for protecting urban areas and buildings from releases of hazardous airborne materials S. Swerdlin, T. Warner, J. Copeland, D. Hahn,

More information

Single Lens Lightcurve Modeling

Single Lens Lightcurve Modeling Single Lens Lightcurve Modeling Scott Gaudi The Ohio State University 2011 Sagan Exoplanet Summer Workshop Exploring Exoplanets with Microlensing July 26, 2011 Outline. Basic Equations. Limits. Derivatives.

More information

Introduction to Bayesian Statistics 1

Introduction to Bayesian Statistics 1 Introduction to Bayesian Statistics 1 STA 442/2101 Fall 2018 1 This slide show is an open-source document. See last slide for copyright information. 1 / 42 Thomas Bayes (1701-1761) Image from the Wikipedia

More information

Accounting for Calibration Uncertainty in Spectral Analysis. David A. van Dyk

Accounting for Calibration Uncertainty in Spectral Analysis. David A. van Dyk Bayesian Analysis of Accounting for in Spectral Analysis David A van Dyk Statistics Section, Imperial College London Joint work with Vinay Kashyap, Jin Xu, Alanna Connors, and Aneta Siegminowska ISIS May

More information

INDEX. (The index refers to the continuous pagination)

INDEX. (The index refers to the continuous pagination) (The index refers to the continuous pagination) Accuracy in physical models methods for assessing overall assessment acquisition of information acrylonitrile hazards polymerisation toxic effects toxic

More information

Additional Keplerian Signals in the HARPS data for Gliese 667C from a Bayesian re-analysis

Additional Keplerian Signals in the HARPS data for Gliese 667C from a Bayesian re-analysis Additional Keplerian Signals in the HARPS data for Gliese 667C from a Bayesian re-analysis Phil Gregory, Samantha Lawler, Brett Gladman Physics and Astronomy Univ. of British Columbia Abstract A re-analysis

More information

Machine Learning Overview

Machine Learning Overview Machine Learning Overview Sargur N. Srihari University at Buffalo, State University of New York USA 1 Outline 1. What is Machine Learning (ML)? 2. Types of Information Processing Problems Solved 1. Regression

More information

Using Bayes Factors for Model Selection in High-Energy Astrophysics

Using Bayes Factors for Model Selection in High-Energy Astrophysics Using Bayes Factors for Model Selection in High-Energy Astrophysics Shandong Zhao Department of Statistic, UCI April, 203 Model Comparison in Astrophysics Nested models (line detection in spectral analysis):

More information

BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA

BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA Intro: Course Outline and Brief Intro to Marina Vannucci Rice University, USA PASI-CIMAT 04/28-30/2010 Marina Vannucci

More information

Likelihood-free MCMC

Likelihood-free MCMC Bayesian inference for stable distributions with applications in finance Department of Mathematics University of Leicester September 2, 2011 MSc project final presentation Outline 1 2 3 4 Classical Monte

More information

Efficient Forecasting of Volcanic Ash Clouds. Roger P Denlinger Hans F Schwaiger US Geological Survey

Efficient Forecasting of Volcanic Ash Clouds. Roger P Denlinger Hans F Schwaiger US Geological Survey Efficient Forecasting of Volcanic Ash Clouds Roger P Denlinger Hans F Schwaiger US Geological Survey Two basic questions addressed in this talk: 1. How does uncertainty affect forecasts of volcanic ash

More information

Urban Dispersion and Data Handling in JEM

Urban Dispersion and Data Handling in JEM Urban Dispersion and Data Handling in JEM Ian Griffiths, David Brook & Paul Cullen (Dstl) Tim Dudman & Russell Mills (RiskAware Ltd) Rick Fry (DTRA) Those parts produced by Dstl authors are Crown Copyright

More information

Bayesian Inference for Normal Mean

Bayesian Inference for Normal Mean Al Nosedal. University of Toronto. November 18, 2015 Likelihood of Single Observation The conditional observation distribution of y µ is Normal with mean µ and variance σ 2, which is known. Its density

More information

Bayesian parameter estimation in predictive engineering

Bayesian parameter estimation in predictive engineering Bayesian parameter estimation in predictive engineering Damon McDougall Institute for Computational Engineering and Sciences, UT Austin 14th August 2014 1/27 Motivation Understand physical phenomena Observations

More information

Comparison of Three Calculation Methods for a Bayesian Inference of Two Poisson Parameters

Comparison of Three Calculation Methods for a Bayesian Inference of Two Poisson Parameters Journal of Modern Applied Statistical Methods Volume 13 Issue 1 Article 26 5-1-2014 Comparison of Three Calculation Methods for a Bayesian Inference of Two Poisson Parameters Yohei Kawasaki Tokyo University

More information

A new Hierarchical Bayes approach to ensemble-variational data assimilation

A new Hierarchical Bayes approach to ensemble-variational data assimilation A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander

More information

Statistical Data Analysis Stat 3: p-values, parameter estimation

Statistical Data Analysis Stat 3: p-values, parameter estimation Statistical Data Analysis Stat 3: p-values, parameter estimation London Postgraduate Lectures on Particle Physics; University of London MSci course PH4515 Glen Cowan Physics Department Royal Holloway,

More information

PSHA for seismicity induced by gas extraction in the Groningen Field

PSHA for seismicity induced by gas extraction in the Groningen Field PSHA for seismicity induced by gas extraction in the Groningen Field Dirk Kraaijpoel, Mauro Caccavale, Torild van Eck, Bernard Dost Schatzalp Workshop Induced Seismicity 2015-03-13 Groningen Field # events

More information

Spatio-temporal precipitation modeling based on time-varying regressions

Spatio-temporal precipitation modeling based on time-varying regressions Spatio-temporal precipitation modeling based on time-varying regressions Oleg Makhnin Department of Mathematics New Mexico Tech Socorro, NM 87801 January 19, 2007 1 Abstract: A time-varying regression

More information

Statistics for extreme & sparse data

Statistics for extreme & sparse data Statistics for extreme & sparse data University of Bath December 6, 2018 Plan 1 2 3 4 5 6 The Problem Climate Change = Bad! 4 key problems Volcanic eruptions/catastrophic event prediction. Windstorms

More information

Module 6: Introduction to Gibbs Sampling. Rebecca C. Steorts

Module 6: Introduction to Gibbs Sampling. Rebecca C. Steorts Module 6: Introduction to Gibbs Sampling Rebecca C. Steorts Agenda Gibbs sampling Exponential example Normal example Pareto example Gibbs sampler Suppose p(x, y) is a p.d.f. or p.m.f. that is difficult

More information