Uncertainty quantification for inverse problems with a weak wave-equation constraint
|
|
- Linette Carroll
- 5 years ago
- Views:
Transcription
1 Uncertainty quantification for inverse problems with a weak wave-equation constraint Zhilong Fang*, Curt Da Silva*, Rachel Kuske** and Felix J. Herrmann* *Seismic Laboratory for Imaging and Modeling (SLIM), University of British Columbia **Department of Mathematics, Georgia Institute of Technology SLIM University of British Columbia
2 Motivation Forward problem m d x x x x x * x x x x x x F (m) 1 3 4
3 Motivation Forward map : F (m) A(m)u = q, d = Pu wavefields +! m source projection operator frequency squared-slowness 3
4 Motivation Inverse problem F 1 (d) d m 4
5 Motivation Statistical inverse problem F 1 (d) d noisy m noisy 5
6 Motivation Statistical inverse problem x = 1m Depth [m] Velocity [km/s] Confidence Interval 6
7 Bayesian inference [A. Tarantola and B. Valette, 198] [J. Kaipio and E. Somersalo, 4] Prior probability density function (PDF): m! prior (m) Likelihood PDF: given data d m! like (d m) Posterior PDF (Bayes rule): post (m d) / like (d m) prior (m) 7
8 Bayes w/ strong PDE constraints Source [m] d Time [s] Time [s] 1.5 Time [s] = Source [m] F (m) Source [m] N (, noise )
9 [A. Tarantola and B. Valette, 198] Bayes w/ strong PDE constraints Posterior PDF w/ strong PDE constraints: post (m d) / exp 1 kpa(m) 1 q dk 1 noise 1 km m priork 1 prior Challenges: high- dimensional model space and data space non- linear and expensive model- to- data map no closed form solution 9
10 Bayes w/ strong PDE constraints [J. Kaipio and E. Somersalo, 4] [A. M. Stuart et al., 4] [J. Martin et al., 1] McMC type methods: Metropolis- Hasting method - draw samples with a proposal PDF Langevin method - construct the proposal PDF with a preconditioning matrix Newton type McMC method - construct the proposal PDF with local Hessian matrix m post (m) prp (m) m 1 1
11 Bayes w/ strong PDE constraints Accurate proposal PDF Low computational cost 11
12 Bayes w/ strong PDE constraints McMC type methods: [J. Kaipio and E. Somersalo, 4] [A. M. Stuart et al., 4] [J. Martin et al., 1] [R. G. Pratt, 1999] Metropolis- Hasting method - draw samples with a proposal PDF Langevin method - construct the proposal PDF with a preconditioning matrix Newton type McMC method - construct the proposal PDF with local Hessian matrix - Hessian matrix and GN Hessian are dense and require additional PDE solves log like (d m) e.g. Gauss- Newton Hessian of : H GN (m) =! 4 diag conj(u) A(m) > P > 1 noise PA(m) 1 diag(u) additional PDE solves 1
13 PDE constrained optimization problems [M. Fisher et al, 4] [T. van Leeuwen and F. J. Herrmann, 13] [T. van Leeuwen and F. J. Herrmann, 15] Original problem: min u,m 1 kpu dk s.t. A(m)u = q Adjoint-state method strong constraint: min m 1 kpa 1 (m)q dk Penalty method weak constraint: min u,m 1 kpu dk + ka(m)u qk 13
14 Extend the search space [T. van Leeuwen and F. J. Herrmann, 13] [T. van Leeuwen and F. J. Herrmann, 15] Larger # of degrees of freedom more convex less local minima 14
15 Extend the search space Introduce auxiliary variable: post (u, m d) / (d u, m) (u, m) (u, m) = (u m) prior (m) A(m)u q Strong PDE constraints: 1 (d u, m) / exp kpu dk 1 noise A(m)u q (u m) = A (m) u q 15
16 Extend the search space Weaken PDE constraints: (u m) = A (m) u q A(m)u q exp ka(m)u qk (u m) / exp ka(m)u qk A(m)u q 16
17 Bayes w/ weak PDE constraints Joint posterior PDF: post (u, m d) / exp 1 kpu dk 1 noise ka(m)u qk 1 km m priork 1 prior This is a bi- Gaussian PDF!! 17
18 Bayes w/ weak PDE constraints Joint posterior PDF: post (u, m d) / exp 1 kpu dk 1 noise ka(m)u qk 1 km m priork 1 prior linear operators For fixed m 18
19 [T. van Leeuwen and F. J. Herrmann, 13] Conditional PDF For fixed m: u N (u, H 1 u ) with u = H 1 u P > 1 noise d + A > (m)q H u = P > 1 noise P + A > (m)a(m) 19
20 Bayes w/ weak PDE constraints Joint posterior PDF: post (u, m d) / exp 1 kpu dk 1 noise ka(m)u qk 1 km m priork 1 prior! diag(m)u + u For fixed m For fixed u! diag(u)m + u linear in m
21 [T. van Leeuwen and F. J. Herrmann, 13] Conditional PDF For fixed u: m N (m, H 1 m ) with m = H 1 m! diag conj(u) (q u)+ 1 prior m prior H m =! 4 diag conj(u) diag(u)+ 1 prior Diagonal matrix 1
22 Gibbs sampling u A(m)u q = m
23 Gibbs sampling u Sampling path * A(m)u q = O( A(m)u q = A(m)u q = O( 1 ) 1 ) m 3
24 Bayes w/ weak PDE constraints Gibbs sampling: 1. start with. for k = 1 : m n smp 3. compute u(m k ) and H u (m k ) 4. draw u k from N u(m k ), H 1 5. compute m(u k ) and 6. draw from m k+1 u (m k ) H m (u k ) N m(u k ), H 1 m (u k ) Main computational cost 7. end 4
25 Computational cost Drawing : u k N u(m k ), Hu 1 (m k ) Step 1 H u (m k )=R > R O(n 3 grid) Step u(m k )=R 1 R > P > 1/ noise d + A > (m k )q O(n grid) Step 3 u k = u(m k )+R 1, N (, I) O(n grid) Cost per each source = solving one PDE 5
26 Weak constraint v.s. Strong constraint Weak constraint w/ Gibbs sampling method joint bi- Gaussian distribution sparse Hessian matrix constructing Hessian matrix does not require additional PDE solves draw samples in a straight- forward manner from the Gaussian conditional distributions Strong constraint w/ M-H type method no special structure dense Hessian matrix constructing Hessian matrix requires additional PDE solves draw samples from certain proposal distribution with accept- reject criteria constructing the proposal distribution may require more PDE solves 6
27 Numerical example - transmission case Z [m] o o o o o o o o x x x x x x x x s /m Model size: 1m x 1m Grid size: m x m Frequency: [, 6, 1, 14] Hz Number of sources: 51 Number of receivers: 51 Number of samplers: 1e X [m] 1.6 True model 7
28 Numerical example - transmission case 1-7 Z [m] o o o o o o o o x x x x x x x x s /m prior = priori, prior =1e-8s /m noise = noisei, noise =1e =1e X [m] 1.6 Prior mean model 8
29 Posterior mean and STD Z [m] 5. s /m Z [m] s /m X [m] X [m] 8.3 Posterior mean model Posterior STD 9
30 Distribution Posterior Prior distribution Z [m] x x x. s /m ρ m [s /m ] X [m] Posterior Prior Posterior Prior x = 5m z = 5m.3.3 ρ ρ m [s /m ] 1-7 x = 18m z = 5m m [s /m ] 1-7 x = 78m z = 5m
31 95% Confidence interval Z [m] 5. s /m X [m]
32 95% Confidence interval m [s /m ].5 Posterior Prior True z = 18m Depth [m] m [s /m ].5 Posterior Prior True z = 5m Depth [m] m [s /m ].5 Posterior Prior True z = 78m Depth [m]
33 Samples m [s /m ].5 Samples x = 18m z = 5m m [s /m ] Number of sample Number of sample 1 5 x = 5m z = 5m 33
34 Numerical example - reflection case Model size: 15m x 3m o x o x o x o x o x o x o x o x o x o x o xo Grid size: 3m x 3m Frequency: [, 4, 6, 8] Hz Z [m] s /m Number of sources: X [m] 1.5 Number of receivers: 11 Number of samplers: 5e5 True model 34
35 Numerical example - reflection case o x o x o x o x o x o x o x o x o x o x o xo prior = priori, prior =3e-8s /m Z [m] s /m noise = noisei, noise =1e X [m] 1.5 =1e3 Prior mean model 35
36 Posterior mean and STD Z [m] s /m Z [m] s /m X [m] X [m].45 Posterior mean model Posterior STD 36
37 Distribution Z [m] 5 1 x x x s /m ρ Posterior Prior X [m] m [s /m ] 1-7 x = 15m z = 75m.5.4 Posterior Prior.5.4 Posterior Prior.3.3 ρ ρ m [s /m ] m [s /m ] x = 15m z = 7m x = 15m z = 117m
38 95% Confidence interval Z [m] s /m X [m]
39 95% Confidence interval Depth [m] Depth [m] Depth [m] Posterior Prior True Posterior Prior True Posterior Prior True m [s /m ] m [s /m ] m [s /m ] 1-7 x = 7m x = 15m x = 67m 39
40 Samples 4 m [s /m ]6 1-7 Samples x = 15m z = 7m Number of samples m [s /m ]4 1-7 x = 15m z = 75m Number of samples 1 5 4
41 Conclusion Posterior distribution for weak PDE constraints inverse problems: joint distribution with respect to the model parameters and wavefields conditional distributions Gaussian distributions with sparse covariance matrices Gibbs sampling method sample model parameters and wavefields from the corresponding conditional distributions alternatively Computational cost one PDE solve per each source per each iteration 41
42 Reference Albert Tarantola, and Bernard Valette. "Inverse problems= quest for information." J. geophys 5.3 (198): Andrew M. Stuart, Jochen Voss, and Petter Wilberg. "Conditional path sampling of SDEs and the Langevin MCMC method." Communications in Mathematical Sciences.4 (4): James Martin, Lucas C. Wilcox, Carsten Burstedde, and OMAR Ghattas. A Stochastic Newton MCMC Method for Large- scale Statistical Inverse Problems with Application to Seismic Inversion. SIAM Journal on Scientific Computing, 34(3):A146 A1487, 1. Jean Virieux and Stéphane Operto. An overview of full- waveform inversion in exploration geophysics. GEOPHYSICS, 74(6):WCC1 WCC6, 9. Tristan van Leeuwen and Felix J. Herrmann. Mitigating local minima in full- waveform inversion by expanding the search space. Geophysical Journal International, 195: , Tristan van Leeuwen and Felix J. Herrmann. A penalty method for PDE- constrained optimization in inverse problems. Inverse Problems, 3(1):157, Michael Fisher, Mand Leutbecher, and G. A. Kelly. "On the equivalence between Kalman smoothing and weak- constraint four- dimensional variational data assimilation." Quarterly Journal of the Royal Meteorological Society (5):
43 Acknowledgements This research was carried out as part of the SINBAD project with the support of the member organizaxons of the SINBAD ConsorXum. 43
Uncertainty quantification for Wavefield Reconstruction Inversion
Uncertainty quantification for Wavefield Reconstruction Inversion Zhilong Fang *, Chia Ying Lee, Curt Da Silva *, Felix J. Herrmann *, and Rachel Kuske * Seismic Laboratory for Imaging and Modeling (SLIM),
More informationUncertainty quantification for Wavefield Reconstruction Inversion
using a PDE free semidefinite Hessian and randomize-then-optimize method Zhilong Fang *, Chia Ying Lee, Curt Da Silva, Tristan van Leeuwen and Felix J. Herrmann Seismic Laboratory for Imaging and Modeling
More informationWavefield Reconstruction Inversion (WRI) a new take on wave-equation based inversion Felix J. Herrmann
Wavefield Reconstruction Inversion (WRI) a new take on wave-equation based inversion Felix J. Herrmann SLIM University of British Columbia van Leeuwen, T and Herrmann, F J (2013). Mitigating local minima
More informationSimultaneous estimation of wavefields & medium parameters
Simultaneous estimation of wavefields & medium parameters reduced-space versus full-space waveform inversion Bas Peters, Felix J. Herrmann Workshop W- 2, The limit of FWI in subsurface parameter recovery.
More informationDimension-Independent likelihood-informed (DILI) MCMC
Dimension-Independent likelihood-informed (DILI) MCMC Tiangang Cui, Kody Law 2, Youssef Marzouk Massachusetts Institute of Technology 2 Oak Ridge National Laboratory 2 August 25 TC, KL, YM DILI MCMC USC
More informationSource estimation for frequency-domain FWI with robust penalties
Source estimation for frequency-domain FWI with robust penalties Aleksandr Y. Aravkin, Tristan van Leeuwen, Henri Calandra, and Felix J. Herrmann Dept. of Earth and Ocean sciences University of British
More informationRecent Advances in Bayesian Inference for Inverse Problems
Recent Advances in Bayesian Inference for Inverse Problems Felix Lucka University College London, UK f.lucka@ucl.ac.uk Applied Inverse Problems Helsinki, May 25, 2015 Bayesian Inference for Inverse Problems
More informationFWI with Compressive Updates Aleksandr Aravkin, Felix Herrmann, Tristan van Leeuwen, Xiang Li, James Burke
Consortium 2010 FWI with Compressive Updates Aleksandr Aravkin, Felix Herrmann, Tristan van Leeuwen, Xiang Li, James Burke SLIM University of British Columbia Full Waveform Inversion The Full Waveform
More informationMonte Carlo in Bayesian Statistics
Monte Carlo in Bayesian Statistics Matthew Thomas SAMBa - University of Bath m.l.thomas@bath.ac.uk December 4, 2014 Matthew Thomas (SAMBa) Monte Carlo in Bayesian Statistics December 4, 2014 1 / 16 Overview
More informationScalable algorithms for optimal experimental design for infinite-dimensional nonlinear Bayesian inverse problems
Scalable algorithms for optimal experimental design for infinite-dimensional nonlinear Bayesian inverse problems Alen Alexanderian (Math/NC State), Omar Ghattas (ICES/UT-Austin), Noémi Petra (Applied Math/UC
More informationPoint spread function reconstruction from the image of a sharp edge
DOE/NV/5946--49 Point spread function reconstruction from the image of a sharp edge John Bardsley, Kevin Joyce, Aaron Luttman The University of Montana National Security Technologies LLC Montana Uncertainty
More informationFull-Waveform Inversion with Gauss- Newton-Krylov Method
Full-Waveform Inversion with Gauss- Newton-Krylov Method Yogi A. Erlangga and Felix J. Herrmann {yerlangga,fherrmann}@eos.ubc.ca Seismic Laboratory for Imaging and Modeling The University of British Columbia
More informationMigration with Implicit Solvers for the Time-harmonic Helmholtz
Migration with Implicit Solvers for the Time-harmonic Helmholtz Yogi A. Erlangga, Felix J. Herrmann Seismic Laboratory for Imaging and Modeling, The University of British Columbia {yerlangga,fherrmann}@eos.ubc.ca
More informationTowards Large-Scale Computational Science and Engineering with Quantifiable Uncertainty
Towards Large-Scale Computational Science and Engineering with Quantifiable Uncertainty Tan Bui-Thanh Computational Engineering and Optimization (CEO) Group Department of Aerospace Engineering and Engineering
More informationMCMC Sampling for Bayesian Inference using L1-type Priors
MÜNSTER MCMC Sampling for Bayesian Inference using L1-type Priors (what I do whenever the ill-posedness of EEG/MEG is just not frustrating enough!) AG Imaging Seminar Felix Lucka 26.06.2012 , MÜNSTER Sampling
More informationEfficient MCMC Sampling for Hierarchical Bayesian Inverse Problems
Efficient MCMC Sampling for Hierarchical Bayesian Inverse Problems Andrew Brown 1,2, Arvind Saibaba 3, Sarah Vallélian 2,3 CCNS Transition Workshop SAMSI May 5, 2016 Supported by SAMSI Visiting Research
More informationMatrix Probing and Simultaneous Sources: A New Approach for Preconditioning the Hessian
Matrix Probing and Simultaneous Sources: A New Approach for Preconditioning the Hessian Curt Da Silva 1 and Felix J. Herrmann 2 1 Dept. of Mathematics 2 Dept. of Earth and Ocean SciencesUniversity of British
More informationMultiple Scenario Inversion of Reflection Seismic Prestack Data
Downloaded from orbit.dtu.dk on: Nov 28, 2018 Multiple Scenario Inversion of Reflection Seismic Prestack Data Hansen, Thomas Mejer; Cordua, Knud Skou; Mosegaard, Klaus Publication date: 2013 Document Version
More informationMarkov Chain Monte Carlo
Markov Chain Monte Carlo Recall: To compute the expectation E ( h(y ) ) we use the approximation E(h(Y )) 1 n n h(y ) t=1 with Y (1),..., Y (n) h(y). Thus our aim is to sample Y (1),..., Y (n) from f(y).
More informationMultivariate Normal & Wishart
Multivariate Normal & Wishart Hoff Chapter 7 October 21, 2010 Reading Comprehesion Example Twenty-two children are given a reading comprehsion test before and after receiving a particular instruction method.
More informationUT-LANL DOE/ASCR ISICLES Project PARADICE: Uncertainty Quantification for Large-Scale Ice Sheet Modeling and Simulation.
UT-LANL DOE/ASCR ISICLES Project PARADICE: Uncertainty Quantification for Large-Scale Ice Sheet Modeling and Simulation Omar Ghattas Representing the rest of the UT-Austin/LANL team: Don Blankenship Tan
More informationLarge Scale Bayesian Inference
Large Scale Bayesian I in Cosmology Jens Jasche Garching, 11 September 2012 Introduction Cosmography 3D density and velocity fields Power-spectra, bi-spectra Dark Energy, Dark Matter, Gravity Cosmological
More informationBayesian Estimation of Input Output Tables for Russia
Bayesian Estimation of Input Output Tables for Russia Oleg Lugovoy (EDF, RANE) Andrey Polbin (RANE) Vladimir Potashnikov (RANE) WIOD Conference April 24, 2012 Groningen Outline Motivation Objectives Bayesian
More informationDirect Current Resistivity Inversion using Various Objective Functions
Direct Current Resistivity Inversion using Various Objective Functions Rowan Cockett Department of Earth and Ocean Science University of British Columbia rcockett@eos.ubc.ca Abstract In geophysical applications
More informationDynamic System Identification using HDMR-Bayesian Technique
Dynamic System Identification using HDMR-Bayesian Technique *Shereena O A 1) and Dr. B N Rao 2) 1), 2) Department of Civil Engineering, IIT Madras, Chennai 600036, Tamil Nadu, India 1) ce14d020@smail.iitm.ac.in
More informationBayesian data analysis in practice: Three simple examples
Bayesian data analysis in practice: Three simple examples Martin P. Tingley Introduction These notes cover three examples I presented at Climatea on 5 October 0. Matlab code is available by request to
More informationForward Problems and their Inverse Solutions
Forward Problems and their Inverse Solutions Sarah Zedler 1,2 1 King Abdullah University of Science and Technology 2 University of Texas at Austin February, 2013 Outline 1 Forward Problem Example Weather
More informationYouzuo Lin and Lianjie Huang
PROCEEDINGS, Thirty-Ninth Workshop on Geothermal Reservoir Engineering Stanford University, Stanford, California, February 24-26, 2014 SGP-TR-202 Building Subsurface Velocity Models with Sharp Interfaces
More informationParallelizing large scale time domain electromagnetic inverse problem
Parallelizing large scale time domain electromagnetic inverse problems Eldad Haber with: D. Oldenburg & R. Shekhtman + Emory University, Atlanta, GA + The University of British Columbia, Vancouver, BC,
More informationComparison between least-squares reverse time migration and full-waveform inversion
Comparison between least-squares reverse time migration and full-waveform inversion Lei Yang, Daniel O. Trad and Wenyong Pan Summary The inverse problem in exploration geophysics usually consists of two
More informationRegularization Parameter Estimation for Least Squares: A Newton method using the χ 2 -distribution
Regularization Parameter Estimation for Least Squares: A Newton method using the χ 2 -distribution Rosemary Renaut, Jodi Mead Arizona State and Boise State September 2007 Renaut and Mead (ASU/Boise) Scalar
More informationConsistent Downscaling of Seismic Inversions to Cornerpoint Flow Models SPE
Consistent Downscaling of Seismic Inversions to Cornerpoint Flow Models SPE 103268 Subhash Kalla LSU Christopher D. White LSU James S. Gunning CSIRO Michael E. Glinsky BHP-Billiton Contents Method overview
More information4. DATA ASSIMILATION FUNDAMENTALS
4. DATA ASSIMILATION FUNDAMENTALS... [the atmosphere] "is a chaotic system in which errors introduced into the system can grow with time... As a consequence, data assimilation is a struggle between chaotic
More informationStochastic Collocation Methods for Polynomial Chaos: Analysis and Applications
Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535
More informationData-Driven Bayesian Model Selection: Parameter Space Dimension Reduction using Automatic Relevance Determination Priors
Data-Driven : Parameter Space Dimension Reduction using Priors Mohammad Khalil mkhalil@sandia.gov, Livermore, CA Workshop on Uncertainty Quantification and Data-Driven Modeling Austin, Texas March 23-24,
More informationTime domain sparsity promoting LSRTM with source estimation
Time domain sparsity promoting LSRTM with source estimation Mengmeng Yang, Philipp Witte, Zhilong Fang & Felix J. Herrmann SLIM University of British Columbia Motivation Features of RTM: pros - no dip
More informationOn Bayesian Computation
On Bayesian Computation Michael I. Jordan with Elaine Angelino, Maxim Rabinovich, Martin Wainwright and Yun Yang Previous Work: Information Constraints on Inference Minimize the minimax risk under constraints
More informationMultimodal Nested Sampling
Multimodal Nested Sampling Farhan Feroz Astrophysics Group, Cavendish Lab, Cambridge Inverse Problems & Cosmology Most obvious example: standard CMB data analysis pipeline But many others: object detection,
More informationLog Gaussian Cox Processes. Chi Group Meeting February 23, 2016
Log Gaussian Cox Processes Chi Group Meeting February 23, 2016 Outline Typical motivating application Introduction to LGCP model Brief overview of inference Applications in my work just getting started
More informationGaussian Process Approximations of Stochastic Differential Equations
Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Centre for Computational Statistics and Machine Learning University College London c.archambeau@cs.ucl.ac.uk CSML
More information(Extended) Kalman Filter
(Extended) Kalman Filter Brian Hunt 7 June 2013 Goals of Data Assimilation (DA) Estimate the state of a system based on both current and all past observations of the system, using a model for the system
More informationUSING GEOSTATISTICS TO DESCRIBE COMPLEX A PRIORI INFORMATION FOR INVERSE PROBLEMS THOMAS M. HANSEN 1,2, KLAUS MOSEGAARD 2 and KNUD S.
USING GEOSTATISTICS TO DESCRIBE COMPLEX A PRIORI INFORMATION FOR INVERSE PROBLEMS THOMAS M. HANSEN 1,2, KLAUS MOSEGAARD 2 and KNUD S. CORDUA 1 1 Institute of Geography & Geology, University of Copenhagen,
More informationErgodicity in data assimilation methods
Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation
More informationTransdimensional Markov Chain Monte Carlo Methods. Jesse Kolb, Vedran Lekić (Univ. of MD) Supervisor: Kris Innanen
Transdimensional Markov Chain Monte Carlo Methods Jesse Kolb, Vedran Lekić (Univ. of MD) Supervisor: Kris Innanen Motivation for Different Inversion Technique Inversion techniques typically provide a single
More informationICES REPORT March Tan Bui-Thanh And Mark Andrew Girolami
ICES REPORT 4- March 4 Solving Large-Scale Pde-Constrained Bayesian Inverse Problems With Riemann Manifold Hamiltonian Monte Carlo by Tan Bui-Thanh And Mark Andrew Girolami The Institute for Computational
More informationUncertainty analysis for the integration of seismic and CSEM data Myoung Jae Kwon & Roel Snieder, Center for Wave Phenomena, Colorado School of Mines
Myoung Jae Kwon & Roel Snieder, Center for Wave Phenomena, Colorado School of Mines Summary Geophysical inverse problems consist of three stages: the forward problem, optimization, and appraisal. We study
More informationWhen one of things that you don t know is the number of things that you don t know
When one of things that you don t know is the number of things that you don t know Malcolm Sambridge Research School of Earth Sciences, Australian National University Canberra, Australia. Sambridge. M.,
More informationF denotes cumulative density. denotes probability density function; (.)
BAYESIAN ANALYSIS: FOREWORDS Notation. System means the real thing and a model is an assumed mathematical form for the system.. he probability model class M contains the set of the all admissible models
More informationDoing Bayesian Integrals
ASTR509-13 Doing Bayesian Integrals The Reverend Thomas Bayes (c.1702 1761) Philosopher, theologian, mathematician Presbyterian (non-conformist) minister Tunbridge Wells, UK Elected FRS, perhaps due to
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is
More informationApplication of new Monte Carlo method for inversion of prestack seismic data. Yang Xue Advisor: Dr. Mrinal K. Sen
Application of new Monte Carlo method for inversion of prestack seismic data Yang Xue Advisor: Dr. Mrinal K. Sen Overview Motivation Introduction Bayes theorem Stochastic inference methods Methodology
More informationSimultaneous Multi-frame MAP Super-Resolution Video Enhancement using Spatio-temporal Priors
Simultaneous Multi-frame MAP Super-Resolution Video Enhancement using Spatio-temporal Priors Sean Borman and Robert L. Stevenson Department of Electrical Engineering, University of Notre Dame Notre Dame,
More informationA new Hierarchical Bayes approach to ensemble-variational data assimilation
A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander
More informationDRAGON ADVANCED TRAINING COURSE IN ATMOSPHERE REMOTE SENSING. Inversion basics. Erkki Kyrölä Finnish Meteorological Institute
Inversion basics y = Kx + ε x ˆ = (K T K) 1 K T y Erkki Kyrölä Finnish Meteorological Institute Day 3 Lecture 1 Retrieval techniques - Erkki Kyrölä 1 Contents 1. Introduction: Measurements, models, inversion
More informationAn introduction to Bayesian statistics and model calibration and a host of related topics
An introduction to Bayesian statistics and model calibration and a host of related topics Derek Bingham Statistics and Actuarial Science Simon Fraser University Cast of thousands have participated in the
More informationParameter Estimation in the Spatio-Temporal Mixed Effects Model Analysis of Massive Spatio-Temporal Data Sets
Parameter Estimation in the Spatio-Temporal Mixed Effects Model Analysis of Massive Spatio-Temporal Data Sets Matthias Katzfuß Advisor: Dr. Noel Cressie Department of Statistics The Ohio State University
More informationParameter estimation by implicit sampling
Parameter estimation by implicit sampling Matthias Morzfeld 1,2,, Xuemin Tu 3, Jon Wilkening 1,2 and Alexandre J. Chorin 1,2 1 Department of Mathematics, University of California, Berkeley, CA 94720, USA.
More informationLearning the hyper-parameters. Luca Martino
Learning the hyper-parameters Luca Martino 2017 2017 1 / 28 Parameters and hyper-parameters 1. All the described methods depend on some choice of hyper-parameters... 2. For instance, do you recall λ (bandwidth
More informationBayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems
Bayesian Methods and Uncertainty Quantification for Nonlinear Inverse Problems John Bardsley, University of Montana Collaborators: H. Haario, J. Kaipio, M. Laine, Y. Marzouk, A. Seppänen, A. Solonen, Z.
More informationFundamentals of Data Assimilation
National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)
More informationHierarchical Nearest-Neighbor Gaussian Process Models for Large Geo-statistical Datasets
Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geo-statistical Datasets Abhirup Datta 1 Sudipto Banerjee 1 Andrew O. Finley 2 Alan E. Gelfand 3 1 University of Minnesota, Minneapolis,
More informationSLIM. University of British Columbia
Accelerating an Iterative Helmholtz Solver Using Reconfigurable Hardware Art Petrenko M.Sc. Defence, April 9, 2014 Seismic Laboratory for Imaging and Modelling Department of Earth, Ocean and Atmospheric
More informationc 2016 Society for Industrial and Applied Mathematics
SIAM J. SCI. COMPUT. Vol. 8, No. 5, pp. A779 A85 c 6 Society for Industrial and Applied Mathematics ACCELERATING MARKOV CHAIN MONTE CARLO WITH ACTIVE SUBSPACES PAUL G. CONSTANTINE, CARSON KENT, AND TAN
More informationHierarchical sparse Bayesian learning for structural health monitoring. with incomplete modal data
Hierarchical sparse Bayesian learning for structural health monitoring with incomplete modal data Yong Huang and James L. Beck* Division of Engineering and Applied Science, California Institute of Technology,
More informationState Space and Hidden Markov Models
State Space and Hidden Markov Models Kunsch H.R. State Space and Hidden Markov Models. ETH- Zurich Zurich; Aliaksandr Hubin Oslo 2014 Contents 1. Introduction 2. Markov Chains 3. Hidden Markov and State
More informationIntroduction to Machine Learning CMU-10701
Introduction to Machine Learning CMU-10701 Markov Chain Monte Carlo Methods Barnabás Póczos & Aarti Singh Contents Markov Chain Monte Carlo Methods Goal & Motivation Sampling Rejection Importance Markov
More informationBayesian Nonparametric Regression for Diabetes Deaths
Bayesian Nonparametric Regression for Diabetes Deaths Brian M. Hartman PhD Student, 2010 Texas A&M University College Station, TX, USA David B. Dahl Assistant Professor Texas A&M University College Station,
More informationData assimilation in high dimensions
Data assimilation in high dimensions David Kelly Courant Institute New York University New York NY www.dtbkelly.com February 12, 2015 Graduate seminar, CIMS David Kelly (CIMS) Data assimilation February
More informationMarkov Chain Monte Carlo
1 Motivation 1.1 Bayesian Learning Markov Chain Monte Carlo Yale Chang In Bayesian learning, given data X, we make assumptions on the generative process of X by introducing hidden variables Z: p(z): prior
More informationProbing the covariance matrix
Probing the covariance matrix Kenneth M. Hanson Los Alamos National Laboratory (ret.) BIE Users Group Meeting, September 24, 2013 This presentation available at http://kmh-lanl.hansonhub.com/ LA-UR-06-5241
More informationFrequentist-Bayesian Model Comparisons: A Simple Example
Frequentist-Bayesian Model Comparisons: A Simple Example Consider data that consist of a signal y with additive noise: Data vector (N elements): D = y + n The additive noise n has zero mean and diagonal
More informationThe Inversion Problem: solving parameters inversion and assimilation problems
The Inversion Problem: solving parameters inversion and assimilation problems UE Numerical Methods Workshop Romain Brossier romain.brossier@univ-grenoble-alpes.fr ISTerre, Univ. Grenoble Alpes Master 08/09/2016
More informationwissen leben WWU Münster
MÜNSTER Sparsity Constraints in Bayesian Inversion Inverse Days conference in Jyväskylä, Finland. Felix Lucka 19.12.2012 MÜNSTER 2 /41 Sparsity Constraints in Inverse Problems Current trend in high dimensional
More informationSeminar: Data Assimilation
Seminar: Data Assimilation Jonas Latz, Elisabeth Ullmann Chair of Numerical Mathematics (M2) Technical University of Munich Jonas Latz, Elisabeth Ullmann (TUM) Data Assimilation 1 / 28 Prerequisites Bachelor:
More informationBayesian Gaussian Process Regression
Bayesian Gaussian Process Regression STAT8810, Fall 2017 M.T. Pratola October 7, 2017 Today Bayesian Gaussian Process Regression Bayesian GP Regression Recall we had observations from our expensive simulator,
More informationIJMGE Int. J. Min. & Geo-Eng. Vol.49, No.1, June 2015, pp
IJMGE Int. J. Min. & Geo-Eng. Vol.49, No.1, June 2015, pp.131-142 Joint Bayesian Stochastic Inversion of Well Logs and Seismic Data for Volumetric Uncertainty Analysis Moslem Moradi 1, Omid Asghari 1,
More informationCourse on Inverse Problems
Stanford University School of Earth Sciences Course on Inverse Problems Albert Tarantola Third Lesson: Probability (Elementary Notions) Let u and v be two Cartesian parameters (then, volumetric probabilities
More informationParameter estimation: A new approach to weighting a priori information
c de Gruyter 27 J. Inv. Ill-Posed Problems 5 (27), 2 DOI.55 / JIP.27.xxx Parameter estimation: A new approach to weighting a priori information J.L. Mead Communicated by Abstract. We propose a new approach
More informationIntroduction to Bayesian methods in inverse problems
Introduction to Bayesian methods in inverse problems Ville Kolehmainen 1 1 Department of Applied Physics, University of Eastern Finland, Kuopio, Finland March 4 2013 Manchester, UK. Contents Introduction
More informationApproximate- vs. full-hessian in FWI: 1D analytical and numerical experiments
Approximate- vs. full-hessian in FWI: 1D analytical and numerical experiments Raul Cova and Kris Innanen ABSTRACT Feasibility of using Full Waveform Inversion (FWI) to build velocity models has been increasing
More informationOn an adaptive preconditioned Crank-Nicolson algorithm for infinite dimensional Bayesian inferences
Noname manuscript No. (will be inserted by the editor) On an adaptive preconditioned Crank-Nicolson algorithm for infinite dimensional Bayesian inferences Zixi Hu Zhewei Yao Jinglai Li Received: date /
More informationCompressive sampling meets seismic imaging
Compressive sampling meets seismic imaging Felix J. Herrmann fherrmann@eos.ubc.ca http://slim.eos.ubc.ca joint work with Tim Lin and Yogi Erlangga Seismic Laboratory for Imaging & Modeling Department of
More informationIntroduction to Machine Learning
Introduction to Machine Learning Brown University CSCI 1950-F, Spring 2012 Prof. Erik Sudderth Lecture 25: Markov Chain Monte Carlo (MCMC) Course Review and Advanced Topics Many figures courtesy Kevin
More informationSequential Monte Carlo Samplers for Applications in High Dimensions
Sequential Monte Carlo Samplers for Applications in High Dimensions Alexandros Beskos National University of Singapore KAUST, 26th February 2014 Joint work with: Dan Crisan, Ajay Jasra, Nik Kantas, Alex
More informationBayesian parameter estimation in predictive engineering
Bayesian parameter estimation in predictive engineering Damon McDougall Institute for Computational Engineering and Sciences, UT Austin 14th August 2014 1/27 Motivation Understand physical phenomena Observations
More informationApproximate Bayesian Computation: a simulation based approach to inference
Approximate Bayesian Computation: a simulation based approach to inference Richard Wilkinson Simon Tavaré 2 Department of Probability and Statistics University of Sheffield 2 Department of Applied Mathematics
More informationAdaptive Posterior Approximation within MCMC
Adaptive Posterior Approximation within MCMC Tiangang Cui (MIT) Colin Fox (University of Otago) Mike O Sullivan (University of Auckland) Youssef Marzouk (MIT) Karen Willcox (MIT) 06/January/2012 C, F,
More informationAssessing the solution quality of the earthquake location problem
Semesterarbeit HS 2008 Department of Earth Sciences ETH Zurich Assessing the solution quality of the earthquake location problem Sabrina Schönholzer Supervisor: Technical Supervisor: Prof. Dr. E. Kissling
More informationBayesian Inverse problem, Data assimilation and Localization
Bayesian Inverse problem, Data assimilation and Localization Xin T Tong National University of Singapore ICIP, Singapore 2018 X.Tong Localization 1 / 37 Content What is Bayesian inverse problem? What is
More informationSub-kilometer-scale space-time stochastic rainfall simulation
Picture: Huw Alexander Ogilvie Sub-kilometer-scale space-time stochastic rainfall simulation Lionel Benoit (University of Lausanne) Gregoire Mariethoz (University of Lausanne) Denis Allard (INRA Avignon)
More informationBayesian Inverse Problems
Bayesian Inverse Problems Jonas Latz Input/Output: www.latz.io Technical University of Munich Department of Mathematics, Chair for Numerical Analysis Email: jonas.latz@tum.de Garching, July 10 2018 Guest
More informationMethods of Data Assimilation and Comparisons for Lagrangian Data
Methods of Data Assimilation and Comparisons for Lagrangian Data Chris Jones, Warwick and UNC-CH Kayo Ide, UCLA Andrew Stuart, Jochen Voss, Warwick Guillaume Vernieres, UNC-CH Amarjit Budiraja, UNC-CH
More informationMAT Inverse Problems, Part 2: Statistical Inversion
MAT-62006 Inverse Problems, Part 2: Statistical Inversion S. Pursiainen Department of Mathematics, Tampere University of Technology Spring 2015 Overview The statistical inversion approach is based on the
More informationBayesian Estimation of DSGE Models
Bayesian Estimation of DSGE Models Stéphane Adjemian Université du Maine, GAINS & CEPREMAP stephane.adjemian@univ-lemans.fr http://www.dynare.org/stepan June 28, 2011 June 28, 2011 Université du Maine,
More informationLow-rank Promoting Transformations and Tensor Interpolation - Applications to Seismic Data Denoising
Low-rank Promoting Transformations and Tensor Interpolation - Applications to Seismic Data Denoising Curt Da Silva and Felix J. Herrmann 2 Dept. of Mathematics 2 Dept. of Earth and Ocean Sciences, University
More informationCompressive Sensing Applied to Full-wave Form Inversion
Compressive Sensing Applied to Full-wave Form Inversion Felix J. Herrmann* fherrmann@eos.ubc.ca Joint work with Yogi Erlangga, and Tim Lin *Seismic Laboratory for Imaging & Modeling Department of Earth
More informationNon-linear least-squares inversion with data-driven
Geophys. J. Int. (2000) 142, 000 000 Non-linear least-squares inversion with data-driven Bayesian regularization Tor Erik Rabben and Bjørn Ursin Department of Petroleum Engineering and Applied Geophysics,
More informationSUMMARY REVIEW OF THE FREQUENCY DOMAIN L2 FWI-HESSIAN
Efficient stochastic Hessian estimation for full waveform inversion Lucas A. Willemsen, Alison E. Malcolm and Russell J. Hewett, Massachusetts Institute of Technology SUMMARY In this abstract we present
More informationBayesian Calibration of Simulators with Structured Discretization Uncertainty
Bayesian Calibration of Simulators with Structured Discretization Uncertainty Oksana A. Chkrebtii Department of Statistics, The Ohio State University Joint work with Matthew T. Pratola (Statistics, The
More informationRandomize-Then-Optimize for Sampling and Uncertainty Quantification in Electrical Impedance Tomography
SIAM/ASA J. UNCERTAINTY QUANTIFICATION Vol. 3, pp. 1136 1158 c 2015 Society for Industrial and Applied Mathematics and American Statistical Association Randomize-Then-Optimize for Sampling and Uncertainty
More information