Data assimilation Schrödinger s perspective
|
|
- Leslie Charles
- 5 years ago
- Views:
Transcription
1 Data assimilation Schrödinger s perspective Sebastian Reich ( Universität Potsdam/ University of Reading IMS NUS, August 3, 218 Universität Potsdam/ University of Reading 1
2 Core components of DA Mean Field Equations Interacting Particle Systems Coupling of Measures Universität Potsdam/ University of Reading 2
3 Entropic couplings Universität Potsdam/ University of Reading 3
4 Ensemble prediction I Ensemble prediction system with M members: d dt Zi t = f (Zi t ), Zi π, i = 1,..., M. Source: ECMWF Universität Potsdam/ University of Reading 4
5 Ensemble prediction II Source: The quiet revolution of numerical weather prediction, Nature, 215 Universität Potsdam/ University of Reading 5
6 Ensemble based data assimilation Continuous in time assimilation of precipitation data y t : d dt Zi t = f (Zi t ) + α 1Q t (Z i t Z t) + α 2 K t (y t h(z i t )) Additional terms: Inflation: α 1 >, Q t R N z N z spd, Z t = 1 M i Z i t Nudging: α 2 >, gain matrix K t R N z N y, forward operator h. Universität Potsdam/ University of Reading 6
7 SDEs & inflation I Forward SDE X + π, t [, T], W + t dz + t = f t (Z + t )dt + γ1/2 dw + t, standard Brownian motion forward in time. Generates probability measure P [,T] over C([, T], R N z) with marginal densities π t, i.e. Z t π t. The same measure is generated by backward SDE dz t = b t (Z t )dt + γ1/2 dw t, W t Brownian motion backward in time, X T π T. It holds that b t (z) = f t (z) γ z log π t (z). Universität Potsdam/ University of Reading 7
8 SDEs & inflation II Fokker-Planck equation for marginals: t π t = z (π t f t ) + γ 2 zπ t = z (π t b t ) γ 2 zπ t = z (π t u t ) with u t (z) = 1 2 (f t(z) + b t (z)) = f t (z) γ 2 z log π t (z). Replace forward SDE by mean field equation d dt Z t = f t (Z t ) γ 2 z log π t (Z t ), Z π. Remark. Generates path measure Q [,T] which is different from SDE measure P [,T] ; only marginals π t agree! Universität Potsdam/ University of Reading 8
9 SDEs & inflation III Lagrangian interacting particles (Gaussian approximation to π t ): d dt Zi t = f t(z i t ) + γ 2 (P t) 1 (Z i t Z t), Z i π, i = 1,..., M, empirical covariance matrix Connection to inflation: P t = 1 M 1 (Z i t Z t)(z i t Z t) T. i Q t = (P t ) 1, α 1 = γ/2. Universität Potsdam/ University of Reading 9
10 References Daley, R., Atmospheric Data Analysis, Cambridge University Press, Nelson, E., Dynamical Theories of Brownian Motion, Princeton University Press, del Moral, P., Mean field simulation for Monte Carlo integration, CRC Press, 213. SR, Cotter, J., Probabilistic Forecasting and Bayesian Data Assimilation, Cambridge University Press, 215. Law, K. et al., Data Assimilation A Mathematical Introduction, Springer, 215. Qiang Liu, Stein Variational Gradient Descent as Gradient Flow, arxiv: v2, 217. Universität Potsdam/ University of Reading 1
11 Recap: Assimilation of precipitation data Continuous in time assimilation of precipitation data y t : d dt Zi t = f (Zi t ) + α 1Q t (Z i t Z t) + α 2 K t (y t h(z i t )) Inflation: α 1 >, Q t R N z N z spd, Z t = 1 M i Z i t Nudging: α 2 >, gain matrix K t R N z N y, forward operator h. Universität Potsdam/ University of Reading 11
12 SDEs & nudging I Given a likelihood function T L(z [,T] ) := exp V t (z t )dt. For example V t (z) = β 2 h(z) y t 2. Bayes theorem (Radon Nikodym): d P [,T] dp [,T] (z [,T] ) := L(z [,T]) P [,T] [L]. The measure P [,T] solves the filtering/smoothing problem of SDE inference. Universität Potsdam/ University of Reading 12
13 SDEs & nudging II Mean field formulation: d Z t = f t ( Z t ) + P t z ψ t ( Z t ) dt + γdw t with the potential ψ t satisfying the elliptic PDE z ( π t P t z ψ t ) = π t (V t V t ) Z π = π, V t = π t [V t ], P t = cov ( Z t ). Universität Potsdam/ University of Reading 13
14 SDEs & nudging III If π t Gaussian and h(z) = Hz in V t, then P t z ψ t (z) = βp t H T y t Hz + HZ t. 2 Compare to nudging scheme: α 2 K t (y t Hz), i.e., K t = P t H T, β = α 2, but innovation different. Universität Potsdam/ University of Reading 14
15 Combining nudging and inflation Ensemble Kalman Bucy filter (Gaussian approximation to π t ): d dt Zi t = f t(z i t ) + γ 2 (P t) 1 (Z i t Z t) + βk t y t h(zi t ) + h t 2 Z i π, i = 1,..., M, empirical covariance matrices P t = 1 M 1 K t = 1 M 1 (Z i t Z t)(z i t Z t) T, i (Z i t Z t)(h(z i t ) h t) T. Remark. Feedback particle filter for likelihood with i V t (z)dt 1 2 h(z) 2 dt h(z) T dy t. Universität Potsdam/ University of Reading 15
16 References Moser, J., On the volume elements on a manifold, Trans. Amer. Math. Soc., SR, A dynamical systems framework for intermittent data assimilation, BIT, 21. Daum, F., Huang, J., Particle filter for nonlinear filters, ICASSP, IEEE, 211. Bergemann, K, SR, An ensemble Kalman Bucy filter for continuous time data assimilation, Meteorolog. Zeitschrift, 212. Yang, T. et al., Feedback particle filter, IEEE Trans. Autom. Control, 213. Taghvaei, A. et al., Kalman filter and its modern extensions for the continuous time nonlinear filtering problem, J. Dyn. Sys., Meas., and Control, 218. de Wiljes, et al., Long time stability and accuracy of the ensemble Kalman Bucy filter for fully observed processes and small measurement noise, SIAM J. Appl. Dyn. Sys., 218. Universität Potsdam/ University of Reading 16
17 Discrete time observations I State Model State Model State Assimilation Assimilation Assimilation Data Data Data time Universität Potsdam/ University of Reading 17
18 Discrete time observations II Discrete time observations: y tn = h(z tn ) + R 1/2 Ξ tn, n = 1,..., N. Likelihood function: L(z [,T] ) := exp 1 (y tn h(z tn )) T R 1 (y tn h(z tn )). 2 n Bayes: dp + [,T] (Z + L(Z [,T] dp ) := [,T] ) [,T] P [,T] [L]. Universität Potsdam/ University of Reading 18
19 Discrete time observations III For simplicity: single observation, i.e. N = 1, R = I, t 1 = T, L(z) = 1 2 y T h(z) 2. But keep recursive nature of sequential DA in mind! Four main players: last analysis: π forecast based on last analysis: π T new analysis at time t = T (Bayes, filtering distribution): π T smoothing distribution at t = : π Universität Potsdam/ University of Reading 19
20 Discrete time observations IV Prediction 1 Smoothing Schrödinger Filtering b Optimal Control b 1 Data y 1 t = t =1 Time Universität Potsdam/ University of Reading 2
21 Example: Gaussian mixture I π 1 is a Gaussian mixture, Gaussian likelihood, π 1 weighted Gaussian mixture..1 prior.5 prediction space smoothing space filtering space space Universität Potsdam/ University of Reading 21
22 Example: Gaussian mixture II 2.5 optimal control proposals 2.5 Schroedinger proposal space space Applied to smoothing PDF π. Applied to π directly! Universität Potsdam/ University of Reading 22
23 Example: Brownian dynamics Scalar Brownian dynamics under a double well potential (γ =.5): last analysis forecast 1 initial mean observation potential smoother new analysis variable z The forecast and the new analysis at T =.5 are nearly singular with respect to each other. The relation between the last analysis (π ) and the smoother ( π ) is somewhat better. Universität Potsdam/ University of Reading 23
24 Discrete time observations III Forward-backward smoother iteration: Forward: Z + π. Yields π t. Backward: dz + t = f (Z + t )dt + γw + t, d Z t with Z T π T and Yields π t. = f ( Z t )dt γ z log π t ( Z t )dt + γw t, π T (z) L(z)π T (z). Smoother: d Z + t Z + π, Z + T π T. = f ( Z + t )dt + γ z log π t π t ( Z + t )dt + γw + t Universität Potsdam/ University of Reading 24
25 Example: Brownian dynamics II Scalar Brownian dynamics under a double well potential (γ =.5): last analysis forecast 1 initial mean observation potential smoother new analysis variable z The forward smoother SDE links the smoother measure π with π T. Still requires transforming π into π (but now at t = ). Universität Potsdam/ University of Reading 25
26 Schrödinger problem of DA I A different perspective on sequential DA: Schrödinger problem. Find the measure P [,T] which minimises the Kullback-Leibler divergence last analysis forecast P [,T] = arg inf Q P KL(Q [,T] P [,T] ) subject to the constraints π = q = π, π T = q T = π T smoother new analysis -5 5 The measure P [,T] is generated by a controlled SDE d Z + t = f ( Z + t )dt + u t( Z + t )dt + γdw + t. Universität Potsdam/ University of Reading 26
27 Schrödinger problem of DA II Find an initial distribution ϕ + and its evolution ϕ+ t under the forward SDE dz + t = f (Z + t ) dt + γdw + t such that the associated backward SDE dz = f (Z t t ) γ z log ϕ + t (Z t ) dt + γdw t with final condition ϕ T := π T leads to marginals ϕ t such that Then the control solves the Schrödinger problem. ϕ = π. u t = γ z log ϕ t ϕ + t Universität Potsdam/ University of Reading 27
28 Example I: Lorenz 63 Starting point: (i) Euler-Maruyama discretization Z n+1 = Z n + f (Z n ) t + (γ t) 1/2 Ξ n giving rise to transition kernel q + (z n+1 z n ). (ii) Given M samples z j n from Z n and M samples z i n+1 from Z n+1 define the M M matrix Q by q ij = q + (z i n+1 zj n ). (iii) Observations at time t n+1 lead to importance weights w i n+1. Universität Potsdam/ University of Reading 28
29 Example II: Lorenz 63 Schrödinger problem: subject to M P = arg min KL(P Q), KL(P Q) := p ij log p ij, P Π q i,j=1 ij Π = Application to DA P R M M : p ij, M p ij = 1/M, i=1 M p ij = w i j=1 a) Schrödinger resample: Use P to sample from π n+1 P[ Z j n+1 ] = zi n+1 ] = Mp ij. b) Schrödinger transform: Set M z j n+1 = M z i n+1 p ij i=1 + (γ t)ξ j. Universität Potsdam/ University of Reading 29
30 Example III: Lorenz RMS errors as a function M RMSE 1-3 particle filter Schrodinger transform Schrodinger resample EnKBF /M Stochastic Lorenz 63, observations at every time step, observation error scaled with inverse time step. Universität Potsdam/ University of Reading 3
31 References Schrödinger, E., Über die Umkehrung der Naturgesetze, Sitzungsberichte der Preuss. Phys. Math. Klasse, Yongxin Chen et al., On the relation between optimal transport and Schrödinger bridges: A stochastic control viewpoint, J. Optim. Theory and Appl., 216. Fearnhead, P., Künsch, H.R., Particle filters and data assimilation, Annual Review of Statistics and Its Application, 218. Guarniero et al., The iterated auxiliary particle filter, J. American Statist. Assoc., 217. van Leeuwen, P.-J., Nonlinear data assimilation, Frontiers in Applied Dynamical Systems, Vol. 2, 215. Peyre, G., Cuturi, M., Computational Optimal Transport, arxiv: , 218. SR, Data assimilation, Acta Numerica, 219, preliminary version on arxiv Universität Potsdam/ University of Reading 31
32 OT meets IS I Importance sampling (IS): Available realisations Z i T π T with importance weights w i π T π T (Z i T ). Optimal transport (OT): Instead of resampling, find coupling/transformation Z T = z ψ(z T ), Z T π T and Z π T. More abstractly, Z T (a) = Z T (a )δ(a a ψ(a))da, where A is some random reference variable. For example, A = Z T. Universität Potsdam/ University of Reading 32
33 OT meets IS II Replace the integral by a sum and formally write M Z j T = Z i T d ij i=1 Requires M 1 d ij = 1, d ij = w i. M i=1 j Select an "optimal" transformation through maximising correlation V(D) = 1 d ij Z i M T Zj T = 1 Z j T M Zj T. ij j In addition, either d ij (Ensemble Transform Particle Filter) or 1 M ( Z i M 1 T z T )( Z i T z M T ) T = w i (Z i T z T )(Z i T z T ) T i=1 i=1 (Nonlinear Ensemble Transform Filter). Universität Potsdam/ University of Reading 33
34 Numerical example I Lorenz-63 model, first component observed infrequently ( t =.12) and with large measurement noise (R = 8): Figure: RMSEs for various second-order accurate LETFs compared to the ETPF, the ESRF, and the SIR PF as a function of the sample size, M. Universität Potsdam/ University of Reading 34
35 Numerical example II Hybrid filter: P := P ESRF (α) P ETPF (1 α). Figure: RMSEs for hybrid ESRF (α = ) and 2nd-order corrected NETF/ETPF (α = 1) as a function of the sample size, M. Universität Potsdam/ University of Reading 35
36 References Evensen, G., Data assimilation the ensemble Kalman filter, Springer, 29. SR, A nonparametric ensemble transform method for Bayesian inference, SIAM J. Sci. Comput., 213. SR, Cotter, J., Probabilistic Forecasting and Bayesian Data Assimilation, Cambridge University Press, 215. Tödter J., Ahrens, B., A second order exact ensemble square root filter for nonlinear data assimilation, Month. Weather Rev., 215. Chustagulprom, N. et al., A hybrid ensemble transform particle filter for nonlinear and spatially extended systems, SIAM/ASA J. UQ, 216. Acevedo, W., et al., Second order accurate ensemble transform particle filters, SIAM J. Sci. Comput., 217. Fearnhead, P., Künsch, H.R., Particle filters and data assimilation, Annual Review of Statistics and Its Application, 218. Universität Potsdam/ University of Reading 36
37 Summary Continuous in time DA naturally leads to various interacting particle systems. Schrödinger problem provides an "optimal" mathematical framework for sequential DA with discrete in time observations. Numerical implementation nontrivial; good drift corrections can be derived using Gaussian approximations or kernel methods. Coupling arguments are central to derivation of interacting particle systems. Relevant to rare event simulations, optimal control problems and derivative free optimization. Universität Potsdam/ University of Reading 37
38 The End (source: J.B. Handelsman, New Yorker, 5/31/1969) Universität Potsdam/ University of Reading 38
39 Collaborators Walter Acevedo Kay Bergemann Yuan Cheng Nawinda Chustagulprom Colin Cotter Jana de Wiljes Prashant Mehta Wilhelm Stannat Amari Taghvaei Universität Potsdam/ University of Reading 39
Data assimilation as an optimal control problem and applications to UQ
Data assimilation as an optimal control problem and applications to UQ Walter Acevedo, Angwenyi David, Jana de Wiljes & Sebastian Reich Universität Potsdam/ University of Reading IPAM, November 13th 2017
More informationEnKF-based particle filters
EnKF-based particle filters Jana de Wiljes, Sebastian Reich, Wilhelm Stannat, Walter Acevedo June 20, 2017 Filtering Problem Signal dx t = f (X t )dt + 2CdW t Observations dy t = h(x t )dt + R 1/2 dv t.
More informationarxiv: v2 [math.na] 22 Sep 2016
Second-order accurate ensemble transform particle filters Jana de Wiljes Walter Acevedo Sebastian Reich September 3, 1 arxiv:1.179v [math.na] Sep 1 Abstract Particle filters (also called sequential Monte
More informationGaussian Process Approximations of Stochastic Differential Equations
Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Centre for Computational Statistics and Machine Learning University College London c.archambeau@cs.ucl.ac.uk CSML
More informationA nonparametric ensemble transform method for Bayesian inference
A nonparametric ensemble transform method for Bayesian inference Article Published Version Reich, S. (2013) A nonparametric ensemble transform method for Bayesian inference. SIAM Journal on Scientific
More informationLagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC
Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background
More informationFundamentals of Data Assimilation
National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)
More informationSmoothers: Types and Benchmarks
Smoothers: Types and Benchmarks Patrick N. Raanes Oxford University, NERSC 8th International EnKF Workshop May 27, 2013 Chris Farmer, Irene Moroz Laurent Bertino NERSC Geir Evensen Abstract Talk builds
More informationStochastic Collocation Methods for Polynomial Chaos: Analysis and Applications
Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535
More informationA Note on the Particle Filter with Posterior Gaussian Resampling
Tellus (6), 8A, 46 46 Copyright C Blackwell Munksgaard, 6 Printed in Singapore. All rights reserved TELLUS A Note on the Particle Filter with Posterior Gaussian Resampling By X. XIONG 1,I.M.NAVON 1,2 and
More informationGaussian Process Approximations of Stochastic Differential Equations
Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run
More informationLecture 6: Bayesian Inference in SDE Models
Lecture 6: Bayesian Inference in SDE Models Bayesian Filtering and Smoothing Point of View Simo Särkkä Aalto University Simo Särkkä (Aalto) Lecture 6: Bayesian Inference in SDEs 1 / 45 Contents 1 SDEs
More informationConvergence of the Ensemble Kalman Filter in Hilbert Space
Convergence of the Ensemble Kalman Filter in Hilbert Space Jan Mandel Center for Computational Mathematics Department of Mathematical and Statistical Sciences University of Colorado Denver Parts based
More informationLecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations
Lecture 6: Multiple Model Filtering, Particle Filtering and Other Approximations Department of Biomedical Engineering and Computational Science Aalto University April 28, 2010 Contents 1 Multiple Model
More informationState Space Models for Wind Forecast Correction
for Wind Forecast Correction Valérie 1 Pierre Ailliot 2 Anne Cuzol 1 1 Université de Bretagne Sud 2 Université de Brest MAS - 2008/28/08 Outline 1 2 Linear Model : an adaptive bias correction Non Linear
More informationLagrangian Data Assimilation and Its Application to Geophysical Fluid Flows
Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Laura Slivinski June, 3 Laura Slivinski (Brown University) Lagrangian Data Assimilation June, 3 / 3 Data Assimilation Setup:
More informationA variational radial basis function approximation for diffusion processes
A variational radial basis function approximation for diffusion processes Michail D. Vrettas, Dan Cornford and Yuan Shen Aston University - Neural Computing Research Group Aston Triangle, Birmingham B4
More informationState and Parameter Estimation in Stochastic Dynamical Models
State and Parameter Estimation in Stochastic Dynamical Models Timothy DelSole George Mason University, Fairfax, Va and Center for Ocean-Land-Atmosphere Studies, Calverton, MD June 21, 2011 1 1 collaboration
More informationA State Space Model for Wind Forecast Correction
A State Space Model for Wind Forecast Correction Valrie Monbe, Pierre Ailliot 2, and Anne Cuzol 1 1 Lab-STICC, Université Européenne de Bretagne, France (e-mail: valerie.monbet@univ-ubs.fr, anne.cuzol@univ-ubs.fr)
More informationErgodicity in data assimilation methods
Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation
More informationAn introduction to data assimilation. Eric Blayo University of Grenoble and INRIA
An introduction to data assimilation Eric Blayo University of Grenoble and INRIA Data assimilation, the science of compromises Context characterizing a (complex) system and/or forecasting its evolution,
More informationThe Ensemble Kalman Filter:
p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen 23, Ocean Dynamics, Vol 53, No 4 p.2 The Ensemble
More informationEVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER
EVALUATING SYMMETRIC INFORMATION GAP BETWEEN DYNAMICAL SYSTEMS USING PARTICLE FILTER Zhen Zhen 1, Jun Young Lee 2, and Abdus Saboor 3 1 Mingde College, Guizhou University, China zhenz2000@21cn.com 2 Department
More informationA variance limiting Kalman filter for data assimilation: I. Sparse observational grids II. Model error
A variance limiting Kalman filter for data assimilation: I. Sparse observational grids II. Model error Georg Gottwald, Lewis Mitchell, Sebastian Reich* University of Sydney, *Universität Potsdam Durham,
More informationHidden Markov Models for precipitation
Hidden Markov Models for precipitation Pierre Ailliot Université de Brest Joint work with Peter Thomson Statistics Research Associates (NZ) Page 1 Context Part of the project Climate-related risks for
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing
More informationData assimilation in high dimensions
Data assimilation in high dimensions David Kelly Courant Institute New York University New York NY www.dtbkelly.com February 12, 2015 Graduate seminar, CIMS David Kelly (CIMS) Data assimilation February
More informationHuman Pose Tracking I: Basics. David Fleet University of Toronto
Human Pose Tracking I: Basics David Fleet University of Toronto CIFAR Summer School, 2009 Looking at People Challenges: Complex pose / motion People have many degrees of freedom, comprising an articulated
More informationVariational inference
Simon Leglaive Télécom ParisTech, CNRS LTCI, Université Paris Saclay November 18, 2016, Télécom ParisTech, Paris, France. Outline Introduction Probabilistic model Problem Log-likelihood decomposition EM
More informationRelative Merits of 4D-Var and Ensemble Kalman Filter
Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29
More informationParticle Filters in High Dimensions
Particle Filters in High Dimensions Dan Crisan Imperial College London Bayesian Computation for High-Dimensional Statistical Models Opening Workshop 27-31 August 2018 Dan Crisan (Imperial College London)
More informationGaussian processes for inference in stochastic differential equations
Gaussian processes for inference in stochastic differential equations Manfred Opper, AI group, TU Berlin November 6, 2017 Manfred Opper, AI group, TU Berlin (TU Berlin) inference in SDE November 6, 2017
More informationEnsemble Kalman Filter
Ensemble Kalman Filter Geir Evensen and Laurent Bertino Hydro Research Centre, Bergen, Norway, Nansen Environmental and Remote Sensing Center, Bergen, Norway The Ensemble Kalman Filter (EnKF) Represents
More informationPATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Contents in latter part Linear Dynamical Systems What is different from HMM? Kalman filter Its strength and limitation Particle Filter
More informationSeminar: Data Assimilation
Seminar: Data Assimilation Jonas Latz, Elisabeth Ullmann Chair of Numerical Mathematics (M2) Technical University of Munich Jonas Latz, Elisabeth Ullmann (TUM) Data Assimilation 1 / 28 Prerequisites Bachelor:
More informationEnKF and Catastrophic filter divergence
EnKF and Catastrophic filter divergence David Kelly Kody Law Andrew Stuart Mathematics Department University of North Carolina Chapel Hill NC bkelly.com June 4, 2014 SIAM UQ 2014 Savannah. David Kelly
More informationFundamentals of Data Assimila1on
014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University
More informationData assimilation in high dimensions
Data assimilation in high dimensions David Kelly Kody Law Andy Majda Andrew Stuart Xin Tong Courant Institute New York University New York NY www.dtbkelly.com February 3, 2016 DPMMS, University of Cambridge
More informationSequential Monte Carlo Samplers for Applications in High Dimensions
Sequential Monte Carlo Samplers for Applications in High Dimensions Alexandros Beskos National University of Singapore KAUST, 26th February 2014 Joint work with: Dan Crisan, Ajay Jasra, Nik Kantas, Alex
More information(Extended) Kalman Filter
(Extended) Kalman Filter Brian Hunt 7 June 2013 Goals of Data Assimilation (DA) Estimate the state of a system based on both current and all past observations of the system, using a model for the system
More informationIntroduction to Particle Filters for Data Assimilation
Introduction to Particle Filters for Data Assimilation Mike Dowd Dept of Mathematics & Statistics (and Dept of Oceanography Dalhousie University, Halifax, Canada STATMOS Summer School in Data Assimila5on,
More informationCSC487/2503: Foundations of Computer Vision. Visual Tracking. David Fleet
CSC487/2503: Foundations of Computer Vision Visual Tracking David Fleet Introduction What is tracking? Major players: Dynamics (model of temporal variation of target parameters) Measurements (relation
More informationControlled sequential Monte Carlo
Controlled sequential Monte Carlo Jeremy Heng, Department of Statistics, Harvard University Joint work with Adrian Bishop (UTS, CSIRO), George Deligiannidis & Arnaud Doucet (Oxford) Bayesian Computation
More informationExpectation propagation for signal detection in flat-fading channels
Expectation propagation for signal detection in flat-fading channels Yuan Qi MIT Media Lab Cambridge, MA, 02139 USA yuanqi@media.mit.edu Thomas Minka CMU Statistics Department Pittsburgh, PA 15213 USA
More informationAuxiliary Particle Methods
Auxiliary Particle Methods Perspectives & Applications Adam M. Johansen 1 adam.johansen@bristol.ac.uk Oxford University Man Institute 29th May 2008 1 Collaborators include: Arnaud Doucet, Nick Whiteley
More informationWhat do we know about EnKF?
What do we know about EnKF? David Kelly Kody Law Andrew Stuart Andrew Majda Xin Tong Courant Institute New York University New York, NY April 10, 2015 CAOS seminar, Courant. David Kelly (NYU) EnKF April
More informationA new Hierarchical Bayes approach to ensemble-variational data assimilation
A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander
More informationIntroduction to Machine Learning
Introduction to Machine Learning Brown University CSCI 1950-F, Spring 2012 Prof. Erik Sudderth Lecture 25: Markov Chain Monte Carlo (MCMC) Course Review and Advanced Topics Many figures courtesy Kevin
More informationShort tutorial on data assimilation
Mitglied der Helmholtz-Gemeinschaft Short tutorial on data assimilation 23 June 2015 Wolfgang Kurtz & Harrie-Jan Hendricks Franssen Institute of Bio- and Geosciences IBG-3 (Agrosphere), Forschungszentrum
More informationEnKF and filter divergence
EnKF and filter divergence David Kelly Andrew Stuart Kody Law Courant Institute New York University New York, NY dtbkelly.com December 12, 2014 Applied and computational mathematics seminar, NIST. David
More informationLarge-scale Ordinal Collaborative Filtering
Large-scale Ordinal Collaborative Filtering Ulrich Paquet, Blaise Thomson, and Ole Winther Microsoft Research Cambridge, University of Cambridge, Technical University of Denmark ulripa@microsoft.com,brmt2@cam.ac.uk,owi@imm.dtu.dk
More informationWHITE NOISE APPROACH TO FEYNMAN INTEGRALS. Takeyuki Hida
J. Korean Math. Soc. 38 (21), No. 2, pp. 275 281 WHITE NOISE APPROACH TO FEYNMAN INTEGRALS Takeyuki Hida Abstract. The trajectory of a classical dynamics is detrmined by the least action principle. As
More informationPar$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading
Par$cle Filters Part I: Theory Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Reading July 2013 Why Data Assimila$on Predic$on Model improvement: - Parameter es$ma$on
More informationFeedback Particle Filter and its Application to Coupled Oscillators Presentation at University of Maryland, College Park, MD
Feedback Particle Filter and its Application to Coupled Oscillators Presentation at University of Maryland, College Park, MD Prashant Mehta Dept. of Mechanical Science and Engineering and the Coordinated
More informationPattern Recognition and Machine Learning
Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability
More informationLecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation
More informationImprecise Filtering for Spacecraft Navigation
Imprecise Filtering for Spacecraft Navigation Tathagata Basu Cristian Greco Thomas Krak Durham University Strathclyde University Ghent University Filtering for Spacecraft Navigation The General Problem
More informationStatistical Inference and Methods
Department of Mathematics Imperial College London d.stephens@imperial.ac.uk http://stats.ma.ic.ac.uk/ das01/ 31st January 2006 Part VI Session 6: Filtering and Time to Event Data Session 6: Filtering and
More informationNonparametric Drift Estimation for Stochastic Differential Equations
Nonparametric Drift Estimation for Stochastic Differential Equations Gareth Roberts 1 Department of Statistics University of Warwick Brazilian Bayesian meeting, March 2010 Joint work with O. Papaspiliopoulos,
More informationExpectation Propagation in Dynamical Systems
Expectation Propagation in Dynamical Systems Marc Peter Deisenroth Joint Work with Shakir Mohamed (UBC) August 10, 2012 Marc Deisenroth (TU Darmstadt) EP in Dynamical Systems 1 Motivation Figure : Complex
More informationData assimilation in the geosciences An overview
Data assimilation in the geosciences An overview Alberto Carrassi 1, Olivier Talagrand 2, Marc Bocquet 3 (1) NERSC, Bergen, Norway (2) LMD, École Normale Supérieure, IPSL, France (3) CEREA, joint lab École
More informationFiltering the Navier-Stokes Equation
Filtering the Navier-Stokes Equation Andrew M Stuart1 1 Mathematics Institute and Centre for Scientific Computing University of Warwick Geometric Methods Brown, November 4th 11 Collaboration with C. Brett,
More informationRelationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF
Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi 4th EnKF Workshop, April 2010 Relationship
More informationECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering
ECE276A: Sensing & Estimation in Robotics Lecture 10: Gaussian Mixture and Particle Filtering Lecturer: Nikolay Atanasov: natanasov@ucsd.edu Teaching Assistants: Siwei Guo: s9guo@eng.ucsd.edu Anwesan Pal:
More information4. DATA ASSIMILATION FUNDAMENTALS
4. DATA ASSIMILATION FUNDAMENTALS... [the atmosphere] "is a chaotic system in which errors introduced into the system can grow with time... As a consequence, data assimilation is a struggle between chaotic
More informationAt A Glance. UQ16 Mobile App.
At A Glance UQ16 Mobile App Scan the QR code with any QR reader and download the TripBuilder EventMobile app to your iphone, ipad, itouch or Android mobile device. To access the app or the HTML 5 version,
More information(Exact and efficient) Simulation of Conditioned Markov Processes
(Exact and efficient) Simulation of Conditioned Markov Processes Omiros Papaspiliopoulos Universitat Pompeu Fabra, Barcelona http://www.econ.upf.edu/ omiros GrStoc α, ΛEYKA A 2009 Acknowledgement: K.Kalogeropoulos
More informationStochastic Spectral Approaches to Bayesian Inference
Stochastic Spectral Approaches to Bayesian Inference Prof. Nathan L. Gibson Department of Mathematics Applied Mathematics and Computation Seminar March 4, 2011 Prof. Gibson (OSU) Spectral Approaches to
More informationMarkov chain Monte Carlo methods for visual tracking
Markov chain Monte Carlo methods for visual tracking Ray Luo rluo@cory.eecs.berkeley.edu Department of Electrical Engineering and Computer Sciences University of California, Berkeley Berkeley, CA 94720
More information2D Image Processing (Extended) Kalman and particle filter
2D Image Processing (Extended) Kalman and particle filter Prof. Didier Stricker Dr. Gabriele Bleser Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz
More informationThe Kalman Filter ImPr Talk
The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman
More informationConvective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter
Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter Jon Poterjoy, Ryan Sobash, and Jeffrey Anderson National Center for Atmospheric Research
More informationarxiv: v1 [stat.me] 6 Nov 2013
Electronic Journal of Statistics Vol. 0 (0000) ISSN: 1935-7524 DOI: 10.1214/154957804100000000 A Generalized Savage-Dickey Ratio Ewan Cameron e-mail: dr.ewan.cameron@gmail.com url: astrostatistics.wordpress.com
More informationLecture 13 : Variational Inference: Mean Field Approximation
10-708: Probabilistic Graphical Models 10-708, Spring 2017 Lecture 13 : Variational Inference: Mean Field Approximation Lecturer: Willie Neiswanger Scribes: Xupeng Tong, Minxing Liu 1 Problem Setup 1.1
More informationFour-Dimensional Ensemble Kalman Filtering
Four-Dimensional Ensemble Kalman Filtering B.R. Hunt, E. Kalnay, E.J. Kostelich, E. Ott, D.J. Patil, T. Sauer, I. Szunyogh, J.A. Yorke, A.V. Zimin University of Maryland, College Park, MD 20742, USA Ensemble
More informationDATA ASSIMILATION FOR FLOOD FORECASTING
DATA ASSIMILATION FOR FLOOD FORECASTING Arnold Heemin Delft University of Technology 09/16/14 1 Data assimilation is the incorporation of measurement into a numerical model to improve the model results
More informationChapter 2 Assimilating data into scientific models: An optimal coupling perspective
Chapter 2 Assimilating data into scientific models: An optimal coupling perspective Yuan Cheng and Sebastian Reich Abstract Data assimilation is the task of combining mathematical models with observational
More informationNumerical Solutions of ODEs by Gaussian (Kalman) Filtering
Numerical Solutions of ODEs by Gaussian (Kalman) Filtering Hans Kersting joint work with Michael Schober, Philipp Hennig, Tim Sullivan and Han C. Lie SIAM CSE, Atlanta March 1, 2017 Emmy Noether Group
More informationBayesian Inverse problem, Data assimilation and Localization
Bayesian Inverse problem, Data assimilation and Localization Xin T Tong National University of Singapore ICIP, Singapore 2018 X.Tong Localization 1 / 37 Content What is Bayesian inverse problem? What is
More informationDer SPP 1167-PQP und die stochastische Wettervorhersage
Der SPP 1167-PQP und die stochastische Wettervorhersage Andreas Hense 9. November 2007 Overview The priority program SPP1167: mission and structure The stochastic weather forecasting Introduction, Probabilities
More informationA Spectral Approach to Linear Bayesian Updating
A Spectral Approach to Linear Bayesian Updating Oliver Pajonk 1,2, Bojana V. Rosic 1, Alexander Litvinenko 1, and Hermann G. Matthies 1 1 Institute of Scientific Computing, TU Braunschweig, Germany 2 SPT
More informationA Maximum Entropy Method for Particle Filtering
A Maximum Entropy Method for Particle Filtering Gregory L. Eyink and Sangil Kim Abstract Standard ensemble or particle filtering schemes do not properly represent states of low priori probability when
More informationLecture 7: Optimal Smoothing
Department of Biomedical Engineering and Computational Science Aalto University March 17, 2011 Contents 1 What is Optimal Smoothing? 2 Bayesian Optimal Smoothing Equations 3 Rauch-Tung-Striebel Smoother
More informationAdaptive ensemble Kalman filtering of nonlinear systems
Adaptive ensemble Kalman filtering of nonlinear systems Tyrus Berry George Mason University June 12, 213 : Problem Setup We consider a system of the form: x k+1 = f (x k ) + ω k+1 ω N (, Q) y k+1 = h(x
More informationA Note on Auxiliary Particle Filters
A Note on Auxiliary Particle Filters Adam M. Johansen a,, Arnaud Doucet b a Department of Mathematics, University of Bristol, UK b Departments of Statistics & Computer Science, University of British Columbia,
More informationBayesian Calibration of Simulators with Structured Discretization Uncertainty
Bayesian Calibration of Simulators with Structured Discretization Uncertainty Oksana A. Chkrebtii Department of Statistics, The Ohio State University Joint work with Matthew T. Pratola (Statistics, The
More informationStein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm
Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm Qiang Liu and Dilin Wang NIPS 2016 Discussion by Yunchen Pu March 17, 2017 March 17, 2017 1 / 8 Introduction Let x R d
More informationMaximum Likelihood Ensemble Filter Applied to Multisensor Systems
Maximum Likelihood Ensemble Filter Applied to Multisensor Systems Arif R. Albayrak a, Milija Zupanski b and Dusanka Zupanski c abc Colorado State University (CIRA), 137 Campus Delivery Fort Collins, CO
More informationSequential Monte Carlo Methods for Bayesian Computation
Sequential Monte Carlo Methods for Bayesian Computation A. Doucet Kyoto Sept. 2012 A. Doucet (MLSS Sept. 2012) Sept. 2012 1 / 136 Motivating Example 1: Generic Bayesian Model Let X be a vector parameter
More informationFour-dimensional ensemble Kalman filtering
Tellus (24), 56A, 273 277 Copyright C Blackwell Munksgaard, 24 Printed in UK. All rights reserved TELLUS Four-dimensional ensemble Kalman filtering By B. R. HUNT 1, E. KALNAY 1, E. J. KOSTELICH 2,E.OTT
More informationarxiv: v1 [physics.ao-ph] 23 Jan 2009
A Brief Tutorial on the Ensemble Kalman Filter Jan Mandel arxiv:0901.3725v1 [physics.ao-ph] 23 Jan 2009 February 2007, updated January 2009 Abstract The ensemble Kalman filter EnKF) is a recursive filter
More informationData assimilation with and without a model
Data assimilation with and without a model Tim Sauer George Mason University Parameter estimation and UQ U. Pittsburgh Mar. 5, 2017 Partially supported by NSF Most of this work is due to: Tyrus Berry,
More informationMethods of Data Assimilation and Comparisons for Lagrangian Data
Methods of Data Assimilation and Comparisons for Lagrangian Data Chris Jones, Warwick and UNC-CH Kayo Ide, UCLA Andrew Stuart, Jochen Voss, Warwick Guillaume Vernieres, UNC-CH Amarjit Budiraja, UNC-CH
More informationRelationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF
Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi ECODYC10, Dresden 28 January 2010 Relationship
More informationFundamentals of Data Assimila1on
2015 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO August 11-14, 2015 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University
More informationEnsemble forecasting and flow-dependent estimates of initial uncertainty. Martin Leutbecher
Ensemble forecasting and flow-dependent estimates of initial uncertainty Martin Leutbecher acknowledgements: Roberto Buizza, Lars Isaksen Flow-dependent aspects of data assimilation, ECMWF 11 13 June 2007
More informationParticle Filters. Outline
Particle Filters M. Sami Fadali Professor of EE University of Nevada Outline Monte Carlo integration. Particle filter. Importance sampling. Degeneracy Resampling Example. 1 2 Monte Carlo Integration Numerical
More informationA nested sampling particle filter for nonlinear data assimilation
Quarterly Journal of the Royal Meteorological Society Q. J. R. Meteorol. Soc. : 14, July 2 A DOI:.2/qj.224 A nested sampling particle filter for nonlinear data assimilation Ahmed H. Elsheikh a,b *, Ibrahim
More informationAt-A-Glance SIAM Events Mobile App
At-A-Glance SIAM Events Mobile App Scan the QR code with any QR reader and download the TripBuilder EventMobile app to your iphone, ipad, itouch or Android mobile device.you can also visit www.tripbuildermedia.com/apps/siamevents
More informationSampling the posterior: An approach to non-gaussian data assimilation
Physica D 230 (2007) 50 64 www.elsevier.com/locate/physd Sampling the posterior: An approach to non-gaussian data assimilation A. Apte a, M. Hairer b, A.M. Stuart b,, J. Voss b a Department of Mathematics,
More information