The Ensemble Kalman Filter:

Size: px
Start display at page:

Download "The Ensemble Kalman Filter:"

Transcription

1 p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen, Ocean Dynamics, Vol 5, No

2 p. The Ensemble Kalman Filter (EnKF) Represents error statistics using an ensemble of model states Evolves error statistics by ensemble integrations Variance minimizing analysis scheme operating on the ensemble Monte Carlo, low rank, error subspace method Converges to the Kalman Filter with increasing ensemble size Fully nonlinear error evolution, contrary to EKF Assumption of Gaussian statistics in analysis scheme

3 p. The error covariance matrix Define ensemble covariances around the ensemble mean The ensemble mean is the best-guess. The ensemble spread defines the error variance. The covariance is determined by the smoothness of the ensemble members. A covariance matrix can be represented by an ensemble of model states (not unique).

4 p. Dynamical evolution of error statistics Each ensemble member evolve according to the model dynamics which is expressed by a stochastic differential equation d The probability density then evolve according to Kolmogorov s equation! This is the fundamental equation for evolution of error statistics and can be solved using Monte Carlo methods.

5 # $ & p.5 Analysis scheme (1) Given an ensemble of model forcasts Create an ensemble of observations. %$ # # with the first guess observations, a vector of observation noise. The measurement error covariance matrix is $ $ &('

6 * *, + *, + ' ' p.6 Analysis scheme () Update each ensemble member according to # ) ' where /. - ' * ) ' This is equivalent to updating the mean * # ) ' The posterior error covariance becomes 1

7 ; p.7 Analysis of the Analysis scheme (1) Define the ensemble matrix :; ) The ensemble mean is (defining 8 The ensemble perturbations becomes 1 becomes The ensemble covariance matrix =

8 # ;? # ; p.8 Analysis equation (), define 5> Given a vector of measurements %$ # # stored in 7 > 5 # # The ensemble perturbations are stored in 7 > 5 $ $ $ thus, the measurement error covariance matrix becomes &

9 . p.9 Analysis equation () The analysis equation can now be written /. & Defining the innovations previous definitions: and using i.e., analysis expressed entirely in terms of the ensemble

10 Practical computation of analysis (1) Use pseudo inverse A B A C. A B. A Computational cost is: D ; to form, E D for eigenvalue decomposition. Unafordable for large D! p.1

11 Practical computation of analysis () Note that 9 F, thus Compute SVD, HG I, giving HG I HI G HG H G Computational cost is E D ; for SVD. p.11

12 Practical computation of analysis () The analysis equation can now be written G B. G The computation goes as follows with J K ; B. G 5 7> D J 5 7 D ; J L G 5 > 7 D ; J M L 5 7 D ; ; M N ; ; All D ; computations reduced to D ;. p.1

13 9 1 1 O M 8 M M L p.1 Practical computation of analysis () The final update can be written as O thus, the analysis is a weakly nonlinear combination of the forecast ensemble. Note also ;

14 O O p.1 Remarks on the analysis equation (1) Covariances only needed between observed variables at measurement locations. Covariances never computed but indirectly used to determine. Analysis may be interpreted as: combination of ensemble members, or, forecast pluss combination of covariance functions. Covariances only needed to compute Accuracy of analysis is determined by the accuracy of the properties of the ensemble error space.

15 p.15 Remarks on the analysis equation () For a linear model, any choice of analysis which is also a solution of the model. Filtering of covariance functions introduces nondynamical modes in the analysis. O will result in an

16 O p.16 Local analysis A local analysis is computed grid point by grid point using only nearby measurements. Introduces nondynamical modes in the analysis. Different for each grid point. Allows us to reach a larger class of solutions.

17 P # P 7 R > 5. p.17 Nonlinear measurements Measurement equation $ P Define ensemble of model prediction of the measurements Q The analysis then becomes Q Q Q Q Analysis based on covariances between P and.

18 O p.18 Ensemble Kalman Smoother (EnKS) Starts with EnKF solution. Computes updates backward in time; sequentially for each measurement time, using covariances in time, no backward integrations. The analysis becomes for. : KVU TS K U _^ ][ WZY \[ XWZY

19 p.19 Some recent applications of the EnKF Haugan and Evensen (), Ocean Dynamics. Mitchell et al. (), MWR. Brusdal et al (), JMS. Natvik and Evensen (a,b), JMS. Keppenne and Rienecker (), JMS. DIADEM project TOPAZ project (topaz.nersc.no) MERSEA project

20 h Time correlated model noise Scalar model. gfu a a `U. `U e`u bdc U. U p.

21 i Results ( ) Time p.1

22 i Results ( j) Time p.

23 Estimate of model noise, EnKF Time p.

24 Estimate of model noise, EnKS Time p.

25 k Model forced by estimated model error k e `U bdc U. U ml ml p.5

26 Š Š z Parameter and bias estimation in model n U Introduces poorly known parameter z ryx ˆ~ w z wqryx upu opo { upu z s ryx qr ƒ { s r { ~} { t ryx opo v upu qr s r t r opo p.6

27 p.7 Estimate and model error, EnKF Time

28 p.8 Estimate and model error, EnKS Time

29 p.9 Estimate, model error and bias, EnKF Time

30 p. Estimate, model error and bias, EnKS Time

31 p.1 Estimated bias and std dev Time

The Ensemble Kalman Filter:

The Ensemble Kalman Filter: p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen 23, Ocean Dynamics, Vol 53, No 4 p.2 The Ensemble

More information

Ensemble Kalman Filter

Ensemble Kalman Filter Ensemble Kalman Filter Geir Evensen and Laurent Bertino Hydro Research Centre, Bergen, Norway, Nansen Environmental and Remote Sensing Center, Bergen, Norway The Ensemble Kalman Filter (EnKF) Represents

More information

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation Noname manuscript No. (will be inserted by the editor) The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen

More information

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation Geir Evensen Norsk Hydro, Oil and Energy Research Centre, Bergen PO Box 7190 - N 5020 Bergen, Norway Geir.Evensen@hydro.com

More information

Analysis Scheme in the Ensemble Kalman Filter

Analysis Scheme in the Ensemble Kalman Filter JUNE 1998 BURGERS ET AL. 1719 Analysis Scheme in the Ensemble Kalman Filter GERRIT BURGERS Royal Netherlands Meteorological Institute, De Bilt, the Netherlands PETER JAN VAN LEEUWEN Institute or Marine

More information

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background

More information

Gaussian Filtering Strategies for Nonlinear Systems

Gaussian Filtering Strategies for Nonlinear Systems Gaussian Filtering Strategies for Nonlinear Systems Canonical Nonlinear Filtering Problem ~u m+1 = ~ f (~u m )+~ m+1 ~v m+1 = ~g(~u m+1 )+~ o m+1 I ~ f and ~g are nonlinear & deterministic I Noise/Errors

More information

Autonomous Navigation for Flying Robots

Autonomous Navigation for Flying Robots Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 6.2: Kalman Filter Jürgen Sturm Technische Universität München Motivation Bayes filter is a useful tool for state

More information

The Ensemble Kalman Filter: theoretical formulation and practical implementation

The Ensemble Kalman Filter: theoretical formulation and practical implementation Ocean Dynamics (2003) 53: 343 367 DOI 10.1007/s10236-003-0036-9 Geir Evensen The Ensemble Kalman Filter: theoretical formulation and practical implementation Received: 16 December 2002 / Accepted: 7 May

More information

6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter

6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter 6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter GEIR EVENSEN Nansen Environmental and Remote Sensing Center, Bergen, Norway 6.1 Introduction Sequential data assimilation

More information

Kalman Filter and Ensemble Kalman Filter

Kalman Filter and Ensemble Kalman Filter Kalman Filter and Ensemble Kalman Filter 1 Motivation Ensemble forecasting : Provides flow-dependent estimate of uncertainty of the forecast. Data assimilation : requires information about uncertainty

More information

Smoothers: Types and Benchmarks

Smoothers: Types and Benchmarks Smoothers: Types and Benchmarks Patrick N. Raanes Oxford University, NERSC 8th International EnKF Workshop May 27, 2013 Chris Farmer, Irene Moroz Laurent Bertino NERSC Geir Evensen Abstract Talk builds

More information

Geir Evensen Data Assimilation

Geir Evensen Data Assimilation Geir Evensen Data Assimilation Geir Evensen Data Assimilation The Ensemble Kalman Filter With 63 Figures PROF.GEIR EVENSEN Hydro Research Centre, Bergen PO Box 7190 N 5020 Bergen Norway and Mohn-Sverdrup

More information

Geir Evensen Data Assimilation

Geir Evensen Data Assimilation Geir Evensen Data Assimilation Geir Evensen Data Assimilation The Ensemble Kalman Filter With 63 Figures PROF.GEIR EVENSEN Hydro Research Centre, Bergen PO Box 7190 N 5020 Bergen Norway and Mohn-Sverdrup

More information

A demonstration of ensemble-based assimilation methods with a layered OGCM from the perspective of operational ocean forecasting systems

A demonstration of ensemble-based assimilation methods with a layered OGCM from the perspective of operational ocean forecasting systems Journal of Marine Systems 40 41 (2003) 253 289 www.elsevier.com/locate/jmarsys A demonstration of ensemble-based assimilation methods with a layered OGCM from the perspective of operational ocean forecasting

More information

A Note on the Particle Filter with Posterior Gaussian Resampling

A Note on the Particle Filter with Posterior Gaussian Resampling Tellus (6), 8A, 46 46 Copyright C Blackwell Munksgaard, 6 Printed in Singapore. All rights reserved TELLUS A Note on the Particle Filter with Posterior Gaussian Resampling By X. XIONG 1,I.M.NAVON 1,2 and

More information

Four-dimensional ensemble Kalman filtering

Four-dimensional ensemble Kalman filtering Tellus (24), 56A, 273 277 Copyright C Blackwell Munksgaard, 24 Printed in UK. All rights reserved TELLUS Four-dimensional ensemble Kalman filtering By B. R. HUNT 1, E. KALNAY 1, E. J. KOSTELICH 2,E.OTT

More information

SPE History Matching Using the Ensemble Kalman Filter on a North Sea Field Case

SPE History Matching Using the Ensemble Kalman Filter on a North Sea Field Case SPE- 1243 History Matching Using the Ensemble Kalman Filter on a North Sea Field Case Vibeke Haugen, SPE, Statoil ASA, Lars-Jørgen Natvik, Statoil ASA, Geir Evensen, Hydro, Aina Berg, IRIS, Kristin Flornes,

More information

The Kalman Filter ImPr Talk

The Kalman Filter ImPr Talk The Kalman Filter ImPr Talk Ged Ridgway Centre for Medical Image Computing November, 2006 Outline What is the Kalman Filter? State Space Models Kalman Filter Overview Bayesian Updating of Estimates Kalman

More information

Asynchronous data assimilation

Asynchronous data assimilation Ensemble Kalman Filter, lecture 2 Asynchronous data assimilation Pavel Sakov Nansen Environmental and Remote Sensing Center, Norway This talk has been prepared in the course of evita-enkf project funded

More information

Stability of Ensemble Kalman Filters

Stability of Ensemble Kalman Filters Stability of Ensemble Kalman Filters Idrissa S. Amour, Zubeda Mussa, Alexander Bibov, Antti Solonen, John Bardsley, Heikki Haario and Tuomo Kauranne Lappeenranta University of Technology University of

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Courant Institute New York University New York NY www.dtbkelly.com February 12, 2015 Graduate seminar, CIMS David Kelly (CIMS) Data assimilation February

More information

Practical Aspects of Ensemble-based Kalman Filters

Practical Aspects of Ensemble-based Kalman Filters Practical Aspects of Ensemble-based Kalman Filters Lars Nerger Alfred Wegener Institute for Polar and Marine Research Bremerhaven, Germany and Bremen Supercomputing Competence Center BremHLR Bremen, Germany

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond January 18, 2017 Contents 1 Batch and Recursive Estimation 2 Towards Bayesian Filtering 3 Kalman Filter and Bayesian Filtering and Smoothing

More information

Ensemble square-root filters

Ensemble square-root filters Ensemble square-root filters MICHAEL K. TIPPETT International Research Institute for climate prediction, Palisades, New Yor JEFFREY L. ANDERSON GFDL, Princeton, New Jersy CRAIG H. BISHOP Naval Research

More information

Relative Merits of 4D-Var and Ensemble Kalman Filter

Relative Merits of 4D-Var and Ensemble Kalman Filter Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29

More information

Organization. I MCMC discussion. I project talks. I Lecture.

Organization. I MCMC discussion. I project talks. I Lecture. Organization I MCMC discussion I project talks. I Lecture. Content I Uncertainty Propagation Overview I Forward-Backward with an Ensemble I Model Reduction (Intro) Uncertainty Propagation in Causal Systems

More information

Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics

Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics JOURNAL OF GEOPHYSICAL RESEARCH, VOL. 99, NO. C, PAGES,143,162, MAY, 1994 Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics Geir

More information

Data Assimilation for Dispersion Models

Data Assimilation for Dispersion Models Data Assimilation for Dispersion Models K. V. Umamaheswara Reddy Dept. of Mechanical and Aerospace Engg. State University of New Yor at Buffalo Buffalo, NY, U.S.A. venatar@buffalo.edu Yang Cheng Dept.

More information

Bayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e.

Bayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e. Kalman Filter Localization Bayes Filter Reminder Prediction Correction Gaussians p(x) ~ N(µ,σ 2 ) : Properties of Gaussians Univariate p(x) = 1 1 2πσ e 2 (x µ) 2 σ 2 µ Univariate -σ σ Multivariate µ Multivariate

More information

The Canadian approach to ensemble prediction

The Canadian approach to ensemble prediction The Canadian approach to ensemble prediction ECMWF 2017 Annual seminar: Ensemble prediction : past, present and future. Pieter Houtekamer Montreal, Canada Overview. The Canadian approach. What are the

More information

An Ensemble Kalman Smoother for Nonlinear Dynamics

An Ensemble Kalman Smoother for Nonlinear Dynamics 1852 MONTHLY WEATHER REVIEW VOLUME 128 An Ensemble Kalman Smoother or Nonlinear Dynamics GEIR EVENSEN Nansen Environmental and Remote Sensing Center, Bergen, Norway PETER JAN VAN LEEUWEN Institute or Marine

More information

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Laura Slivinski June, 3 Laura Slivinski (Brown University) Lagrangian Data Assimilation June, 3 / 3 Data Assimilation Setup:

More information

Aspects of the practical application of ensemble-based Kalman filters

Aspects of the practical application of ensemble-based Kalman filters Aspects of the practical application of ensemble-based Kalman filters Lars Nerger Alfred Wegener Institute for Polar and Marine Research Bremerhaven, Germany and Bremen Supercomputing Competence Center

More information

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi 4th EnKF Workshop, April 2010 Relationship

More information

A Comparison of Error Subspace Kalman Filters

A Comparison of Error Subspace Kalman Filters Tellus 000, 000 000 (0000) Printed 4 February 2005 (Tellus LATEX style file v2.2) A Comparison of Error Subspace Kalman Filters By LARS NERGER, WOLFGANG HILLER and JENS SCHRÖTER Alfred Wegener Institute

More information

Accepted in Tellus A 2 October, *Correspondence

Accepted in Tellus A 2 October, *Correspondence 1 An Adaptive Covariance Inflation Error Correction Algorithm for Ensemble Filters Jeffrey L. Anderson * NCAR Data Assimilation Research Section P.O. Box 3000 Boulder, CO 80307-3000 USA Accepted in Tellus

More information

Data assimilation in the geosciences An overview

Data assimilation in the geosciences An overview Data assimilation in the geosciences An overview Alberto Carrassi 1, Olivier Talagrand 2, Marc Bocquet 3 (1) NERSC, Bergen, Norway (2) LMD, École Normale Supérieure, IPSL, France (3) CEREA, joint lab École

More information

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535

More information

Environment Canada s Regional Ensemble Kalman Filter

Environment Canada s Regional Ensemble Kalman Filter Environment Canada s Regional Ensemble Kalman Filter May 19, 2014 Seung-Jong Baek, Luc Fillion, Kao-Shen Chung, and Peter Houtekamer Meteorological Research Division, Environment Canada, Dorval, Quebec

More information

arxiv: v1 [physics.ao-ph] 23 Jan 2009

arxiv: v1 [physics.ao-ph] 23 Jan 2009 A Brief Tutorial on the Ensemble Kalman Filter Jan Mandel arxiv:0901.3725v1 [physics.ao-ph] 23 Jan 2009 February 2007, updated January 2009 Abstract The ensemble Kalman filter EnKF) is a recursive filter

More information

Localization and Correlation in Ensemble Kalman Filters

Localization and Correlation in Ensemble Kalman Filters Localization and Correlation in Ensemble Kalman Filters Jeff Anderson NCAR Data Assimilation Research Section The National Center for Atmospheric Research is sponsored by the National Science Foundation.

More information

Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic

Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic L. Nerger S. Danilov, G. Kivman, W. Hiller, and J. Schröter Alfred Wegener

More information

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter A data-driven method for improving the correlation estimation in serial ensemble Kalman filter Michèle De La Chevrotière, 1 John Harlim 2 1 Department of Mathematics, Penn State University, 2 Department

More information

Methods of Data Assimilation and Comparisons for Lagrangian Data

Methods of Data Assimilation and Comparisons for Lagrangian Data Methods of Data Assimilation and Comparisons for Lagrangian Data Chris Jones, Warwick and UNC-CH Kayo Ide, UCLA Andrew Stuart, Jochen Voss, Warwick Guillaume Vernieres, UNC-CH Amarjit Budiraja, UNC-CH

More information

Four-Dimensional Ensemble Kalman Filtering

Four-Dimensional Ensemble Kalman Filtering Four-Dimensional Ensemble Kalman Filtering B.R. Hunt, E. Kalnay, E.J. Kostelich, E. Ott, D.J. Patil, T. Sauer, I. Szunyogh, J.A. Yorke, A.V. Zimin University of Maryland, College Park, MD 20742, USA Ensemble

More information

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania Nonlinear and/or Non-normal Filtering Jesús Fernández-Villaverde University of Pennsylvania 1 Motivation Nonlinear and/or non-gaussian filtering, smoothing, and forecasting (NLGF) problems are pervasive

More information

Short tutorial on data assimilation

Short tutorial on data assimilation Mitglied der Helmholtz-Gemeinschaft Short tutorial on data assimilation 23 June 2015 Wolfgang Kurtz & Harrie-Jan Hendricks Franssen Institute of Bio- and Geosciences IBG-3 (Agrosphere), Forschungszentrum

More information

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation A. Shah 1,2, M. E. Gharamti 1, L. Bertino 1 1 Nansen Environmental and Remote Sensing Center 2 University of Bergen

More information

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm Overview 1 2 3 Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation 6th EnKF Purpose EnKF equations localization After the 6th EnKF (2014), I decided with Prof. Zhang to summarize progress

More information

A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific

A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific ADVANCES IN ATMOSPHERIC SCIENCES, VOL. 26, NO. 5, 2009, 1042 1052 A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific WAN Liying 1 (!"#), ZHU Jiang 2 ($%), WANG Hui

More information

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Lecture 2: From Linear Regression to Kalman Filter and Beyond Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation

More information

Local Ensemble Transform Kalman Filter

Local Ensemble Transform Kalman Filter Local Ensemble Transform Kalman Filter Brian Hunt 11 June 2013 Review of Notation Forecast model: a known function M on a vector space of model states. Truth: an unknown sequence {x n } of model states

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Kody Law Andy Majda Andrew Stuart Xin Tong Courant Institute New York University New York NY www.dtbkelly.com February 3, 2016 DPMMS, University of Cambridge

More information

Balanced multivariate model errors of an intermediate coupled model for ensemble Kalman filter data assimilation

Balanced multivariate model errors of an intermediate coupled model for ensemble Kalman filter data assimilation Click Here for Full Article JOURNAL OF GEOPHYSICAL RESEARCH, VOL. 113,, doi:10.1029/2007jc004621, 2008 Balanced multivariate model errors of an intermediate coupled model for ensemble Kalman filter data

More information

Sequential data assimilation techniques in oceanography

Sequential data assimilation techniques in oceanography Sequential data assimilation techniques in oceanography Laurent BERTINO, Geir EVENSEN, Hans WACKERNAGEL Nansen Environmental and Remote Sensing Center, Norway Centre de Géostatistique, Ecole des Mines

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 2015 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO August 11-14, 2015 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

Ergodicity in data assimilation methods

Ergodicity in data assimilation methods Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation

More information

Convergence of the Ensemble Kalman Filter in Hilbert Space

Convergence of the Ensemble Kalman Filter in Hilbert Space Convergence of the Ensemble Kalman Filter in Hilbert Space Jan Mandel Center for Computational Mathematics Department of Mathematical and Statistical Sciences University of Colorado Denver Parts based

More information

Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters

Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters 1042 M O N T H L Y W E A T H E R R E V I E W VOLUME 136 Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters PAVEL SAKOV AND PETER R. OKE CSIRO Marine and Atmospheric

More information

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi ECODYC10, Dresden 28 January 2010 Relationship

More information

Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF

Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF Javier Amezcua, Dr. Kayo Ide, Dr. Eugenia Kalnay 1 Outline

More information

Fundamentals of Data Assimilation

Fundamentals of Data Assimilation National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)

More information

State and Parameter Estimation in Stochastic Dynamical Models

State and Parameter Estimation in Stochastic Dynamical Models State and Parameter Estimation in Stochastic Dynamical Models Timothy DelSole George Mason University, Fairfax, Va and Center for Ocean-Land-Atmosphere Studies, Calverton, MD June 21, 2011 1 1 collaboration

More information

Par$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading

Par$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Par$cle Filters Part I: Theory Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Reading July 2013 Why Data Assimila$on Predic$on Model improvement: - Parameter es$ma$on

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run

More information

Adaptive ensemble Kalman filtering of nonlinear systems

Adaptive ensemble Kalman filtering of nonlinear systems Adaptive ensemble Kalman filtering of nonlinear systems Tyrus Berry George Mason University June 12, 213 : Problem Setup We consider a system of the form: x k+1 = f (x k ) + ω k+1 ω N (, Q) y k+1 = h(x

More information

Review of Covariance Localization in Ensemble Filters

Review of Covariance Localization in Ensemble Filters NOAA Earth System Research Laboratory Review of Covariance Localization in Ensemble Filters Tom Hamill NOAA Earth System Research Lab, Boulder, CO tom.hamill@noaa.gov Canonical ensemble Kalman filter update

More information

A Spectral Approach to Linear Bayesian Updating

A Spectral Approach to Linear Bayesian Updating A Spectral Approach to Linear Bayesian Updating Oliver Pajonk 1,2, Bojana V. Rosic 1, Alexander Litvinenko 1, and Hermann G. Matthies 1 1 Institute of Scientific Computing, TU Braunschweig, Germany 2 SPT

More information

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Lessons in Estimation Theory for Signal Processing, Communications, and Control Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL

More information

Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model

Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model Ehouarn Simon 1, Annette Samuelsen 1, Laurent Bertino 1 Dany Dumont

More information

Robust Ensemble Filtering With Improved Storm Surge Forecasting

Robust Ensemble Filtering With Improved Storm Surge Forecasting Robust Ensemble Filtering With Improved Storm Surge Forecasting U. Altaf, T. Buttler, X. Luo, C. Dawson, T. Mao, I.Hoteit Meteo France, Toulouse, Nov 13, 2012 Project Ensemble data assimilation for storm

More information

Assimilation des Observations et Traitement des Incertitudes en Météorologie

Assimilation des Observations et Traitement des Incertitudes en Météorologie Assimilation des Observations et Traitement des Incertitudes en Météorologie Olivier Talagrand Laboratoire de Météorologie Dynamique, Paris 4èmes Rencontres Météo/MathAppli Météo-France, Toulouse, 25 Mars

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Contents in latter part Linear Dynamical Systems What is different from HMM? Kalman filter Its strength and limitation Particle Filter

More information

Localization in the ensemble Kalman Filter

Localization in the ensemble Kalman Filter Department of Meteorology Localization in the ensemble Kalman Filter Ruth Elizabeth Petrie A dissertation submitted in partial fulfilment of the requirement for the degree of MSc. Atmosphere, Ocean and

More information

STA414/2104 Statistical Methods for Machine Learning II

STA414/2104 Statistical Methods for Machine Learning II STA414/2104 Statistical Methods for Machine Learning II Murat A. Erdogdu & David Duvenaud Department of Computer Science Department of Statistical Sciences Lecture 3 Slide credits: Russ Salakhutdinov Announcements

More information

Probabilistic Graphical Models

Probabilistic Graphical Models Probabilistic Graphical Models Brown University CSCI 2950-P, Spring 2013 Prof. Erik Sudderth Lecture 12: Gaussian Belief Propagation, State Space Models and Kalman Filters Guest Kalman Filter Lecture by

More information

Application of the Ensemble Kalman Filter to History Matching

Application of the Ensemble Kalman Filter to History Matching Application of the Ensemble Kalman Filter to History Matching Presented at Texas A&M, November 16,2010 Outline Philosophy EnKF for Data Assimilation Field History Match Using EnKF with Covariance Localization

More information

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data John Harlim and Brian R. Hunt Department of Mathematics and Institute for Physical Science and Technology University

More information

Sequential data assimilation techniques in oceanography

Sequential data assimilation techniques in oceanography Sequential data assimilation techniques in oceanography Laurent BERTINO ½, Geir EVENSEN ½, Hans WACKERNAGEL ¾ ½ Nansen Environmental and Remote Sensing Center, Norway ¾ Centre de Géostatistique, Ecole

More information

Abstract 2. ENSEMBLE KALMAN FILTERS 1. INTRODUCTION

Abstract 2. ENSEMBLE KALMAN FILTERS 1. INTRODUCTION J5.4 4D ENSEMBLE KALMAN FILTERING FOR ASSIMILATION OF ASYNCHRONOUS OBSERVATIONS T. Sauer George Mason University, Fairfax, VA 22030 B.R. Hunt, J.A. Yorke, A.V. Zimin, E. Ott, E.J. Kostelich, I. Szunyogh,

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP

Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP Francois Counillon, Noel Keenlyside, Mats Bentsen, Ingo Bethke, Laurent Bertino, Teferi Demissie, Tor Eldevik, Shunya Koseki, Camille

More information

Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP

Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP Project eam: Mark Buehner Cecilien Charette Bin He Peter Houtekamer Herschel Mitchell WWRP/HORPEX Workshop on 4D-VAR and Ensemble

More information

Ensemble Kalman Filtering for State and Parameter Estimation on a Reservoir Model

Ensemble Kalman Filtering for State and Parameter Estimation on a Reservoir Model Ensemble Kalman Filtering for State and Parameter Estimation on a Reservoir Model John Petter Jensen Master of Science in Engineering Cybernetics Submission date: June 27 Supervisor: Bjarne Anton Foss,

More information

Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter

Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter Jon Poterjoy, Ryan Sobash, and Jeffrey Anderson National Center for Atmospheric Research

More information

Assimilating Altimetry Data into a HYCOM Model of the Pacific: Ensemble Optimal Interpolation versus Ensemble Kalman Filter

Assimilating Altimetry Data into a HYCOM Model of the Pacific: Ensemble Optimal Interpolation versus Ensemble Kalman Filter APRIL 2010 W A N E T A L. 753 Assimilating Altimetry Data into a HYCOM Model of the Pacific: Ensemble Optimal Interpolation versus Ensemble Kalman Filter LIYING WAN National Marine Environmental Forecasting

More information

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance The Kalman Filter Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience Sarah Dance School of Mathematical and Physical Sciences, University of Reading s.l.dance@reading.ac.uk July

More information

SIMON FRASER UNIVERSITY School of Engineering Science

SIMON FRASER UNIVERSITY School of Engineering Science SIMON FRASER UNIVERSITY School of Engineering Science Course Outline ENSC 810-3 Digital Signal Processing Calendar Description This course covers advanced digital signal processing techniques. The main

More information

Nonlinear variational inverse problems

Nonlinear variational inverse problems 6 Nonlinear variational inverse problems This chapter considers highly nonlinear variational inverse problems and their properties. More general inverse formulations for nonlinear dynamical models will

More information

Reservoir Monitoring and Continuous Model Updating Using Ensemble Kalman Filter

Reservoir Monitoring and Continuous Model Updating Using Ensemble Kalman Filter SPE 84372 Reservoir Monitoring and Continuous Model Updating Using Ensemble Kalman Filter Geir Nævdal, RF-Rogaland Research; Liv Merethe Johnsen, SPE, Norsk Hydro; Sigurd Ivar Aanonsen, SPE, Norsk Hydro;

More information

Monte Carlo Simulation. CWR 6536 Stochastic Subsurface Hydrology

Monte Carlo Simulation. CWR 6536 Stochastic Subsurface Hydrology Monte Carlo Simulation CWR 6536 Stochastic Subsurface Hydrology Steps in Monte Carlo Simulation Create input sample space with known distribution, e.g. ensemble of all possible combinations of v, D, q,

More information

Maximum Likelihood Ensemble Filter Applied to Multisensor Systems

Maximum Likelihood Ensemble Filter Applied to Multisensor Systems Maximum Likelihood Ensemble Filter Applied to Multisensor Systems Arif R. Albayrak a, Milija Zupanski b and Dusanka Zupanski c abc Colorado State University (CIRA), 137 Campus Delivery Fort Collins, CO

More information

Data assimilation; comparison of 4D-Var and LETKF smoothers

Data assimilation; comparison of 4D-Var and LETKF smoothers Data assimilation; comparison of 4D-Var and LETKF smoothers Eugenia Kalnay and many friends University of Maryland CSCAMM DAS13 June 2013 Contents First part: Forecasting the weather - we are really getting

More information

An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norwa

An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norwa An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norway Journal of Marine Systems, submitted, 1999 Mette

More information

Sampling versus optimization in very high dimensional parameter spaces

Sampling versus optimization in very high dimensional parameter spaces Sampling versus optimization in very high dimensional parameter spaces Grigor Aslanyan Berkeley Center for Cosmological Physics UC Berkeley Statistical Challenges in Modern Astronomy VI Carnegie Mellon

More information

Adaptive ensemble Kalman filtering of nonlinear systems. Tyrus Berry and Timothy Sauer George Mason University, Fairfax, VA 22030

Adaptive ensemble Kalman filtering of nonlinear systems. Tyrus Berry and Timothy Sauer George Mason University, Fairfax, VA 22030 Generated using V3.2 of the official AMS LATEX template journal page layout FOR AUTHOR USE ONLY, NOT FOR SUBMISSION! Adaptive ensemble Kalman filtering of nonlinear systems Tyrus Berry and Timothy Sauer

More information

Efficient Data Assimilation for Spatiotemporal Chaos: a Local Ensemble Transform Kalman Filter

Efficient Data Assimilation for Spatiotemporal Chaos: a Local Ensemble Transform Kalman Filter Efficient Data Assimilation for Spatiotemporal Chaos: a Local Ensemble Transform Kalman Filter arxiv:physics/0511236 v1 28 Nov 2005 Brian R. Hunt Institute for Physical Science and Technology and Department

More information

Ensemble variational assimilation as a probabilistic estimator Part 1: The linear and weak non-linear case

Ensemble variational assimilation as a probabilistic estimator Part 1: The linear and weak non-linear case Nonlin. Processes Geophys., 25, 565 587, 28 https://doi.org/.594/npg-25-565-28 Author(s) 28. This work is distributed under the Creative Commons Attribution 4. License. Ensemble variational assimilation

More information

DATA ASSIMILATION FOR FLOOD FORECASTING

DATA ASSIMILATION FOR FLOOD FORECASTING DATA ASSIMILATION FOR FLOOD FORECASTING Arnold Heemin Delft University of Technology 09/16/14 1 Data assimilation is the incorporation of measurement into a numerical model to improve the model results

More information