Ensemble Kalman Filter

Size: px
Start display at page:

Download "Ensemble Kalman Filter"

Transcription

1 Ensemble Kalman Filter Geir Evensen and Laurent Bertino Hydro Research Centre, Bergen, Norway, Nansen Environmental and Remote Sensing Center, Bergen, Norway

2 The Ensemble Kalman Filter (EnKF) Represents error statistics using an ensemble of model states. Evolves error statistics by ensemble integrations. Variance minimizing analysis scheme operating on the ensemble. Monte Carlo, low rank, error subspace method. Converges to the Kalman Filter with increasing ensemble size. Fully nonlinear error evolution, contrary to EKF. Assumption of Gaussian statistics in analysis scheme.

3 The error covariance matrix Define ensemble covariances around the ensemble mean C f ψψ (Cf ψψ )e = (ψ f ψ f )(ψ f ψ f ) T C a ψψ (Ca ψψ )e = (ψ a ψ a )(ψ a ψ a ) T The ensemble mean ψ is the best-guess. The ensemble spread defines the error variance. The covariance is determined by the smoothness of the ensemble members. A covariance matrix can be represented by an ensemble of model states (not unique).

4 Dynamical evolution of error statistics Each ensemble member evolves according to the model dynamics which is expressed by a stochastic differential equation dψ = g(ψ)dt + h(ψ)dq. The probability density f then evolve according to Kolmogorov s equation f t + i (g i f) ψ i = 1 2 i,j 2 f(hc qq h T ) ij ψ i ψ j. This is the fundamental equation for evolution of error statistics and can be solved using Monte Carlo methods.

5 Analysis scheme (1) Given an ensemble of model forcasts, ψ f j, defining forecast error covariance C f ψψ (Cf ψψ )e = (ψ f ψ f )(ψ f ψ f ) T. Create an ensemble of observations d j = d + ɛ j, with d, the real observations, ɛ j, a vector of observation noise, ɛɛ T = (C ɛɛ ) e C ɛɛ.

6 Analysis scheme (2) Update each ensemble member according to ψ a j = ψ f j+(c f ψψ )e M T( M(C f ψψ )e M T +C ɛɛ ) 1 (d j Mψ f j Thus, the update of the mean becomes ψ a = ψ f +(C f ψψ )e M T( M(C f ψψ )e M T +C ɛɛ ) 1 (d Mψ f). The posterior error covariance becomes (C a ψψ )e = (C f ψψ )e (C f ψψ )e M T ( M(C f ψψ )e M T + C ɛɛ ) 1 M(C f ψψ ) e. ).

7 Example: Lorenz model Application with the chaotic Lorenz model Illustrates properties with higly nonlinear dynamical models. From Evensen (1997), MWR.

8 EnKF solution 20 EnKF: Estimate

9 EnKF error variance 30 EnKF: Error variance

10 Summary: Lorenz model The EnKF works well with highly nonlinear dynamical models. There is no linearization in the evolution of error statistics. Methods using tangent linear or adjoint operators have problems with the Lorenz equations: limited by the predictability time, limited by the validity time of tangent linear operator. Can we expect the same to be true for more complex models with large state spaces?

11 Analysis equation (1) Define the ensemble matrix A = (ψ 1, ψ 2,..., ψ N ) R n N. The ensemble mean is (defining 1 N R N N 1/N) A = A1 N. The ensemble perturbations become A = A A = A(I 1 N ). The ensemble covariance matrix (C ψψ ) e R n n becomes (C ψψ ) e = A (A ) T N 1.

12 Analysis equation (2) Given a vector of measurements d R m, define stored in d j = d + ɛ j, j = 1,..., N, D = (d 1, d 2,..., d N ) R m N. The ensemble perturbations are stored in E = (ɛ 1, ɛ 2,..., ɛ N ) R m N, thus, the measurement error covariance matrix becomes C e ɛɛ = EET N 1.

13 Analysis equation (3) The analysis equation can now be written A a = A+(C ψψ ) e M T( M(C ψψ ) e M T +C ɛɛ ) 1 (D MA ). Defining the innovations D = D MA and using previous definitions: A a = A + A (MA ) T ( (MA )(MA ) T + C ɛɛ ) 1 D. i.e., analysis expressed entirely in terms of the ensemble

14 Analysis equation (4) Define S = MA and C = SS T + C ɛɛ. Use A = A(I 1 N ). Use 1 N S T 0. ( ) 1 A a = A + A S T SS T + C ɛɛ D = A + A(I 1 N )S T C 1 D = A (I + S T C 1 D ) = AX

15 Remarks (C ψψ ) e never computed but indirectly used to determine M(C ψψ ) e M T = SS T. Covariances only needed between observed variables at measurement locations. Analysis may be interpreted as: combination of forecast ensemble members, or, forecast plus combination of covariance functions. Accuracy of analysis is determined by: the accuracy of X, the properties of the ensemble error space.

16 Remarks For a linear model, any choice of X will result in an analysis which is also a solution of the model.

17 Examples of ensemble statistics Taken from Haugen and Evensen (2002), Ocean Dynamics. OGCM (MICOM) for the Indian Ocean. Assimilation of SST and SLA data.

18 Spatial correlations Latitude SST-DP(1) Latitude SSH-DP(1) Longitude Longitude Latitude SST-SSH Latitude SSH-UVEL Longitude Longitude

19 Correlation functions SSH SSH SSH SST SSH DP SST SSH SST SST SST DP

20 Correlation functions SSH SSH SSH SST SSH DP SST SSH SST SST SST DP

21 Time Depth: Temperature Depth OBSERVED AND SIMULATED TEMPERATURE Days

The Ensemble Kalman Filter:

The Ensemble Kalman Filter: p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen 23, Ocean Dynamics, Vol 53, No 4 p.2 The Ensemble

More information

The Ensemble Kalman Filter:

The Ensemble Kalman Filter: p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen, Ocean Dynamics, Vol 5, No p. The Ensemble

More information

6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter

6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter 6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter GEIR EVENSEN Nansen Environmental and Remote Sensing Center, Bergen, Norway 6.1 Introduction Sequential data assimilation

More information

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation Noname manuscript No. (will be inserted by the editor) The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen

More information

Geir Evensen Data Assimilation

Geir Evensen Data Assimilation Geir Evensen Data Assimilation Geir Evensen Data Assimilation The Ensemble Kalman Filter With 63 Figures PROF.GEIR EVENSEN Hydro Research Centre, Bergen PO Box 7190 N 5020 Bergen Norway and Mohn-Sverdrup

More information

Geir Evensen Data Assimilation

Geir Evensen Data Assimilation Geir Evensen Data Assimilation Geir Evensen Data Assimilation The Ensemble Kalman Filter With 63 Figures PROF.GEIR EVENSEN Hydro Research Centre, Bergen PO Box 7190 N 5020 Bergen Norway and Mohn-Sverdrup

More information

Asynchronous data assimilation

Asynchronous data assimilation Ensemble Kalman Filter, lecture 2 Asynchronous data assimilation Pavel Sakov Nansen Environmental and Remote Sensing Center, Norway This talk has been prepared in the course of evita-enkf project funded

More information

Analysis Scheme in the Ensemble Kalman Filter

Analysis Scheme in the Ensemble Kalman Filter JUNE 1998 BURGERS ET AL. 1719 Analysis Scheme in the Ensemble Kalman Filter GERRIT BURGERS Royal Netherlands Meteorological Institute, De Bilt, the Netherlands PETER JAN VAN LEEUWEN Institute or Marine

More information

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation A. Shah 1,2, M. E. Gharamti 1, L. Bertino 1 1 Nansen Environmental and Remote Sensing Center 2 University of Bergen

More information

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background

More information

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation Geir Evensen Norsk Hydro, Oil and Energy Research Centre, Bergen PO Box 7190 - N 5020 Bergen, Norway Geir.Evensen@hydro.com

More information

Smoothers: Types and Benchmarks

Smoothers: Types and Benchmarks Smoothers: Types and Benchmarks Patrick N. Raanes Oxford University, NERSC 8th International EnKF Workshop May 27, 2013 Chris Farmer, Irene Moroz Laurent Bertino NERSC Geir Evensen Abstract Talk builds

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Courant Institute New York University New York NY www.dtbkelly.com February 12, 2015 Graduate seminar, CIMS David Kelly (CIMS) Data assimilation February

More information

Gaussian Filtering Strategies for Nonlinear Systems

Gaussian Filtering Strategies for Nonlinear Systems Gaussian Filtering Strategies for Nonlinear Systems Canonical Nonlinear Filtering Problem ~u m+1 = ~ f (~u m )+~ m+1 ~v m+1 = ~g(~u m+1 )+~ o m+1 I ~ f and ~g are nonlinear & deterministic I Noise/Errors

More information

A Note on the Particle Filter with Posterior Gaussian Resampling

A Note on the Particle Filter with Posterior Gaussian Resampling Tellus (6), 8A, 46 46 Copyright C Blackwell Munksgaard, 6 Printed in Singapore. All rights reserved TELLUS A Note on the Particle Filter with Posterior Gaussian Resampling By X. XIONG 1,I.M.NAVON 1,2 and

More information

Methods of Data Assimilation and Comparisons for Lagrangian Data

Methods of Data Assimilation and Comparisons for Lagrangian Data Methods of Data Assimilation and Comparisons for Lagrangian Data Chris Jones, Warwick and UNC-CH Kayo Ide, UCLA Andrew Stuart, Jochen Voss, Warwick Guillaume Vernieres, UNC-CH Amarjit Budiraja, UNC-CH

More information

Kalman Filter and Ensemble Kalman Filter

Kalman Filter and Ensemble Kalman Filter Kalman Filter and Ensemble Kalman Filter 1 Motivation Ensemble forecasting : Provides flow-dependent estimate of uncertainty of the forecast. Data assimilation : requires information about uncertainty

More information

Adaptive ensemble Kalman filtering of nonlinear systems

Adaptive ensemble Kalman filtering of nonlinear systems Adaptive ensemble Kalman filtering of nonlinear systems Tyrus Berry George Mason University June 12, 213 : Problem Setup We consider a system of the form: x k+1 = f (x k ) + ω k+1 ω N (, Q) y k+1 = h(x

More information

Data assimilation in the geosciences An overview

Data assimilation in the geosciences An overview Data assimilation in the geosciences An overview Alberto Carrassi 1, Olivier Talagrand 2, Marc Bocquet 3 (1) NERSC, Bergen, Norway (2) LMD, École Normale Supérieure, IPSL, France (3) CEREA, joint lab École

More information

Four-Dimensional Ensemble Kalman Filtering

Four-Dimensional Ensemble Kalman Filtering Four-Dimensional Ensemble Kalman Filtering B.R. Hunt, E. Kalnay, E.J. Kostelich, E. Ott, D.J. Patil, T. Sauer, I. Szunyogh, J.A. Yorke, A.V. Zimin University of Maryland, College Park, MD 20742, USA Ensemble

More information

Nonlinear variational inverse problems

Nonlinear variational inverse problems 6 Nonlinear variational inverse problems This chapter considers highly nonlinear variational inverse problems and their properties. More general inverse formulations for nonlinear dynamical models will

More information

State and Parameter Estimation in Stochastic Dynamical Models

State and Parameter Estimation in Stochastic Dynamical Models State and Parameter Estimation in Stochastic Dynamical Models Timothy DelSole George Mason University, Fairfax, Va and Center for Ocean-Land-Atmosphere Studies, Calverton, MD June 21, 2011 1 1 collaboration

More information

An Iterative EnKF for Strongly Nonlinear Systems

An Iterative EnKF for Strongly Nonlinear Systems 1988 M O N T H L Y W E A T H E R R E V I E W VOLUME 140 An Iterative EnKF for Strongly Nonlinear Systems PAVEL SAKOV Nansen Environmental and Remote Sensing Center, Bergen, Norway DEAN S. OLIVER Uni Centre

More information

Four-dimensional ensemble Kalman filtering

Four-dimensional ensemble Kalman filtering Tellus (24), 56A, 273 277 Copyright C Blackwell Munksgaard, 24 Printed in UK. All rights reserved TELLUS Four-dimensional ensemble Kalman filtering By B. R. HUNT 1, E. KALNAY 1, E. J. KOSTELICH 2,E.OTT

More information

Ergodicity in data assimilation methods

Ergodicity in data assimilation methods Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation

More information

Data assimilation with and without a model

Data assimilation with and without a model Data assimilation with and without a model Tim Sauer George Mason University Parameter estimation and UQ U. Pittsburgh Mar. 5, 2017 Partially supported by NSF Most of this work is due to: Tyrus Berry,

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Kody Law Andy Majda Andrew Stuart Xin Tong Courant Institute New York University New York NY www.dtbkelly.com February 3, 2016 DPMMS, University of Cambridge

More information

A Stochastic Collocation based. for Data Assimilation

A Stochastic Collocation based. for Data Assimilation A Stochastic Collocation based Kalman Filter (SCKF) for Data Assimilation Lingzao Zeng and Dongxiao Zhang University of Southern California August 11, 2009 Los Angeles Outline Introduction SCKF Algorithm

More information

A comparison of sequential data assimilation schemes for. Twin Experiments

A comparison of sequential data assimilation schemes for. Twin Experiments A comparison of sequential data assimilation schemes for ocean prediction with HYCOM Twin Experiments A. Srinivasan, University of Miami, Miami, FL E. P. Chassignet, COAPS, Florida State University, Tallahassee,

More information

The Ensemble Kalman Filter: theoretical formulation and practical implementation

The Ensemble Kalman Filter: theoretical formulation and practical implementation Ocean Dynamics (2003) 53: 343 367 DOI 10.1007/s10236-003-0036-9 Geir Evensen The Ensemble Kalman Filter: theoretical formulation and practical implementation Received: 16 December 2002 / Accepted: 7 May

More information

SPE History Matching Using the Ensemble Kalman Filter on a North Sea Field Case

SPE History Matching Using the Ensemble Kalman Filter on a North Sea Field Case SPE- 1243 History Matching Using the Ensemble Kalman Filter on a North Sea Field Case Vibeke Haugen, SPE, Statoil ASA, Lars-Jørgen Natvik, Statoil ASA, Geir Evensen, Hydro, Aina Berg, IRIS, Kristin Flornes,

More information

Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP

Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP Francois Counillon, Noel Keenlyside, Mats Bentsen, Ingo Bethke, Laurent Bertino, Teferi Demissie, Tor Eldevik, Shunya Koseki, Camille

More information

Stability of Ensemble Kalman Filters

Stability of Ensemble Kalman Filters Stability of Ensemble Kalman Filters Idrissa S. Amour, Zubeda Mussa, Alexander Bibov, Antti Solonen, John Bardsley, Heikki Haario and Tuomo Kauranne Lappeenranta University of Technology University of

More information

Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model

Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model Ehouarn Simon 1, Annette Samuelsen 1, Laurent Bertino 1 Dany Dumont

More information

Bayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e.

Bayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e. Kalman Filter Localization Bayes Filter Reminder Prediction Correction Gaussians p(x) ~ N(µ,σ 2 ) : Properties of Gaussians Univariate p(x) = 1 1 2πσ e 2 (x µ) 2 σ 2 µ Univariate -σ σ Multivariate µ Multivariate

More information

Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics

Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics JOURNAL OF GEOPHYSICAL RESEARCH, VOL. 99, NO. C, PAGES,143,162, MAY, 1994 Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics Geir

More information

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter A data-driven method for improving the correlation estimation in serial ensemble Kalman filter Michèle De La Chevrotière, 1 John Harlim 2 1 Department of Mathematics, Penn State University, 2 Department

More information

The ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations

The ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations The Hybrid 4D-Var and Ensemble of Data Assimilations Lars Isaksen, Massimo Bonavita and Elias Holm Data Assimilation Section lars.isaksen@ecmwf.int Acknowledgements to: Mike Fisher and Marta Janiskova

More information

Abstract 2. ENSEMBLE KALMAN FILTERS 1. INTRODUCTION

Abstract 2. ENSEMBLE KALMAN FILTERS 1. INTRODUCTION J5.4 4D ENSEMBLE KALMAN FILTERING FOR ASSIMILATION OF ASYNCHRONOUS OBSERVATIONS T. Sauer George Mason University, Fairfax, VA 22030 B.R. Hunt, J.A. Yorke, A.V. Zimin, E. Ott, E.J. Kostelich, I. Szunyogh,

More information

Data assimilation with and without a model

Data assimilation with and without a model Data assimilation with and without a model Tyrus Berry George Mason University NJIT Feb. 28, 2017 Postdoc supported by NSF This work is in collaboration with: Tim Sauer, GMU Franz Hamilton, Postdoc, NCSU

More information

Comparison of of Assimilation Schemes for HYCOM

Comparison of of Assimilation Schemes for HYCOM Comparison of of Assimilation Schemes for HYCOM Ashwanth Srinivasan, C. Thacker, Z. Garraffo, E. P. Chassignet, O. M. Smedstad, J. Cummings, F. Counillon, L. Bertino, T. M. Chin, P. Brasseur and C. Lozano

More information

Gaussian anamorphosis extension of the DEnKF for combined state and parameter estimation: application to a 1D ocean ecosystem model.

Gaussian anamorphosis extension of the DEnKF for combined state and parameter estimation: application to a 1D ocean ecosystem model. Gaussian anamorphosis extension of the DEnKF for combined state and parameter estimation: application to a D ocean ecosystem model. Ehouarn Simon a,, Laurent Bertino a a Nansen Environmental and Remote

More information

An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norwa

An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norwa An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norway Journal of Marine Systems, submitted, 1999 Mette

More information

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm Overview 1 2 3 Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation 6th EnKF Purpose EnKF equations localization After the 6th EnKF (2014), I decided with Prof. Zhang to summarize progress

More information

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Laura Slivinski June, 3 Laura Slivinski (Brown University) Lagrangian Data Assimilation June, 3 / 3 Data Assimilation Setup:

More information

Forecasting and data assimilation

Forecasting and data assimilation Supported by the National Science Foundation DMS Forecasting and data assimilation Outline Numerical models Kalman Filter Ensembles Douglas Nychka, Thomas Bengtsson, Chris Snyder Geophysical Statistics

More information

Autonomous Navigation for Flying Robots

Autonomous Navigation for Flying Robots Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 6.2: Kalman Filter Jürgen Sturm Technische Universität München Motivation Bayes filter is a useful tool for state

More information

Relative Merits of 4D-Var and Ensemble Kalman Filter

Relative Merits of 4D-Var and Ensemble Kalman Filter Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29

More information

Demonstration and Comparison of of Sequential Approaches for Altimeter Data Assimilation in in HYCOM

Demonstration and Comparison of of Sequential Approaches for Altimeter Data Assimilation in in HYCOM Demonstration and Comparison of of Sequential Approaches for Altimeter Data Assimilation in in HYCOM A. Srinivasan, E. P. Chassignet, O. M. Smedstad, C. Thacker, L. Bertino, P. Brasseur, T. M. Chin,, F.

More information

A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific

A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific ADVANCES IN ATMOSPHERIC SCIENCES, VOL. 26, NO. 5, 2009, 1042 1052 A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific WAN Liying 1 (!"#), ZHU Jiang 2 ($%), WANG Hui

More information

A Spectral Approach to Linear Bayesian Updating

A Spectral Approach to Linear Bayesian Updating A Spectral Approach to Linear Bayesian Updating Oliver Pajonk 1,2, Bojana V. Rosic 1, Alexander Litvinenko 1, and Hermann G. Matthies 1 1 Institute of Scientific Computing, TU Braunschweig, Germany 2 SPT

More information

A Comparison of Error Subspace Kalman Filters

A Comparison of Error Subspace Kalman Filters Tellus 000, 000 000 (0000) Printed 4 February 2005 (Tellus LATEX style file v2.2) A Comparison of Error Subspace Kalman Filters By LARS NERGER, WOLFGANG HILLER and JENS SCHRÖTER Alfred Wegener Institute

More information

Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic

Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic L. Nerger S. Danilov, G. Kivman, W. Hiller, and J. Schröter Alfred Wegener

More information

A demonstration of ensemble-based assimilation methods with a layered OGCM from the perspective of operational ocean forecasting systems

A demonstration of ensemble-based assimilation methods with a layered OGCM from the perspective of operational ocean forecasting systems Journal of Marine Systems 40 41 (2003) 253 289 www.elsevier.com/locate/jmarsys A demonstration of ensemble-based assimilation methods with a layered OGCM from the perspective of operational ocean forecasting

More information

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications Dongbin Xiu Department of Mathematics, Purdue University Support: AFOSR FA955-8-1-353 (Computational Math) SF CAREER DMS-64535

More information

Practical Aspects of Ensemble-based Kalman Filters

Practical Aspects of Ensemble-based Kalman Filters Practical Aspects of Ensemble-based Kalman Filters Lars Nerger Alfred Wegener Institute for Polar and Marine Research Bremerhaven, Germany and Bremen Supercomputing Competence Center BremHLR Bremen, Germany

More information

Aspects of the practical application of ensemble-based Kalman filters

Aspects of the practical application of ensemble-based Kalman filters Aspects of the practical application of ensemble-based Kalman filters Lars Nerger Alfred Wegener Institute for Polar and Marine Research Bremerhaven, Germany and Bremen Supercomputing Competence Center

More information

An Ensemble Kalman Smoother for Nonlinear Dynamics

An Ensemble Kalman Smoother for Nonlinear Dynamics 1852 MONTHLY WEATHER REVIEW VOLUME 128 An Ensemble Kalman Smoother or Nonlinear Dynamics GEIR EVENSEN Nansen Environmental and Remote Sensing Center, Bergen, Norway PETER JAN VAN LEEUWEN Institute or Marine

More information

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi 4th EnKF Workshop, April 2010 Relationship

More information

Ensemble square-root filters

Ensemble square-root filters Ensemble square-root filters MICHAEL K. TIPPETT International Research Institute for climate prediction, Palisades, New Yor JEFFREY L. ANDERSON GFDL, Princeton, New Jersy CRAIG H. BISHOP Naval Research

More information

Handling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model

Handling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model Handling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model Shu-Chih Yang 1*, Eugenia Kalnay, and Brian Hunt 1. Department of Atmospheric Sciences, National Central

More information

Ensemble Data Assimilation and Uncertainty Quantification

Ensemble Data Assimilation and Uncertainty Quantification Ensemble Data Assimilation and Uncertainty Quantification Jeff Anderson National Center for Atmospheric Research pg 1 What is Data Assimilation? Observations combined with a Model forecast + to produce

More information

Parametric Problems, Stochastics, and Identification

Parametric Problems, Stochastics, and Identification Parametric Problems, Stochastics, and Identification Hermann G. Matthies a B. Rosić ab, O. Pajonk ac, A. Litvinenko a a, b University of Kragujevac c SPT Group, Hamburg wire@tu-bs.de http://www.wire.tu-bs.de

More information

Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2)

Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2) Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2) Time series curves 500hPa geopotential Correlation coefficent of forecast anomaly N Hemisphere Lat 20.0 to 90.0

More information

Advances and Challenges in Ensemblebased Data Assimilation in Meteorology. Takemasa Miyoshi

Advances and Challenges in Ensemblebased Data Assimilation in Meteorology. Takemasa Miyoshi January 18, 2013, DA Workshop, Tachikawa, Japan Advances and Challenges in Ensemblebased Data Assimilation in Meteorology Takemasa Miyoshi RIKEN Advanced Institute for Computational Science Takemasa.Miyoshi@riken.jp

More information

Finite-size ensemble Kalman filters (EnKF-N)

Finite-size ensemble Kalman filters (EnKF-N) Finite-size ensemble Kalman filters (EnKF-N) Marc Bocquet (1,2), Pavel Sakov (3,4) (1) Université Paris-Est, CEREA, joint lab École des Ponts ParisTech and EdF R&D, France (2) INRIA, Paris-Rocquencourt

More information

Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF

Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF Javier Amezcua, Dr. Kayo Ide, Dr. Eugenia Kalnay 1 Outline

More information

Bayesian Inverse problem, Data assimilation and Localization

Bayesian Inverse problem, Data assimilation and Localization Bayesian Inverse problem, Data assimilation and Localization Xin T Tong National University of Singapore ICIP, Singapore 2018 X.Tong Localization 1 / 37 Content What is Bayesian inverse problem? What is

More information

4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données

4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données Four-Dimensional Ensemble-Variational Data Assimilation 4DEnVar Colloque National sur l'assimilation de données Andrew Lorenc, Toulouse France. 1-3 décembre 2014 Crown copyright Met Office 4DEnVar: Topics

More information

Nonlinear Ensemble Data Assimilation for the Ocean

Nonlinear Ensemble Data Assimilation for the Ocean Nonlinear Ensemble Data Assimilation for the Ocean Peter Jan van Leeuwen Institute for Marine and Atmospheric research Utrecht (IMAU) Utrecht University, P.O.Box 85, 358 TA Utrecht, The Netherlands leeuwen@phys.uu.nl

More information

Ensemble variational assimilation as a probabilistic estimator Part 1: The linear and weak non-linear case

Ensemble variational assimilation as a probabilistic estimator Part 1: The linear and weak non-linear case Nonlin. Processes Geophys., 25, 565 587, 28 https://doi.org/.594/npg-25-565-28 Author(s) 28. This work is distributed under the Creative Commons Attribution 4. License. Ensemble variational assimilation

More information

Review of Covariance Localization in Ensemble Filters

Review of Covariance Localization in Ensemble Filters NOAA Earth System Research Laboratory Review of Covariance Localization in Ensemble Filters Tom Hamill NOAA Earth System Research Lab, Boulder, CO tom.hamill@noaa.gov Canonical ensemble Kalman filter update

More information

Performance of ensemble Kalman filters with small ensembles

Performance of ensemble Kalman filters with small ensembles Performance of ensemble Kalman filters with small ensembles Xin T Tong Joint work with Andrew J. Majda National University of Singapore Sunday 28 th May, 2017 X.Tong EnKF performance 1 / 31 Content Ensemble

More information

Adaptive ensemble Kalman filtering of nonlinear systems. Tyrus Berry and Timothy Sauer George Mason University, Fairfax, VA 22030

Adaptive ensemble Kalman filtering of nonlinear systems. Tyrus Berry and Timothy Sauer George Mason University, Fairfax, VA 22030 Generated using V3.2 of the official AMS LATEX template journal page layout FOR AUTHOR USE ONLY, NOT FOR SUBMISSION! Adaptive ensemble Kalman filtering of nonlinear systems Tyrus Berry and Timothy Sauer

More information

Organization. I MCMC discussion. I project talks. I Lecture.

Organization. I MCMC discussion. I project talks. I Lecture. Organization I MCMC discussion I project talks. I Lecture. Content I Uncertainty Propagation Overview I Forward-Backward with an Ensemble I Model Reduction (Intro) Uncertainty Propagation in Causal Systems

More information

Par$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading

Par$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Par$cle Filters Part I: Theory Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Reading July 2013 Why Data Assimila$on Predic$on Model improvement: - Parameter es$ma$on

More information

4. DATA ASSIMILATION FUNDAMENTALS

4. DATA ASSIMILATION FUNDAMENTALS 4. DATA ASSIMILATION FUNDAMENTALS... [the atmosphere] "is a chaotic system in which errors introduced into the system can grow with time... As a consequence, data assimilation is a struggle between chaotic

More information

A new Hierarchical Bayes approach to ensemble-variational data assimilation

A new Hierarchical Bayes approach to ensemble-variational data assimilation A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander

More information

Environment Canada s Regional Ensemble Kalman Filter

Environment Canada s Regional Ensemble Kalman Filter Environment Canada s Regional Ensemble Kalman Filter May 19, 2014 Seung-Jong Baek, Luc Fillion, Kao-Shen Chung, and Peter Houtekamer Meteorological Research Division, Environment Canada, Dorval, Quebec

More information

Lecture 16: State Space Model and Kalman Filter Bus 41910, Time Series Analysis, Mr. R. Tsay

Lecture 16: State Space Model and Kalman Filter Bus 41910, Time Series Analysis, Mr. R. Tsay Lecture 6: State Space Model and Kalman Filter Bus 490, Time Series Analysis, Mr R Tsay A state space model consists of two equations: S t+ F S t + Ge t+, () Z t HS t + ɛ t (2) where S t is a state vector

More information

Uncertainty in Models of the Ocean and Atmosphere

Uncertainty in Models of the Ocean and Atmosphere Uncertainty in Models of the Ocean and Atmosphere Robert N. Miller College of Oceanic and Atmospheric Sciences Oregon State University Corvallis, OR 97330 Uncertainty in Models of the Ocean and Atmosphere

More information

Ensemble Kalman filters, Sequential Importance Resampling and beyond

Ensemble Kalman filters, Sequential Importance Resampling and beyond Ensemble Kalman filters, Sequential Importance Resampling and beyond Peter Jan van Leeuwen Institute for Marine and Atmospheric research Utrecht (IMAU) Utrecht University, P.O.Box 80005, 3508 TA Utrecht,

More information

Sequential data assimilation techniques in oceanography

Sequential data assimilation techniques in oceanography Sequential data assimilation techniques in oceanography Laurent BERTINO, Geir EVENSEN, Hans WACKERNAGEL Nansen Environmental and Remote Sensing Center, Norway Centre de Géostatistique, Ecole des Mines

More information

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi ECODYC10, Dresden 28 January 2010 Relationship

More information

Localization and Correlation in Ensemble Kalman Filters

Localization and Correlation in Ensemble Kalman Filters Localization and Correlation in Ensemble Kalman Filters Jeff Anderson NCAR Data Assimilation Research Section The National Center for Atmospheric Research is sponsored by the National Science Foundation.

More information

On the convergence of (ensemble) Kalman filters and smoothers onto the unstable subspace

On the convergence of (ensemble) Kalman filters and smoothers onto the unstable subspace On the convergence of (ensemble) Kalman filters and smoothers onto the unstable subspace Marc Bocquet CEREA, joint lab École des Ponts ParisTech and EdF R&D, Université Paris-Est, France Institut Pierre-Simon

More information

Applications of an ensemble Kalman Filter to regional ocean modeling associated with the western boundary currents variations

Applications of an ensemble Kalman Filter to regional ocean modeling associated with the western boundary currents variations Applications of an ensemble Kalman Filter to regional ocean modeling associated with the western boundary currents variations Miyazawa, Yasumasa (JAMSTEC) Collaboration with Princeton University AICS Data

More information

Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter

Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter Jon Poterjoy, Ryan Sobash, and Jeffrey Anderson National Center for Atmospheric Research

More information

Local Ensemble Transform Kalman Filter

Local Ensemble Transform Kalman Filter Local Ensemble Transform Kalman Filter Brian Hunt 11 June 2013 Review of Notation Forecast model: a known function M on a vector space of model states. Truth: an unknown sequence {x n } of model states

More information

Combining geostatistics and Kalman filtering for data assimilation in an estuarine system

Combining geostatistics and Kalman filtering for data assimilation in an estuarine system INSTITUTE OF PHYSICS PUBLISHING Inverse Problems 18 (2002) 1 23 INVERSE PROBLEMS PII: S0266-5611(02)20832-1 Combining geostatistics and Kalman filtering for data assimilation in an estuarine system Laurent

More information

Accepted in Tellus A 2 October, *Correspondence

Accepted in Tellus A 2 October, *Correspondence 1 An Adaptive Covariance Inflation Error Correction Algorithm for Ensemble Filters Jeffrey L. Anderson * NCAR Data Assimilation Research Section P.O. Box 3000 Boulder, CO 80307-3000 USA Accepted in Tellus

More information

What do we know about EnKF?

What do we know about EnKF? What do we know about EnKF? David Kelly Kody Law Andrew Stuart Andrew Majda Xin Tong Courant Institute New York University New York, NY April 10, 2015 CAOS seminar, Courant. David Kelly (NYU) EnKF April

More information

Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit

Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit Evan Kwiatkowski, Jan Mandel University of Colorado Denver December 11, 2014 OUTLINE 2 Data Assimilation Bayesian Estimation

More information

Data assimilation; comparison of 4D-Var and LETKF smoothers

Data assimilation; comparison of 4D-Var and LETKF smoothers Data assimilation; comparison of 4D-Var and LETKF smoothers Eugenia Kalnay and many friends University of Maryland CSCAMM DAS13 June 2013 Contents First part: Forecasting the weather - we are really getting

More information

Data Assimilation for Dispersion Models

Data Assimilation for Dispersion Models Data Assimilation for Dispersion Models K. V. Umamaheswara Reddy Dept. of Mechanical and Aerospace Engg. State University of New Yor at Buffalo Buffalo, NY, U.S.A. venatar@buffalo.edu Yang Cheng Dept.

More information

Maximum Likelihood Ensemble Filter Applied to Multisensor Systems

Maximum Likelihood Ensemble Filter Applied to Multisensor Systems Maximum Likelihood Ensemble Filter Applied to Multisensor Systems Arif R. Albayrak a, Milija Zupanski b and Dusanka Zupanski c abc Colorado State University (CIRA), 137 Campus Delivery Fort Collins, CO

More information

Bred vectors: theory and applications in operational forecasting. Eugenia Kalnay Lecture 3 Alghero, May 2008

Bred vectors: theory and applications in operational forecasting. Eugenia Kalnay Lecture 3 Alghero, May 2008 Bred vectors: theory and applications in operational forecasting. Eugenia Kalnay Lecture 3 Alghero, May 2008 ca. 1974 Central theorem of chaos (Lorenz, 1960s): a) Unstable systems have finite predictability

More information

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data John Harlim and Brian R. Hunt Department of Mathematics and Institute for Physical Science and Technology University

More information

Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters

Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters 1042 M O N T H L Y W E A T H E R R E V I E W VOLUME 136 Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters PAVEL SAKOV AND PETER R. OKE CSIRO Marine and Atmospheric

More information

DATA ASSIMILATION FOR FLOOD FORECASTING

DATA ASSIMILATION FOR FLOOD FORECASTING DATA ASSIMILATION FOR FLOOD FORECASTING Arnold Heemin Delft University of Technology 09/16/14 1 Data assimilation is the incorporation of measurement into a numerical model to improve the model results

More information