The Ensemble Kalman Filter:

Similar documents
The Ensemble Kalman Filter:

Ensemble Kalman Filter

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation

The Ensemble Kalman Filter: Theoretical Formulation and Practical Implementation

Analysis Scheme in the Ensemble Kalman Filter

Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC

Gaussian Filtering Strategies for Nonlinear Systems

Autonomous Navigation for Flying Robots

The Ensemble Kalman Filter: theoretical formulation and practical implementation

6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter

Kalman Filter and Ensemble Kalman Filter

Smoothers: Types and Benchmarks

Geir Evensen Data Assimilation

Geir Evensen Data Assimilation

A demonstration of ensemble-based assimilation methods with a layered OGCM from the perspective of operational ocean forecasting systems

A Note on the Particle Filter with Posterior Gaussian Resampling

Four-dimensional ensemble Kalman filtering

SPE History Matching Using the Ensemble Kalman Filter on a North Sea Field Case

The Kalman Filter ImPr Talk

Asynchronous data assimilation

Stability of Ensemble Kalman Filters

Data assimilation in high dimensions

Practical Aspects of Ensemble-based Kalman Filters

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Ensemble square-root filters

Relative Merits of 4D-Var and Ensemble Kalman Filter

Organization. I MCMC discussion. I project talks. I Lecture.

Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics

Data Assimilation for Dispersion Models

Bayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e.

The Canadian approach to ensemble prediction

An Ensemble Kalman Smoother for Nonlinear Dynamics

Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows

Aspects of the practical application of ensemble-based Kalman filters

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF

A Comparison of Error Subspace Kalman Filters

Accepted in Tellus A 2 October, *Correspondence

Data assimilation in the geosciences An overview

Stochastic Collocation Methods for Polynomial Chaos: Analysis and Applications

Environment Canada s Regional Ensemble Kalman Filter

arxiv: v1 [physics.ao-ph] 23 Jan 2009

Localization and Correlation in Ensemble Kalman Filters

Data Assimilation with the Ensemble Kalman Filter and the SEIK Filter applied to a Finite Element Model of the North Atlantic

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter

Methods of Data Assimilation and Comparisons for Lagrangian Data

Four-Dimensional Ensemble Kalman Filtering

Nonlinear and/or Non-normal Filtering. Jesús Fernández-Villaverde University of Pennsylvania

Short tutorial on data assimilation

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm

A Dressed Ensemble Kalman Filter Using the Hybrid Coordinate Ocean Model in the Pacific

Lecture 2: From Linear Regression to Kalman Filter and Beyond

Local Ensemble Transform Kalman Filter

Data assimilation in high dimensions

Balanced multivariate model errors of an intermediate coupled model for ensemble Kalman filter data assimilation

Sequential data assimilation techniques in oceanography

Fundamentals of Data Assimila1on

Ergodicity in data assimilation methods

Convergence of the Ensemble Kalman Filter in Hilbert Space

Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF

Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF

Fundamentals of Data Assimilation

State and Parameter Estimation in Stochastic Dynamical Models

Par$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading

Gaussian Process Approximations of Stochastic Differential Equations

Adaptive ensemble Kalman filtering of nonlinear systems

Review of Covariance Localization in Ensemble Filters

A Spectral Approach to Linear Bayesian Updating

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Estimation of positive sum-to-one constrained parameters with ensemble-based Kalman filters: application to an ocean ecosystem model

Robust Ensemble Filtering With Improved Storm Surge Forecasting

Assimilation des Observations et Traitement des Incertitudes en Météorologie

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA

Localization in the ensemble Kalman Filter

STA414/2104 Statistical Methods for Machine Learning II

Probabilistic Graphical Models

Application of the Ensemble Kalman Filter to History Matching

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data

Sequential data assimilation techniques in oceanography

Abstract 2. ENSEMBLE KALMAN FILTERS 1. INTRODUCTION

Fundamentals of Data Assimila1on

Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP

Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP

Ensemble Kalman Filtering for State and Parameter Estimation on a Reservoir Model

Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter

Assimilating Altimetry Data into a HYCOM Model of the Pacific: Ensemble Optimal Interpolation versus Ensemble Kalman Filter

The Kalman Filter. Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience. Sarah Dance

SIMON FRASER UNIVERSITY School of Engineering Science

Nonlinear variational inverse problems

Reservoir Monitoring and Continuous Model Updating Using Ensemble Kalman Filter

Monte Carlo Simulation. CWR 6536 Stochastic Subsurface Hydrology

Maximum Likelihood Ensemble Filter Applied to Multisensor Systems

Data assimilation; comparison of 4D-Var and LETKF smoothers

An Ensemble Kalman Filter with a 1{D Marine Ecosystem Model Mette Eknes and Geir Evensen Nansen Environmental and Remote Sensing Center, Bergen, Norwa

Sampling versus optimization in very high dimensional parameter spaces

Adaptive ensemble Kalman filtering of nonlinear systems. Tyrus Berry and Timothy Sauer George Mason University, Fairfax, VA 22030

Efficient Data Assimilation for Spatiotemporal Chaos: a Local Ensemble Transform Kalman Filter

Ensemble variational assimilation as a probabilistic estimator Part 1: The linear and weak non-linear case

DATA ASSIMILATION FOR FLOOD FORECASTING

Transcription:

p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen, Ocean Dynamics, Vol 5, No

p. The Ensemble Kalman Filter (EnKF) Represents error statistics using an ensemble of model states Evolves error statistics by ensemble integrations Variance minimizing analysis scheme operating on the ensemble Monte Carlo, low rank, error subspace method Converges to the Kalman Filter with increasing ensemble size Fully nonlinear error evolution, contrary to EKF Assumption of Gaussian statistics in analysis scheme

p. The error covariance matrix Define ensemble covariances around the ensemble mean The ensemble mean is the best-guess. The ensemble spread defines the error variance. The covariance is determined by the smoothness of the ensemble members. A covariance matrix can be represented by an ensemble of model states (not unique).

p. Dynamical evolution of error statistics Each ensemble member evolve according to the model dynamics which is expressed by a stochastic differential equation d The probability density then evolve according to Kolmogorov s equation! This is the fundamental equation for evolution of error statistics and can be solved using Monte Carlo methods.

# $ & p.5 Analysis scheme (1) Given an ensemble of model forcasts Create an ensemble of observations. %$ # # with the first guess observations, a vector of observation noise. The measurement error covariance matrix is $ $ &('

* *, + *, + ' ' p.6 Analysis scheme () Update each ensemble member according to # ) ' where /. - ' * ) ' This is equivalent to updating the mean * # ) ' The posterior error covariance becomes 1

7 6 5 9 7 5 8 8 6 7 5 6 ; p.7 Analysis of the Analysis scheme (1) Define the ensemble matrix :; ) The ensemble mean is (defining 8 The ensemble perturbations becomes 1 becomes The ensemble covariance matrix =

# ;? # ; p.8 Analysis equation (), define 5> Given a vector of measurements %$ # # stored in 7 > 5 # # The ensemble perturbations are stored in 7 > 5 $ $ $ thus, the measurement error covariance matrix becomes &

. p.9 Analysis equation () The analysis equation can now be written /. & Defining the innovations previous definitions: and using i.e., analysis expressed entirely in terms of the ensemble

Practical computation of analysis (1) Use pseudo inverse A B A C. A B. A Computational cost is: D ; to form, E D for eigenvalue decomposition. Unafordable for large D! p.1

Practical computation of analysis () Note that 9 F, thus Compute SVD, HG I, giving HG I HI G HG H G Computational cost is E D ; for SVD. p.11

Practical computation of analysis () The analysis equation can now be written G B. G The computation goes as follows with J K ; B. G 5 7> D J 5 7 D ; J L G 5 > 7 D ; J M L 5 7 D ; ; M 5 6 7 N ; ; All D ; computations reduced to D ;. p.1

9 1 1 O M 8 M M L p.1 Practical computation of analysis () The final update can be written as O thus, the analysis is a weakly nonlinear combination of the forecast ensemble. Note also ;

O O p.1 Remarks on the analysis equation (1) Covariances only needed between observed variables at measurement locations. Covariances never computed but indirectly used to determine. Analysis may be interpreted as: combination of ensemble members, or, forecast pluss combination of covariance functions. Covariances only needed to compute Accuracy of analysis is determined by the accuracy of the properties of the ensemble error space.

p.15 Remarks on the analysis equation () For a linear model, any choice of analysis which is also a solution of the model. Filtering of covariance functions introduces nondynamical modes in the analysis. O will result in an

O p.16 Local analysis A local analysis is computed grid point by grid point using only nearby measurements. Introduces nondynamical modes in the analysis. Different for each grid point. Allows us to reach a larger class of solutions.

P # P 7 R > 5. p.17 Nonlinear measurements Measurement equation $ P Define ensemble of model prediction of the measurements Q The analysis then becomes Q Q Q Q Analysis based on covariances between P and.

O p.18 Ensemble Kalman Smoother (EnKS) Starts with EnKF solution. Computes updates backward in time; sequentially for each measurement time, using covariances in time, no backward integrations. The analysis becomes for. : KVU TS K U _^ ][ WZY \[ XWZY

p.19 Some recent applications of the EnKF Haugan and Evensen (), Ocean Dynamics. Mitchell et al. (), MWR. Brusdal et al (), JMS. Natvik and Evensen (a,b), JMS. Keppenne and Rienecker (), JMS. DIADEM project TOPAZ project (topaz.nersc.no) MERSEA project

h Time correlated model noise Scalar model. gfu a a `U. `U e`u bdc U. U p.

i Results ( ) 1-1 - - - 1 5 6 7 8 9 1 Time p.1

i Results ( j) 1-1 - - - 1 5 6 7 8 9 1 Time p.

Estimate of model noise, EnKF 1 1-1 - -1 - - - 1 5 6 7 8 9 1 Time p.

Estimate of model noise, EnKS 1-1 - 1 5 6 7 8 9 1 Time p.

k Model forced by estimated model error k e `U bdc U. U ml ml p.5

Š Š z Parameter and bias estimation in model n U Introduces poorly known parameter z ryx ˆ~ w z wqryx upu opo { upu z s ryx qr ƒ { s r { ~} { t ryx opo v upu qr s r t r opo p.6

p.7 Estimate and model error, EnKF 5 1 1-1 - -1 - - - 1 5 Time

p.8 Estimate and model error, EnKS 5 1-1 - 1 5 Time

p.9 Estimate, model error and bias, EnKF 5 1 1-1 - -1 - - - 1 5 Time

p. Estimate, model error and bias, EnKS 5 1-1 - 1 5 Time

p.1 Estimated bias and std dev 1-1 - 1 5 Time