Observability, a Problem in Data Assimilation

Size: px
Start display at page:

Download "Observability, a Problem in Data Assimilation"

Transcription

1 Observability, Data Assimilation with the Extended Kalman Filter 1 Observability, a Problem in Data Assimilation Chris Danforth Department of Applied Mathematics and Scientific Computation, UMD March 10, 2004 Advisors Joaquim Ballabrera, UMD/ESSIC James Yorke, UMD/IPST Eugenia Kalnay, UMD/METO D.J. Patil, UMD/IPST Bob Cahalan, NASA/GSFC

2 Observability, Data Assimilation with the Extended Kalman Filter 2 Sources of Numerical Forecast Error Displacement error (standard chaos) initial conditions are approximate indistinguishable conditions of the atmosphere diverge Model error improper physical parameterizations sub-grid scale phenomena

3 Observability, Data Assimilation with the Extended Kalman Filter 3 Ensemble Forecasts and Shadowing

4 Observability, Data Assimilation with the Extended Kalman Filter 4 Ensemble Forecasts and Shadowing

5 Observability, Data Assimilation with the Extended Kalman Filter 5 Ensemble Forecasts and Shadowing

6 Observability, Data Assimilation with the Extended Kalman Filter 6 Ensemble Forecasts and Shadowing

7 Observability, Data Assimilation with the Extended Kalman Filter 7 Model Error and Nudging Conservation law q t = F(q)

8 Observability, Data Assimilation with the Extended Kalman Filter 8 Conservation law Model Error and Nudging q t = F(q) Nudge model forecast to truth through relaxation q t = F(q) + q obs q τ

9 Observability, Data Assimilation with the Extended Kalman Filter 9 Conservation law Model Error and Nudging q t = F(q) Nudge model forecast to truth through relaxation q t = F(q) + q obs q τ Hourly nudging terms correct state-dependent tendency error Time-averaged nudging terms represent systematic model error

10 Observability, Data Assimilation with the Extended Kalman Filter 10 Data Assimilation Data Assimilation Cycle: Start with best guess of initial conditions, background Integrate model to generate prediction, forecast Make measurements of truth, observations Combine model prediction with observations, analysis

11 Observability, Data Assimilation with the Extended Kalman Filter 11 Data Assimilation Data Assimilation Cycle: Start with best guess of initial conditions, background Integrate model to generate prediction, forecast Make measurements of truth, observations Combine model prediction with observations, analysis Sources of difficulty: Model grid vs observational grid Model variables vs observations Observability : Does the model respond to measurements?

12 Observability, Data Assimilation with the Extended Kalman Filter 12 Kalman Filter Analysis cycle: Combine forecast with observations K [ o H f ] + f = a Operator H transforms model forecast state f into the space of observation o Kalman Gain matrix K weights the observational increment with knowledge of confidence in measurements and forecast Analysis state a is our new best guess

13 Observability, Data Assimilation with the Extended Kalman Filter 13 Lorenz Model dx dt = σy(t) σx(t) dy dt = ρx(t) x(t)z(t) y(t) dz dt = x(t)y(t) βz(t) Solutions represent simplified convection in the atmosphere Chaotic for certain parameter values Suitable for testing data assimilation techniques

14 Observability, Data Assimilation with the Extended Kalman Filter 14 Twin Experiments Generate reference state (truth) from model integration of an arbitrary initial condition Start forecast from a different arbitrary initial state Observe truth at relevant time steps, combine with forecast Generate analysis (best estimate) of current state Does the forecast stay close to the truth?

15 Observability, Data Assimilation with the Extended Kalman Filter 15 Plot of y(t), assimilating x every two time steps

16 Observability, Data Assimilation with the Extended Kalman Filter 16 Relative Error remains small observing x,y and combinations

17 Observability, Data Assimilation with the Extended Kalman Filter 17 Plot of x(t), assimilating z every time step

18 Observability, Data Assimilation with the Extended Kalman Filter 18 Observability Conclusions The EKF fails to push forecasts to truth in the classic toy weather model of Lorenz, when measuring the variable z Nonlinear systems do not necessarily respond to assimilation of all state variables, not all measurements are the same! Operational weather models need to be tested for observability

19 Observability, Data Assimilation with the Extended Kalman Filter 19 Current Work Researching 40-d Lorenz model to develop techniques of ensemble variance inflation Model error experiments with Marshall and Molteni global 3-level QG model show nudging terms correct model bias Displacement error and model error cooperate to destroy weather forecasts......to keep the truth contained within our ensemble ellipse, and to evaluate/ correct model error, we MUST effectively assimilate accurate and representative observations!

20 Observability, Data Assimilation with the Extended Kalman Filter 20 References [1] Robert Miller, Michael Ghil, Francois Gauthiez, Advanced Data Assimilation in Strongly Nonlinear Dynamical Systems, Journal of the Atmospheric Sciences, Vol. 51, No. 8, April [2] Eugenia Kalnay, Atmospheric Modeling, Data Assimilation and Predictability, Cambridge University Press, 2002 [3] Edward Lorenz, Predictability - a problem partly solved, in Predictability, edited by T. Palmer, European Centre for Medium- Range Weather Forecasting, Shinfield Park, Reading, UK, [4] D.J. Patil, E. Ott, B.R. Hunt, E.Kalnay, J.A. Yorke, Local low dimensionality of atmospheric dynamics, Physical Review Letters, Vol. 86, No 26, 2001, The End Thank you Contact: danforth@math.umd.edu

Bred vectors: theory and applications in operational forecasting. Eugenia Kalnay Lecture 3 Alghero, May 2008

Bred vectors: theory and applications in operational forecasting. Eugenia Kalnay Lecture 3 Alghero, May 2008 Bred vectors: theory and applications in operational forecasting. Eugenia Kalnay Lecture 3 Alghero, May 2008 ca. 1974 Central theorem of chaos (Lorenz, 1960s): a) Unstable systems have finite predictability

More information

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi 4th EnKF Workshop, April 2010 Relationship

More information

Adaptive ensemble Kalman filtering of nonlinear systems

Adaptive ensemble Kalman filtering of nonlinear systems Adaptive ensemble Kalman filtering of nonlinear systems Tyrus Berry George Mason University June 12, 213 : Problem Setup We consider a system of the form: x k+1 = f (x k ) + ω k+1 ω N (, Q) y k+1 = h(x

More information

A Comparative Study of 4D-VAR and a 4D Ensemble Kalman Filter: Perfect Model Simulations with Lorenz-96

A Comparative Study of 4D-VAR and a 4D Ensemble Kalman Filter: Perfect Model Simulations with Lorenz-96 Tellus 000, 000 000 (0000) Printed 20 October 2006 (Tellus LATEX style file v2.2) A Comparative Study of 4D-VAR and a 4D Ensemble Kalman Filter: Perfect Model Simulations with Lorenz-96 Elana J. Fertig

More information

Comparison of 3D-Var and LETKF in an Atmospheric GCM: SPEEDY

Comparison of 3D-Var and LETKF in an Atmospheric GCM: SPEEDY Comparison of 3D-Var and LEKF in an Atmospheric GCM: SPEEDY Catherine Sabol Kayo Ide Eugenia Kalnay, akemasa Miyoshi Weather Chaos, UMD 9 April 2012 Outline SPEEDY Formulation Single Observation Eperiments

More information

Chapter 6: Ensemble Forecasting and Atmospheric Predictability. Introduction

Chapter 6: Ensemble Forecasting and Atmospheric Predictability. Introduction Chapter 6: Ensemble Forecasting and Atmospheric Predictability Introduction Deterministic Chaos (what!?) In 1951 Charney indicated that forecast skill would break down, but he attributed it to model errors

More information

We honor Ed Lorenz ( ) who started the whole new science of predictability

We honor Ed Lorenz ( ) who started the whole new science of predictability Atmospheric Predictability: From Basic Theory to Forecasting Practice. Eugenia Kalnay Alghero, May 2008, Lecture 1 We honor Ed Lorenz (1917-2008) who started the whole new science of predictability Ed

More information

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi ECODYC10, Dresden 28 January 2010 Relationship

More information

Some ideas for Ensemble Kalman Filter

Some ideas for Ensemble Kalman Filter Some ideas for Ensemble Kalman Filter Former students and Eugenia Kalnay UMCP Acknowledgements: UMD Chaos-Weather Group: Brian Hunt, Istvan Szunyogh, Ed Ott and Jim Yorke, Kayo Ide, and students Former

More information

Ensemble Kalman Filter potential

Ensemble Kalman Filter potential Ensemble Kalman Filter potential Former students (Shu-Chih( Yang, Takemasa Miyoshi, Hong Li, Junjie Liu, Chris Danforth, Ji-Sun Kang, Matt Hoffman), and Eugenia Kalnay University of Maryland Acknowledgements:

More information

Edward Lorenz: Predictability

Edward Lorenz: Predictability Edward Lorenz: Predictability Master Literature Seminar, speaker: Josef Schröttle Edward Lorenz in 1994, Northern Hemisphere, Lorenz Attractor I) Lorenz, E.N.: Deterministic Nonperiodic Flow (JAS, 1963)

More information

Data Assimilation: Finding the Initial Conditions in Large Dynamical Systems. Eric Kostelich Data Mining Seminar, Feb. 6, 2006

Data Assimilation: Finding the Initial Conditions in Large Dynamical Systems. Eric Kostelich Data Mining Seminar, Feb. 6, 2006 Data Assimilation: Finding the Initial Conditions in Large Dynamical Systems Eric Kostelich Data Mining Seminar, Feb. 6, 2006 kostelich@asu.edu Co-Workers Istvan Szunyogh, Gyorgyi Gyarmati, Ed Ott, Brian

More information

Four-Dimensional Ensemble Kalman Filtering

Four-Dimensional Ensemble Kalman Filtering Four-Dimensional Ensemble Kalman Filtering B.R. Hunt, E. Kalnay, E.J. Kostelich, E. Ott, D.J. Patil, T. Sauer, I. Szunyogh, J.A. Yorke, A.V. Zimin University of Maryland, College Park, MD 20742, USA Ensemble

More information

Abstract 2. ENSEMBLE KALMAN FILTERS 1. INTRODUCTION

Abstract 2. ENSEMBLE KALMAN FILTERS 1. INTRODUCTION J5.4 4D ENSEMBLE KALMAN FILTERING FOR ASSIMILATION OF ASYNCHRONOUS OBSERVATIONS T. Sauer George Mason University, Fairfax, VA 22030 B.R. Hunt, J.A. Yorke, A.V. Zimin, E. Ott, E.J. Kostelich, I. Szunyogh,

More information

Coupled Ocean-Atmosphere Assimilation

Coupled Ocean-Atmosphere Assimilation Coupled Ocean-Atmosphere Assimilation Shu-Chih Yang 1, Eugenia Kalnay 2, Joaquim Ballabrera 3, Malaquias Peña 4 1:Department of Atmospheric Sciences, National Central University 2: Department of Atmospheric

More information

Ensemble prediction and strategies for initialization: Tangent Linear and Adjoint Models, Singular Vectors, Lyapunov vectors

Ensemble prediction and strategies for initialization: Tangent Linear and Adjoint Models, Singular Vectors, Lyapunov vectors Ensemble prediction and strategies for initialization: Tangent Linear and Adjoint Models, Singular Vectors, Lyapunov vectors Eugenia Kalnay Lecture 2 Alghero, May 2008 Elements of Ensemble Forecasting

More information

Diagnostics of the prediction and maintenance of Euro-Atlantic blocking

Diagnostics of the prediction and maintenance of Euro-Atlantic blocking Diagnostics of the prediction and maintenance of Euro-Atlantic blocking Mark Rodwell, Laura Ferranti, Linus Magnusson Workshop on Atmospheric Blocking 6-8 April 2016, University of Reading European Centre

More information

Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter

Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY Q. J. R. Meteorol. Soc. 135: 523 533 (2009) Published online 3 February 2009 in Wiley InterScience (www.interscience.wiley.com).371 Simultaneous estimation

More information

Observation impact on data assimilation with dynamic background error formulation

Observation impact on data assimilation with dynamic background error formulation Observation impact on data assimilation with dynamic background error formulation ALEXANDER BECK alexander.beck@univie.ac.at Department of, Univ. Vienna, Austria Thanks to: Martin Ehrendorfer, Patrick

More information

Multivariate Correlations: Applying a Dynamic Constraint and Variable Localization in an Ensemble Context

Multivariate Correlations: Applying a Dynamic Constraint and Variable Localization in an Ensemble Context Multivariate Correlations: Applying a Dynamic Constraint and Variable Localization in an Ensemble Context Catherine Thomas 1,2,3, Kayo Ide 1 Additional thanks to Daryl Kleist, Eugenia Kalnay, Takemasa

More information

Generating climatological forecast error covariance for Variational DAs with ensemble perturbations: comparison with the NMC method

Generating climatological forecast error covariance for Variational DAs with ensemble perturbations: comparison with the NMC method Generating climatological forecast error covariance for Variational DAs with ensemble perturbations: comparison with the NMC method Matthew Wespetal Advisor: Dr. Eugenia Kalnay UMD, AOSC Department March

More information

Introduction to ensemble forecasting. Eric J. Kostelich

Introduction to ensemble forecasting. Eric J. Kostelich Introduction to ensemble forecasting Eric J. Kostelich SCHOOL OF MATHEMATICS AND STATISTICS MSRI Climate Change Summer School July 21, 2008 Co-workers: Istvan Szunyogh, Brian Hunt, Edward Ott, Eugenia

More information

4D-Var or Ensemble Kalman Filter? TELLUS A, in press

4D-Var or Ensemble Kalman Filter? TELLUS A, in press 4D-Var or Ensemble Kalman Filter? Eugenia Kalnay 1 *, Hong Li 1, Takemasa Miyoshi 2, Shu-Chih Yang 1, and Joaquim Ballabrera-Poy 3 1 University of Maryland, College Park, MD, 20742-2425 2 Numerical Prediction

More information

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm

EnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm Overview 1 2 3 Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation 6th EnKF Purpose EnKF equations localization After the 6th EnKF (2014), I decided with Prof. Zhang to summarize progress

More information

Will it rain? Predictability, risk assessment and the need for ensemble forecasts

Will it rain? Predictability, risk assessment and the need for ensemble forecasts Will it rain? Predictability, risk assessment and the need for ensemble forecasts David Richardson European Centre for Medium-Range Weather Forecasts Shinfield Park, Reading, RG2 9AX, UK Tel. +44 118 949

More information

Data assimilation; comparison of 4D-Var and LETKF smoothers

Data assimilation; comparison of 4D-Var and LETKF smoothers Data assimilation; comparison of 4D-Var and LETKF smoothers Eugenia Kalnay and many friends University of Maryland CSCAMM DAS13 June 2013 Contents First part: Forecasting the weather - we are really getting

More information

Ensemble Assimilation of Global Large-Scale Precipitation

Ensemble Assimilation of Global Large-Scale Precipitation Ensemble Assimilation of Global Large-Scale Precipitation Guo-Yuan Lien 1,2 in collaboration with Eugenia Kalnay 2, Takemasa Miyoshi 1,2 1 RIKEN Advanced Institute for Computational Science 2 University

More information

Improved analyses and forecasts with AIRS retrievals using the Local Ensemble Transform Kalman Filter

Improved analyses and forecasts with AIRS retrievals using the Local Ensemble Transform Kalman Filter Improved analyses and forecasts with AIRS retrievals using the Local Ensemble Transform Kalman Filter Hong Li, Junjie Liu, and Elana Fertig E. Kalnay I. Szunyogh, E. J. Kostelich Weather and Chaos Group

More information

RISE undergraduates find that regime changes in Lorenz s model are predictable

RISE undergraduates find that regime changes in Lorenz s model are predictable RISE undergraduates find that regime changes in Lorenz s model are predictable Erin Evans (1), Nadia Bhatti (1), Jacki Kinney (1,4), Lisa Pann (1), Malaquias Peña (2), Shu-Chih Yang (2), Eugenia Kalnay

More information

Using Singular Value Decomposition to Parameterize. State-Dependent Model Errors

Using Singular Value Decomposition to Parameterize. State-Dependent Model Errors Using Singular Value Decomposition to Parameterize State-Dependent Model Errors Christopher M. Danforth Department of Mathematics and Statistics, University of Vermont Burlington, VT 05401 Eugenia Kalnay

More information

State and Parameter Estimation in Stochastic Dynamical Models

State and Parameter Estimation in Stochastic Dynamical Models State and Parameter Estimation in Stochastic Dynamical Models Timothy DelSole George Mason University, Fairfax, Va and Center for Ocean-Land-Atmosphere Studies, Calverton, MD June 21, 2011 1 1 collaboration

More information

The convection-permitting COSMO-DE-EPS and PEPS at DWD

The convection-permitting COSMO-DE-EPS and PEPS at DWD Deutscher Wetterdienst The convection-permitting COSMO-DE-EPS and PEPS at DWD Detlev Majewski based on Chr. Gebhardt, S. Theis, M. Paulat, M. Buchhold and M. Denhard Deutscher Wetterdienst The model COSMO-DE

More information

6.2 Brief review of fundamental concepts about chaotic systems

6.2 Brief review of fundamental concepts about chaotic systems 6.2 Brief review of fundamental concepts about chaotic systems Lorenz (1963) introduced a 3-variable model that is a prototypical example of chaos theory. These equations were derived as a simplification

More information

Estimating observation impact without adjoint model in an ensemble Kalman filter

Estimating observation impact without adjoint model in an ensemble Kalman filter QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY Q. J. R. Meteorol. Soc. 134: 1327 1335 (28) Published online in Wiley InterScience (www.interscience.wiley.com) DOI: 1.12/qj.28 Estimating observation

More information

Model Uncertainty Quantification for Data Assimilation in partially observed Lorenz 96

Model Uncertainty Quantification for Data Assimilation in partially observed Lorenz 96 Model Uncertainty Quantification for Data Assimilation in partially observed Lorenz 96 Sahani Pathiraja, Peter Jan Van Leeuwen Institut für Mathematik Universität Potsdam With thanks: Sebastian Reich,

More information

The analog data assimilation: method, applications and implementation

The analog data assimilation: method, applications and implementation The analog data assimilation: method, applications and implementation Pierre Tandeo pierre.tandeo@imt-atlantique.fr IMT-Atlantique, Brest, France 16 th of February 2018 Before starting Works in collaboration

More information

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data John Harlim and Brian R. Hunt Department of Mathematics and Institute for Physical Science and Technology University

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Kody Law Andy Majda Andrew Stuart Xin Tong Courant Institute New York University New York NY www.dtbkelly.com February 3, 2016 DPMMS, University of Cambridge

More information

PH36010: Numerical Methods - Evaluating the Lorenz Attractor using Runge-Kutta methods Abstract

PH36010: Numerical Methods - Evaluating the Lorenz Attractor using Runge-Kutta methods Abstract PH36010: Numerical Methods - Evaluating the Lorenz Attractor using Runge-Kutta methods Mr. Benjamen P. Reed (110108461) IMPACS, Aberystwyth University January 31, 2014 Abstract A set of three coupled ordinary

More information

Local Ensemble Transform Kalman Filter

Local Ensemble Transform Kalman Filter Local Ensemble Transform Kalman Filter Brian Hunt 11 June 2013 Review of Notation Forecast model: a known function M on a vector space of model states. Truth: an unknown sequence {x n } of model states

More information

Lagrangian data assimilation for point vortex systems

Lagrangian data assimilation for point vortex systems JOT J OURNAL OF TURBULENCE http://jot.iop.org/ Lagrangian data assimilation for point vortex systems Kayo Ide 1, Leonid Kuznetsov 2 and Christopher KRTJones 2 1 Department of Atmospheric Sciences and Institute

More information

DART_LAB Tutorial Section 5: Adaptive Inflation

DART_LAB Tutorial Section 5: Adaptive Inflation DART_LAB Tutorial Section 5: Adaptive Inflation UCAR 14 The National Center for Atmospheric Research is sponsored by the National Science Foundation. Any opinions, findings and conclusions or recommendations

More information

4D-Var or Ensemble Kalman Filter?

4D-Var or Ensemble Kalman Filter? 4D-Var or Ensemble Kalman Filter? Eugenia Kalnay, Shu-Chih Yang, Hong Li, Junjie Liu, Takemasa Miyoshi,Chris Danforth Department of AOS and Chaos/Weather Group University of Maryland Chaos/Weather group

More information

Forecasting and data assimilation

Forecasting and data assimilation Supported by the National Science Foundation DMS Forecasting and data assimilation Outline Numerical models Kalman Filter Ensembles Douglas Nychka, Thomas Bengtsson, Chris Snyder Geophysical Statistics

More information

Analysis sensitivity calculation in an Ensemble Kalman Filter

Analysis sensitivity calculation in an Ensemble Kalman Filter Analysis sensitivity calculation in an Ensemble Kalman Filter Junjie Liu 1, Eugenia Kalnay 2, Takemasa Miyoshi 2, and Carla Cardinali 3 1 University of California, Berkeley, CA, USA 2 University of Maryland,

More information

A variance limiting Kalman filter for data assimilation: I. Sparse observational grids II. Model error

A variance limiting Kalman filter for data assimilation: I. Sparse observational grids II. Model error A variance limiting Kalman filter for data assimilation: I. Sparse observational grids II. Model error Georg Gottwald, Lewis Mitchell, Sebastian Reich* University of Sydney, *Universität Potsdam Durham,

More information

Parameter Estimation in EnKF: Surface Fluxes of Carbon, Heat, Moisture and Momentum

Parameter Estimation in EnKF: Surface Fluxes of Carbon, Heat, Moisture and Momentum Parameter Estimation in EnKF: Surface Fluxes of Carbon, Heat, Moisture and Momentum *Ji-Sun Kang, *Eugenia Kalnay, *Takemasa Miyoshi, + Junjie Liu, # Inez Fung, *Kayo Ide *University of Maryland, College

More information

Een vlinder in de wiskunde: over chaos en structuur

Een vlinder in de wiskunde: over chaos en structuur Een vlinder in de wiskunde: over chaos en structuur Bernard J. Geurts Enschede, November 10, 2016 Tuin der Lusten (Garden of Earthly Delights) In all chaos there is a cosmos, in all disorder a secret

More information

AMERICAN METEOROLOGICAL SOCIETY

AMERICAN METEOROLOGICAL SOCIETY AMERICAN METEOROLOGICAL SOCIETY Monthly Weather Review EARLY ONLINE RELEASE This is a preliminary PDF of the author-produced manuscript that has been peer-reviewed and accepted for publication. Since it

More information

Ensemble Data Assimilation and Uncertainty Quantification

Ensemble Data Assimilation and Uncertainty Quantification Ensemble Data Assimilation and Uncertainty Quantification Jeff Anderson National Center for Atmospheric Research pg 1 What is Data Assimilation? Observations combined with a Model forecast + to produce

More information

M.Sc. in Meteorology. Numerical Weather Prediction

M.Sc. in Meteorology. Numerical Weather Prediction M.Sc. in Meteorology UCD Numerical Weather Prediction Prof Peter Lynch Meteorology & Climate Cehtre School of Mathematical Sciences University College Dublin Second Semester, 2005 2006. Text for the Course

More information

6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter

6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter 6 Sequential Data Assimilation for Nonlinear Dynamics: The Ensemble Kalman Filter GEIR EVENSEN Nansen Environmental and Remote Sensing Center, Bergen, Norway 6.1 Introduction Sequential data assimilation

More information

6.5 Operational ensemble forecasting methods

6.5 Operational ensemble forecasting methods 6.5 Operational ensemble forecasting methods Ensemble forecasting methods differ mostly by the way the initial perturbations are generated, and can be classified into essentially two classes. In the first

More information

Ji-Sun Kang. Pr. Eugenia Kalnay (Chair/Advisor) Pr. Ning Zeng (Co-Chair) Pr. Brian Hunt (Dean s representative) Pr. Kayo Ide Pr.

Ji-Sun Kang. Pr. Eugenia Kalnay (Chair/Advisor) Pr. Ning Zeng (Co-Chair) Pr. Brian Hunt (Dean s representative) Pr. Kayo Ide Pr. Carbon Cycle Data Assimilation Using a Coupled Atmosphere-Vegetation Model and the LETKF Ji-Sun Kang Committee in charge: Pr. Eugenia Kalnay (Chair/Advisor) Pr. Ning Zeng (Co-Chair) Pr. Brian Hunt (Dean

More information

Aspects of the practical application of ensemble-based Kalman filters

Aspects of the practical application of ensemble-based Kalman filters Aspects of the practical application of ensemble-based Kalman filters Lars Nerger Alfred Wegener Institute for Polar and Marine Research Bremerhaven, Germany and Bremen Supercomputing Competence Center

More information

Ergodicity in data assimilation methods

Ergodicity in data assimilation methods Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation

More information

DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation.

DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation. DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation. UCAR 2014 The National Center for Atmospheric Research is sponsored by the National

More information

Handling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model

Handling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model Handling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model Shu-Chih Yang 1*, Eugenia Kalnay, and Brian Hunt 1. Department of Atmospheric Sciences, National Central

More information

Maximum Likelihood Ensemble Filter Applied to Multisensor Systems

Maximum Likelihood Ensemble Filter Applied to Multisensor Systems Maximum Likelihood Ensemble Filter Applied to Multisensor Systems Arif R. Albayrak a, Milija Zupanski b and Dusanka Zupanski c abc Colorado State University (CIRA), 137 Campus Delivery Fort Collins, CO

More information

Recent Advances in EnKF

Recent Advances in EnKF Recent Advances in EnKF Former students (Shu-Chih( Yang, Takemasa Miyoshi, Hong Li, Junjie Liu, Chris Danforth, Ji-Sun Kang, Matt Hoffman, Steve Penny, Steve Greybush), and Eugenia Kalnay University of

More information

P 1.86 A COMPARISON OF THE HYBRID ENSEMBLE TRANSFORM KALMAN FILTER (ETKF)- 3DVAR AND THE PURE ENSEMBLE SQUARE ROOT FILTER (EnSRF) ANALYSIS SCHEMES

P 1.86 A COMPARISON OF THE HYBRID ENSEMBLE TRANSFORM KALMAN FILTER (ETKF)- 3DVAR AND THE PURE ENSEMBLE SQUARE ROOT FILTER (EnSRF) ANALYSIS SCHEMES P 1.86 A COMPARISON OF THE HYBRID ENSEMBLE TRANSFORM KALMAN FILTER (ETKF)- 3DVAR AND THE PURE ENSEMBLE SQUARE ROOT FILTER (EnSRF) ANALYSIS SCHEMES Xuguang Wang*, Thomas M. Hamill, Jeffrey S. Whitaker NOAA/CIRES

More information

Ensembles and Particle Filters for Ocean Data Assimilation

Ensembles and Particle Filters for Ocean Data Assimilation DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. Ensembles and Particle Filters for Ocean Data Assimilation Robert N. Miller College of Oceanic and Atmospheric Sciences

More information

An introduction to data assimilation. Eric Blayo University of Grenoble and INRIA

An introduction to data assimilation. Eric Blayo University of Grenoble and INRIA An introduction to data assimilation Eric Blayo University of Grenoble and INRIA Data assimilation, the science of compromises Context characterizing a (complex) system and/or forecasting its evolution,

More information

Data assimilation with and without a model

Data assimilation with and without a model Data assimilation with and without a model Tim Sauer George Mason University Parameter estimation and UQ U. Pittsburgh Mar. 5, 2017 Partially supported by NSF Most of this work is due to: Tyrus Berry,

More information

Four-dimensional ensemble Kalman filtering

Four-dimensional ensemble Kalman filtering Tellus (24), 56A, 273 277 Copyright C Blackwell Munksgaard, 24 Printed in UK. All rights reserved TELLUS Four-dimensional ensemble Kalman filtering By B. R. HUNT 1, E. KALNAY 1, E. J. KOSTELICH 2,E.OTT

More information

Accelerating the spin-up of Ensemble Kalman Filtering

Accelerating the spin-up of Ensemble Kalman Filtering Accelerating the spin-up of Ensemble Kalman Filtering Eugenia Kalnay * and Shu-Chih Yang University of Maryland Abstract A scheme is proposed to improve the performance of the ensemble-based Kalman Filters

More information

Quarterly Journal of the Royal Meteorological Society !"#$%&'&(&)"&'*'+'*%(,#$,-$#*'."(/'*0'"(#"(1"&)23$)(4#$2#"( 5'$*)6!

Quarterly Journal of the Royal Meteorological Society !#$%&'&(&)&'*'+'*%(,#$,-$#*'.(/'*0'(#(1&)23$)(4#$2#( 5'$*)6! !"#$%&'&(&)"&'*'+'*%(,#$,-$#*'."(/'*0'"(#"("&)$)(#$#"( '$*)! "#$%&'()!!"#$%&$'()*+"$,#')+-)%.&)/+(#')0&%&+$+'+#')+&%(! *'&$+,%-./!0)! "! :-(;%/-,(;! '/;!?$@A-//;B!@

More information

Data assimilation for the coupled ocean-atmosphere

Data assimilation for the coupled ocean-atmosphere GODAE Ocean View/WGNE Workshop 2013 19 March 2013 Data assimilation for the coupled ocean-atmosphere Eugenia Kalnay, Tamara Singleton, Steve Penny, Takemasa Miyoshi, Jim Carton Thanks to the UMD Weather-Chaos

More information

How does 4D-Var handle Nonlinearity and non-gaussianity?

How does 4D-Var handle Nonlinearity and non-gaussianity? How does 4D-Var handle Nonlinearity and non-gaussianity? Mike Fisher Acknowledgements: Christina Tavolato, Elias Holm, Lars Isaksen, Tavolato, Yannick Tremolet Slide 1 Outline of Talk Non-Gaussian pdf

More information

Simple Doppler Wind Lidar adaptive observation experiments with 3D-Var. and an ensemble Kalman filter in a global primitive equations model

Simple Doppler Wind Lidar adaptive observation experiments with 3D-Var. and an ensemble Kalman filter in a global primitive equations model 1 2 3 4 Simple Doppler Wind Lidar adaptive observation experiments with 3D-Var and an ensemble Kalman filter in a global primitive equations model 5 6 7 8 9 10 11 12 Junjie Liu and Eugenia Kalnay Dept.

More information

Assimilating Nonlocal Observations using a Local Ensemble Kalman Filter

Assimilating Nonlocal Observations using a Local Ensemble Kalman Filter Tellus 000, 000 000 (0000) Printed 16 February 2007 (Tellus LATEX style file v2.2) Assimilating Nonlocal Observations using a Local Ensemble Kalman Filter Elana J. Fertig 1, Brian R. Hunt 1, Edward Ott

More information

The Local Ensemble Transform Kalman Filter (LETKF) Eric Kostelich. Main topics

The Local Ensemble Transform Kalman Filter (LETKF) Eric Kostelich. Main topics The Local Ensemble Transform Kalman Filter (LETKF) Eric Kostelich Arizona State University Co-workers: Istvan Szunyogh, Brian Hunt, Ed Ott, Eugenia Kalnay, Jim Yorke, and many others http://www.weatherchaos.umd.edu

More information

Ensemble Kalman Filter

Ensemble Kalman Filter Ensemble Kalman Filter Geir Evensen and Laurent Bertino Hydro Research Centre, Bergen, Norway, Nansen Environmental and Remote Sensing Center, Bergen, Norway The Ensemble Kalman Filter (EnKF) Represents

More information

Applications of Hurst Coefficient Analysis to Chaotic Response of ODE Systems: Part 1a, The Original Lorenz System of 1963

Applications of Hurst Coefficient Analysis to Chaotic Response of ODE Systems: Part 1a, The Original Lorenz System of 1963 Applications of Hurst Coefficient Analysis to Chaotic Response of ODE Systems: Part 1a, The Original Lorenz System of 1963 Dan Hughes December 2008 Abstract I have coded the process for calculating Hurst

More information

Model error and seasonal forecasting

Model error and seasonal forecasting Model error and seasonal forecasting Antje Weisheimer European Centre for Medium-Range Weather Forecasts ECMWF, Reading, UK with thanks to Paco Doblas-Reyes and Tim Palmer Model error and model uncertainty

More information

ABSTRACT. Numerical weather forecast errors are generated by model deficiencies and by errors in the

ABSTRACT. Numerical weather forecast errors are generated by model deficiencies and by errors in the ABSTRACT Title of dissertation: MAKING FORECASTS FOR CHAOTIC PROCESSES IN THE PRESENCE OF MODEL ERROR Christopher M. Danforth, Doctor of Philosophy, 2006 Dissertation directed by: Professor James A. Yorke

More information

The Use of a Self-Evolving Additive Inflation in the CNMCA Ensemble Data Assimilation System

The Use of a Self-Evolving Additive Inflation in the CNMCA Ensemble Data Assimilation System The Use of a Self-Evolving Additive Inflation in the CNMCA Ensemble Data Assimilation System Lucio Torrisi and Francesca Marcucci CNMCA, Italian National Met Center Outline Implementation of the LETKF

More information

Relative Merits of 4D-Var and Ensemble Kalman Filter

Relative Merits of 4D-Var and Ensemble Kalman Filter Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29

More information

Bred Vectors, Singular Vectors, and Lyapunov Vectors in Simple and Complex Models

Bred Vectors, Singular Vectors, and Lyapunov Vectors in Simple and Complex Models Bred Vectors, Singular Vectors, and Lyapunov Vectors in Simple and Complex Models Adrienne Norwood Advisor: Eugenia Kalnay With special thanks to Drs. Kayo Ide, Brian Hunt, Shu-Chih Yang, and Christopher

More information

Data assimilation with and without a model

Data assimilation with and without a model Data assimilation with and without a model Tyrus Berry George Mason University NJIT Feb. 28, 2017 Postdoc supported by NSF This work is in collaboration with: Tim Sauer, GMU Franz Hamilton, Postdoc, NCSU

More information

Development of the Local Ensemble Transform Kalman Filter

Development of the Local Ensemble Transform Kalman Filter Development of the Local Ensemble Transform Kalman Filter Istvan Szunyogh Institute for Physical Science and Technology & Department of Atmospheric and Oceanic Science AOSC Special Seminar September 27,

More information

Evaluation of mountain drag schemes from regional simulation Steve Garner GFDL

Evaluation of mountain drag schemes from regional simulation Steve Garner GFDL Evaluation of mountain drag schemes from regional simulation Steve Garner GFDL Strategies for evaluating and tuning drag schemes 1. Optimize climate diagnostics (e.g., Palmer et al. 1986) 2. Correct biases

More information

ESTIMATING CORRELATIONS FROM A COASTAL OCEAN MODEL FOR LOCALIZING AN ENSEMBLE TRANSFORM KALMAN FILTER

ESTIMATING CORRELATIONS FROM A COASTAL OCEAN MODEL FOR LOCALIZING AN ENSEMBLE TRANSFORM KALMAN FILTER ESTIMATING CORRELATIONS FROM A COASTAL OCEAN MODEL FOR LOCALIZING AN ENSEMBLE TRANSFORM KALMAN FILTER Jonathan Poterjoy National Weather Center Research Experiences for Undergraduates, Norman, Oklahoma

More information

Introduction to data assimilation and least squares methods

Introduction to data assimilation and least squares methods Introduction to data assimilation and least squares methods Eugenia Kalnay and many friends University of Maryland October 008 (part 1 Contents (1 Forecasting the weather - we are really getting better!

More information

Why are Discrete Maps Sufficient?

Why are Discrete Maps Sufficient? Why are Discrete Maps Sufficient? Why do dynamical systems specialists study maps of the form x n+ 1 = f ( xn), (time is discrete) when much of the world around us evolves continuously, and is thus well

More information

Fundamentals of Data Assimilation

Fundamentals of Data Assimilation National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)

More information

Data Assimilation Research Testbed Tutorial. Section 7: Some Additional Low-Order Models

Data Assimilation Research Testbed Tutorial. Section 7: Some Additional Low-Order Models Data Assimilation Research Testbed Tutorial Section 7: Some Additional Low-Order Models Version.: September, 6 /home/jla/dart_tutorial/dart/tutorial/section7/tut_section7.fm 1 7/13/7 Low-order models in

More information

Nonlinear error dynamics for cycled data assimilation methods

Nonlinear error dynamics for cycled data assimilation methods Nonlinear error dynamics for cycled data assimilation methods A J F Moodey 1, A S Lawless 1,2, P J van Leeuwen 2, R W E Potthast 1,3 1 Department of Mathematics and Statistics, University of Reading, UK.

More information

Methods of Data Assimilation and Comparisons for Lagrangian Data

Methods of Data Assimilation and Comparisons for Lagrangian Data Methods of Data Assimilation and Comparisons for Lagrangian Data Chris Jones, Warwick and UNC-CH Kayo Ide, UCLA Andrew Stuart, Jochen Voss, Warwick Guillaume Vernieres, UNC-CH Amarjit Budiraja, UNC-CH

More information

Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter

Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter Jon Poterjoy, Ryan Sobash, and Jeffrey Anderson National Center for Atmospheric Research

More information

Smoothers: Types and Benchmarks

Smoothers: Types and Benchmarks Smoothers: Types and Benchmarks Patrick N. Raanes Oxford University, NERSC 8th International EnKF Workshop May 27, 2013 Chris Farmer, Irene Moroz Laurent Bertino NERSC Geir Evensen Abstract Talk builds

More information

Gaussian Process Approximations of Stochastic Differential Equations

Gaussian Process Approximations of Stochastic Differential Equations Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run

More information

Observation Bias Correction with an Ensemble Kalman Filter

Observation Bias Correction with an Ensemble Kalman Filter Tellus 000, 000 000 (0000) Printed 10 April 2007 (Tellus LATEX style file v2.2) Observation Bias Correction with an Ensemble Kalman Filter Elana J. Fertig 1, Seung-Jong Baek 2, Brian R. Hunt 1, Edward

More information

Data assimilation with Lorenz 3-variable model. Prepared by Shu-Chih Yang Modified by Juan Ruiz.

Data assimilation with Lorenz 3-variable model. Prepared by Shu-Chih Yang Modified by Juan Ruiz. Data assimilation with Lorenz 3-variable model Prepared by Shu-Chih Yang Modified by Juan Ruiz. Governing equations dx dt dy dt dz dt = σ(y x) = rx y xz = xy bz Lorenz, E. N, 1963: Deterministic nonperiodic

More information

Some Applications of WRF/DART

Some Applications of WRF/DART Some Applications of WRF/DART Chris Snyder, National Center for Atmospheric Research Mesoscale and Microscale Meteorology Division (MMM), and Institue for Mathematics Applied to Geoscience (IMAGe) WRF/DART

More information

Ensemble-based Data Assimilation of TRMM/GPM Precipitation Measurements

Ensemble-based Data Assimilation of TRMM/GPM Precipitation Measurements January 16, 2014, JAXA Joint PI Workshop, Tokyo Ensemble-based Data Assimilation of TRMM/GPM Precipitation Measurements PI: Takemasa Miyoshi RIKEN Advanced Institute for Computational Science Takemasa.Miyoshi@riken.jp

More information

Data Assimilation Research Testbed Tutorial

Data Assimilation Research Testbed Tutorial Data Assimilation Research Testbed Tutorial Section 2: How should observations of a state variable impact an unobserved state variable? Multivariate assimilation. Single observed variable, single unobserved

More information

A mechanism for catastrophic filter divergence in data assimilation for sparse observation networks

A mechanism for catastrophic filter divergence in data assimilation for sparse observation networks Manuscript prepared for Nonlin. Processes Geophys. with version 5. of the L A TEX class copernicus.cls. Date: 5 August 23 A mechanism for catastrophic filter divergence in data assimilation for sparse

More information

(Toward) Scale-dependent weighting and localization for the NCEP GFS hybrid 4DEnVar Scheme

(Toward) Scale-dependent weighting and localization for the NCEP GFS hybrid 4DEnVar Scheme (Toward) Scale-dependent weighting and localization for the NCEP GFS hybrid 4DEnVar Scheme Daryl Kleist 1, Kayo Ide 1, Rahul Mahajan 2, Deng-Shun Chen 3 1 University of Maryland - Dept. of Atmospheric

More information

The forecast skill horizon

The forecast skill horizon The forecast skill horizon Roberto Buizza, Martin Leutbecher, Franco Molteni, Alan Thorpe and Frederic Vitart European Centre for Medium-Range Weather Forecasts WWOSC 2014 (Montreal, Aug 2014) Roberto

More information