Data assimilation didactic examples. User s guide - David Cugnet, 2011
|
|
- Martha Paul
- 5 years ago
- Views:
Transcription
1 Data assimilation didactic examples. User s guide - David Cugnet, 2011 Introduction The present didactic software is using two models: the first one is a simple damped mechanical oscillator, and the second is the Lorenz oscillator. We will focus hereafter on the second one. For more details about the theoretical background, please refer to reference [1]. The Lorenz model In a 1963 article [1], the meteorologist Edward N. Lorenz has for the first time described an example of chaotic non- periodic oscillator obtained by deriving the governing equations of a simplified convective fluid dynamic system. Following Salzman [2], he constructed a truncated Fourier expansion of the physical system, which leads to a set of three differential equations: =. =. +. =.. (1) The key idea is to choose a set of, and parameters such that the oscillator becomes critical and exhibits a so- called chaotic behaviour. This oscillator is now widely known as the Lorenz Oscillator. The most usual set of parameters is the following: = 10 = 8 3 = 28 (2) There are at most three equilibrium points. The first one, the origin, exists whatever the values of the three parameters. The other two, symmetric with respect to the origin, exist for > 1, and are located at:. 1,. 1, 1 and. 1,. 1, 1 (3) The trajectories are rolling around those two last attraction points and switch from one attractor to the other without any apparent intuitive predictability, and the sensitivity to the starting point is very high. This model is rather demanding to test assimilations techniques, but belongs at the same time simple enough to allow testing most of the adjustable parameters, so that one can test the assimilations methods and their parameterization rather than the model itself, and learn useful lessons about the way to deal with more complex and realistic models, in particular meteorological models.
2 Some assimilation algorithms 1. Optimal interpolation Estimation is updated each time a new measurement is available via the relation: (4) = +.., where = The matrix is constant, equal to its initial value (default: climatological matrix). 2. 4D- Var Each measurement within the assimilation window is contributing to a cost function J that has to be minimized to find the optimal starting point. J includes also a term for the initial guess (background), which can be considered as another measurement (in the model space) following another statistic (the background error covariance matrix B). J has the following expression: 1 1 = (5) 2 2 Its minimization requires the gradient. For a small model space like ours, it can be done using a simple finite differences approach. For larger systems, it is mandatory to find an alternative method, because the numerical cost becomes prohibitive. The most popular and efficient method is based on the adjoint model usage. Here, although the model space is quite small (3 parameters for Lorenz oscillator, 2 for damped oscillator), we chose also the adjoint method for its precision and robustness. 3. Incremental 4D- Var This alternative method is widely used for large systems. It allows to solve the problem on a subset of the model space by reduction of the resolution of the increments. It is usually divided into two loops, an internal and an external, helping for massive numerical cost reduction, and uses a simplified low resolution model. Although it could be also implemented for small models, the benefit is very marginal and the present version of the software does not include this method yet (and this is unlikely to change). 4. Extended Kalman Filter The Kalman filter method is very similar to optimal interpolation, but the background covariance error matrix is also updated, so the gain matrix is changing each time a measurement is taken into account. It consists in five stages: State forecast: =. (6.1) Error covariance forecast: =.. + (6.2) Kalman gain computation: = (6.3) State analysis: = +.. (6.4) Error covariance analysis: =.. (6.5) The regular Kalman filters works under the hypothesis that both model M and observation operator are linear, which is not the case for Lorenz model, at least for M. Hence, we use an extended approach: the tangent linear version of M is used instead. Note that equation 6.2 contains, which is the model error covariance matrix. 5. 4D- PSAS (dual formulation of 4D- Var) The basic idea is to rewrite 4D- Var equations in physical space instead of model space. For more details, see [3]. This method isn t included in the present software yet.
3 The software 1. Prerequisite The user must have access to a machine with MATLAB software installed, and of course the Didactic.tgz archive available. 2. Expanding the archive Chose a place to store the archive Didactic.tgz and expand it : with MacOS or a Windows system, using your favourite tool. with a Linux system, using the following command: tar xvzf Didactic.tgz 3. Launching MATLAB with MacOS or a Windows system, just click on the corresponding icon. with a Linux system, use the following terminal command: matlab desktop & Note that if you re connecting to a remote machine, X windows agent has to be activated. To do so, use the X option: ssh X user@machine 4. Selecting the folder containing the code Under the top left menu of the main MATLAB window, click on one of the following: the blue folder if you d like to type the folder path directly the << sign to select one basic place the arrow in the bottom direction to select an already visited place When selection is done, the MATLAB source files names should appear just under the path name. 5. Main GUI window creation 5.1. Launch the software by typing in the matlab main window the following command : Didactic 5.2. Select the model you want to work on by clicking on the adequate knob : We suppose from now the Lorenz model has been selected. Few parameters accessible in the command window are differing from Lorenz to damped oscillators (manly the number of independent variables: 2 instead of three for the damped oscillator). This illustrates the assimilation part is almost independent of the choice of the model.
4 5.3. Selection of the number of experiences to be run together (by default: 2): The following window is appearing : The number can be modified using the keyboard after clicking on the box : All the experiences run together are using the same random numbers, i.e. the same background noise (for starting point, using ) and measurement noise (using ). Numerically, we can add a noise with covariance matrix to vector this way: = +.. (7) has been diagonalized using SVD (Singular Values Decomposition): =.. is a gaussian noise vector with unit variance and zero mean is positive defined, so its eigenvalues are positive real and their square roots also Estimation of the background error covariance matrix The following window appears the time required to compute an approximation of the variance matrix of the system by integrating a trajectory during a long time and calculating variances and co- variances numerically. The matrix obtained using a very long sample (i.e. hundreds of time units, with a time step equal to 0.02 unit) is singular, so we are restricting the integration time to 20 units. This is not fully satisfactory, but enough for our purpose Main GUI command window
5 6. Main parameters 6.1. Assimilation algorithm Roll menu: Available choices: Optimal Interpolation 4D- Var Incremental 4D- Var Extended Kalman Filter Note that the incremental 4D- Var is not implemented yet, so avoid using this option Assimilation window size Roll menu: Available choices: The assimilation window is the time interval observations are available and the integration period for variational algorithms. Time unit corresponds roughly to a full revolution around one of the attractors of Lorenz model Observations spacing and measurement noise variance: Roll menu: Available choices: Fenêtre d édition (bruit) : Spacing is given in model integration time step unit. The default value (0,02 time unit) can be changed via the advanced parameters (see below) Background error statistics (starting point of the trajectory) Exact start: With error: The starting point is exact if the box is checked. Otherwise, a noise (cf. eq. (7)) characterized with climatological scaled with an editable coefficient (in %) is added. 7. Advanced parameters Hidden menus can be revealed by pushing the knob More options on the right: 7.1. Integration time step Can be edited via the window: Keyboard- edited value is rounded ; observations spacing menu is modified accordingly (time steps number between two observations must divide the number in the assimilation) Controlled variables: They can be chosen using this menu: These are the degrees of freedom visible through the observations.
6 7.3. Background and observation error covariance matrix: By default, is set to 0.01 time identity matrix, scaled with an editable coefficient. The user option gives access to Edit knob, that makes full editing possible. The useful coefficients of the matrix only (i.e. for controlled d.o.f) are displayed. See example on the left: coefficients related to uncontrolled y are not accessible. Same principle for the background error covariance matrix. The default value is the climatologic Ensemble methods. This option can be used to produce a set of almost identical simulations. The only difference is that each of them includes additional noise both for background (starting point) and observations. This option is not usable for irrelevant methods (Optimal Interpolation for example). Ensemble members number can be selected when this option is set on: 7.5. Reduced rank methods This kind of methods is irrelevant for such small models, and has hence been disabled. It will be useful, though, for further more complex models still to be included Model error growth term For adequate methods (Kalman filter), this particular term can be taken into account. This matrix, named in equation (6.2), is predefined (valid for a time step equal to 0,02 time unit) and hard coded, so one have to modify program init_model.m L change it. No effect for damped oscillator model. 8. Assimilation Main window displaying process also creates a MATLAB structure, named par. For more details about this structure, please refer to the annex. Pushing the Assimilation knob on the left has several effects: User- chosen parameters and other derived quantities, are stored in par. Measurements and initial conditions are generated. Assimilation itself is performed for each experiment. Messages are informing the user about the computing progress. 9. Displaying the results Drawings are obtained after assimilation by pushing the display knob. There are four windows. There are four windows. Two different experiences can be displayed at the same time ; they are chosen with the rolling menus on the right of the drawing panels. See example, for three simultaneous experiments. * The two left graphs show the trajectories and the measurements. * The two right graphs show diagnostics (TmA, TmP, OmA, FmA when possible)
7 The sub- menu Variables helps to select the variables to display ; all option displays a 3D trajectory (and first variable for diagnostics). Here s an example for three experiments, the first one being displayed in 3D mode: The Forecast wind(%) editable boxes help to choose the ratio fc between the forecast and the assimilation window lengths. /\ Hence, fc is not a pure display parameter: it can t be changed after assimilation To improve results comparison, the horizontal scales are identical for every experiment. So the model is always integrated until tf, with = max 1 + ". "
8 Annex 1: Integration algorithm Both models are governed by first order differential systems that can be rewritten: =, " Second order Runge- Kutta method is one of the simplest ways to solve such systems: + Δ = + Δ. where: =, and = + Δ., + Δ 2 1. Direct model If is only depending on time through, and if we note = : = Tangent linear model If = +, direct model rewrites: = +. We have: =. Also: = , so: =. + Globally, the tangent linear model can be expressed this way: " = Adjoint model It is defined by the relation :. =.. After some algebra: " = Annex 2: Cost function derivatives A minimization method requires the gradient of J, derived by taking the gradient of (5):.... =. The Hessian matrix is also required. Here is the full expression: = The second order term involving crossed derivatives is usually neglected, because it causes numerical instabilities. Resulting expression is: = +....
9 Annex 3: Levenberg Marquardt method To find the minimum of a cost function, gradient method is safe, but slow. It consists in searching the minimum along the direction given by the local gradient. A more efficient method, often used in operational assimilation systems, is the conjugate gradient, also called Newton method, based in a parabolic approximation of the J hyper- surface in the minimum vicinity. Much faster, this strategy is not robust far from the minimum, where the parabolic approximation does not stand anymore. Here, we are talking of quasi- newtonian method because of the approximation on the Hessian (second partial derivative terms suppressed), by contrast with a pure newtonian method, which would include the crossed derivatives term. The Levenberg Marquardt is a compromise combining the advantages of both methods. The diagonal of the Hessian, used in the matrix system giving the quasi- newtonian increment, is multiplied by +, where is an adjustable coefficient: If, the algorithm tends to be quasi- Newtonian. If, the algorithm tends to the gradient method. Roughly, the algorithm is the following: (1) = (2) J, and are computed (where = and = ) (3) Quasi- Newton system is solved ( "# = "# +. ) (4) As long as J is decreasing, is divided by 10 - > to (3) (tends to quasi- Newton) (5) As soon as J is increasing, is multiplied by 10 - > to (2) (tends to gradient step) The global convergence is achieved when the relative difference between two successive J values is lower than a predefined small value. Annex 4: The matlab structure used in the program. We are only giving the main components of this structure. par(k).f1.f2 is the sub- field f2 of field f1 of experience n k. The parameters come directly (m) or are derived (d) from the menu window reading. F1 F2 Rôle Variable(s) menu m/d = Model dt Model integration time step TStep (e) m fc Total integration time (divided by t a) frcst (e) d 0.01*frcst Obs dob Spacing between obs (in time steps) Sampl (p) m Obs nob Observations number d da/dt Obs iob Observations indices in vectors d 1+(1:nob)*dob Obs tob Observations times vector d (1:nob)*ta/nob Obs NVar Observation noise variance NoisV (e) m Obs Crl Indices of controled variables Crli (e) (i=1:nv) d find([crl1 crl2...]) Obs H Observation operator d I nv(crl,:) Obs Rtrue Real meas. error covariance matrix d NVar*I nv Obs R0 Initial meas. Error covariance matrix R0entr (e) / R (m) d R0entr*Rtrue/R 1 Assim algo Assimilation algorithm Method (p) m Assim Ta Temps d assimilation WSize (p) m Assim Na Assimilation time (in time steps) d ta/dt Assim Nt Total integration time steps number d fc.ta/dt Bkg Btrue True background error cov. matrix Bscal (e) d 0.01*Bscal*Bclim Bkg B0 Initial background error cov. Matrix B0entr (e) / B (m) d B0entr*Btrue/B 1,2
10 1 Two possible modes for R0 and B0 computing : keep a fraction of the exact matrix ; then, R0entr is used. full manual mode is used ; then, R parameter menu is used. 2 Matrix R0 is restricted to the controlled variables, indicated by the vector Crl. Note : Inv is a nv*nv identity matrix, where nv is the number of variables. Annex 5: References. [1] Edward N. Lorenz, Deterministic nonperiodic flow, J. atmos. Sci., 20, , 1963 [2] Saltzman, B., Finite amplitude free convection as an initial value problem I, J. atmos. Sci., 19, , 1962 [3] Bouttier, F. ; Courtier, P, D Data assimilation concepts and methods, ECMWF Lecture Notes, 1999
Data Assimilation Research Testbed Tutorial
Data Assimilation Research Testbed Tutorial Section 2: How should observations of a state variable impact an unobserved state variable? Multivariate assimilation. Single observed variable, single unobserved
More informationIntroduction to Data Assimilation. Reima Eresmaa Finnish Meteorological Institute
Introduction to Data Assimilation Reima Eresmaa Finnish Meteorological Institute 15 June 2006 Outline 1) The purpose of data assimilation 2) The inputs for data assimilation 3) Analysis methods Theoretical
More informationDART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation.
DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation. UCAR 2014 The National Center for Atmospheric Research is sponsored by the National
More informationThe University of Reading
The University of Reading Radial Velocity Assimilation and Experiments with a Simple Shallow Water Model S.J. Rennie 2 and S.L. Dance 1,2 NUMERICAL ANALYSIS REPORT 1/2008 1 Department of Mathematics 2
More informationFundamentals of Data Assimilation
National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)
More information4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données
Four-Dimensional Ensemble-Variational Data Assimilation 4DEnVar Colloque National sur l'assimilation de données Andrew Lorenc, Toulouse France. 1-3 décembre 2014 Crown copyright Met Office 4DEnVar: Topics
More informationThe ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations
The Hybrid 4D-Var and Ensemble of Data Assimilations Lars Isaksen, Massimo Bonavita and Elias Holm Data Assimilation Section lars.isaksen@ecmwf.int Acknowledgements to: Mike Fisher and Marta Janiskova
More informationEnsemble Kalman Filter
Ensemble Kalman Filter Geir Evensen and Laurent Bertino Hydro Research Centre, Bergen, Norway, Nansen Environmental and Remote Sensing Center, Bergen, Norway The Ensemble Kalman Filter (EnKF) Represents
More informationEnsemble prediction and strategies for initialization: Tangent Linear and Adjoint Models, Singular Vectors, Lyapunov vectors
Ensemble prediction and strategies for initialization: Tangent Linear and Adjoint Models, Singular Vectors, Lyapunov vectors Eugenia Kalnay Lecture 2 Alghero, May 2008 Elements of Ensemble Forecasting
More informationA Note on the Particle Filter with Posterior Gaussian Resampling
Tellus (6), 8A, 46 46 Copyright C Blackwell Munksgaard, 6 Printed in Singapore. All rights reserved TELLUS A Note on the Particle Filter with Posterior Gaussian Resampling By X. XIONG 1,I.M.NAVON 1,2 and
More informationIntroduction to initialization of NWP models
Introduction to initialization of NWP models weather forecasting an initial value problem traditionally, initialization comprised objective analysis of obs at a fixed synoptic time, i.e. 00Z or 12Z: data
More informationData assimilation; comparison of 4D-Var and LETKF smoothers
Data assimilation; comparison of 4D-Var and LETKF smoothers Eugenia Kalnay and many friends University of Maryland CSCAMM DAS13 June 2013 Contents First part: Forecasting the weather - we are really getting
More informationAssimilation Techniques (4): 4dVar April 2001
Assimilation echniques (4): 4dVar April By Mike Fisher European Centre for Medium-Range Weather Forecasts. able of contents. Introduction. Comparison between the ECMWF 3dVar and 4dVar systems 3. he current
More informationRelationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF
Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi 4th EnKF Workshop, April 2010 Relationship
More informationEnsemble Data Assimilation and Uncertainty Quantification
Ensemble Data Assimilation and Uncertainty Quantification Jeff Anderson National Center for Atmospheric Research pg 1 What is Data Assimilation? Observations combined with a Model forecast + to produce
More informationParallel Algorithms for Four-Dimensional Variational Data Assimilation
Parallel Algorithms for Four-Dimensional Variational Data Assimilation Mie Fisher ECMWF October 24, 2011 Mie Fisher (ECMWF) Parallel 4D-Var October 24, 2011 1 / 37 Brief Introduction to 4D-Var Four-Dimensional
More informationData assimilation. Polyphemus Training Session. June 9, Introduction 2
Data assimilation Polyphemus Training Session June 9, 2009 About Purpose: introduction to optimal interpolation, Kalman filtering and variational data assimilation with Polair3D; application to photochemistry
More information4. DATA ASSIMILATION FUNDAMENTALS
4. DATA ASSIMILATION FUNDAMENTALS... [the atmosphere] "is a chaotic system in which errors introduced into the system can grow with time... As a consequence, data assimilation is a struggle between chaotic
More informationWILEY. Differential Equations with MATLAB (Third Edition) Brian R. Hunt Ronald L. Lipsman John E. Osborn Jonathan M. Rosenberg
Differential Equations with MATLAB (Third Edition) Updated for MATLAB 2011b (7.13), Simulink 7.8, and Symbolic Math Toolbox 5.7 Brian R. Hunt Ronald L. Lipsman John E. Osborn Jonathan M. Rosenberg All
More informationEnsemble forecasting and flow-dependent estimates of initial uncertainty. Martin Leutbecher
Ensemble forecasting and flow-dependent estimates of initial uncertainty Martin Leutbecher acknowledgements: Roberto Buizza, Lars Isaksen Flow-dependent aspects of data assimilation, ECMWF 11 13 June 2007
More informationCan hybrid-4denvar match hybrid-4dvar?
Comparing ensemble-variational assimilation methods for NWP: Can hybrid-4denvar match hybrid-4dvar? WWOSC, Montreal, August 2014. Andrew Lorenc, Neill Bowler, Adam Clayton, David Fairbairn and Stephen
More informationAppendix A Prototypes Models
Appendix A Prototypes Models This appendix describes the model of the prototypes used in Chap. 3. These mathematical models can also be found in the Student Handout by Quanser. A.1 The QUANSER SRV-02 Setup
More informationNumerical Methods I Solving Nonlinear Equations
Numerical Methods I Solving Nonlinear Equations Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fall 2014 October 16th, 2014 A. Donev (Courant Institute)
More informationVariational Data Assimilation Current Status
Variational Data Assimilation Current Status Eĺıas Valur Hólm with contributions from Mike Fisher and Yannick Trémolet ECMWF NORDITA Solar and stellar dynamos and cycles October 2009 Eĺıas Valur Hólm (ECMWF)
More informationData assimilation with Lorenz 3-variable model. Prepared by Shu-Chih Yang Modified by Juan Ruiz.
Data assimilation with Lorenz 3-variable model Prepared by Shu-Chih Yang Modified by Juan Ruiz. Governing equations dx dt dy dt dz dt = σ(y x) = rx y xz = xy bz Lorenz, E. N, 1963: Deterministic nonperiodic
More informationBrian J. Etherton University of North Carolina
Brian J. Etherton University of North Carolina The next 90 minutes of your life Data Assimilation Introit Different methodologies Barnes Analysis in IDV NWP Error Sources 1. Intrinsic Predictability Limitations
More informationUser Guide for Hermir version 0.9: Toolbox for Synthesis of Multivariate Stationary Gaussian and non-gaussian Series
User Guide for Hermir version 0.9: Toolbox for Synthesis of Multivariate Stationary Gaussian and non-gaussian Series Hannes Helgason, Vladas Pipiras, and Patrice Abry June 2, 2011 Contents 1 Organization
More informationChem 1 Kinetics. Objectives. Concepts
Chem 1 Kinetics Objectives 1. Learn some basic ideas in chemical kinetics. 2. Understand how the computer visualizations can be used to benefit the learning process. 3. Understand how the computer models
More informationDATA ASSIMILATION FOR FLOOD FORECASTING
DATA ASSIMILATION FOR FLOOD FORECASTING Arnold Heemin Delft University of Technology 09/16/14 1 Data assimilation is the incorporation of measurement into a numerical model to improve the model results
More informationChapter 6 - Ordinary Differential Equations
Chapter 6 - Ordinary Differential Equations 7.1 Solving Initial-Value Problems In this chapter, we will be interested in the solution of ordinary differential equations. Ordinary differential equations
More informationOPTIMAL CONTROL AND ESTIMATION
OPTIMAL CONTROL AND ESTIMATION Robert F. Stengel Department of Mechanical and Aerospace Engineering Princeton University, Princeton, New Jersey DOVER PUBLICATIONS, INC. New York CONTENTS 1. INTRODUCTION
More informationKalman Filter and Ensemble Kalman Filter
Kalman Filter and Ensemble Kalman Filter 1 Motivation Ensemble forecasting : Provides flow-dependent estimate of uncertainty of the forecast. Data assimilation : requires information about uncertainty
More informationA new Hierarchical Bayes approach to ensemble-variational data assimilation
A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander
More informationRelative Merits of 4D-Var and Ensemble Kalman Filter
Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29
More informationTangent linear and adjoint models for variational data assimilation
Data Assimilation Training Course, Reading, -4 arch 4 Tangent linear and adjoint models for variational data assimilation Angela Benedetti with contributions from: arta Janisková, Philippe Lopez, Lars
More informationData Assimilation Research Testbed Tutorial. Section 7: Some Additional Low-Order Models
Data Assimilation Research Testbed Tutorial Section 7: Some Additional Low-Order Models Version.: September, 6 /home/jla/dart_tutorial/dart/tutorial/section7/tut_section7.fm 1 7/13/7 Low-order models in
More informationMaps and differential equations
Maps and differential equations Marc R. Roussel November 8, 2005 Maps are algebraic rules for computing the next state of dynamical systems in discrete time. Differential equations and maps have a number
More informationLecture 9. Time series prediction
Lecture 9 Time series prediction Prediction is about function fitting To predict we need to model There are a bewildering number of models for data we look at some of the major approaches in this lecture
More informationHandling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model
Handling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model Shu-Chih Yang 1*, Eugenia Kalnay, and Brian Hunt 1. Department of Atmospheric Sciences, National Central
More informationChapter 6: Ensemble Forecasting and Atmospheric Predictability. Introduction
Chapter 6: Ensemble Forecasting and Atmospheric Predictability Introduction Deterministic Chaos (what!?) In 1951 Charney indicated that forecast skill would break down, but he attributed it to model errors
More informationVariational ensemble DA at Météo-France Cliquez pour modifier le style des sous-titres du masque
Cliquez pour modifier le style du titre Variational ensemble DA at Météo-France Cliquez pour modifier le style des sous-titres du masque L. Berre, G. Desroziers, H. Varella, L. Raynaud, C. Labadie and
More informationAccelerating the spin-up of Ensemble Kalman Filtering
Accelerating the spin-up of Ensemble Kalman Filtering Eugenia Kalnay * and Shu-Chih Yang University of Maryland Abstract A scheme is proposed to improve the performance of the ensemble-based Kalman Filters
More informationEnsemble square-root filters
Ensemble square-root filters MICHAEL K. TIPPETT International Research Institute for climate prediction, Palisades, New Yor JEFFREY L. ANDERSON GFDL, Princeton, New Jersy CRAIG H. BISHOP Naval Research
More informationLocal Ensemble Transform Kalman Filter
Local Ensemble Transform Kalman Filter Brian Hunt 11 June 2013 Review of Notation Forecast model: a known function M on a vector space of model states. Truth: an unknown sequence {x n } of model states
More informationThe Inversion Problem: solving parameters inversion and assimilation problems
The Inversion Problem: solving parameters inversion and assimilation problems UE Numerical Methods Workshop Romain Brossier romain.brossier@univ-grenoble-alpes.fr ISTerre, Univ. Grenoble Alpes Master 08/09/2016
More informationLecture 1: Primal 4D-Var
Lecture 1: Primal 4D-Var Outline ROMS 4D-Var overview 4D-Var concepts Primal formulation of 4D-Var Incremental approach used in ROMS The ROMS I4D-Var algorithm ROMS 4D-Var Priors f b, B f Ensemble 4D-Var
More informationEnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm
Overview 1 2 3 Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation 6th EnKF Purpose EnKF equations localization After the 6th EnKF (2014), I decided with Prof. Zhang to summarize progress
More informationExperiment 1: The Same or Not The Same?
Experiment 1: The Same or Not The Same? Learning Goals After you finish this lab, you will be able to: 1. Use Logger Pro to collect data and calculate statistics (mean and standard deviation). 2. Explain
More informationLagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC
Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background
More informationIntroduction to Data Assimilation. Saroja Polavarapu Meteorological Service of Canada University of Toronto
Introduction to Data Assimilation Saroja Polavarapu Meteorological Service of Canada University of Toronto GCC Summer School, Banff. May 22-28, 2004 Outline of lectures General idea Numerical weather prediction
More informationMaximum Likelihood Ensemble Filter Applied to Multisensor Systems
Maximum Likelihood Ensemble Filter Applied to Multisensor Systems Arif R. Albayrak a, Milija Zupanski b and Dusanka Zupanski c abc Colorado State University (CIRA), 137 Campus Delivery Fort Collins, CO
More informationOpenIFS practical exercises with Metview (Stockholm)
OpenIFS practical exercises with Metview (Stockholm) Author: Date: URL: Sandor Kertesz 09-Jun-2014 15:37 https://software.ecmwf.int/wiki/pages/viewpage.action?pageid=33719209 1 of 12 Table of Contents
More informationRepresentation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices
Representation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices Andreas Rhodin, Harald Anlauf German Weather Service (DWD) Workshop on Flow-dependent aspects of data assimilation,
More informationME scope Application Note 28
App Note 8 www.vibetech.com 3/7/17 ME scope Application Note 8 Mathematics of a Mass-Spring-Damper System INTRODUCTION In this note, the capabilities of ME scope will be used to build a model of the mass-spring-damper
More informationCLASS NOTES Computational Methods for Engineering Applications I Spring 2015
CLASS NOTES Computational Methods for Engineering Applications I Spring 2015 Petros Koumoutsakos Gerardo Tauriello (Last update: July 27, 2015) IMPORTANT DISCLAIMERS 1. REFERENCES: Much of the material
More informationRelationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF
Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi ECODYC10, Dresden 28 January 2010 Relationship
More informationFundamentals of Data Assimila1on
014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University
More informationReview for Exam 2 Ben Wang and Mark Styczynski
Review for Exam Ben Wang and Mark Styczynski This is a rough approximation of what we went over in the review session. This is actually more detailed in portions than what we went over. Also, please note
More informationEdward Lorenz. Professor of Meteorology at the Massachusetts Institute of Technology
The Lorenz system Edward Lorenz Professor of Meteorology at the Massachusetts Institute of Technology In 1963 derived a three dimensional system in efforts to model long range predictions for the weather
More informationTing Lei, Xuguang Wang University of Oklahoma, Norman, OK, USA. Wang and Lei, MWR, Daryl Kleist (NCEP): dual resolution 4DEnsVar
GSI-based four dimensional ensemble-variational (4DEnsVar) data assimilation: formulation and single resolution experiments with real data for NCEP GFS Ting Lei, Xuguang Wang University of Oklahoma, Norman,
More informationFour-Dimensional Ensemble Kalman Filtering
Four-Dimensional Ensemble Kalman Filtering B.R. Hunt, E. Kalnay, E.J. Kostelich, E. Ott, D.J. Patil, T. Sauer, I. Szunyogh, J.A. Yorke, A.V. Zimin University of Maryland, College Park, MD 20742, USA Ensemble
More informationData Assimilation Research Testbed Tutorial
Data Assimilation Research Testbed Tutorial Section 3: Hierarchical Group Filters and Localization Version 2.: September, 26 Anderson: Ensemble Tutorial 9//6 Ways to deal with regression sampling error:
More informationChapter 1, Section 1.2, Example 9 (page 13) and Exercise 29 (page 15). Use the Uniqueness Tool. Select the option ẋ = x
Use of Tools from Interactive Differential Equations with the texts Fundamentals of Differential Equations, 5th edition and Fundamentals of Differential Equations and Boundary Value Problems, 3rd edition
More information1 Singular Value Decomposition and Principal Component
Singular Value Decomposition and Principal Component Analysis In these lectures we discuss the SVD and the PCA, two of the most widely used tools in machine learning. Principal Component Analysis (PCA)
More information1. Current atmospheric DA systems 2. Coupling surface/atmospheric DA 3. Trends & ideas
1 Current issues in atmospheric data assimilation and its relationship with surfaces François Bouttier GAME/CNRM Météo-France 2nd workshop on remote sensing and modeling of surface properties, Toulouse,
More informationES205 Analysis and Design of Engineering Systems: Lab 1: An Introductory Tutorial: Getting Started with SIMULINK
ES205 Analysis and Design of Engineering Systems: Lab 1: An Introductory Tutorial: Getting Started with SIMULINK What is SIMULINK? SIMULINK is a software package for modeling, simulating, and analyzing
More informationIntelligent Embedded Systems Uncertainty, Information and Learning Mechanisms (Part 1)
Advanced Research Intelligent Embedded Systems Uncertainty, Information and Learning Mechanisms (Part 1) Intelligence for Embedded Systems Ph. D. and Master Course Manuel Roveri Politecnico di Milano,
More informationHow does 4D-Var handle Nonlinearity and non-gaussianity?
How does 4D-Var handle Nonlinearity and non-gaussianity? Mike Fisher Acknowledgements: Christina Tavolato, Elias Holm, Lars Isaksen, Tavolato, Yannick Tremolet Slide 1 Outline of Talk Non-Gaussian pdf
More informationDetermining C-H Connectivity: ghmqc and ghmbc (VnmrJ-2.2D Version: For use with the new Software)
Determining C-H Connectivity: ghmqc and ghmbc (VnmrJ-2.2D Version: For use with the new Software) Heteronuclear Multiple Quantum Coherence (HMQC) and Heteronuclear Multiple Bond Coherence (HMBC) are 2-dimensional
More informationR. E. Petrie and R. N. Bannister. Department of Meteorology, Earley Gate, University of Reading, Reading, RG6 6BB, United Kingdom
A method for merging flow-dependent forecast error statistics from an ensemble with static statistics for use in high resolution variational data assimilation R. E. Petrie and R. N. Bannister Department
More informationWinmostar tutorial LAMMPS Melting point V X-Ability Co,. Ltd. 2017/8/17
Winmostar tutorial LAMMPS Melting point V7.025 X-Ability Co,. Ltd. question@winmostar.com Contents Configure I. Build solid phase II. Equilibration of solid phase III. Equilibration of liquid phase IV.
More informationMECH : a Primer for Matlab s ode suite of functions
Objectives MECH 4-563: a Primer for Matlab s ode suite of functions. Review the fundamentals of initial value problems and why numerical integration methods are needed.. Introduce the ode suite of numerical
More informationSolving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations
Solving PDEs with PGI CUDA Fortran Part 4: Initial value problems for ordinary differential equations Outline ODEs and initial conditions. Explicit and implicit Euler methods. Runge-Kutta methods. Multistep
More informationStability of Ensemble Kalman Filters
Stability of Ensemble Kalman Filters Idrissa S. Amour, Zubeda Mussa, Alexander Bibov, Antti Solonen, John Bardsley, Heikki Haario and Tuomo Kauranne Lappeenranta University of Technology University of
More informationDynamical Systems and Chaos Part I: Theoretical Techniques. Lecture 4: Discrete systems + Chaos. Ilya Potapov Mathematics Department, TUT Room TD325
Dynamical Systems and Chaos Part I: Theoretical Techniques Lecture 4: Discrete systems + Chaos Ilya Potapov Mathematics Department, TUT Room TD325 Discrete maps x n+1 = f(x n ) Discrete time steps. x 0
More informationSome general observations.
Modeling and analyzing data from computer experiments. Some general observations. 1. For simplicity, I assume that all factors (inputs) x1, x2,, xd are quantitative. 2. Because the code always produces
More informationIntensive Course on Data Assimilation SPEEDY DA (3D-VAR)
Intensive Course on Data Assimilation SPEEDY DA (3D-VAR) Prepared by Junjie Liu, Takemasa Miyoshi and Juan Ruiz Buenos Aires, Argentina 27 October 7 November 2008 What will we learn in this lesson: Speedy
More informationECE295, Data Assimila0on and Inverse Problems, Spring 2015
ECE295, Data Assimila0on and Inverse Problems, Spring 2015 1 April, Intro; Linear discrete Inverse problems (Aster Ch 1 and 2) Slides 8 April, SVD (Aster ch 2 and 3) Slides 15 April, RegularizaFon (ch
More informationObservation Impact Assessment for Dynamic. Data-Driven Coupled Chaotic System
Applied Mathematical Sciences, Vol. 10, 2016, no. 45, 2239-2248 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2016.65170 Observation Impact Assessment for Dynamic Data-Driven Coupled Chaotic
More informationNumerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2)
Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2) Time series curves 500hPa geopotential Correlation coefficent of forecast anomaly N Hemisphere Lat 20.0 to 90.0
More informationData assimilation concepts and methods March 1999
Data assimilation concepts and methods March 1999 By F. Bouttier and P. Courtier Abstract These training course lecture notes are an advanced and comprehensive presentation of most data assimilation methods
More informationUsing Tables and Graphing Calculators in Math 11
Using Tables and Graphing Calculators in Math 11 Graphing calculators are not required for Math 11, but they are likely to be helpful, primarily because they allow you to avoid the use of tables in some
More informationIntroduction to Data Assimilation
Introduction to Data Assimilation Alan O Neill Data Assimilation Research Centre University of Reading What is data assimilation? Data assimilation is the technique whereby observational data are combined
More informationDeep Learning & Neural Networks Lecture 4
Deep Learning & Neural Networks Lecture 4 Kevin Duh Graduate School of Information Science Nara Institute of Science and Technology Jan 23, 2014 2/20 3/20 Advanced Topics in Optimization Today we ll briefly
More informationP7.1 STUDY ON THE OPTIMAL SCANNING STRATEGIES OF PHASE-ARRAY RADAR THROUGH ENSEMBLE KALMAN FILTER ASSIMILATION OF SIMULATED DATA
P7.1 STUDY ON THE OPTIMAL SCANNING STRATEGIES OF PHASE-ARRAY RADAR THROUGH ENSEMBLE KALMAN FILTER ASSIMILATION OF SIMULATED DATA Ting Lei 1, Ming Xue 1,, Tianyou Yu 3 and Michihiro Teshiba 3 1 Center for
More informationAdaptive Data Assimilation and Multi-Model Fusion
Adaptive Data Assimilation and Multi-Model Fusion Pierre F.J. Lermusiaux, Oleg G. Logoutov and Patrick J. Haley Jr. Mechanical Engineering and Ocean Science and Engineering, MIT We thank: Allan R. Robinson
More information(Toward) Scale-dependent weighting and localization for the NCEP GFS hybrid 4DEnVar Scheme
(Toward) Scale-dependent weighting and localization for the NCEP GFS hybrid 4DEnVar Scheme Daryl Kleist 1, Kayo Ide 1, Rahul Mahajan 2, Deng-Shun Chen 3 1 University of Maryland - Dept. of Atmospheric
More informationNUMERICAL METHODS USING MATLAB
NUMERICAL METHODS USING MATLAB Dr John Penny George Lindfield Department of Mechanical Engineering, Aston University ELLIS HORWOOD NEW YORK LONDON TORONTO SYDNEY TOKYO SINGAPORE Preface 1 An introduction
More informationQuarterly Journal of the Royal Meteorological Society
Quarterly Journal of the Royal Meteorological Society Effects of sequential or simultaneous assimilation of observations and localization methods on the performance of the ensemble Kalman filter Journal:
More informationNew Fast Kalman filter method
New Fast Kalman filter method Hojat Ghorbanidehno, Hee Sun Lee 1. Introduction Data assimilation methods combine dynamical models of a system with typically noisy observations to obtain estimates of the
More informationIntroduction to Hartree-Fock calculations in Spartan
EE5 in 2008 Hannes Jónsson Introduction to Hartree-Fock calculations in Spartan In this exercise, you will get to use state of the art software for carrying out calculations of wavefunctions for molecues,
More informationA reduced rank estimate of forecast error variance changes due to intermittent modifications of the observing network
384 A reduced rank estimate of forecast error variance changes due to intermittent modifications of the observing network Martin Leutbecher Research Department Centre National de Recherches Météorologique,
More informationSuperCELL Data Programmer and ACTiSys IR Programmer User s Guide
SuperCELL Data Programmer and ACTiSys IR Programmer User s Guide This page is intentionally left blank. SuperCELL Data Programmer and ACTiSys IR Programmer User s Guide The ACTiSys IR Programmer and SuperCELL
More informationLocal Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data
Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data John Harlim and Brian R. Hunt Department of Mathematics and Institute for Physical Science and Technology University
More informationTheoretical physics. Deterministic chaos in classical physics. Martin Scholtz
Theoretical physics Deterministic chaos in classical physics Martin Scholtz scholtzzz@gmail.com Fundamental physical theories and role of classical mechanics. Intuitive characteristics of chaos. Newton
More informationReducing the Impact of Sampling Errors in Ensemble Filters
Reducing the Impact of Sampling Errors in Ensemble Filters Jeffrey Anderson NCAR Data Assimilation Research Section The National Center for Atmospheric Research is sponsored by the National Science Foundation.
More informationM.Sc. in Meteorology. Numerical Weather Prediction
M.Sc. in Meteorology UCD Numerical Weather Prediction Prof Peter Lynch Meteorology & Climate Cehtre School of Mathematical Sciences University College Dublin Second Semester, 2005 2006. Text for the Course
More informationSensitivity analysis in variational data assimilation and applications
Sensitivity analysis in variational data assimilation and applications Dacian N. Daescu Portland State University, P.O. Box 751, Portland, Oregon 977-751, U.S.A. daescu@pdx.edu ABSTRACT Mathematical aspects
More informationTangent-linear and adjoint models in data assimilation
Tangent-linear and adjoint models in data assimilation Marta Janisková and Philippe Lopez ECMWF Thanks to: F. Váňa, M.Fielding 2018 Annual Seminar: Earth system assimilation 10-13 September 2018 Tangent-linear
More informationTECDIS and TELchart ECS Weather Overlay Guide
1 of 24 TECDIS and TELchart ECS provides a very advanced weather overlay feature, using top quality commercial maritime weather forecast data available as a subscription service from Jeppesen Marine. The
More information