Variational data assimilation
|
|
- Abel Booker
- 5 years ago
- Views:
Transcription
1 Background and methods NCEO, Dept. of Meteorology, Univ. of Reading 710 March 2018, Univ. of Reading
2 Bayes' Theorem Bayes' Theorem p(x y) = posterior distribution = p(x) p(y x) p(y) prior distribution likelihood normalizing constant Prior distribution: PDF of the state before observations are considered (e.g. PDF of model forecast). Likelihood: PDF of observations given that the state is x. Posterior: PDF of the state after the observations have been considered.
3 The Gaussian assumption PDFs are often described by Gaussians (normal distributions). Gaussian PDFs are described by a mean and covariance only. P(x) = x N(x b,b) 1 (2π) n det(b) epsilon1 ε = x x b exp 1 2 epsilon2 ( x x b ) T B 1 ( x x b)
4 Meaning of x and y x a analysis; x b background state; δ x increment (perturbation) y observations; y m = H (x) model observations. H (x) is the observation operator / forward model. Sometimes x and y are for only one time (3DVar). x-vectors have n elements; y-vectors have p elements.
5 Back to the Gaussian assumption Prior: mean x b, covariance B P(x) = 1 (2π) n det(b) exp 1 2 ( x x b ) T B 1 ( x x b) Likelihood: mean H (x), covariance R P(y x) = 1 (2π) p det(r) exp 1 2 (y H (x))t R 1 (y H (x)) Posterior p(x y) = p(x) p(y x) p(y) exp 1 [ (x x b ) T B 1 ( x x b) 2 ] +(y H (x)) T R 1 (y H (x))
6 Variational DA the idea In Var., we seek a solution that maximizes the posterior probability p(x y) (maximum-a-posteriori). This is the most likely state given the observations (and the background), called the analysis, x a. Maximizing p(x y) is equivalent to minimizing ln p(x y) J(x) (a least-squares problem). p(x y) = C exp 1 2 J(x) = lnc [ (x x b ) T B 1 ( x x b) ] +(y H (x)) T R 1 (y H (x)) ( x x b ) T B 1 ( x x b) (y H (x))t R 1 (y H (x)) = constant (ignored) + J b (x) + J o (x)
7 Four-dimensional Var (4DVar) Aim To nd the `best' estimate of the true state of the system (analysis), consistent with the observations, the background, and the system dynamics.
8 Towards a 4DVar cost function Consider the observation operator in this case: x 0 H 0 (x 0 ) H (x) = H. =. H N (x N ) x N So the J o is (assume that R is block diagonal): J o = 1 2 (y H (x))t R 1 (y H (x)) = T 1 y 0 H 0 (x 0 ) R y 0 H 0 (x 0 ) y N H N (x N ) 0 0 R N y N H N (x N ) = 1 2 N i=0 (y i H i (x i )) T R 1 i (y i H i (x i )) where x i+1 = M i (x i )
9 The 4DVar cost function (`full 4DVar') Let (a) T A 1 (a) (a) T A 1 ( ) J(x) = 1 ( x0 x b ) T 0 B ( ) (y H (x))t R 1 ( ) = 1 ( x0 x b ) T 0 B ( ) N i=0 subject to x i+1 = M i (x i ) (y i H i (x i )) T R 1 i ( ) x b 0 a-priori (background) state at t 0. y i observations at t i. H i (x i ) observation operator at t i. B 0 background error covariance matrix at t 0. R i observation error covariance matrix at t i.
10 How to minimize this cost function? Minimize J(x) iteratively The gradient of the cost function Use the gradient of J at each iteration: x k+1 0 = x k 0 + α J(x k 0) J/ (x 0 ) 1 J(x 0 ) =. J/ (x 0 ) n J points in the direction of steepest descent. Methods: steepest descent (inecient), conjugate gradient (more ecient),...
11 The gradient of the cost function (wrt x(t 0 )) Either: 1 Di. J(x 0 ) w.r.t. x 0 with x i = M i 1 (M i 2 ( M 0 (x 0 ))). 2 Di. J(x) = J(x 0,x 1,...,x N ) w.r.t. x 0,x 1,...,x N subject to the constraint N 1 L(x,λ) = J(x) + x i+1 M i (x i ) = 0 i=0 Each approach leads to the adjoint method λ T i+1 (x i+1 M i (x i )). An ecient means of computing the gradient. Uses the linearized/adjoint of M i and H i : M T i and H T i.
12 The adjoint method Equivalent gradient formula: 1 J J(x 0 ) = B 1 ( 0 x0 x b ) 0 N i=0 M T 0...M T i 1 HT i R 1 i (y i H i (x i )) 2 λ N+1 = 0 λ i = H T i R 1 i (y i H i (x i )) + M T i λ i+1 λ 0 = J o J = J b + J o = B 1 0 ( x0 x b ) 0 + λ 0
13 The adjoint method
14 Simplications and complications The full 4DVar method is expensive and dicult to solve. Model M i is non-linear. Observation operators, H i can be non-linear. Linear H quadratic cost function easy(er) to minimize, J o 1 2 (y ax)2 /σ 2 o. Non-linear H non-quadratic cost function hard to minimize, J o 1 2 (y f (x))2 /σ 2 o. Later will recognise that models are `wrong'! Look for simplications: Incremental 4DVar (linearized 4DVar) 3D-FGAT 3DVar Complications: Weak constraint (imperfect model)
15 Incremental 4DVar 1 definitions: x R i+1(k) = M i ( ) x R i(k) x i = x R i(k) + δ x i x b 0 = x R 0(k) + δ xb 0 x i+1 = M i (x i ) H i (x i ) H i (x R i(k) δ x i+1 M i(k) δ x i ) + H i(k) δ x i δ x i M i 1(k) M i 2(k)...M 0(k) δ x 0
16 Incremental 4DVar 2 J (k) (δ x 0 ) = 1 ( δ x0 δ x b ) T ( ) 0 B N i=0 ( 0 y i H i (x R i(k) ) H i(k)δ x i ) T R 1 i ( ) `Inner loop': iterations to nd δ x 0 (as adjoint method). `Outer loop' (k): iterate x R 0(k+1) = xr 0(k) + δ x 0 Inner loop is exactly quadratic (e.g. has a unique minimum). Inner loop can be simplied (lower res., simplied physics).
17 Simplication 1: 3D-FGAT Three dimensional variational data assimilation with first guess (i.e. x R i(k) ) is computed at the appropriate time. Simplication is that M i(k) I, i.e. δ x i = M i 1(k)...M 0(k) δ x 0 δ x 0. J(k) 3DFGAT (δ x 0 ) = 1 ( δ x0 δ x b ) T 0 B N ( 1 2 i=0 ( ) y i H i (x R i(k) ) H i(k)δ x 0 ) T R 1 i ( )
18 Simplication 2: 3DVar This has no time dependence within the assimilation window. Not used (these days 3D-Var really means 3D-FGAT). J(k) 3DVar (δ x 0 ) = 1 ( δ x0 δ x b 0 2 N ( 1 2 i=0 ) T B 1 0 ( ) y i H i (x R 0(k) ) H i(k)δ x 0 ) T R 1 i ( )
19 Properties of 4DVar Observations are treated at the correct time. Use of dynamics means that more information can be obtained from observations. Covariance B 0 is implicitly evolved, B i = ( M i 1(k)...M 0(k) ) B0 ( Mi 1(k)...M 0(k) ) T. In practice development of linear and adjoint models is complex. But note M i, H i, M i, H i, M T i, and HT i are subroutines, and so `matrices' are usually not in explicit matrix form. Standard 4DVar assumes the model is perfect. This can lead to sub-optimalities. Weak-constraint 4DVar relaxes this assumption.
20 Weak constraint 4DVar Modify evolution equation: x i+1 = M i (x i ) + η i where η i N(0,Q i ) `State formulation' of WC4DVar J wc (x 0,...,x N ) = J b + J o `Error formulation' of WC4DVar N 1 i=0 J wc (x o,η 0...,η N 1 ) = J b + J o (x i+1 M i (x i )) T Q 1 i ( ) N 1 i=0 η T i Q 1 i η i
21 Implementation of weak constraint 4DVar Vector to be determined (`control vector') increases from n in 4DVar to n + n(n 1) in WC4DVar. The model error covariance matrices, Q i, need to be estimated. How? The `state' formulation (determine x 0,...,x N ) and the `error' formulation (determine x 0,η 0...,η N 1 ) are mathematically equivalent, but can behave dierently in practice. There is an incremental form of WC4DVar.
22 Summary of 4DVar The variational method forms the basis of many operational weather and ocean forecasting systems, including at ECMWF, the Met Oce, Météo-France, etc. It allows complicated observation operators to be used (e.g. for assimilation of satellite data). It has been very successful. Incremental (quasi-linear) versions are usually implemented. It requires specication of B 0, the background error cov. matrix, and R i, the observation error cov. matrix. 4DVar requires the development of linear and adjoint models not a simple task! Weak constraint formulations require the additional specication of Q i.
23 Some challenges ahead Methods assume that error cov. matrices are correctly known. Representing B 0. Better models of B 0. Flow dependency (e.g. Ensemble-Var or hybrid methods). Representing R i. Allowing for observation error covariances. Representing Q i. Numerical conditioning of the problem. Application to more complicated systems (e.g. high-resolution models, coupled atmosphere-ocean DA, chemical DA). Variational bias correction. Moist processes, inc. clouds. Eective use on massively parallel computer architectures.
24 Selected References Original application of 4DVar: Talagrand O, Courtier P, Variational assimilation of meteorological observations with the adjoint vorticity equation I: Theory, Q. J. R. Meteorol. Soc. 113, (1987). Excellent tutorial on Var: Schlatter TW, Variational assimilation of meteorological observations in the lower atmosphere: A tutorial on how it works, J. Atmos. Sol. Terr. Phys. 62, (2000). Incremental 4DVar: Courtier P, Thepaut J-N, Hollingsworth A, A strategy for operational implementation of 4D-Var, using an incremental approach, Q. J. R. Meteorol. Soc. 120, (1994). High-resolution application of 4DVar: Park SK, Zupanski D, Four-dimensional variational data assimilation for mesoscale and storm scale applications, Meteorol. Atmos. Phys. 82, (2003). Met Oce 4DVar: Rawlins F, Ballard SP, Bovis KJ, Clayton AM, Li D, Inverarity GW, Lorenc AC, Payne TJ, The Met Oce global four-dimensional variational data assimilation scheme, Q. J. R. Meteorol. Soc. 133, (2007). Weak constraint 4DVar: Tremolet Y, Model-error estimation in 4D-Var, Q. J. R. Meteorol. Soc. 133, (2007). Inner and outer loops: Lawless, Gratton & Nichols, QJRMS, 2005; Gratton, Lawless & Nichols, SIAM J. on Optimization (2007). More detailed survey of variational methods than can be done in this lecture (plus ensemble-variational, hybrid methods): Bannister R.N., A review of operational methods of variational and ensemble-variational data assimilation, Q.J.R. Meteor. Soc. 143, (2017).
In the derivation of Optimal Interpolation, we found the optimal weight matrix W that minimizes the total analysis error variance.
hree-dimensional variational assimilation (3D-Var) In the derivation of Optimal Interpolation, we found the optimal weight matrix W that minimizes the total analysis error variance. Lorenc (1986) showed
More information4. DATA ASSIMILATION FUNDAMENTALS
4. DATA ASSIMILATION FUNDAMENTALS... [the atmosphere] "is a chaotic system in which errors introduced into the system can grow with time... As a consequence, data assimilation is a struggle between chaotic
More informationComparisons between 4DEnVar and 4DVar on the Met Office global model
Comparisons between 4DEnVar and 4DVar on the Met Office global model David Fairbairn University of Surrey/Met Office 26 th June 2013 Joint project by David Fairbairn, Stephen Pring, Andrew Lorenc, Neill
More informationFundamentals of Data Assimilation
National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)
More informationSensitivity analysis in variational data assimilation and applications
Sensitivity analysis in variational data assimilation and applications Dacian N. Daescu Portland State University, P.O. Box 751, Portland, Oregon 977-751, U.S.A. daescu@pdx.edu ABSTRACT Mathematical aspects
More informationLecture 1: Primal 4D-Var
Lecture 1: Primal 4D-Var Outline ROMS 4D-Var overview 4D-Var concepts Primal formulation of 4D-Var Incremental approach used in ROMS The ROMS I4D-Var algorithm ROMS 4D-Var Priors f b, B f Ensemble 4D-Var
More informationCan hybrid-4denvar match hybrid-4dvar?
Comparing ensemble-variational assimilation methods for NWP: Can hybrid-4denvar match hybrid-4dvar? WWOSC, Montreal, August 2014. Andrew Lorenc, Neill Bowler, Adam Clayton, David Fairbairn and Stephen
More information(Extended) Kalman Filter
(Extended) Kalman Filter Brian Hunt 7 June 2013 Goals of Data Assimilation (DA) Estimate the state of a system based on both current and all past observations of the system, using a model for the system
More informationMet Office convective-scale 4DVAR system, tests and improvement
Met Office convective-scale 4DVAR system, tests and improvement Marco Milan*, Marek Wlasak, Stefano Migliorini, Bruce Macpherson Acknowledgment: Inverarity Gordon, Gareth Dow, Mike Thurlow, Mike Cullen
More informationCoupled atmosphere-ocean data assimilation in the presence of model error. Alison Fowler and Amos Lawless (University of Reading)
Coupled atmosphere-ocean data assimilation in the presence of model error Alison Fowler and Amos Lawless (University of Reading) Introduction Coupled DA methods are being developed to initialise forecasts
More informationThe University of Reading
The University of Reading Radial Velocity Assimilation and Experiments with a Simple Shallow Water Model S.J. Rennie 2 and S.L. Dance 1,2 NUMERICAL ANALYSIS REPORT 1/2008 1 Department of Mathematics 2
More informationRelative Merits of 4D-Var and Ensemble Kalman Filter
Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29
More informationFundamentals of Data Assimila1on
014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University
More informationVariational Data Assimilation Current Status
Variational Data Assimilation Current Status Eĺıas Valur Hólm with contributions from Mike Fisher and Yannick Trémolet ECMWF NORDITA Solar and stellar dynamos and cycles October 2009 Eĺıas Valur Hólm (ECMWF)
More informationMathematical Concepts of Data Assimilation
Mathematical Concepts of Data Assimilation N.K. Nichols 1 Introduction Environmental systems can be realistically described by mathematical and numerical models of the system dynamics. These models can
More informationIntroduction to initialization of NWP models
Introduction to initialization of NWP models weather forecasting an initial value problem traditionally, initialization comprised objective analysis of obs at a fixed synoptic time, i.e. 00Z or 12Z: data
More informationIntroduction to Data Assimilation
Introduction to Data Assimilation Alan O Neill Data Assimilation Research Centre University of Reading What is data assimilation? Data assimilation is the technique whereby observational data are combined
More informationNumerical Weather prediction at the European Centre for Medium-Range Weather Forecasts
Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts Time series curves 500hPa geopotential Correlation coefficent of forecast anomaly N Hemisphere Lat 20.0 to 90.0 Lon
More informationEvolution of Forecast Error Covariances in 4D-Var and ETKF methods
Evolution of Forecast Error Covariances in 4D-Var and ETKF methods Chiara Piccolo Met Office Exeter, United Kingdom chiara.piccolo@metoffice.gov.uk Introduction Estimates of forecast error covariances
More information4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données
Four-Dimensional Ensemble-Variational Data Assimilation 4DEnVar Colloque National sur l'assimilation de données Andrew Lorenc, Toulouse France. 1-3 décembre 2014 Crown copyright Met Office 4DEnVar: Topics
More informationData assimilation : Basics and meteorology
Data assimilation : Basics and meteorology Olivier Talagrand Laboratoire de Météorologie Dynamique, École Normale Supérieure, Paris, France Workshop on Coupled Climate-Economics Modelling and Data Analysis
More informationNumerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2)
Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2) Time series curves 500hPa geopotential Correlation coefficent of forecast anomaly N Hemisphere Lat 20.0 to 90.0
More informationThe ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations
The Hybrid 4D-Var and Ensemble of Data Assimilations Lars Isaksen, Massimo Bonavita and Elias Holm Data Assimilation Section lars.isaksen@ecmwf.int Acknowledgements to: Mike Fisher and Marta Janiskova
More informationModel-error estimation in 4D-Var
QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY Q. J. R. Meteorol. Soc. 33: 67 80 (007) Published online 3 July 007 in Wiley InterScience (www.interscience.wiley.com) DOI: 0.00/qj.94 Model-error
More informationAssimilation Techniques (4): 4dVar April 2001
Assimilation echniques (4): 4dVar April By Mike Fisher European Centre for Medium-Range Weather Forecasts. able of contents. Introduction. Comparison between the ECMWF 3dVar and 4dVar systems 3. he current
More informationFundamentals of Data Assimila1on
2015 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO August 11-14, 2015 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University
More informationWeak Constraints 4D-Var
Weak Constraints 4D-Var Yannick Trémolet ECMWF Training Course - Data Assimilation May 1, 2012 Yannick Trémolet Weak Constraints 4D-Var May 1, 2012 1 / 30 Outline 1 Introduction 2 The Maximum Likelihood
More informationIntroduction to Data Assimilation. Reima Eresmaa Finnish Meteorological Institute
Introduction to Data Assimilation Reima Eresmaa Finnish Meteorological Institute 15 June 2006 Outline 1) The purpose of data assimilation 2) The inputs for data assimilation 3) Analysis methods Theoretical
More informationBackground and observation error covariances Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience
Background and observation error covariances Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience Sarah Dance School of Mathematical and Physical Sciences, University of Reading
More informationKalman Filter and Ensemble Kalman Filter
Kalman Filter and Ensemble Kalman Filter 1 Motivation Ensemble forecasting : Provides flow-dependent estimate of uncertainty of the forecast. Data assimilation : requires information about uncertainty
More informationA new Hierarchical Bayes approach to ensemble-variational data assimilation
A new Hierarchical Bayes approach to ensemble-variational data assimilation Michael Tsyrulnikov and Alexander Rakitko HydroMetCenter of Russia College Park, 20 Oct 2014 Michael Tsyrulnikov and Alexander
More informationThe Structure of Background-error Covariance in a Four-dimensional Variational Data Assimilation System: Single-point Experiment
ADVANCES IN ATMOSPHERIC SCIENCES, VOL. 27, NO. 6, 2010, 1303 1310 The Structure of Background-error Covariance in a Four-dimensional Variational Data Assimilation System: Single-point Experiment LIU Juanjuan
More informationConsider the joint probability, P(x,y), shown as the contours in the figure above. P(x) is given by the integral of P(x,y) over all values of y.
ATMO/OPTI 656b Spring 009 Bayesian Retrievals Note: This follows the discussion in Chapter of Rogers (000) As we have seen, the problem with the nadir viewing emission measurements is they do not contain
More informationA Regime-dependent balanced control variable based on potential vorticity
A Regime-dependent balanced control variable based on potential vorticity Ross N. Bannister 1 and Mike J. P. Cullen 2 1 Data Assimilation Research Centre, Dept. of Meteorology, Univ. of Reading, Reading,
More informationAccelerating the spin-up of Ensemble Kalman Filtering
Accelerating the spin-up of Ensemble Kalman Filtering Eugenia Kalnay * and Shu-Chih Yang University of Maryland Abstract A scheme is proposed to improve the performance of the ensemble-based Kalman Filters
More informationA Penalized 4-D Var data assimilation method for reducing forecast error
A Penalized 4-D Var data assimilation method for reducing forecast error M. J. Hossen Department of Mathematics and Natural Sciences BRAC University 66 Mohakhali, Dhaka-1212, Bangladesh I. M. Navon Department
More informationUsing Model Reduction Methods within Incremental Four-Dimensional Variational Data Assimilation
APRIL 2008 L A W L E S S E T A L. 1511 Using Model Reduction Methods within Incremental Four-Dimensional Variational Data Assimilation A. S. LAWLESS AND N. K. NICHOLS Department of Mathematics, University
More informationDiagnosis of observation, background and analysis-error statistics in observation space
Q. J. R. Meteorol. Soc. (2005), 131, pp. 3385 3396 doi: 10.1256/qj.05.108 Diagnosis of observation, background and analysis-error statistics in observation space By G. DESROZIERS, L. BERRE, B. CHAPNIK
More informationModel error in coupled atmosphereocean data assimilation. Alison Fowler and Amos Lawless (and Keith Haines)
Model error in coupled atmosphereocean data assimilation Alison Fowler and Amos Lawless (and Keith Haines) Informal DARC seminar 11 th February 2015 Introduction Coupled atmosphere-ocean DA schemes have
More informationThe Impact of Background Error on Incomplete Observations for 4D-Var Data Assimilation with the FSU GSM
The Impact of Background Error on Incomplete Observations for 4D-Var Data Assimilation with the FSU GSM I. Michael Navon 1, Dacian N. Daescu 2, and Zhuo Liu 1 1 School of Computational Science and Information
More informationPerformance of 4D-Var with Different Strategies for the Use of Adjoint Physics with the FSU Global Spectral Model
668 MONTHLY WEATHER REVIEW Performance of 4D-Var with Different Strategies for the Use of Adjoint Physics with the FSU Global Spectral Model ZHIJIN LI Supercomputer Computations Research Institute, The
More informationAn introduction to data assimilation. Eric Blayo University of Grenoble and INRIA
An introduction to data assimilation Eric Blayo University of Grenoble and INRIA Data assimilation, the science of compromises Context characterizing a (complex) system and/or forecasting its evolution,
More informationDiagnostics of linear and incremental approximations in 4D-Var
399 Diagnostics of linear and incremental approximations in 4D-Var Yannick Trémolet Research Department February 03 Submitted to Q. J. R. Meteorol. Soc. For additional copies please contact The Library
More informationConjugate Gradient (CG) Method
Conjugate Gradient (CG) Method by K. Ozawa 1 Introduction In the series of this lecture, I will introduce the conjugate gradient method, which solves efficiently large scale sparse linear simultaneous
More informationMulti-layer Neural Networks
Multi-layer Neural Networks Steve Renals Informatics 2B Learning and Data Lecture 13 8 March 2011 Informatics 2B: Learning and Data Lecture 13 Multi-layer Neural Networks 1 Overview Multi-layer neural
More informationHow does 4D-Var handle Nonlinearity and non-gaussianity?
How does 4D-Var handle Nonlinearity and non-gaussianity? Mike Fisher Acknowledgements: Christina Tavolato, Elias Holm, Lars Isaksen, Tavolato, Yannick Tremolet Slide 1 Outline of Talk Non-Gaussian pdf
More informationData assimilation; comparison of 4D-Var and LETKF smoothers
Data assimilation; comparison of 4D-Var and LETKF smoothers Eugenia Kalnay and many friends University of Maryland CSCAMM DAS13 June 2013 Contents First part: Forecasting the weather - we are really getting
More informationRelationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF
Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi 4th EnKF Workshop, April 2010 Relationship
More informationOPERATIONAL IMPLEMENTATION OF VARIATIONAL DATA ASSIMILATION
OPERATIONAL IMPLEMENTATION OF VARIATIONAL DATA ASSIMILATION PIERRE GAUTHIER Meteorological Service of Canada Dorval, Québec, Canada 1. Introduction Over the last few years, the variational form of statistical
More information4DEnVar: link with 4D state formulation of variational assimilation and different possible implementations
QuarterlyJournalof theoyalmeteorologicalsociety Q J Meteorol Soc 4: 97 October 4 A DOI:/qj35 4DEnVar: lin with 4D state formulation of variational assimilation and different possible implementations Gérald
More informationStability of Ensemble Kalman Filters
Stability of Ensemble Kalman Filters Idrissa S. Amour, Zubeda Mussa, Alexander Bibov, Antti Solonen, John Bardsley, Heikki Haario and Tuomo Kauranne Lappeenranta University of Technology University of
More informationSSMIS 1D-VAR RETRIEVALS. Godelieve Deblonde
SSMIS 1D-VAR RETRIEVALS Godelieve Deblonde Meteorological Service of Canada, Dorval, Québec, Canada Summary Retrievals using synthetic background fields and observations for the SSMIS (Special Sensor Microwave
More informationHow is balance of a forecast ensemble affected by adaptive and non-adaptive localization schemes?
1 How is balance of a forecast ensemble affected by adaptive and non-adaptive localization schemes? Ross Bannister Stefano Migliorini, Laura Baker, Ali Rudd NCEO, DIAMET, ESA University of Reading 2 Outline
More informationTing Lei, Xuguang Wang University of Oklahoma, Norman, OK, USA. Wang and Lei, MWR, Daryl Kleist (NCEP): dual resolution 4DEnsVar
GSI-based four dimensional ensemble-variational (4DEnsVar) data assimilation: formulation and single resolution experiments with real data for NCEP GFS Ting Lei, Xuguang Wang University of Oklahoma, Norman,
More informationInverse problems and uncertainty quantification in remote sensing
1 / 38 Inverse problems and uncertainty quantification in remote sensing Johanna Tamminen Finnish Meterological Institute johanna.tamminen@fmi.fi ESA Earth Observation Summer School on Earth System Monitoring
More informationData assimilation for large state vectors
Data assimilation for large state vectors Frédéric Chevallier Laboratoire des Sciences du Climat et de l Environnement Gif-sur-Yvette France Outline Introduction Basic concepts Prior information Analytical
More informationVariational ensemble DA at Météo-France Cliquez pour modifier le style des sous-titres du masque
Cliquez pour modifier le style du titre Variational ensemble DA at Météo-France Cliquez pour modifier le style des sous-titres du masque L. Berre, G. Desroziers, H. Varella, L. Raynaud, C. Labadie and
More informationObservation error specifications
Observation error specifications Gérald Desroziers, with many contributions Météo-France, CNRS 4 av. G. Coriolis, 357 Toulouse Cédex, France gerald.desroziers@meteo.fr ABSTRACT The aim of this paper is
More informationDoppler radial wind spatially correlated observation error: operational implementation and initial results
Doppler radial wind spatially correlated observation error: operational implementation and initial results D. Simonin, J. Waller, G. Kelly, S. Ballard,, S. Dance, N. Nichols (Met Office, University of
More informationT2.3: Use of ensemble information in ocean analysis and development of efficient 4D-Var
T2.3: Use of ensemble information in ocean analysis and development of efficient 4D-Var A. Weaver 1,B.Ménétrier 1,J.Tshimanga 1 and A. Vidard 2 1 CERFACS, Toulouse 2 INRIA/LJK, Grenoble December 10, 2015
More informationVariational assimilation Practical considerations. Amos S. Lawless
Variational assimilation Practical considerations Amos S. Lawless a.s.lawless@reading.ac.uk 4D-Var problem ] [ ] [ 2 2 min i i i n i i T i i i b T b h h J y R y B,,, n i i i i f subject to Minimization
More informationNumerical Weather Prediction: Data assimilation. Steven Cavallo
Numerical Weather Prediction: Data assimilation Steven Cavallo Data assimilation (DA) is the process estimating the true state of a system given observations of the system and a background estimate. Observations
More informationA comparison of the model error and state formulations of weak-constraint 4D-Var
A comparison of the model error and state formulations of weak-constraint 4D-Var A. El-Said, A.S. Lawless and N.K. Nichols School of Mathematical and Physical Sciences University of Reading Work supported
More informationCurrent Limited Area Applications
Current Limited Area Applications Nils Gustafsson SMHI Norrköping, Sweden nils.gustafsson@smhi.se Outline of talk (contributions from many HIRLAM staff members) Specific problems of Limited Area Model
More informationGSI Tutorial Background and Observation Errors: Estimation and Tuning. Daryl Kleist NCEP/EMC June 2011 GSI Tutorial
GSI Tutorial 2011 Background and Observation Errors: Estimation and Tuning Daryl Kleist NCEP/EMC 29-30 June 2011 GSI Tutorial 1 Background Errors 1. Background error covariance 2. Multivariate relationships
More informationLecture notes on assimilation algorithms
Lecture notes on assimilation algorithms Elías alur Hólm European Centre for Medium-Range Weather Forecasts Reading, UK April 18, 28 1 Basic concepts 1.1 The analysis In meteorology and other branches
More informationMETEOSAT cloud-cleared radiances for use in three/fourdimensional variational data assimilation
METEOSAT cloud-cleared radiances for use in three/fourdimensional variational data assimilation G. A. Kelly, M. Tomassini and M. Matricardi European Centre for Medium-Range Weather Forecasts, Reading,
More informationRosemary Munro*, Graeme Kelly, Michael Rohn* and Roger Saunders
ASSIMILATION OF METEOSAT RADIANCE DATA WITHIN THE 4DVAR SYSTEM AT ECMWF Rosemary Munro*, Graeme Kelly, Michael Rohn* and Roger Saunders European Centre for Medium Range Weather Forecasts Shinfield Park,
More informationDifferent approaches to model error formulation in 4D-Var: a study with high-resolution advection schemes
SERIES A DYNAMIC METEOROLOGY AND OCEANOGRAPHY PUBLISHED BY THE INTERNATIONAL METEOROLOGICAL INSTITUTE IN STOCKHOLM Tellus (29), 61A, 112 128 Printed in Singapore. All rights reserved C 28 The Authors Journal
More informationEstimating Observation Impact in a Hybrid Data Assimilation System: Experiments with a Simple Model
Estimating Observation Impact in a Hybrid Data Assimilation System: Experiments with a Simple Model NOAA / NCEP / EMC College Park, MD 20740, USA 10 February 2014 Overview Goal Sensitivity Theory Adjoint
More informationc 2007 Society for Industrial and Applied Mathematics
SIAM J. OPTIM. Vol. 18, No. 1, pp. 106 13 c 007 Society for Industrial and Applied Mathematics APPROXIMATE GAUSS NEWTON METHODS FOR NONLINEAR LEAST SQUARES PROBLEMS S. GRATTON, A. S. LAWLESS, AND N. K.
More informationIdeas for adding flow-dependence to the Met Office VAR system
Ideas for adding flow-dependence to the Met Office VAR system Andrew Lorenc Met Office, Exeter, UK andrew.lorenc@metoffice.gov.uk 1. Introduction The Met Office started developing variational assimilation
More informationOcean data assimilation for reanalysis
Ocean data assimilation for reanalysis Matt Martin. ERA-CLIM2 Symposium, University of Bern, 14 th December 2017. Contents Introduction. On-going developments to improve ocean data assimilation for reanalysis.
More informationNew Applications and Challenges In Data Assimilation
New Applications and Challenges In Data Assimilation Met Office Nancy Nichols University of Reading 1. Observation Part Errors 1. Applications Coupled Ocean-Atmosphere Ensemble covariances for coupled
More informationParallel Algorithms for Four-Dimensional Variational Data Assimilation
Parallel Algorithms for Four-Dimensional Variational Data Assimilation Mie Fisher ECMWF October 24, 2011 Mie Fisher (ECMWF) Parallel 4D-Var October 24, 2011 1 / 37 Brief Introduction to 4D-Var Four-Dimensional
More informationUNDERSTANDING DATA ASSIMILATION APPLICATIONS TO HIGH-LATITUDE IONOSPHERIC ELECTRODYNAMICS
Monday, June 27, 2011 CEDAR-GEM joint workshop: DA tutorial 1 UNDERSTANDING DATA ASSIMILATION APPLICATIONS TO HIGH-LATITUDE IONOSPHERIC ELECTRODYNAMICS Tomoko Matsuo University of Colorado, Boulder Space
More informationModel error and parameter estimation
Model error and parameter estimation Chiara Piccolo and Mike Cullen ECMWF Annual Seminar, 11 September 2018 Summary The application of interest is atmospheric data assimilation focus on EDA; A good ensemble
More informationEngineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 5: Single Layer Perceptrons & Estimating Linear Classifiers
Engineering Part IIB: Module 4F0 Statistical Pattern Processing Lecture 5: Single Layer Perceptrons & Estimating Linear Classifiers Phil Woodland: pcw@eng.cam.ac.uk Michaelmas 202 Engineering Part IIB:
More information1. Current atmospheric DA systems 2. Coupling surface/atmospheric DA 3. Trends & ideas
1 Current issues in atmospheric data assimilation and its relationship with surfaces François Bouttier GAME/CNRM Météo-France 2nd workshop on remote sensing and modeling of surface properties, Toulouse,
More informationObservations 3: Data Assimilation of Water Vapour Observations at NWP Centres
Observations 3: Data Assimilation of Water Vapour Observations at NWP Centres OUTLINE: Data Assimilation A simple analogy: data fitting 4D-Var The observation operator : RT modelling Review of Radiative
More informationImproving weather prediction via advancing model initialization
Improving weather prediction via advancing model initialization Brian Etherton, with Christopher W. Harrop, Lidia Trailovic, and Mark W. Govett NOAA/ESRL/GSD 15 November 2016 The HPC group at NOAA/ESRL/GSD
More informationRelationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF
Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF Eugenia Kalnay and Shu-Chih Yang with Alberto Carrasi, Matteo Corazza and Takemasa Miyoshi ECODYC10, Dresden 28 January 2010 Relationship
More informationEnsemble of Data Assimilations and Uncertainty Estimation
Ensemble of Data Assimilations and Uncertainty Estimation Massimo Bonavita ECMWF, Reading, UK Massimo.Bonavita@ecmwf.int ABSTRACT The background error covariance matrix (B) plays a fundamental role in
More informationData assimilation concepts and methods March 1999
Data assimilation concepts and methods March 1999 By F. Bouttier and P. Courtier Abstract These training course lecture notes are an advanced and comprehensive presentation of most data assimilation methods
More informationTangent linear and adjoint models for variational data assimilation
Data Assimilation Training Course, Reading, -4 arch 4 Tangent linear and adjoint models for variational data assimilation Angela Benedetti with contributions from: arta Janisková, Philippe Lopez, Lars
More informationVariational data assimilation of lightning with WRFDA system using nonlinear observation operators
Variational data assimilation of lightning with WRFDA system using nonlinear observation operators Virginia Tech, Blacksburg, Virginia Florida State University, Tallahassee, Florida rstefane@vt.edu, inavon@fsu.edu
More informationData Assimilation: Finding the Initial Conditions in Large Dynamical Systems. Eric Kostelich Data Mining Seminar, Feb. 6, 2006
Data Assimilation: Finding the Initial Conditions in Large Dynamical Systems Eric Kostelich Data Mining Seminar, Feb. 6, 2006 kostelich@asu.edu Co-Workers Istvan Szunyogh, Gyorgyi Gyarmati, Ed Ott, Brian
More informationDacian N. Daescu 1, I. Michael Navon 2
6.4 REDUCED-ORDER OBSERVATION SENSITIVITY IN 4D-VAR DATA ASSIMILATION Dacian N. Daescu 1, I. Michael Navon 2 1 Portland State University, Portland, Oregon, 2 Florida State University, Tallahassee, Florida
More informationCERA-SAT: A coupled reanalysis at higher resolution (WP1)
CERA-SAT: A coupled reanalysis at higher resolution (WP1) ERA-CLIM2 General assembly Dinand Schepers 16 Jan 2017 Contributors: Eric de Boisseson, Per Dahlgren, Patrick Lalolyaux, Iain Miller and many others
More informationIntroduction to Data Assimilation. Saroja Polavarapu Meteorological Service of Canada University of Toronto
Introduction to Data Assimilation Saroja Polavarapu Meteorological Service of Canada University of Toronto GCC Summer School, Banff. May 22-28, 2004 Outline of lectures General idea Numerical weather prediction
More informationEstimating Observation Impact in a Hybrid Data Assimilation System: Experiments with a Simple Model
Estimating Observation Impact in a Hybrid Data Assimilation System: Experiments with a Simple Model Rahul Mahajan NOAA / NCEP / EMC - IMSG College Park, MD 20740, USA Acknowledgements: Ron Gelaro, Ricardo
More informationRadar data assimilation using a modular programming approach with the Ensemble Kalman Filter: preliminary results
Radar data assimilation using a modular programming approach with the Ensemble Kalman Filter: preliminary results I. Maiello 1, L. Delle Monache 2, G. Romine 2, E. Picciotti 3, F.S. Marzano 4, R. Ferretti
More informationTHE IMPACT OF DIFFERENT DATA FIELDS ON STORM-SSCALE DATA ASSIMILATION
JP1J.3 THE IMPACT OF DIFFERENT DATA FIELDS ON STORM-SSCALE DATA ASSIMILATION Guoqing Ge 1,2,*, Jidong Gao 1, Kelvin Droegemeier 1,2 Center for Analysis and Prediction of Storms, University of Oklahoma,
More informationGaussian Process Approximations of Stochastic Differential Equations
Gaussian Process Approximations of Stochastic Differential Equations Cédric Archambeau Dan Cawford Manfred Opper John Shawe-Taylor May, 2006 1 Introduction Some of the most complex models routinely run
More informationM.Sc. in Meteorology. Numerical Weather Prediction
M.Sc. in Meteorology UCD Numerical Weather Prediction Prof Peter Lynch Meteorology & Climate Cehtre School of Mathematical Sciences University College Dublin Second Semester, 2005 2006. Text for the Course
More informationProspects for radar and lidar cloud assimilation
Prospects for radar and lidar cloud assimilation Marta Janisková, ECMWF Thanks to: S. Di Michele, E. Martins, A. Beljaars, S. English, P. Lopez, P. Bauer ECMWF Seminar on the Use of Satellite Observations
More informationEFSO and DFS diagnostics for JMA s global Data Assimilation System: their caveats and potential pitfalls
EFSO and DFS diagnostics for JMA s global Data Assimilation System: their caveats and potential pitfalls Daisuke Hotta 1,2 and Yoichiro Ota 2 1 Meteorological Research Institute, Japan Meteorological Agency
More informationA Comparative Study of 4D-VAR and a 4D Ensemble Kalman Filter: Perfect Model Simulations with Lorenz-96
Tellus 000, 000 000 (0000) Printed 20 October 2006 (Tellus LATEX style file v2.2) A Comparative Study of 4D-VAR and a 4D Ensemble Kalman Filter: Perfect Model Simulations with Lorenz-96 Elana J. Fertig
More informationThe Inversion Problem: solving parameters inversion and assimilation problems
The Inversion Problem: solving parameters inversion and assimilation problems UE Numerical Methods Workshop Romain Brossier romain.brossier@univ-grenoble-alpes.fr ISTerre, Univ. Grenoble Alpes Master 08/09/2016
More informationR. E. Petrie and R. N. Bannister. Department of Meteorology, Earley Gate, University of Reading, Reading, RG6 6BB, United Kingdom
A method for merging flow-dependent forecast error statistics from an ensemble with static statistics for use in high resolution variational data assimilation R. E. Petrie and R. N. Bannister Department
More information