Relative Merits of 4D-Var and Ensemble Kalman Filter
|
|
- Sheryl Marshall
- 5 years ago
- Views:
Transcription
1 Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29 - September 3, L'Aquila, Italy. Crown copyright
2 Outline Consider 4D-Var & EnKF for NWP applications Look at how they represent covariances, and hence their expected properties Incremental 4D-Var as a 4D covariance model EnKF sampling of covariances Compare assimilation characteristics Ease of implementation Two ways forward 2 Andrew Lorenc. ISSAOS Crown copyright
3 Data Assimilation Represent in terms of NWP model variables Uncertainty PDF of all variables Evolve using physically based NWP equations should propagate uncertainty & allow for model error Fokker-Planck equation Combine using Bayes theorem characterise observation uncertainties PDFs are unknowable! 3 Andrew Lorenc. ISSAOS Crown copyright
4 Data Assimilation Represent in terms of NWP model variables Uncertainty PDF of all variables Evolve using physically based NWP equations should propagate uncertainty & allow for model error Fokker-Planck equation Combine using Bayes theorem characterise observation uncertainties PDFs are unknowable! 4 Andrew Lorenc. ISSAOS Crown copyright
5 Fokker-Planck Equation pdf t0 ` pdf t1 chaotic growth + model error increase spread 5 Andrew Lorenc. ISSAOS Crown copyright
6 Data Assimilation Represent in terms of NWP model variables Uncertainty PDF of all variables Evolve using physically based NWP equations should propagate uncertainty & allow for model error Fokker-Planck equation Combine using Bayes theorem characterise observation uncertainties PDFs are unknowable! 6 Andrew Lorenc. ISSAOS Crown copyright
7 Bayes Theorem Observation x b 2 pdf f x 2 a pdf a y o =(x 1 +x 2 )/2 7 Andrew Lorenc. ISSAOS Crown copyright x 1 a x 1 b
8 Synoptic-scale Incremental 4D-Var Assume background PDFs are Gaussian Reduce dimensionality Linear evolution Builds on existing 3D-Var Can be thought of as a 4D (time & space) PDF describing uncertainty, for use in Bayesian fit to all observations in a 4D time-window. 8 Andrew Lorenc. ISSAOS Crown copyright
9 Incremental 4D-Var PF model evolves any simplified perturbation, and hence covariance of pdf Simplified Gaussian pdf t0 ` Full model evolves mean of pdf Simplified Gaussian pdf t1 9 Andrew Lorenc. ISSAOS Crown copyright
10 Incremental 4D-Var 3D-Var supplies 3D covariance at t=0, consistent with dynamical balance relationships PF model evolves this in time, to create a 4D covariance consistent with PF equations Do a 4D fit to observations in the time-window Covariances define relative weighting, interpolation and extrapolation of observations in space & time Covariances (thro null-space) define classes of 4D analysis increments which are not allowed (e.g. unbalanced, or inconsistent with PF equations) 10 Andrew Lorenc. ISSAOS Crown copyright
11 Incremental 4D-Var Equations δ x is 4D increment to 4D guess: Want 4D fit, minimising: g x = x +δ x 1 ( ) ( b) 1 )( b x = ) 2 x x B( x x x J δ δ δ δ δ 1 2 T ( o) 1( o y y R y y ) + y is prediction of obs in time window: y = H( x) v is transformed control variable: I S is incrementing operator, M is Perturbation Forecast model, U is 3DVAR variable transform, I B : S MU models 4D covariance ( x) B ( x) δ x = = S S I T MUv I T T T MUU M 1 T 1 Transformed minimisation: ( ) ( o) 1( o J v = ) 2v v+ 2 y y R y y T S
12 Benefits of 4D-Var Retains benefits of 3D-Var: assimilation of radiances, good balance, Better than 3D-Var in using obs where there are tendencies represented by PF model e.g. baroclinic developments severe weather Scope for better assimilation of cloud and ppn 12 Andrew Lorenc. ISSAOS Crown copyright
13 Ensemble Kalman Filter Mean & covariance of ensemble members define evolved pdf Gaussian pdf t0 ` Gaussian pdf t1 Full model evolves each ensemble member 13 Andrew Lorenc. ISSAOS Crown copyright
14 14 Andrew Lorenc. ISSAOS Crown copyright Extended Kalman Filter
15 EnKF = = = 15 Andrew Lorenc. ISSAOS Crown copyright
16 A form of square-root filter: 16 Andrew Lorenc. ISSAOS Crown copyright
17 Errors in sampled EnKF covariances 1.5 N=100 1 covariance distance (km) 17 Andrew Lorenc. ISSAOS Crown copyright
18 Errors in sampled EnKF covariances (2) A sub-optimal Kalman gain calculated using the estimated covariances: K f T ( HP H + ) 1 f T = P H R e e e, gives larger analysis errors, which can be calculated if one knows the true covariance: f T T ( HP H R) K a f f P = P 2 K ehp + K e + e. Global average variance, using a perfect ob: Correct K gives Sampled K e gives Andrew Lorenc. ISSAOS Crown copyright
19 The Schur or Hadamard Product Curve C chosen such that covariances go to zero at distance. e.g. compactly supported (4.10) from Gapsari and Cohn (1999) n=100 * compact support 1 This gives: Ensemble covariances modified to be 0 at distance. Covariance function slightly narrower than ideal. covariance distance (km) 19 Andrew Lorenc. ISSAOS Crown copyright
20 Best scale for C depends on ensemble size N: change in global error variance 0 N=10 N=20 N=40 N=100 N=1000 ideal best relative scale of correlation Andrew Lorenc. ISSAOS Crown copyright
21 Choices in EnKF Treat pdfs as Gaussian represented by mean & covariance excludes Ens DA methods for small nonlinear problems Localise covariances How to generate analysis ensemble?? Perturbed observations? Transform methods (ETKF EAKF EnSRF) 21 Andrew Lorenc. ISSAOS Crown copyright
22 Perturbed model & observation ensemble 22 Andrew Lorenc. ISSAOS Crown copyright
23 Transform methods avoiding perturbed obs Using SVD, transform { x f } i with covariance P = X X f f f T a a a f f T f T f into { a } T x i with = = ( + ) 1 P X X P P H HP H R HP : 1) Update all ensemble by mean increment. 2) Scale perturbations to have correct covariance: - Ensemble Adjustment Kalman Filter (Anderson): a T f X = A X. - Ensemble Transform Kalman Filter (Bishop): a f X = X T. - Ensemble square root filter (Tippett et al): sequential processing of obs 23 Andrew Lorenc. ISSAOS Crown copyright
24 Properties of transform methods Mathematically equivalent for Gaussian pdfs Reduces errors due to noisy estimation of covariances (Whitaker & Hamill) If covariance localisation is wanted, then only practicable with sequential processing of obs Localised sequential processing EnSRF is simple to code and implement 24 Andrew Lorenc. ISSAOS Crown copyright
25 Degenerate covariances The basic EnKF (without the Schur product) only has N degrees of freedom available to fit the observations. A perfect observation removes a degree of freedom from the ensemble: So the EnKF can only fit N pieces of information (in an area whose size depends on the Schur product correlation scale). 25 Andrew Lorenc. ISSAOS Crown copyright
26 26 Andrew Lorenc. ISSAOS Crown copyright Degenerate covariances
27 27 Andrew Lorenc. ISSAOS Crown copyright Balance
28 Effect of Schur product on geostrophic balance Effect of Schur product on balance Height covariances drop off more steeply, increasing geostrophic wind inplied by a single height 0.9 observation, sub-geostrophic factor but height-wind covariances are reduced, reducing 0.7 actual wind increments N 28 Andrew Lorenc. ISSAOS Crown copyright
29 Non-Gaussian Analysis Equations (1) Can be done in principle, but too difficult & costly for NWP - requires nonlinear ensemble adjustment, or resampling. I only consider applying the standard eqn to: 1 non-linear observation operators 2 Quality Control 29 Andrew Lorenc. ISSAOS Crown copyright
30 Example EnKF of a wind speed ob (N=1000) Forecast (u,v). sd(u)=sd(v)= Forecast (u,s) Andrew Lorenc. ISSAOS Crown copyright -4 Analysed (u,v) for s=3, sd(s)=0. -4 Analysed (u,v) for s=3, sd(s)=1.
31 Non-Gaussian Analysis Equations (2) Quality Control For situations where information from nearby observations helps (e.g. extreme obs corroborating each other), Var with a non-quadratic penalty function should do better than the (sequential Gaussian) EnKF. But many QC decisions are in data-sparse areas, where the principle source of corroborative information is the forecast. If the error variance of the day from the ensemble, despite sampling noise, is more accurate than that assumed in Var, then the EnKF will do better. 31 Andrew Lorenc. ISSAOS Crown copyright
32 Assimilation characteristics Forecast covariances Ability to fit detailed observations. Balance constraints Nonlinear observation operators Non-Gaussian observational errors Incremental 4D-Var Modelled at t 0 (usually isotropic), time evolution for a finite time-window represented by linear and adjoint models. Limited by resolution of simplified model. Tendencies fitted within timewindow. Can be imposed through a dynamical design to the variable transform, or a separate balance penalty. Allowed if differentiable. (Results uncertain if pdf is bimodal in range of interest.) Allowed if differentiable. (Results uncertain if pdf is bimodal in range of interest.) EnKF Sampled by ensemble (flowdependent). Noisy: must be modified to have compact support using Schur product. Fewer data (in a region) than ensemble members. Tendency information only extracted if obs properly fitted. Only imposed if each forecast in the ensemble is balanced. Lost slightly in Schur product. Allowed, but resulting pdf modelled by Gaussian. Not allowed. Prior QC step is needed. 32 Andrew Lorenc. ISSAOS Crown copyright
33 Practical characteristics Forecast model Linear model Adjoint model Covariance model Observation operators Analysis algorithm Suitability for parallel computers Limited-area modelling 33 Andrew Lorenc. ISSAOS Crown copyright Incremental 4D-Var Predict evolution of mean. No switches. Predict average evolution of finite perturbations from the mean. May be simplified. Needed for (simplified) linear model. Significant effort for covariance model. Adjoint code needed. Linear and adjoint operators needed (not usually difficult). Descent algorithm available as "off the shelf" software. Require parallel simplified and adjoint models. Error covariance models OK to specify boundary value errors EnKF Predict typical state. May have stochastic physics and switches. Not needed. Not needed. Simple correlation in Schur product. Covariance inflation to keep the right spread. Only uses forward operators. EnSRF very easy. Simultaneous box algorithms are more complicated (like OI). Forecasts can run in parallel. Covariances require a transposition. Sequential proc of obs difficult. Ensemble of global forecasts to provide boundary conditions.
34 Two possible ways forward Hybrid 4D-Var - EnKF for mainstream NWP Nested EnKF for special applications 34 Andrew Lorenc. ISSAOS Crown copyright
35 Mainstream NWP Systems - requirements High resolution to reduced errors of representativeness Analyse all scales with significant errors Quality control observations Use nonlinear observations Update satellite bias corrections Better (mean) short-period forecast more important than better error estimates VAR can address all of these simultaneously Seek to enhance it by adding benefits of EnKF 35 Andrew Lorenc. ISSAOS Crown copyright
36 Variational use of EnKF covariance (1) Can use the ensemble generated covariances in a variational algorithm This should give identical results to the mean from an ideal EnKF algorithm As usual with VAR, the analysis error covariance is not automatically obtained So the VAR method cannot easily generate an ensemble, but it can use one made by another system. 36 Andrew Lorenc. ISSAOS Crown copyright
37 Variational use of EnKF covariance (1) 37 Andrew Lorenc. ISSAOS Crown copyright
38 (2) Similarly, VAR can use ensemble covariances modified by a Schur product: 38 Andrew Lorenc. ISSAOS Crown copyright
39 (3) VAR can use the ensemble to augment the traditional covariance model with some Errors Of The Day. β Should reduce traditional error covariances to compensate for those represented by the ensemble (β>1). Dale Barker & Adrian Semple at Met Office. Hamill & Snyder (2000). 39 Andrew Lorenc. ISSAOS Crown copyright
40 Response to a single T ob Basic 3D-Var 3D-Var + 1 bred mode Dale Barker EOTD expts. Mark Dubal GCT expts. Adrian Semple, 2001: A Meteorological Assessment of the Geostrophic Co-ordinate Transform and Error Breeding System When used in 3D Variational Data Assimilation. NWP Tech Rep Andrew Lorenc. ISSAOS Crown copyright
41 Hybrid 4D-Var EnKF - a possible scenario High resolution control NWP model, for the best possible prediction of the best estimate. Incremental 4D-Var, using all relevant observations in a time-window (including nonlinear H, and QC). Final outer-iteration at sufficient resolution to extract information from the tendencies between consecutive observed fields. Background Covariances in 4D-Var enhanced by synopticscale Errors of The Day from an ensemble of perturbations. Ensemble propagated using an ETKF centred on the high-res 4D-Var control. 41 Andrew Lorenc. ISSAOS Crown copyright
42 EnKF for special applications Large uncertainty difficulty with 4D-Var: Deterministic NWP model for ensemble mean Evolution of perturbations nonlinear EnKF can work with large uncertainty: Sparse observations (Whitaker et al.) Idealized convective-scale, with no large-scale errors (Snyder & Zhang) EnKF is easy to develop, even if model is also developing Use EnKF for R&D of new NWP applications with large uncertainty (e.g. convective-scale) Nested in mainstream NWP bcs to give synoptic-scales 42 Andrew Lorenc. ISSAOS Crown copyright
43 4D-Var v EnKF Summary 43 Andrew Lorenc. ISSAOS Crown copyright
4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données
Four-Dimensional Ensemble-Variational Data Assimilation 4DEnVar Colloque National sur l'assimilation de données Andrew Lorenc, Toulouse France. 1-3 décembre 2014 Crown copyright Met Office 4DEnVar: Topics
More informationKalman Filter and Ensemble Kalman Filter
Kalman Filter and Ensemble Kalman Filter 1 Motivation Ensemble forecasting : Provides flow-dependent estimate of uncertainty of the forecast. Data assimilation : requires information about uncertainty
More informationCan hybrid-4denvar match hybrid-4dvar?
Comparing ensemble-variational assimilation methods for NWP: Can hybrid-4denvar match hybrid-4dvar? WWOSC, Montreal, August 2014. Andrew Lorenc, Neill Bowler, Adam Clayton, David Fairbairn and Stephen
More information4. DATA ASSIMILATION FUNDAMENTALS
4. DATA ASSIMILATION FUNDAMENTALS... [the atmosphere] "is a chaotic system in which errors introduced into the system can grow with time... As a consequence, data assimilation is a struggle between chaotic
More informationLocalization in the ensemble Kalman Filter
Department of Meteorology Localization in the ensemble Kalman Filter Ruth Elizabeth Petrie A dissertation submitted in partial fulfilment of the requirement for the degree of MSc. Atmosphere, Ocean and
More informationGaussian Filtering Strategies for Nonlinear Systems
Gaussian Filtering Strategies for Nonlinear Systems Canonical Nonlinear Filtering Problem ~u m+1 = ~ f (~u m )+~ m+1 ~v m+1 = ~g(~u m+1 )+~ o m+1 I ~ f and ~g are nonlinear & deterministic I Noise/Errors
More informationComparisons between 4DEnVar and 4DVar on the Met Office global model
Comparisons between 4DEnVar and 4DVar on the Met Office global model David Fairbairn University of Surrey/Met Office 26 th June 2013 Joint project by David Fairbairn, Stephen Pring, Andrew Lorenc, Neill
More informationComparing Variational, Ensemble-based and Hybrid Data Assimilations at Regional Scales
Comparing Variational, Ensemble-based and Hybrid Data Assimilations at Regional Scales Meng Zhang and Fuqing Zhang Penn State University Xiang-Yu Huang and Xin Zhang NCAR 4 th EnDA Workshop, Albany, NY
More informationEvolution of Forecast Error Covariances in 4D-Var and ETKF methods
Evolution of Forecast Error Covariances in 4D-Var and ETKF methods Chiara Piccolo Met Office Exeter, United Kingdom chiara.piccolo@metoffice.gov.uk Introduction Estimates of forecast error covariances
More informationModel error and parameter estimation
Model error and parameter estimation Chiara Piccolo and Mike Cullen ECMWF Annual Seminar, 11 September 2018 Summary The application of interest is atmospheric data assimilation focus on EDA; A good ensemble
More informationFundamentals of Data Assimila1on
014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University
More informationA Note on the Particle Filter with Posterior Gaussian Resampling
Tellus (6), 8A, 46 46 Copyright C Blackwell Munksgaard, 6 Printed in Singapore. All rights reserved TELLUS A Note on the Particle Filter with Posterior Gaussian Resampling By X. XIONG 1,I.M.NAVON 1,2 and
More informationHow 4DVAR can benefit from or contribute to EnKF (a 4DVAR perspective)
How 4DVAR can benefit from or contribute to EnKF (a 4DVAR perspective) Dale Barker WWRP/THORPEX Workshop on 4D-Var and Ensemble Kalman Filter Intercomparisons Sociedad Cientifica Argentina, Buenos Aires,
More informationHybrid Variational Ensemble Data Assimilation for Tropical Cyclone
Hybrid Variational Ensemble Data Assimilation for Tropical Cyclone Forecasts Xuguang Wang School of Meteorology University of Oklahoma, Norman, OK Acknowledgement: OU: Ting Lei, Yongzuo Li, Kefeng Zhu,
More informationLocal Ensemble Transform Kalman Filter
Local Ensemble Transform Kalman Filter Brian Hunt 11 June 2013 Review of Notation Forecast model: a known function M on a vector space of model states. Truth: an unknown sequence {x n } of model states
More informationIdeas for adding flow-dependence to the Met Office VAR system
Ideas for adding flow-dependence to the Met Office VAR system Andrew Lorenc Met Office, Exeter, UK andrew.lorenc@metoffice.gov.uk 1. Introduction The Met Office started developing variational assimilation
More informationAddressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF
Addressing the nonlinear problem of low order clustering in deterministic filters by using mean-preserving non-symmetric solutions of the ETKF Javier Amezcua, Dr. Kayo Ide, Dr. Eugenia Kalnay 1 Outline
More informationP 1.86 A COMPARISON OF THE HYBRID ENSEMBLE TRANSFORM KALMAN FILTER (ETKF)- 3DVAR AND THE PURE ENSEMBLE SQUARE ROOT FILTER (EnSRF) ANALYSIS SCHEMES
P 1.86 A COMPARISON OF THE HYBRID ENSEMBLE TRANSFORM KALMAN FILTER (ETKF)- 3DVAR AND THE PURE ENSEMBLE SQUARE ROOT FILTER (EnSRF) ANALYSIS SCHEMES Xuguang Wang*, Thomas M. Hamill, Jeffrey S. Whitaker NOAA/CIRES
More informationEnKF Review. P.L. Houtekamer 7th EnKF workshop Introduction to the EnKF. Challenges. The ultimate global EnKF algorithm
Overview 1 2 3 Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation 6th EnKF Purpose EnKF equations localization After the 6th EnKF (2014), I decided with Prof. Zhang to summarize progress
More informationFundamentals of Data Assimila1on
2015 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO August 11-14, 2015 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University
More informationEnsemble 4DVAR for the NCEP hybrid GSI EnKF data assimilation system and observation impact study with the hybrid system
Ensemble 4DVAR for the NCEP hybrid GSI EnKF data assimilation system and observation impact study with the hybrid system Xuguang Wang School of Meteorology University of Oklahoma, Norman, OK OU: Ting Lei,
More informationAccelerating the spin-up of Ensemble Kalman Filtering
Accelerating the spin-up of Ensemble Kalman Filtering Eugenia Kalnay * and Shu-Chih Yang University of Maryland Abstract A scheme is proposed to improve the performance of the ensemble-based Kalman Filters
More informationEnsemble 4DVAR and observa3on impact study with the GSIbased hybrid ensemble varia3onal data assimila3on system. for the GFS
Ensemble 4DVAR and observa3on impact study with the GSIbased hybrid ensemble varia3onal data assimila3on system for the GFS Xuguang Wang University of Oklahoma, Norman, OK xuguang.wang@ou.edu Ting Lei,
More informationIntroduction to initialization of NWP models
Introduction to initialization of NWP models weather forecasting an initial value problem traditionally, initialization comprised objective analysis of obs at a fixed synoptic time, i.e. 00Z or 12Z: data
More informationTing Lei, Xuguang Wang University of Oklahoma, Norman, OK, USA. Wang and Lei, MWR, Daryl Kleist (NCEP): dual resolution 4DEnsVar
GSI-based four dimensional ensemble-variational (4DEnsVar) data assimilation: formulation and single resolution experiments with real data for NCEP GFS Ting Lei, Xuguang Wang University of Oklahoma, Norman,
More informationSome Applications of WRF/DART
Some Applications of WRF/DART Chris Snyder, National Center for Atmospheric Research Mesoscale and Microscale Meteorology Division (MMM), and Institue for Mathematics Applied to Geoscience (IMAGe) WRF/DART
More informationEnsemble Data Assimilation and Uncertainty Quantification
Ensemble Data Assimilation and Uncertainty Quantification Jeff Anderson National Center for Atmospheric Research pg 1 What is Data Assimilation? Observations combined with a Model forecast + to produce
More informationIntroduction to Data Assimilation
Introduction to Data Assimilation Alan O Neill Data Assimilation Research Centre University of Reading What is data assimilation? Data assimilation is the technique whereby observational data are combined
More informationReport on the Joint SRNWP workshop on DA-EPS Bologna, March. Nils Gustafsson Alex Deckmyn.
Report on the Joint SRNWP workshop on DA-EPS Bologna, 22-24 March Nils Gustafsson Alex Deckmyn http://www.smr.arpa.emr.it/srnwp/ Purpose of the workshop On the one hand, data assimilation techniques require
More informationFundamentals of Data Assimilation
National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)
More informationHybrid variational-ensemble data assimilation. Daryl T. Kleist. Kayo Ide, Dave Parrish, John Derber, Jeff Whitaker
Hybrid variational-ensemble data assimilation Daryl T. Kleist Kayo Ide, Dave Parrish, John Derber, Jeff Whitaker Weather and Chaos Group Meeting 07 March 20 Variational Data Assimilation J Var J 2 2 T
More informationLagrangian Data Assimilation and Its Application to Geophysical Fluid Flows
Lagrangian Data Assimilation and Its Application to Geophysical Fluid Flows Laura Slivinski June, 3 Laura Slivinski (Brown University) Lagrangian Data Assimilation June, 3 / 3 Data Assimilation Setup:
More informationA Comparison between the 4DVAR and the Ensemble Kalman Filter Techniques for Radar Data Assimilation
NOVEMBER 2005 C A Y A E T A L. 3081 A Comparison between the 4DVAR and the Ensemble Kalman Filter Techniques for Radar Data Assimilation A. CAYA, J.SUN, AND C. SNYDER National Center for Atmospheric Research,*
More informationThe hybrid ETKF- Variational data assimilation scheme in HIRLAM
The hybrid ETKF- Variational data assimilation scheme in HIRLAM (current status, problems and further developments) The Hungarian Meteorological Service, Budapest, 24.01.2011 Nils Gustafsson, Jelena Bojarova
More informationNumerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2)
Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2) Time series curves 500hPa geopotential Correlation coefficent of forecast anomaly N Hemisphere Lat 20.0 to 90.0
More informationGSI 3DVar-based Ensemble-Variational Hybrid Data Assimilation for NCEP Global Forecast System: Single Resolution Experiments
1 2 GSI 3DVar-based Ensemble-Variational Hybrid Data Assimilation for NCEP Global Forecast System: Single Resolution Experiments 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29
More informationOcean data assimilation for reanalysis
Ocean data assimilation for reanalysis Matt Martin. ERA-CLIM2 Symposium, University of Bern, 14 th December 2017. Contents Introduction. On-going developments to improve ocean data assimilation for reanalysis.
More informationEnsemble Kalman Filter based snow data assimilation
Ensemble Kalman Filter based snow data assimilation (just some ideas) FMI, Sodankylä, 4 August 2011 Jelena Bojarova Sequential update problem Non-linear state space problem Tangent-linear state space problem
More informationData assimilation in the geosciences An overview
Data assimilation in the geosciences An overview Alberto Carrassi 1, Olivier Talagrand 2, Marc Bocquet 3 (1) NERSC, Bergen, Norway (2) LMD, École Normale Supérieure, IPSL, France (3) CEREA, joint lab École
More informationEnvironment Canada s Regional Ensemble Kalman Filter
Environment Canada s Regional Ensemble Kalman Filter May 19, 2014 Seung-Jong Baek, Luc Fillion, Kao-Shen Chung, and Peter Houtekamer Meteorological Research Division, Environment Canada, Dorval, Quebec
More informationUsing Observations at Different Spatial. Scales in Data Assimilation for. Environmental Prediction. Joanne A. Waller
UNIVERSITY OF READING DEPARTMENT OF MATHEMATICS AND STATISTICS Using Observations at Different Spatial Scales in Data Assimilation for Environmental Prediction Joanne A. Waller Thesis submitted for the
More information1. Current atmospheric DA systems 2. Coupling surface/atmospheric DA 3. Trends & ideas
1 Current issues in atmospheric data assimilation and its relationship with surfaces François Bouttier GAME/CNRM Météo-France 2nd workshop on remote sensing and modeling of surface properties, Toulouse,
More informationData Assimilation: Finding the Initial Conditions in Large Dynamical Systems. Eric Kostelich Data Mining Seminar, Feb. 6, 2006
Data Assimilation: Finding the Initial Conditions in Large Dynamical Systems Eric Kostelich Data Mining Seminar, Feb. 6, 2006 kostelich@asu.edu Co-Workers Istvan Szunyogh, Gyorgyi Gyarmati, Ed Ott, Brian
More informationFour-Dimensional Ensemble Kalman Filtering
Four-Dimensional Ensemble Kalman Filtering B.R. Hunt, E. Kalnay, E.J. Kostelich, E. Ott, D.J. Patil, T. Sauer, I. Szunyogh, J.A. Yorke, A.V. Zimin University of Maryland, College Park, MD 20742, USA Ensemble
More informationImproving GFS 4DEnVar Hybrid Data Assimilation System Using Time-lagged Ensembles
Improving GFS 4DEnVar Hybrid Data Assimilation System Using Time-lagged Ensembles Bo Huang and Xuguang Wang School of Meteorology University of Oklahoma, Norman, OK, USA Acknowledgement: Junkyung Kay (OU);
More informationThe ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations
The Hybrid 4D-Var and Ensemble of Data Assimilations Lars Isaksen, Massimo Bonavita and Elias Holm Data Assimilation Section lars.isaksen@ecmwf.int Acknowledgements to: Mike Fisher and Marta Janiskova
More informationLocal Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data
Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data John Harlim and Brian R. Hunt Department of Mathematics and Institute for Physical Science and Technology University
More informationGSI 3DVar-Based Ensemble Variational Hybrid Data Assimilation for NCEP Global Forecast System: Single-Resolution Experiments
4098 M O N T H L Y W E A T H E R R E V I E W VOLUME 141 GSI 3DVar-Based Ensemble Variational Hybrid Data Assimilation for NCEP Global Forecast System: Single-Resolution Experiments XUGUANG WANG School
More informationThe Nowcasting Demonstration Project for London 2012
The Nowcasting Demonstration Project for London 2012 Susan Ballard, Zhihong Li, David Simonin, Jean-Francois Caron, Brian Golding, Met Office, UK Introduction The success of convective-scale NWP is largely
More informationVariational data assimilation
Background and methods NCEO, Dept. of Meteorology, Univ. of Reading 710 March 2018, Univ. of Reading Bayes' Theorem Bayes' Theorem p(x y) = posterior distribution = p(x) p(y x) p(y) prior distribution
More informationData assimilation; comparison of 4D-Var and LETKF smoothers
Data assimilation; comparison of 4D-Var and LETKF smoothers Eugenia Kalnay and many friends University of Maryland CSCAMM DAS13 June 2013 Contents First part: Forecasting the weather - we are really getting
More informationQuarterly Journal of the Royal Meteorological Society
Quarterly Journal of the Royal Meteorological Society Effects of sequential or simultaneous assimilation of observations and localization methods on the performance of the ensemble Kalman filter Journal:
More informationLagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model. David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC
Lagrangian Data Assimilation and Manifold Detection for a Point-Vortex Model David Darmon, AMSC Kayo Ide, AOSC, IPST, CSCAMM, ESSIC Background Data Assimilation Iterative process Forecast Analysis Background
More informationUniversity of Oklahoma, Norman Oklahoma Monthly Weather Review Submitted June 2017 Accepted November 2017
Development of a Hybrid En3DVar Data Assimilation System and Comparisons with 3DVar and EnKF for Radar Data Assimilation with Observing System Simulation Experiments Rong Kong 1,2, Ming Xue 1,2, and Chengsi
More informationConvective Scale Ensemble for NWP
Convective Scale Ensemble for NWP G. Leoncini R. S. Plant S. L. Gray Meteorology Department, University of Reading NERC FREE Ensemble Workshop September 24 th 2009 Outline 1 Introduction The Problem Uncertainties
More informationEnsemble square-root filters
Ensemble square-root filters MICHAEL K. TIPPETT International Research Institute for climate prediction, Palisades, New Yor JEFFREY L. ANDERSON GFDL, Princeton, New Jersy CRAIG H. BISHOP Naval Research
More informationJ1.3 GENERATING INITIAL CONDITIONS FOR ENSEMBLE FORECASTS: MONTE-CARLO VS. DYNAMIC METHODS
J1.3 GENERATING INITIAL CONDITIONS FOR ENSEMBLE FORECASTS: MONTE-CARLO VS. DYNAMIC METHODS Thomas M. Hamill 1, Jeffrey S. Whitaker 1, and Chris Snyder 2 1 NOAA-CIRES Climate Diagnostics Center, Boulder,
More informationRecent Data Assimilation Activities at Environment Canada
Recent Data Assimilation Activities at Environment Canada Major upgrade to global and regional deterministic prediction systems (now in parallel run) Sea ice data assimilation Mark Buehner Data Assimilation
More informationMet Office convective-scale 4DVAR system, tests and improvement
Met Office convective-scale 4DVAR system, tests and improvement Marco Milan*, Marek Wlasak, Stefano Migliorini, Bruce Macpherson Acknowledgment: Inverarity Gordon, Gareth Dow, Mike Thurlow, Mike Cullen
More informationEnKF Localization Techniques and Balance
EnKF Localization Techniques and Balance Steven Greybush Eugenia Kalnay, Kayo Ide, Takemasa Miyoshi, and Brian Hunt Weather Chaos Meeting September 21, 2009 Data Assimilation Equation Scalar form: x a
More informationIn the derivation of Optimal Interpolation, we found the optimal weight matrix W that minimizes the total analysis error variance.
hree-dimensional variational assimilation (3D-Var) In the derivation of Optimal Interpolation, we found the optimal weight matrix W that minimizes the total analysis error variance. Lorenc (1986) showed
More informationA Hybrid ETKF 3DVAR Data Assimilation Scheme for the WRF Model. Part I: Observing System Simulation Experiment
5116 M O N T H L Y W E A T H E R R E V I E W VOLUME 136 A Hybrid ETKF 3DVAR Data Assimilation Scheme for the WRF Model. Part I: Observing System Simulation Experiment XUGUANG WANG Cooperative Institute
More informationIntroduction to Data Assimilation. Saroja Polavarapu Meteorological Service of Canada University of Toronto
Introduction to Data Assimilation Saroja Polavarapu Meteorological Service of Canada University of Toronto GCC Summer School, Banff. May 22-28, 2004 Outline of lectures General idea Numerical weather prediction
More informationConvective-scale NWP for Singapore
Convective-scale NWP for Singapore Hans Huang and the weather modelling and prediction section MSS, Singapore Dale Barker and the SINGV team Met Office, Exeter, UK ECMWF Symposium on Dynamical Meteorology
More informationPractical Aspects of Ensemble-based Kalman Filters
Practical Aspects of Ensemble-based Kalman Filters Lars Nerger Alfred Wegener Institute for Polar and Marine Research Bremerhaven, Germany and Bremen Supercomputing Competence Center BremHLR Bremen, Germany
More informationM.Sc. in Meteorology. Numerical Weather Prediction
M.Sc. in Meteorology UCD Numerical Weather Prediction Prof Peter Lynch Meteorology & Climate Cehtre School of Mathematical Sciences University College Dublin Second Semester, 2005 2006. Text for the Course
More informationCoupled atmosphere-ocean data assimilation in the presence of model error. Alison Fowler and Amos Lawless (University of Reading)
Coupled atmosphere-ocean data assimilation in the presence of model error Alison Fowler and Amos Lawless (University of Reading) Introduction Coupled DA methods are being developed to initialise forecasts
More informationData Assimilation Research Testbed Tutorial
Data Assimilation Research Testbed Tutorial Section 3: Hierarchical Group Filters and Localization Version 2.: September, 26 Anderson: Ensemble Tutorial 9//6 Ways to deal with regression sampling error:
More informationAccepted in Tellus A 2 October, *Correspondence
1 An Adaptive Covariance Inflation Error Correction Algorithm for Ensemble Filters Jeffrey L. Anderson * NCAR Data Assimilation Research Section P.O. Box 3000 Boulder, CO 80307-3000 USA Accepted in Tellus
More informationCurrent Issues and Challenges in Ensemble Forecasting
Current Issues and Challenges in Ensemble Forecasting Junichi Ishida (JMA) and Carolyn Reynolds (NRL) With contributions from WGNE members 31 th WGNE Pretoria, South Africa, 26 29 April 2016 Recent trends
More informationThe Canadian approach to ensemble prediction
The Canadian approach to ensemble prediction ECMWF 2017 Annual seminar: Ensemble prediction : past, present and future. Pieter Houtekamer Montreal, Canada Overview. The Canadian approach. What are the
More informationInter-comparison of 4D-Var and EnKF systems for operational deterministic NWP
Inter-comparison of 4D-Var and EnKF systems for operational deterministic NWP Project eam: Mark Buehner Cecilien Charette Bin He Peter Houtekamer Herschel Mitchell WWRP/HORPEX Workshop on 4D-VAR and Ensemble
More informationToward improved initial conditions for NCAR s real-time convection-allowing ensemble. Ryan Sobash, Glen Romine, Craig Schwartz, and Kate Fossell
Toward improved initial conditions for NCAR s real-time convection-allowing ensemble Ryan Sobash, Glen Romine, Craig Schwartz, and Kate Fossell Storm-scale ensemble design Can an EnKF be used to initialize
More informationHandling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model
Handling nonlinearity in Ensemble Kalman Filter: Experiments with the three-variable Lorenz model Shu-Chih Yang 1*, Eugenia Kalnay, and Brian Hunt 1. Department of Atmospheric Sciences, National Central
More informationStability of Ensemble Kalman Filters
Stability of Ensemble Kalman Filters Idrissa S. Amour, Zubeda Mussa, Alexander Bibov, Antti Solonen, John Bardsley, Heikki Haario and Tuomo Kauranne Lappeenranta University of Technology University of
More informationError (E) Covariance Diagnostics. in Ensemble Data Assimilation. Kayo Ide, Daryl Kleist, Adam Kubaryk University of Maryland
Error (E) Covariance Diagnostics in Ensemble Data Assimilation Kayo Ide, Daryl Kleist, Adam Kubaryk University of Maryland 7 th EnKF Data Assimilation Workshop May 2016 Outline Part I. Background: E-diagnostics
More informationA Comparison of Hybrid Ensemble Transform Kalman Filter Optimum Interpolation and Ensemble Square Root Filter Analysis Schemes
MARCH 2007 W A N G E T A L. 1055 A Comparison of Hybrid Ensemble Transform Kalman Filter Optimum Interpolation and Ensemble Square Root Filter Analysis Schemes XUGUANG WANG CIRES Climate Diagnostics Center,
More informationRobust Ensemble Filtering With Improved Storm Surge Forecasting
Robust Ensemble Filtering With Improved Storm Surge Forecasting U. Altaf, T. Buttler, X. Luo, C. Dawson, T. Mao, I.Hoteit Meteo France, Toulouse, Nov 13, 2012 Project Ensemble data assimilation for storm
More information(Toward) Scale-dependent weighting and localization for the NCEP GFS hybrid 4DEnVar Scheme
(Toward) Scale-dependent weighting and localization for the NCEP GFS hybrid 4DEnVar Scheme Daryl Kleist 1, Kayo Ide 1, Rahul Mahajan 2, Deng-Shun Chen 3 1 University of Maryland - Dept. of Atmospheric
More informationXuguang Wang and Ting Lei. School of Meteorology, University of Oklahoma and Center for Analysis and Prediction of Storms, Norman, OK.
1 2 3 GSI-based four dimensional ensemble-variational (4DEnsVar) data assimilation: formulation and single resolution experiments with real data for NCEP Global Forecast System 4 5 6 7 8 9 10 11 12 13
More informationDART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation.
DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation. UCAR 2014 The National Center for Atmospheric Research is sponsored by the National
More informationFour-dimensional ensemble Kalman filtering
Tellus (24), 56A, 273 277 Copyright C Blackwell Munksgaard, 24 Printed in UK. All rights reserved TELLUS Four-dimensional ensemble Kalman filtering By B. R. HUNT 1, E. KALNAY 1, E. J. KOSTELICH 2,E.OTT
More informationPar$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading
Par$cle Filters Part I: Theory Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Reading July 2013 Why Data Assimila$on Predic$on Model improvement: - Parameter es$ma$on
More informationNumerical Weather Prediction: Data assimilation. Steven Cavallo
Numerical Weather Prediction: Data assimilation Steven Cavallo Data assimilation (DA) is the process estimating the true state of a system given observations of the system and a background estimate. Observations
More informationThe Ensemble Kalman Filter:
p.1 The Ensemble Kalman Filter: Theoretical formulation and practical implementation Geir Evensen Norsk Hydro Research Centre, Bergen, Norway Based on Evensen 23, Ocean Dynamics, Vol 53, No 4 p.2 The Ensemble
More informationAssimilation des Observations et Traitement des Incertitudes en Météorologie
Assimilation des Observations et Traitement des Incertitudes en Météorologie Olivier Talagrand Laboratoire de Météorologie Dynamique, Paris 4èmes Rencontres Météo/MathAppli Météo-France, Toulouse, 25 Mars
More informationConvergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit
Convergence of Square Root Ensemble Kalman Filters in the Large Ensemble Limit Evan Kwiatkowski, Jan Mandel University of Colorado Denver December 11, 2014 OUTLINE 2 Data Assimilation Bayesian Estimation
More informationForecasting and data assimilation
Supported by the National Science Foundation DMS Forecasting and data assimilation Outline Numerical models Kalman Filter Ensembles Douglas Nychka, Thomas Bengtsson, Chris Snyder Geophysical Statistics
More informationDATA ASSIMILATION FOR FLOOD FORECASTING
DATA ASSIMILATION FOR FLOOD FORECASTING Arnold Heemin Delft University of Technology 09/16/14 1 Data assimilation is the incorporation of measurement into a numerical model to improve the model results
More informationEFSO and DFS diagnostics for JMA s global Data Assimilation System: their caveats and potential pitfalls
EFSO and DFS diagnostics for JMA s global Data Assimilation System: their caveats and potential pitfalls Daisuke Hotta 1,2 and Yoichiro Ota 2 1 Meteorological Research Institute, Japan Meteorological Agency
More informationLocalization and Correlation in Ensemble Kalman Filters
Localization and Correlation in Ensemble Kalman Filters Jeff Anderson NCAR Data Assimilation Research Section The National Center for Atmospheric Research is sponsored by the National Science Foundation.
More informationMesoscale Ensemble Data Assimilation: Opportunities and Challenges. Fuqing Zhang Penn State University
Mesoscale Ensemble Data Assimilation: Opportunities and Challenges Fuqing Zhang Penn State University Mesoscale EnKF: some incomplete background 1 st proposed by Evensen (1994); Houtekamer and Micthell
More informationBackground and observation error covariances Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience
Background and observation error covariances Data Assimilation & Inverse Problems from Weather Forecasting to Neuroscience Sarah Dance School of Mathematical and Physical Sciences, University of Reading
More informationAbstract 2. ENSEMBLE KALMAN FILTERS 1. INTRODUCTION
J5.4 4D ENSEMBLE KALMAN FILTERING FOR ASSIMILATION OF ASYNCHRONOUS OBSERVATIONS T. Sauer George Mason University, Fairfax, VA 22030 B.R. Hunt, J.A. Yorke, A.V. Zimin, E. Ott, E.J. Kostelich, I. Szunyogh,
More informationHow is balance of a forecast ensemble affected by adaptive and non-adaptive localization schemes?
1 How is balance of a forecast ensemble affected by adaptive and non-adaptive localization schemes? Ross Bannister Stefano Migliorini, Laura Baker, Ali Rudd NCEO, DIAMET, ESA University of Reading 2 Outline
More information4D-Var or Ensemble Kalman Filter? TELLUS A, in press
4D-Var or Ensemble Kalman Filter? Eugenia Kalnay 1 *, Hong Li 1, Takemasa Miyoshi 2, Shu-Chih Yang 1, and Joaquim Ballabrera-Poy 3 1 University of Maryland, College Park, MD, 20742-2425 2 Numerical Prediction
More informationImproved analyses and forecasts with AIRS retrievals using the Local Ensemble Transform Kalman Filter
Improved analyses and forecasts with AIRS retrievals using the Local Ensemble Transform Kalman Filter Hong Li, Junjie Liu, and Elana Fertig E. Kalnay I. Szunyogh, E. J. Kostelich Weather and Chaos Group
More informationEnhancing information transfer from observations to unobserved state variables for mesoscale radar data assimilation
Enhancing information transfer from observations to unobserved state variables for mesoscale radar data assimilation Weiguang Chang and Isztar Zawadzki Department of Atmospheric and Oceanic Sciences Faculty
More informationMonthly Weather Review (Proof Only)
JOBNAME: MWR 00#0 2011 PAGE: 1 SESS: 8 OUTPUT: Mon Apr 11 14:12:32 2011 Total No. of Pages: 21 MONTH 2011 R E V I E W 1 Limited-Area Ensemble-Based Data Assimilation ZHIYONG MENG Laboratory for Climate
More informationThe Local Ensemble Transform Kalman Filter (LETKF) Eric Kostelich. Main topics
The Local Ensemble Transform Kalman Filter (LETKF) Eric Kostelich Arizona State University Co-workers: Istvan Szunyogh, Brian Hunt, Ed Ott, Eugenia Kalnay, Jim Yorke, and many others http://www.weatherchaos.umd.edu
More information