Andrew C Lorenc 07/20/14. Met Oce Prepared for DAOS meeting, August 2014, Montreal.

Similar documents
Data assimilation for local rainfall near Tokyo on 18 July 2013 using EnVAR with observation space localization

Joint state and parameter estimation with an iterative ensemble Kalman smoother

An iterative ensemble Kalman smoother

Notes on Kalman Filtering

Comparisons between 4DEnVar and 4DVar on the Met Office global model

Can hybrid-4denvar match hybrid-4dvar?

Data Assimilation. Alan O Neill National Centre for Earth Observation & University of Reading

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données

An iterative ensemble Kalman smoother

Recent Developments In Evolutionary Data Assimilation And Model Uncertainty Estimation For Hydrologic Forecasting Hamid Moradkhani

Tracking. Announcements

Financial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2

Extended ensemble Kalman filters for high-dimensional hierarchical state-space models

Robot Motion Model EKF based Localization EKF SLAM Graph SLAM

An recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes

Advances and Challenges in Ensemblebased Data Assimilation in Meteorology. Takemasa Miyoshi

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Ensemble-based Data Assimilation of TRMM/GPM Precipitation Measurements

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Ensemble 4DVAR for the NCEP hybrid GSI EnKF data assimilation system and observation impact study with the hybrid system

hen found from Bayes rule. Specically, he prior disribuion is given by p( ) = N( ; ^ ; r ) (.3) where r is he prior variance (we add on he random drif

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis

SEIF, EnKF, EKF SLAM. Pieter Abbeel UC Berkeley EECS

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

A variational radial basis function approximation for diffusion processes.

(10) (a) Derive and plot the spectrum of y. Discuss how the seasonality in the process is evident in spectrum.

Aspects of the Ensemble Kalman Filter. David Livings

Probabilistic Robotics SLAM

Testing for a Single Factor Model in the Multivariate State Space Framework

Numerical Dispersion

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Filtering Turbulent Signals Using Gaussian and non-gaussian Filters with Model Error

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Augmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004

Ensemble- based observa/on impact es/mates using the NCEP/GFS

Ensemble 4DVAR and observa3on impact study with the GSIbased hybrid ensemble varia3onal data assimila3on system. for the GFS

Lecture 3: Exponential Smoothing

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006

Stable block Toeplitz matrix for the processing of multichannel seismic data

Linear Gaussian State Space Models

STATE-SPACE MODELLING. A mass balance across the tank gives:

Ensamble methods: Bagging and Boosting

RL Lecture 7: Eligibility Traces. R. S. Sutton and A. G. Barto: Reinforcement Learning: An Introduction 1

Physics 127b: Statistical Mechanics. Fokker-Planck Equation. Time Evolution

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Hybrid Variational Ensemble Data Assimilation for Tropical Cyclone

Probabilistic Robotics

Introduction to Mobile Robotics

Using the Kalman filter Extended Kalman filter

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Ting Lei, Xuguang Wang University of Oklahoma, Norman, OK, USA. Wang and Lei, MWR, Daryl Kleist (NCEP): dual resolution 4DEnsVar

The electromagnetic interference in case of onboard navy ships computers - a new approach

Ensamble methods: Boosting

Analyze patterns and relationships. 3. Generate two numerical patterns using AC

EFSO and DFS diagnostics for JMA s global Data Assimilation System: their caveats and potential pitfalls

4.2 The Fourier Transform

Probabilistic Robotics SLAM

OBJECTIVES OF TIME SERIES ANALYSIS

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

Comparing Variational, Ensemble-based and Hybrid Data Assimilations at Regional Scales

Linear Response Theory: The connection between QFT and experiments

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

EXPLICIT TIME INTEGRATORS FOR NONLINEAR DYNAMICS DERIVED FROM THE MIDPOINT RULE

Announcements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering

Chapter 5. Heterocedastic Models. Introduction to time series (2008) 1

Theory of! Partial Differential Equations!

P 1.86 A COMPARISON OF THE HYBRID ENSEMBLE TRANSFORM KALMAN FILTER (ETKF)- 3DVAR AND THE PURE ENSEMBLE SQUARE ROOT FILTER (EnSRF) ANALYSIS SCHEMES

di Bernardo, M. (1995). A purely adaptive controller to synchronize and control chaotic systems.

2017 3rd International Conference on E-commerce and Contemporary Economic Development (ECED 2017) ISBN:

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits

CS376 Computer Vision Lecture 6: Optical Flow

Accelerated micro/macro Monte Carlo simulation of dilute polymer solutions

References are appeared in the last slide. Last update: (1393/08/19)

Unsteady Flow Problems

Monitoring and data filtering II. Dynamic Linear Models

A Shooting Method for A Node Generation Algorithm

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Multivariate Correlations: Applying a Dynamic Constraint and Variable Localization in an Ensemble Context

ST2352. Stochastic Processes constructed via Conditional Simulation. 09/02/2014 ST2352 Week 4 1

Air Traffic Forecast Empirical Research Based on the MCMC Method

20. Applications of the Genetic-Drift Model

EKF SLAM vs. FastSLAM A Comparison

Properties of Autocorrelated Processes Economics 30331

Error (E) Covariance Diagnostics. in Ensemble Data Assimilation. Kayo Ide, Daryl Kleist, Adam Kubaryk University of Maryland

A FLEXIBLE APPROACH FOR THE NUMERICAL SOLUTION OF THE INS MECHANIZATION EQUATIONS

An introduction to the theory of SDDP algorithm

Refraction coefficient determination and modelling for the territory of the Kingdom of Saudi Arabia

CSE-473. A Gentle Introduction to Particle Filters

Improving GFS 4DEnVar Hybrid Data Assimilation System Using Time-lagged Ensembles

A Fusion Model for Day-Ahead Wind Speed Prediction based on the Validity of the Information

GDP PER CAPITA IN EUROPE: TIME TRENDS AND PERSISTENCE

The complexity of climate model drifts

NCSS Statistical Software. , contains a periodic (cyclic) component. A natural model of the periodic component would be

Single and Double Pendulum Models

Introduction D P. r = constant discount rate, g = Gordon Model (1962): constant dividend growth rate.

Solutions to the Exam Digital Communications I given on the 11th of June = 111 and g 2. c 2

Transcription:

Ensemble Forecas Sensiiviy o Observaions EFSO) and Flow-Following Localisaion in 4DEnVar Andrew C Lorenc 07/20/14 Me Oce andrew.lorenc@meoce.gov.uk Prepared for DAOS meeing, Augus 2014, Monreal.

Inroducion The global FSO algorihm, developed wih he help of DAOS, has become a useful ool for OS managers. How can we mainain his in fuure EnVar mehods, wihou an adjoin forecas model? Ensemble covariance esimaes are noisy! Filering usually localisaion) is essenial for accurae resuls. EFSO has o ler 4D covariances for longer windows han DA. ETKF can deec he large signals from major arge areas wihou localisaion.) This is work in progress: 1. Flow-following localisaion in 4DEnVar 2. EFSO using 4DEnVar

The Advanages of 4DEnVar DA Can iniialise higher resoluion NWP han an ensemble Model-space ensemble covariance faciliiaes many forms of lering as well as simple spaial localisaion: - Hybridisaion, balance, ime smoohing, - spaial smoohing via specral localisaion Buehner and Charron 2007)), - muli-scale localisaion Does no need repeaed runs of linear and adjoin model

The need for ow following localisaion in 4DEnVar Top: 6 hour ime-evoluion of incremen from localised ensemble in 4DEnVar. Boom: Evoluion of he same iniial incremen by he PF model in ensemble-4dvar Lorenc e al., 2014).

Flow-following localisaion in 4DEnVar Could do his saisically Bishop and Hodyss, 2009a,b; Gasperoni and Wang, 2014). Insead we choose o apply he dynamical idea of advecing he α-eld using an esimae of he group velociy e.g. 0.75 of he smoohed wind eld). Each α i is consruced such ha α i α T i = L, he 4D localisaion marix. Basic 4DEnVar Lorenc e al., 2014) uses a persisence forecas α i = Iα i so ha L = ILI T. Our plan is o use a simple semi-lagrangian advecion α i = U α α i o give a fully 4D L wih localisaion following he ow.

The Me Oce FSO sysem Lorenc and Marrio, 2014). )) δx 0 = K y o H x b 0 Variaional daa assimilaion: Dierence, due o obs: The dierence beween scores: is he Impac: J = Linearise abou nie dierence: Aribue o each ob: J = δx fa y o H x fa = M x a 0) ), = M x fb δx = x fa x b 0 x fb δx fa = x fa x, δx fb = x fb x ) T C 1 δx fa J = δx T C δx fa δx fb + δx fb ) T C 1 δx fb ) T x0)) b K T M T C δx fa + δx fb ) K and K T are solved implicily using minimisaions. M T is an adjoin model.

ETKF FSO sysems Liu and Kalnay, 2008; Li e al., 2010). )) ETKF wrien as: δx 0 = X b K y o H x b 0 K isn' marix-mul.: A = K )) y o H x b evaluaed each 0 grid-poin o give rows of δx = A i α i x i )))) whose columns are he α i : δx 0 = X b K y o H x b 0 1 K )) T Aribue o each ob J = y o H x b heir noaion 0 KT X f T 6) C δx fa + δx fb ) marix noaion: ) T J = 1 T K y o H x0)) b KT X f ) ) T 6 C δx fa + δx fb ) K and K T come from LETKF. There is no ow-following localisaion unless he ETKF is amended for KT. Kunii e al. 2012) evaluaed EFSO in a 12 hr WRF forecas of a yphoon very plausible resuls, validaing well agains OSE.

Relies on EnKF mehods producing an analysis ensemble: Alernaive form for he Kalman gain: Aribue o each ob unlocalised) Normal EnKF localisaion: EnKF FSO sysems Kalnay e al., 2012). P a e = X a X a ) T K = P a H T R 1 T J = y o H x0)) b R 1 HX a X a ) T C δx fa + δx fb ) T J = y o H x0)) b R 1 L om Y )) a X a ) T C δx fa + δx fb ) Simple mehod which works in any EnKF sysem. Localisaion L om can be made ow-dependen. Several sudies on is bes form: Kalnay e al. 2012) in a oy 40 variable model ried displacing hem wih a mean group velociy clearly beer han xed localisaion. Oa e al. 2013) in he NCEP GFS, found i bes o advec he cenre of he localisaion funcion by 0.75 imes mean wind a each level.

4DEnVar FSO 4DEnVar sysems do no usually generae ensemble, so we rever o adjoin mehod, bu wihou using M T. Exend ensemble & 4DEnVar a lease in principle) o give incremen a ime : Aribue o each ob J = δx = K ex 4DEnV ar y o H y o H )) x b 0 T x0)) b K T ex 4DEnV ar C δx fa Schur produc is inside K T ex 4DEnV ar his is like LETKF FSO, excep for ow-dependen α advecion. + δx fb ) K T ex 4DEnV ar is solved implicily by minimisaion algorihm. As in oher ensemble mehods, no need for adjoin model M T.

Long erm prospecs Ensemble mehods can work, bu ow-following localisaion is he key. Bu here are heriage ETKF mehods???) Ensemble mehods are likely o be more accurae for more nonlinear and longer windows. Convecive-scale mehods will need a new deniion of impac J since accurae vericaion analyses are unavailable. Me Oce is using J o observaion penaly from VAR. Unlikely o have single impac measure his won' please OS managers. Can in principle measure impac of larger-scales, via boundary condiions. Bu is i worh he eor?

References Bishop CH, Hodyss D. 2009a. Ensemble covariances adapively localized wih ECO-RAP. par 1: ess on simple error models. Tellus A 61: 8496, doi:hp://dx.doi. org/10.1111/j.1600-0870.2008.00371.x. Bishop CH, Hodyss D. 2009b. Ensemble covariances adapively localized wih ECO-RAP. par 2: a sraegy for he amosphere. Tellus A 61: 97111, doi:hp: //dx.doi.org/10.1111/j.1600-0870.2008.00372.x. Buehner M, Charron M. 2007. Specral and spaial localizaion of background-error correlaions for daa assimilaion. Q. J. R. Meeorol. Soc. 133: 615630, doi: hp://dx.doi.org/10.1002/qj.50. Gasperoni N, Wang X. 2014. Improved localizaion of he ensemble-based observaion esimae using a dynamic group heory echnique. In: proceedings. URL hp://hfip.psu.edu/fuz4/enkf2014/enkf-day2/gasperoni_enkf-workshop-2014.pdf. 6h EnKF Workshop Kalnay E, Oa Y, Miyoshi T, Liu J. 2012. A simpler formulaion of forecas sensiiviy o observaions: hp://dx.doi.org/10.3402/ellusa.v64i0.18462. applicaion o ensemble kalman lers. ellusa 64, doi: Kunii M, Miyoshi T, Kalnay E. 2012. Esimaing he impac of real observaions in regional numerical weaher predicion using an ensemble kalman ler. Mon. Weaher Rev. 1406): 19751987. Li H, Liu J, Kalnay E. 2010. Correcion of: Esimaing observaion impac wihou adjoin model in an ensemble Kalman ler. Q. J. R. Meeorol. Soc. 136651): 16521654. Liu J, Kalnay E. 2008. Esimaing observaion impac wihou adjoin model in an ensemble kalman ler. Q. J. R. Meeorol. Soc. 134634): 13271335. Lorenc AC, Bowler NE, Clayon AM, Fairbairn D, Pring SR. 2014. Comparison of hybrid-4denvar and hybrid-4dvar daa assimilaion mehods for global NWP. Mon. Weaher Rev. submied. Lorenc AC, Marrio R. 2014. Forecas sensiiviy o observaions in he Me Oce global NWP sysem. Q. J. R. Meeorol. Soc. 140: 209224, doi:hp://dx.doi.org/ 10.1002/qj.2122. Oa Y, Derber JC, Kalnay E, Miyoshi T. 2013. Ensemble-based observaion impac esimaes using he NCEP GFS. Tellus A 65, doi:hp://dx.doi.org/10.3402/ellusa. v65i0.20038.