Background error modelling: climatological flow-dependence

Similar documents
Inhomogeneous Background Error Modeling and Estimation over Antarctica with WRF-Var/AMPS

The ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations

GSI Tutorial Background and Observation Error Estimation and Tuning. 8/6/2013 Wan-Shu Wu 1

Filtering of variances and correlations by local spatial averaging. Loïk Berre Météo-France

Background Error Covariance Modelling

Comparison of 3D-Var and LETKF in an Atmospheric GCM: SPEEDY

13A. 4 Analysis and Impact of Super-obbed Doppler Radial Velocity in the NCEP Grid-point Statistical Interpolation (GSI) Analysis System

GSI Tutorial Background and Observation Errors: Estimation and Tuning. Daryl Kleist NCEP/EMC June 2011 GSI Tutorial

An Ensemble Kalman Filter for NWP based on Variational Data Assimilation: VarEnKF

Representation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices

Signal Modeling Techniques in Speech Recognition. Hassan A. Kingravi

Assimilation of cloud/precipitation data at regional scales

Time Series: Theory and Methods

Hilbert Space Methods for Reduced-Rank Gaussian Process Regression

Data Assimilation Research Testbed Tutorial

Multivariate Correlations: Applying a Dynamic Constraint and Variable Localization in an Ensemble Context

DATA ASSIMILATION FOR FLOOD FORECASTING

Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2)

Objective localization of ensemble covariances: theory and applications

Simulation of error cycling

The hybrid ETKF- Variational data assimilation scheme in HIRLAM

Can hybrid-4denvar match hybrid-4dvar?

Spectral and morphing ensemble Kalman filters

The Impact of Background Error Statistics and MODIS Winds for AMPS

T2.3: Use of ensemble information in ocean analysis and development of efficient 4D-Var

Recent Developments in Numerical Methods for 4d-Var

Reducing the Impact of Sampling Errors in Ensemble Filters

4DEnVar. Four-Dimensional Ensemble-Variational Data Assimilation. Colloque National sur l'assimilation de données

Met Office convective-scale 4DVAR system, tests and improvement

Loïk Berre Météo-France (CNRM/GAME) Thanks to Gérald Desroziers

Review of Covariance Localization in Ensemble Filters

Variational ensemble DA at Météo-France Cliquez pour modifier le style des sous-titres du masque

Background Error, Observation Error, and GSI Hybrid Analysis

Modelling of background error covariances for the analysis of clouds and precipitation

Empirical Mean and Variance!

The Use of a Self-Evolving Additive Inflation in the CNMCA Ensemble Data Assimilation System

ECE Digital Image Processing and Introduction to Computer Vision. Outline

552 Final Exam Preparation: 3/12/14 9:39 AM Page 1 of 7

Heterogeneous Convective-Scale Background Error Covariances with the Inclusion of Hydrometeor Variables

Brian J. Etherton University of North Carolina

A general hybrid formulation of the background-error covariance matrix for ensemble-variational ocean data assimilation

Hybrid variational-ensemble data assimilation. Daryl T. Kleist. Kayo Ide, Dave Parrish, John Derber, Jeff Whitaker

Problems with EOF (unrotated)

Introduction. Spatial Processes & Spatial Patterns

Spectral and morphing ensemble Kalman filters

USE OF SURFACE MESONET DATA IN THE NCEP REGIONAL GSI SYSTEM

15B.7 A SEQUENTIAL VARIATIONAL ANALYSIS APPROACH FOR MESOSCALE DATA ASSIMILATION

A Comparison between the 3/4DVAR and Hybrid Ensemble-VAR Techniques for Radar Data Assimilation ABSTRACT

Adaptive Localization: Proposals for a high-resolution multivariate system Ross Bannister, HRAA, December 2008, January 2009 Version 3.

A computationally efficient approach to generate large ensembles of coherent climate data for GCAM

Cross-validation methods for quality control, cloud screening, etc.

New data analysis for AURIGA. Lucio Baggio Italy, INFN and University of Trento AURIGA

Alexander Barth, Aida Alvera-Azc. Azcárate, Robert H. Weisberg, University of South Florida. George Halliwell RSMAS, University of Miami

Statistics 910, #15 1. Kalman Filter

Simple Examples. Let s look at a few simple examples of OI analysis.

Covariance Localization with the Diffusion-Based Correlation Models

Relationship between Singular Vectors, Bred Vectors, 4D-Var and EnKF

Progress in developing a 3D background error correlation model using an implicit diusion operator

A HYBRID ENSEMBLE KALMAN FILTER / 3D-VARIATIONAL ANALYSIS SCHEME

Recent developments for CNMCA LETKF

(Regional) Climate Model Validation

Introduction to GSI Background Error Covariance (BE)

Estimation of the local diffusion tensor and normalization for heterogeneous correlation modelling using a diffusion equation

Filtering and Edge Detection

Report on the Joint SRNWP workshop on DA-EPS Bologna, March. Nils Gustafsson Alex Deckmyn.

Image Noise: Detection, Measurement and Removal Techniques. Zhifei Zhang

Retrieval of Moisture from Simulated GPS Slant-Path Water Vapor Observations Using 3DVAR with Anisotropic Recursive Filters

Background Error Covariance! and GEN_BE!!! Tom Auligné! Gael Descombes!!!!!!

Comparing the SEKF with the DEnKF on a land surface model

We will of course continue using the discrete form of the power spectrum described via calculation of α and β.

The Canadian approach to ensemble prediction

MACHINE LEARNING. Methods for feature extraction and reduction of dimensionality: Probabilistic PCA and kernel PCA

How 4DVAR can benefit from or contribute to EnKF (a 4DVAR perspective)

Recent achievements in the data assimilation systems of ARPEGE and AROME-France

SIO 210 CSP: Data analysis methods L. Talley, Fall Sampling and error 2. Basic statistical concepts 3. Time series analysis

Standardized Anomaly Model Output Statistics Over Complex Terrain.

Image Filtering. Slides, adapted from. Steve Seitz and Rick Szeliski, U.Washington

The Ensemble Kalman Filter:

Spatial smoothing using Gaussian processes

Model Selection for Gaussian Processes

Satellite Retrieval Assimilation (a modified observation operator)

Sensor Tasking and Control

The Impact of Background Error on Incomplete Observations for 4D-Var Data Assimilation with the FSU GSM

Comparing two different methods to describe radar precipitation uncertainty

Anisotropic spatial filter that is based on flow-dependent background error structures is implemented and tested.

Basics on 2-D 2 D Random Signal

Direct Learning: Linear Classification. Donglin Zeng, Department of Biostatistics, University of North Carolina

Templates, Image Pyramids, and Filter Banks

How does 4D-Var handle Nonlinearity and non-gaussianity?

Lifting Detail from Darkness

A Hybrid ETKF 3DVAR Data Assimilation Scheme for the WRF Model. Part I: Observing System Simulation Experiment

Developments to the assimilation of sea surface temperature

AMS 17th Conference on Numerical Weather Predition, 1-5 August 2005, Washington D.C. Paper 16A.3

Learning gradients: prescriptive models

Feb 21 and 25: Local weighted least squares: Quadratic loess smoother

Comparing Variational, Ensemble-based and Hybrid Data Assimilations at Regional Scales

Suppression of impulse noise in Track-Before-Detect Algorithms

Robust Estimation Methods for Impulsive Noise Suppression in Speech


TAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω

Transcription:

Background error modelling: climatological flow-dependence Yann MICHEL NCAR/MMM/B Meeting 16 th April 2009 1 Introduction 2 A new estimate of lengthscales 3 Climatological flow-dependence Yann MICHEL B modelling: climatological flow-dependence 1

Background error modelling: climatological flow-dependence Spectral formulations of the B matrix allow: three-dimensional grid point background error σ b ; good representation the average spatial structure of analysis increments. But they are restricted to homogeneous isotropic horizontal analysis increments (for CV); homogeneous structure of vertical correlation (for CV). Gridpoint formulations They allow to relax those assumptions: EOF decomposition can be local; recursive filters can be applied with varying lengthscales. Yann MICHEL B modelling: climatological flow-dependence 2

Background error modelling: climatological flow-dependence However currently gen_be/wrf-var do not make benefit of this! We end up with the worse covariances of both worlds! homogeneous and isotropic structure of horizontal analysis increments (for CV), that have a bad power spectrum (Gaussian assumption) homogeneous structure of vertical correlation (for CV) homogeneous σ b (they are the sqrt of EOF eigenvalues) Moreover, the horizontal analysis increments looks not so good (c.f. PSOT results of gen_be_stage4_regional without tuning of lengthscales). Yann MICHEL B modelling: climatological flow-dependence 3

A new estimate of lengthscales The Wu, Purser and Parrish (2002) formula The correlation lengthscale can be estimated through the ration of the variance of the field to the variance of its Laplacian: L = 8 V «1/4 ψ V ζ gen_be_stage4_regional_from_variances * for each member (date or ensemble) + for each vertical level or EOF mode - perform spatial laplacian computation with fft - accumulate variance for projected field - accumulate variance for projected Laplacian field + end * end * Compute lengthscales Yann MICHEL B modelling: climatological flow-dependence 5

A new estimate of lengthscales: results for CONUS 200 We obtain local lengthscales which noise seems in agreement with Pannekoucke et al (2008) and choose to use the median over the domain. Figure: Comparison of raw lengthscales obtained over the CONUS domain (200 km resolution) for the fit of spatial correlation (gen_be_stage4_regional) and the new estimate from the variances (gen_be_stage4_regional_from_variances) Yann MICHEL B modelling: climatological flow-dependence 6

A new estimate of lengthscales: results for AMPSRT 45 Comparison Smoother results over the EOF mode (more robust). Shorter lengthscales for ψ, χ u and larger for t u, rh. Figure: Same comparison over the AMPSRT domain (45 km resolution) Yann MICHEL B modelling: climatological flow-dependence 7

Single observation experiments (PSOT) Figure: PSOT over the AMPSRT domain (45 km resolution) for a u observation Yann MICHEL B modelling: climatological flow-dependence 8

Single observation experiments (PSOT) Figure: PSOT over the AMPSRT domain (45 km resolution) for a u observation Yann MICHEL B modelling: climatological flow-dependence 8

Single observation experiments (PSOT) Figure: PSOT over the AMPSRT domain (45 km resolution) for a t observation Yann MICHEL B modelling: climatological flow-dependence 9

Single observation experiments (PSOT) Figure: PSOT over the AMPSRT domain (45 km resolution) for a t observation Yann MICHEL B modelling: climatological flow-dependence 9

Single observation experiments (PSOT) Figure: PSOT over the AMPSRT domain (45 km resolution) for a rh observation Yann MICHEL B modelling: climatological flow-dependence 10

Modelling the climatological flow-dependence Currently, the bin_type in gen_be is an on-off way of specifying B. It allows j-dependence of Regression coefficients (stage 2, U p ) Eigenvalues/vectors of vertical covariance (stage 3, U v ) Lengthscales (stage 4, U h ) But when the grid is not j/latitude (as for AMPSRT), we are restricted to homogeneity (bin_type 5) x = U p U v U h v (1) Yann MICHEL B modelling: climatological flow-dependence 11

Varying background error variances gen_be_stage4_regional_from_variances provides gridpoint variances of fields on EOF modes that could be used to add climatological dependence of background error variances. Figure: Variance for ψ and χ u on EOF 1 Yann MICHEL B modelling: climatological flow-dependence 12

Varying background error lengthscales gen_be_stage4_regional_from_variances provides gridpoint lengthscales of fields on EOF modes Figure: Lengthscale for ψ and χu on EOF 1 Yann MICHEL B modelling: climatological flow-dependence 13

Varying background error lengthscales: recursive filters Recursive filters can deal with smoothly varying lengthscales, but the amplitude of the filter has to be reconsidered (Purser et.al, 2003). Basic equation of recursive filter of smoothing parameter α can easily be made grid-dependent. A i = αa i 1 + (1 α)a i 500 450 400 350 300 250 200 150 100 0 20 40 60 80 100 120 140 160 180 200 Figure: A varying lengthscale (km) 0.10 0.09 0.08 0.07 0.06 0.05 0.04 0.03 0.02 0.01 Impulse 0.00 0 20 40 60 80 100 120 140 160 180 200 Figure: Impulse response of the 6-order recursive filter. Yann MICHEL B modelling: climatological flow-dependence 14

Varying background error lengthscales in WRFVAR An academic test where the background error lengthscales are increasing by a factor of 2 from West to East. Still some work to go to achieve proper normalization of the amplitude of the recursive filters. Yann MICHEL B modelling: climatological flow-dependence 15

Conclusion Climatological flow-dependence New way of computing lengthscales, more efficient, looks better. On the way of specifying varying background error variances On the way of specifying varying background error lengthscales With bin_type=0, one can have varying regression coefficients (not shown) Filtering Variances, Lengthscales and Regression coefficients may need to be locally averaged (spatially and or temporally averaged). The filter could be adaptive to the noise level and structure (Berre, Raynaud, Pannekoucke). Flow-dependence of the day This improvements could be used with the hybrid framework, but still a lot of work before. Yann MICHEL B modelling: climatological flow-dependence 16