Skill of Nowcasting of Precipitation by NWP and by Lagrangian Persistence. (where we chronicle the bridging of the gap )

Similar documents
THE DECORRELATION SCALE: METHODOLOGY AND APPLICATION FOR PRECIPITATION FORECASTS

Hazard assessment based on radar-based rainfall nowcasts at European scale The HAREN project

Enhancing information transfer from observations to unobserved state variables for mesoscale radar data assimilation

Update on CoSPA Storm Forecasts

Predicting rainfall using ensemble forecasts

Ensemble Kalman Filter Assimilation of Radar Data for a Convective Storm using a Two-moment Microphysics Scheme 04/09/10

Spatial verification of NWP model fields. Beth Ebert BMRC, Australia

Feature-specific verification of ensemble forecasts

ABSTRACT 3 RADIAL VELOCITY ASSIMILATION IN BJRUC 3.1 ASSIMILATION STRATEGY OF RADIAL

Application and verification of ECMWF products 2008

DATA FUSION NOWCASTING AND NWP

Toward improved initial conditions for NCAR s real-time convection-allowing ensemble. Ryan Sobash, Glen Romine, Craig Schwartz, and Kate Fossell

FORECASTING: A REVIEW OF STATUS AND CHALLENGES. Eric Grimit and Kristin Larson 3TIER, Inc. Pacific Northwest Weather Workshop March 5-6, 2010

Generating probabilistic forecasts from convectionpermitting. Nigel Roberts

Precipitation verification. Thanks to CMC, CPTEC, DWD, ECMWF, JMA, MF, NCEP, NRL, RHMC, UKMO

Assimilation of radar reflectivity

Convective-scale NWP for Singapore

Probabilistic Weather Prediction

0-6 hour Weather Forecast Guidance at The Weather Company. Steven Honey, Joseph Koval, Cathryn Meyer, Peter Neilley The Weather Company

2012 and changes to the Rapid Refresh and HRRR weather forecast models

Application and verification of the ECMWF products Report 2007

PRELIMINARY RESULTS OF THE COMPARISON OF TWO ADVECTION METHODS

DEVELOPMENT OF CELL-TRACKING ALGORITHM IN THE CZECH HYDROMETEOROLOGICAL INSTITUTE

Verifying Ensemble Forecasts Using A Neighborhood Approach

CAPS Storm-Scale Ensemble Forecasting (SSEF) System

Recent advances in Tropical Cyclone prediction using ensembles

Performance of TANC (Taiwan Auto- Nowcaster) for 2014 Warm-Season Afternoon Thunderstorm

Application and verification of ECMWF products 2014

Thunderstorm-Scale EnKF Analyses Verified with Dual-Polarization, Dual-Doppler Radar Data

STEPS-BE: an ensemble radar rainfall nowcasting system for urban hydrology in Belgium

GL Garrad Hassan Short term power forecasts for large offshore wind turbine arrays

CONTRIBUTION OF ENSEMBLE FORECASTING APPROACHES TO FLASH FLOOD NOWCASTING AT GAUGED AND UNGAUGED CATCHMENTS

Big Ensemble Data Assimilation

Assimilation of Airborne Doppler Radar Observations Using the Unified GSI based Hybrid Ensemble Variational Data Assimilation System for HWRF

Global NWP Index documentation

Focus on parameter variation results

Application and verification of ECMWF products: 2010

Current best practice of uncertainty forecast for wind energy

Extracting probabilistic severe weather guidance from convection-allowing model forecasts. Ryan Sobash 4 December 2009 Convection/NWP Seminar Series

Scatterometer Wind Assimilation at the Met Office

The Nowcasting Demonstration Project for London 2012

Convection-Resolving NWP with WRF. Section coordinator Ming Xue University of Oklahoma

A WRF-based rapid updating cycling forecast system of. BMB and its performance during the summer and Olympic. Games 2008

The Impacts of GPS Radio Occultation Data on the Analysis and Prediction of Tropical Cyclones. Bill Kuo, Xingqin Fang, and Hui Liu UCAR COSMIC

The Use of GPS Radio Occultation Data for Tropical Cyclone Prediction. Bill Kuo and Hui Liu UCAR

ICAM conference 6 June 2013 Kranjska Gora (SLO) Objective forecast verification of WRF compared to ALARO and the derived INCA-FVG outputs

Verification of ensemble and probability forecasts

Application and verification of ECMWF products 2009

Evaluating Forecast Quality

Assimilation in the PBL

P3.10 EVALUATION OF A 2 HOUR REFLECTIVITY NOWCAST USING A CROSS CORRELATION TECHNIQUE COMPARED TO PERSISTENCE

Deterministic and Ensemble Storm scale Lightning Data Assimilation

Application and verification of ECMWF products 2016

Recent achievements in the data assimilation systems of ARPEGE and AROME-France

P1.10 Synchronization of Multiple Radar Observations in 3-D Radar Mosaic

Application and verification of ECMWF products 2012

Model verification and tools. C. Zingerle ZAMG

Probabilistic Quantitative Precipitation Forecasts for Tropical Cyclone Rainfall

Application and verification of ECMWF products 2009

Assimilation of Doppler radar observations for high-resolution numerical weather prediction

An Overview of Atmospheric Analyses and Reanalyses for Climate

Convective Scale Ensemble for NWP

Seamless Probabilistic Forecasts for Civil Protection: from week to minutes

The ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations

Tangent-linear and adjoint models in data assimilation

EWGLAM/SRNWP National presentation from DMI

C. Gebhardt, S. Theis, R. Kohlhepp, E. Machulskaya, M. Buchhold. developers of KENDA, ICON-EPS, ICON-EDA, COSMO-D2, verification

Can hybrid-4denvar match hybrid-4dvar?

AN OBSERVING SYSTEM EXPERIMENT OF MTSAT RAPID SCAN AMV USING JMA MESO-SCALE OPERATIONAL NWP SYSTEM

On the prognostic treatment of stratospheric ozone in the Environment Canada global NWP system

Flood Forecasting with Radar

Representation of model error in a convective-scale ensemble

Application and verification of ECMWF products 2015

Spatial forecast verification

Application and verification of ECMWF products 2016

QPE and QPF in the Bureau of Meteorology

Nowcasting techniques in use for severe weather operation in NMC/CMA

Severe storm forecast guidance based on explicit identification of convective phenomena in WRF-model forecasts

A new mesoscale NWP system for Australia

Model Error and Parameter Estimation in a Simplied Mesoscale Prediction Framework, Part I:

All-sky observations: errors, biases, representativeness and gaussianity

Developing Operational MME Forecasts for Subseasonal Timescales

Strategic Radar Enhancement Project (SREP) Forecast Demonstration Project (FDP) The future is here and now

Jidong Gao and David Stensrud. NOAA/National Severe Storm Laboratory Norman, Oklahoma

Weather Forecasting. March 26, 2009

Supplementary Figure 1. Summer mesoscale convective systems rainfall climatology and trends. Mesoscale convective system (MCS) (a) mean total

Measuring In-cloud Turbulence: The NEXRAD Turbulence Detection Algorithm

NCEP ENSEMBLE FORECAST SYSTEMS

Current verification practices with a particular focus on dust

Standardized Anomaly Model Output Statistics Over Complex Terrain.

1. INTRODUCTION 2. QPF

Convection-Allowing Models (CAMs) A discussion on Creating a Roadmap to a Unified CAM-based Data-Assimilation and Forecast Ensemble

Calibration with MOS at DWD

University of Oklahoma, Norman, OK INTRODUCTION

Utilising Radar and Satellite Based Nowcasting Tools for Aviation Purposes in South Africa. Erik Becker

Enhanced Predictability During Extreme Winter Flow Regimes

Optimal combination of NWP Model Forecasts for AutoWARN

Judit Kerényi. OMSZ-Hungarian Meteorological Service P.O.Box 38, H-1525, Budapest Hungary Abstract

Short-Term Weather Forecasting for Probabilistic Wake-Vortex Prediction

Model error and parameter estimation

Transcription:

Skill of Nowcasting of Precipitation by NWP and by Lagrangian Persistence (where we chronicle the bridging of the gap )

Skill of Nowcasting of Precipitation by NWP and by Lagrangian Persistence (where we chronicle the bridging of the gap )

There were various attempts at improving precipitation nowcasting through addition of NWP: Skill-weighted average of Lagrangian Persistence (LP) and NWP Correction of positional errors (and more) of NWP Selectively adding NWP-predicted growth and decay to LP Correction of phase errors of NWP (As a standalone or in combination with LP, with or without data assimilation; deterministic or ensemble NWP)

Basic fact of life: short scales are ephemeral 2 16 Lifetime [h] 12 8 4 9% Band-pass Lifetime 1% 1 1 1 Linear Scale [km]

Basic fact of life: Precipitation patterns have characteristics of pink noise

Basic fact of life: Precipitation patterns have characteristics of pink noise

Model vs. Nowcast & Merging (for 6 days of rain) 1..8.6.4.2 R>.1mm/h POD O-MAPLE+WRF+GEM O-MAPLE WRF GEM GEM+WRF MAPLE.8.6.4.2 CSI.8.6.4.2 R>1mm/h CSI. 2 4 6 8 1 12. 2 4 6 8 1 12 forecast hour. 2 4 6 8 1 12 forecast hour weight 1 1 CSI(i,t) 1 a better balance for t<4h is obtained with weight 1 1 2.5 1 [CSI(i,t)]

Nowcasting Skill of Model and of Lagrangian Persistence The nowcast is improved when NWP nowcast and Lagrangian persistence nowcast are merged by a skill-weighted average. However, there is no advantage in doing this adaptively: climatological skill is as good as the skill determined in a particular situation just prior to the nowcast. Question: Why? Possible answers: Either model skill is not sufficiently persistent in time (ex: effect of diurnal cycle) or the skill of model and of LP are correlated

Scatterplots of CSI June to August 25 CORRELATION 1..8.6.4 1 2 3 4 5 6 Lead time [h]

Scatterplots of CSI Jan. to March 25 CORRELATION 1..8.6.4 1 2 3 4 5 6 Lead time [h]

Scatterplots of CSI Jan. to March 25 CORRELATION 1..8.6.4 1 2 3 4 5 6 Lead time [h] Should we be asking why so much scatter?

We acquired outputs of ensemble runs (OU, Ming Xue) to further experiment with NWP contributions to nowcasting. The ensemble is generated by varying initial conditions and model physics. Radar data are assimilated in all members except c ; cn is identical to c except that radar data were assimilated Ensemble mean is re-calibrated by probability matching, PM (making the pdf of intensity equal to the average pdf of members)

We acquired outputs of ensemble runs (OU, Ming Xue) to further experiment with NWP contributions to nowcasting. The ensemble is generated by varying initial conditions and model physics. Radar data are assimilated in all members except c ; cn is identical to c except that radar data were assimilated Ensemble mean is re-calibrated by probability matching, PM (making the pdf of intensity equal to the average pdf of members) Note: the POD of the ensemble mean (before PM) is smaller than one, indicating that the ensemble does not cover all observed precipitation)

NWP Ensembles (poor and best predictability cases)

Diurnal cycle in pdf of rain

Models fail to correctly reproduce the diurnal cycle 5 Summer precipitation over this domain: Mean (no assim) CN (assim) GEM WRF 18 UTC time [h] 12 6 18 12 6.6-15 -95-85 Radar 18-15 -95.12-85 -15-95 Mean.7-15 -95-85 C.8-85 -15-95 CN.7-85 GEM -15-95.1-85 WRF UTC time [h] 12 6 18 12 6.13-15 -95-85 longitude [deg].17.18.19.15-15 -95-85 -15-95 -85-15 -95-85 -15-95 -85 longitude [deg] longitude [deg] longitude [deg] longitude [deg].18-15 -95-85 longitude [deg] Note the more consistent diurnal cycle in observations Latitude Radar C 45 4 35 3.5 3 3.36 25 3.8 2.8 2.52 2.24 1.96 1.68 1.4 1.12.84.56.28. 3.5 3.36 3.8 2.8 2.52 2.24 1.96 1.68 1.4 1.12.84.56.28. -12-11 -1-9 Longitude Coverage Intensity -8-7

Models fail to correctly reproduce the diurnal cycle 36 coverage of the 24 h cycle 36 intensity of the 24h cycle phase [deg] 18-18 GEM WRF ens. mean OU model cn OU model c NSSL mosaic 18 12 6 18 12 6 peak time UTC [h] phase [deg] 18-18 GEM WRF ens. mean OU model cn OU model c NSSL mosaic 18 12 6 18 12 6 peak time UTC [h] -36-15 -1-95 -9-85 -8 longitude [deg] -36-15 -1-95 -9-85 -8 longitude [deg]

Models fail to correctly reproduce the diurnal cycle 36 coverage of the 24 h cycle 36 intensity of the 24h cycle phase [deg] 18-18 GEM WRF ens. mean OU model cn OU model c NSSL mosaic 18 12 6 18 12 6 peak time UTC [h] phase [deg] 18-18 GEM WRF ens. mean OU model cn OU model c NSSL mosaic 18 12 6 18 12 6 peak time UTC [h] -36-15 -1-95 -9-85 -8 longitude [deg] -36 {Region of transport of diurnal cycle -15-1 -95-9 -85-8 longitude [deg] {

The larger forecast errors of diurnal cycle happens where LP is longer!! 5 45 Latitude N 4 35 3 Lifetime -1-95 -9-85 -8 Longitude E miss 4 6 8 1 h

The larger forecast errors of diurnal cycle happens where LP is longer!! 5 45 Latitude N 4 35 3 Lifetime -1-95 -9-85 -8 Longitude E miss 4 6 8 1 h Is this one of the reasons why the predictability by LP and NWP is not better correlated?

Summary: Model-LP comparison of precipitation nowcasting 1..8 GEM15 C CN N2 PM mean MAPLE a) 1. b).8 CSI.6.4 correlation.6.4.2.2.. 2.5 2. d) EPS mean is re-calibrated by PM Note the diurnal cycle in the RMS error RMSE [mm] 1.5 1..5. 6 12 18 24 3 UTC [h]

NWP Ensembles (the best case) OU & 4 km resolution Scores at 15 dbz threshold CSI.8.6.4.2 28418 Radar coverage MEAN CN C.3.25.2.15.1.5 Fractional coverage. 5 1 15 2 25 Forecast time [h]. No single member is better Effect of data assimilation is short-lived

Position distance between model and radar WRF Model Corrected model Radar CSI 1..8.6.4.2 MODEL, POSITION CORRECTED by VET MODEL. 6 8 1 12 14 16 Time [h] CRMSE 14 12 1 8 6 4 2 6 8 1 12 14 16 Time [h] CORRELATION 1..8.6.4.2. 6 8 1 12 14 16 Time [h]

Nowcasting by correcting the model-radar distance WRF Model Corrected model Radar CSI 1..8.6.4.2 MODEL MODEL, POSITION CORRECTED by VET MAPLE 15 dbz threshold. 1 2 3 4 5 6 Lead time [h] CRMSE 14 12 1 8 6 4 2 1 2 3 4 5 6 Lead time [h] CORRELATION 1..8.6.4.2. 1 2 3 4 5 6 Lead time [h]

Nowcasting by correcting the model-radar distance WRF Model Corrected model Radar CSI 1..8.6.4.2. MODEL MODEL, POSITION CORRECTED (VET) MAPLE 15 dbz 1 2 3 4 5 6 Lead time [h] CRMSE 14 12 1 8 6 4 2 1 2 3 4 5 6 Lead time [h] CORRELATION 1..8.6.4.2. 1 2 3 4 Lead time [h] 5 6

Blending NWP with Lagrangian persistence of a 3 radars network (Catalunya).8 LE radar NWP+Assim Blending.7 LAPS with 3D VAR; position corrected; blended by averaging; re-calibrated by PMM..6 CSI.5.4.3.2.1 1 2 3 4 Lead-time [h] 5 6

Morphing model into radar by phase correction (one wavelength at a time)

Morphing model into radar by phase correction (one wavelength at a time)

Phase distance between model and radar RMS error (dbz) 3 25 2 15 1 5 Phase & power corrected WRF 1 1 1 (km) hour 24 22 2 18 16 14 12 1 8 6 4 2 211-4-4 1 9 8 7 6 5 4 3 2 1 Phase contribution (%) 1 1 1 (km) 1 9 8 7 6 5 4 3 2 1 Power contribution (%) 1 1 1 (km)

Phase distance between model and radar D(kx, ky) /( 2. 1..3 dbz threshold 2 3 4 1 1 1 (km)

Phase distance between model and radar D(kx, ky) /( 2. 1..3 dbz threshold 2 3 4 Dashed: Random within threshold 1 1 1 (km)

Defining growth and decay in radar (a) UTC (b) 1 UTC 5 5 45 45 4 4 35 35 3 3 25 ï11 25 ï11 ï15 ï1 ï15 ï1 ï95 ï9 ï85 5 4 3 2 (c) ï95 ï9 ï85 Growth and decay 5 5 45 Maximize cross-correlation between (a) and (b) by a solid translation and rotation; 4 The difference defines growth and decay (c) 35 3 25 ï11 ï15 ï1 ï5 ï95 ï9 ï85

Lifetime of growth and decay 4 8/21 8/13 8/1 7/3 7/24 7/22 7/18 7/13 7/9 6/6 5/24 5/6 4/18 35 Lifetime (h) Precipitation lifetime 3 25 2 15 1 5 3.5 5 1 15 Scale (cutoff wavelength) [km] 2 Growth & Decay 8/21 8/13 8/1 7/3 7/24 7/22 7/18 7/13 7/9 6/6 5/24 5/6 4/18 3 Lifetime (h) Growth & decay lifetime 2.5 2 1.5 1.5 5 1 15 Scale (cutoff wavelength) [km] 2 25

Effect of model error due to resolution

Effect of model error due to resolution Rel RMS Diff = i i ( X i Y ) 2 i ( X i + Y ) i Relative RMS Diff 1..8.6.4.2. WRF3Km } WRF1Km vs. radar WRF333m WRF333m-1Km dashed WRF3Km-1Km dotted 1 1 Cutoff Scale [km]

Effect of model error & data assimilation (average of 24 cases) c during spinup; clear effect of assimilation on cn rapid loss of assimilation effect at the small scales rapid loss of assimilation effect at the all scales 1% difference between c and cn at smal scales Relative RMS Diff 1..8.6.4.2. 1..8.6.4.2. 1..8.6.4.2. 1..8.6.4.2. C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar t=1h t=4h 1 1 1 Cutoff Scale [km] C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar t=2h t=5h 1 1 1 Cutoff Scale [km] C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar t=3h t=6h t=13h t=14h t=15h t=16h t=17h t=18h 1 1 1 Cutoff Scale [km]

Ensembles (EnKF) to the rescue?

Models have qualitative errors

Effect of model erros on assimilation Simulation using data assimilation (model as strong constraint) into a simple model of freely falling rain-shaft with a 2-parameter DSD representation. Note that 3 parameters are needed to correctly describe the DSDs of falling drops. Observations Note a second shaft due to model error

Effect of model erros on assimilation Simulation using data assimilation (model as strong constraint) into a simple model of freely falling rain-shaft with a 2-parameter DSD representation. Note that 3 parameters are needed to correctly describe the DSDs of falling drops. Observations Note a second shaft due to model error

Conclusions The lifetime of scales below 1 km is SHORT

Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar)

Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE)

Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE

Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE Uncertainties in LP nowcast (not discussed here) are handled by pure statistical ensembling; some physics is in order

Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE Uncertainties in LP nowcast (not discussed here) are handled by pure statistical ensembling; some physics is in order Letʼs shutdown the supercomputers for a decade so there is time to study model errors

Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE Uncertainties in LP nowcast (not discussed here) are handled by pure statistical ensembling; some physics is in order Letʼs shutdown the supercomputers for a decade so there is time to study model errors

Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE Uncertainties in LP nowcast (not discussed here) are handled by pure statistical ensembling; some physics is in order Letʼs shutdown the supercomputers for a decade so there is time to study model errors