Skill of Nowcasting of Precipitation by NWP and by Lagrangian Persistence (where we chronicle the bridging of the gap )
Skill of Nowcasting of Precipitation by NWP and by Lagrangian Persistence (where we chronicle the bridging of the gap )
There were various attempts at improving precipitation nowcasting through addition of NWP: Skill-weighted average of Lagrangian Persistence (LP) and NWP Correction of positional errors (and more) of NWP Selectively adding NWP-predicted growth and decay to LP Correction of phase errors of NWP (As a standalone or in combination with LP, with or without data assimilation; deterministic or ensemble NWP)
Basic fact of life: short scales are ephemeral 2 16 Lifetime [h] 12 8 4 9% Band-pass Lifetime 1% 1 1 1 Linear Scale [km]
Basic fact of life: Precipitation patterns have characteristics of pink noise
Basic fact of life: Precipitation patterns have characteristics of pink noise
Model vs. Nowcast & Merging (for 6 days of rain) 1..8.6.4.2 R>.1mm/h POD O-MAPLE+WRF+GEM O-MAPLE WRF GEM GEM+WRF MAPLE.8.6.4.2 CSI.8.6.4.2 R>1mm/h CSI. 2 4 6 8 1 12. 2 4 6 8 1 12 forecast hour. 2 4 6 8 1 12 forecast hour weight 1 1 CSI(i,t) 1 a better balance for t<4h is obtained with weight 1 1 2.5 1 [CSI(i,t)]
Nowcasting Skill of Model and of Lagrangian Persistence The nowcast is improved when NWP nowcast and Lagrangian persistence nowcast are merged by a skill-weighted average. However, there is no advantage in doing this adaptively: climatological skill is as good as the skill determined in a particular situation just prior to the nowcast. Question: Why? Possible answers: Either model skill is not sufficiently persistent in time (ex: effect of diurnal cycle) or the skill of model and of LP are correlated
Scatterplots of CSI June to August 25 CORRELATION 1..8.6.4 1 2 3 4 5 6 Lead time [h]
Scatterplots of CSI Jan. to March 25 CORRELATION 1..8.6.4 1 2 3 4 5 6 Lead time [h]
Scatterplots of CSI Jan. to March 25 CORRELATION 1..8.6.4 1 2 3 4 5 6 Lead time [h] Should we be asking why so much scatter?
We acquired outputs of ensemble runs (OU, Ming Xue) to further experiment with NWP contributions to nowcasting. The ensemble is generated by varying initial conditions and model physics. Radar data are assimilated in all members except c ; cn is identical to c except that radar data were assimilated Ensemble mean is re-calibrated by probability matching, PM (making the pdf of intensity equal to the average pdf of members)
We acquired outputs of ensemble runs (OU, Ming Xue) to further experiment with NWP contributions to nowcasting. The ensemble is generated by varying initial conditions and model physics. Radar data are assimilated in all members except c ; cn is identical to c except that radar data were assimilated Ensemble mean is re-calibrated by probability matching, PM (making the pdf of intensity equal to the average pdf of members) Note: the POD of the ensemble mean (before PM) is smaller than one, indicating that the ensemble does not cover all observed precipitation)
NWP Ensembles (poor and best predictability cases)
Diurnal cycle in pdf of rain
Models fail to correctly reproduce the diurnal cycle 5 Summer precipitation over this domain: Mean (no assim) CN (assim) GEM WRF 18 UTC time [h] 12 6 18 12 6.6-15 -95-85 Radar 18-15 -95.12-85 -15-95 Mean.7-15 -95-85 C.8-85 -15-95 CN.7-85 GEM -15-95.1-85 WRF UTC time [h] 12 6 18 12 6.13-15 -95-85 longitude [deg].17.18.19.15-15 -95-85 -15-95 -85-15 -95-85 -15-95 -85 longitude [deg] longitude [deg] longitude [deg] longitude [deg].18-15 -95-85 longitude [deg] Note the more consistent diurnal cycle in observations Latitude Radar C 45 4 35 3.5 3 3.36 25 3.8 2.8 2.52 2.24 1.96 1.68 1.4 1.12.84.56.28. 3.5 3.36 3.8 2.8 2.52 2.24 1.96 1.68 1.4 1.12.84.56.28. -12-11 -1-9 Longitude Coverage Intensity -8-7
Models fail to correctly reproduce the diurnal cycle 36 coverage of the 24 h cycle 36 intensity of the 24h cycle phase [deg] 18-18 GEM WRF ens. mean OU model cn OU model c NSSL mosaic 18 12 6 18 12 6 peak time UTC [h] phase [deg] 18-18 GEM WRF ens. mean OU model cn OU model c NSSL mosaic 18 12 6 18 12 6 peak time UTC [h] -36-15 -1-95 -9-85 -8 longitude [deg] -36-15 -1-95 -9-85 -8 longitude [deg]
Models fail to correctly reproduce the diurnal cycle 36 coverage of the 24 h cycle 36 intensity of the 24h cycle phase [deg] 18-18 GEM WRF ens. mean OU model cn OU model c NSSL mosaic 18 12 6 18 12 6 peak time UTC [h] phase [deg] 18-18 GEM WRF ens. mean OU model cn OU model c NSSL mosaic 18 12 6 18 12 6 peak time UTC [h] -36-15 -1-95 -9-85 -8 longitude [deg] -36 {Region of transport of diurnal cycle -15-1 -95-9 -85-8 longitude [deg] {
The larger forecast errors of diurnal cycle happens where LP is longer!! 5 45 Latitude N 4 35 3 Lifetime -1-95 -9-85 -8 Longitude E miss 4 6 8 1 h
The larger forecast errors of diurnal cycle happens where LP is longer!! 5 45 Latitude N 4 35 3 Lifetime -1-95 -9-85 -8 Longitude E miss 4 6 8 1 h Is this one of the reasons why the predictability by LP and NWP is not better correlated?
Summary: Model-LP comparison of precipitation nowcasting 1..8 GEM15 C CN N2 PM mean MAPLE a) 1. b).8 CSI.6.4 correlation.6.4.2.2.. 2.5 2. d) EPS mean is re-calibrated by PM Note the diurnal cycle in the RMS error RMSE [mm] 1.5 1..5. 6 12 18 24 3 UTC [h]
NWP Ensembles (the best case) OU & 4 km resolution Scores at 15 dbz threshold CSI.8.6.4.2 28418 Radar coverage MEAN CN C.3.25.2.15.1.5 Fractional coverage. 5 1 15 2 25 Forecast time [h]. No single member is better Effect of data assimilation is short-lived
Position distance between model and radar WRF Model Corrected model Radar CSI 1..8.6.4.2 MODEL, POSITION CORRECTED by VET MODEL. 6 8 1 12 14 16 Time [h] CRMSE 14 12 1 8 6 4 2 6 8 1 12 14 16 Time [h] CORRELATION 1..8.6.4.2. 6 8 1 12 14 16 Time [h]
Nowcasting by correcting the model-radar distance WRF Model Corrected model Radar CSI 1..8.6.4.2 MODEL MODEL, POSITION CORRECTED by VET MAPLE 15 dbz threshold. 1 2 3 4 5 6 Lead time [h] CRMSE 14 12 1 8 6 4 2 1 2 3 4 5 6 Lead time [h] CORRELATION 1..8.6.4.2. 1 2 3 4 5 6 Lead time [h]
Nowcasting by correcting the model-radar distance WRF Model Corrected model Radar CSI 1..8.6.4.2. MODEL MODEL, POSITION CORRECTED (VET) MAPLE 15 dbz 1 2 3 4 5 6 Lead time [h] CRMSE 14 12 1 8 6 4 2 1 2 3 4 5 6 Lead time [h] CORRELATION 1..8.6.4.2. 1 2 3 4 Lead time [h] 5 6
Blending NWP with Lagrangian persistence of a 3 radars network (Catalunya).8 LE radar NWP+Assim Blending.7 LAPS with 3D VAR; position corrected; blended by averaging; re-calibrated by PMM..6 CSI.5.4.3.2.1 1 2 3 4 Lead-time [h] 5 6
Morphing model into radar by phase correction (one wavelength at a time)
Morphing model into radar by phase correction (one wavelength at a time)
Phase distance between model and radar RMS error (dbz) 3 25 2 15 1 5 Phase & power corrected WRF 1 1 1 (km) hour 24 22 2 18 16 14 12 1 8 6 4 2 211-4-4 1 9 8 7 6 5 4 3 2 1 Phase contribution (%) 1 1 1 (km) 1 9 8 7 6 5 4 3 2 1 Power contribution (%) 1 1 1 (km)
Phase distance between model and radar D(kx, ky) /( 2. 1..3 dbz threshold 2 3 4 1 1 1 (km)
Phase distance between model and radar D(kx, ky) /( 2. 1..3 dbz threshold 2 3 4 Dashed: Random within threshold 1 1 1 (km)
Defining growth and decay in radar (a) UTC (b) 1 UTC 5 5 45 45 4 4 35 35 3 3 25 ï11 25 ï11 ï15 ï1 ï15 ï1 ï95 ï9 ï85 5 4 3 2 (c) ï95 ï9 ï85 Growth and decay 5 5 45 Maximize cross-correlation between (a) and (b) by a solid translation and rotation; 4 The difference defines growth and decay (c) 35 3 25 ï11 ï15 ï1 ï5 ï95 ï9 ï85
Lifetime of growth and decay 4 8/21 8/13 8/1 7/3 7/24 7/22 7/18 7/13 7/9 6/6 5/24 5/6 4/18 35 Lifetime (h) Precipitation lifetime 3 25 2 15 1 5 3.5 5 1 15 Scale (cutoff wavelength) [km] 2 Growth & Decay 8/21 8/13 8/1 7/3 7/24 7/22 7/18 7/13 7/9 6/6 5/24 5/6 4/18 3 Lifetime (h) Growth & decay lifetime 2.5 2 1.5 1.5 5 1 15 Scale (cutoff wavelength) [km] 2 25
Effect of model error due to resolution
Effect of model error due to resolution Rel RMS Diff = i i ( X i Y ) 2 i ( X i + Y ) i Relative RMS Diff 1..8.6.4.2. WRF3Km } WRF1Km vs. radar WRF333m WRF333m-1Km dashed WRF3Km-1Km dotted 1 1 Cutoff Scale [km]
Effect of model error & data assimilation (average of 24 cases) c during spinup; clear effect of assimilation on cn rapid loss of assimilation effect at the small scales rapid loss of assimilation effect at the all scales 1% difference between c and cn at smal scales Relative RMS Diff 1..8.6.4.2. 1..8.6.4.2. 1..8.6.4.2. 1..8.6.4.2. C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar t=1h t=4h 1 1 1 Cutoff Scale [km] C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar t=2h t=5h 1 1 1 Cutoff Scale [km] C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar C-CN CN-Radar C-Radar t=3h t=6h t=13h t=14h t=15h t=16h t=17h t=18h 1 1 1 Cutoff Scale [km]
Ensembles (EnKF) to the rescue?
Models have qualitative errors
Effect of model erros on assimilation Simulation using data assimilation (model as strong constraint) into a simple model of freely falling rain-shaft with a 2-parameter DSD representation. Note that 3 parameters are needed to correctly describe the DSDs of falling drops. Observations Note a second shaft due to model error
Effect of model erros on assimilation Simulation using data assimilation (model as strong constraint) into a simple model of freely falling rain-shaft with a 2-parameter DSD representation. Note that 3 parameters are needed to correctly describe the DSDs of falling drops. Observations Note a second shaft due to model error
Conclusions The lifetime of scales below 1 km is SHORT
Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar)
Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE)
Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE
Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE Uncertainties in LP nowcast (not discussed here) are handled by pure statistical ensembling; some physics is in order
Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE Uncertainties in LP nowcast (not discussed here) are handled by pure statistical ensembling; some physics is in order Letʼs shutdown the supercomputers for a decade so there is time to study model errors
Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE Uncertainties in LP nowcast (not discussed here) are handled by pure statistical ensembling; some physics is in order Letʼs shutdown the supercomputers for a decade so there is time to study model errors
Conclusions The lifetime of scales below 1 km is SHORT At scales below 1 km NWP has no skill (when compared to radar) All tried corrections to forecast errors did not lead to nowcast better than LP (MAPLE) Present data assimilation does seem to lead to nowcasts better than MAPLE Uncertainties in LP nowcast (not discussed here) are handled by pure statistical ensembling; some physics is in order Letʼs shutdown the supercomputers for a decade so there is time to study model errors