Verification of the operational NWP models at DWD - with special focus at COSMO-EU
|
|
- Brittney Beasley
- 6 years ago
- Views:
Transcription
1 Verification of the operational NWP models at DWD - with special focus at COSMO-EU Ulrich Damrath Ulrich.Damrath@dwd.de
2 Ein Mensch erkennt (und das ist wichtig): Nichts ist ganz falsch und nichts ganz richtig Eugen Roth
3 A man discerns - perhaps you too: Nothing is entirely wrong and nothing entirely true Eugen Roth
4 Basic tasks of verification 4Comparison of forecast results with the truth (observation and analysis) 4Calculation of forecast quality in terms of so called scores 4Feedback to endusers and modellers
5 Outline: A mixture of 4General remarks 4The verification system at DWD 4Examples of verification results 4How did verification help (in some cases)?
6 Purposes of verification 4Watching the operational system 4Assessment of new model versions 4Evaluation of predictability 4Interpretation of model errors
7 Methods of verification 4Subjective assessment 4Objective assessment 4Special investigations
8 Course of verification on principal Forecast Modeller Analysis Verification Enduser Data control Observation Data control
9 Forecast of precipitation
10 Climate simulation for precipitation from: U. Böhm et.al.: Climate reconstruction over Europe...
11 Climate simulation for precipitation
12 Observation ( UTC UTC) and forecast of precipitation (T+18-T+42 from UTC
13 Observation ( UTC UTC) and forecast of precipitation (T+06-T+30 from UTC
14 Objective assessment calculation of scores which characterize the truth of the forecast Advantage: 8objective criteria for all forecasts Disadvantage: 8Perhaps only some aspects of the forecasts are catched. 8Impossibility to express all degrees of freedom of a forecast in some simple numbers
15 Methods of objective verification 4calculation of scores for continuous weather elements 4calculation of scores for categorical weather elements 4calculation of scores for probabilistic weather elements 4calculation of scores that are representative for very high resolution models
16 Scores for continuous weather elements 8Mean error 8Mean absolute error 8Root mean square error 8Standard deviation 8Correlation coefficient 8Skill scores
17 A basic rule Try to interpret each score dependent on its characteristics as - a physical and - a statistical term!
18 Scores for continuous weather elements - mean error or BIAS BIAS = F i ME = 1 N forecast N ( F O i i= 1 Properties: ideal value: 0 no general information about forecast quality If errors have a Gaussian distribution: Estimation of the expected value of errors i ) O i observation
19 Time series of BIAS of 2m-temperatures over Germany (January 1994 till May 2007)
20 Time series of BIAS of 2m-temperatures over Germany (January 1994 till May 2007)
21 Time series of BIAS of wind speed 10m over Germany (May May 2007)
22 Time series of BIAS of wind speed 10m over Germany stations below 100 m (May May 2007)
23 Monthly mean values of surface weather elements for station January 2008
24 Monthly mean values of surface weather elements for station January 2008
25 Monthly mean values of surface weather elements for station (cases with cloud cover observed and forecasted >4/8)
26 Example for conditional verification Forecasted and observed values of surface level pressure over the region of Germany during DJF 2005/2006 (RMSE and STDV) Forecasted and observed values of surface level pressure over the region of Germany during DJF 2005/2006 observed and forecasted values lower than 1020 hpa (RMSE and STDV) Forecasted and observed values of surface level pressure over the region of Germany during DJF 2005/2006 observed and forecasted values higher than 1020 hpa (RMSE and STDV)
27 Distribution of surface level pressure in COSMO-EU and in GME
28 Distribution of surface level pressure in COSMO-EU and in GME
29 Distribution of surface level pressure in COSMO-EU and in GME
30 Verification of surface weather elements: The effect of the SSO-scheme in COSMO-EU Consideration of frictional and gravity effects caused by processes that are not resolved by model orography
31 Distribution of surface level pressure in COSMO-EU and in GME
32 Distribution of surface level pressure in COSMO-EU and in GME
33 Distribution of surface level pressure in COSMO-EU and in GME
34 Distribution of surface level pressure in COSMO-EU and in GME
35 Scores for continuous weather elements - mean absolute error MAE = 1 N N i= 1 F i O i Properties: ideal value: 0 errors are simply added
36 Scores for continuous weather elements - root mean square error RMSE = N 1 ( F i N i= 1 O i ) 2 Properties: ideal value: 0 sensitive concerning phase and amplitude errors
37 Verification of surface weather elements: The effect of the SSO-scheme in COSMO-EU (Spring)
38 Verification of surface weather elements: The effect of the SSO-scheme in COSMO-EU(Autumn)
39 Verification of surface weather elements: Modification of T2m-diagnosis in GME, COSMO-EU and COSMO-DE z P + z 0 z A + z 0 0 z 0 l = l κ logarithmic freeturbulent-layer profile φ A expon. roughness-layer profile 0 φ S φ 2 φ δ φ m h 2m h z P + z d z A + z d z d 0 l d l = d κ unstable stable φ 2m φ S φ 20m 10m z P z A h 2m 0 z φ upper boundary of the lowest model layer lower boundary of the lowest model layer lowest model main level
40 Verification of surface weather elements: Modification of T2m-diagnosis in GME, COSMO-EU and COSMO-DE Z 0 taken from model surface Z 0 taken as 2 cm
41 Verification of surface weather elements: Modification of T2m-diagnosis in COSMO-EU (Winter)
42 Verification of surface weather elements: Modification of T2m-diagnosis in COSMO-EU (Winter)
43 Verification of surface weather elements: Modification of T2m-diagnosis in COSMO-EU (Summer)
44 Verification of surface weather elements: Modification of T2m-diagnosis in COSMO-EU (Sommer)
45 Diurnal cycle of forecasted and observed T2m- COSMO-EU, Summer 2007, Start 00 UTC
46 Diurnal cycle of forecasted and observed T2m - COSMO-EU, Summer 2008, Start 00 UTC
47 Diurnal cycle of forecasted and observed precipitation - COSMO-EU, Summer 2007(top) and 2008(bottom), Start 00 UTC!!!!!
48 Bias T2m- GME/LM/COSMO-EU, since 1999, Stations below 100 m, Start 00 UTC
49 Bias T2m- GME/LM/COSMO-EU, since 1999, Stations below 100 m, Start 00 UTC
50 Scores for continuous weather elements - standard deviation STDV = N 1 ( F i Oi ( F N i= 1 O)) Properties: ideal value: 0 If errors have a Gaussian distribution: around 68% of errors can be expected in the interval: < BIAS-STDV, BIAS+STDV > 2
51 Scores for continuous weather elements - correlation coefficient R : reference forecast short range : persistence medium range: climate CC = Properties: range: -1 till +1 (ideal value) mainly sensitive concerning phase errors critical value: 0.6 ( F ( F R R ( F ( F R)) R)) 2 ( A ( A R R ( A ( A R)) R)) 2
52
53
54 Scores for continuous weater elements Examples of scores for four artificial situations:
55 Scores for continuous weater elements Examples of scores for four artificial situations:
56 Scores for continuous weater elements Examples of scores for four artificial situations:
57 Scores for continuous weater elements Examples of scores for four artificial situations:
58 Scores for continuous weather elements - Skill Score S1 Properties: range: 0 (ideal value) till 200 (worst value)
59 Scores for continuous weather elements - skill score - relates a score of interest to a score of a reference forecast SKSC = SCORE( forecast) SCORE( ideal) SCORE( reference) SCORE( reference) Properties: range: - till +1 (ideal value) example: reduction of variance: sometimes given in percent RV = 1 RMSE RMSE 2 forecast 2 reference
60 A global score for COSMO models: COSI rmse = 1 n n ( ) t f t o 2 Continuous elements rmsvwe = 1 n n V f V o 2 Wind SS = 1 r r 2 f 2 p Skill score for wind and continuous elements related to persistence ETS = R "chance" T "chance" Skill score for categorical elements related to chance
61 Final definition of the score: 1 Continuous elements, sum over 8 time steps: (start: vv=3, end: vv=24, step: 3) Equal weights for all forecast times! SK SK j j 8 1 = 8 : i= 1 Skill sk i, j Score for element j sk i, j : Skill Score for element j at time stepi
62 SK sk Final definition of the score: 2 Categorical elements, sum over N time steps: (start: vv=vvb, end: vv=vve, step: vvs) Cloud cover: vvb=3, vve=24 vvs=3 Precipitation: vvb=6, vve=24 vvs=6 SK Equal weights for all forecast times and categories! j j i, j, m M N Skill Skill M l= 1 N = : : 1 * i= 1 sk Score Score in category m i, j, m for element for element j j at time stepi
63 Final definition of the score: 3 Sum over all elements: Equal weights for all elements! SK = 1 N E N E j= 1 SK j
64 The Score COSI : All days COSMO-EU V3.19 V 3.22 T 2m SSO
65 Long term trends of verification results for surface weather elements: Wind 00 UTC
66 Long term trends of verification results for surface weather elements: Wind 12 UTC
67 Long term trends of verification results for surface weather elements: Temperature 2m 12 UTC
68 Long term trends of verification results for surface weather elements: Minimumtemperature 2m 06 UTC
69 Long term trends of verification results for surface weather elements: Maximumtemperature 2m 18 UTC
70 Long term trends of verification results for surface weather elements: Temperature 2m 18 UTC
71 Single components of the COSI: Day 1 Trend: + Trend: + Trend: + Trend:? Trend:?
72 Verification of precipitation area mean
73 Scores for categorical weather elements aim: to express the correctness of forecasts for yes/no events for example: fog, thunderstorm, cloudiness, precipitation (over a limit of interest), temperature: warming or cooling,... Method: stratification of forecasts build up contingency tables
74 Scores for categorical weather elements General structure of contingency tables: Observation yes Observation no Forecast yes A B Forecast no C D
75 Scores for categorical weather elements Probability of detection: POD OY ON POD = A A + C FY A B FN C D range : 0-1 perfect : 1 maximise : overforecast event disadvantage: only yes-forecasts are considered
76 Scores for categorical weather elements False alarm rate: FAR OY ON FAR = A B + B FY A B FN C D range : 0-1 perfect : 0 maximise : underforecast event disadvantage: only yes-forecasts are considered
77 Scores for categorical weather elements Percentage correct: PEC A D A+ B+ + = C+ D A N D PEC = + range : 0-1 perfect : 1 maximise : do everything correct disadvantage: for rare events high correctness is suggested OY ON FY A B FN C D
78 Scores for categorical weather elements Frequency bias: FBI FBI = A A + + C B OY ON FY A B FN C D range : 0 - perfect : 1 maximise : do everything correct disadvantage: no account to accuracy
79 Scores for categorical weather elements Threat score (critical success index): CSI CSI = A+ B A + C range : 0-1 perfect : 1 advantage : false alarms and missed events are included disadvantage: Depends on climatological frequency of events (poorer scores for rare events) since some hits can occur purely due to random chance. OY ON FY A B FN C D
80 Scores for categorical weather elements Equitable threat score : ETS FY A B relates CSI to a reference forecast FN C D = A E A+ B+ ( A+ B) ( C E E( chance) = A+ B+ C range : -1/3-1 perfect : 1 advantage : false alarms and missed events are included, effect of a reference forecasts is included ETS OY ON A+ C) + D
81 Scores for categorical weather elements Heidke skill score : HSS OY relates PEC to a reference forecast = A+ D R A+ B+ C+ D R HSS R( chance) range : - -1 perfect : 1 advantage : false alarms and missed events are included, effect of a reference forecasts is included disadvantage: very sensitive to dry events = ( A+ B) ( A+ C) + ( C+ D) ( B+ D) A+ B+ C+ D ON FY A B FN C D
82 Scores for categorical weather elements True skill statistics (Hansen-Kuiper discriminant) : TSS TSS = A D B C ( A+ C) ( B+ D) range : perfect : 1 advantage : equal emphasis to yes/noevents disadvantage: for rare events similar to POD OY ON FY A B FN C D
83 Scores for categorical weather elements: GME-grid 2007
84 Scores for categorical weather elements COSMO-EU-grid 2007
85 Scores for probabilistic weather elements: The Brier score BRSC = N 1 ( F i N i= 1 O i F i : forecasted probability O i : observed probability 0: if event was not observed 1: if event was observed Properties: ideal value: 0 maximum: 1 ) 2
86 Verification of very high resolution models - basic problem: The double penalty hhigh resolution models often give right signals hbut 8 forecasts may be a little bit shifted compared to observations htherefore 8 forecasts are penalized at those points where the event was predicted 8 forecasts are penalized at those points where the event was not predicted 8 The right signal is not recompensed!
87 !!! A question for a quiz program: Which forecast is the best?!!!
88 !?!
89 Verification of very high resolution models - basic problem: Solution look into windows with different sizes calculate a set of scores that represent the content of the windows
90 GME COSMO-EU COSMO-DE Fractions skill score for forecasts of GME, COSMO-EU and COSMO-DE for December 2008, forecast time hours
91 Examination of statistical significance of fuzzy -verification results using bootstrapping Basic idea of bootstrapping: Repeat a resampling all elements of a given in a sample of forecasts and observations as often as necessary (N times) and calculate the relevant score(s) Calculate from N scores statistical properties of the sample such as mean value standard deviation, confidence intervals and quantiles Application to fuzzy -verification Resampling is done using blocks. Blocks are defined as single days. Number of resampling cases: N=Days*100 Calculation scores from N samples for NT thesholds and NW windows Calculation of quantiles for each window and threshold
92 Values and quantiles 0.1 and 0.9 for Upscaling ETS COSMO-DE, period June -August 2009 Germany
93 Differences between GME and COSMO-DE ETS(COSMO-DE) - ETS(GME) Significance test Germany COSMO-DE better than GME COSMO-DE worse than GME
94 Differences between COSMO-DE and COSMO-EU ETS(COSMO-DE) - ETS(COSMO-EU) Significance test Germany COSMO-DE better than COSMO-EU COSMO-DE worse than COSMO-EU
95 Differences between COSMO-DE and COSMO-EU ETS(COSMO-DE) - ETS(COSMO-EU) Significance test COSMO-DE better than COSMO-EU COSMO-DE worse than COSMO-EU
96 The problem of precipitation seems to be solved!!! BUT!
97 One of open questions: Surprisingly bad forecasts for temperature on some days during winter
98 One of open questions: Forecasted temperature over snow
99 One of open questions: Forecasted temperature over snow
100 The verification system at DWD verification against analysis verification against surface observations verification of vertical structures using different observation systems
101 Verification against analysis verification of geopotential, temperature, wind and humidity at all pressure levels calculation of ME, RMSE, correlation coefficients, Skill-Score S1,... calculation of scores for 26 regions calculation of horizontal distribution of errors
102 Verification against surface weather elements 8Verification worldwide (~3300 stations) 8 cloud cover(s) and 6h-precipitation (contingency tables), gusts 8 wind, temperature, dew point(depression), extreme temperatures 8Verification over Germany (~205 stations) 8 cloud cover(s) and 1h-precipitation (contingency tables), gusts 8 wind, temperature, dew point(depression), extreme temperatures
103 Verification of vertical structures 4Geopotential, wind, temperature, humidity 4TEMPs, AMDARs, wind profiler 4GME, COSMO-EU, COSMO-DE 4single TEMPs, single wind profiler,...
104 Vertical profiles of forecast errors according to AMDAR measurements bias of wind speed Forecasts starting 00 UTC since 2000 positive bias negative bias Fc-time:00 h Fc-time:24 h Fc-time:48 h
105 Vertical profiles of forecast errors according to TEMP measurements bias of wind speed Forecasts starting 00 UTC since 2000 positive bias negative bias Fc-time:00 h Fc-time:12 h Fc-time:24 h Fc-time:36 h Fc-time:48 h
106 Number of scores for each model run (crude approximation) 8Verifcation against surface observations: ~ scores 8Verification against analysis: ~ scores 8Verification against upper air observations: ~ scores 8Calculate the scores AND watch the system! 8Verification is a full time job for at least 2 persons!
107 A typical situation
108 First possible solution of the problem: t-test,... Hypothesistests: Are average values of two different time series significantly different? Significancetests for the parameters of these time series -t Test weak t test t = t test N X μ S N: Number of cases X: sample mean value S: sample standard deviation μ: hypothetial mean value t S = 2 D = x1 x S D ( N ) S1 + ( N2 1) S N + N 2 1 N1N2 N + N
109 Second possible solution of the problem: bootstrapping Sample with 10 elements Realisation 1: mean value using elements: Realisation 2: mean value using elements: Realisation 3: mean value using elements: Realisation 4: mean value using elements: Realisation 5: mean value using elements: Realisation 6: mean value using elements: Realisation 7: mean value using elements: Realisation 8: mean value using elements: Realisation 9: mean value using elements: Realisation 10: mean value using elements:
110 A typical situation
111
Verification of the operational NWP models at DWD - with special focus at COSMO-EU. Ulrich Damrath
Verification of the operational NWP models at DWD - with special focus at COSMO-EU Ulrich Damrath Ulrich.Damrath@dwd.de Ein Mensch erkennt (und das ist wichtig): Nichts ist ganz falsch und nichts ganz
More informationModel verification and tools. C. Zingerle ZAMG
Model verification and tools C. Zingerle ZAMG Why verify? The three most important reasons to verify forecasts are: to monitor forecast quality - how accurate are the forecasts and are they improving over
More informationApplication and verification of ECMWF products 2008
Application and verification of ECMWF products 2008 RHMS of Serbia 1. Summary of major highlights ECMWF products are operationally used in Hydrometeorological Service of Serbia from the beginning of 2003.
More informationVerification of ECMWF products at the Deutscher Wetterdienst (DWD)
Verification of ECMWF products at the Deutscher Wetterdienst (DWD) DWD Martin Göber 1. Summary of major highlights The usage of a combined GME-MOS and ECMWF-MOS continues to lead to a further increase
More informationWG5: Common Plot Reports
WG5: Common Plot Reports Dimitra Boucouvala & WG5 COSMO GM Parallel session, 7-10 Sept 2015, Wroclaw THE COSMO MODELS COSMO-RU7(RHM) COSMO-EU (DWD) COSMO-7 (MCH) COSMO-PL(IMGW) COSMO-ME (IT) COSMO-I7 (IT)
More informationApplication and verification of the ECMWF products Report 2007
Application and verification of the ECMWF products Report 2007 National Meteorological Administration Romania 1. Summary of major highlights The medium range forecast activity within the National Meteorological
More informationApplication and verification of ECMWF products: 2010
Application and verification of ECMWF products: 2010 Hellenic National Meteorological Service (HNMS) F. Gofa, D. Tzeferi and T. Charantonis 1. Summary of major highlights In order to determine the quality
More informationBasic Verification Concepts
Basic Verification Concepts Barbara Brown National Center for Atmospheric Research Boulder Colorado USA bgb@ucar.edu May 2017 Berlin, Germany Basic concepts - outline What is verification? Why verify?
More informationDetective Miss Marple in Murder at the Gallop. 3rd verification workshop, ECMWF 2007, Göber
m Detective Miss Marple in Murder at the Gallop Slide m Now, this is how we verify the forecasters at DWD: we watch them intensily and when they get it wrong, they'll get a bang over their head. OK, I'm
More informationDenver International Airport MDSS Demonstration Verification Report for the Season
Denver International Airport MDSS Demonstration Verification Report for the 2015-2016 Season Prepared by the University Corporation for Atmospheric Research Research Applications Division (RAL) Seth Linden
More informationTowards a Definitive High- Resolution Climate Dataset for Ireland Promoting Climate Research in Ireland
Towards a Definitive High- Resolution Climate Dataset for Ireland Promoting Climate Research in Ireland Jason Flanagan, Paul Nolan, Christopher Werner & Ray McGrath Outline Project Background and Objectives
More informationEnsemble Verification Metrics
Ensemble Verification Metrics Debbie Hudson (Bureau of Meteorology, Australia) ECMWF Annual Seminar 207 Acknowledgements: Beth Ebert Overview. Introduction 2. Attributes of forecast quality 3. Metrics:
More informationCategorical Verification
Forecast M H F Observation Categorical Verification Tina Kalb Contributions from Tara Jensen, Matt Pocernich, Eric Gilleland, Tressa Fowler, Barbara Brown and others Finley Tornado Data (1884) Forecast
More informationApplication and verification of ECMWF products 2013
Application and verification of EMWF products 2013 Hellenic National Meteorological Service (HNMS) Flora Gofa and Theodora Tzeferi 1. Summary of major highlights In order to determine the quality of the
More informationAllison Monarski, University of Maryland Masters Scholarly Paper, December 6, Department of Atmospheric and Oceanic Science
Allison Monarski, University of Maryland Masters Scholarly Paper, December 6, 2011 1 Department of Atmospheric and Oceanic Science Verification of Model Output Statistics forecasts associated with the
More informationPrecipitation verification. Thanks to CMC, CPTEC, DWD, ECMWF, JMA, MF, NCEP, NRL, RHMC, UKMO
Precipitation verification Thanks to CMC, CPTEC, DWD, ECMWF, JMA, MF, NCEP, NRL, RHMC, UKMO Outline 1) Status of WGNE QPF intercomparisons 2) Overview of the use of recommended methods for the verification
More informationOperations Portugal (second half of 2010)
Operations Portugal (second half of 2010) In the second half of 2010, important changes happened in the operational procedures, the main event being the operationalization of AROME for Madeira archipelago
More informationForecast Verification Analysis of Rainfall for Southern Districts of Tamil Nadu, India
International Journal of Current Microbiology and Applied Sciences ISSN: 2319-7706 Volume 6 Number 5 (2017) pp. 299-306 Journal homepage: http://www.ijcmas.com Original Research Article https://doi.org/10.20546/ijcmas.2017.605.034
More informationSpatial forecast verification
Spatial forecast verification Manfred Dorninger University of Vienna Vienna, Austria manfred.dorninger@univie.ac.at Thanks to: B. Ebert, B. Casati, C. Keil 7th Verification Tutorial Course, Berlin, 3-6
More informationApplication and verification of ECMWF products 2016
Application and verification of ECMWF products 2016 RHMS of Serbia 1 Summary of major highlights ECMWF forecast products became the backbone in operational work during last several years. Starting from
More informationApplication and verification of ECMWF products 2016
Application and verification of ECMWF products 2016 Icelandic Meteorological Office (www.vedur.is) Bolli Pálmason and Guðrún Nína Petersen 1. Summary of major highlights Medium range weather forecasts
More informationEvaluating Forecast Quality
Evaluating Forecast Quality Simon J. Mason International Research Institute for Climate Prediction Questions How do we decide whether a forecast was correct? How do we decide whether a set of forecasts
More informationMethods of forecast verification
Methods of forecast verification Kiyotoshi Takahashi Climate Prediction Division Japan Meteorological Agency 1 Outline 1. Purposes of verification 2. Verification methods For deterministic forecasts For
More informationComparison of Interpolation Methods for Precipitation Data in a mountainous Region (Upper Indus Basin-UIB)
Comparison of Interpolation Methods for Precipitation Data in a mountainous Region (Upper Indus Basin-UIB) AsimJahangir Khan, Doctoral Candidate, Department of Geohydraulicsand Engineering Hydrology, University
More informationBasic Verification Concepts
Basic Verification Concepts Barbara Brown National Center for Atmospheric Research Boulder Colorado USA bgb@ucar.edu Basic concepts - outline What is verification? Why verify? Identifying verification
More informationCalibration with MOS at DWD
Calibration with MOS at DWD ECMWF Calibration Meeting 12 February 2015 Reinhold Hess, Jenny Glashof, Cristina Primo Deutscher Wetterdienst Calibration with MOS at DWD Outline Overview of MOS Systems at
More informationDownscaling of ECMWF seasonal integrations by RegCM
Downscaling of ECMWF seasonal integrations by RegCM Čedo Branković and Mirta Patarčić Croatian Meteorological and Hydrological Service Grič 3, 10000 Zagreb, Croatia (Thanks to Paul Dando and Manuel Fuentes
More informationICON. Limited-area mode (ICON-LAM) and updated verification results. Günther Zängl, on behalf of the ICON development team
ICON Limited-area mode (ICON-LAM) and updated verification results Günther Zängl, on behalf of the ICON development team COSMO General Meeting, Offenbach, 07.09.2016 Outline Status of limited-area-mode
More informationApplication and verification of ECMWF products 2015
Application and verification of ECMWF products 2015 Hungarian Meteorological Service 1. Summary of major highlights The objective verification of ECMWF forecasts have been continued on all the time ranges
More informationCurrent best practice of uncertainty forecast for wind energy
Current best practice of uncertainty forecast for wind energy Dr. Matthias Lange Stochastic Methods for Management and Valuation of Energy Storage in the Future German Energy System 17 March 2016 Overview
More informationApplication and verification of ECMWF products in Norway 2008
Application and verification of ECMWF products in Norway 2008 The Norwegian Meteorological Institute 1. Summary of major highlights The ECMWF products are widely used by forecasters to make forecasts for
More informationExtracting probabilistic severe weather guidance from convection-allowing model forecasts. Ryan Sobash 4 December 2009 Convection/NWP Seminar Series
Extracting probabilistic severe weather guidance from convection-allowing model forecasts Ryan Sobash 4 December 2009 Convection/NWP Seminar Series Identification of severe convection in high-resolution
More informationRevisiting predictability of the strongest storms that have hit France over the past 32 years.
Revisiting predictability of the strongest storms that have hit France over the past 32 years. Marie Boisserie L. Descamps, P. Arbogast GMAP/RECYF 20 August 2014 Introduction Improving early detection
More informationApplication and verification of ECMWF products 2016
Application and verification of ECMWF products 2016 Hellenic National Meteorological Service (HNMS) Flora Gofa and Panagiotis Skrimizeas 1. Summary of major highlights In order to determine the quality
More informationState of the art of wind forecasting and planned improvements for NWP Helmut Frank (DWD), Malte Mülller (met.no), Clive Wilson (UKMO)
State of the art of wind forecasting and planned improvements for NWP Helmut Frank (DWD), Malte Mülller (met.no), Clive Wilson (UKMO) thanks to S. Bauernschubert, U. Blahak, S. Declair, A. Röpnack, C.
More informationFocus on Spatial Verification Filtering techniques. Flora Gofa
Focus on Spatial Verification Filtering techniques Flora Gofa Approach Attempt to introduce alternative methods for verification of spatial precipitation forecasts and study their relative benefits Techniques
More informationComplimentary assessment of forecast performance with climatological approaches
Complimentary assessment of forecast performance with climatological approaches F.Gofa, V. Fragkouli, D.Boucouvala The use of SEEPS with metrics that focus on extreme events, such as the Symmetric Extremal
More informationDROUGHT FORECASTING IN CROATIA USING STANDARDIZED PRECIPITATION INDEX (SPI)
Meteorological and Hydrological Service of Croatia www.meteo.hr DROUGHT FORECASTING IN CROATIA USING STANDARDIZED PRECIPITATION INDEX (SPI) K. Cindrićand L. Kalin cindric@cirus.dhz.hr, kalin@cirus.dhz.hr
More informationCb-LIKE: thunderstorm forecasts up to 6 hrs with fuzzy logic
Cb-LIKE: thunderstorm forecasts up to 6 hrs with fuzzy logic Martin Köhler DLR Oberpfaffenhofen 15th EMS/12th ECAM 07 11 September, Sofia, Bulgaria Long-term forecasts of thunderstorms why? -> Thunderstorms
More informationApplication and verification of ECMWF products 2014
Application and verification of ECMWF products 2014 Israel Meteorological Service (IMS), 1. Summary of major highlights ECMWF deterministic runs are used to issue most of the operational forecasts at IMS.
More informationApplication and verification of ECMWF products 2009
Application and verification of ECMWF products 2009 RHMS of Serbia 1. Summary of major highlights ECMWF products are operationally used in Hydrometeorological Service of Serbia from the beginning of 2003.
More informationSTATISTICAL MODELS and VERIFICATION
STATISTICAL MODELS and VERIFICATION Mihaela NEACSU & Otilia DIACONU ANM/LMN/AMASC COSMO-September 2013 Mihaela NEACSU & Otilia DIACONU (ANM/LMN/AMASC) MOS & VERIF COSMO-September 2013 1 / 48 SUMMARY 1
More informationTAF and TREND Verification
TAF and TREND Verification Guenter Mahringer and Horst Frey, Austro Control, Aviation MET Service Linz, A-4063 Hoersching, Austria. guenter.mahringer@austrocontrol.at The TAF Verification Concept A TAF
More informationoperational status and developments
COSMO-DE DE-EPSEPS operational status and developments Christoph Gebhardt, Susanne Theis, Zied Ben Bouallègue, Michael Buchhold, Andreas Röpnack, Nina Schuhen Deutscher Wetterdienst, DWD COSMO-DE DE-EPSEPS
More informationTowards Operational Probabilistic Precipitation Forecast
5 Working Group on Verification and Case Studies 56 Towards Operational Probabilistic Precipitation Forecast Marco Turco, Massimo Milelli ARPA Piemonte, Via Pio VII 9, I-10135 Torino, Italy 1 Aim of the
More informationVALIDATION RESULTS OF THE OPERATIONAL LSA-SAF SNOW COVER MAPPING
VALIDATION RESULTS OF THE OPERATIONAL LSA-SAF SNOW COVER MAPPING Niilo Siljamo, Otto Hyvärinen Finnish Meteorological Institute, Erik Palménin aukio 1, P.O.Box 503, FI-00101 HELSINKI Abstract Hydrological
More informationWMO Aeronautical Meteorology Scientific Conference 2017
Session 1 Science underpinning meteorological observations, forecasts, advisories and warnings 1.6 Observation, nowcast and forecast of future needs 1.6.1 Advances in observing methods and use of observations
More informationApplication and verification of ECMWF products 2018
Application and verification of ECMWF products 2018 National Meteorological Administration, Romania 1. Summary of major highlights In the field of numerical model verification, the daily GRID_STAT method
More informationVerification of different wind gust parametrizations Overview of verification results at MeteoSwiss in the year 2012
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Verification of different wind gust parametrizations Overview of verification results at MeteoSwiss in the
More informationCurrent verification practices with a particular focus on dust
Current verification practices with a particular focus on dust Marion Mittermaier and Ric Crocker Outline 1. Guide to developing verification studies 2. Observations at the root of it all 3. Grid-to-point,
More informationSPECIAL PROJECT PROGRESS REPORT
SPECIAL PROJECT PROGRESS REPORT Progress Reports should be 2 to 10 pages in length, depending on importance of the project. All the following mandatory information needs to be provided. Reporting year
More informationPredictability of precipitation determined by convection-permitting ensemble modeling
Predictability of precipitation determined by convection-permitting ensemble modeling Christian Keil and George C.Craig Meteorologisches Institut, Ludwig-Maximilians-Universität, München Motivation 1.Predictability,
More informationFlora Gofa. (on behalf of) Working Group on Verification and Case studies
COSMO Verification Overview Flora Gofa (on behalf of) Working Group on Verification and Case studies 37th EWGLAM and 22th SRNWP Meeting, Belgrade, 05-08 October 2015 Definition of Common Verification Activities
More information4.3.2 Configuration. 4.3 Ensemble Prediction System Introduction
4.3 Ensemble Prediction System 4.3.1 Introduction JMA launched its operational ensemble prediction systems (EPSs) for one-month forecasting, one-week forecasting, and seasonal forecasting in March of 1996,
More informationApplication and verification of ECMWF products 2009
Application and verification of ECMWF products 2009 Danish Meteorological Institute Author: Søren E. Olufsen, Deputy Director of Forecasting Services Department and Erik Hansen, forecaster M.Sc. 1. Summary
More informationVerification of LAMI (Local Area Model Italy) using non-gts Data over Mountainous Regions
Verification of LAMI (Local Area Model Italy) using non-gts Data over Mountainous Regions Elena Oberto (*), Stefano Bande (*), Massimo Milelli (*) (*) ARPA Piemonte, Torino, Italy LAMI model Non-hydrostatic
More informationThe Impact of Horizontal Resolution and Ensemble Size on Probabilistic Forecasts of Precipitation by the ECMWF EPS
The Impact of Horizontal Resolution and Ensemble Size on Probabilistic Forecasts of Precipitation by the ECMWF EPS S. L. Mullen Univ. of Arizona R. Buizza ECMWF University of Wisconsin Predictability Workshop,
More informationSupplementary Figure 1. Summer mesoscale convective systems rainfall climatology and trends. Mesoscale convective system (MCS) (a) mean total
Supplementary Figure 1. Summer mesoscale convective systems rainfall climatology and trends. Mesoscale convective system (MCS) (a) mean total rainfall and (b) total rainfall trend from 1979-2014. Total
More informationComparison of ICON- and COSMO-EU forecast quality
Comparison of ICON- and COSMO-EU forecast quality Ulrich Damrath Ulrich.Damrath@dwd.de Models - slide got from Felix Fundel ICON (no nest) Non-hydrostatic, icosahedral 13.2 km, 90 vertical levels (~75km)
More informationModel verification / validation A distributions-oriented approach
Model verification / validation A distributions-oriented approach Dr. Christian Ohlwein Hans-Ertel-Centre for Weather Research Meteorological Institute, University of Bonn, Germany Ringvorlesung: Quantitative
More informationReport on stay at ZAMG
Report on stay at ZAMG Viena, Austria 13.05.2013 05.07.2013 Simona Tascu NMA, Romania Supervised by: Yong Wang and Theresa Gorgas Introduction The goal of the present stay was to develop and optimize the
More informationDrought forecasting methods Blaz Kurnik DESERT Action JRC
Ljubljana on 24 September 2009 1 st DMCSEE JRC Workshop on Drought Monitoring 1 Drought forecasting methods Blaz Kurnik DESERT Action JRC Motivations for drought forecasting Ljubljana on 24 September 2009
More informationVerification of Continuous Forecasts
Verification of Continuous Forecasts Presented by Barbara Brown Including contributions by Tressa Fowler, Barbara Casati, Laurence Wilson, and others Exploratory methods Scatter plots Discrimination plots
More informationApplication and verification of ECMWF products 2017
Application and verification of ECMWF products 2017 Finnish Meteorological Institute compiled by Weather and Safety Centre with help of several experts 1. Summary of major highlights FMI s forecasts are
More informationMETinfo Verification of Operational Weather Prediction Models December 2017 to February 2018 Mariken Homleid and Frank Thomas Tveter
METinfo No. /8 ISSN 89-79X Meteorology Verification of Operational Weather Prediction Models December 7 to February 8 Mariken Homleid and Frank Thomas Tveter Photo: Jan Erik Haugen Contents Introduction
More informationMETinfo Verification of Operational Weather Prediction Models June to August 2017 Mariken Homleid and Frank Thomas Tveter
METinfo No. /7 ISSN 89-79X Meteorology Verification of Operational Weather Prediction Models June to August 7 Mariken Homleid and Frank Thomas Tveter Contents Introduction Models..............................................
More informationThe Ensemble-MOS of Deutscher Wetterdienst
The Ensemble-MOS of Deutscher Wetterdienst 15th EMS/12th ECAM Session ECAM1 07 September 2015 Reinhold Hess, Jenny Glashoff, and Bernhard K. Reichert Deutscher Wetterdienst The Ensemble-MOS of Deutscher
More informationApplication and verification of ECMWF products 2016
Application and verification of ECMWF products 2016 Meteorological and Hydrological Service of Croatia Lovro Kalin and Zoran Vakula 1. Summary of major highlights At Meteorological and Hydrological Service
More informationApplication and verification of ECMWF products 2012
Application and verification of ECMWF products 2012 Instituto Português do Mar e da Atmosfera, I.P. (IPMA) 1. Summary of major highlights ECMWF products are used as the main source of data for operational
More informationApplication and verification of ECMWF products 2009
Application and verification of ECMWF products 2009 Hungarian Meteorological Service 1. Summary of major highlights The objective verification of ECMWF forecasts have been continued on all the time ranges
More informationVerification of nowcasts and short-range forecasts, including aviation weather
Verification of nowcasts and short-range forecasts, including aviation weather Barbara Brown NCAR, Boulder, Colorado, USA WMO WWRP 4th International Symposium on Nowcasting and Very-short-range Forecast
More informationWhat s new for ARPEGE/ALADIN since Utrecht 2009?
What s new for ARPEGE/ALADIN since Utrecht 2009? E. Bazile with contributions from GMAP/OBS and GMAP/PROC ASM HIRLAM ALADIN 12-16 April, 2010 Krakow Outline QPF performance of ARPEGE/ALADIN with the new
More informationICON. The Icosahedral Nonhydrostatic modelling framework
ICON The Icosahedral Nonhydrostatic modelling framework Basic formulation, NWP and high-performance computing aspects, and its perspective towards a unified model for seamless prediction Günther Zängl,
More informationTerminal aerodrome forecast verification in Austro Control using time windows and ranges of forecast conditions
METEOROLOGICAL APPLICATIONS Meteorol. Appl. 15: 113 123 (2008) Published online in Wiley InterScience (www.interscience.wiley.com).62 Terminal aerodrome forecast verification in Austro Control using time
More informationDevelopments at DWD: Integrated water vapour (IWV) from ground-based GPS
1 Working Group on Data Assimilation 2 Developments at DWD: Integrated water vapour (IWV) from ground-based Christoph Schraff, Maria Tomassini, and Klaus Stephan Deutscher Wetterdienst, Frankfurter Strasse
More informationWG1 Overview. PP KENDA for km-scale EPS: LETKF. current DA method: nudging. radar reflectivity (precip): latent heat nudging 1DVar (comparison)
WG1 Overview Deutscher Wetterdienst, D-63067 Offenbach, Germany current DA method: nudging PP KENDA for km-scale EPS: LETKF radar reflectivity (precip): latent heat nudging 1DVar (comparison) radar radial
More informationApplication and verification of ECMWF products 2012
Application and verification of ECMWF products 2012 Met Eireann, Glasnevin Hill, Dublin 9, Ireland. J.Hamilton 1. Summary of major highlights The verification of ECMWF products has continued as in previous
More informationDevelopments towards multi-model based forecast product generation
Developments towards multi-model based forecast product generation Ervin Zsótér Methodology and Forecasting Section Hungarian Meteorological Service Introduction to the currently operational forecast production
More informationUpscaled and fuzzy probabilistic forecasts: verification results
4 Predictability and Ensemble Methods 124 Upscaled and fuzzy probabilistic forecasts: verification results Zied Ben Bouallègue Deutscher Wetterdienst (DWD), Frankfurter Str. 135, 63067 Offenbach, Germany
More informationDATA FUSION NOWCASTING AND NWP
DATA FUSION NOWCASTING AND NWP Brovelli Pascal 1, Ludovic Auger 2, Olivier Dupont 1, Jean-Marc Moisselin 1, Isabelle Bernard-Bouissières 1, Philippe Cau 1, Adrien Anquez 1 1 Météo-France Forecasting Department
More informationData Assimilation at CHMI
Data Assimilation at CHMI progress report from September 2008 Alena Trojáková Czech Hydrometeorological Institute Na Šabatce 17, 143 06 Prague 4 Contents 1 Introduction 3 2 Evaluation of the assimilation
More informationSpatial Verification. for Ensemble. at DWD
Spatial Verification for Ensemble at DWD Susanne Theis Deutscher Wetterdienst (DWD) Introduction Spatial Verification of Single Simulations Box Statistics (e.g. averaging) Fraction Skill Score Wavelets
More informationApplication and verification of ECMWF products 2012
Application and verification of ECMWF products 2012 National Meteorological Administration 1. Summary of major highlights The objective verification of all deterministic models forecasts in use have been
More informationApplication and verification of ECMWF products at the Finnish Meteorological Institute
Application and verification of ECMWF products 2010 2011 at the Finnish Meteorological Institute by Juhana Hyrkkènen, Ari-Juhani Punkka, Henri Nyman and Janne Kauhanen 1. Summary of major highlights ECMWF
More informationP r o c e. d i n g s. 1st Workshop. Madrid, Spain September 2002
P r o c e e d i n g s 1st Workshop Madrid, Spain 23-27 September 2002 VERIFYIG SATELLITE PRECIPITATIO ESTIMATES FOR WEATHER AD HYDROLOGICAL APPLICATIOS Elizabeth E. Ebert 1 Abstract ear real time satellite
More informationStatistical interpretation of NWP products in India
Meteorol. Appl. 9, 21 31 (2002) Statistical interpretation of NWP products in India Parvinder Maini, Ashok Kumar, S V Singh and L S Rathore, National Center for Medium Range Weather Forecasting, Department
More informationThe correction of initial values of temperature based on T2m measurements
The correction of initial values of temperature based on T2m measurements Russian Hydrometeocentre Denis Blinov Anastasia Revokatova Inna Rozinkina Gdaly Rivin COSMO GM215, Wroclaw, 7-1 September Motivation
More informationWind verification with DIST method: preliminary results. Maria Stefania Tesini Offenbach - 6 September 2016 COSMO General Meeting
Wind verification with DIST method: preliminary results Maria Stefania Tesini Offenbach - 6 September 2016 COSMO General Meeting Motivation Current wind forecast verification at Arpae is not completely
More informationMonthly probabilistic drought forecasting using the ECMWF Ensemble system
Monthly probabilistic drought forecasting using the ECMWF Ensemble system Christophe Lavaysse(1) J. Vogt(1), F. Pappenberger(2) and P. Barbosa(1) (1) European Commission (JRC-IES), Ispra Italy (2) ECMWF,
More informationCalibration of ECMWF forecasts
from Newsletter Number 142 Winter 214/15 METEOROLOGY Calibration of ECMWF forecasts Based on an image from mrgao/istock/thinkstock doi:1.21957/45t3o8fj This article appeared in the Meteorology section
More informationVerifying Ensemble Forecasts Using A Neighborhood Approach
Verifying Ensemble Forecasts Using A Neighborhood Approach Craig Schwartz NCAR/MMM schwartz@ucar.edu Thanks to: Jack Kain, Ming Xue, Steve Weiss Theory, Motivation, and Review Traditional Deterministic
More informationOptimal combination of NWP Model Forecasts for AutoWARN
ModelMIX Optimal combination of NWP Model Forecasts for AutoWARN Tamas Hirsch, Reinhold Hess, Sebastian Trepte, Cristina Primo, Jenny Glashoff, Bernhard Reichert, Dirk Heizenreder Deutscher Wetterdienst
More informationThe Analysis of the Thunderstorm Forecasts on the Friuli-Venezia Giulia Plain
Friulian Journal of Science 2. 2002, 59-76 The Analysis of the Thunderstorm Forecasts on the Friuli-Venezia Giulia Plain DARIO GIAIOTTI * & FULVIO STEL * Abstract. This work looks at four years of objective
More informationVerification and performance measures of Meteorological Services to Air Traffic Management (MSTA)
Verification and performance measures of Meteorological Services to Air Traffic Management (MSTA) Background Information on the accuracy, reliability and relevance of products is provided in terms of verification
More informationP3.1 Development of MOS Thunderstorm and Severe Thunderstorm Forecast Equations with Multiple Data Sources
P3.1 Development of MOS Thunderstorm and Severe Thunderstorm Forecast Equations with Multiple Data Sources Kathryn K. Hughes * Meteorological Development Laboratory Office of Science and Technology National
More informationClustering Techniques and their applications at ECMWF
Clustering Techniques and their applications at ECMWF Laura Ferranti European Centre for Medium-Range Weather Forecasts Training Course NWP-PR: Clustering techniques and their applications at ECMWF 1/32
More informationExperimental MOS Precipitation Type Guidance from the ECMWF Model
Experimental MOS Precipitation Type Guidance from the ECMWF Model Phillip E. Shafer David E. Rudack National Weather Service Meteorological Development Laboratory Silver Spring, MD Development Overview:
More informationVerification of Probability Forecasts
Verification of Probability Forecasts Beth Ebert Bureau of Meteorology Research Centre (BMRC) Melbourne, Australia 3rd International Verification Methods Workshop, 29 January 2 February 27 Topics Verification
More informationREPORT ON APPLICATIONS OF EPS FOR SEVERE WEATHER FORECASTING
WORLD METEOROLOGICAL ORGANIZATION COMMISSION FOR BASIC SYSTEMS OPAG DPFS EXPERT TEAM ON ENSEMBLE PREDICTION SYSTEMS CBS-DPFS/EPS/Doc. 7(2) (31.I.2006) Item: 7 ENGLISH ONLY EXETER, UNITED KINGDOM 6-10 FEBRUARY
More informationECMWF 10 th workshop on Meteorological Operational Systems
ECMWF 10 th workshop on Meteorological Operational Systems 18th November 2005 Crown copyright 2004 Page 1 Monthly range prediction products: Post-processing methods and verification Bernd Becker, Richard
More information