North Carolina State University Land Grant University founded in undergraduate fields of study 80 master's degree areas 51 doctoral degree
|
|
- Sharyl Gaines
- 6 years ago
- Views:
Transcription
1
2
3 NC State University North Carolina State University Land Grant University founded in undergraduate fields of study 80 master's degree areas 51 doctoral degree programs Enrollment is 33,819 students (~19% graduate students) Raleigh is the state capital (population ~390,000) Research Triangle Park 3 Corners: NCSU, Duke, and UNC
4 35 faculty; 100 grad students; 240 undergrads Only Ph.D. atmospheric sciences program in the Carolinas One of largest interdisciplinary environmental sciences departments in U.S. High level of sponsored research (~$6M/year) Faculty participation in IPCC assessment.
5
6
7 Lorenz Attractor Slight change in ICs ends up in a same wing target Prediction event Lorenz Attractor
8 Methods for Estimating Quality of Ensemble Climate Prediction Systems Root Mean Square Error (RMSE) Brier Skill Score (BSS) Heidke Skill Score (SS) Kuipers Skill Score (KS) Relative Operating Characteristics (ROC)
9 Criteria for making decision The user of an ensemble of (N) forecasts has (N) options for use as a decision criteria with respect to his/her climate-related action. (i) He or she can chose to take action only if all (N) forecasts predict the adverse climate (ii) He or she can chose to take action only if at least (N-1), (n-2),, forecasts predict the adverse climate, OR (iii) He or she can chose to take action even if only one member predicts the adverse climate
10 Quality of Ensemble Climate Prediction Systems Root Mean Square Error (RMSE) Brier Skill Score (BSS) Heidke Skill Score (SS) Kuipers Skill Score (KS) Relative Operating Characteristics (ROC) also recommended by WMO
11 Decision to issue a forecast of (E) to occur is probabilistically based on the criteria: (N): size of the ensemble (n): number of the runs in the ensemble for which (E) actually occurs (p): probability given by the ratio (n/n) this is the threshold fraction above which the event (E) is predicted to occur based on the model forecast
12 What do these variables mean? ROC and other skill evaluation tools rely on identifying a particular event (E, e.g. high/low precipitation events) Historical record of E as forecasted by an EPS Observational record of E
13 Forecast-Model Contingence Matrix A decision maker becomes a user of weather forecasts if he/she alters his/her actions based on forecast information Over a large sample of independent forecasts we construct a 2x2 matrix in which we evaluate the skill of a probabilistic forecast EPS Forecast No Yes Observations No No cost ( ) False Alarm (γ) Yes Miss (β) Hit (δ) Hit Rate: H pt = δ/(β +δ) False Alarm Rate: F pt = γ/(γ + )
14 Hit Rate & False Alarm Hit rate = δ/(β+δ) observations forecast i.e. fraction of correct forecasts to total observed occurrence False alarm = γ/(γ+ ) i.e. fraction of cases when E was predicted to occur but did not occur of the total number of cases when the event E was observed not to occur
15 Quality of Ensemble Climate Prediction Systems
16 Relative Operating Characteristics (ROC) RFor each there is a corresponding pair of H(t) & F(t) which may be plotted on a ROC plot +1 Hit rate * *** *** False Alarm ratio 1. No relative skill i.e. climatology H=F, the chances for a Hit are as good as the chances for a False Alarm. 2. Total area under curve is usually used to provide a measure of the skill of the model to predict event E. 3. For a skillful forecast: the hit rate is >the false alarm. +1
17 Relative Operating Characteristics (ROC) Relative operating area (ROC area) is one of the summary measure of ensemble forecast performance ROC area (ROCA) is defined by the points (0,0), (1,1), and the points representing the forecast system
18 Relative Operating Characteristics (ROC) The closer a curve is to the upper-left-hand corner, the more skillful is the forecast system A perfect forecast system would have a ROCA of 1 A system with no capability of distinguishing in advance between different climate events has a score of 0.5, i.e. lying on the diagonal defined by (0,0) and (1,1)
19 Estimation of Economic Value (Development of Methodology) Based on trade-off between cost in taking action by the user and the loss when no action is taken & the event occurs Let $C = cost of protection (See examples) Let $L = Loss for not protecting when E occurs Occurrence of Event No Yes EXPENSE No O L CONTINGENCY Action Yes C C MATRIX User to take action that will minimize expense over a large number of cases Occurrence of Event No Yes No O βl USER Action Yes Cγ Cδ EXPENSE MATRIX
20 Observations EPS Forecast No Yes No No cost ( ) False Alarm (Cγ) Yes Miss (Lβ) Hit (Cδ) We can now represent the expected user expense using the variables with the following equation: (3)
21 From the relationships created by (3), we can develop and derive further associations among the variables presented in the tables Over the course of time, the climatological occurrence of the event becomes: (4) The definition of also allows us to derive further identities: (5) For eq. 6 to be true, # of events has to be sufficiently large, End user can now make informed decisions concerning impending expenses. (6)
22 Using eq. 1 and eq. 4 we find that: so that, when multiplying both sides by, we get: Cost of E occurring equals climatology multiplied by the hit rate (H) Similarly, employing eq. 2 and the identity in eq. 6, we find that: (7) when variables are rearranged, we get the following formula: this identity allows us to gauge the interconnection between F and (8)
23 Using equations 5 and 7 and substituting δ with, we find: which allows us to represent β as the hit rate-climatology relationship subtracted from climatology itself in order to analyze the loses due to errant forecasts relative to the climatology. (9)
24 Now that we have derived all variables in terms of their relationship with (H, F, ) the average frequency of the event,, we rewrite (3) as: where the Ls cancel out and the equation reduces to The C/L derived here now represents a hypothetical user for which there is a particular C/L ratio that they are willing to work with when utilizing EPS forecasts.
25 Redistributing the C/L we get: which becomes: (10) Substituting µ for C/L we can rewrite our equation as follows: (11) This is equation (4) in Semazzi and Mera (2006) and defines the value of an EPS for a range of mitigation options (or users) µ.
26 One special case of the M equation includes the perfect forecast, where Hpt = 1 and Fpt = 0. Thus, (11) becomes: Which becomes: (12)
27 Another special case for (11) occurs when we define the value for climatology, so that M has two possible outcomes: One is H = 0 and F = 0, when the user never takes action and the other occurs when H = F = 1 (when a user always takes action). If all you have is climatology then there is no basis for a user to change take action to take action and vice versa. When H = F = 0 we get: Which reduces to: (13) In the case where H = F = 1, we get: Which reduces to: (14)
28 Special Case: Perfect Prediction Model Perfect Forecast H=1 & F=0
29 Special Case Climatology: Poor Man s Prediction Model Only Climatology is known (Has Important Economic Benefits) Option 1: Always Take Action (H=F=1) Option 2: Never take action (H=0, F=0)
30 Option 1: Always Take Action [H=F=1] ` O observed N Y Forecast N 0 0 Y γ δ Always forecasts E to occur but it is equally likely that E will not occur
31 F Option 2: Never take action (H=0, F=0) O N Y N β Y O O Comes from Always take action Comes from never take action If L very large If C very small If L is very small
32 NOTE
33 Formula for Computing Value Define as reduction of M over normalized by maximum possible reduction I.e. so that O<V<1 V=0 for Climatology V=1 for perfect prediction model
34 Thus, we have arrived at two possible outcomes of M cli, which is defined by the hypothetical user. We now have the ability to define the value of an EPS forecast for a hypothetical user by utilizing the following formula: (15) This formula can be employed for every point in the ROC graph, that is, every Hpt and Fpt have a corresponding value curve on the EV plot and using eq. (15) and combining it with (11), (12), (13) and (14) we define specific Vpt for every H and F on the ROC figure: (16)
35 Assessment of Economic Benefits of Cli.Prediction USER SECTOR MODEL HINDCAST MET. OBS Define (E) Identity C & L Forecast (E) Specify (Pt) Obs (E) Compute OCCURANCE Fst No β Yes γ δ No Yes Region 1 Region 2 Region 9 ROC (Perfect) H F (Climatology) See example figure See example figure DECISION IF $ IS IMPORTANT TO SECTOR
36 The envelope curve may be obtained by plotting V against µ for discrete values of pt appropriately covering the possible range of 0 1. Palmer et al. (2000) have shown that the end user with should expect the maximum value V=Vmax. This relationship allows us to construct EV
37
38
39 Required Input from User Sectors: Identification of Important Climatic Event e.g. Temperature below which crop fails. E Identification of Loss L$ which occurs when no action is taken to prevent loss. Identification of Cost C$ required to prevent loss. User Benefits: Level I: Criteria either always action or never to take action when only climatology is known. Level II: Estimate of $ saved over using only climatology information Model Development Benefits: To Access/Identify model improvements which result in added value Model Intercomparison
40 Summary Diagrams of yields estimates of Eco. Ben Methodology provide means of determining when model has achieved usable range. ROC>1/2 not adequate if C/L is out of range. Ensemble approach provides objective way for combining probabilistic forecasts from different model Method is ideal for investigating added value due to downscaling based on regional climate model Application of the knowledge of climatology alone has economic benefits User need to be prepared to rely on forecast for V Based on Based on Based on Optimal (C/L) is given by. Therefore qualitative potential benefits of climate prediction can be assessed by comparing (C/L) & even before using model output. Specific sector could explore adjusting (C/L) to increased V. C/L
41 Main Conclusion The evaluation may be customized for a specific end-user application and the results are in a form that is understandable by the user & the producer of the forecasts
42 The EROC Method The traditional ROC method is widely used and indeed highly recommended by WMO. Therefore, it is more desirable to express Relative Economic Value in terms of ROC metrics if at all possible
43 The EROC Method EROC merges the information for a range of hypothetical users within the ROC plot itself. Using (16), we recognize that the V will change for each µ and that a non-optimal user would shift from its position at H = F (climatology). It is desirable for a user to set a threshold of the minimum added value that make it worth investing in an EPS. Thus, we find that V >V min and we rewrite (16): (17)
44 In order to construct our baselines where Hpt is a function of Fpt we divide both sides of (17) by and re-arranging we obtain: Further dividing both sides by we get: (18) We wish to construct mathematical forms where H is a linear function of F, thus be able to apply similar interpretation of ROC
45 If (18) becomes: With further simplification yields, (19)
46 If (18) the function becomes: where the (20)
47 Note that both (19) and (20) have (i.e a function of F) in common and constant term (i.e not a function of F). The two equations are reproduced below for convenience: (19) (20) Thus, we can combine (19) and (20) into one equation that defines H as an inequality function of F: (21)
48 where and for for (22) (23) We note that H=F is a special case of (21), when and V min =0. Therefore the traditional ROC condition for using the condition as a metric for measuring the skill on an EPS is a very special case of a user where.
49 Bounds for Our µ range is thus bounded by the two inequalities so that: (24) Outside this range the EPS has no value for the user µ
50 EROC & EV Relationship We now know that ROC is a special case of EROC for an optimal user. We found that when,, (21) reduces to H = F, or the H=F diagonal in ROC plots. We generalize this by the following equation: (25) so that all baselines can be derived from (25) as a function of a particular µ. In the case of, (25) reduces to: or simply, climatology
51 Let us now calculate a baseline given a specific µ where H is now the point corresponding to the baseline and also a function of F. To obtain the difference between ROC and the new baseline we set: (26) where H is the baseline. Combining (25) with (26), we get Again the ideal user: (27) (28)
52 Combining the equation for V in (16) and in (27) yields: for for (29)
53 The Semazzi-Mera Skill Score We have shown that there is one-to-one relationship between EROC and EV. We also showed that the base line H=F, common to the widely-used ROC plots, is a special case of (21), and as thus, a special case of EROC. Another important use of ROC in EPS skill measurement is the Area Skill Score (ASS) or ROC Skill Score (RSS), as shown in Richardson (2000a) and references therein: (30)
54 The area A under the ROC is used as an index of the accuracy of the forecast system (Mason 1982; Buizza et al. 1998, 1999). A perfect system would have A = 1.0, while no-skill systems (H = F) would have A = 0.5. Substituting A per =1, and A clim =0.5, we have Which reduces to: (31) The skill score as determined by Richardson (2000a), Stanski, and Wilks (2006), corresponds to the optimal user where M clim in the equation for V is given by H = F. Adopting a more general baseline the Semazzi-Mera Skill Score (SMSS) is given by: (32)
55 In SMSS where A is the area under the ROC curve, A per = 1, and Aµ is the appropriate area between the baseline and the ROC graph. In this case, Aµ is determined by the µ. It is the climatological baseline for a hypothetical user. (33)
56 The Application Meningitis is a serious infectious disease affecting 21 countries 300 million people at risk 700,000 cases in the past 10 years % case fatality rates
57 Meningitis-Climate link Outbreaks coincide with dry, dusty conditions over the Sahel due to the Harmattan winds Largest correlation occurs between humidity and disease ( 2003 al., outbreaks (Molesworth et Disease occurrence drops dramatically with the onset of humidity SH L SH L January July
58 Our Study: Predictability of Atmospheric Moisture What are the variables important for the prediction of the moisture regime? What are the sources of moisture in West Africa during the Boreal Spring? Can regional climate models forecast moisture transport dynamics?
59 The Variables Variables related to the West Africa monsoon have the highest correlation with meningitis We use relative humidity (RH) as an indicator in our study From Yaka et al (2008)
60 Intraseasonal Variability Kano Short-term events
61 Ensemble Dynamical Downscaling Analysis of added value of dynamical downscaling We use the Weather Research and Forecasting WRF Model as both a predictive and analytical tool for High resolution reanalysis Real-time forecasts Sensitivity experiments Comparison with large-scale models Scale of relevance
62 Advantages of Dynamical Downscaling Ghana Ghana WRF at 30km resolution NCEP/NCAR Reanalysis at 2.5
63 Advantages of Dynamical Downscaling Kano
64 Lessons
65 References Richardson, D. S., 2001: Measures of skill and value of ensemble prediction systems, their interrrelationship and the effect of ensemble size. Quart. J. Rol. Meteor. Soc., 127, Zhu et al (2002): The economic value of ensemble-based weather forecasts. BAMS, January 2002, Semazzi, F.H.M., and R. Mera, 2006: An Extended Procedure for Implementing the Relative Operating Characteristic Graphical Method. J. Appl. Meteor. Clim., 45, Publications cited in Richardson (2001), Zhu(2002), & Semazzi and Mera (2006).
66 More Information Updates on our work: twitter.com/climlab
67 Acknowledgements
Predicting uncertainty in forecasts of weather and climate (Also published as ECMWF Technical Memorandum No. 294)
Predicting uncertainty in forecasts of weather and climate (Also published as ECMWF Technical Memorandum No. 294) By T.N. Palmer Research Department November 999 Abstract The predictability of weather
More informationDrought forecasting methods Blaz Kurnik DESERT Action JRC
Ljubljana on 24 September 2009 1 st DMCSEE JRC Workshop on Drought Monitoring 1 Drought forecasting methods Blaz Kurnik DESERT Action JRC Motivations for drought forecasting Ljubljana on 24 September 2009
More informationEvaluating Forecast Quality
Evaluating Forecast Quality Simon J. Mason International Research Institute for Climate Prediction Questions How do we decide whether a forecast was correct? How do we decide whether a set of forecasts
More informationTowards Operational Probabilistic Precipitation Forecast
5 Working Group on Verification and Case Studies 56 Towards Operational Probabilistic Precipitation Forecast Marco Turco, Massimo Milelli ARPA Piemonte, Via Pio VII 9, I-10135 Torino, Italy 1 Aim of the
More informationQUANTIFYING THE ECONOMIC VALUE OF WEATHER FORECASTS: REVIEW OF METHODS AND RESULTS
QUANTIFYING THE ECONOMIC VALUE OF WEATHER FORECASTS: REVIEW OF METHODS AND RESULTS Rick Katz Institute for Study of Society and Environment National Center for Atmospheric Research Boulder, CO USA Email:
More informationThe Impact of Horizontal Resolution and Ensemble Size on Probabilistic Forecasts of Precipitation by the ECMWF EPS
The Impact of Horizontal Resolution and Ensemble Size on Probabilistic Forecasts of Precipitation by the ECMWF EPS S. L. Mullen Univ. of Arizona R. Buizza ECMWF University of Wisconsin Predictability Workshop,
More informationVERFICATION OF OCEAN WAVE ENSEMBLE FORECAST AT NCEP 1. Degui Cao, H.S. Chen and Hendrik Tolman
VERFICATION OF OCEAN WAVE ENSEMBLE FORECAST AT NCEP Degui Cao, H.S. Chen and Hendrik Tolman NOAA /National Centers for Environmental Prediction Environmental Modeling Center Marine Modeling and Analysis
More informationS e a s o n a l F o r e c a s t i n g f o r t h e E u r o p e a n e n e r g y s e c t o r
S e a s o n a l F o r e c a s t i n g f o r t h e E u r o p e a n e n e r g y s e c t o r C3S European Climatic Energy Mixes (ECEM) Webinar 18 th Oct 2017 Philip Bett, Met Office Hadley Centre S e a s
More informationMethods of forecast verification
Methods of forecast verification Kiyotoshi Takahashi Climate Prediction Division Japan Meteorological Agency 1 Outline 1. Purposes of verification 2. Verification methods For deterministic forecasts For
More informationProbabilistic verification
Probabilistic verification Chiara Marsigli with the help of the WG and Laurie Wilson in particular Goals of this session Increase understanding of scores used for probability forecast verification Characteristics,
More informationCategorical Verification
Forecast M H F Observation Categorical Verification Tina Kalb Contributions from Tara Jensen, Matt Pocernich, Eric Gilleland, Tressa Fowler, Barbara Brown and others Finley Tornado Data (1884) Forecast
More informationEnsemble Verification Metrics
Ensemble Verification Metrics Debbie Hudson (Bureau of Meteorology, Australia) ECMWF Annual Seminar 207 Acknowledgements: Beth Ebert Overview. Introduction 2. Attributes of forecast quality 3. Metrics:
More informationVerification of intense precipitation forecasts from single models and ensemble prediction systems
Verification of intense precipitation forecasts from single models and ensemble prediction systems F Atger To cite this version: F Atger Verification of intense precipitation forecasts from single models
More informationThe Latest Science of Seasonal Climate Forecasting
The Latest Science of Seasonal Climate Forecasting Emily Wallace Met Office 7 th June 2018 Research and Innovation Program under Grant 776868. Agreement Background: - Why are they useful? - What do we
More informationForecast Verification Analysis of Rainfall for Southern Districts of Tamil Nadu, India
International Journal of Current Microbiology and Applied Sciences ISSN: 2319-7706 Volume 6 Number 5 (2017) pp. 299-306 Journal homepage: http://www.ijcmas.com Original Research Article https://doi.org/10.20546/ijcmas.2017.605.034
More informationMonthly probabilistic drought forecasting using the ECMWF Ensemble system
Monthly probabilistic drought forecasting using the ECMWF Ensemble system Christophe Lavaysse(1) J. Vogt(1), F. Pappenberger(2) and P. Barbosa(1) (1) European Commission (JRC-IES), Ispra Italy (2) ECMWF,
More informationVerification of nowcasts and short-range forecasts, including aviation weather
Verification of nowcasts and short-range forecasts, including aviation weather Barbara Brown NCAR, Boulder, Colorado, USA WMO WWRP 4th International Symposium on Nowcasting and Very-short-range Forecast
More informationVerification of Probability Forecasts
Verification of Probability Forecasts Beth Ebert Bureau of Meteorology Research Centre (BMRC) Melbourne, Australia 3rd International Verification Methods Workshop, 29 January 2 February 27 Topics Verification
More informationManaging the risk of agricultural drought in Africa
Managing the risk of agricultural drought in Africa Emily Black, Dagmawi Asfaw, Matt Brown, Caroline Dunning, Fred Otu-Larbi, Tristan Quaife University of Reading, NCAS-Climate, NCEO, Ghana Meteorological
More informationFive years of limited-area ensemble activities at ARPA-SIM: the COSMO-LEPS system
Five years of limited-area ensemble activities at ARPA-SIM: the COSMO-LEPS system Andrea Montani, Chiara Marsigli and Tiziana Paccagnella ARPA-SIM Hydrometeorological service of Emilia-Romagna, Italy 11
More informationOn downscaling methodologies for seasonal forecast applications
On downscaling methodologies for seasonal forecast applications V. Moron,* A. W. Robertson * J.H. Qian * CEREGE, Université Aix-Marseille, France * IRI, Columbia University, USA WCRP Workshop on Seasonal
More informationWill it rain? Predictability, risk assessment and the need for ensemble forecasts
Will it rain? Predictability, risk assessment and the need for ensemble forecasts David Richardson European Centre for Medium-Range Weather Forecasts Shinfield Park, Reading, RG2 9AX, UK Tel. +44 118 949
More informationBroader Impacts of the Application of the Combined Use of Data-Driven Methodology and Physics-Based Weather and Climate Prediction Models
Broader Impacts of the Application of the Combined Use of Data-Driven Methodology and Physics-Based Weather and Climate Prediction Models Professor Fredrick Semazzi North Carolina State University Department
More information4.3.2 Configuration. 4.3 Ensemble Prediction System Introduction
4.3 Ensemble Prediction System 4.3.1 Introduction JMA launched its operational ensemble prediction systems (EPSs) for one-month forecasting, one-week forecasting, and seasonal forecasting in March of 1996,
More informationAssessment of Ensemble Forecasts
Assessment of Ensemble Forecasts S. L. Mullen Univ. of Arizona HEPEX Workshop, 7 March 2004 Talk Overview Ensemble Performance for Precipitation Global EPS and Mesoscale 12 km RSM Biases, Event Discrimination
More informationSeasonal forecasting of climate anomalies for agriculture in Italy: the TEMPIO Project
Seasonal forecasting of climate anomalies for agriculture in Italy: the TEMPIO Project M. Baldi(*), S. Esposito(**), E. Di Giuseppe (**), M. Pasqui(*), G. Maracchi(*) and D. Vento (**) * CNR IBIMET **
More informationPredictability from a Forecast Provider s Perspective
Predictability from a Forecast Provider s Perspective Ken Mylne Met Office, Bracknell RG12 2SZ, UK. email: ken.mylne@metoffice.com 1. Introduction Predictability is not a new issue for forecasters or forecast
More informationModel verification and tools. C. Zingerle ZAMG
Model verification and tools C. Zingerle ZAMG Why verify? The three most important reasons to verify forecasts are: to monitor forecast quality - how accurate are the forecasts and are they improving over
More informationGlobal Flash Flood Forecasting from the ECMWF Ensemble
Global Flash Flood Forecasting from the ECMWF Ensemble Calumn Baugh, Toni Jurlina, Christel Prudhomme, Florian Pappenberger calum.baugh@ecmwf.int ECMWF February 14, 2018 Building a Global FF System 1.
More informationVerification of ensemble and probability forecasts
Verification of ensemble and probability forecasts Barbara Brown NCAR, USA bgb@ucar.edu Collaborators: Tara Jensen (NCAR), Eric Gilleland (NCAR), Ed Tollerud (NOAA/ESRL), Beth Ebert (CAWCR), Laurence Wilson
More informationEnhancing Weather Information with Probability Forecasts. An Information Statement of the American Meteorological Society
Enhancing Weather Information with Probability Forecasts An Information Statement of the American Meteorological Society (Adopted by AMS Council on 12 May 2008) Bull. Amer. Meteor. Soc., 89 Summary This
More informationBarnabas Chipindu, Department of Physics, University of Zimbabwe
DEFICIENCIES IN THE OPERATIONAL APPLICATIONS OF LONG - RANGE WEATHER PREDICTIONS FOR AGRICULTURE - RECOMMENDATIONS FOR IMPROVING THE TECHNOLOGY FOR THE BENEFIT OF AGRICULTURE AT THE NATIONAL AND REGIONAL
More information10A.1 The Model Evaluation Tool
10A.1 The Model Evaluation Tool Lacey Holland, John Halley Gotway, Barbara Brown, Randy Bullock, Eric Gilleland, and David Ahijevych National Center for Atmospheric Research Boulder, CO 80307 1. INTRODUCTION
More informationCombining Deterministic and Probabilistic Methods to Produce Gridded Climatologies
Combining Deterministic and Probabilistic Methods to Produce Gridded Climatologies Michael Squires Alan McNab National Climatic Data Center (NCDC - NOAA) Asheville, NC Abstract There are nearly 8,000 sites
More informationDROUGHT FORECASTING IN CROATIA USING STANDARDIZED PRECIPITATION INDEX (SPI)
Meteorological and Hydrological Service of Croatia www.meteo.hr DROUGHT FORECASTING IN CROATIA USING STANDARDIZED PRECIPITATION INDEX (SPI) K. Cindrićand L. Kalin cindric@cirus.dhz.hr, kalin@cirus.dhz.hr
More informationModel error and seasonal forecasting
Model error and seasonal forecasting Antje Weisheimer European Centre for Medium-Range Weather Forecasts ECMWF, Reading, UK with thanks to Paco Doblas-Reyes and Tim Palmer Model error and model uncertainty
More informationTranslating Ensemble Weather Forecasts into Probabilistic User-Relevant Information
Translating Ensemble Weather Forecasts into Probabilistic User-Relevant Information Matthias Steiner with contributions from Robert Sharman, Thomas Hopson, Yubao Liu, Mike Chapman, and Mary Hayden Email:
More informationECMWF 10 th workshop on Meteorological Operational Systems
ECMWF 10 th workshop on Meteorological Operational Systems 18th November 2005 Crown copyright 2004 Page 1 Monthly range prediction products: Post-processing methods and verification Bernd Becker, Richard
More informationCurrent status of the Pan-Arctic Regional Climate Outlook Forum (PARCOF)
Current status of the Pan-Arctic Regional Climate Outlook Forum (PARCOF) Bertrand Denis Meteorological Service of Canada WMO International Workshop on Global Review of Regional Climate Outlook Forums,
More informationEMC Probabilistic Forecast Verification for Sub-season Scales
EMC Probabilistic Forecast Verification for Sub-season Scales Yuejian Zhu Environmental Modeling Center NCEP/NWS/NOAA Acknowledgement: Wei Li, Hong Guan and Eric Sinsky Present for the DTC Test Plan and
More informationExtracting probabilistic severe weather guidance from convection-allowing model forecasts. Ryan Sobash 4 December 2009 Convection/NWP Seminar Series
Extracting probabilistic severe weather guidance from convection-allowing model forecasts Ryan Sobash 4 December 2009 Convection/NWP Seminar Series Identification of severe convection in high-resolution
More informationWhat is the IPCC? Intergovernmental Panel on Climate Change
IPCC WG1 FAQ What is the IPCC? Intergovernmental Panel on Climate Change The IPCC is a scientific intergovernmental body set up by the World Meteorological Organization (WMO) and by the United Nations
More informationThe economic value of weather forecasts for decision-making problems in the profit/loss situation
METEOROLOGICAL APPLICATIONS Meteorol. Appl. 4: 455 463 (27) Published online in Wiley InterScience (www.interscience.wiley.com) DOI:.2/met.44 The economic value of weather forecasts for decision-making
More informationREPORT ON APPLICATIONS OF EPS FOR SEVERE WEATHER FORECASTING
WORLD METEOROLOGICAL ORGANIZATION COMMISSION FOR BASIC SYSTEMS OPAG DPFS EXPERT TEAM ON ENSEMBLE PREDICTION SYSTEMS CBS-DPFS/EPS/Doc. 7(2) (31.I.2006) Item: 7 ENGLISH ONLY EXETER, UNITED KINGDOM 6-10 FEBRUARY
More informationSeasonal Climate Watch June to October 2018
Seasonal Climate Watch June to October 2018 Date issued: May 28, 2018 1. Overview The El Niño-Southern Oscillation (ENSO) has now moved into the neutral phase and is expected to rise towards an El Niño
More informationVerification Methods for High Resolution Model Forecasts
Verification Methods for High Resolution Model Forecasts Barbara Brown (bgb@ucar.edu) NCAR, Boulder, Colorado Collaborators: Randy Bullock, John Halley Gotway, Chris Davis, David Ahijevych, Eric Gilleland,
More informationVerification of Continuous Forecasts
Verification of Continuous Forecasts Presented by Barbara Brown Including contributions by Tressa Fowler, Barbara Casati, Laurence Wilson, and others Exploratory methods Scatter plots Discrimination plots
More informationEnsemble forecast and verification of low level wind shear by the NCEP SREF system
Ensemble forecast and verification of low level wind shear by the NCEP SREF system Binbin Zhou*, Jeff McQueen, Jun Du, Geoff DiMego, Zoltan Toth, Yuejian Zhu NOAA/NWS/NCEP/Environment Model Center 1. Introduction
More informationBasic Verification Concepts
Basic Verification Concepts Barbara Brown National Center for Atmospheric Research Boulder Colorado USA bgb@ucar.edu Basic concepts - outline What is verification? Why verify? Identifying verification
More informationVerification of the operational NWP models at DWD - with special focus at COSMO-EU
Verification of the operational NWP models at DWD - with special focus at COSMO-EU Ulrich Damrath Ulrich.Damrath@dwd.de Ein Mensch erkennt (und das ist wichtig): Nichts ist ganz falsch und nichts ganz
More informationDeterministic and Probabilistic prediction approaches in Seasonal to Inter-annual climate forecasting
RA 1 EXPERT MEETING ON THE APPLICATION OF CLIMATE FORECASTS FOR AGRICULTURE Banjul, Gambia, 9-13 December 2002 Deterministic and Probabilistic prediction approaches in Seasonal to Inter-annual climate
More informationImprovements to, and Verification of, Intraseasonal to Seasonal Prediction of Tropical Cyclogenesis
Improvements to, and Verification of, Intraseasonal to Seasonal Prediction of Tropical Cyclogenesis David Meyer and Tom Murphree Naval Postgraduate School dwmeyer@nps.edu and murphree@nps.edu 15W (Talas)
More informationTOOLS AND DATA NEEDS FOR FORECASTING AND EARLY WARNING
TOOLS AND DATA NEEDS FOR FORECASTING AND EARLY WARNING Professor Richard Samson Odingo Department of Geography and Environmental Studies University of Nairobi, Kenya THE NEED FOR ADEQUATE DATA AND APPROPRIATE
More informationRevisiting predictability of the strongest storms that have hit France over the past 32 years.
Revisiting predictability of the strongest storms that have hit France over the past 32 years. Marie Boisserie L. Descamps, P. Arbogast GMAP/RECYF 20 August 2014 Introduction Improving early detection
More informationSeasonal Climate Watch September 2018 to January 2019
Seasonal Climate Watch September 2018 to January 2019 Date issued: Aug 31, 2018 1. Overview The El Niño-Southern Oscillation (ENSO) is still in a neutral phase and is still expected to rise towards an
More informationA skill score based on economic value for probability forecasts
Meteorol. Appl. 8, 209 219 (2001) A skill score based on economic value for probability forecasts D S Wilks, Department of Earth and Atmospheric Sciences, Cornell University, Ithaca, New York, USA An approach
More informationUpscaled and fuzzy probabilistic forecasts: verification results
4 Predictability and Ensemble Methods 124 Upscaled and fuzzy probabilistic forecasts: verification results Zied Ben Bouallègue Deutscher Wetterdienst (DWD), Frankfurter Str. 135, 63067 Offenbach, Germany
More informationSeasonal Climate Watch July to November 2018
Seasonal Climate Watch July to November 2018 Date issued: Jun 25, 2018 1. Overview The El Niño-Southern Oscillation (ENSO) is now in a neutral phase and is expected to rise towards an El Niño phase through
More informationVerification and performance measures of Meteorological Services to Air Traffic Management (MSTA)
Verification and performance measures of Meteorological Services to Air Traffic Management (MSTA) Background Information on the accuracy, reliability and relevance of products is provided in terms of verification
More informationRisk in Climate Models Dr. Dave Stainforth. Risk Management and Climate Change The Law Society 14 th January 2014
Risk in Climate Models Dr. Dave Stainforth Grantham Research Institute on Climate Change and the Environment, and Centre for the Analysis of Timeseries, London School of Economics. Risk Management and
More informationRecommendations on trajectory selection in flight planning based on weather uncertainty
Recommendations on trajectory selection in flight planning based on weather uncertainty Philippe Arbogast, Alan Hally, Jacob Cheung, Jaap Heijstek, Adri Marsman, Jean-Louis Brenguier Toulouse 6-10 Nov
More informationFeature-specific verification of ensemble forecasts
Feature-specific verification of ensemble forecasts www.cawcr.gov.au Beth Ebert CAWCR Weather & Environmental Prediction Group Uncertainty information in forecasting For high impact events, forecasters
More informationSpatial Forecast Verification Methods
Spatial Forecast Verification Methods Barbara Brown Joint Numerical Testbed Program Research Applications Laboratory, NCAR 22 October 2014 Acknowledgements: Tara Jensen, Randy Bullock, Eric Gilleland,
More informationNon catchment type instruments for snowfall measurement: General considerations and
Non catchment type instruments for snowfall measurement: General considerations and issues encountered during the WMO CIMO SPICE experiment, and derived recommendations Authors : Yves Alain Roulet (1),
More informationPrediction of Climate Change Impacts in Tanzania using Mathematical Models: The Case of Dar es Salaam City
Prediction of Climate Change Impacts in Tanzania using Mathematical Models: The Case of Dar es Salaam City By Guido Uhinga PhD Student (Climate Change) Ardhi University Local Climate Solutions for Africa
More informationRCOF Review [Regional Climate Outlook Forum for the Gulf of Guinea region of Africa - PRESAGG] Status Report
RCOF Review 2017 [Regional Climate Outlook Forum for the Gulf of Guinea region of Africa - PRESAGG] Status Report Specific Climate features of concerned region This region typically covers the area below
More informationBaseline Climatology. Dave Parker ADD PRESENTATION TITLE HERE (GO TO: VIEW / MASTER / SLIDE MASTER TO AMEND) ADD PRESENTER S NAME HERE / ADD DATE HERE
Baseline Climatology Dave Parker ADD PRESENTATION TITLE HERE (GO TO: VIEW / MASTER / SLIDE MASTER TO AMEND) ADD PRESENTER S NAME HERE / ADD DATE HERE Copyright EDF Energy. All rights reserved. Introduction
More informationSpatial verification of NWP model fields. Beth Ebert BMRC, Australia
Spatial verification of NWP model fields Beth Ebert BMRC, Australia WRF Verification Toolkit Workshop, Boulder, 21-23 February 2007 New approaches are needed to quantitatively evaluate high resolution
More informationDetective Miss Marple in Murder at the Gallop. 3rd verification workshop, ECMWF 2007, Göber
m Detective Miss Marple in Murder at the Gallop Slide m Now, this is how we verify the forecasters at DWD: we watch them intensily and when they get it wrong, they'll get a bang over their head. OK, I'm
More informationExploring ensemble forecast calibration issues using reforecast data sets
NOAA Earth System Research Laboratory Exploring ensemble forecast calibration issues using reforecast data sets Tom Hamill and Jeff Whitaker NOAA Earth System Research Lab, Boulder, CO tom.hamill@noaa.gov
More informationCurrent verification practices with a particular focus on dust
Current verification practices with a particular focus on dust Marion Mittermaier and Ric Crocker Outline 1. Guide to developing verification studies 2. Observations at the root of it all 3. Grid-to-point,
More informationBasic Verification Concepts
Basic Verification Concepts Barbara Brown National Center for Atmospheric Research Boulder Colorado USA bgb@ucar.edu May 2017 Berlin, Germany Basic concepts - outline What is verification? Why verify?
More informationBAYESIAN APPROACH TO DECISION MAKING USING ENSEMBLE WEATHER FORECASTS
BAYESIAN APPROACH TO DECISION MAKING USING ENSEMBLE WEATHER FORECASTS Rick Katz Institute for Study of Society and Environment National Center for Atmospheric Research Email: rwk@ucar.edu Paper: R.W. Katz
More informationSeasonal prediction of extreme events
Seasonal prediction of extreme events C. Prodhomme, F. Doblas-Reyes MedCOF training, 29 October 2015, Madrid Climate Forecasting Unit Outline: Why focusing on extreme events? Extremeness metric Soil influence
More informationSPC Fire Weather Forecast Criteria
SPC Fire Weather Forecast Criteria Critical for temperature, wind, and relative humidity: - Sustained winds 20 mph or greater (15 mph Florida) - Minimum relative humidity at or below regional thresholds
More informationA simple method for seamless verification applied to precipitation hindcasts from two global models
A simple method for seamless verification applied to precipitation hindcasts from two global models Matthew Wheeler 1, Hongyan Zhu 1, Adam Sobel 2, Debra Hudson 1 and Frederic Vitart 3 1 Bureau of Meteorology,
More informationHistorical and Modelled Climate Data issues with Extreme Weather: An Agricultural Perspective. Neil Comer, Ph.D.
Historical and Modelled Climate Data issues with Extreme Weather: An Agricultural Perspective Neil Comer, Ph.D. When Crops are in the fields it s looking good: Trend in Summer Temperature (L) & Summer
More informationSevere storm forecast guidance based on explicit identification of convective phenomena in WRF-model forecasts
Severe storm forecast guidance based on explicit identification of convective phenomena in WRF-model forecasts Ryan Sobash 10 March 2010 M.S. Thesis Defense 1 Motivation When the SPC first started issuing
More informationComputer Models of the Earth s Climate
Computer Models of the Earth s Climate DARGAN M. W. FRIERSON DEPARTMENT OF ATMOSPHERIC SCIENCES MATH DAY, 3-25-13 Climate Models Climate Models Climate Models Mathematical model: uses equations to describe
More informationTAF and TREND Verification
TAF and TREND Verification Guenter Mahringer and Horst Frey, Austro Control, Aviation MET Service Linz, A-4063 Hoersching, Austria. guenter.mahringer@austrocontrol.at The TAF Verification Concept A TAF
More informationSeasonal Climate Watch April to August 2018
Seasonal Climate Watch April to August 2018 Date issued: Mar 23, 2018 1. Overview The El Niño-Southern Oscillation (ENSO) is expected to weaken from a moderate La Niña phase to a neutral phase through
More informationWMO Climate Watch System
WMO Climate Watch System Purpose and Requirements Peer Hechler, Omar Baddour, Karolin Eichler (WMO/OBS/WIS/DMA) Content Introduction CWS in general CWS components CWS requirements Examples Summary Climate
More informationSeasonal Climate Watch January to May 2016
Seasonal Climate Watch January to May 2016 Date: Dec 17, 2015 1. Advisory Most models are showing the continuation of a strong El-Niño episode towards the latesummer season with the expectation to start
More informationMarch Regional Climate Modeling in Seasonal Climate Prediction: Advances and Future Directions
1934-2 Fourth ICTP Workshop on the Theory and Use of Regional Climate Models: Applying RCMs to Developing Nations in Support of Climate Change Assessment and Extended-Range Prediction 3-14 March 2008 Regional
More informationEvaluation of Ensemble Icing Probability Forecasts in NCEP s SREF, VSREF and NARRE-TL Systems
Evaluation of Ensemble Icing Probability Forecasts in NCEP s, V and Systems Binbin Zhou 1,2, Jun Du 2, Geoff DeMigo 2 and Robert Sallee 3 1. I.M. System Group 2. Environmental Modeling Center of NCEP 3.
More informationClustering Techniques and their applications at ECMWF
Clustering Techniques and their applications at ECMWF Laura Ferranti European Centre for Medium-Range Weather Forecasts Training Course NWP-PR: Clustering techniques and their applications at ECMWF 1/32
More informationNOTES AND CORRESPONDENCE. Improving Week-2 Forecasts with Multimodel Reforecast Ensembles
AUGUST 2006 N O T E S A N D C O R R E S P O N D E N C E 2279 NOTES AND CORRESPONDENCE Improving Week-2 Forecasts with Multimodel Reforecast Ensembles JEFFREY S. WHITAKER AND XUE WEI NOAA CIRES Climate
More informationApplication and verification of ECMWF products 2009
Application and verification of ECMWF products 2009 Hungarian Meteorological Service 1. Summary of major highlights The objective verification of ECMWF forecasts have been continued on all the time ranges
More informationstatistical methods for tailoring seasonal climate forecasts Andrew W. Robertson, IRI
statistical methods for tailoring seasonal climate forecasts Andrew W. Robertson, IRI tailored seasonal forecasts why do we make probabilistic forecasts? to reduce our uncertainty about the (unknown) future
More informationDownscaling in Time. Andrew W. Robertson, IRI. Advanced Training Institute on Climate Variability and Food Security, 12 July 2002
Downscaling in Time Andrew W. Robertson, IRI Advanced Training Institute on Climate Variability and Food Security, 12 July 2002 Preliminaries Crop yields are driven by daily weather variations! Current
More informationVerification of WAQUA/DCSMv5 s operational water level probability forecasts
Ministry of Infrastructure and Water Management Verification of WAQUA/DCSMv5 s operational water level probability forecasts N. Wagenaar KNMI Internal report IR-18-1 UTRECHT UNIVSERSITY DEPARTMENT OF
More informationVerifying Ensemble Forecasts Using A Neighborhood Approach
Verifying Ensemble Forecasts Using A Neighborhood Approach Craig Schwartz NCAR/MMM schwartz@ucar.edu Thanks to: Jack Kain, Ming Xue, Steve Weiss Theory, Motivation, and Review Traditional Deterministic
More informationExercise Part 1 - Producing Guidance and Verification -
Exercise Part 1 - Producing Guidance and Verification - 1 Objectives To understand how to produce guidance for seasonal temperature and precipitation. To think rationally and find possible predictors.
More informationUnderstanding Weather and Climate Risk. Matthew Perry Sharing an Uncertain World Conference The Geological Society, 13 July 2017
Understanding Weather and Climate Risk Matthew Perry Sharing an Uncertain World Conference The Geological Society, 13 July 2017 What is risk in a weather and climate context? Hazard: something with the
More informationComparison of the NCEP and DTC Verification Software Packages
Comparison of the NCEP and DTC Verification Software Packages Point of Contact: Michelle Harrold September 2011 1. Introduction The National Centers for Environmental Prediction (NCEP) and the Developmental
More informationSeasonal forecasts presented by:
Seasonal forecasts presented by: Latest Update: 9 February 2019 The seasonal forecasts presented here by Seasonal Forecast Worx are based on forecast output of the coupled ocean-atmosphere models administered
More informationA Local Ensemble Prediction System for Fog and Low Clouds: Construction, Bayesian Model Averaging Calibration, and Validation
3072 J O U R N A L O F A P P L I E D M E T E O R O L O G Y A N D C L I M A T O L O G Y VOLUME 47 A Local Ensemble Prediction System for Fog and Low Clouds: Construction, Bayesian Model Averaging Calibration,
More informationOperational Practices in South African Weather Service (SAWS)
Operational Practices in South African Weather Service (SAWS) Abiodun Adeola, Hannes Rautenbach, Cobus Olivier 2018/06/12 1 Overview Seasonal Forecasting System at SAWS How to Interpret Seasonal Forecasts
More informationJaclyn Ashley Shafer. Bachelor of Science Meteorology Florida Institute of Technology 2006
A Verification of the National Hurricane Center s Tropical Cyclone Wind Speed Probability Forecast Product by Jaclyn Ashley Shafer Bachelor of Science Meteorology Florida Institute of Technology 2006 A
More informationOverview of the TAMSAT drought forecasting system
Overview of the TAMSAT drought forecasting system The TAMSAT drought forecasting system produces probabilistic forecasts of drought by combining information on the contemporaneous condition of the land
More information