NWS Tornado Warnings with Zero or Negative Lead Times

140 W E A T H E R A N D F O R E C A S T I N G VOLUME 24 NWS Tornado Warnings with Zero or Negative Lead Times J. BROTZGE Center for Analysis and Prediction of Storms, University of Oklahoma, Norman, Oklahoma S. ERICKSON NOAA/National Severe Storms Laboratory, Norman, Oklahoma (Manuscript received 1 October 2007, in final form 26 June 2008) ABSTRACT During a 5-yr period of study from 2000 to 2004, slightly more than 10% of all National Weather Service (NWS) tornado were issued either simultaneously as the tornado formed (i.e., with zero ) or minutes after initial tornado formation but prior to tornado dissipation (i.e., with negative ). This study examines why these tornadoes were not warned in advance, and what climate, storm morphology, and sociological factors may have played a role in delaying the issuance of the warning. This dataset of zero and negative are sorted by their F-scale ratings, geographically by region and weather forecast office (WFO), hour of the day, month of the year, tornado-to-radar distance, county population density, and number of tornadoes by day, hour, and order of occurrence. Two key results from this study are (i) providing advance warning on the first tornado of the day remains a difficult challenge and (ii) the more isolated the tornado event, the less likelihood that an advance warning is provided. WFOs that experience many large-scale outbreaks have a lower proportion of with negative than WFOs that experience many more isolated, one-tornado or two-tornado warning days. Monthly and geographic trends in are directly impacted by the number of multiple tornado events. Except for a few isolated cases, the impacts of tornado-to-radar distance, county population density, and storm morphology did not have a significant impact on negative lead-time. 1. Introduction Corresponding author address: Jerald Brotzge, University of Oklahoma, 120 David L. Boren Blvd., Suite 2500, Norman, OK 73072-7309. E-mail: jbrotzge@ou.edu Statistics indicate that the National Weather Service (NWS) was able to provide to the general public on about 75% of all tornadoes identified during 2006 (NWS 2007). With the modernization of the NWS (Friday 1994) including the introduction of Weather Surveillance Radars-1988 Doppler (WSR-88Ds; Crum and Alberty 1993) and the Advanced Weather Interactive Processing System (AWIPS) environment (Seguin 2002), automated feature detection algorithms (Mitchell et al. 1998; Stumpf et al. 1998), increasingly sophisticated training (Magsig et al. 2006), and greater conceptual understanding through field programs such as the Verification of the Origins of Rotation in Tornadoes Experiment (VORTEX-95; Rasmussen et al. 1994), the average tornado warning is now 13 min (Erickson and Brooks 2006), thereby saving lives and reducing injuries (Simmons and Sutter 2005). Nevertheless, in lieu of these advances, a significant number of tornado still are issued either simultaneously as the tornado forms (i.e., with zero lead time) or minutes after initial tornado formation but prior to tornado dissipation (i.e., with negative lead time). As long as these tornadoes have zero or negative s, the potential will exist for the public to remain unwarned in advance of these potentially destructive misoscale wind events. This study asks the questions: What, if any, specific causes prevented these tornado from being issued sooner? What climatological, storm morphological, or sociological factors play a role? Does a delayed NWS warning impact tornado fatalities? Finally, what are areas of focus for improving the current warning system to DOI: 10.1175/2008WAF2007076.1 Ó 2009 American Meteorological Society

FEBRUARY 2009 B R O T Z G E A N D E R I C K S O N 141 reduce the number of zero and negative tornado? 2. Data A compilation of 5 yr of tornado warning reports from 2000 to 2004 were obtained from the National Oceanic and Atmospheric Administration (NOAA)/ NWS. These data included information on all confirmed tornadoes and their associated NWS warning; a list of those tornadoes without advance NWS warning was also provided. These reports contained the date and location of each tornado, the time of the event, the time the NWS warning was issued, the weather forecast office (WFO) that issued the warning, the county or parish location, the estimated F-scale rating, the number of fatalities and estimates of the damage. Additional information on each zero and negative lead-time event was obtained from the National Climatic Data Center, including tornado pathlength, width, and duration. County population estimates were obtained from the 1 July 2000 population estimates produced by the Population Division of the U.S. Census Bureau. Storm morphology was determined by manual review of radar reflectivity data, using the classification scheme as suggested by Gallus et al. (2008). Each storm event was classified as either line, cell, tropical (hurricane, tropical storm), or undefined. No radar velocity data were included in this classification scheme. All zero and negative are associated with tornadoes that were still in progress when the warning was issued. No NWS issued after tornado dissipation were included in this study. 3. Climatology In an effort to better understand the root causes for the delays in the zero and negative lead-time, especially when compared to those issued well in advance of touchdown, a climatology of the zero and negative lead-time (henceforth, simply referred to together as negative lead-time ) was completed. The negative lead-time were sorted as a function of F-scale ranking, geographically by region and WFO, hour of the day, month of the year, distance from radar, county population, and number of tornadoes by day, hour, and order of occurrence. The database of warned tornadoes from 2000 to 2004 includes 4604 (89.1%) positive lead-time events, 211 (4.1%) zero lead-time events, and 355 (6.9%) negative lead-time events. The negative s ranged from 21 to255 min, with a mean negative of 25.2 min and a median negative of 23 min FIG. 1. All zero and negative lead-time events plotted as a function of the F scale. (excluding zero lead-time events). Fifty tornadoes had a negative of 210 min or more. a. Negative lead-time sorted by F scale All negative lead-time were compared against the estimated F-scale damage incurred by the event (Fig. 1). During the 5 yr of study, the distributions of F0, F1, F2, F3, and F4 tornadoes were 59.5%, 28.4%, 9.9%, 1.6%, and 0.5%, respectively. This distribution is nearly identical to the F-scale estimates of those tornadoes with positive s, with distributions of 63.9%, 24.2%, 8.1%, 3.0%, and 0.7%, respectively. Note that there were no F5 tornadoes reported during the 5 yr of study. An examination of Fig. 1 highlights four outliers in the dataset with negative s of 240 min or greater. A summary of these four events is as follows: 1) A tornado in Angelina County, Texas, formed within a severe squall line causing $5 million in damage but no fatalities. The 30 March 2002 tornado was approximately 170 km from the nearest radar and occurred near dusk at 0105 UTC on a Saturday night. 2) A tornado occurred on 7 September 2004 in Sumter County, South Carolina, spawned by Hurricane Frances. It caused $1.7 million in damage, but no fatalities. The tornado was approximately 68 km from the nearest radar and in a relatively populated area, but occurred during the early morning hours at

142 W E A T H E R A N D F O R E C A S T I N G VOLUME 24 Date Deaths TABLE 1. List of all F3 and F4 tornadoes with zero or negative s. Local time Day of week F scale State Lead time (min) Storm type Distance to WSR-88D (km) County population density (persons per square kilometer) 21 Apr 2001 1 2115 Saturday F4 KS 27 Cells 132.7 12.7 28 Apr 2002 1 1856 Sunday F4 MD 26 Cells 53.7 84.7 13 Jul 2004 0 1434 Tuesday F4 IL 0 Cells 72.2 23.9 3 Jan 2000 0 1523 Monday F3 KY 23 Line 87.8 16.1 23 Apr 2000 0 1945 Sunday F3 LA 26 Cells 77.5 11.3 27 May 2000 0 1446 Saturday F3 TN 22 Line 76.6 13.5 30 Mar 2002 0 1905 Saturday F3 TX 243 Line 170.5 33.7 21 Apr 2002 1 1451 Sunday F3 IL 210 Cells 142.7 9.3 2 Sep 2002 0 1622 Monday F3 WI 215 Cells 173.0 6.4 10 Nov 2002 0 1645 Sunday F3 OH 22 Cells 109.9 28.3 4 May 2003 0 2009 Sunday F3 AR 0 Line 26.4 19.8 5 May 2003 0 1145 Monday F3 TN 0 Cells 59.0 19.1 1128 UTC and was 1 of 19 tornadoes warned on by the WFO that day. 3) A tornado in Baca County, Colorado, formed 16 July 2000 from an undefined (not readily classifiable) convective complex. It caused no damage or fatalities, and no other tornadoes were reported that day. The tornado was approximately 205 km from the nearest radar in a county with a county population density of 0.7 persons per square kilometer (national average county population density is ;31 persons per square kilometer). 4) A tornado in Henry County, Tennessee, formed after dark (0425 UTC) on 6 May 2003 from an undefined convective complex. It caused $15,000 in damage and no fatalities. These four cases highlight four critical challenges to the operational forecaster. First, none of these four tornadoes developed from a parent classical supercell thunderstorm. Tornadoes developing from lines, hurricanes, and less-organized convection are in general more difficult to anticipate and detect. A second challenge for the operational forecaster is the lack of spotter reports, particularly at night and in sparsely populated regions. Spotter reports provide ongoing analysis of storm evolution, and instant communication for when tornado formation begins, lessening the chance for a large negative lead-time warning. Three of the four events occurred during the evening through early morning hours (events 1, 2, and 4). A third challenge is identifying tornadoes when the storms are far from radar. The center of a radar beam at 0.58 elevation at a range of 120 km is ;1.98 km AGL, meaning that the radar beam is overshooting the lowest 2 km beyond a range of 120 km. Two of the four tornado warning outliers with large negative s had tornado-toradar distances of 120 km or greater. A fourth challenge for the operational forecaster is providing advance warning for situations in which many are needed for a variety of severe weather conditions, such as during Hurricane Frances. Providing advance for isolated events during nonclassical severe weather situations, such as in Baca County, also presents some unique challenges. A list of all tornadoes classified as F3 or F4 with zero or negative s is presented in Table 1. Between 2000 and 2004, 12 tornadoes occurred that were classified as F3 or higher with zero or negative. The distance of the tornado from the radar may have impacted the warning. The four events with the greatest negative s are also the same four cases with the farthest tornado-to-radar distance. Nevertheless, the relatively small sample size of F3 and F4 tornadoes in this dataset makes any inferences difficult. b. Geographical distribution Are zero and negative s more prevalent in certain geographic regions of the country? One may surmise that variations in storm climatology combined with differences in NWS office warning management and experience could lead to varying patterns of negative s across the country. To assess the impact of regional climatology on the warning process, all (positive, zero, and negative lead time) tornado were sorted among four broad geographic regions: southeast (SE), midwest/east (MW), plains, and west (Fig. 2). In general, the lowest proportion of zero and negative was issued in the southeast region, with the plains region having the greatest positive and lowest negative (Table 2). When combined, all tornado warning data fit a gamma distribution, so a Wilcoxon Mann Whitney rank sum test was used to determine the

FEBRUARY 2009 B R O T Z G E A N D E R I C K S O N 143 FIG. 2. All data were divided among four geographic regions: midwest/east, southeast, plains, and west. uniqueness of these four regions. For positive, the plains region was significantly different from the SE and MW regions at the 99% confidence level, and the West region was significantly different from the SE and MW regions at the 90% confidence level. For negative s, the plains region was found to be significantly different from each of the other three regions at the 90% confidence level; none of the other regions were significantly different from any other. Including the zero lead-time events, the plains region was found to be significantly different from all other regions at the 99% confidence level. Next, all zero and negative lead-time events were sorted by the NWS WFO that issued each warning. A percentage of the total number of tornado with a zero or negative was calculated for each WFO. These percentages of zero and negative lead times are plotted against the total number of verified tornado issued by each WFO (Fig. 3). WFOs with less than 10 tornado issued during the 5- yr period were not plotted. As evident in Fig. 3, in general the greater number of tornado events warned by a given WFO, the lower percentage of those are issued with zero or negative. All WFOs with over 100 tornado during the 5-yr period of study averaged less than 10% of with negative. A few WFOs were found to have exceptionally high zero or negative lead-time rates when compared with other forecast offices. Over 30% of all tornado from two WFOs (labeled A and B ) were issued with zero. Over 40% of tornado from one WFO ( C ) were issued after tornado formation. Indeed, the tornado warning statistics at these three WFOs differ markedly from those at other forecast offices. Parker and Waldron (2002) and Wolf (2002) demonstrate that WFO warning operations can significantly impact warning results. c. Diurnal climatology What is the impact of time of day on the issuance of tornado? The numbers of tornado with positive, zero, and negative s were plotted by hour (Fig. 4a). For easier interpretation, hourly percentages were subtracted from the daily zero and negative mean percentages (4.2% and 6.1%, respectively) as shown in Fig. 4b. Overall, one clear trend emerges. Above-average numbers of zero and negative lead-time are issued between 1300 and 1800 local time (LT) and belowaverage numbers of negative are issued between 1800 and 0200 LT. This trend likely captures the difficulty in warning on the first tornado of the day. This is explored in more detail in section 3h. d. Seasonal climatology As with the diurnal cycle, the seasonal cycle in storm climatology may affect the predictability and detectability of tornadoes and, thereby, impact tornado warning s. The percentages of all tornado with zero or negative s were plotted as a function of month (Fig. 5a). Nationwide, warned tornadoes with zero or negative s peaked during July and August with a relative minimum observed during May. To better discern the causes driving the monthly differences, the data were sorted by region and again plotted as a function of month (Fig. 5b). Note that the percentages are computed from the total number within each region, such that the percentage within each geographic region totals 100%. Tornadoes TABLE 2. Positive, zero, and negative lead-time statistics for the four geographic regions. Sample size Percentage of Median (min) Mean (min) Region (1) (0) (2) (1) (0) (2) (1) (2) (1) (2) (Total) Southeast 1287 36 69 92.5 2.6 5.0 115 24 116.7 26.6 115.1 Midwest 794 29 74 88.5 3.2 8.2 114 24 116.7 25.1 114.4 Plains 2295 132 167 88.5 5.1 6.4 117 23 119.2 24.2 116.7 West 228 14 45 79.4 4.9 15.7 117 24 119.0 26.7 114.0

144 W E A T H E R A N D F O R E C A S T I N G VOLUME 24 FIG. 3. Percentage of warned tornado events with (a) zero and (b) negative s plotted against the total number of tornado issued by that WFO during the 5 yr of study. with zero and negative lead-time peaked in the southeast and west regions in July and August, the peak in the midwest was observed in July followed by June, and in the plains region the peak was observed in September, followed by July and April. Most regions indicated relative minima in tornadoes with zero and negative lead-time during May. The distribution of all zero and negative s was plotted as a function of month (Fig. 6). No data from any month with fewer than 10 negative lead-time events were shown. In general, the early spring and fall months had a greater number of large negative lead-time events. Ironically, the month with by far the greatest number of tornadoes (May) had among the lowest mean negative FIG. 4. (a) Number of tornado issued each hour with positive, zero, and negative s. (b) Percent deviation from the daily average percentage of with zero or negative lead-times plotted as a function of hour of day.

FEBRUARY 2009 B R O T Z G E A N D E R I C K S O N 145 FIG. 5. (a) Percentage of all warned tornadoes with zero or negative s plotted as a function of the month of the year. (b) Same as in (a) but sorted by geographic region. Note that regional percentages are computed from the total number within each region, such that the percentage within each geographic region totals 100%.. Using a Wilcoxon Mann Whitney rank sum test, May s were significantly lower than those from March, April, June, August, and October at the 90% confidence level; no other month was significantly different from any other month. e. Impact of storm morphology A subsample of 110 positive and 110 negative leadtime events was classified by storm type to better understand the impact of storm morphology on tornado warning s. A semirandom sample was chosen; every 5th event was classified in the zero and negative lead-time dataset, while every 40th event was classified from the positive lead-time warning dataset. Each event was manually reviewed using mosaic radar data (see the Web site http://www.mmm.ucar.edu/imagearchive/ for an example), or when not available, level 2 and level 3 radar data archived at the National Climatic Data Center were used. As described in section 2, each storm event was classified as line, cell, tropical (hurricane, tropical storm), or undefined, as described by Gallus et al. (2008). Broken lines of individual storm cells were classified under the cell heading; line events were generally solid convective squall lines. Undefined events were primarily stratiform regions with embedded convective elements. Storm classification was valid only at the time of tornado formation; many storms were in the process of evolving from clusters or lines of cells to more solid convective lines. Little noticeable difference was found in storm type between those tornado with positive and tornadoes with zero or negative. Positive (negative) lead-time classified as cells, lines, tropical, and undefined were 48%, 34%, 8%, and 10% (57%, 31%, 9%, and 3%), respectively, of the total subset. FIG. 6. Box plots of all zero and negative s plotted as a function of the month of the year.

146 W E A T H E R A N D F O R E C A S T I N G VOLUME 24 FIG. 7. (a) A subsample of 110 tornado with positive classified by storm type and geographic region. (b) A subsample of 110 tornado with either zero or negative classified by storm type and geographic region. In summary, there was no statistical relationship found between storm type and tornado warning. The classified storms also were sorted by geographic region (Fig. 7). The southeast region was dominated by linear events whereas the plains and west regions were dominated by cell-based events. The midwest region had more lines than cells in the positive lead-time sample, but more cells than line events in the negative lead-time sample. Overall, there were no clear differences between those storm types with positive and negative s. A greater number of cell-based tornadic storms in the plains and west regions could partially explain the higher positive s in those regions. All tornado events classified by storm type were sorted by month (Fig. 8) to discern any impact on seasonal variations with tornado warning as discussed in section 3d. No clear relationship was evident between the fraction of negative lead-time and the dominant storm type. Quasi-linear systems were more prevalent during March and April and could be responsible for the higher negative s during those months. Tropical systems dominated the tornado statistics during September but, in general, were not responsible for many of the highest negative s observed during that month. f. Impact of population Spotter reports are a valuable tool used by forecasters in evaluating the development and severity of a storm and are a critical component to the decision-making process for tornado warning issuance. In general, it is assumed that the greater the population density of an area, the greater the chance that any tornadoes that develop will be reported to the WFO. If true, we can expect smaller negative lead-time within more densely populated areas. FIG. 8. A subsample of 220 of all of the warned tornado events classified by storm morphology sorted by month.

FEBRUARY 2009 B R O T Z G E A N D E R I C K S O N 147 FIG. 9. Box plots showing the mean and range of county population density (persons per square kilometer) plotted as a function of negative (min). To test this assumption, tornado with zero and negative s were plotted against the county population density in which the tornado began (Fig. 9). No statistical significance is found relating negative lead time and county population density. g. Impact of distance from radar As with county population density, no statistical relationship could be found between negative s and the distance of the tornadoes from radar (Fig. 10). However, the radar-to-tornado distance appears to play some role in at least a few events, as shown in Table 1. Many studies have shown a direct relationship between tornado reports and distance from radar (e.g., Ray et al. 2003). The current study has not focused on unwarned tornadoes, and it is possible that this type of study may show a much greater impact of radar coverage on warning performance. We also did not consider the impact of the elevation of the radar on tornado warning performance, which would be expected to have some influence in high-terrain regions. h. High-impact events Does the number of tornado issued in a day by a WFO impact the warning? Is the first tornado report of the day more difficult to warn in advance? Are certain geographic regions more prone to experiencing tornado outbreaks (multiple tornadoes within a WFO county warning area per day), and if so, how does this impact the tornado warning? To FIG. 10. Box plots showing the mean and range of tornado distance (km) from the nearest WSR-88D plotted as a function of negative (min). address these questions, the tornado warning data were parsed by the number of tornado per day, per hour, and the order of occurrence. All tornado warning data were separated by the number of confirmed tornado per day (Table 3). A total of 5170 confirmed tornado were issued during the 5 yr of study. Of these, 14.9% (772) of the were the only confirmed tornado issued by a WFO during that calendar day. Another 13.3% of were associated with two per day, 10.6% of were associated with three per day, and the remainder (61.2%) of was associated with days during which four or more confirmed tornado were issued by a single WFO during one calendar day. Interestingly, the ratio of with zero or negative decreases with increasing number of verified tornado per day; in other words, the more warned tornadoes per day, the smaller the ratio of zero or negative lead-time. As shown in Table 3, the percentage of with negative decreases from 21.6% of days with one confirmed warning to only 2.1% for days with 20 or more confirmed. In part because there are proportionally fewer zero and negative lead-time on high tornado warning days, the average tornado warning increases from 11.8 min with a single tornado warning per day to 161 min for tornadoes on days with four or more confirmed. In an effort to

148 W E A T H E R A N D F O R E C A S T I N G VOLUME 24 TABLE 3. Tornado warning statistics and s listed as a function of the number of confirmed tornado per day per WFO. Tornado per day (verified) Total No. of Warnings with positive Warnings with zero or negative Percent of with zero or negative Avg lead time (min) Avg of positive Avg of zero and negative lead-time 1 772 605 167 21.6 11.8 16.1 23.6 2 686 575 111 16.2 13.3 16.5 23.1 3 546 499 47 8.6 14.3 16.1 24.5 4 412 365 47 11.4 16.5 19.0 22.7 5 9 1339 1227 112 8.4 16.7 18.5 22.6 10 19 995 922 73 7.3 18.1 19.7 22.8 $20 420 411 9 2.1 19.3 19.8 25.1 minimize false alarms, operational forecasters are likely reluctant to issue that first tornado warning of the day until they are given sufficient evidence that an ongoing storm is capable of producing a tornado. The of with only positive also jumps; increases from ;16 min for days with one to three warned tornadoes to ;19 min for days with four or more confirmed tornado per day per WFO. One possible reason for this increase in positive with number of tornado per day is the issuance of downstream for ongoing tornadic storms. These continuance likely have a much greater warning, although this could not be verified with this particular dataset. Surprisingly, very little discussion of the impact of continuance on tornado warning lead-time statistics is found in the meteorological literature. A second possible reason for the increase in positive is that weather conditions that are able to produce multiple tornadoes per day within a WFO County Warning Area (CWA; or immediately downstream across neighboring NWS CWAs) are likely stronger and more organized and therefore easier to anticipate and detect than more marginally severe systems (e.g., Guillot et al. 2008). The impact of tornado order on warning was examined. Warning and lead-time statistics were calculated from all verified tornado issued by a WFO on days with four or more tornado (Table 4). The first confirmed tornado warning of the day has a high (19.5%) ratio of having a zero and negative. However, the ratio of zero and negative lead time remains relatively steady after and including the second tornado of the day. The average of positive lead-time increases gradually with tornado order from 16.4 min for the 1st tornado of the day to ;22 min for the 10th tornado of the day. The average of negative lead-time remains steady regardless of tornado occurrence order. As discussed previously, the first tornado of the day is the most difficult on which to warn, as evident by the high ratio of zero and negative. After the first tornado of the day, however, it is primarily the increased positive lead time that dominates the lead-time average. Tornadoes warned in succession are more likely to be on tornadoes already in progress, whereas the first tornado warning of the day is likely a warning based on the anticipation of what will occur. Bieringer and Ray (1996) also found a much lower warning for the first tornado events of the day. Could the number of tornadoes per day or tornado order have a diurnal impact on? As discussed in section 3c, a review of all warned tornadoes showed TABLE 4. Tornado warning statistics and as a function of the order of tornado occurrence for days with four or more confirmed tornado issued by a single WFO in one calendar day (0000 2359 LT). Order of tornado occurrence Total No. of Warnings with positive Warnings with zero or negative Percent of with zero or negative Avg lead time (min) Avg of positive lead-time Avg of zero and negative lead-time 1st 401 323 78 19.5 12.7 16.4 22.6 2nd 401 376 25 6.2 15.3 16.5 23.6 3rd 401 365 36 9.0 16.8 18.7 22.4 4th 401 379 22 5.5 17.7 18.9 23.3 5th 9th 975 928 47 4.8 18.5 19.6 22.7 10th 19th 452 423 29 6.4 20.6 22.2 22.5 $20th 135 123 4 3.0 20.7 21.6 25.5

FEBRUARY 2009 B R O T Z G E A N D E R I C K S O N 149 FIG. 11. Hourly deviation from the daily percentage of events with negative. Only those hours with 20 or more observations are plotted. Dataset includes (a) all data, (b) days with one tornado, (c) the first tornado from days with four or more tornadoes, and (d) all tornadoes after and including the fourth tornado of the day from days with four or more tornadoes. an above-average percentage of negative lead-time between 1300 and 1800 LT and below-average percentage between 1800 and 0200 LT (Fig. 11a). A review of all single tornado days showed a very similar pattern with an above-average percentage of negative issued between 1400 and 1700 LT with a below-average percentage of negative issued between 1700 and 2200 LT (Fig. 11b). However, a review of tornadoes from days with four or more tornadoes showed no discernable diurnal pattern (Figs. 11c and 11d). From these data, the diurnal pattern appears limited to weaker storm systems (i.e., those systems with less than four tornadoes per day). Furthermore, the diurnal pattern does not appear to be a function of day versus night. An above-average percentage of negative events is recorded prior to 1700 1800 LT, and a below-average percentage is recorded after this time. For weakly forced events, perhaps forecasters simply have a much lower expectation of tornadogenesis during the early afternoon than

150 W E A T H E R A N D F O R E C A S T I N G VOLUME 24 FIG. 12. (a) Monthly average of the number of confirmed tornado issued per tornado day. (b) Monthly average of the number of confirmed tornado issued per tornado day plotted as a function of the percentage of with zero or negative s. during the evening. Nevertheless, the exact cause of the diurnal pattern is unknown. The number of tornadoes associated with a given tornado day may be expected to change with season. The average number of tornado issued by a WFO per tornado day was calculated monthly (Fig. 12a). Typically, those months with more isolated, single tornado days (e.g., August) were found to have the highest proportion of zero and negative lead-time (Fig. 12b). Thus, much of the seasonal variability in the number of zero and negative lead-time can be directly attributed to the number of multitornado events per month. To determine the relationship between the number of tornadoes per day and geography, the number of confirmed tornado per day (with either positive or negative ) was calculated as a function of geographic region (Fig. 13). Over 60% of tornado days in the West region are single, isolated tornado events, followed by just over 50% of tornado days in the midwest region. Given that negative is more often associated with isolated, single-tornado events, we can expect these regions to have slightly lower average warning s when compared to other regions. A review of Table 2 shows that indeed the west and midwest regions have the lowest average s. Contrarily, the plains and southeast regions, which experience many more multiple-tornado events, have a much higher overall tornado warning. The average number of confirmed tornado per tornado day also was calculated for each NWS WFO. Then, each WFO average was plotted against the percentage of warned tornadoes with zero and negative s (Figs. 14a and 14b). An examination of zero FIG. 13. The percentage of confirmed tornado per day estimated and plotted as a function of geographic region.

FEBRUARY 2009 B R O T Z G E A N D E R I C K S O N 151 FIG. 14. Percentage of warned tornado events with (a) zero and (b) negative s plotted against the average number of confirmed tornado issued per WFO per tornado day. lead-time shows only a slight negative trend with the average number of confirmed per tornado day. However, a strong correlation exists between the percentage of negative lead-time and the average number of confirmed tornado per tornado day. In other words, those WFOs with the greatest number of multitornado events are likely to have a much lower ratio of negative lead-time tornado. Next, the tornado warning data were separated by the number of confirmed tornado per hour per WFO (Table 5). Statistics indicate that the ratio of tornado with zero or negative decreases with increasing numbers of tornado per hour. As a result, the average increases from 14.3 min for one tornado warning per hour to ;17 min for three or more tornado per hour. There appears to be a difference between one or two tornado per hour and three or more per hour; however, there is little difference in the statistics within each group (one to two versus three or more ). During the 5 yr of study, 16 tornado outbreaks of three or more tornadoes occurred in which a WFO issued three or more during a single weather event, each with either zero or negative (Table 6). A review of these cases points to several commonalities among these events. First, many of these tornadoes occurred in rapid succession, often times with two or more tornadoes occurring within the same hour and, sometimes, even simultaneously. Seven of the events had three or more tornadoes occur within 1 h and with zero or negative. Second, seven of the events were Tornado per hour (verified) TABLE 5. Tornado warning statistics and s listed as a function of the number of confirmed tornado per hour per WFO. Total No. of Warnings with positive Warnings with zero or negative Percent of with zero and negative Avg lead time (min) Avg of positive lead-time Avg of zero and negative lead-time 1 1852 1571 281 15.2 14.3 17.5 23.3 2 1258 1114 144 11.4 15.3 17.7 23.7 3 696 651 45 6.5 17.5 18.9 23.1 4 496 459 37 7.5 17.1 18.7 22.4 5 9 678 630 48 7.1 17.3 18.7 22.0 $10 190 179 11 5.8 17.0 18.3 24.4

152 W E A T H E R A N D F O R E C A S T I N G VOLUME 24 TABLE 6. List of all tornado outbreaks with three or more tornado all with zero or negative s issued from the same WFO. Date State Times of tornado events (LT) Total No. of warned tornadoes Day of week Storm type 18 May 2000 IL 1605, 1812, 1840 11 Thursday Line 11 Jul 2000 SD, IA 1756, 1759, 1936 5 Tuesday Line 1 Nov 2000 ND 1433, 1505, 1505, 1543 6 Wednesday Cells 16 Dec 2000 AL, FL 1034, 1108, 1324 7 Saturday Cells/Line 10 Apr 2001 KS 2235, 2238, 2324 7 Tuesday Line 11 Apr 2001 IA 1440, 1500, 1607 15 Wednesday Cells 30 Apr 2001 IA 1630, 1635, 1859 3 Monday Cells 24 Nov 2001 AL 1542, 1554, 1603 19 Saturday Line 11 May 2002 KS 1527, 1527, 1552 7 Saturday Cells 24 Aug 2002 WY 1322, 1349, 1617 3 Saturday Cells 8 Sep 2002 TX 206, 206, 302, 345 4 Sunday Tropical Storm 1 Jun 2003 CO, KS 1355, 1359, 1406, 1408 10 Sunday Cells 29 May 2004 NE 1521, 1633, 1633 12 Saturday Cells 6 Jun 2004 ND 1817, 1858,1956, 2032 7 Sunday Cells 15 Sep 2004 GA, FL 1537, 1855, 2007 18 Wednesday Hurricane 4 Oct 2004 CO 1555, 1602, 1613, 1640 11 Monday Cells associated with outbreaks where the WFO had to issue 10 or more tornado within a short period of time. Under such conditions, even the best WFO operations could become overwhelmed. Third, half of the events occurred on the weekend, almost twice the number expected by chance. Subtle differences in office management and staffing at the WFO could have a considerable effect during high-impact outbreak situations (Waldstreicher 2005). 4. Relationship between negative and fatalities Overall, tornadoes with zero or negative lead-time account for 10.9% of all tornado and are associated with 8.5% of all tornado fatalities. During the 5 yr of study, there were 12 fatal tornadoes with zero or negative lead-time warning with a total of 17 fatalities. A review of these events (Table 7) reflects several difficulties in the warning process. First, three-fourths of the events took place either late at night and/or on the weekend, when the public was least likely to hear and act upon a warning. Second, some storm types remain challenging, especially tornadoes spawned from hurricanes; in this case, such storms were responsible for 5 of the 17 deaths. The undefined case in Texas also posed a challenge, with two isolated tornadoes occurring in an otherwise mostly benign, heavy rain event. No initial advance warning was given, despite the short distance from radar in a heavily populated region. Date Deaths Local time TABLE 7. List of all fatal tornadoes with zero or negative lead-time. Day of week F scale State Lead time (min) Storm type Distance to WSR-88D (km)* County population density (persons per square kilometer) 16 Dec 2000 1 1034 Saturday F2 AL 0 Cell 50.3 15.8 15 Mar 2001 1 0330 Thursday F2 FL 27 Line 72.3 11.3 11 Apr 2001 2 1600 Wednesday F2 IA 25 Cell 140.0 31.9 21 Apr 2001 1 2115 Saturday F4 KS 27 Cell 132.7 12.7 21 Apr 2002 1 1551 Sunday F3 IL 210 Cell 142.7 9.3 28 Apr 2002 1 1856 Sunday F4 MD 26 Cell 53.7 84.7 28 Apr 2002 1 0308 Sunday F2 KY 29 Line 57.8 11.0 24 Oct 2002 1 1419 Thursday F2 TX 0 Undef. 11.9 134.5 10 Nov 2002 1 1954 Sunday F2 PA 22 Line 82.6 69.5 20 Mar 2003 2 0525 Thursday F2 GA 25 Line 111.4 13.4 15 Sep 2004 4 2107 Wednesday F2 FL 21 Hurr. 70.1 7.5 16 Sep 2004 1 1745 Thursday F2 GA 0 Hurr. 116.5 24.4 * Center of the beam at an elevation angle of 0.58 at a distance of 120 km is 1.98 km AGL (information online at http://www.wdtb. noaa.gov/tools/misc/beamwidth/index.htm).

FEBRUARY 2009 B R O T Z G E A N D E R I C K S O N 153 5. Conclusions A comprehensive review of NWS tornado warning statistics from 2000 to 2004 examined in detail those with zero or negative. Zero and negative lead-time were sorted by F-scale rating, geography, WFO, time of day, month, storm type, county population density, distance from radar, and tornado order during multiple tornado events. Our results are summarized as follows: d d d d Providing advance warning for the first tornado of the day remains a difficult challenge. Diurnal trends show that the hours during the early afternoon, primarily during the time when the first tornadic storms are developing, have the highest ratio of negative leadtime (Fig. 4). Statistics indicate the first tornado of the day has 3 times the proportion of zero or negative lead-time than does the second tornado of the day for days with four or more tornado within a WFO county warning area (Table 4). In addition, likely due to the inclusion of continuance, the national average of positive lead-time increases with each successive tornado warning per day. In general, the more isolated the tornado event, the less is the likelihood that an advance warning is provided. Isolated, single tornado per day events have 10 times the ratio of zero and negative lead-time than do days with 20 or more tornadoes (Table 3). Average increases from 11.8 min for singletornado warning days to 19.3 min for days with 20 or more confirmed tornado within a given WFO county warning area. Monthly and geographic trends in are directly impacted by the number of multiple tornado events. Because s are skewed by continuance, those months during which tornado outbreaks are most common (e.g., May) have a much lower proportion of zero and negative lead-time (Figs. 5a and 12). Geographic regions, such as the plains and southeast, where multiple-tornado events are more common, are observed to have greater average warning s (Table 2, Fig. 13). WFOs that experience many large-scale outbreaks have a lower proportion of with negative than WFOs that experience many more isolated, one- or two-tornado warning days (Fig. 14). During a tornado outbreak several tornadoes can be on going simultaneously, leading to a stressful situation for NWS operations (Andra et al. 2002). However, on average these situations do not negatively impact tornado warning s nor do they d lead to an increase in the ratio of zero or negative lead-time events (Table 5), with some notable exceptions (Table 6). Staffing shortages may arise during some unanticipated tornado outbreak situations. A clear impact of storm morphology on tornado warning s was difficult to discern from this 5- yr dataset. No direct relationship was found between storm type and the ratio of zero or negative lead-time (Fig. 7), and no statistical relationship could be found between storm type and tornado warning. It is possible that the higher proportion of linear and tropical systems in the midwest and southeast regions could be negatively impacting positive tornado warning s (Fig. 7, Table 2). Some isolated cases (Fig. 1, Tables 6 and 7) were shown to pose some unique challenges for the forecaster, particularly from tropical systems and lessorganized convection. Gallus et al. (2008) show a relationship between storm morphology and the type of severe weather produced. Other studies have shown some impact of storm type on tornado warning. Trapp et al. (1999) found tornadoes resulting from nondescending vortices, often associated with quasi-linear convective systems, were associated with shorter warning s. Guillot et al. (2008) found higher tornado warning s for isolated supercells and strong convective lines but less lead time for weaker, less-organized systems. However, stronger systems are more likely to produce multipletornado events; in this case, tornado warning lead times for strong events may be artificially enhanced by including more continuance. The National Weather Service vision for 2025 is to provide tornado warning s of 45 min or greater (J. Hayes 2007, personal communication). The conclusions from this paper identify those situations and times that are most vulnerable to failure in the current tornado warning process. If we are to continue to improve tornado warning s, special attention should be given to two specific areas: (i) warning on the first tornado of the day (or rather, first tornado from a given storm complex) and (ii) warning on nontypical (weak and/or isolated) severe storms. Simply raising awareness of these gaps in the warning process is a critical first step in improving tornado warning operations. Similar work is needed to examine the causes of no-warn events and false alarms. One short-term solution for improving our understanding of the tornado warning process is to create a detailed metadata archive to accompany all NWS tornado. Such information should include items such as why each tornado warning was issued, on what

154 W E A T H E R A N D F O R E C A S T I N G VOLUME 24 criteria the warning was based, and whether or not the warning was a continuance warning of a tornado already in progress. Such details could yield long-term dividends in understanding and improving tornado warning statistics. The long-term solution to improving tornado warning s will ultimately depend upon our ability to provide warn on forecast. As shown in this manuscript, our inability to predict the first tornado of the day greatly limits our overall tornado. The use of additional observing tools along with improved conceptual models, statistical nowcasting techniques, datamining algorithms, or some blending with numerical weather prediction models will likely be needed. Finally, it is noteworthy that despite the delay in issuance of the tornado discussed in this manuscript, over 80% of these zero and negative lead-time still provided valuable positive s for those downstream in the path of the ongoing storm. Of these, the tornado remained on the ground on average for another 7 min, providing critical life-saving information to the general public. Acknowledgments. We thank Brent Macaloney at NWS Headquarters for supplying us with the tornado record data used in this study, and Harold Brooks, Rodger Brown, Michael Richman, Liz Quoetone, and three anonymous reviewers for excellent suggestions to improve this manuscript. Thanks to James Hocker for his GIS expertise. This work is supported by the Engineering Research Centers Program of the National Science Foundation under NSF Award 0313747. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the authors and do not necessarily reflect those of the National Science Foundation. REFERENCES Andra, D. L., E. M. Quoetone, and W. F. Bunting, 2002: Warning decision making: The relative roles of conceptual models, technology, strategy, and forecaster expertise in 3 May 1999. Wea. Forecasting, 17, 559 566. Bieringer, P., and P. S. Ray, 1996: A comparison of tornado warning s with and without NEXRAD Doppler radar. Wea. Forecasting, 11, 47 52. Crum, T. D., and R. L. Alberty, 1993: The WSR-88D and the WSR-88D Operational Support Facility. Bull. Amer. Meteor. Soc., 74, 1669 1687. Erickson, S., and H. Brooks, 2006: Lead time and time under tornado : 1986 2004. Preprints, 23rd Conf. on Severe Local Storms, Atlanta, GA, Amer. Meteor. Soc., 11.5. [Available online at http://ams.confex.com/ams/23sls/techprogram/ paper_115194.htm.] Friday, E. W., Jr., 1994: The modernization and associated restructuring of the National Weather Service: An overview. Bull. Amer. Meteor. Soc., 75, 43 52. Gallus, W. A., Jr., N. Snook, and E. V. Johnson, 2008: Spring and summer severe weather reports over the Midwest as a function of convective mode: A preliminary study. Wea. Forecasting, 23, 101 113. Guillot, E., V. Lakshmanan, T. Smith, G. Stumpf, D. Burgess, and K. Elmore, 2008: Tornado and severe thunderstorm warning forecast skill and its relationship to storm type. Preprints, 24th Int. Conf. on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology, New Orleans, LA, Amer. Meteor. Soc., 4A.3. [Available online at http://ams.confex.com/ams/pdfpapers/ 132244.pdf.] Magsig, M. A., T. Decker, and N. M. Said, 2006: Builds five and six of NOAA s NWS weather event simulator. Preprints, 22nd Int. Conf. on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology, Atlanta, GA, Amer. Meteor. Soc., P7.7. [Available online at http://ams. confex.com/ams/pdfpapers/104624.pdf.] Mitchell,E.D.,S.V.Vasiloff,G.J.Stumpf,A.Witt,M.P.Eilts, J. T. Johnson, and K. W. Thomas, 1998: TheNational Severe Storms Laboratory tornado detection algorithm. Wea. Forecasting, 13, 352 366. NWS, cited 2007: NOAA s NWS national performance measures FY 2006 FY National Weather Service. [Available online at http://www.nws.noaa.gov/com/files/all_gpra2006.ppt.] Parker, S. S., and H. Waldron, 2002: Dramatically improving warning services One office s experience. Preprints, 21st Conf. on Severe Local Storms, San Antonio, TX, Amer. Meteor. Soc., P9.5. [Available online at http://ams.confex.com/ ams/pdfpapers/46785.pdf.] Rasmussen, E. N., J. Straka, R. Davies-Jones, C. Doswell III, F. Carr, M. Eilts, and D. MacGorman, 1994: The Verification of the Origins of Rotation in Tornadoes Experiment: VOR- TEX. Bull. Amer. Meteor. Soc., 75, 997 1006. Ray, P., P. Bieringer, X. Niu, and B. Whissel, 2003: An improved estimate of tornado occurrence. Mon. Wea. Rev., 131, 1026 1031. Seguin, W., 2002: AWIPS An end-to-end look. Preprints, Interactive Symp. on the Advanced Weather Interactive Processing System (AWIPS), Orlando, FL, Amer. Meteor. Soc., 147 150. Simmons, K. M., and D. Sutter, 2005: WSR-88D radar, tornado, and tornado casualties. Wea. Forecasting, 20, 301 310. Stumpf, G. J., A. Witt, E. D. Mitchell, P. L. Spenser, J. T. Johnson, M. D. Eilts, K. W. Thomas, and D. W. Burgess, 1998: The National Severe Storms Laboratory mesocyclone detection algorithm for the WSR-88D. Wea. Forecasting, 13, 304 326. Trapp, R. J., E. D. Mitchell, G. A. Tipton, D. W. Effertz, A. I. Watson, D. L. Andra, and M. A. Magsig, 1999: Descending and nondescending tornadic vortex signatures detected by WSR-88Ds. Wea. Forecasting, 14, 625 639. Waldstreicher, J. S., 2005: Assessing the impact of collaborative research projects on NWS warning performance. Bull. Amer. Meteor. Soc., 86, 193 203. Wolf, P. L., 2002: Toward better warning decision-making and verification statistics: Improvements at the Wichita National Weather Service office. Preprints, 21st Conf. on Severe Local Storms, San Antonio, TX, Amer. Meteor. Soc., 10B.4. [Available online at http://ams.confex.com/ams/sls_waf_nwp/ techprogram/paper_46960.htm.]