Credibility of climate predictions revisited

Similar documents
Assessment of the reliability of climate predictions based on comparisons with historical time series

Confronting Climate Change in the Great Lakes Region. Technical Appendix Climate Change Projections CLIMATE MODELS

Comparison of climate time series produced by General Circulation Models and by observed data on a global scale

Climate Change Scenarios Dr. Elaine Barrow Canadian Climate Impacts Scenarios (CCIS) Project

Risks from dismissing stationarity

Long-term properties of annual maximum daily rainfall worldwide

Mozambique. General Climate. UNDP Climate Change Country Profiles. C. McSweeney 1, M. New 1,2 and G. Lizcano 1

Malawi. General Climate. UNDP Climate Change Country Profiles. C. McSweeney 1, M. New 1,2 and G. Lizcano 1

Multi-model approach for projecting future climate change conditions in Central Vietnam

Annex I to Target Area Assessments

Downscaling ability of the HadRM3P model over North America

Southern New England s Changing Climate. Raymond S. Bradley and Liang Ning Northeast Climate Science Center University of Massachusetts, Amherst

Spatial and temporal variability of wind speed and energy over Greece

A Study of the Uncertainty in Future Caribbean Climate Using the PRECIS Regional Climate Model

Climate change and variability -

Regional Climate Simulations with WRF Model

CLIMATE CHANGE IMPACTS ON HYDROMETEOROLOGICAL VARIABLES AT LAKE KARLA WATERSHED

Long term properties of monthly atmospheric pressure fields

Modelling changes in the runoff regime in Slovakia using high resolution climate scenarios

The role of teleconnections in extreme (high and low) precipitation events: The case of the Mediterranean region

FUTURE PROJECTIONS OF PRECIPITATION CHARACTERISTICS IN ASIA

Training: Climate Change Scenarios for PEI. Training Session April Neil Comer Research Climatologist

Climatic change certainty versus climatic uncertainty and inferences in hydrological studies and water resources management

Climatic change certainty versus climatic uncertainty and inferences in hydrological studies and water resources management

SUPPLEMENTARY INFORMATION

SUPPLEMENTARY INFORMATION

Application and verification of ECMWF products 2013

CLIMATE SCENARIOS FOR ALBERTA

technological change and economic growth more fragmented; slower, higher population growth middle emissions path

Does the model regional bias affect the projected regional climate change? An analysis of global model projections

Projections of future climate change

Probabilistic assessment of regional climate change: a Bayesian approach to combining. predictions from multi-model ensembles

Climate change and variability -

Zambia. General Climate. Recent Climate Trends. UNDP Climate Change Country Profiles. Temperature. C. McSweeney 1, M. New 1,2 and G.

How reliable are selected methods of projections of future thermal conditions? A case from Poland

Climate change and changing monsoon patterns

Suriname. General Climate. Recent Climate Trends. UNDP Climate Change Country Profiles. Temperature. C. McSweeney 1, M. New 1,2 and G.

What is the IPCC? Intergovernmental Panel on Climate Change

SEASONAL AND ANNUAL TRENDS OF AUSTRALIAN MINIMUM/MAXIMUM DAILY TEMPERATURES DURING

St Lucia. General Climate. Recent Climate Trends. UNDP Climate Change Country Profiles. Temperature. Precipitation

Enabling Climate Information Services for Europe

Challenges for Climate Science in the Arctic. Ralf Döscher Rossby Centre, SMHI, Sweden

Manfred A. Lange Energy, Environment and Water Research Center The Cyprus Institute. M. A. Lange 11/26/2008 1

Grenada. General Climate. Recent Climate Trends. UNDP Climate Change Country Profiles. Temperature. Precipitation

CHAPTER 1: INTRODUCTION

Antigua and Barbuda. General Climate. Recent Climate Trends. UNDP Climate Change Country Profiles. Temperature

Cuba. General Climate. Recent Climate Trends. UNDP Climate Change Country Profiles. Temperature. C. McSweeney 1, M. New 1,2 and G.

The Climatology of Clouds using surface observations. S.G. Warren and C.J. Hahn Encyclopedia of Atmospheric Sciences.

Sensitivity to the composition of the feature vector and passive simulations

Faisal S. Syed, Shahbaz M.,Nadia R.,Siraj I. K., M. Adnan Abid, M. Ashfaq, F. Giorgi, J. Pal, X. Bi

Julie A. Winkler. Raymond W. Arritt. Sara C. Pryor. Michigan State University. Iowa State University. Indiana University

UNST 232 Mentor Section Assignment 5 Historical Climate Data

A climate change index: Where climate change may be most prominent in the 21st century

REGIONAL SIMULATION WITH THE PRECIS MODEL

Cape Verde. General Climate. Recent Climate. UNDP Climate Change Country Profiles. Temperature. Precipitation

Development of Pakistan s New Area Weighted Rainfall Using Thiessen Polygon Method

Climate Change in Victoria

INVESTIGATING THE SIMULATIONS OF HYDROLOGICAL and ENERGY CYCLES OF IPCC GCMS OVER THE CONGO AND UPPER BLUE NILE BASINS

Development of Super High Resolution Global and Regional Climate Models

Reduced Overdispersion in Stochastic Weather Generators for Statistical Downscaling of Seasonal Forecasts and Climate Change Scenarios

The ENSEMBLES Project

An Initial Estimate of the Uncertainty in UK Predicted Climate Change Resulting from RCM Formulation

The Art and Role of Climate Modeling

Impacts of Climate Change on Autumn North Atlantic Wave Climate

STUDY OF FUTURE CLIMATIC VARIATIONS OF A TELECONNECTION PATTERN AFFECTING EASTERN MEDITERRANEAN

Climate Change 2007: The Physical Science Basis

100 ANALYSIS OF PRECIPITATION-RELATED CLIMATE INDICES PROJECTED FOR CENTRAL/EASTERN EUROPE USING BIAS-CORRECTED ENSEMBLES SIMULATIONS

Chapter outline. Reference 12/13/2016

The impact of climate change on wind energy resources

Tropical Cyclones - Ocean feedbacks: Effects on the Ocean Heat Transport as simulated by a High Resolution Coupled General Circulation Model

Attribution of anthropogenic influence on seasonal sea level pressure

Changes in Frequency of Extreme Wind Events in the Arctic

Impact of climate change on freshwater resources in the Changjiang river basin

Will a warmer world change Queensland s rainfall?

Time-slice experiments

Supplementary Material: Characterizing Changes in Drought Risk for the United States from Climate Change [1] October 12, 2010

Climate Risk Profile for Samoa

Uncertainties in multi-model climate projections

The Implication of Ural Blocking on the East Asian Winter Climate in CMIP5 Models

SUPPLEMENTARY INFORMATION

Riscuri şi Catastrofe

CURRICULUM COURSE OUTLINE

Uncertainties in extreme surge level estimates from observational records

Why build a climate model

No pause in the increase of hot temperature extremes

[1] Emissions of CO 2 and other GHGs are increasing

Application and verification of ECMWF products 2010

Appendix E. OURANOS Climate Change Summary Report

The CLIMGEN Model. More details can be found at and in Mitchell et al. (2004).

The 20th century warming and projections for the 21st century climate in the region of the Ukrainian Antarctic station Akademik Vernadsky

CGE TRAINING MATERIALS ON VULNERABILITY AND ADAPTATION ASSESSMENT. Climate change scenarios

4.3.2 Configuration. 4.3 Ensemble Prediction System Introduction

Climate Outlook for December 2015 May 2016

Potential of Equatorial Atlantic Variability to Enhance El Niño Prediction

Future Climate Projection in Mainland Southeast Asia: Climate change scenario for 21 st century. Suppakorn Chinvanno

An OLR perspective on El Niño and La Niña impacts on seasonal weather anomalies

Northern Rockies Adaptation Partnership: Climate Projections

The Analysis of Uncertainty of Climate Change by Means of SDSM Model Case Study: Kermanshah

Evidence for Weakening of Indian Summer Monsoon and SA CORDEX Results from RegCM

THE RELATION AMONG SEA ICE, SURFACE TEMPERATURE, AND ATMOSPHERIC CIRCULATION IN SIMULATIONS OF FUTURE CLIMATE

Transcription:

European Geosciences Union General Assembly 29 Vienna, Austria, 19 24 April 29 Session CL54/NP4.5 Climate time series analysis: Novel tools and their application Credibility of climate predictions revisited G. G. Anagnostopoulos, D. Koutsoyiannis, A. Efstratiadis, A. Christofides, and N. Mamassis Department of Water Resources and Environmental Engineering National Technical University of Athens (www.itia.ntua.gr)

1. Abstract Predictions of future climate, obtained through climate models, are widely used in many scientific disciplines, and form the basis of important economic and social policies, but their reliability is rarely assessed. In a recent paper *, the credibility of six climate models was assessed, based on comparisons with long (1 years or more) historical series of temperature and precipitation, obtained from 8 stations around the globe. The study showed that models perform poorly (worse than elementary predictions based on the time average), even at a climatic (3 year) scale, while none of the examined models proved to be systematically better than any other. Extending this research **, we test the performance of climate models at over 5 additional stations. Furthermore, we make comparisons at a large subcontinental spatial scale after integrating modelled and observed series from 7 stations in the contiguous USA. * Koutsoyiannis, D., Efstratiadis, A., Mamassis N. & Christofides, A. (28) On the credibility of climate predictions. Hydrol. Sci. J., 53(4), 671 684 (www.itia.ntua.gr/en/docinfo/864/). ** See details in Anagnostopoulos, G. (29) Assessment of the reliability of climate models, Diploma thesis (supervised by D. Koutsoyiannis; in Greek), Department of Water Resources and Environmental Engineering National Technical University of Athens, Athens (www.itia.ntua.gr/en/docinfo/893/).

2. Related questions General questions Is climate deterministically predictable? Do global circulation models (GCMs) produce credible predictions of future climate for horizons of 5, 1 or even more years? Can such predictions serve as a basis to support decisions for important economic and social policies? Can the continental or global climatic projections be credible if the distributed information, from which the aggregated information is derived, is not? Are geographically distributed GCM predictions credible enough in order to be used in further studies at regional scales, e.g. to assess the freshwater future availability? Specific questions addressed in this paper How well do current GCMs reproduce past climate (temperature and precipitation) at a local scale? Does integration of local predictions at a sub continental scale improve the GCM performance in terms of reproducing past climate?

3. Methodological framework 1. Selection of historical time series: We selected monthly temperature and precipitation records from 55 stations worldwide (for point analysis) and 7 stations across the contiguous USA (for sub continental analysis), according to the following criteria: (1) even geographical distribution of stations, (2) availability of data on the Internet, and (3) sample size at least 1 years, without (or with few) missing data. 2. Selection of modelled time series: We picked three TAR and three AR4 models and one simulation run for each model; the criterion for selecting the latter was to cover past periods rather than merely referring to future. 3. Spatial adaptation of historical and modelled series: For the point analysis, we extracted the monthly time series for the four grid points closest to each of the examined stations through an optimization approach, while for the subcontinental analysis we spatially integrated both the historical and the modelled series, using appropriate weighting techniques. 4. Assessment of credibility of modelled time series: To evaluate the performance of the GCM series against the observed ones, we made both graphical and numerical comparisons. For the latter, we used two typical statistical fitting criteria (correlation coefficient and efficiency) and also compared various statistical metrics of the two series (e.g. standard deviation, extremes, Hurst coefficient), using four time scales, i.e. monthly, seasonal, annual and climatic; the latter was assumed to be the 3 year centred moving average.

4. IPCC models and simulation runs (TAR & AR4) IPCC model outputs: Three TAR and three AR4 general circulation models have been selected. Simulation runs: For the TAR models we used the SRES IS92a scenario, most runs of which are based on historical GCM input data prior to 1989 and extended using scenarios for 199 and beyond. For such runs, the choice of scenario is irrelevant for test periods up to 1989, while for later periods, there is no significant difference between different scenarios for the same model. For the AR4 models we used the 2C3M scenario (the only relevant with this study), generated from the outputs of late 19 th and 2 th century simulations from coupled ocean atmosphere models, to help assess past climate change. Main characteristics of the GCMs used in the study (identical to Koutsoyiannis et al., 28). IPCC report Name Developed by Resolution ( o ) in latitude and longitude TAR ECHAM4/OPYC3 Max-Planck-Institute for Meteorology & Deutsches Grid points, latitudes longitudes 2.8 2.8 64 128 Klimarechenzentrum, Hamburg, Germany TAR CGCM2 Canadian Centre for Climate Modeling and Analysis 3.7 3.7 48 96 TAR HADCM3 Hadley Centre for Climate Prediction and Research 2.5 3.7 73 96 AR4 CGCM3-T47 Canadian Centre for Climate (as above) 3.7 3.7 48 96 AR4 ECHAM5-OM Max-Planck-Institute (as above) 1.9 1.9 96 192 AR4 PCM National Centre for Atmospheric Research, USA 2.8 2.8 64 128

5. Meteorological stations for point analysis Temperature time series Stations Min. z (m) Max. z (m) Europe 18 15 569 N. America 12 6 184 S. America 5 14 924 Asia 12 4 757 Africa 4 37 125 Australia 4 4 275 Total 55 4 125 time series Stations Min. z (m) Max. z (m) Europe 15 15 657 N. America 9 1 89 S. America 1 37 248 Asia 9 6 177 Africa 8 4 2556 Australia 4 4 432 Total 55 1 2556 Data source: http://climexp.knmi.nl/

6. Spatial adaptation of GCM series for point comparison To compare the climate model predictions with the observed time series, we interpolated GCM gridded outputs to the point of interest, using the four grid points nearest to each study location (the specific grid depends on the model). The generation of modelled time series for each location was based on the best linear unbiased estimation technique (BLUE), by optimizing the weighting coefficients λ 1, λ 2, λ 3, λ 4 in a linear relationship x = λ 1 x 1 + λ 2 x 2 + λ 3 x 3 +λ 4 x 4 (with λ 1 + λ 2 + λ 3 + λ 4 = 1), where x is the best linear estimate of the monthly historical value x (i.e. x x is the prediction error), and x 1, x 2, x 3, x 4 are the climate model outputs for the four closest grid points. Optimization was implemented by maximizing the coefficient of efficiency, computed as Eff = 1 e 2 /σ 2, where e 2 is the mean square error in prediction and σ 2 is the variance of the historical series. In that manner, we let the modelled time series fit the historical monthly ones as closely as possible. For physical consistency, we assumed non negative values of the weights λ 1, λ 2, λ 3, λ 4.

7. Graphical comparisons and characteristic examples The majority of models (both TAR and AR4) are totally irrelevant to the observed temperature and precipitation time series, and they fail to predict the historical fluctuations at the annual and climatic time scale. One of the worst model performances is observed in Durban (left panel). One of the best model performances is observed in De Bilt (right panel) if the modified ( homogenized ) time series is used in the comparison (the original observed time series, also shown in figure, is very different both from models and the modified series). Annual Mean Temperature (oc) Observed CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M 22.5 22. 21.5 21. 2.5 2. 19.5 19. Modelled trend Historical fluctuation 185 187 189 191 193 195 197 199 21 Plots of observed and modelled annual (doted lines) and 3 year moving average (continuous lines) temperature time series at Durban, South Africa (left) and De Bilt, Netherlands (right). Annual Mean Temperature (oc) Observed (unmodified) Observed (modified) CGCM2-A2 HADCM3-A2 12. 11. 1. 9. 8. 7. 185 187 189 191 193 195 197 199 21

8. Synoptic statistical comparisons at annual and climatic time scales Average values for all models and locations Annual time scale Temperature Correlation Efficiency Annual mean.12 5.2 Maximum monthly.6 5.3 Minimum monthly.3 3.7 Annual amplitude.1 4.1 Seasonal mean (DJF).5 3.9 Seasonal mean (JJA).7 7.5 Climatic time scale Temperature Correlation Efficiency Annual mean.33 89. Maximum monthly.21 118.5 Minimum monthly.18 117.4 Annual amplitude.3 17.4 Seasonal mean (DJF).24 92. Seasonal mean (JJA).21 18.4 Correlation Efficiency Correlation Efficiency Annual mean. 3. Maximum monthly.1 1.3 Minimum monthly. 167.4 Seasonal mean (DJF). 3.8 Seasonal mean (JJA). 12.2 Annual mean.2 125.9 Maximum monthly.2 51.4 Minimum monthly.1 5456.7 Seasonal mean (DJF).5 28. Seasonal mean (JJA).4 164.1

9. Comparison of variability metrics for temperature Hurst Coef of Modeled Temperature Series (Annual Mean Temperature) CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M CGCM2-A2 HADCM3-A2 1..9.8.7.6.5.4.4.5.6.7.8.9 1. Hurst Coef Of Observed Temperature Series St Dev of Modeled Temperature Series (Annual Mean Temperature) CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M CGCM2-A2 HADCM3-A2 2. 1.8 1.6 1.4 1.2 1..8.6.4.2.2.4.6.8 1. 1.2 1.4 1.6 1.8 2. St Dev Of Observed Temperature Series Scatter plots of Hurst coefficient (left) and standard deviation (right) of observed vs. modelled mean annual temperature (underestimation in 74% of cases for Hurst and 7% for standard deviation). Hurst Coef of Modeled Temperature Series (Annual Temp Amplitude) 1..9.8.7.6.5.4.3.3.4.5.6.7.8.9 1. Hurst Coef Of Observed Temperature Series St Dev of Modeled Temperature Series (Annual Temp Amplitude ) 5.5 5. 4.5 4. 3.5 3. 2.5 2. 1.5 1..5...5 1. 1.5 2. 2.5 3. 3.5 4. 4.5 5. 5.5 St Dev Of Observed Temperature Series Scatter plots of Hurst coefficient (left) and standard deviation (right) of observed vs. modelled annual temperature amplitude (underestimation in 69% of cases for Hurst and 68% for standard deviation).

1. Comparison of variability metrics for precipitation Hurst Coef of Modeled Series (Annual ) CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M CGCM2-A2 HADCM3-A2 1..9.8.7.6.5.4.3.2.1.1.2.3.4.5.6.7.8.9 1. Hurst Coef Of Observed Series St Dev of Modeled Series (Annual ) CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M CGCM2-A2 HADCM3-A2 6 5 4 3 2 1 1 2 3 4 5 6 St Dev Of Observed Series Scatter plots of Hurst coefficient (left) and standard deviation (right) of observed vs. modelled annual precipitation (underestimation in 79% of cases for Hurst and 89% for standard deviation). Hurst Coef of Modeled Series (Max Monthly ).9.8.7.6.5.4.3.2.2.3.4.5.6.7.8.9 Hurst Coef Of Observed Series St Dev of Modeled Series (Max Monthly ) 15 125 1 75 5 25 25 5 75 1 125 15 St Dev Of Observed Series Scatter plots of Hurst coefficient (left) and standard deviation (right) of observed vs. modelled maximum monthly precipitation (underestimation in 67% of cases for Hurst and 95% for standard deviation).

11. Do models reproduce the observed climate changes? DT (19-2) of modelled series (Annual Mean Temperature) CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M CGCM2-A2 2.5 2. 1.5 1..5. -.5-1. -1.5-1.5 -.5.5 1.5 2.5 DT (19-2) of observed temperature series Max. fluctuation of modelled series (Annual Mean Temperature) CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M CGCM2-A2 HADCM3-A2 3.5 3. 2.5 2. 1.5 1..5. -.5-1. -1.5-1.5 -.5.5 1.5 2.5 3.5 Max. fluctuation of observed temperature series Scatter plots of overyear difference (left) and maximum fluctuation (right) during the 2th century of observed vs. modelled 3 year moving average temperature series. DP (19-2) of modelled series (Annual Precipitaion) 5-5 -1-1 -5 5 Max. fluctuation of observed precipitation series Max. fluctuation of modelled series (Annual Precipitaion) 5-5 -1-1 -5 5 Max. fluctuation of observed precipitation series Scatter plots of overyear difference (left) and maximum fluctuation (right) during the 2th century of observed vs. modelled 3 year moving average precipitation series.

12. General observations on point analysis All examined long historical records exhibit large over year variability (i.e. long term fluctuations), with no systematic signatures across the different locations/climates. At the monthly scale, although significant bias may be present, GCMs generally reproduce the broad climatic behaviours at the different locations and the sequence of wet/dry or warm/cold periods. This is expected, since models represent the seasonal variations of climatic variables, and also account for key factors such as latitude (see figure) and proximity to the sea. Yet, the performance of GCMs remains poor, regarding all statistical indicators at the seasonal, annual and climatic time scales; in most cases the observed variability metrics (standard deviation and Hurst coefficient), extremes (annual minima and maxima) and long term fluctuations during the 2 th century are underestimated. St Dev (Temperature) St Dev () 1.8 1.6 1.4 1.2 1..8.6.4.2. 4 35 3 25 2 15 1 5 Obserbed CGCM2-A2 1 2 3 4 5 6 7 Obserbed CGCM2-A2 1 2 3 4 5 6 7 Latitude Standard deviation of the annual mean temperature (up) and annual precipitation (low) with respect to the latitude for the observed time series and the CGCM A2 series (northern hemisphere stations).

13. Sub continental analysis: stations across USA and spatial computations Collection of monthly temperature and precipitation records, from 7 stations distributed across the contiguous USA (obtained from http://climexp.knmi.nl/). Older stations: Amherst and Detroit (continuous operation from 1836). Elevations: minimum +4 m (Fort Myers); maximum +213 m (Austin). Mapping of stations, construction of Thiessen (Voronoi) polygons and computation of the distribution area A i for each station i, using GIS. Estimation of weighting coefficients w i = A i / A i for all stations i = 1,, 7. Areal integration by weighted average of point temperature and precipitation series.

14. Spatial integration and adjustment of observed series The Thiessen integrated temperature series is adjusted for elevation by estimating (via linear regression of mean annual temperature against elevation) a temperature gradient of θ =.38 C/m and using the mean elevation of the contiguous USA, H = 745 m, and the weighted average of station elevations, H m = 67 m. A similar correction was impossible for precipitation, since no correlation between precipitation and elevation was found. The areal estimations for temperature are very close to those of NOAA. slightly differs (by 4 mm). Annual Mean Temperature (oc) 13. 12.5 12. 11.5 11. 1.5 1. Annual -Thiessen (mm) Thiessen NOAA 189 191 193 195 197 199 21 9 85 8 75 7 65 6 55 Thiessen NOAA 189 191 193 195 197 199 21 Comparison between areal time series of NOAA (http://www.ncdc.noaa.gov/ /oa/climate /research/cag3/cag3.html) and the areal time series derived by the Thiessen method (and adjusted for elevation for T). 94 89 84 79 74 69 64 59 Annual - NOAA (mm)

15. Spatial integration of GCM outputs and comparison with observed series The weights w i were estimated on the basis of the influence area of each grid point i. The influence area of each grid point is a rectangle whose vertical (perpendicular to the equator) side is proportional to (φ 2 φ 1 )/2 and its horizontal side is proportional to cosφ, where φ is the latitude of each grid point, and φ 2 and φ 1 are the latitudes of the adjacent horizontal grid lines. The resulting weighting coefficient is: w i = (φ i2 φ i1 ) cosφ i Annual Mean Temperature (oc) Observed CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M 16. 15. 14. 13. 12. 11. 1. 185 187 189 191 193 195 197 199 21 Annual (mm) Observed CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M 12 11 1 9 8 7 6 5 185 187 189 191 193 195 197 199 21 Observed and modelled areal temperature and precipitation, on annual and climatic scales.

16. Reproduction of seasonal characteristics and extremes Max Monthly Temperature (oc) Observed CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M 26. 25. 24. 23. 22. 21. 2. 185 187 189 191 193 195 197 199 21 Seasonal DJF(mm) Observed CGCM3-2C3M-T47 PCM-2C3M ECHAM5-2C3M 3 28 26 24 22 2 18 16 14 12 1 185 187 189 191 193 195 197 199 21 Min Monthly Temperature (oc) 8. 6. 4. 2.. -2. -4. -6. 185 187 189 191 193 195 197 199 21 Observed vs. modelled temperature maxima (up) and minima (down) on annual and climatic time scales. Seasonal JJA (mm) 31 29 27 25 23 21 19 17 15 185 187 189 191 193 195 197 199 21 Observed vs. modelled seasonal precipitation (up winter; down summer) on annual and climatic time scales.

17. Detailed results for temperature series Period Average ( o C) Standard deviation ( o C) Autocorrelation Hurst coefficient Evaluation indices against observations Correlation Efficiency Annual Mean Temperature Observed 189 26 11.5.4.3.77 CGCM3 2C3M T47 189 26 12.9.5.67.93.19 11. PCM 2C3M 189 26 11.4.4.21.63.3.3 ECHAM5 2C3M 189 26 14.3.49.31.75.31 41. CGCM2 A2 19 26 12.9.5.53.85.19 1.5 HADCM3 A2 195 26 12.7.5.45.87.37 9.4 ECHAM4 GG 189 26 15.1.5.69.92.4 7.1 Max Monthly Temperature Observed 189 26 23.2.6.22.76 CGCM3 2C3M T47 189 26 23.7.7.48.89.2 2.2 PCM 2C3M 189 26 21.7.5.2.42.17 5.9 ECHAM5 2C3M 189 26 23.4.4.32.74.9.5 CGCM2 A2 19 26 23..5.59.9.17.6 HADCM3 A2 195 26 23.1.7.51.87.12 1.4 ECHAM4 GG 189 26 25.1.6.6.91.8 1.5 Min Monthly Temperature Observed 189 26.7 1.4.4.52 CGCM3 2C3M T47 189 26 2.1 1.2.15.74.5 4.9 PCM 2C3M 189 26.3 1.2.2.47.13 1.5 ECHAM5 2C3M 189 26 4.6 1..16.58.9 14.4 CGCM2 A2 19 26 3.1 1..3.52.9 7.3 HADCM3 A2 195 26 1.9 1..1.57.11 3. ECHAM4 GG 189 26 5.1.9.12.6.6 16.8

18. Detailed results for precipitation series Period Average ( o C) Standard deviation ( o C) Autocorrelation Hurst coefficient Evaluation indices against observations Correlation Efficiency Annual Observed 189 26 698.3 52.2.2.63 CGCM3 2C3M T47 189 26 815.2 36.7.31.72.17 5.1 PCM 2C3M 189 26 91.2 41..8.54.11 15. ECHAM5 2C3M 189 26 961.9 58.7.17.43.4 27.1 CGCM2 A2 19 26 971.1 34.8.3.6.1 26.4 HADCM3 A2 195 26 966.8 49.2.21.7.2 23.3 ECHAM4 GG 189 26 894.2 42.4.6.42.3 14.9 Max Monthly Observed 189 26 81.1 8.9.11.42 CGCM3 2C3M T47 189 26 83.2 6.8.19.66.4.6 PCM 2C3M 189 26 94.6 4.7.4.48.5 2.6 ECHAM5 2C3M 189 26 11.7 6.8.17.51.3 6. CGCM2 A2 19 26 96.9 5.4.5.42.5 3.6 HADCM3 A2 195 26 97.9 7.1.1.56.12 4.8 ECHAM4 GG 189 26 95.6 6.1..56.8 3. Min Monthly Observed 189 26 34.3 7.2.6.47 CGCM3 2C3M T47 189 26 52.9 5.9.16.6.11 7.3 PCM 2C3M 189 26 56.2 6..13.51.7 9.9 ECHAM5 2C3M 189 26 59.5 7.9.5.4.11 13.1 CGCM2 A2 19 26 65.2 5.5.1.48.8 18.1 HADCM3 A2 195 26 63.7 6.3.1.51.2 15. ECHAM4 GG 189 26 53.4 7..13.42.17 8.3

19. Observed vs. modeled variability metrics Percent Percent ( ( ±% ±% ) ) Percent Percent ( ( ±% ±% ) ) 5 5 4 4 3 3 2 2 1 1-1 -1-2 -2-3 -3-4 -4-5 -5 5 5 4 4 3 3 2 2 1 1-1 -1-2 -2-3 -3-4 -4-5 -5 Annual Annual Mean Mean Temperature Temperature Max Max Monthly Monthly Temperature Temperature Min Min Monthly Monthly Temperature Temperature Annual Annual Temperature Temperature Amplitude Amplitude Seasonal Seasonal Temperature Temperature DJF DJF Seasonal Seasonal Temperature Temperature JJA JJA CGCM3-2C3M-T47 CGCM3-2C3M-T47 PCM-2C3M PCM-2C3M ECHAM5-2C3M ECHAM5-2C3M CGCM2-A2 CGCM2-A2 HADCM3-A2 HADCM3-A2 Difference form form observed Hurst Coefficient Annual Annual Mean Mean Temperature Temperature Max Max Monthly Monthly Temperature Temperature Min Min Monthly Monthly Temperature Temperature Annual Annual Temperature Temperature Amplitude Amplitude Seasonal Seasonal Temperature Temperature DJF DJF Seasonal Seasonal Temperature Temperature JJA JJA CGCM3-2C3M-T47 CGCM3-2C3M-T47 PCM-2C3M PCM-2C3M ECHAM5-2C3M ECHAM5-2C3M CGCM2-A2 CGCM2-A2 HADCM3-A2 HADCM3-A2 Difference from from observed Standard Deviation Percent Percent ( ( ±% ±% ) ) Percent Percent ( ( ±% ±% ) ) 8 8 6 6 4 4 2 2-2 -2-4 -4 3 3 2 2 1 1-1 -1-2 -2-3 -3-4 -4-5 -5-6 -6 Annual Annual Annual Annual Max Max Annual Annual Min Min Winter Winter Summer Summer CGCM3-2C3M-T47 CGCM3-2C3M-T47 PCM-2C3M PCM-2C3M ECHAM5-2C3M ECHAM5-2C3M CGCM2-A2 CGCM2-A2 HADCM3-A2 HADCM3-A2 Difference from from observed Hurst Hurst Coefficient Annual Annual Annual Annual Max Max Annual Annual Min Min Winter Winter Summer Summer CGCM3-2C3M-T47 CGCM3-2C3M-T47 PCM-2C3M PCM-2C3M ECHAM5-2C3M ECHAM5-2C3M CGCM2-A2 CGCM2-A2 HADCM3-A2 HADCM3-A2 Difference from from observed Standard Deviation Percent Percent ( ( ±% ±% ) ) 4 4 3 3 2 2 1 1-1 -1 Annual Annual Mean Mean Temperature Temperature Max Max Monthly Monthly Temperature Temperature Min Min Monthly Monthly Temperature Temperature Seasonal Seasonal Temperature Temperature DJF DJF Seasonal Seasonal Temperature Temperature JJA JJA Percent Percent ( ( ±% ±% ) ) -5-5 -1-1 -15-15 Annual Annual Annual Annual Max Max Annual Annual Min Min Winter Winter Summer Summer -2-2 CGCM3-2C3M-T47 CGCM3-2C3M-T47 PCM-2C3M PCM-2C3M ECHAM5-2C3M ECHAM5-2C3M CGCM2-A2 CGCM2-A2 Difference from from observed DT DT (19-2) -2-2 CGCM3-2C3M-T47 CGCM3-2C3M-T47 PCM-2C3M PCM-2C3M ECHAM5-2C3M ECHAM5-2C3M CGCM2-A2 CGCM2-A2 Difference from from observed DP DP (19-2)

2. Conclusions The performance of the models at local scale at 55 stations worldwide (in addition to the 8 stations used in Koutsoyiannis et al., 28) is poor regarding all statistical indicators at the seasonal, annual and climatic time scales. In most cases the observed variability metrics (standard deviation and Hurst coefficient) are underestimated. The performance of the models (both the TAR and AR4 ones) at a large spatial scale, i.e. the contiguous USA, is even worse. None of the examined models reproduces the over year fluctuations of the areal temperature of USA (gradual increase before 194, falling trend until the early 197 s, slight upward trend thereafter); most overestimate the annual mean (by up to 4 C) and predict a rise more intense than reality during the later 2 th century. On the climatic scale, the model whose results for temperature are closest to reality (PCM 2C3M) has an efficiency of.5, virtually equivalent to an elementary prediction based on the historical mean; its predictive capacity against other indicators (e.g. maximum and minimum monthly temperature) is worse. The predictive capacity of GCMs against the areal precipitation is even poorer (overestimation by about 1 to 3 mm). All efficiency values at all time scales are strongly negative, while correlations vary from negative to slightly positive. Contrary to the common practice of climate modellers and IPCC, here comparisons are made in terms of actual values and not departures from means ( anomalies ). The enormous differences from reality (up to 6 C in minimum temperature and 3 mm in annual precipitation) would have been concealed if departures from mean had been taken. Could models, which consistently err by several degrees in the 2 th century, be trusted for their future predictions of decadal trends that are much lower than this error?