Issues in estimating past climate change at local scale.

Size: px
Start display at page:

Download "Issues in estimating past climate change at local scale."

Transcription

1 14th EMS Annual Meeting, Prague Oct. 6th 2014 Issues in estimating past climate change at local scale. Case study: the recent warming ( ) over France. Lola Corre (Division de la Climatologie, Météo-France) Aurélien Ribes (CNRM-GAME, Météo-France) Anne-Laure Gibelin (Division de la Climatologie, Météo-France) Brigitte Dubuisson (Division de la Climatologie, Météo-France) 1

2 A new reference dataset Monthly homogeneous series of temperature covering the period: Mean temperature: 187 series Mean temperature over France See the poster: Production of a reference data set of homogenised series for analysis of temperature evolution in France since 1959, Gibelin et al. (MC1 session) 2

3 Background Widely used method to estimate the long term change: Linear regression model Mean temperature over France Y(t) = β. t + ε(t) Cov (ε) = σ2. Id Y: observed local temperature β: amplitude of the change ε: internal variability σ2: observed variance 3 +β

4 Method and issues Method: temporal regression model Widely used Y(t) = β. t + ε(t) Y(t) = β. X(t) + ε(t) Cov (ε) = σ2. Id Cov (ε) = σ2. Σ Y: observed local temperature β: amplitude of the change ε: internal variability σ2: observed variance Issues: 4 This study 1. Estimating the change 2. Quantifying the associated uncertainty (Ribes et al. 2010) Y: observed local temperature (known) X: temporal pattern of the change (known) β: amplitude of the change (unknown) ε: internal variability σ2: observed variance (unknown) Σ: covariance structure of ε (known)

5 1. How to estimate the change? Y(t) = β. X(t) + ε(t) Cov (ε) = σ2. Σ Simulated mean French temperature (CMIP5 multi-model ALL forcings) Which temporal pattern? - Linear X - Forced X (simulated response to external forcings) smoothing spline Time 5

6 1. How to estimate the change? Y(t) = β. X(t) + ε(t) Cov (ε) = σ2. Σ Simulated mean French temperature (CMIP5 multi-model ALL forcings) Which temporal pattern? - Linear X - Forced X (simulated response to external forcings) smoothing spline 1.2. Which estimator? ^ - OLS (Ordinary Least Square) : β = (x'x)-1x'y widely used ^ - GLS (Generalized Least Square) : β = (x'σ-1x)-1x'σy optimal when Σ Id 6 Time

7 Estimates of the recent mean French warming Observed mean French temperature evolution Forced X Various approaches lead to quite similar results 7

8 Estimates of the recent mean French warming Observed mean French temperature evolution Forced X Various approaches lead to quite similar results 8 Selected method: forced X and OLS estimator

9 Estimate of the change at local scale Observed temperature change ( ) Method: - Forced X What is the associated uncertainty? - OLS estimator

10 2. Assessing uncertainty / significance Various hypothesis to characterize the internal variability ε: - T1: independant over time (white noise) - T2: short-term memory effect estimated with an autoregressive process of order 1 in time (AR1) - T3: covariance structure deduced from CMIP5 control runs AR1: εt = α. εt-1 + noise Confidence interval (95%) calculations: C.I.up 2 cases: - α = 0.2 (Ribes et al. 2010) - α = 0.3 N.B: α = 0 white noise Estimated change (Forced X and OLS estimator) C.I.low C.I.low > 0 10 warming significantly detected

11 Confidence interval (95%) of the mean change Mean change over France ( ) I.C. width ( C) Mean 1.0 White noise 0.8 AR1(0.2) 1.0 AR1(0.3) 1.2 Models [ ] Multi-model 1.0 ~ C Hypothesis concerning ε: T T1: white noise - T2: AR1 - T3: covariance structure deduced from CMIP5 control runs T2 T1

12 Confidence interval (95%) of the local change C.I. lower margin (2.5%) Observed temperature change ( ) C.I. upper margin (97.5%) Method: - Forced X - OLS estimator - T2 ε: AR1(0.2) 12

13 Local detection result C.I. lower margin For each individual series : C.I.low > Detection of a significant warming for every locations of the French territory 13

14 Local detection result C.I. lower margin For each individual series : C.I.low > Detection of a significant warming for every locations of the French territory Not shown: same conclusion whatever is the hypothesis concerning ε 14

15 Conclusions We used a new dataset of homogeneous temperature series produced by Météo-France to estimate the recent warming over France. Different approaches have been tested: 1. To estimate the observed change results are not sensitive to the selected temporal pattern nor the estimator 2. To assess statistical signification of the change the C.I. is under-estimated by 20 % under the assumption of a white noise internal variability using an AR1 (0.2) process to characterize the internal variability leads to similar results than using control runs. On average over metropolitan France, from 1959 to 2009: 1.5 C +/- 0.5 C (95%) At local scale, for every individual series: whatever the assumption concerning the internal variability, a significant warming has been detected. 15 Selected method: - Forced signal - OLS estimator - internal variability: AR1(0.2)

16 Conclusions We used a new dataset of homogeneous temperature series produced by Météo-France to estimate the recent warming over France. Different approaches have been tested: 1. To estimate the observed change results are not sensitive to the selected temporal pattern nor the estimator 2. To assess statistical signification of the change the C.I. is under-estimated by 20 % under the assumption of a white noise internal variability using an AR1 (0.2) process to characterize the internal variability leads to similar results than using control runs. On average over metropolitan France, from 1959 to 2009: 1.5 C +/- 0.5 C (95%) At local scale, for every individual series: whatever the assumption concerning the internal variability, a significant warming has been detected. 16 Thank you for your attention! Selected method: - Forced signal - OLS estimator - internal variability: AR1(0.2)

17 17

18 Comparing methods : detection results - T1: white noise - T2: AR1 - T3: covariance structure deduced from CMIP5 control runs Lower margins of the 95% C.I. Box plots built from all individual series Whatever the hypothesis concerning ε : C.I.low> 0 Detection of a significant warming for every locations of the French territory Hypothesis concerning ε 18 T3 T2 T1

19 Comparing methods: C.I. widths C.I. width = upper margin lower margin - T1: white noise - T2: AR1 (0.2) - T3: covariance structure deduced from CMIP5 control runs Ratios of C.I. widths T3 / T1 19 Ratios around 1.2 C.I. width 20 % larger with T3 than T1 Ratios of C.I. widths T3 / T2 Ratios around 1 parametric hypothesis AR1 (0.2) acceptable

Linear Model Under General Variance Structure: Autocorrelation

Linear Model Under General Variance Structure: Autocorrelation Linear Model Under General Variance Structure: Autocorrelation A Definition of Autocorrelation In this section, we consider another special case of the model Y = X β + e, or y t = x t β + e t, t = 1,..,.

More information

1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects.

1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects. 1. How can you tell if there is serial correlation? 2. AR to model serial correlation. 3. Ignoring serial correlation. 4. GLS. 5. Projects. 1) Identifying serial correlation. Plot Y t versus Y t 1. See

More information

Introduction to climate modelling: Evaluating climate models

Introduction to climate modelling: Evaluating climate models Introduction to climate modelling: Evaluating climate models Why? How? Professor David Karoly School of Earth Sciences, University of Melbourne Experiment design Detection and attribution of climate change

More information

Chapter 2: Unit Roots

Chapter 2: Unit Roots Chapter 2: Unit Roots 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and undeconometrics II. Unit Roots... 3 II.1 Integration Level... 3 II.2 Nonstationarity

More information

Theoretical and Simulation-guided Exploration of the AR(1) Model

Theoretical and Simulation-guided Exploration of the AR(1) Model Theoretical and Simulation-guided Exploration of the AR() Model Overview: Section : Motivation Section : Expectation A: Theory B: Simulation Section : Variance A: Theory B: Simulation Section : ACF A:

More information

Prof. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis

Prof. Dr. Roland Füss Lecture Series in Applied Econometrics Summer Term Introduction to Time Series Analysis Introduction to Time Series Analysis 1 Contents: I. Basics of Time Series Analysis... 4 I.1 Stationarity... 5 I.2 Autocorrelation Function... 9 I.3 Partial Autocorrelation Function (PACF)... 14 I.4 Transformation

More information

Classic Time Series Analysis

Classic Time Series Analysis Classic Time Series Analysis Concepts and Definitions Let Y be a random number with PDF f Y t ~f,t Define t =E[Y t ] m(t) is known as the trend Define the autocovariance t, s =COV [Y t,y s ] =E[ Y t t

More information

Supplemental Material

Supplemental Material Supplemental Material Copyright 2018 American Meteorological Society Permission to use figures, tables, and brief excerpts from this work in scientific and educational works is hereby granted provided

More information

Spatial Regression. 13. Spatial Panels (1) Luc Anselin. Copyright 2017 by Luc Anselin, All Rights Reserved

Spatial Regression. 13. Spatial Panels (1) Luc Anselin.  Copyright 2017 by Luc Anselin, All Rights Reserved Spatial Regression 13. Spatial Panels (1) Luc Anselin http://spatial.uchicago.edu 1 basic concepts dynamic panels pooled spatial panels 2 Basic Concepts 3 Data Structures 4 Two-Dimensional Data cross-section/space

More information

The General Linear Model (GLM)

The General Linear Model (GLM) The General Linear Model (GLM) Dr. Frederike Petzschner Translational Neuromodeling Unit (TNU) Institute for Biomedical Engineering, University of Zurich & ETH Zurich With many thanks for slides & images

More information

Lecture # 37. Prof. John W. Sutherland. Nov. 28, 2005

Lecture # 37. Prof. John W. Sutherland. Nov. 28, 2005 Lecture # 37 Prof. John W. Sutherland Nov. 28, 2005 Linear Regression 8 y 7 6 5 4 3 2 1 0 0 1 2 3 4 5 6 7 8 x Modeling To describe the data above, propose the model: y = B 0 + B 1 x + ε Fitted model will

More information

Overview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power

Overview of SPM. Overview. Making the group inferences we want. Non-sphericity Beyond Ordinary Least Squares. Model estimation A word on power Group Inference, Non-sphericity & Covariance Components in SPM Alexa Morcom Edinburgh SPM course, April 011 Centre for Cognitive & Neural Systems/ Department of Psychology University of Edinburgh Overview

More information

FinQuiz Notes

FinQuiz Notes Reading 9 A time series is any series of data that varies over time e.g. the quarterly sales for a company during the past five years or daily returns of a security. When assumptions of the regression

More information

IV. Covariance Analysis

IV. Covariance Analysis IV. Covariance Analysis Autocovariance Remember that when a stochastic process has time values that are interdependent, then we can characterize that interdependency by computing the autocovariance function.

More information

Lecture 14 Simple Linear Regression

Lecture 14 Simple Linear Regression Lecture 4 Simple Linear Regression Ordinary Least Squares (OLS) Consider the following simple linear regression model where, for each unit i, Y i is the dependent variable (response). X i is the independent

More information

Econometrics 2, Class 1

Econometrics 2, Class 1 Econometrics 2, Class Problem Set #2 September 9, 25 Remember! Send an email to let me know that you are following these classes: paul.sharp@econ.ku.dk That way I can contact you e.g. if I need to cancel

More information

Semi-parametric estimation of non-stationary Pickands functions

Semi-parametric estimation of non-stationary Pickands functions Semi-parametric estimation of non-stationary Pickands functions Linda Mhalla 1 Joint work with: Valérie Chavez-Demoulin 2 and Philippe Naveau 3 1 Geneva School of Economics and Management, University of

More information

Hydrological statistics for engineering design in a varying climate

Hydrological statistics for engineering design in a varying climate EGS - AGU - EUG Joint Assembly Nice, France, 6- April 23 Session HS9/ Climate change impacts on the hydrological cycle, extremes, forecasting and implications on engineering design Hydrological statistics

More information

Serially Correlated Regression Disturbances

Serially Correlated Regression Disturbances LECTURE 5 Serially Correlated Regression Disturbances Autoregressive Disturbance Processes The interpretation which is given to the disturbance term of a regression model depends upon the context in which

More information

Statistics 910, #5 1. Regression Methods

Statistics 910, #5 1. Regression Methods Statistics 910, #5 1 Overview Regression Methods 1. Idea: effects of dependence 2. Examples of estimation (in R) 3. Review of regression 4. Comparisons and relative efficiencies Idea Decomposition Well-known

More information

Econ 424 Time Series Concepts

Econ 424 Time Series Concepts Econ 424 Time Series Concepts Eric Zivot January 20 2015 Time Series Processes Stochastic (Random) Process { 1 2 +1 } = { } = sequence of random variables indexed by time Observed time series of length

More information

Quantitative Analysis of Financial Markets. Summary of Part II. Key Concepts & Formulas. Christopher Ting. November 11, 2017

Quantitative Analysis of Financial Markets. Summary of Part II. Key Concepts & Formulas. Christopher Ting. November 11, 2017 Summary of Part II Key Concepts & Formulas Christopher Ting November 11, 2017 christopherting@smu.edu.sg http://www.mysmu.edu/faculty/christophert/ Christopher Ting 1 of 16 Why Regression Analysis? Understand

More information

University of Minnesota Duluth

University of Minnesota Duluth Trend analyses for species of concern: Analysis of CPUE data for walleye, cisco, and smallmouth bass 1970-2008 Dave Staples 1, Lucinda Johnson 2, Jennifer Olker 2, Dan Brenneman 2 1 Minnesota Department

More information

Application of climate services at the regional and sub-regional scale Some lessons from the CLIM-RUN and DRIAS projects

Application of climate services at the regional and sub-regional scale Some lessons from the CLIM-RUN and DRIAS projects Application of climate services at the regional and sub-regional scale Some lessons from the CLIM-RUN and DRIAS projects Serge Planton Météo-France, CNRM/GAME With inputs from Paolo Ruti (WMO) and Samuel

More information

PhD/MA Econometrics Examination. January, 2015 PART A. (Answer any TWO from Part A)

PhD/MA Econometrics Examination. January, 2015 PART A. (Answer any TWO from Part A) PhD/MA Econometrics Examination January, 2015 Total Time: 8 hours MA students are required to answer from A and B. PhD students are required to answer from A, B, and C. PART A (Answer any TWO from Part

More information

An Introduction to Nonstationary Time Series Analysis

An Introduction to Nonstationary Time Series Analysis An Introduction to Analysis Ting Zhang 1 tingz@bu.edu Department of Mathematics and Statistics Boston University August 15, 2016 Boston University/Keio University Workshop 2016 A Presentation Friendly

More information

Peter Hoff Linear and multilinear models April 3, GLS for multivariate regression 5. 3 Covariance estimation for the GLM 8

Peter Hoff Linear and multilinear models April 3, GLS for multivariate regression 5. 3 Covariance estimation for the GLM 8 Contents 1 Linear model 1 2 GLS for multivariate regression 5 3 Covariance estimation for the GLM 8 4 Testing the GLH 11 A reference for some of this material can be found somewhere. 1 Linear model Recall

More information

Spatial inference. Spatial inference. Accounting for spatial correlation. Multivariate normal distributions

Spatial inference. Spatial inference. Accounting for spatial correlation. Multivariate normal distributions Spatial inference I will start with a simple model, using species diversity data Strong spatial dependence, Î = 0.79 what is the mean diversity? How precise is our estimate? Sampling discussion: The 64

More information

Regression of Time Series

Regression of Time Series Mahlerʼs Guide to Regression of Time Series CAS Exam S prepared by Howard C. Mahler, FCAS Copyright 2016 by Howard C. Mahler. Study Aid 2016F-S-9Supplement Howard Mahler hmahler@mac.com www.howardmahler.com/teaching

More information

(x t. x t +1. TIME SERIES (Chapter 8 of Wilks)

(x t. x t +1. TIME SERIES (Chapter 8 of Wilks) 45 TIME SERIES (Chapter 8 of Wilks) In meteorology, the order of a time series matters! We will assume stationarity of the statistics of the time series. If there is non-stationarity (e.g., there is a

More information

Department of Economics, UCSD UC San Diego

Department of Economics, UCSD UC San Diego Department of Economics, UCSD UC San Diego itle: Spurious Regressions with Stationary Series Author: Granger, Clive W.J., University of California, San Diego Hyung, Namwon, University of Seoul Jeon, Yongil,

More information

AGEC 621 Lecture 16 David Bessler

AGEC 621 Lecture 16 David Bessler AGEC 621 Lecture 16 David Bessler This is a RATS output for the dummy variable problem given in GHJ page 422; the beer expenditure lecture (last time). I do not expect you to know RATS but this will give

More information

Anthropogenic forcing fingerprint on the tropical Pacific sea level trend pattern from the CMIP5 simulations of the XXI st century

Anthropogenic forcing fingerprint on the tropical Pacific sea level trend pattern from the CMIP5 simulations of the XXI st century Anthropogenic forcing fingerprint on the tropical Pacific sea level trend pattern from the CMIP5 simulations of the XXI st century Benoît t Meyssignac 1, David Salas y Melia Anny Cazenave 1 1 LEGOS, CNRM/Météo

More information

The Identification of ARIMA Models

The Identification of ARIMA Models APPENDIX 4 The Identification of ARIMA Models As we have established in a previous lecture, there is a one-to-one correspondence between the parameters of an ARMA(p, q) model, including the variance of

More information

An Introduction to Wavelets with Applications in Environmental Science

An Introduction to Wavelets with Applications in Environmental Science An Introduction to Wavelets with Applications in Environmental Science Don Percival Applied Physics Lab, University of Washington Data Analysis Products Division, MathSoft overheads for talk available

More information

Forecasting Data Streams: Next Generation Flow Field Forecasting

Forecasting Data Streams: Next Generation Flow Field Forecasting Forecasting Data Streams: Next Generation Flow Field Forecasting Kyle Caudle South Dakota School of Mines & Technology (SDSMT) kyle.caudle@sdsmt.edu Joint work with Michael Frey (Bucknell University) and

More information

Lecture 1 Intro to Spatial and Temporal Data

Lecture 1 Intro to Spatial and Temporal Data Lecture 1 Intro to Spatial and Temporal Data Dennis Sun Stanford University Stats 253 June 22, 2015 1 What is Spatial and Temporal Data? 2 Trend Modeling 3 Omitted Variables 4 Overview of this Class 1

More information

Regression with correlation for the Sales Data

Regression with correlation for the Sales Data Regression with correlation for the Sales Data Scatter with Loess Curve Time Series Plot Sales 30 35 40 45 Sales 30 35 40 45 0 10 20 30 40 50 Week 0 10 20 30 40 50 Week Sales Data What is our goal with

More information

TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA

TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA CHAPTER 6 TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA 6.1. Introduction A time series is a sequence of observations ordered in time. A basic assumption in the time series analysis

More information

Simple and Multiple Linear Regression

Simple and Multiple Linear Regression Sta. 113 Chapter 12 and 13 of Devore March 12, 2010 Table of contents 1 Simple Linear Regression 2 Model Simple Linear Regression A simple linear regression model is given by Y = β 0 + β 1 x + ɛ where

More information

Estimating the slope and standard error of a long-term. linear trend fitted to adjusted annual temperatures

Estimating the slope and standard error of a long-term. linear trend fitted to adjusted annual temperatures Estimating the slope and standard error of a long-term linear trend fitted to adjusted annual temperatures Brett Mullan National Institute of Water and Atmospheric Research New Zealand Stephen Stuart National

More information

6.435, System Identification

6.435, System Identification SET 6 System Identification 6.435 Parametrized model structures One-step predictor Identifiability Munther A. Dahleh 1 Models of LTI Systems A complete model u = input y = output e = noise (with PDF).

More information

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Outline Ordinary Least Squares (OLS) Regression Generalized Linear Models

More information

The General Linear Model (GLM)

The General Linear Model (GLM) he General Linear Model (GLM) Klaas Enno Stephan ranslational Neuromodeling Unit (NU) Institute for Biomedical Engineering University of Zurich & EH Zurich Wellcome rust Centre for Neuroimaging Institute

More information

Ch 2: Simple Linear Regression

Ch 2: Simple Linear Regression Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component

More information

Chapte The McGraw-Hill Companies, Inc. All rights reserved.

Chapte The McGraw-Hill Companies, Inc. All rights reserved. 12er12 Chapte Bivariate i Regression (Part 1) Bivariate Regression Visual Displays Begin the analysis of bivariate data (i.e., two variables) with a scatter plot. A scatter plot - displays each observed

More information

Ch.10 Autocorrelated Disturbances (June 15, 2016)

Ch.10 Autocorrelated Disturbances (June 15, 2016) Ch10 Autocorrelated Disturbances (June 15, 2016) In a time-series linear regression model setting, Y t = x tβ + u t, t = 1, 2,, T, (10-1) a common problem is autocorrelation, or serial correlation of the

More information

Detection and Attribution of Climate Change

Detection and Attribution of Climate Change Detection and Attribution of Climate Change What is D&A? Global Mean Temperature Extreme Event Attribution Geert Jan van Oldenborgh, Sjoukje Philip (KNMI) Definitions Detection: demonstrating that climate

More information

Introduction to Econometrics

Introduction to Econometrics Introduction to Econometrics STAT-S-301 Introduction to Time Series Regression and Forecasting (2016/2017) Lecturer: Yves Dominicy Teaching Assistant: Elise Petit 1 Introduction to Time Series Regression

More information

LECTURE 13: TIME SERIES I

LECTURE 13: TIME SERIES I 1 LECTURE 13: TIME SERIES I AUTOCORRELATION: Consider y = X + u where y is T 1, X is T K, is K 1 and u is T 1. We are using T and not N for sample size to emphasize that this is a time series. The natural

More information

Econ 4120 Applied Forecasting Methods L10: Forecasting with Regression Models. Sung Y. Park CUHK

Econ 4120 Applied Forecasting Methods L10: Forecasting with Regression Models. Sung Y. Park CUHK Econ 4120 Applied Forecasting Methods L10: Forecasting with Regression Models Sung Y. Park CUHK Conditional forecasting model Forecast a variable conditional on assumptions about other variables. (scenario

More information

Name of the Student: Problems on Discrete & Continuous R.Vs

Name of the Student: Problems on Discrete & Continuous R.Vs Engineering Mathematics 08 SUBJECT NAME : Probability & Random Processes SUBJECT CODE : MA645 MATERIAL NAME : University Questions REGULATION : R03 UPDATED ON : November 07 (Upto N/D 07 Q.P) (Scan the

More information

Comparing two independent samples

Comparing two independent samples In many applications it is necessary to compare two competing methods (for example, to compare treatment effects of a standard drug and an experimental drug). To compare two methods from statistical point

More information

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature

More information

ENVE3502. Environmental Monitoring, Measurements & Data Analysis. Points from previous lecture

ENVE3502. Environmental Monitoring, Measurements & Data Analysis. Points from previous lecture ENVE35. Environmental Monitoring, Measurements & Data Analysis Regression and Correlation Analysis Points from previous lecture Noise in environmental data can obscure trends; Smoothing is one mechanism

More information

Simple Linear Regression for the Climate Data

Simple Linear Regression for the Climate Data Prediction Prediction Interval Temperature 0.2 0.0 0.2 0.4 0.6 0.8 320 340 360 380 CO 2 Simple Linear Regression for the Climate Data What do we do with the data? y i = Temperature of i th Year x i =CO

More information

Variance. Standard deviation VAR = = value. Unbiased SD = SD = 10/23/2011. Functional Connectivity Correlation and Regression.

Variance. Standard deviation VAR = = value. Unbiased SD = SD = 10/23/2011. Functional Connectivity Correlation and Regression. 10/3/011 Functional Connectivity Correlation and Regression Variance VAR = Standard deviation Standard deviation SD = Unbiased SD = 1 10/3/011 Standard error Confidence interval SE = CI = = t value for

More information

Statistical Inference

Statistical Inference Statistical Inference J. Daunizeau Institute of Empirical Research in Economics, Zurich, Switzerland Brain and Spine Institute, Paris, France SPM Course Edinburgh, April 2011 Image time-series Spatial

More information

Detection and Attribution of Climate Change. ... in Indices of Extremes?

Detection and Attribution of Climate Change. ... in Indices of Extremes? Detection and Attribution of Climate Change... in Indices of Extremes? Reiner Schnur Max Planck Institute for Meteorology MPI-M Workshop Climate Change Scenarios and Their Use for Impact Studies September

More information

S-GSTAR-SUR Model for Seasonal Spatio Temporal Data Forecasting ABSTRACT

S-GSTAR-SUR Model for Seasonal Spatio Temporal Data Forecasting ABSTRACT Malaysian Journal of Mathematical Sciences (S) March : 53-65 (26) Special Issue: The th IMT-GT International Conference on Mathematics, Statistics and its Applications 24 (ICMSA 24) MALAYSIAN JOURNAL OF

More information

F9 F10: Autocorrelation

F9 F10: Autocorrelation F9 F10: Autocorrelation Feng Li Department of Statistics, Stockholm University Introduction In the classic regression model we assume cov(u i, u j x i, x k ) = E(u i, u j ) = 0 What if we break the assumption?

More information

Basics: Definitions and Notation. Stationarity. A More Formal Definition

Basics: Definitions and Notation. Stationarity. A More Formal Definition Basics: Definitions and Notation A Univariate is a sequence of measurements of the same variable collected over (usually regular intervals of) time. Usual assumption in many time series techniques is that

More information

Comparison of rainfall distribution method

Comparison of rainfall distribution method Team 6 Comparison of rainfall distribution method In this section different methods of rainfall distribution are compared. METEO-France is the French meteorological agency, a public administrative institution

More information

Chapter 11 GMM: General Formulas and Application

Chapter 11 GMM: General Formulas and Application Chapter 11 GMM: General Formulas and Application Main Content General GMM Formulas esting Moments Standard Errors of Anything by Delta Method Using GMM for Regressions Prespecified weighting Matrices and

More information

Problem Set 6 Solution

Problem Set 6 Solution Problem Set 6 Solution May st, 009 by Yang. Causal Expression of AR Let φz : αz βz. Zeros of φ are α and β, both of which are greater than in absolute value by the assumption in the question. By the theorem

More information

Basic Probability Reference Sheet

Basic Probability Reference Sheet February 27, 2001 Basic Probability Reference Sheet 17.846, 2001 This is intended to be used in addition to, not as a substitute for, a textbook. X is a random variable. This means that X is a variable

More information

Outline. Nature of the Problem. Nature of the Problem. Basic Econometrics in Transportation. Autocorrelation

Outline. Nature of the Problem. Nature of the Problem. Basic Econometrics in Transportation. Autocorrelation 1/30 Outline Basic Econometrics in Transportation Autocorrelation Amir Samimi What is the nature of autocorrelation? What are the theoretical and practical consequences of autocorrelation? Since the assumption

More information

Climate Projections and Energy Security

Climate Projections and Energy Security NOAA Research Earth System Research Laboratory Physical Sciences Division Climate Projections and Energy Security Andy Hoell and Jim Wilczak Research Meteorologists, Physical Sciences Division 7 June 2016

More information

Applied Econometrics. Professor Bernard Fingleton

Applied Econometrics. Professor Bernard Fingleton Applied Econometrics Professor Bernard Fingleton 1 Causation & Prediction 2 Causation One of the main difficulties in the social sciences is estimating whether a variable has a true causal effect Data

More information

Master s Written Examination - Solution

Master s Written Examination - Solution Master s Written Examination - Solution Spring 204 Problem Stat 40 Suppose X and X 2 have the joint pdf f X,X 2 (x, x 2 ) = 2e (x +x 2 ), 0 < x < x 2

More information

14.0 RESPONSE SURFACE METHODOLOGY (RSM)

14.0 RESPONSE SURFACE METHODOLOGY (RSM) 4. RESPONSE SURFACE METHODOLOGY (RSM) (Updated Spring ) So far, we ve focused on experiments that: Identify a few important variables from a large set of candidate variables, i.e., a screening experiment.

More information

STAT 100C: Linear models

STAT 100C: Linear models STAT 100C: Linear models Arash A. Amini June 9, 2018 1 / 56 Table of Contents Multiple linear regression Linear model setup Estimation of β Geometric interpretation Estimation of σ 2 Hat matrix Gram matrix

More information

Lesson 17: Vector AutoRegressive Models

Lesson 17: Vector AutoRegressive Models Dipartimento di Ingegneria e Scienze dell Informazione e Matematica Università dell Aquila, umberto.triacca@ec.univaq.it Vector AutoRegressive models The extension of ARMA models into a multivariate framework

More information

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING. Non-linear regression techniques Part - II

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING. Non-linear regression techniques Part - II 1 Non-linear regression techniques Part - II Regression Algorithms in this Course Support Vector Machine Relevance Vector Machine Support vector regression Boosting random projections Relevance vector

More information

CE3502. Environmental Monitoring, Measurements & Data Analysis. Points from previous lecture

CE3502. Environmental Monitoring, Measurements & Data Analysis. Points from previous lecture CE35. Environmental Monitoring, Measurements & Data Analysis Regression and Correlation Analysis 11 February 9 Points from previous lecture Noise in environmental data can obscure trends; Smoothing is

More information

Ref.: Spring SOS3003 Applied data analysis for social science Lecture note

Ref.:   Spring SOS3003 Applied data analysis for social science Lecture note SOS3003 Applied data analysis for social science Lecture note 05-2010 Erling Berge Department of sociology and political science NTNU Spring 2010 Erling Berge 2010 1 Literature Regression criticism I Hamilton

More information

Correlation: Relationships between Variables

Correlation: Relationships between Variables Correlation Correlation: Relationships between Variables So far, nearly all of our discussion of inferential statistics has focused on testing for differences between group means However, researchers are

More information

Lecture 15. Hypothesis testing in the linear model

Lecture 15. Hypothesis testing in the linear model 14. Lecture 15. Hypothesis testing in the linear model Lecture 15. Hypothesis testing in the linear model 1 (1 1) Preliminary lemma 15. Hypothesis testing in the linear model 15.1. Preliminary lemma Lemma

More information

5.1 Model Specification and Data 5.2 Estimating the Parameters of the Multiple Regression Model 5.3 Sampling Properties of the Least Squares

5.1 Model Specification and Data 5.2 Estimating the Parameters of the Multiple Regression Model 5.3 Sampling Properties of the Least Squares 5.1 Model Specification and Data 5. Estimating the Parameters of the Multiple Regression Model 5.3 Sampling Properties of the Least Squares Estimator 5.4 Interval Estimation 5.5 Hypothesis Testing for

More information

Correlation and Linear Regression

Correlation and Linear Regression Correlation and Linear Regression Correlation: Relationships between Variables So far, nearly all of our discussion of inferential statistics has focused on testing for differences between group means

More information

ROBUST MEASUREMENT OF THE DURATION OF

ROBUST MEASUREMENT OF THE DURATION OF ROBUST MEASUREMENT OF THE DURATION OF THE GLOBAL WARMING HIATUS Ross McKitrick Department of Economics University of Guelph Revised version, July 3, 2014 Abstract: The IPCC has drawn attention to an apparent

More information

Seasonal Models and Seasonal Adjustment

Seasonal Models and Seasonal Adjustment LECTURE 10 Seasonal Models and Seasonal Adjustment So far, we have relied upon the method of trigonometrical regression for building models which can be used for forecasting seasonal economic time series.

More information

Regression Analysis. y t = β 1 x t1 + β 2 x t2 + β k x tk + ϵ t, t = 1,..., T,

Regression Analysis. y t = β 1 x t1 + β 2 x t2 + β k x tk + ϵ t, t = 1,..., T, Regression Analysis The multiple linear regression model with k explanatory variables assumes that the tth observation of the dependent or endogenous variable y t is described by the linear relationship

More information

Unit Root and Cointegration

Unit Root and Cointegration Unit Root and Cointegration Carlos Hurtado Department of Economics University of Illinois at Urbana-Champaign hrtdmrt@illinois.edu Oct 7th, 016 C. Hurtado (UIUC - Economics) Applied Econometrics On the

More information

Ch 5. Models for Nonstationary Time Series. Time Series Analysis

Ch 5. Models for Nonstationary Time Series. Time Series Analysis We have studied some deterministic and some stationary trend models. However, many time series data cannot be modeled in either way. Ex. The data set oil.price displays an increasing variation from the

More information

Statistical signal processing

Statistical signal processing Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable

More information

Lab 07 Introduction to Econometrics

Lab 07 Introduction to Econometrics Lab 07 Introduction to Econometrics Learning outcomes for this lab: Introduce the different typologies of data and the econometric models that can be used Understand the rationale behind econometrics Understand

More information

Problem Set 1 Solution Sketches Time Series Analysis Spring 2010

Problem Set 1 Solution Sketches Time Series Analysis Spring 2010 Problem Set 1 Solution Sketches Time Series Analysis Spring 2010 1. Construct a martingale difference process that is not weakly stationary. Simplest e.g.: Let Y t be a sequence of independent, non-identically

More information

Global temperature trend biases and statistical homogenization methods

Global temperature trend biases and statistical homogenization methods Global temperature trend biases and statistical homogenization methods Victor Venema & Ralf Lindau @VariabilityBlog variable-variability.blogspot.com Outline talk Early warming (1850 to 1920, red rectangle)

More information

11. Further Issues in Using OLS with TS Data

11. Further Issues in Using OLS with TS Data 11. Further Issues in Using OLS with TS Data With TS, including lags of the dependent variable often allow us to fit much better the variation in y Exact distribution theory is rarely available in TS applications,

More information

ECE 636: Systems identification

ECE 636: Systems identification ECE 636: Systems identification Lectures 3 4 Random variables/signals (continued) Random/stochastic vectors Random signals and linear systems Random signals in the frequency domain υ ε x S z + y Experimental

More information

Linear Model Under General Variance

Linear Model Under General Variance Linear Model Under General Variance We have a sample of T random variables y 1, y 2,, y T, satisfying the linear model Y = X β + e, where Y = (y 1,, y T )' is a (T 1) vector of random variables, X = (T

More information

Lecture 2: Linear Models. Bruce Walsh lecture notes Seattle SISG -Mixed Model Course version 23 June 2011

Lecture 2: Linear Models. Bruce Walsh lecture notes Seattle SISG -Mixed Model Course version 23 June 2011 Lecture 2: Linear Models Bruce Walsh lecture notes Seattle SISG -Mixed Model Course version 23 June 2011 1 Quick Review of the Major Points The general linear model can be written as y = X! + e y = vector

More information

Approaches to Modeling Menstrual Cycle Function

Approaches to Modeling Menstrual Cycle Function Approaches to Modeling Menstrual Cycle Function Paul S. Albert (albertp@mail.nih.gov) Biostatistics & Bioinformatics Branch Division of Epidemiology, Statistics, and Prevention Research NICHD SPER Student

More information

Name of the Student: Problems on Discrete & Continuous R.Vs

Name of the Student: Problems on Discrete & Continuous R.Vs Engineering Mathematics 05 SUBJECT NAME : Probability & Random Process SUBJECT CODE : MA6 MATERIAL NAME : University Questions MATERIAL CODE : JM08AM004 REGULATION : R008 UPDATED ON : Nov-Dec 04 (Scan

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference

More information

THE PACIFIC DECADAL OSCILLATION, REVISITED. Matt Newman, Mike Alexander, and Dima Smirnov CIRES/University of Colorado and NOAA/ESRL/PSD

THE PACIFIC DECADAL OSCILLATION, REVISITED. Matt Newman, Mike Alexander, and Dima Smirnov CIRES/University of Colorado and NOAA/ESRL/PSD THE PACIFIC DECADAL OSCILLATION, REVISITED Matt Newman, Mike Alexander, and Dima Smirnov CIRES/University of Colorado and NOAA/ESRL/PSD PDO and ENSO ENSO forces remote changes in global oceans via the

More information

CONTROL AND OPTIMIZATION IN SMART-GRIDS

CONTROL AND OPTIMIZATION IN SMART-GRIDS CONTROL AND OPTIMIZATION IN SMART-GRIDS Fredy Ruiz Ph.D. Pontificia Universidad Javeriana, Colombia Visiting Profesor - ruizf@javeriana.edu.co May, 2018 Course topics Session 1: Introduction to Power systems

More information

Next is material on matrix rank. Please see the handout

Next is material on matrix rank. Please see the handout B90.330 / C.005 NOTES for Wednesday 0.APR.7 Suppose that the model is β + ε, but ε does not have the desired variance matrix. Say that ε is normal, but Var(ε) σ W. The form of W is W w 0 0 0 0 0 0 w 0

More information

Non-independence due to Time Correlation (Chapter 14)

Non-independence due to Time Correlation (Chapter 14) Non-independence due to Time Correlation (Chapter 14) When we model the mean structure with ordinary least squares, the mean structure explains the general trends in the data with respect to our dependent

More information