Exploring persistence in the forward rate series

Size: px
Start display at page:

Download "Exploring persistence in the forward rate series"

Transcription

1 From the SelectedWorks of Derek Bond February, 2009 Exploring persistence in the forward rate series Derek Bond, University of Ulster Available at:

2 Exploring persistence in the Forward Rate Series Derek Bond 1 Mike Harrison 2 Ed O Brien 3 1 University of Ulster at Coleraine 2 University College Dublin 3 European Central Bank FSRG th February Copies of Presentation available at

3 The Problem Non-stationarity and nonlinearity are closely related. Perron(1989) and Harrison and Bond (1992) It is difficult to statistically distinguish between difference stationary series and nonlinear but stationary series.

4 The Aim of the Presentation To explore the use of some recent tests on non-linearity using semi-parametric estimates of the fractional integration parameter d Smith(2005) modified gph test. Perron and Qu(2009) t d (a, c 1 ; b, c 2 ) tests Shimotsu (2006) Wald and d th differencing tests Qu(2009) Wald test To test the behaviour of time series involved in the Forward Rate Unbiasness debate.

5 Integration Background {y t } t=0 is said to be integrated of order d denoted by I(d)if the series is differenced d times before it is stationary. Classical analysis d is integer. Normally either: y t = y t y t 1 or is stationary y t

6 The restriction that d is integer is relaxed. Thus: d y t = y t dy t ! d(d 1)y t j! d(d 1)..(d j +1)y t j...

7 Stationary & Non-Stationary When 0 < d < 1 it follows that long memory exists If 0 < d < 0.5 then {y t } t = 0 is stationary if 0.5 d < 1.0 then the series {y t } t = 0 is non stationary.

8 Testing for : Dolado(2002) Traditional methods use semi-parametric spectral estimates Dolado(2002) approach is based on the distribution of the t statistic on φ from the generalised ADF regression: d 0 y t = φ d 1 y t 1 + p ζ i y t i + υ t i=1 where υ t is a hypothesised white noise error. Dolado (2002) set d 0 equal to 1.

9 Testing for : Lobato(2007) Dolado(2002) test is inefficient Lobato and Velasco (2007) propose an efficient Wald test based on the model: where if d > 0.5 the normal test. y t = φ 2 z t 1 (d2) + u t z t 1 (d 2 ) = ( d 2 1 1) 1 d 2 y t

10 Estimating ˆd Background Background to Tests Overview of Random Field Models Two main approaches to estimating ˆd: parametric Maximum Likelihood Non-linear least squares Semi parametric GPH Whittle

11 Logic behind tests Background Background to Tests Overview of Random Field Models If the series is linear changing the frequency domain should not effect the estimated value of d

12 Smith (2005) modified GPH Background to Tests Overview of Random Field Models Smith(2005) conducted monte-carlo studies on a mean plus noise model: y t = µ t + ɛ t and µ t = (1 ρ)µ t 1 + pη t 0 < p < 1 Smith shows that estimating d using GPH is biased upwards

13 Smith s modification Background Background to Tests Overview of Random Field Models Smith suggests estimating d from the following regression ˆf is the periodgram logf j = α + dx j + βz kj + û j where X j is the standard GPH term X j = log(2 2cos(ω j )) ω j = φj/t and Z kj is the additional term k is a nuisance parameter. ( ) (kj) 2 Z kj = log T 2 + ω2 j

14 Smith s test Background Background to Tests Overview of Random Field Models Let the modified GPH estimator be ˆd k then: if ˆd k < ˆd it is likely that the series contains a mena shift; if ˆd k ˆd it is unlikley that the series contains a mean shift.

15 The t d (a, c 1 ; b, c 2 ) tests Background to Tests Overview of Random Field Models Perron and Qu(2008) explored the behaviour of ˆd as m varies. Their basic statistic is: 24c1 [T t d (a, c 1 ; b, c 2 ) = a ] π 2 (ˆd a,c1 ˆd b,c2 ) Three tests: 1 t d ( 1 2, 1; 4 5, 1) 2 sup t d = sup c1 [1,2]t d ( 1 3, c 1; 1 2, 1) 3 mean t d = mean c1 [1,2]t d ( 1 3, c 1; 1 2, 1)

16 Shimotsu s Simple Wald Test Background to Tests Overview of Random Field Models Using the local Whittle or two step feasible Whittle, Shimotsu suggests the following test statistic: ( ) ( cm/n ) W c = 4m Aˆd n (AΩA ) + Aˆd n m/n where: ˆd d 0 ˆd ˆd (1) d n =., A = ˆd (n) d 0 c m = m i=1 v 2 i, v i = log(i) 1 m m log(j) j=1

17 Shimotsu s d th difference tests Background to Tests Overview of Random Field Models Shimotsu also suggests using both the Phillips and Perron Z t test and the KPSS test on the differenced series. Differencing carried out on a mean adjusted series. The adjustment is: µ(d) = w(d) X + (1 w(d))x 1 where w(d) is a smooth weight function such that w(d) = 1 for d 1 2 and w(d) = 0 for d 3 4. Shimotsu suggests using w(d) = 1 2 [1 + cos(4πd)] when d ( 1 2, 3 4 ).

18 Wu s Test Background Background to Tests Overview of Random Field Models If λ j are the frequencies and G(d) = 1 m m j=1 λ2d j I j then the test statistic is: m W = sup r [ɛ;1] vj 2 j=1 1 2 [mr] j=1 v j I j G(ˆd)λ 2ˆd j 1

19 Suggested Methodology Background to Tests Overview of Random Field Models Tradition classical regression Fractional testing Random Field non-linear tests (Random Field Modelling) Smith s Tests, Perron & Qu Tests, Qu s test; (Shimotsu s test)

20 Non-linear Modelling Background Background to Tests Overview of Random Field Models Increasingly Smooth Transition Regression being used rather abitary in choice of transition variable An alternative is random fields regression. Random field approach has relatively better small sample performance than a wide range of parametric and non-parametric alternatives including LSTR and ESTR.

21 Random Fields Background Background to Tests Overview of Random Field Models The basic model is of the form: y t = µ(x t ) + ɛ t where the functional form µ(x t ) is unknown and assumed to be the outcome of a random field. Hamilton s conditional mean function µ(x t ) as µ(x t ) = α 0 + α x t + λm( x t ) where x t = g x t, g is a kx1 vector of parameters and denotes the Hadamard product of matrices.

22 Gaussian random field Background to Tests Overview of Random Field Models Defined fully by its first two moments 0 and H k. so it follows that y t = α 0 + α 1 x t + u t where u t = λm( x t ) + ɛ t or in matrix form y = Xβ + u (1) where β = (α 0, α 1 ) so it follows that: u N(0, λ 2 H k + σ 2 I T ) (2)

23 Background to Tests Overview of Random Field Models Can be viewed as a generalised least squares problem The profile maximum likelihood function can be obtained and estimated. Only problem is that the form of the covariance matrix is unknown. Hamilton derives H k as a simple moving average representation of the random field based on g using a L 2 norm measure.

24 Random Field Non-Linearity Tests Background to Tests Overview of Random Field Models Simple method of testing is to check if λ is zero or not. MLE λ 2 for fixed g is consistent and asymptotically normal. Computationally complex. Simpler method is to construct Lagrange Multiplier test under the assumption of normality and linearity Provided the covariance function of the random field can be derived, for a fixed g this only requires a single linear regression to be estimated.

25 Hamilton s Test Background Background to Tests Overview of Random Field Models Hamilton(2001) used covariance function based on the L 2 norm derived the appropriate score vectors of first derivatives, for up to k=5, and the associated information matrix and proposed a form of the LM test for practical application. λ E H, the test statistic is distributed as χ2 1 under the null hypothesis. Problem of nuisance parameters under H 1

26 Dahl s alternatives Background Background to Tests Overview of Random Field Models Dahl(2003) λ E OP, covariance matrix based on the L 1 norm. λ A OP covariance function depicted by a Taylor expansion. g test makes no assumption about either the covariance function or λ. λ A OP and the g test have, in many circumstances, better power than other tests of nonlinearity.

27 Profile Likelihood Background Background to Tests Overview of Random Field Models estimating λ and g gives useful insights. need to estimate reparameterised likelihood η(y, X : g, ζ) = T 2 ln(2π) T 2 lnˆσ2 T (g, ζ) 1 2 ln W (X : g, ζ) T 2 ˆβ T (g, ζ) = [X W (X : g, ζ) 1 X] 1 [X W (X : g, ζ) 1 y] ˆσ T 2 (g, ζ) = 1 T [y X ˆβ T (g, ζ)] W (X : g, ζ) 1 [y X ˆβ T (g, ζ)] where ζ = λ/σ and W (X : g, ζ) = ζ 2 H k + I T. maximised with respect to (g, ζ)

28 Theoretical Background Results The Forward Rate Anomaly It is argued that the Forward Rate F t,k in period t is an unbiased predictor of the Spot Rate S t+k in period t + k. that is s t+k = E [ F t,k ] So in the regressions: s t+k = α 1 + β 1 F t,k + ɛ t and s t+k = α 2 + β 2 F t,k + ɛ t α 1 = α 2 = 0 β 1 = β 2 = 1 In practice ˆα i 0 and ˆβ i < 0 i = 1, 2

29 Results Background Theoretical Background Results See handout

30 Theoretical Background Results Simple regression results α and β - normally not within 2 SD of 0 and 1 R 2 decreases as time period increases D.W. close to zero Co-integration ADF test only significant for levels with low time period

31 Theoretical Background Results RF tests for non-linearity results majority of tests strongly support non-linearity of g op supports linearity for 1 one week - euro level 2 one week and one month us dollar level and return

32 Theoretical Background Results RF model results Strong support for non-linearity in exogenous variable except for nine month euro level all euro level results are within 2 S.D. of hypothesised values euro returns the βs are with 2 SD of one except for one year all dollar levels with 2 S.D. of hypothesised values results for dollar returns confused.

33 Fractional and Smith Results Theoretical Background Results See handout

34 Theoretical Background Results Figure 1: Expected value of likelihood function Euro-Sterling levels

35 Theoretical Background Results Figure 2: Expected value of likelihood function Dollar-Sterling levels

36 Theoretical Background Results Figure 3: Expected value of likelihood function Euro-Sterling returns

37 Theoretical Background Results Figure 4: Expected value of likelihood function Dollar-Sterling returns

Modelling Ireland s exchange rates: from EMS to EMU

Modelling Ireland s exchange rates: from EMS to EMU From the SelectedWorks of Derek Bond November, 2007 Modelling Ireland s exchange rates: from EMS to EMU Derek Bond, University of Ulster Available at: https://works.bepress.com/derek_bond/15/ Background

More information

Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III)

Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III) Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III) Florian Pelgrin HEC September-December 2010 Florian Pelgrin (HEC) Constrained estimators September-December

More information

Introduction to Estimation Methods for Time Series models Lecture 2

Introduction to Estimation Methods for Time Series models Lecture 2 Introduction to Estimation Methods for Time Series models Lecture 2 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 2 SNS Pisa 1 / 21 Estimators:

More information

BCT Lecture 3. Lukas Vacha.

BCT Lecture 3. Lukas Vacha. BCT Lecture 3 Lukas Vacha vachal@utia.cas.cz Stationarity and Unit Root Testing Why do we need to test for Non-Stationarity? The stationarity or otherwise of a series can strongly influence its behaviour

More information

If we want to analyze experimental or simulated data we might encounter the following tasks:

If we want to analyze experimental or simulated data we might encounter the following tasks: Chapter 1 Introduction If we want to analyze experimental or simulated data we might encounter the following tasks: Characterization of the source of the signal and diagnosis Studying dependencies Prediction

More information

Econometrics. Week 4. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague

Econometrics. Week 4. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Econometrics Week 4 Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Fall 2012 1 / 23 Recommended Reading For the today Serial correlation and heteroskedasticity in

More information

The Bootstrap: Theory and Applications. Biing-Shen Kuo National Chengchi University

The Bootstrap: Theory and Applications. Biing-Shen Kuo National Chengchi University The Bootstrap: Theory and Applications Biing-Shen Kuo National Chengchi University Motivation: Poor Asymptotic Approximation Most of statistical inference relies on asymptotic theory. Motivation: Poor

More information

Statistics and econometrics

Statistics and econometrics 1 / 36 Slides for the course Statistics and econometrics Part 10: Asymptotic hypothesis testing European University Institute Andrea Ichino September 8, 2014 2 / 36 Outline Why do we need large sample

More information

GARCH Models Estimation and Inference

GARCH Models Estimation and Inference GARCH Models Estimation and Inference Eduardo Rossi University of Pavia December 013 Rossi GARCH Financial Econometrics - 013 1 / 1 Likelihood function The procedure most often used in estimating θ 0 in

More information

Econometric Analysis of Cross Section and Panel Data

Econometric Analysis of Cross Section and Panel Data Econometric Analysis of Cross Section and Panel Data Jeffrey M. Wooldridge / The MIT Press Cambridge, Massachusetts London, England Contents Preface Acknowledgments xvii xxiii I INTRODUCTION AND BACKGROUND

More information

GLS and FGLS. Econ 671. Purdue University. Justin L. Tobias (Purdue) GLS and FGLS 1 / 22

GLS and FGLS. Econ 671. Purdue University. Justin L. Tobias (Purdue) GLS and FGLS 1 / 22 GLS and FGLS Econ 671 Purdue University Justin L. Tobias (Purdue) GLS and FGLS 1 / 22 In this lecture we continue to discuss properties associated with the GLS estimator. In addition we discuss the practical

More information

Econometrics II - EXAM Answer each question in separate sheets in three hours

Econometrics II - EXAM Answer each question in separate sheets in three hours Econometrics II - EXAM Answer each question in separate sheets in three hours. Let u and u be jointly Gaussian and independent of z in all the equations. a Investigate the identification of the following

More information

MEI Exam Review. June 7, 2002

MEI Exam Review. June 7, 2002 MEI Exam Review June 7, 2002 1 Final Exam Revision Notes 1.1 Random Rules and Formulas Linear transformations of random variables. f y (Y ) = f x (X) dx. dg Inverse Proof. (AB)(AB) 1 = I. (B 1 A 1 )(AB)(AB)

More information

(θ θ ), θ θ = 2 L(θ ) θ θ θ θ θ (θ )= H θθ (θ ) 1 d θ (θ )

(θ θ ), θ θ = 2 L(θ ) θ θ θ θ θ (θ )= H θθ (θ ) 1 d θ (θ ) Setting RHS to be zero, 0= (θ )+ 2 L(θ ) (θ θ ), θ θ = 2 L(θ ) 1 (θ )= H θθ (θ ) 1 d θ (θ ) O =0 θ 1 θ 3 θ 2 θ Figure 1: The Newton-Raphson Algorithm where H is the Hessian matrix, d θ is the derivative

More information

Quick Review on Linear Multiple Regression

Quick Review on Linear Multiple Regression Quick Review on Linear Multiple Regression Mei-Yuan Chen Department of Finance National Chung Hsing University March 6, 2007 Introduction for Conditional Mean Modeling Suppose random variables Y, X 1,

More information

Econ 583 Final Exam Fall 2008

Econ 583 Final Exam Fall 2008 Econ 583 Final Exam Fall 2008 Eric Zivot December 11, 2008 Exam is due at 9:00 am in my office on Friday, December 12. 1 Maximum Likelihood Estimation and Asymptotic Theory Let X 1,...,X n be iid random

More information

Lecture 7 Introduction to Statistical Decision Theory

Lecture 7 Introduction to Statistical Decision Theory Lecture 7 Introduction to Statistical Decision Theory I-Hsiang Wang Department of Electrical Engineering National Taiwan University ihwang@ntu.edu.tw December 20, 2016 1 / 55 I-Hsiang Wang IT Lecture 7

More information

[y i α βx i ] 2 (2) Q = i=1

[y i α βx i ] 2 (2) Q = i=1 Least squares fits This section has no probability in it. There are no random variables. We are given n points (x i, y i ) and want to find the equation of the line that best fits them. We take the equation

More information

Econometrics I, Estimation

Econometrics I, Estimation Econometrics I, Estimation Department of Economics Stanford University September, 2008 Part I Parameter, Estimator, Estimate A parametric is a feature of the population. An estimator is a function of the

More information

Supplemental Material for KERNEL-BASED INFERENCE IN TIME-VARYING COEFFICIENT COINTEGRATING REGRESSION. September 2017

Supplemental Material for KERNEL-BASED INFERENCE IN TIME-VARYING COEFFICIENT COINTEGRATING REGRESSION. September 2017 Supplemental Material for KERNEL-BASED INFERENCE IN TIME-VARYING COEFFICIENT COINTEGRATING REGRESSION By Degui Li, Peter C. B. Phillips, and Jiti Gao September 017 COWLES FOUNDATION DISCUSSION PAPER NO.

More information

Understanding Regressions with Observations Collected at High Frequency over Long Span

Understanding Regressions with Observations Collected at High Frequency over Long Span Understanding Regressions with Observations Collected at High Frequency over Long Span Yoosoon Chang Department of Economics, Indiana University Joon Y. Park Department of Economics, Indiana University

More information

Adjusted Empirical Likelihood for Long-memory Time Series Models

Adjusted Empirical Likelihood for Long-memory Time Series Models Adjusted Empirical Likelihood for Long-memory Time Series Models arxiv:1604.06170v1 [stat.me] 21 Apr 2016 Ramadha D. Piyadi Gamage, Wei Ning and Arjun K. Gupta Department of Mathematics and Statistics

More information

Response surface models for the Elliott, Rothenberg, Stock DF-GLS unit-root test

Response surface models for the Elliott, Rothenberg, Stock DF-GLS unit-root test Response surface models for the Elliott, Rothenberg, Stock DF-GLS unit-root test Christopher F Baum Jesús Otero UK Stata Users Group Meetings, London, September 2017 Baum, Otero (BC, U. del Rosario) DF-GLS

More information

Financial Econometrics

Financial Econometrics Material : solution Class : Teacher(s) : zacharias psaradakis, marian vavra Example 1.1: Consider the linear regression model y Xβ + u, (1) where y is a (n 1) vector of observations on the dependent variable,

More information

Cointegration Lecture I: Introduction

Cointegration Lecture I: Introduction 1 Cointegration Lecture I: Introduction Julia Giese Nuffield College julia.giese@economics.ox.ac.uk Hilary Term 2008 2 Outline Introduction Estimation of unrestricted VAR Non-stationarity Deterministic

More information

Linear Regression. In this problem sheet, we consider the problem of linear regression with p predictors and one intercept,

Linear Regression. In this problem sheet, we consider the problem of linear regression with p predictors and one intercept, Linear Regression In this problem sheet, we consider the problem of linear regression with p predictors and one intercept, y = Xβ + ɛ, where y t = (y 1,..., y n ) is the column vector of target values,

More information

Advanced Quantitative Methods: maximum likelihood

Advanced Quantitative Methods: maximum likelihood Advanced Quantitative Methods: Maximum Likelihood University College Dublin 4 March 2014 1 2 3 4 5 6 Outline 1 2 3 4 5 6 of straight lines y = 1 2 x + 2 dy dx = 1 2 of curves y = x 2 4x + 5 of curves y

More information

1 Mixed effect models and longitudinal data analysis

1 Mixed effect models and longitudinal data analysis 1 Mixed effect models and longitudinal data analysis Mixed effects models provide a flexible approach to any situation where data have a grouping structure which introduces some kind of correlation between

More information

Response surface models for the Elliott, Rothenberg, Stock DF-GLS unit-root test

Response surface models for the Elliott, Rothenberg, Stock DF-GLS unit-root test Response surface models for the Elliott, Rothenberg, Stock DF-GLS unit-root test Christopher F Baum Jesús Otero Stata Conference, Baltimore, July 2017 Baum, Otero (BC, U. del Rosario) DF-GLS response surfaces

More information

The outline for Unit 3

The outline for Unit 3 The outline for Unit 3 Unit 1. Introduction: The regression model. Unit 2. Estimation principles. Unit 3: Hypothesis testing principles. 3.1 Wald test. 3.2 Lagrange Multiplier. 3.3 Likelihood Ratio Test.

More information

Nonconcave Penalized Likelihood with A Diverging Number of Parameters

Nonconcave Penalized Likelihood with A Diverging Number of Parameters Nonconcave Penalized Likelihood with A Diverging Number of Parameters Jianqing Fan and Heng Peng Presenter: Jiale Xu March 12, 2010 Jianqing Fan and Heng Peng Presenter: JialeNonconcave Xu () Penalized

More information

5. Erroneous Selection of Exogenous Variables (Violation of Assumption #A1)

5. Erroneous Selection of Exogenous Variables (Violation of Assumption #A1) 5. Erroneous Selection of Exogenous Variables (Violation of Assumption #A1) Assumption #A1: Our regression model does not lack of any further relevant exogenous variables beyond x 1i, x 2i,..., x Ki and

More information

GARCH Models Estimation and Inference

GARCH Models Estimation and Inference Università di Pavia GARCH Models Estimation and Inference Eduardo Rossi Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function

More information

GARCH Models Estimation and Inference. Eduardo Rossi University of Pavia

GARCH Models Estimation and Inference. Eduardo Rossi University of Pavia GARCH Models Estimation and Inference Eduardo Rossi University of Pavia Likelihood function The procedure most often used in estimating θ 0 in ARCH models involves the maximization of a likelihood function

More information

1.1 Basis of Statistical Decision Theory

1.1 Basis of Statistical Decision Theory ECE598: Information-theoretic methods in high-dimensional statistics Spring 2016 Lecture 1: Introduction Lecturer: Yihong Wu Scribe: AmirEmad Ghassami, Jan 21, 2016 [Ed. Jan 31] Outline: Introduction of

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference

More information

Wavelet Methods for Time Series Analysis. Part IV: Wavelet-Based Decorrelation of Time Series

Wavelet Methods for Time Series Analysis. Part IV: Wavelet-Based Decorrelation of Time Series Wavelet Methods for Time Series Analysis Part IV: Wavelet-Based Decorrelation of Time Series DWT well-suited for decorrelating certain time series, including ones generated from a fractionally differenced

More information

LECTURE ON HAC COVARIANCE MATRIX ESTIMATION AND THE KVB APPROACH

LECTURE ON HAC COVARIANCE MATRIX ESTIMATION AND THE KVB APPROACH LECURE ON HAC COVARIANCE MARIX ESIMAION AND HE KVB APPROACH CHUNG-MING KUAN Institute of Economics Academia Sinica October 20, 2006 ckuan@econ.sinica.edu.tw www.sinica.edu.tw/ ckuan Outline C.-M. Kuan,

More information

Simple and Multiple Linear Regression

Simple and Multiple Linear Regression Sta. 113 Chapter 12 and 13 of Devore March 12, 2010 Table of contents 1 Simple Linear Regression 2 Model Simple Linear Regression A simple linear regression model is given by Y = β 0 + β 1 x + ɛ where

More information

Lasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices

Lasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices Article Lasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices Fei Jin 1,2 and Lung-fei Lee 3, * 1 School of Economics, Shanghai University of Finance and Economics,

More information

Modelling of Economic Time Series and the Method of Cointegration

Modelling of Economic Time Series and the Method of Cointegration AUSTRIAN JOURNAL OF STATISTICS Volume 35 (2006), Number 2&3, 307 313 Modelling of Economic Time Series and the Method of Cointegration Jiri Neubauer University of Defence, Brno, Czech Republic Abstract:

More information

Ma 3/103: Lecture 24 Linear Regression I: Estimation

Ma 3/103: Lecture 24 Linear Regression I: Estimation Ma 3/103: Lecture 24 Linear Regression I: Estimation March 3, 2017 KC Border Linear Regression I March 3, 2017 1 / 32 Regression analysis Regression analysis Estimate and test E(Y X) = f (X). f is the

More information

Regression, Ridge Regression, Lasso

Regression, Ridge Regression, Lasso Regression, Ridge Regression, Lasso Fabio G. Cozman - fgcozman@usp.br October 2, 2018 A general definition Regression studies the relationship between a response variable Y and covariates X 1,..., X n.

More information

Modification and Improvement of Empirical Likelihood for Missing Response Problem

Modification and Improvement of Empirical Likelihood for Missing Response Problem UW Biostatistics Working Paper Series 12-30-2010 Modification and Improvement of Empirical Likelihood for Missing Response Problem Kwun Chuen Gary Chan University of Washington - Seattle Campus, kcgchan@u.washington.edu

More information

Univariate, Nonstationary Processes

Univariate, Nonstationary Processes Univariate, Nonstationary Processes Jamie Monogan University of Georgia March 20, 2018 Jamie Monogan (UGA) Univariate, Nonstationary Processes March 20, 2018 1 / 14 Objectives By the end of this meeting,

More information

Problem Selected Scores

Problem Selected Scores Statistics Ph.D. Qualifying Exam: Part II November 20, 2010 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. Problem 1 2 3 4 5 6 7 8 9 10 11 12 Selected

More information

Univariate Unit Root Process (May 14, 2018)

Univariate Unit Root Process (May 14, 2018) Ch. Univariate Unit Root Process (May 4, 8) Introduction Much conventional asymptotic theory for least-squares estimation (e.g. the standard proofs of consistency and asymptotic normality of OLS estimators)

More information

Casuality and Programme Evaluation

Casuality and Programme Evaluation Casuality and Programme Evaluation Lecture V: Difference-in-Differences II Dr Martin Karlsson University of Duisburg-Essen Summer Semester 2017 M Karlsson (University of Duisburg-Essen) Casuality and Programme

More information

Darmstadt Discussion Papers in Economics

Darmstadt Discussion Papers in Economics Darmstadt Discussion Papers in Economics The Effect of Linear Time Trends on Cointegration Testing in Single Equations Uwe Hassler Nr. 111 Arbeitspapiere des Instituts für Volkswirtschaftslehre Technische

More information

Multivariate Tests of the CAPM under Normality

Multivariate Tests of the CAPM under Normality Multivariate Tests of the CAPM under Normality Bernt Arne Ødegaard 6 June 018 Contents 1 Multivariate Tests of the CAPM 1 The Gibbons (198) paper, how to formulate the multivariate model 1 3 Multivariate

More information

The Power of the KPSS Test for Cointegration when Residuals are Fractionally Integrated 1

The Power of the KPSS Test for Cointegration when Residuals are Fractionally Integrated 1 The Power of the KPSS Test for Cointegration when Residuals are Fractionally Integrated 1 by Philipp Sibbertsen 2 and Walter Krämer Fachbereich Statistik, Universität Dortmund, D-44221 Dortmund, Germany

More information

Nonresponse weighting adjustment using estimated response probability

Nonresponse weighting adjustment using estimated response probability Nonresponse weighting adjustment using estimated response probability Jae-kwang Kim Yonsei University, Seoul, Korea December 26, 2006 Introduction Nonresponse Unit nonresponse Item nonresponse Basic strategy

More information

CALCULATION METHOD FOR NONLINEAR DYNAMIC LEAST-ABSOLUTE DEVIATIONS ESTIMATOR

CALCULATION METHOD FOR NONLINEAR DYNAMIC LEAST-ABSOLUTE DEVIATIONS ESTIMATOR J. Japan Statist. Soc. Vol. 3 No. 200 39 5 CALCULAION MEHOD FOR NONLINEAR DYNAMIC LEAS-ABSOLUE DEVIAIONS ESIMAOR Kohtaro Hitomi * and Masato Kagihara ** In a nonlinear dynamic model, the consistency and

More information

Model comparison and selection

Model comparison and selection BS2 Statistical Inference, Lectures 9 and 10, Hilary Term 2008 March 2, 2008 Hypothesis testing Consider two alternative models M 1 = {f (x; θ), θ Θ 1 } and M 2 = {f (x; θ), θ Θ 2 } for a sample (X = x)

More information

Empirical Likelihood

Empirical Likelihood Empirical Likelihood Patrick Breheny September 20 Patrick Breheny STA 621: Nonparametric Statistics 1/15 Introduction Empirical likelihood We will discuss one final approach to constructing confidence

More information

Econ 510 B. Brown Spring 2014 Final Exam Answers

Econ 510 B. Brown Spring 2014 Final Exam Answers Econ 510 B. Brown Spring 2014 Final Exam Answers Answer five of the following questions. You must answer question 7. The question are weighted equally. You have 2.5 hours. You may use a calculator. Brevity

More information

Generalised AR and MA Models and Applications

Generalised AR and MA Models and Applications Chapter 3 Generalised AR and MA Models and Applications 3.1 Generalised Autoregressive Processes Consider an AR1) process given by 1 αb)x t = Z t ; α < 1. In this case, the acf is, ρ k = α k for k 0 and

More information

A Panel Test of Purchasing Power Parity. under the Null of Stationarity.

A Panel Test of Purchasing Power Parity. under the Null of Stationarity. A Panel Test of Purchasing Power Parity under the Null of Stationarity. John Hunter * and Mark Simpson Department of Economics, Brunel University, Uxbridge, Middlesex UB8 3PH Abstract Purchasing Power

More information

High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data

High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data High Dimensional Empirical Likelihood for Generalized Estimating Equations with Dependent Data Song Xi CHEN Guanghua School of Management and Center for Statistical Science, Peking University Department

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7

More information

Likelihood-Based Methods

Likelihood-Based Methods Likelihood-Based Methods Handbook of Spatial Statistics, Chapter 4 Susheela Singh September 22, 2016 OVERVIEW INTRODUCTION MAXIMUM LIKELIHOOD ESTIMATION (ML) RESTRICTED MAXIMUM LIKELIHOOD ESTIMATION (REML)

More information

Testing an Autoregressive Structure in Binary Time Series Models

Testing an Autoregressive Structure in Binary Time Series Models ömmföäflsäafaäsflassflassflas ffffffffffffffffffffffffffffffffffff Discussion Papers Testing an Autoregressive Structure in Binary Time Series Models Henri Nyberg University of Helsinki and HECER Discussion

More information

1 Estimation of Persistent Dynamic Panel Data. Motivation

1 Estimation of Persistent Dynamic Panel Data. Motivation 1 Estimation of Persistent Dynamic Panel Data. Motivation Consider the following Dynamic Panel Data (DPD) model y it = y it 1 ρ + x it β + µ i + v it (1.1) with i = {1, 2,..., N} denoting the individual

More information

Lecture 5: Unit Roots, Cointegration and Error Correction Models The Spurious Regression Problem

Lecture 5: Unit Roots, Cointegration and Error Correction Models The Spurious Regression Problem Lecture 5: Unit Roots, Cointegration and Error Correction Models The Spurious Regression Problem Prof. Massimo Guidolin 20192 Financial Econometrics Winter/Spring 2018 Overview Stochastic vs. deterministic

More information

Estimating functions for inhomogeneous spatial point processes with incomplete covariate data

Estimating functions for inhomogeneous spatial point processes with incomplete covariate data Estimating functions for inhomogeneous spatial point processes with incomplete covariate data Rasmus aagepetersen Department of Mathematics Aalborg University Denmark August 15, 2007 1 / 23 Data (Barro

More information

Testing for non-stationarity

Testing for non-stationarity 20 November, 2009 Overview The tests for investigating the non-stationary of a time series falls into four types: 1 Check the null that there is a unit root against stationarity. Within these, there are

More information

11/18/2008. So run regression in first differences to examine association. 18 November November November 2008

11/18/2008. So run regression in first differences to examine association. 18 November November November 2008 Time Series Econometrics 7 Vijayamohanan Pillai N Unit Root Tests Vijayamohan: CDS M Phil: Time Series 7 1 Vijayamohan: CDS M Phil: Time Series 7 2 R 2 > DW Spurious/Nonsense Regression. Integrated but

More information

Likelihood Ratio Tests. that Certain Variance Components Are Zero. Ciprian M. Crainiceanu. Department of Statistical Science

Likelihood Ratio Tests. that Certain Variance Components Are Zero. Ciprian M. Crainiceanu. Department of Statistical Science 1 Likelihood Ratio Tests that Certain Variance Components Are Zero Ciprian M. Crainiceanu Department of Statistical Science www.people.cornell.edu/pages/cmc59 Work done jointly with David Ruppert, School

More information

Financial Time Series Analysis: Part II

Financial Time Series Analysis: Part II Department of Mathematics and Statistics, University of Vaasa, Finland Spring 2017 1 Unit root Deterministic trend Stochastic trend Testing for unit root ADF-test (Augmented Dickey-Fuller test) Testing

More information

Birkbeck Working Papers in Economics & Finance

Birkbeck Working Papers in Economics & Finance ISSN 1745-8587 Birkbeck Working Papers in Economics & Finance Department of Economics, Mathematics and Statistics BWPEF 1809 A Note on Specification Testing in Some Structural Regression Models Walter

More information

Greene, Econometric Analysis (6th ed, 2008)

Greene, Econometric Analysis (6th ed, 2008) EC771: Econometrics, Spring 2010 Greene, Econometric Analysis (6th ed, 2008) Chapter 17: Maximum Likelihood Estimation The preferred estimator in a wide variety of econometric settings is that derived

More information

Long memory and changing persistence

Long memory and changing persistence Long memory and changing persistence Robinson Kruse and Philipp Sibbertsen August 010 Abstract We study the empirical behaviour of semi-parametric log-periodogram estimation for long memory models when

More information

On the Power of Tests for Regime Switching

On the Power of Tests for Regime Switching On the Power of Tests for Regime Switching joint work with Drew Carter and Ben Hansen Douglas G. Steigerwald UC Santa Barbara May 2015 D. Steigerwald (UCSB) Regime Switching May 2015 1 / 42 Motivating

More information

y it = α i + β 0 ix it + ε it (0.1) The panel data estimators for the linear model are all standard, either the application of OLS or GLS.

y it = α i + β 0 ix it + ε it (0.1) The panel data estimators for the linear model are all standard, either the application of OLS or GLS. 0.1. Panel Data. Suppose we have a panel of data for groups (e.g. people, countries or regions) i =1, 2,..., N over time periods t =1, 2,..., T on a dependent variable y it and a kx1 vector of independent

More information

Elements of Multivariate Time Series Analysis

Elements of Multivariate Time Series Analysis Gregory C. Reinsel Elements of Multivariate Time Series Analysis Second Edition With 14 Figures Springer Contents Preface to the Second Edition Preface to the First Edition vii ix 1. Vector Time Series

More information

Invariance of the first difference in ARFIMA models

Invariance of the first difference in ARFIMA models Computational Statistics DOI 10.1007/s00180-006-0005-0 ORIGINAL PAPER Invariance of the first difference in ARFIMA models Barbara P. Olbermann Sílvia R.C. Lopes Valdério A. Reisen Physica-Verlag 2006 Abstract

More information

A COMPARISON OF ESTIMATION METHODS IN NON-STATIONARY ARFIMA PROCESSES. October 30, 2002

A COMPARISON OF ESTIMATION METHODS IN NON-STATIONARY ARFIMA PROCESSES. October 30, 2002 A COMPARISON OF ESTIMATION METHODS IN NON-STATIONARY ARFIMA PROCESSES Lopes, S.R.C. a1, Olbermann, B.P. a and Reisen, V.A. b a Instituto de Matemática - UFRGS, Porto Alegre, RS, Brazil b Departamento de

More information

MS&E 226: Small Data. Lecture 11: Maximum likelihood (v2) Ramesh Johari

MS&E 226: Small Data. Lecture 11: Maximum likelihood (v2) Ramesh Johari MS&E 226: Small Data Lecture 11: Maximum likelihood (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 18 The likelihood function 2 / 18 Estimating the parameter This lecture develops the methodology behind

More information

8. Hypothesis Testing

8. Hypothesis Testing FE661 - Statistical Methods for Financial Engineering 8. Hypothesis Testing Jitkomut Songsiri introduction Wald test likelihood-based tests significance test for linear regression 8-1 Introduction elements

More information

Robust methods for detecting multiple level breaks in autocorrelated time series

Robust methods for detecting multiple level breaks in autocorrelated time series Robust methods for detecting multiple level breaks in autocorrelated time series by David I. Harvey, Stephen J. Leybourne and A. M. Robert Taylor Granger Centre Discussion Paper No. 10/01 Robust Methods

More information

Exogeneity tests and weak identification

Exogeneity tests and weak identification Cireq, Cirano, Départ. Sc. Economiques Université de Montréal Jean-Marie Dufour Cireq, Cirano, William Dow Professor of Economics Department of Economics Mcgill University June 20, 2008 Main Contributions

More information

Introductory Econometrics

Introductory Econometrics Based on the textbook by Wooldridge: : A Modern Approach Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna December 17, 2012 Outline Heteroskedasticity

More information

MA Advanced Econometrics: Applying Least Squares to Time Series

MA Advanced Econometrics: Applying Least Squares to Time Series MA Advanced Econometrics: Applying Least Squares to Time Series Karl Whelan School of Economics, UCD February 15, 2011 Karl Whelan (UCD) Time Series February 15, 2011 1 / 24 Part I Time Series: Standard

More information

Economic modelling and forecasting

Economic modelling and forecasting Economic modelling and forecasting 2-6 February 2015 Bank of England he generalised method of moments Ole Rummel Adviser, CCBS at the Bank of England ole.rummel@bankofengland.co.uk Outline Classical estimation

More information

Consistent estimation of the memory parameter for nonlinear time series

Consistent estimation of the memory parameter for nonlinear time series Consistent estimation of the memory parameter for nonlinear time series Violetta Dalla, Liudas Giraitis and Javier Hidalgo London School of Economics, University of ork, London School of Economics 18 August,

More information

Zellner s Seemingly Unrelated Regressions Model. James L. Powell Department of Economics University of California, Berkeley

Zellner s Seemingly Unrelated Regressions Model. James L. Powell Department of Economics University of California, Berkeley Zellner s Seemingly Unrelated Regressions Model James L. Powell Department of Economics University of California, Berkeley Overview The seemingly unrelated regressions (SUR) model, proposed by Zellner,

More information

Appendix A: The time series behavior of employment growth

Appendix A: The time series behavior of employment growth Unpublished appendices from The Relationship between Firm Size and Firm Growth in the U.S. Manufacturing Sector Bronwyn H. Hall Journal of Industrial Economics 35 (June 987): 583-606. Appendix A: The time

More information

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors Laura Mayoral IAE, Barcelona GSE and University of Gothenburg Gothenburg, May 2015 Roadmap of the course Introduction.

More information

This chapter reviews properties of regression estimators and test statistics based on

This chapter reviews properties of regression estimators and test statistics based on Chapter 12 COINTEGRATING AND SPURIOUS REGRESSIONS This chapter reviews properties of regression estimators and test statistics based on the estimators when the regressors and regressant are difference

More information

QED. Queen s Economics Department Working Paper No. 1324

QED. Queen s Economics Department Working Paper No. 1324 QED Queen s Economics Department Working Paper No. 1324 Quasi-Maximum Likelihood Estimation and Bootstrap Inference in Fractional Time Series Models with Heteroskedasticity of Unknown Form Giuseppe Cavaliere

More information

Geographically Weighted Regression as a Statistical Model

Geographically Weighted Regression as a Statistical Model Geographically Weighted Regression as a Statistical Model Chris Brunsdon Stewart Fotheringham Martin Charlton October 6, 2000 Spatial Analysis Research Group Department of Geography University of Newcastle-upon-Tyne

More information

Journal of Econometrics. Semiparametric inference in multivariate fractionally cointegrated systems

Journal of Econometrics. Semiparametric inference in multivariate fractionally cointegrated systems Journal of Econometrics 57 00) 49 5 Contents lists available at ScienceDirect Journal of Econometrics journal homepage: wwwelseviercom/locate/jeconom Semiparametric inference in multivariate fractionally

More information

Let us first identify some classes of hypotheses. simple versus simple. H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided

Let us first identify some classes of hypotheses. simple versus simple. H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided Let us first identify some classes of hypotheses. simple versus simple H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided H 0 : θ θ 0 versus H 1 : θ > θ 0. (2) two-sided; null on extremes H 0 : θ θ 1 or

More information

Economics 536 Lecture 7. Introduction to Specification Testing in Dynamic Econometric Models

Economics 536 Lecture 7. Introduction to Specification Testing in Dynamic Econometric Models University of Illinois Fall 2016 Department of Economics Roger Koenker Economics 536 Lecture 7 Introduction to Specification Testing in Dynamic Econometric Models In this lecture I want to briefly describe

More information

Likely causes: The Problem. E u t 0. E u s u p 0

Likely causes: The Problem. E u t 0. E u s u p 0 Autocorrelation This implies that taking the time series regression Y t X t u t but in this case there is some relation between the error terms across observations. E u t 0 E u t E u s u p 0 Thus the error

More information

Econometrics of Panel Data

Econometrics of Panel Data Econometrics of Panel Data Jakub Mućk Meeting # 9 Jakub Mućk Econometrics of Panel Data Meeting # 9 1 / 22 Outline 1 Time series analysis Stationarity Unit Root Tests for Nonstationarity 2 Panel Unit Root

More information

Introduction Large Sample Testing Composite Hypotheses. Hypothesis Testing. Daniel Schmierer Econ 312. March 30, 2007

Introduction Large Sample Testing Composite Hypotheses. Hypothesis Testing. Daniel Schmierer Econ 312. March 30, 2007 Hypothesis Testing Daniel Schmierer Econ 312 March 30, 2007 Basics Parameter of interest: θ Θ Structure of the test: H 0 : θ Θ 0 H 1 : θ Θ 1 for some sets Θ 0, Θ 1 Θ where Θ 0 Θ 1 = (often Θ 1 = Θ Θ 0

More information

TECHNICAL REPORT # 59 MAY Interim sample size recalculation for linear and logistic regression models: a comprehensive Monte-Carlo study

TECHNICAL REPORT # 59 MAY Interim sample size recalculation for linear and logistic regression models: a comprehensive Monte-Carlo study TECHNICAL REPORT # 59 MAY 2013 Interim sample size recalculation for linear and logistic regression models: a comprehensive Monte-Carlo study Sergey Tarima, Peng He, Tao Wang, Aniko Szabo Division of Biostatistics,

More information

Final Exam November 24, Problem-1: Consider random walk with drift plus a linear time trend: ( t

Final Exam November 24, Problem-1: Consider random walk with drift plus a linear time trend: ( t Problem-1: Consider random walk with drift plus a linear time trend: y t = c + y t 1 + δ t + ϵ t, (1) where {ϵ t } is white noise with E[ϵ 2 t ] = σ 2 >, and y is a non-stochastic initial value. (a) Show

More information

UCD CENTRE FOR ECONOMIC RESEARCH WORKING PAPER SERIES

UCD CENTRE FOR ECONOMIC RESEARCH WORKING PAPER SERIES UCD CENTRE FOR ECONOMIC RESEARCH WORKING PAPER SERIES 009 Exploring Long Meory and Nonlinearity in Irish Real Exchange Rates using Tests based on Seiparaetric Estiation Derek Bond, University of Ulster,

More information