N-CONSISTENT SEMIPARAMETRIC REGRESSION: UNIT ROOT TESTS WITH NONLINEARITIES. 1. Introduction

Similar documents
Supplemental Material for KERNEL-BASED INFERENCE IN TIME-VARYING COEFFICIENT COINTEGRATING REGRESSION. September 2017

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Darmstadt Discussion Papers in Economics

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Testing for non-stationarity

Robust Unit Root and Cointegration Rank Tests for Panels and Large Systems *

Econometric Methods for Panel Data

Testing Error Correction in Panel data

LM threshold unit root tests

Non-Stationary Time Series and Unit Root Testing

Model Specification Testing in Nonparametric and Semiparametric Time Series Econometrics. Jiti Gao

Christopher Dougherty London School of Economics and Political Science

On the Long-Run Variance Ratio Test for a Unit Root

Working Paper No Unit Root Testing with Stationary Covariates and a Structural Break in the Trend Function

Non-Stationary Time Series and Unit Root Testing

Nonstationary Panels

A Test of Cointegration Rank Based Title Component Analysis.

This chapter reviews properties of regression estimators and test statistics based on

On detection of unit roots generalizing the classic Dickey-Fuller approach

Econometrics. Week 11. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague

E 4101/5101 Lecture 9: Non-stationarity

Simulating Properties of the Likelihood Ratio Test for a Unit Root in an Explosive Second Order Autoregression

BCT Lecture 3. Lukas Vacha.

Steven Cook University of Wales Swansea. Abstract

Unit Root Testing in Heteroskedastic Panels using the Cauchy Estimator

The Impact of the Initial Condition on Covariate Augmented Unit Root Tests

EC821: Time Series Econometrics, Spring 2003 Notes Section 9 Panel Unit Root Tests Avariety of procedures for the analysis of unit roots in a panel

On Perron s Unit Root Tests in the Presence. of an Innovation Variance Break

A PANIC Attack on Unit Roots and Cointegration. July 31, Preliminary and Incomplete

Modelling of Economic Time Series and the Method of Cointegration

On Bootstrap Implementation of Likelihood Ratio Test for a Unit Root

Non-Stationary Time Series and Unit Root Testing

E 4160 Autumn term Lecture 9: Deterministic trends vs integrated series; Spurious regression; Dickey-Fuller distribution and test

Econ 423 Lecture Notes: Additional Topics in Time Series 1

Econometrics of Panel Data

Moreover, the second term is derived from: 1 T ) 2 1

by Ye Cai and Mototsugu Shintani

Multivariate Time Series: Part 4

Unit Root and Cointegration

The Number of Bootstrap Replicates in Bootstrap Dickey-Fuller Unit Root Tests

Robust Backtesting Tests for Value-at-Risk Models

Title. Description. Quick start. Menu. stata.com. xtcointtest Panel-data cointegration tests

Economic modelling and forecasting. 2-6 February 2015

Flexible Estimation of Treatment Effect Parameters

A TIME SERIES PARADOX: UNIT ROOT TESTS PERFORM POORLY WHEN DATA ARE COINTEGRATED

G. S. Maddala Kajal Lahiri. WILEY A John Wiley and Sons, Ltd., Publication

Questions and Answers on Unit Roots, Cointegration, VARs and VECMs

Nonstationary time series models

Panel Unit Root Tests in the Presence of Cross-Sectional Dependencies: Comparison and Implications for Modelling

ARDL Cointegration Tests for Beginner

Fall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.

TESTING SERIAL CORRELATION IN SEMIPARAMETRIC VARYING COEFFICIENT PARTIALLY LINEAR ERRORS-IN-VARIABLES MODEL

Bootstrapping Long Memory Tests: Some Monte Carlo Results

ECONOMETRICS II, FALL Testing for Unit Roots.

Bootstrapping Long Memory Tests: Some Monte Carlo Results

The Role of "Leads" in the Dynamic Title of Cointegrating Regression Models. Author(s) Hayakawa, Kazuhiko; Kurozumi, Eiji

Tests for Cointegration, Cobreaking and Cotrending in a System of Trending Variables

Test for Structural Change in Vector Error Correction Models 1

A nonparametric test for seasonal unit roots

Nonsense Regressions due to Neglected Time-varying Means

Bootstrapping the Grainger Causality Test With Integrated Data

1 Introduction. April 23, 2010

Testing for unit roots with stationary covariates

Why Segregating Cointegration Test?

Response surface models for the Elliott, Rothenberg, Stock DF-GLS unit-root test

Taking a New Contour: A Novel View on Unit Root Test 1

Volume 03, Issue 6. Comparison of Panel Cointegration Tests

Final Exam November 24, Problem-1: Consider random walk with drift plus a linear time trend: ( t

A Bootstrap Test for Conditional Symmetry

Trend and initial condition in stationarity tests: the asymptotic analysis

Econ 623 Econometrics II Topic 2: Stationary Time Series

11/18/2008. So run regression in first differences to examine association. 18 November November November 2008

Do Markov-Switching Models Capture Nonlinearities in the Data? Tests using Nonparametric Methods

A Fixed-b Perspective on the Phillips-Perron Unit Root Tests

Econometrics of Panel Data

Psychology 282 Lecture #4 Outline Inferences in SLR

A PANIC Attack on Unit Roots and Cointegration

Some Monte Carlo Evidence for Adaptive Estimation of Unit-Time Varying Heteroscedastic Panel Data Models

Lecture 7: Dynamic panel models 2

Density estimation Nonparametric conditional mean estimation Semiparametric conditional mean estimation. Nonparametrics. Gabriel Montes-Rojas

Vector error correction model, VECM Cointegrated VAR

Groupe de Recherche en Économie et Développement International. Cahier de recherche / Working Paper 08-17

Choice of Spectral Density Estimator in Ng-Perron Test: Comparative Analysis

A New Approach to Robust Inference in Cointegration

7. Integrated Processes

Unit Root Tests for Panels in the Presence of Short-run and Long-run Dependencies: Nonlinear IV Approach with Fixed N and Large T 1

Lecture 5: Unit Roots, Cointegration and Error Correction Models The Spurious Regression Problem

Testing for Unit Roots in Small Panels with Short-run and Long-run Cross-sectional Dependencies 1

ECON 616: Lecture Two: Deterministic Trends, Nonstationary Processes

Quantile methods. Class Notes Manuel Arellano December 1, Let F (r) =Pr(Y r). Forτ (0, 1), theτth population quantile of Y is defined to be

Independent and conditionally independent counterfactual distributions

Generalized Autoregressive Score Models

QED. Queen s Economics Department Working Paper No Improved Likelihood Ratio Tests for Cointegration Rank in the VAR Model

Model Specification Test with Correlated but not Cointegrated Variables

Diagnostic Test for GARCH Models Based on Absolute Residual Autocorrelations

Discussion of Bootstrap prediction intervals for linear, nonlinear, and nonparametric autoregressions, by Li Pan and Dimitris Politis

Empirical Market Microstructure Analysis (EMMA)

On the robustness of cointegration tests when series are fractionally integrated

Nonstationary Time Series:

Nonparametric Econometrics

Transcription:

-COSISTET SEMIPARAMETRIC REGRESSIO: UIT ROOT TESTS WITH OLIEARITIES TED JUHL AD ZHIJIE XIAO Abstract. We develop unit root tests using additional time series as suggested in Hansen 995). However, we allow for the covariate to enter the model in a nonlinear fashion, so that our model is an extension of the semiparametric model analyzed in Robinson 988). It is proven that the autoregressive parameter is estimated at rate even though part of the model is estimated nonparametrically. The limiting distribution is a mixture of a standard normal and the Dickey-Fuller distribution. A Monte Carlo experiment is used to evaluate the performance of the tests for various linear and nonlinear specifications.. Introduction Increasing power in unit root tests has become an important research topic in recent years. Elliot, Rothenberg, and Stock 996) propose an estimation strategy which focuses on estimating potential trends under the alternative hypothesis in order to effectively reach the Gaussian power envelope for unit root tests. Another branch of the unit root literature focuses on using some other features of the time series data. For example, Lucas 995) uses M-estimators to take advantage of non-gaussian errors in unit root tests. His results show that power gains are possible, even if the M-estimator does not coincide with the true likelihood. Using rank based tests, Hasan and Koenker 997) are also able to realize increased power under certain error distributions while experiencing a small loss in power if the errors are actually Gaussian. Seo 999) simultaneously estimates GARCH effects along with the autoregressive coefficients to increase power. Shin and So 999) and Beelders 999) use adaptive estimation to nonparametrically estimate the density of errors, and again obtain large Ted Juhl, Department of Economics, University of Kansas and Zhijie Xiao, Department of Economics, University of Illinois at Urbana Champaign.

Unit Root Tests power gains, particularly if the error terms are heavy-tailed. Hansen 995) shows that inclusion of stationary covariates can generate more precise estimates of the autoregressive parameter, translating into higher power for unit root tests. The extension of these methods to the multivariate case in models of cointegration has been explored as well. The multivariate treatment of estimating trends is provided in Xiao and Phillips 998). Lucas 997) and Boswijk and Lucas 999) use likelihood-ratio type tests and adaptive estimation to test for the number of cointegrating vectors in a multivariate system. Seo 998) extends Hansen s 995) result to incorporate additional stationary time series in a multivariate system. Phillips 995) proposes estimating cointegrating relationships using least absolute deviations or M-estimation and illustrates the improved performance of the estimators. In all of the papers listed above, some additional information is used to improve efficiency in the estimation of autoregressive parameters. In this way, the goal is to improve power against linear alternatives. To treat potential nonlinearities, Phillips and Park 999) propose an even more general framework in which they allow for a nonlinear autoregressive structure. The convergence of the nonparametric estimator of the autoregressive function in the unit root case is at rate /4. In this paper, we allow for an unknown nonlinear function of covariates to influence the time series while still retaining a partially linear model. In allowing such a general structure, we hope to further increase the power gains from using covariates, particularly if there is a nonlinear relationship with the chosen covariate. Since the form of the nonlinearity is unknown, we estimate this part of the model nonparametrically while retaining the linear specification for the autoregressive component. There are several findings in this paper. First, by using the compromise of a partial linear model, the convergence for the autoregressive component remains at rate. This is an important extension of Robinson s 988) result to the nonstationary case. In addition, the limiting distribution of the unit root test is identical to the distribution found in Hansen 995) where covariates are used in a linear fashion.

Ted Juhl and Zhijie Xiao 3 This implies that, asymptotically, there is no loss from our general framework using an unknown nonlinear component rather than assuming a linear structure and using OLS. Finally, in the course of proving our theorem, we show that nonparametrically regressing an I) series on an I0) series is asymptotcially equivalent to an OLS regression of the I) series on a constant. The outline of the paper is as follows. In Section, we develop the model and provide a brief description of the estimation procedure. Section 3 provides the assumptions and asymptotic distribution of the test. A small Monte Carlo experiment is given in Section 4 and Section 5 concludes. otation is standard with weak convergence denoted by and convergence in probability by. p. The Model We begin with a simple time series model with deterministic component d i y i = d i + s i s i = δs i + v i where the error term v i has mean zero. covariates which help explain v i, so that However, there are additional stationary v i = gx i ) + ɛ i with ɛ i and x i iid random variables. Let g : R q R and Egx i )) = µ g. Following Hansen 995), we define σ vɛ = Ev i ɛ i ), σ v = Ev i ), σ ɛ = Eɛ i ), and ρ = σ vɛ. σvσ ɛ First, consider the case where d i = µ so that the model becomes.) y i = µ + δy i + gx i ) + ɛ i,

4 Unit Root Tests where µ = δµ µ g. Following Robinson 988), we obtain an estimate of δ in two steps. First, we regress y i and y i nonparametrically on x i. The nonparametric estimation uses a adaraya-watson kernel estimator which we illustrate below. Let ku) be the univariate kernel and we denote Ku) = q p= ku p) if u is q dimensional. In addition, let ) xi x j K ij = K a where a is a bandwidth parameter. Then we have ˆf i = a q ) j= K ij ŷ i = j= K ijy j j= K ij ˆ y i = j= K ij y j j= K. ij We trim out small values of ˆfi which will appear in the denominator of our nonparamteric estimates. Hence, we define I i = I ˆf i > b) for some b > 0. The residuals from regressing y i and y i on x i are denoted ê d and ê y respectively. ext, we regress ê d on ê y using OLS and incorporating the trimming to obtain ) ˆδ = ê yii i ê yi ê di I i. ow consider the case where d i = µ + θi so that the model becomes.) y i = µ + θ i + δy i + gx i ) + ɛ i, where µ = θ δµ µ g and θ = δθ. We introduce another term which accounts for the estimated trend, î = j= K ijj j= K. ij Let the residual from regressing the trend on x i be denoted ê ti = i î. In order to get an estimate of δ, we regress ê d on ê y and ê t using OLS and incorporating the trimming procedure. Then ˆδ is the estimated coefficient on ê y.

Ted Juhl and Zhijie Xiao 5 3. Limiting Distribution We derive the limiting distribution of our estimator in this section. For purposes of determining asymptotic distributions, we use local to unity asymptotics so that δ = c/. Under the null hypothesis of a unit root, c = 0, while under c 0, the alternative hypothesis becomes increasingly difficult to detect as the sample size increases. We follow convention and denote W c r) the solution to the stochastic differential equation dw c r) = cw c r) + dw r), where W r) is a continuous stochastic process. The following definitions are given in Robinson 988). Definition : K l, l >, is the class of even functions k : R R satisfying u i ku)du = δ i0 i = 0,,..., l ) R ku) = O + u l++ɛ ) ) for some ɛ > 0. Definition : Gµ α, α > 0, µ > 0, is the class of functions g : R q R satisfying: g is m ) times partially differentiable, for m ) µ m; for some η > 0, sup y φzη gy) gz) Q g y, z) / y z µ h g z) for all z, where φ zη = {y : y z < η}; Q g = 0 when m =, Q g is an m )th degree homogeneous polynomial in y z with coefficients the partial derivatives of g at z of orders through m when m > ; and gz), its partial derivatives of order m and less, and h g z), have finite αth moments. These definitions are used to put conditions on the number of zero moments of the kernel and to provide moment and smoothness conditions for the nonlinear function and the density of the covariate. We begin by stating a Lemma which is used throughout the proof of the main theorem.

6 Unit Root Tests Lemma 3.. Let fx) be the density of x i. If sup x fx) <, E gx) <, and sup u ku) + ku) du <, then 3.) ŷ i ȳ)i i = o p ). The above result indicates that if one nonparametrically regresses y i on x i, the predicted value behaves asymptotically as if we used the sample mean. This is intuitive because we are attempting to explain a nonstationary series with a stationary series. Since such a regression is inconsistent, the sample mean is the default result. The lemma can be generalized to cases where y i is generated independently of x i rather than in the manner suggested in.). Theorem 3.. Suppose the following conditions hold: i) x i and ɛ i are independent and identically distributed; ii) E ɛ 4 < ; iii) x has pdf f G λ, for some λ > 0; iv) g G 4 ν, for some ν > 0; v) as, a q b 4 0, a minλ+,ν) q b 4 0; v) k K l+n for integers l and n such that l < λ l,n < ν n; vi) σ v > 0 and ρ > 0; vii) µ g = 0. Then 3.) ˆδ δ) W τ ) ) ρ W τ dw + ρ ρ 4 W τ dw ), where W and W are independent standard Brownian motions, W τ = W c r) W c s)ds for model.) and W τ = W c r)+6r 4) W c s)ds r 6) W c s)s ds for model.). The t-statistic based on ˆδ has limiting distrubution 3.3) tˆδ) c ρ W τ ) ) + ) W τ ) ρ W τ dw ) + ρ 0, ). Assumptions i)-v) are similar to Robinson 988). The limiting distribution given in Theorem 3. is identical to Theorem in Hansen 995). However, unlike Hansen, we are unable to estimate a third model, one without a constant term. The reason is the well known fact that in this form of semiparametric estimation, the intercept

Ted Juhl and Zhijie Xiao 7 term is not idenitifed. The apparent lack of identification arises because we have already implicitly estimated an intercept in the nonparametric regression, and no such effect remains. That we cannot estimate a model without an intercept is not a drawback in the nonstationary case since one would at least estimate an intercept even in the simplest unit root test and even if an intercept is not present under the null hypothesis. As further evidence that this effect is indeed accounted for, notice the presence of demeaned Ornstein-Uhlenbeck processes in the limiting distribution of the proposed estimator, as expected from estimating an intercept. The limiting distribution in Theorem 3. also appears in various other related unit root tests. In particular, similiar or identical) limiting distributions arise in Hasan and Koenker 997) for their unmodified statistic S T based on ranks, in Lucas 995) for unit root tests based on M-estimators, and in Seo 999) for unit root tests allowing for GARCH effects. Beelders 999) and Shin and So 999) also obtained the same limiting distribution for unit root tests when adaptive estimation is used. The distribution has the disadvantage that ρ is a remaining nuisance parameter. There have been various approaches for dealing with the nuisance parameter, ranging from simulating critical values for each value of the parameter to using conservative critical values to cover the range of possible ρ. We use the simulated critical values from Hansen 995) in a limited Monte Carlo experiment given in the next section. 4. Monte Carlo We consider several specifications of gx), both linear and nonlinear to compare the standard Dickey-Fuller test, Hansen s 995) CADF test, and the new tests using the partial linear model which we denote PLMUR. The data generating process is y i = δy i + g j x i ) + ɛ i, j =,..., 5. See Hamilton 994), chapter 7 for a discussion on inclusion of deterministic terms in tests for unit roots. The case with an estimated intercept when no intercept is present corresponds to case in chapter 7 of Hamilton.

8 Unit Root Tests The different functions are listed below. g x) = 0 g x) = x g 3 x) = logx) g 4 x) = x g 5 x) = x 3 x The x variables are all standard normal except in g 3 x) where x is log-normally distributed. When g x) is used, we expect the Dickey-Fuller test to perform the best as there is no x effect to detect. The function g x) gives the CADF test of Hansen the advantage since the covariate enter linearly. The other specifications are nonlinear, so that the PLMUR tests should be more powerful if the nonlinearity is estimated reasonably. Smaller values of ρ are indicative of the effectiveness of covariates in explaining variation in v i = gx i ) + ɛ i. Therefore, we expect more powerful tests if ρ is small. Straightforward calculations show that ρ = ρ = 0.0 ρ 3 = 0.50 ρ 4 = 0.5 ρ 5 = 0.0 where ρ j is associated with g j x).

Ted Juhl and Zhijie Xiao 9 For the PLMUR test, we need to select a kernel and a bandwidth. In our experiment, we chose the Epanechnikov kernel given by.75 u ) if u [, ], ku) = 0 otherwise. The bandwidth was set to 5 for all specifications and sample sizes. The PLMUR test and the CADF test both require estimates of ρ. We compute these using the residuals from each of the regressions and then use the resulting estimate to select a critical value from Table in Hansen 995). We explore size and power by changing the value of c in δ = c. For each specification, we generate sample sizes of 00 and 00 and compute 0,000 replications. The results appear in Table. For c = 0, we have a unit root and we compare the size for each of the tests. The DF test has size close to the nominal 5% for all choices of gx) but the CADF is actually undersized for the linear, log, and cubic cases. The PLMUR test is slightly oversized when there are no covariates in the data generating process, yet this distortion is mitigated by the increase in sample size. The size result for the PLMUR test indicates that the asymptotic theory provides an accurate approximation for the distribution of the statistic. For c = 3, the departure from the unit root becomes apparent in the increased rejection frequencies. All of the tests perform similarly when there is no covariate effect, indicating that little is lost when estimating a partial linear model even when it is not warranted. Moreover, for g, the linear effect, the PLMUR test competes favorably with the CADF test, suggesting that when there is a linear effect, the loss in using the more general PLMUR test is small as well. The advantage of the PLMUR test becomes apparent when the log specification is considered. Power is roughly The computations took around 0 days on a Pentium 600 computer. The programs were written in Ox.0, see Doornik 998).

0 Unit Root Tests double the competing tests here as the covariate is successfully used to reduce the variance of the estimator of δ. For the quadratic function, the difference is more pronounced with the PLMUR test generating triple the power of the competing tests. Finally, using the cubic function, power is six times that of the other tests since the true value of ρ is.0 in this case. Similar results are obtained for the other local alternatives of c = 6 and c = 9 with all tests increasing in power as the alternative becomes more obvious. In all cases where covariates are correctly chosen, both the CADF and the PLMUR test dominate the standard Dickey-Fuller tests. In all cases where there is a nonlinear effect, the PLMUR test is the most powerful, with power increasing as ρ decreases. 5. Conclusions We have proposed a unit root test based on estimating a partial linear model where a covariate enters the model nonlinearly. The relevant asymptotic theory was developed and we provided a limited Monte Carlo experiment to examine the performance of the test. The results indicate that the test effectively exploits the nonlinear effect to increase power substantially. In addition, it appears that in our simple case, estimating a partial linear model is benign even in cases where the covariates do not have a nonlinear effect. There are several issues which remain. First, an extension to allow non iid settings is necessary. An extension to an augmented Dickey-Fuller test is straightforward since the coefficients of the lagged y i terms will converge at a slower rate than the nonstationary components. A more ambitious project is to allow dependence in x i. The complication arises because the kernels will be evaluated at values of x i x j which will depend on the difference i j. As a practical matter, the issue of bandwidth selection needs to be treated carefully, with the development of some type of cross-validation procedure. Finally, an obvious extension to the multivariate case of cointegration is possible. This is currently being undertaken by the authors.

Ted Juhl and Zhijie Xiao Table : Size and Power =00 =00 DF CADF PLMUR DF CADF PLMUR g 0.0457 0.0478 0.080 0.0484 0.0495 0.0670 g 0.0487 0.063 0.0540 0.0484 0.03 0.0479 c = 0 g 3 0.0464 0.0339 0.0660 0.048 0.036 0.0594 g 4 0.0498 0.0493 0.0568 0.05 0.050 0.0507 g 5 0.0530 0.039 0.0400 0.053 0.037 0.040 g 0.0940 0.0950 0.60 0.0894 0.096 0.30 g 0.0894 0.3639 0.4638 0.0856 0.3368 0.466 c = 3 g 3 0.087 0.07 0.45 0.0886 0.0 0.039 g 4 0.0857 0.0878 0.3056 0.08 0.083 0.978 g 5 0.070 0.036 0.638 0.0693 0.0949 0.68 g 0.67 0.707 0.998 0.505 0.530 0.734 g 0.589 0.7897 0.8460 0.537 0.7789 0.8547 c = 6 g 3 0.640 0.594 0.469 0.55 0.365 0.444 g 4 0.60 0.679 0.6457 0.456 0.57 0.6496 g 5 0.43 0.777 0.940 0.365 0.605 0.9480 g 0.956 0.970 0.3366 0.707 0.70 0.90 g 0.3043 0.9569 0.9780 0.760 0.9559 0.9747 c = 9 g 3 0.309 0.48 0.705 0.745 0.453 0.7046 g 4 0.866 0.3039 0.8667 0.75 0.8 0.874 g 5 0.673 0.58 0.9800 0.60 0.4907 0.993 Appendix A. To begin, use y i = i l=0 c/)i l gx l ) + ɛ l ). Without loss of generality, we find the convergence rates for c = 0, the case of a unit root. otice that we also are assuming that the initial value is y 0 = 0.

Unit Root Tests Proof of Lemma 3.: The proof is given in a technical appendix available from the authors upon request. Appendix B. We prove Theorem 3. for model.) in this appendix. ote that ˆδ δ) = D E + F )) where D = y i ŷ i ) I i E = y i ŷ i ) gx i ) ĝx i ) + ˆɛ i ) I i i F = y i ŷ i ) ɛ i I i i The theorem holds if we can show that D σv W τ s)) ds, E p 0, F σ v σ ɛ ρ W τ dw + ρ W τ dw ) We prove these results in a series of six propositions. Proposition. B.) y i ŷ i )ɛ i I i σ v σ ɛ ρ W τ dw + ρ W τ dw ) Proof of Proposition : The proof follows if which we show by E p ŷ i ȳ)ɛ i I i 0, ) ŷ i ȳ)ɛ i I i 0.

E Ted Juhl and Zhijie Xiao 3 ) ŷ i ȳ)ɛ i I i = E ŷ i ȳ) ɛ i I i + ŷ i ȳ)ŷ j ȳ)ɛ i ɛ j I i I j i j }{{}}{{} A B We have E ŷ i ȳ) I i = O a q b ) so that EA) = O a q b ). For part B, we find the order of the terms of the form Eŷ i ȳ)ŷ j ȳ)ɛ i ɛ j K ik l= = E K il l= K il k= ) y k ) K jm ) ) l= K jl l= K y m ɛ i ɛ j jl Conditioning on X = x 0,..., x ) and taking expectations, we find that the order is the same as the order of E K ik ) l= K il B.) l= K il k= m= m= K jm ) l= K jl l= K. jl By identity of distribution, B.) has terms of the form ) E K ik K jm K ik K jk l= K il l= K. jl Taking the expected value of the absolute value the above term is O 3 a q b ), implying that EB) = O a q b ). Proposition. p y i ȳ)ȳ ŷ i )I i 0. Proof of Proposition : ) E B.3) y 4 i ȳ)ȳ ŷ i )I i Ey i ȳ) E ȳ ŷ i) I i by Loève s c r inequality and Cauchy-Schwartz. Since E ȳ ŷ i) I i = O a q b ) and Ey i ȳ) = O), then B.3) is O a q b ).

4 Unit Root Tests Proposition 3. ȳ ŷ i ) p I i 0 Proof of Proposition 3: The proof is given in a technical appendix available from the authors upon request. Proposition 4. y i ŷ i ) I i W W ) Proof of Proposition 4: y i ŷ i ) I i = y i ȳ) + + ȳ ŷ i ) I i y i ȳ)ȳ ŷ i )I i The second and third terms on the right hand side converge to zero by Propositions and 3. Proposition 5. p y i ŷ i )ˆɛ i I i 0. Proof of Proposition 5: The proof appears in a technical appendix available from the authors upon request. Proposition 6. p y i ŷ i )gx i ) ĝx i ))I i 0. Proof of Proposition 6: The proof appears in a technical appendix available from the authors upon request.

Ted Juhl and Zhijie Xiao 5 Appendix C. We prove Theorem 3. for model.). We define w i = θi + y i so that the relationship between the previous propositions and those given in this appendix is more transparent. The joint estimators for δ, β) are given by ˆδ wê w ê wê t = ˆβ ê wê w ê, ê t ê w ê t ê t ê i ê w where ê w, ê w, and ê t are the residuals from nonparametrically regressing w, w, and a trend on x i. A rotation of the type in Fuller 976) is applied to facilitate the proof. ê w θê t ) ê w θê t ) 0 ˆδ = θ 3 3 ˆβ ê t ê w θê t ) 5 ê w θê t ) ê t 5 ê t ê t 3 ê w θê t ) ê w ê t ê w We show the joint) convergence of the above terms in a series of propositions. otice that using the rotation above, we generate ê wi θê ti = w i ŵ i θi î) 3 C.) = θi + y i θî ŷ i θi + θî = y i ŷ i. This allows us to use some of the results in Appendix B in the remaining proofs. Proposition 7. C.) ê wi θê ti ) I d W i W ) Proof of Proposition 7 The result follows by Proposition 4.

6 Unit Root Tests Proposition 8. C.3) E ) î I i = O p a q b ) Proof of Proposition 8 j ) E j K ij j K ij ) ) I i a q b) E K ij j ). Then ) E K ij j ) = j EKij ) + j EK ij K il ) l ) j j j l }{{}}{{} A B Part A is Oa q ). otice that we can pull out EK ij K il by identity of distribution and note j l j ) l ) = j = 4 = O), j ) j j j 3 + + ) 4 ) so that part B is Oa q ). Proposition 9. C.4) 5 Proof of Proposition 9 5 We first write ê wi θê ti )ê ti I d W i W ) sds ê yi θê ti )ê ti I i = 5 y i ŷ i )ii i 5 y i ŷ i )îi i. 5 y i ŷ i )i = 5 y i ȳ)i + 5 ȳ ŷ i )i.

Then E 5 ȳ ŷ i )i) = 5 E Ted Juhl and Zhijie Xiao 7 ȳ ŷ i ) i I i + 5 E i j ȳ ŷ i )ȳ ŷ j )iji i I j Using the Cauchy-Schwartz inequality and the fact that Eȳ ŷ i ) I i = Oa q b ), the above term is O a q b ). It is well known that 5 y i ȳ)i W W )sds, so it remains to show that C.5) It is easy to see that 5 3 p y i ŷ i )îi i 0. y i ŷ i ) I p i 0 using Lemma 3. so it is enough to show that 3 3 y i ŷ i ) î )I i = 3 The expectation of part A squared is 3 y i ŷ i ) î )I p i 0. y i ȳ) î )I i + 3 } {{ } A ȳ ŷ i ) î )I i } {{ } B Ey i ȳ) î ) I i + 3 Ey i ȳ)y j ȳ) î ) ĵ )I ii j i j This term is clearly O a q b ) from Proposition 8. The expectation of part B squared is 3 Eȳ ŷ i ) î ) I i + 3 Eȳ ŷ i )ȳ ŷ j ) î ) ĵ )I ii j i j which is seen to be O a q b 4 ).

8 Unit Root Tests Proposition 0. 3 ê tii i p Proof of Proposition 0 3 ê ti = i + î ) which can be written as i ) + For the first term, i ) )) ) î + î i ) since i E i / and 3 i /3. ext, i ) )) î = 4 E + 4 E i j i i ) î ) ) î ) j ) ĵ which is O a q b ) by Proposition 8 and Cauchy-Schwartz. Then ) E î For part A, consider ) = 4 E î 4 }{{} A ) î 4 ) 4 a q b) 4 E K ij j ). j= ) ) ) + 4 E î ˆl i l }{{} B

Using Loève s c r inequality, we have ) 4 E K ij i ) 3 Ted Juhl and Zhijie Xiao 9 j= j= K 4 ij j )4, so that part A is O 3 a 3q b 4 ). By Cauchy-Schwartz and Proposition 8, part B is O 4 a q b 4 ). Proposition. 3 i î)ɛ i I d i s )dw s) Proof of Proposition : The proof is completed by showing that ) î p ɛ i 0. Conditioning on X and using the independence of ɛ i gives ) ) E î ɛ i = E which is O a q b ). î ) ɛ i Proposition. 3 p i î)ˆɛ i I i 0 Proof of Proposition : Again, we break this term into two parts: 3 For the part A, E i î)ˆɛ i I i = i )ˆɛ ii i + } {{ } A ) i )ˆɛ ii i = E i )ˆɛ i I i + E i l î )ˆɛ ii i. }{{} B i ) i )ˆɛ iˆɛ l I i I l

0 Unit Root Tests The first part of the above term is O a q b ). Using the fact that Eˆɛ iˆɛ l I i I l is identical for i l and the fact that i l i/ /)l/ /) = O), part A is O p / a q/ b ). For part B, E ) î )ˆɛ ii i = E + E i l î )ˆɛ i I i î ) ˆl )ˆɛ iˆɛ l I i I l Using Cauchy-Schwartz,??), and Proposition 8, part B is O p / a q b ). Proposition 3. 3 p i î)gx i ) ĝx i ))I i 0 Proof of Proposition 3: The proof is identical to the proof of Proposition with the exception that Proposition of Robinson is applied to gx i ) ĝx i ) as??) was applied to ˆɛ i. The order is O p / a q/ b + a ζ b ) where ζ = minλ +, ν) as in Proposition 6. References Beelders, O. 999): Adaptive Estimation and Unit Root Tests, Emory University. Boswijk, H. P., and A. Lucas 997): Semi-nonparametric Cointegration Testing, Vrije Universiteit, Amsterdam. Doornik, J. A. 998): Ox-An Object Oriented Matrix Programming Language. London: Timberlake Consultants Press. Elliot, G., T. J. Rothenberg, and J. H. Stock 996): Efficient Tests for an Autoregressive Unit Root, Econometrica, 64, 83 836. Hansen, B. E. 995): Rethinking the Univariate Approach to Unit Root Testing, Econometric Theory,, 48 7. Hasan, M.., and R. W. Koenker 997): Robust Rank Tests of the Unit Root Hyptothesis, Econometrica, 65, 33 6.

Ted Juhl and Zhijie Xiao Lucas, A. 995): Unit Root Tests Based on M Estimators, Econometric Theory,, 33 346. 997): Cointegration Testing Using Pseudolikelihood Ratio Tests, Econometric Theory, 3, 49 69. Phillips, P. C. B. 995): Robust onstationary Regression, Econometric Theory,, 9 95. Phillips, P. C. B., and J. Y. Park 998): onstationary Density Estimation and Kernel Autoregression, Yale University. Robinson, P. M. 988): Root--Consistent Semiparametric Regression, Econometrica, 56, 93 954. Seo, B. 998): Statistical Inference on Cointegrating Rank in Error Correction Models with Stationary Covariates, Journal of Econometrics, 85, 339 385. 999): Distribution Theory for Unit Root Tests with Conditional Heteroskedasticity, Journal of Econometrics, 9, 3 44. Shin, D. W., and B. S. So 999): Unit Root Tests Based on Adaptive Maximum Likelihood Estimation, Econometric Theory, 5, 3. Xiao, Z., and P. C. B. Phillips 999): Efficient Detrending in Cointegrating Regression, Econometric Theory, 5, 59 548.