Limit Theory for VARs with Mixed Roots Near Unity

Size: px
Start display at page:

Download "Limit Theory for VARs with Mixed Roots Near Unity"

Transcription

1 Limit Theory for VARs with Mixed Roots Near Uity Peter C. B. Phillips Yale Uiversity, Uiversity of Aucklad, Sigapore Maagemet Uiversity & Uiversity of Southampto Ji Hyug Lee Yale Uiversity August, Abstract Limit theory is developed for ostatioary vector autoregressio (VAR) with mixed roots i the viciity of uity ivolvig persistet ad explosive compoets. Statistical tests for commo roots are examied ad model selectio approaches for discrimiatig roots are explored. The results are useful i empirical testig for multiple maifestatios of ostatioarity i particular for distiguishig mildly explosive roots from roots that are local to uity ad for testig commoality i persistece. Keywords: Commo roots, Local to uity, Mildly explosive, Mixed roots, Model selectio, Persistece, Tests of commo roots. JEL classi catio: C Itroductio Ama Ullah s cotributios cover a wide spectrum of ecoometrics with sustaied scieti c work over the last four decades i ite sample theory, oparametric estimatio, spatial ecoometrics, pael data modelig, acial ecoometrics, time series ad applied This paper is based o the rst part of a Yale take home examiatio i /. The authors thak the Editor ad two referees for helpful ad costructive commets o the origial versio. Phillips ackowledges support from the NSF uder Grat No. SES

2 ecoometrics. His advaced textbook o Noparametric Ecoometrics (999, with Adria Paga) has bee particularly i uetial, helpig to educate a geeratio of ecoometricias i oparametric methods ad providig a accessible referece for applied researchers. His moograph o Fiite Sample Ecoometrics (4) ecapsulates may of his ow cotributios to this subject ad touches some of the wider reaches of this di cult ad vitally importat eld. Oe eld of ecoometrics that his work has less frequetly touched is ostatioary time series ad uit root limit theory. Sice the mid 98s models with autoregressive roots i the viciity of uity have attracted much attetio. These models are particularly useful i empirical work with ostatioary series whe it may be too restrictive to isist o the presece of roots precisely at uity or where mildly itegrated or mildly explosive behavior may be more relevat tha uit roots. Whe multiple time series are cosidered, it may be useful to allow simultaeously for various types of behavior i the idividual series: some roots that are local to uity (of the form + c for xed c ad give sample size ) ad others that are mildly itegrated (of the form + b k for xed b < ad a sequece k! slower tha ) or mildly explosive (of the form + b k for xed b > xed ad a similar sequece k! slower tha ). Roots of the latter form lie i a wide ad thereby accommodate some iterestig alteratives viciity of uity of radius O k where the behavior of the process, icludig its limit behavior, di er from that of the radom waderig character associated with uit root processes. The mathematical form of these roots ivolves the localizig coe ciet b ad a rate sequece k which it is ofte coveiet to write i the expoet form k for some parameter (; ) : Limit theory for regressors with roots local to uity developed early i the literature of this eld (Phillips, 987b; Cha ad Wei, 987). More recet work has cosidered mildly itegrated ad mildly explosive cases (Phillips ad Magdalios, 7a, 7b; [PM7a&b]). The latter theory has proved particularly relevat i studyig data durig periods of - acial exuberace (Phillips, Wu ad Yu, ; Phillips ad Yu, ). I such cases, exuberace ca be modeled i terms of a mildly explosive process with a autoregressive root + b k for which b > ad k + k! : It is especially iterestig i practical work to study trasitios betwee ormal market behavior, which ca be represeted i terms of a uit root or ear uit root model, ad exuberat behavior. The emergece of market exuberace or a asset price bubble may the be modeled as a structural break i which the (log ru) autoregressive coe ciet of the model shifts from beig ear to uity to mildly explosive. Datig such a trasitio amouts to date stampig the emer-

3 gece of exuberace. A similar trasitio from a exuberat to a mildly itegrated or mea revertig process captures the collapse of a asset price bubble ad correspodigly eables the date stampig of bubble termiatio. Phillips, Wu ad Yu () ad Phillips ad Yu () showed how to perform tests of these hypotheses ad costruct date stampig algorithms that were empirically implemeted to characterize the 99s Nasdaq bubble ad the evets leadig up to ad followig the recet global acial crisis. The work i those papers dealt with the special case where the ormal period model was a strict uit root process. The methods of the preset paper allow for these methods to be exteded to the wider class of local to uity processes (for ormal periods) ad eable tests to be developed to distiguish such roots from mildly explosive ad mildly itegrated roots, thereby wideig the rage of potetial empirical applicatios. I particular, the preset paper cosiders time series models with mixed ad commo roots i the viciity of uity. To simplify expositio, we work with a bivariate model ad aalyze a case of primary iterest where there is oe local to uit root ad oe mildly explosive root. Models of this type may be aticipated whe there are maifestatios of ostatioarity i the data but somewhat di eret idividual characteristics i the two series. Or it may be that the behavior is commo across the series for istace i several asset prices arisig from a sigle source of persistece or exuberace. We may be particularly iterested empirically i testig commoality i persistece or log ru behavior across series, which occurs whe the autoregressive roots have the same value. The methods of the curret paper eable empirical researchers to coduct such tests. The remaider of the paper is orgaized as follows. Sectio cosiders mixed VARs whose variates have mixed degrees of persistece that allow for a local to uit root ad a mildly explosive root. A limit theory for least squares regressio ad associated Wald tests for commoality i the autoregressive coe ciets is developed. Sice the ull hypothesis is composite ad ivolves the ukow (local to uity) localizig coe ciet, stadard Wald tests have limit distributios that are parameter depedet ad do ot have uiform size. Modi ed Wald statistics for testig commoality i log ru behavior are developed ad show to produce cosistet tests. I particular, this modi catio esures that the tests are completely cosistet i the sese that size goes to zero ad power to uity asymptotically. Sectio 3 cosiders a model selectio approach ad shows that the BIC criterio ca also distiguish persistet ad mildly explosive behavior. Sectio 4 cocludes. A techical Appedix icludes subsidiary lemmas ad proofs of the mai results. 3

4 Mixed Variate VARs For simplicity of expositio, we cosider the bivariate VAR() model X t R X t + u t ; t ; :::; ; (.) R ; + c ; + b ; b > ; (.) k which we write i compoet form as X t X t X t X t + u t u t ; t ; :::; (.3) with iitializatio X o p k ; ad martigale di erece iovatios u t satisfyig Assumptio below. Our results may be exteded to systems with weakly depedet errors u t uder coditios like those i the liear process framework of Magdalios ad Phillips (9), but all the key ideas follow as i the simpler VAR() model studied here so we do ot provide details. The coe ciet + c is local to uity, + b k is a mildly explosive coe ciet with b > ad the sequece k satis es k + k! as! : The power rate k for (; ) satis es this latter coditio as well as coditios we use later i the paper to develop cosistet test procedures that ivolve slowly varyig fuctios L! : I particular L! for all such fuctios L : Although! as! (so both coe ciets are i the viciity of uity), k! b > ad so is further from uity tha for all ite c as! : I order to distiguish the mildly explosive behavior iduced by from the persistece iduced by, statistical tests eed to di eretiate from for all ite c as! : As we will show, cosistet tests ca be costructed to discrimiate betwee such localizig coe ciets. The fact that cosistet tests of hypotheses ivolvig localizig coe ciets is possible is relevat to practical work where there is substatial iterest i idetifyig exuberace i asset price data. It is also of theoretical iterest because it is well kow that the localizig coe ciet c caot be cosistetly estimated i local to uity speci catios. By cotrast, the localizig coe ciet b i mildly itegrated ad mildly explosive speci - catios is cosistetly estimable, ad it is this feature of the model that makes possible cosistet testig of di ereces i localizig behavior. The diagoal form of R i (.) coforms with stadard practice i the stochastically 4

5 ostatioary literature. The presece of o-zero o diagoal elemets i R iduces higher order stochastic treds or explosive mechaisms i the time series, at least uless those coe ciets are local to zero or egligible. Hece, o-zero o diagoal elemets i R result i ampli ed feedback across series i ostatioary autoregressios. It is therefore covetioal practice to retai a diagoal form R i developig a limit theory, as we do here. Of course, if the cotext ad characteristics of the series suggest the presece of such feedbacks the they may be icluded ad their e ects o the limit theory ca be aalyzed. Assumptio. The errors fu t g i (.) form a martigale di erece sequece with respect to the atural ltratio F t (u t ; u t ; :::) satisfyig E Ft u t u t ad EFt ku t k a:s: for all t (.4) for some > ad positive de ite matrix ; sup t E ku t k 4 < ; ad max E ku t k fku t k > g! as! (.5) t for ay sequece ( ) N such that!, ad where is the spectral orm of the matrix M: o kmk max i i : i is a eigevalue of M M As expected from the di ereces i the coe ciets ad i (.3), the time series compoets X t ad X t have di eret orders of magitude as! : These di ereces traslate ito di eret rates of covergece of the sample momets of X t ad the least squares regressio compoets. To accommodate these di ereces we employ the (asymptotically equivalet) ormalizig matrices D : k ad F : ( ) The urestricted least squares regressio estimate of R i (.) is writte i stadard otatio as ^R X X X X : This estimate is cosistet ad has a limit distributio that is obtaied from a combiatio of fuctioal limit theory that applies to : 5

6 the persistet compoets ad cetral limit theory that applies to the mildly explosive compoets, as detailed i the followig result. Theorem. As! ; ^R R F ) R J c(r)db(r) R J c(r) dr Y (b) X (b) : ; (.6) where J c (r) R r ec(r s) db (s); which is a Orstei-Uhlebeck (O-U) process, B (r) (B (r) ; B (r)) is bivariate Browia motio with variace matrix ; X(b) (X (b) ; X (b)) N(; b ); Y (b) d X(b); ad X(b) ad Y (b) are idepedet. The two colum compoets R J c(r)db(r) of the limitig matric variate are idepedet. R J c(r) dr ad Y (b) X (b) Remarks. The two colums of ^R R coverge at di eret rates, the rst at the usual O () rate for ear itegrated regressios ad the secod at the mildly explosive rate O (k ) O k e bk : I particular, writig ( ij ) ; we have ( ) (br r ) ) (br r ) ) R J c(r)db (r) R J ; (.7) c(r) dr R J c(r)db (r) R J ; (.8) c(r) dr ( ) (br r ) ) Y (b) X (b) ; ( ) (br r ) ) Y (b) X (b) : (.9). The process J c (r) R r ec(r s) db (s) that appears i the limit variate ivolves compoet B (r) of B(r); so that the limit variate R J c(r)db (r) R J c(r) dr has a stadard local uit root distributio that is idepedet of but is depedet o c: 3. The limit variate Y (b) X (b) (b) Y (b) : Y (b) X (b) X is idepedet of b ad we ca therefore write Y (b) X (b) : Y X ; where Y N (; ) ; X (X ; X ) N (; ) ; ad X ad Y are idepedet. 6

7 As idicated earlier, we may be iterested i testig commoality of persistece characteristics i the compoet series X t ad X t : I the preset case, settig R (r ij ) ad uder a maitaied hypothesis that R is diagoal with roots local to uity, commoality amouts to testig the hypothesis H : r r + c for some ite c ( ; ) : The ull ca be writte as H : a vec (R ) where a [; ; ; ] without explicitly specifyig a commo persistece parameter r + c: H may also be subsumed i a block test of R r I for some r + c ; which we ca write i the form HA : A vec (R ) where we use row vectorizatio i the vec operator ad A 6 4 The stadard Wald test of H uses the statistic W : 4 a a a : a o vec ^R a ^ X X a ; ad the correspodig block test of H A has the form W A A vec ^R A ^ o X X A A vec ^R A ^ X o X A A vec ^R A vec ^R ; where ^ P t ^u t^u t is a cosistet estimator of based o the least squares residuals ^u t X t ^R X t : b k Uder (.3) the coe ciets r ad r ; so that r r c o(); which is local to zero. Hece the model (.) actually correspods to a local alterative to the ull H : Theorem. Uder the ull hypothesis H : R r I with r + c, as! b k W ) a (a ) R ; (.) J c(r)j c (r) a 7

8 ad Z ) W A ) A A ( J c (r)j c (r) dr A! A ; (.) where J c (r) R r ec(r s) db(s); vec () ad R dbj c R J cj c : Uder the alterative H : R diag ( ; ) k b W ; W A R f + o p ()g O p : (.) J c(r) k dr Remarks 4. The ull limit distributios (.) ad (.) are parameter depedet. The depedece ivolves the localizig coe ciet c ad the variace matrix : Whe c ; Z Z Z Z dbb BB dv V V V : V where V BM (I ) is stadard vector Browia motio. The limit distributio of the Wald statistic is the W ) a a V R V V a (b V ) R b I V V b ; (.3) where V vec ( V ) ad b a (a ( ) a ) lies o the uit sphere b b : Thus, eve i the case of a commo uit root, the ull limit distributio of the test depeds o ; although this matrix is cosistetly estimable by the residual momet matrix ^: I the geeral case, the limit distributios (.) ad (.) both have uisace parameters (c; ) : 5. The parameter c is ot cosistetly estimable ad it is therefore ot possible to costruct a stadard test of the composite H : However, modi ed tests are available to distiguish H from alteratives that ivolve a mildly explosive compoet. For istace, for some (possibly slowly varyig) sequece L! ; the statistic W L 8

9 W L! p uder H for all ite c: The, uder the alterative hypothesis H ; W L O p kl which diverges for all sequeces L! such that k L! : I particular, if k O ( ) for some (; ) ad L is slowly varyig at i ity, the W L O ( ) p L! as! ad tests based o the statistic W L with ay xed critical value are cosistet ad have zero size asymptotically. Similar remarks apply to the block test based o WL A W A L : 6. I view of (.), W ; W A O p ad the Wald statistics diverge, as do the k scaled statistics W L ad WL A. So there is discrimiatory power uder the local alterative H : r + c ; r + b k : 3 Model Selectio Aother approach to testig for commo roots i (.) is to apply model selectio methods. This ivolves estimatig (.) i the restricted case uder the ull of a commo root ad uder the alterative of urestricted roots. Estimatig (.) uder the restrictio R r I gives the pooled least squares estimator ^r ( P t X tx t ) P t X t X t of the commo root r : We have the followig limit theory for ^r uder the ull hypothesis ad alterative. Lemma 3. (i) Uder the ull R r I with r + c ; ^r has the limit distributio Z (^r r ) ) Z J c (r) db J c (r) J c (r)dr ; (3.) ad the residual momet matrix ~ P t ~u t~u t! p ; where ~u t X t ^r X t ; has the form ~ X u t u t + O : (3.) t (ii) Uder the alterative hypothesis where R diag ( ; ) ; ^r has the limit distributio k (^r ) ) b Y (b) X (b) ; (3.3) For example, asymptotic critical values might be computed for the limit distributio (.3) with I ad b a (a a) 9

10 where Y (b) d X (b) N ; b ad Y (b) ad X (b) are idepedet. The residual momet matrix ~ of the restricted regressio has the followig asymptotic behavior uder the alterative hypothesis: ~ X t u t u t + b k P t X t f + o p ()g : (3.4) Sice P t u tu t! p, it follows from (3.) that ~ is cosistet for uder the ull. However, from (3.4) ad the fact that P t X t ) R J c ; it is apparet that ~ is cosistet for whe o k but is icosistet whe k O () ad, i particular, whe k o : These results eable us to determie coditios for the cosistecy of model selectio criteria such as the Schwarz criterio (BIC). are: For the model (.), the restricted regressio ad urestricted regressio BIC criteria BIC r log ~ + log ; BIC u log ^ + 4 log : Whe the ull holds ad R r I it is evidet that BIC r log ~ + log log + log + O p ; (3.5) whereas for the urestricted regressio BIC u log ^ + 4 log log + 4 log + O p (3.6) sice ^ + O p aalogous to the proof of (3.). I view of (3.5) ad (3.6), BIC r < BIC u up to a term of O p : The restricted model will therefore be correctly chose with probability approachig uity uder the ull. Whe the alterative holds, (3.6) cotiues to apply for the urestricted regressio. But uder the alterative for the restricted regressio we have from (3.4) log ~ log + b P t X t k f + o p ()g log + log I + b P t X t f + o p ()g k

11 where : log + b tr ( k log jj + b k tr ( P t X t P t X t log jj + b P t X t k f + o p ()g ; : : The ) ) f + o p ()g f + o p ()g BIC r log ~ + log log + b P t X t f + o p ()g + log : : k It follows that BIC r > BIC u uder the alterative as! wheever b P t X t k : > 3 log ; which iequality holds with probability approachig uity provided! as! k log because P t X t ) R J c > with probability oe. Hece, uder the alterative, the urestricted model will be chose with probability approachig uity as! provided k goes to i ity slower tha (log ) k(log ) ; that is provided! : It follows that model selectio by BIC is cosistet ad as! the criterio will successfully distiguish roots i the viciity of uity provided oe of the roots + b k is mildly explosive ad su cietly di eret from local to uity i the sese that k! slower tha O where L L is a slowly varyig fuctio that diverges at least as fast as L (log ) ; i.e., lim if! >. I this respect, the discrimiatory capability of (log ) model selectio is aalogous to that of classical Wald testig. 4 Coclusio Model selectio by BIC is well kow to be blid to local alteratives i geeral (see Ploberger ad Phillips, 3; ad Leeb ad Poetscher, 5). For istace, i the curret set up, BIC caot cosistetly distiguish betwee a model with a uit root ( ) ad models with roots local to uity ( + c ), just as localizig coe ciets such as

12 the parameter c are ot cosistetly estimable. O the other had, as show here, BIC ad classical tests ca successfully distiguish roots i the immediate locality of uity like from roots that are i the wider viciity of uity like ; which opes the door to distiguishig mildly explosive behavior i data. We expect these model selectio results to be geeralizable to models with weakly depedet iovatios, aalogous to the digs i Phillips (8) o uit root discrimiatio ad Cheg ad Phillips (9) for coitegratig rak determiatio. Tests of this type will be useful i empirical work where it is of iterest to di eretiate betwee the behavioral time series character of acial data such as asset prices ad the fudametals that are believed to determie prices, like divideds ad earigs. I such cases, the primary maitaied hypothesis is that the series have roots that are local to uity (without beig speci c about the localizig coe ciet) ad the alterative is that oe or other of the series may be mildly explosive at least over subperiods of data (see Phillips, Wu ad Yu, ; Phillips ad Yu, ). O the other had, if the primary maitaied hypothesis is that both series may be mildly explosive ad the ull hypothesis is commoality i the roots, the problems of bias ad icosistecy may arise i testig ad model selectio. Recet work by Nielse (9) ad Phillips ad Magdalios () provide a limit theory for least squares regressio i the case of purely explosive commo roots ad show that least squares regressio is icosistet. That work may be exteded to the case of commo mildly explosive roots ad will be explored i later work. 5 Appedix 5. Prelimiary Lemmas We start with some lemmas that assist i the asymptotic developmet. These results rely o existig limit theory so we oly sketch the mai details here for coveiece. We repeatedly use the fact that k ( ) b+o( k ) ad exp( b k ) f + o()g o(): The rst result is from PM7a. See also Phillips ad Magdalios (8) ad Magdalios ad Phillips (9) for related results o systems with explosive ad mildly explosive processes.

13 Lemma 5. (PM7a) De e X (b) Y (b) X (b) X (b) Y (b) Y (b) : p k : p k X j j u j ; X ( j) u j : j The, as! ; X (b))x(b) (X (b) ; X (b)) N(; b ); ad Y (b))y (b) (Y (b) ; Y (b)) ; where Y (b) d X(b); ad X(b) ad Y (b) are idepedet. Lemma 5. De e S (r) : p P brc j u j ad X(r) c X brc p brc X p j u brc j ; X (b) X p k p k j X j u j j : The, as! ; (i) S (r) p P brc j u j p P brc j u j ) B (r) B (r) B(r) BM(); (ii) X c (r))j c(r) R r ec(r s) db (s) ad P j X t u t ) R J c(r)db(r); (iii) X (b))x (b); where X (b) N ; b ; (iv) J c (r) ad X (b) are idepedet. (v) For all s; r > the followig joit covergece applies: Xbrc X bsc p ; p k bsc ) [J c (r); X (b)] ; as! : Proof. Result (i) is stadard, (ii) is from Phillips (987b), ad (iii) is from lemma 5.. To prove (iv), it su ces to show that B (r) ad X (b) are idepedet, sice J c (r) is a 3

14 fuctioal of fb (s)g sr : Note that the covariace E (S ()X (b)) E 4@ p p k X X j k k u j A p k X k p k p k f + o()g b u k k! 3 5 r k f + o()g o(); as! : Idepedece of the limit processes J c (r) ad X (b) follows. To prove (v), rst observe that for ay (iteger sequece) L! such that L X (b): Note that X (b) E X u j p k j jl + X L p k L sice L + b L k X L pk L k + p P u j k jl + j X jl + j k L ad k k L+! ; we have o(); +L X L pk L + b k L k k exp( b L k ) + o() o(): Hece, ) X (b) by lemma 5.. Now let L bsc for ay s > ad the X bsc p ) k bsc X (b): Joit covergece ad (v) follow from margial covergece ad asymptotic idepedece of the compoets. Lemma 5.3 As! ; P (i) k t X t ) (X (b)) b ; (ii) P t X t ) R J c(r) dr; (iii) k P t X t X t o p (): Proof. (i) follows from PM7a ad (ii) is stadard h (Phillips, i 987a&b). For (iii), it is Xbrc coveiet to take a probability space where p ;! p [J c (r); X (b)] : The, X bsc p k bsc ) 4

15 for ay sequece L! such that L k X X t X t t! ; we have ( X L p k X (b) p k + L p k t X + tl + XL t X tl + J c t ) Xt p Xt p k t t Xt p Xt p k t t f + o p ()g t L Now P t J c E X (b) p k X (b) p k X t X tl + X t t J c t t J c t + o p (): t t has zero mea ad variace! t J c t X X t s M L L f + o p ()g + O p p k for some ite costats M ad M : It follows that X! t Var p k J c t tl t s E J c J c t+s M k b ; k O k O k o(); P leadig to p t k tl J c t P o p (); which implies that k t X t X t o p () ad this also holds i the origial probability space, givig the required result. Lemma 5.4 As! ; R (i) D X X D ) J c(r) dr h R (ii) u X D ) J c(r)db(r) X (b)y (b) (X (b)) b 5 i : ;

16 Proof. Usig lemma 5.3 D X X D D )! X X t Xt t P t X t k D P k t X t X t P t X t X t R J c(r) dr (X (b)) b ; k P t X t givig (i). Result (ii) follows directly from lemmas 5. ad 5.3 as u X D ) h h P t P t X t u t k Xt p p ut P t X t p k h R J c(r)db(r) X (b)y (b) u t i P t Xt i : pk t u t t Joit covergece follows from the idepedece betwee B(r) ad (X (b); Y (b)): i 5. Proofs of the Mai Results Proof of Theorem.. we have ^R Usig Lemma 5.4, cotiuous mappig ad joit covergece, R D u X D D X X D R ) J c(r)db(r) R J c(r) dr Y (b) X (b)b : Sice ( ) b k ( + o()) the equivalet result ^R R F ) R J c(r)db(r) R J c(r) dr Y (b) X (b) ; holds as stated. Proof of Theorem.. We rst prove (.) ad (.) for the statistic W : Uder the ull we have by stadard theory ^R R ) Z Z Z dbjc J c Jc : ; X X ) J c Jc (5.) 6

17 ^ P t ^u t^u t! p ; ad (.) follows directly for W ad (.) for W A. Uder the alterative from theorem. with correct ceterig we have o a vec ^R R F (br r ) ( ) (br r ) )a vec; whereas uder (.) with b > ; the ull cetred liear combiatio behaves as a vec ^R (br br ) (br r ) (br r ) + (r r ) (br r ) ( ) (br r ) ( ) b + c k (br r ) + c b k + o p () (br r ) + O p ( k )! ; as! ; i view of (.7) - (.9) ad sice ( ) settig d P P t X t t X t d that 8 X X >< d Xt Xt >: ad t X t Xt t t k k k ( ) O( exp(b )) o(): Next, k ( P t X t X t ) ad usig Lemma 4.3 we P k t X t X t P t X t k P t X t X Xt f o p ()g ; (5.) 9 > >; d k X X X t k t Xt f o p ()g t Z! ) J c (r) X (b) dr : b 7

18 It follows that P X P X t X t t X t X t P d t X P t X t t X t 3 Sice ^! p ; we have 4 4 P t X t P t X t P X t P t X t t X t P t X t + op () o p () o p () o p () P t X t P X t P t X t t X t P t X t 3 5 ) 4 5 f + o p ()g(5.3) R J c(r) dr a o ^ X X a 8 P < 39 a t X t : ( + o p ()) 4 + op () o p () 5 o p () o p () ; a 8 < R 39 ) a : 4 J c(r) dr 5 ; a Z J c (r) dr : 3 5 : It follows that W a o vec ^R a ^ X X o (br r ) + O p ( k ) R J c(r) dr + op () O p k a ; givig the stated result. The proof of (.) for the statistic W A uder the alterative follows the same lies but ivolves more complex calculatios to cope with di eret orders of magitude i the compoets. First cosider the behavior of the cetred elemets uder the alterative. By 8

19 (.7) - (.9) we have o A vec ^R R F 6 4 (br r ) ( ) (br 3 r ) ( ) (br r ) 7 5 (br r ) )A vec: O the other had uder (.) with b > ; the ull-cetred liear combiatios behave as follows. First, a vec ^R (br br ) (br r ) (br r ) + (r r ) (br r ) ( ) (br r ) ( ) b + c k (br r ) + O p ( k )! ; as! ; as for W. Secod a vec ^R br ( ) br ( )! k O p exp(b o p () ; k ) ad third a 3 vec ^R br ) a 3vec; as! : Also, as i (5.3) X X 4 P P t X t t X t P X t P t X t t X t P t X t X t P P t X t t X t P t X t 3 5 f + o p ()g : We ow evaluate each of the compoets of the matrix ^ A o X X A 3 a 6 4 a 7 ^ X 5 X ^ X X ^ X X ^ X X [a ; a ; a 3 ] : a 3 9

20 Usig lemma 4.3 we d a ^ X X ^ X X a ^ X X ^ X X ^ P t X t ^ P f + o p ()g ; t X t P t + ^ X t X t P P + ^ P t X t t X t t X t f + o p ()g a ^ X X ^ X X ^ X X ^ X X a P t ^ X t X t P P + ^ P t X t t X t t X t f + o p ()g P t ^ X t X t P P f + o p ()g ; t X t t X t a a 3 ^ X X ^ X X ^ X X ^ X X a ^ P f + o p ()g ; t X t ^ X X ^ X X ^ X X ^ X X a 3 ^ P f + o p ()g ; t X t a ^ X X ^ X X a 3 ^ X X ^ X X ^ P t X t P t ^ X t X t P P f + o p ()g t X t t X t P t ^ X t X t P P f + o p ()g ; t X t t X t a ^ X X ^ X X P t ^ X X ^ X X a 3 ^ X t P X t P f + o p ()g ; t X t t X t

21 ad Hece a 3 ^ X X ^ X X ^ X X ^ X X a 3 ^ P f + o p ()g : t X t ^ A o X X A ^ P t X t 6 4 ^ P t X t X t P P t X t t X t ^ P t X t ^ P t X t X t P P t X t t X t ^ P t X t X t P P t X t t X t ^ P t X t f + o p ()g : Set K diag(; ; k ) ad observe that ^ K A o X X AK ^ P o p () o p () t X t 6 ^ P o p () 4 t X t k ^ P t X t f + o p ()g sice P t X t X t P P t X t t X t o p () ; k P t X t X t P P t X t t X t k P t X t X t P t X t k P t X t o p () ;

22 by lemma 4.3(iii). We deduce that W A A vec ^R A ^ o X X A A vec ^R A vec ^R K K ^ A o X X AK K A vec ^R 3 P 6 t X t 7 ^R K A vec 6 4 P t X t k P t X t K A vec ^R f + o p ()g : (5.4) 7 5 Next A vec ^R K A vec ^R R K + A vec (R ) K 3 3 (br r ) (br r ) (r r ) (br r ) k (br r ) (br r ) + O p O p k k (br r ) k 3 c k b ; (5.5) from Theorem. ad (.7) - (.9). It ow follows from (5.4) ad (5.5) that W A 6 4 b + O p () ; o p () ; O p () 6 k 4 k b k b + O p () o p () O p () Z givig the stated result P t X t J c (r) dr f + o p ()g ; P t X t k P t X t 3 7 5

23 Proof of Lemma 3.. Part (i) follows by stadard methods i view of Lemmas Also ~u t X t ^r X t u t (^r r ) X t, ad so we have X X ~ u t u t + (^r r ) t t t X t u t + u t Xt X + (^r r ) X t Xt X u t u t + O p ; (5.6) as stated. For part (ii) to obtai the limit distributio uder the alterative, write ^r as ^r X X t X t + t P t X t P t X t +! X X t X t t P t X t + P t X t P + t X t P t X t + P t X t P t X t + P t u tx t + X Xt + t P t + u tx t P t X t X t X t! t + P t u tx t + P t X t P t X t + P t u tx t P t X t + P t X t P t X t P t + X t P t X t P t X t P t + u tx t + P P t X t t u tx t P t X t P t + X t P : t X t The, usig Lemma 5.3 ^r ( ) P t X t P t X t P t f + o p ()g + u tx t + P t u tx t P t X t f + o p ()g k + k P k t u tx t + c b k k k P t X t P t u tx t P t X t P f + o p ()g k t X t P k k t u tx t f + o p ()g ; k P t X t f + o p ()g 3

24 ad i view of Lemma 5. k (^r ) ) X (b) Y (b) X (b) b b Y (b) X (b) ; givig the stated result (3.3). To prove (3.4), rst ote that b ^r (^r ) + ( ) k c + O p k : The restricted regressio residuals are ~u t X t ^r X t u t (^r I R ) X t u t u t (^r ) X t + u t + b k X t ( ) X t f + o p ()g : ^r ^r X t Let P t u tu t ad the! p ad ~ + b k + b k + b k ( X t X t X t h i ) u t + u t X t h i X t X t P t X t f + o p ()g ; sice P t X t u t O p () by Lemma 5.(ii) ad k! : 6 Refereces Cha, N. H. ad C. Z. Wei (987). Asymptotic Iferece for Nearly Nostatioary AR() Processes, Aals of Statistics 5, Cheg, X ad P. C. B. Phillips (9). Semiparametric coitegratig rak selectio, 4

25 The Ecoometrics Joural,, pp. S83-S4. Hall, P. ad C.C. Heyde (98). Martigale Limit Theory ad its Applicatio. Academic Press. Lai, T.L. ad C.Z. Wei (98). Least Squares Estimates i Stochastic Regressio Models with Applicatios to Ideti catio ad Cotrol of Dyamic Systems. Aals of Statistics,, Leeb H. ad B. Pötscher, Model selectio ad iferece: facts ad ctio, Ecoometric Theory,, pp Magdalios, T. ad P. C. B Phillips (9). Limit Theory for Coitegrated Systems with Moderately Itegrated ad Moderately Explosive Regressors. Ecoometric Theory, 5, Nielse, B. (9). Sigular vector autoregressios with determiistic terms: Strog cosistecy ad lag order determiatio. Uiversity of Oxford workig paper. Paga, A. ad A. Ullah (999). Noparametric Ecooometrics. Cambridge Uiversity Press. Ploberger, W. ad P. C. B. Phillips (3). Empirical limits for time series ecoometric models Ecoometrica, 7, Phillips, P. C. B. (987a). Time Series Regressio with a Uit Root, Ecoometrica, 55, 77 3 Phillips, P. C. B. (987b). Towards a Ui ed Asymptotic Theory for Autoregressio, Biometrika 74, Phillips, P. C. B. (8). Uit root model selectio, Joural of the Japa Statistical Society, 38, Phillips, P. C. B., T. Magdalios (7a), Limit Theory for Moderate Deviatios from a Uit Root, Joural of Ecoometrics 36, 5-3. Phillips, P. C. B., T. Magdalios (7b), Limit Theory for Moderate Deviatios from a Uit Root Uder Weak Depedece, i G. D. A. Phillips ad E. Tzavalis (Eds.) 5

26 The Re emet of Ecoometric Estimatio ad Test Procedures: Fiite Sample ad Asymptotic Aalysis. Cambridge: Cambridge Uiversity Press, pp.3-6. Phillips, P. C. B. ad T. Magdalios (8). Limit theory for explosively coitegrated systems, Ecoometric Theory, 4, Phillips, P. C. B., T. Magdalios (), Icosistet VAR Regressio with Commo Explosive Roots, Workig Paper, Yale Uiversity. Phillips P. C. B., Y. Wu ad J. Yu (). Explosive behavior i the 99s Nasdaq: Whe did exuberace escalate asset values?, Iteratioal Ecoomic Review, 5, pp. -6. Phillips P. C. B. ad J. Yu (). Datig the Timelie of Fiacial Bubbles durig the Subprime Crisis, Quatitative Ecoomics,, pp Ullah, A. (4). Fiite Sample Ecoometrics. Oxford: Oxford Uiversity Press. 6

UNIT ROOT MODEL SELECTION PETER C. B. PHILLIPS COWLES FOUNDATION PAPER NO. 1231

UNIT ROOT MODEL SELECTION PETER C. B. PHILLIPS COWLES FOUNDATION PAPER NO. 1231 UNIT ROOT MODEL SELECTION BY PETER C. B. PHILLIPS COWLES FOUNDATION PAPER NO. 1231 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY Box 28281 New Have, Coecticut 652-8281 28 http://cowles.eco.yale.edu/

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

Spurious Fixed E ects Regression

Spurious Fixed E ects Regression Spurious Fixed E ects Regressio I Choi First Draft: April, 00; This versio: Jue, 0 Abstract This paper shows that spurious regressio results ca occur for a xed e ects model with weak time series variatio

More information

LECTURE 11 LINEAR PROCESSES III: ASYMPTOTIC RESULTS

LECTURE 11 LINEAR PROCESSES III: ASYMPTOTIC RESULTS PRIL 7, 9 where LECTURE LINER PROCESSES III: SYMPTOTIC RESULTS (Phillips ad Solo (99) ad Phillips Lecture Notes o Statioary ad Nostatioary Time Series) I this lecture, we discuss the LLN ad CLT for a liear

More information

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,

More information

Study the bias (due to the nite dimensional approximation) and variance of the estimators

Study the bias (due to the nite dimensional approximation) and variance of the estimators 2 Series Methods 2. Geeral Approach A model has parameters (; ) where is ite-dimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite

More information

Cointegration versus Spurious Regression and Heterogeneity in Large Panels

Cointegration versus Spurious Regression and Heterogeneity in Large Panels Coitegratio versus Spurious Regressio ad Heterogeeity i Large Paels Lorezo rapai Cass Busiess School Jauary 8, 009 Abstract his paper provides a estimatio ad testig framework to idetify the source(s) of

More information

A note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors

A note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors Appl. Math. J. Chiese Uiv. 008, 3(): 97-0 A ote o self-ormalized Dickey-Fuller test for uit root i autoregressive time series with GARCH errors YANG Xiao-rog ZHANG Li-xi Abstract. I this article, the uit

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

1 General linear Model Continued..

1 General linear Model Continued.. Geeral liear Model Cotiued.. We have We kow y = X + u X o radom u v N(0; I ) b = (X 0 X) X 0 y E( b ) = V ar( b ) = (X 0 X) We saw that b = (X 0 X) X 0 u so b is a liear fuctio of a ormally distributed

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

A Weak Law of Large Numbers Under Weak Mixing

A Weak Law of Large Numbers Under Weak Mixing A Weak Law of Large Numbers Uder Weak Mixig Bruce E. Hase Uiversity of Wiscosi Jauary 209 Abstract This paper presets a ew weak law of large umbers (WLLN) for heterogeous depedet processes ad arrays. The

More information

Summary and Discussion on Simultaneous Analysis of Lasso and Dantzig Selector

Summary and Discussion on Simultaneous Analysis of Lasso and Dantzig Selector Summary ad Discussio o Simultaeous Aalysis of Lasso ad Datzig Selector STAT732, Sprig 28 Duzhe Wag May 4, 28 Abstract This is a discussio o the work i Bickel, Ritov ad Tsybakov (29). We begi with a short

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials

More information

4. Hypothesis testing (Hotelling s T 2 -statistic)

4. Hypothesis testing (Hotelling s T 2 -statistic) 4. Hypothesis testig (Hotellig s T -statistic) Cosider the test of hypothesis H 0 : = 0 H A = 6= 0 4. The Uio-Itersectio Priciple W accept the hypothesis H 0 as valid if ad oly if H 0 (a) : a T = a T 0

More information

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Limit Theory for Cointegrated Systems with Moderately Integrated and Moderately Explosive Regressors 1

Limit Theory for Cointegrated Systems with Moderately Integrated and Moderately Explosive Regressors 1 Limit Theory for Coitegrated Systems with Moderately Itegrated ad Moderately Explosive Regressors Tassos Magdalios Uiversity of Nottigham, UK Peter C. B. Phillips Cowles Foudatio for Research i Ecoomics

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Solution to Chapter 2 Analytical Exercises

Solution to Chapter 2 Analytical Exercises Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Asymptotic Results for the Linear Regression Model

Asymptotic Results for the Linear Regression Model Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is

More information

Spatial Nonstationarity and Spurious Regression: The Case with Row-Normalized Spatial Weights Matrix

Spatial Nonstationarity and Spurious Regression: The Case with Row-Normalized Spatial Weights Matrix Spatial Nostatioarity ad Spurious Regressio: The Case with Row-Normalized Spatial Weights Matrix March 26, 29 Abstract This paper ivestigates the spurious regressio i the spatial settig where the regressat

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

11 THE GMM ESTIMATION

11 THE GMM ESTIMATION Cotets THE GMM ESTIMATION 2. Cosistecy ad Asymptotic Normality..................... 3.2 Regularity Coditios ad Idetificatio..................... 4.3 The GMM Iterpretatio of the OLS Estimatio.................

More information

Random Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices

Random Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices Radom Matrices with Blocks of Itermediate Scale Strogly Correlated Bad Matrices Jiayi Tog Advisor: Dr. Todd Kemp May 30, 07 Departmet of Mathematics Uiversity of Califoria, Sa Diego Cotets Itroductio Notatio

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

1 Covariance Estimation

1 Covariance Estimation Eco 75 Lecture 5 Covariace Estimatio ad Optimal Weightig Matrices I this lecture, we cosider estimatio of the asymptotic covariace matrix B B of the extremum estimator b : Covariace Estimatio Lemma 4.

More information

LECTURE 13 SPURIOUS REGRESSION, TESTING FOR UNIT ROOT = C (1) C (1) 0! ! uv! 2 v. t=1 X2 t

LECTURE 13 SPURIOUS REGRESSION, TESTING FOR UNIT ROOT = C (1) C (1) 0! ! uv! 2 v. t=1 X2 t APRIL 9, 7 Sprios regressio LECTURE 3 SPURIOUS REGRESSION, TESTING FOR UNIT ROOT I this sectio, we cosider the sitatio whe is oe it root process, say Y t is regressed agaist aother it root process, say

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Lecture 24: Variable selection in linear models

Lecture 24: Variable selection in linear models Lecture 24: Variable selectio i liear models Cosider liear model X = Z β + ε, β R p ad Varε = σ 2 I. Like the LSE, the ridge regressio estimator does ot give 0 estimate to a compoet of β eve if that compoet

More information

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The

More information

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker

SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker CHAPTER 9. POINT ESTIMATION 9. Covergece i Probability. The bases of poit estimatio have already bee laid out i previous chapters. I chapter 5

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

Efficient GMM LECTURE 12 GMM II

Efficient GMM LECTURE 12 GMM II DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Rank tests and regression rank scores tests in measurement error models

Rank tests and regression rank scores tests in measurement error models Rak tests ad regressio rak scores tests i measuremet error models J. Jurečková ad A.K.Md.E. Saleh Charles Uiversity i Prague ad Carleto Uiversity i Ottawa Abstract The rak ad regressio rak score tests

More information

On the Asymptotics of ADF Tests for Unit Roots 1

On the Asymptotics of ADF Tests for Unit Roots 1 O the Asymptotics of ADF Tests for Uit Roots Yoosoo Chag Departmet of Ecoomics Rice Uiversity ad Joo Y. Park School of Ecoomics Seoul Natioal Uiversity Abstract I this paper, we derive the asymptotic distributios

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

A Uni ed Estimation Approach for Spatial Dynamic Panel Data Models: Stability, Spatial Cointegration and Explosive Roots

A Uni ed Estimation Approach for Spatial Dynamic Panel Data Models: Stability, Spatial Cointegration and Explosive Roots A Ui ed Estimatio Approach for Spatial Dyamic Pael Data Models: Stability, Spatial Coitegratio ad Explosive Roots Lug-fei Lee Departmet of Ecoomics Ohio State Uiversity lee.777osu.edu Jihai Yu Departmet

More information

MA Advanced Econometrics: Properties of Least Squares Estimators

MA Advanced Econometrics: Properties of Least Squares Estimators MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample

More information

Heretoskedasticity: Cont.

Heretoskedasticity: Cont. Heretoskedasticity: Cot. We have see last time how to costruct heteroskedasticity robust t-test, i.e. b i 1= bi = (W hite) se bi 1= (W hite)se bi We ow see how to costruct heteroskedastic robust Wald test

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

ON THE BREITUNG TEST FOR PANEL UNIT ROOTS AND LOCAL ASYMPTOTIC POWER. H. R. MOON, B. PERRON and P. C. B. PHILLIPS COWLES FOUNDATION PAPER NO.

ON THE BREITUNG TEST FOR PANEL UNIT ROOTS AND LOCAL ASYMPTOTIC POWER. H. R. MOON, B. PERRON and P. C. B. PHILLIPS COWLES FOUNDATION PAPER NO. ON HE BREIUNG ES FOR PANEL UNI ROOS AND LOCAL ASYMPOIC POWER BY H. R. MOON, B. PERRON ad P. C. B. PHILLIPS COWLES FOUNDAION PAPER NO. 79 COWLES FOUNDAION FOR RESEARCH IN ECONOMICS YALE UNIVERSIY Box 088

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung

Bull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

Lecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)

Lecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise) Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +

More information

Notes 27 : Brownian motion: path properties

Notes 27 : Brownian motion: path properties Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

Output Analysis and Run-Length Control

Output Analysis and Run-Length Control IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

More information

THE DATA-BASED CHOICE OF BANDWIDTH FOR KERNEL QUANTILE ESTIMATOR OF VAR

THE DATA-BASED CHOICE OF BANDWIDTH FOR KERNEL QUANTILE ESTIMATOR OF VAR Iteratioal Joural of Iovative Maagemet, Iformatio & Productio ISME Iteratioal c2013 ISSN 2185-5439 Volume 4, Number 1, Jue 2013 PP. 17-24 THE DATA-BASED CHOICE OF BANDWIDTH FOR KERNEL QUANTILE ESTIMATOR

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

UNIFORM INTERVAL ESTIMATION FOR AN AR(1) PROCESS WITH AR ERRORS

UNIFORM INTERVAL ESTIMATION FOR AN AR(1) PROCESS WITH AR ERRORS Statistica Siica 6 (06), 9-36 doi:http://dx.doi.org/0.5705/ss.04.5 UNIFORM INTERVAL ESTIMATION FOR AN AR() PROCESS WITH AR ERRORS Joatha Hill, Deyua Li ad Liag Peg Uiversity of North Carolia, Fuda Uiversity

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Conditional-Sum-of-Squares Estimation of Models for Stationary Time Series with Long Memory

Conditional-Sum-of-Squares Estimation of Models for Stationary Time Series with Long Memory Coditioal-Sum-of-Squares Estimatio of Models for Statioary Time Series with Log Memory.M. Robiso Lodo School of Ecoomics The Sutory Cetre Sutory ad Toyota Iteratioal Cetres for Ecoomics ad Related Disciplies

More information

Lecture 12: September 27

Lecture 12: September 27 36-705: Itermediate Statistics Fall 207 Lecturer: Siva Balakrisha Lecture 2: September 27 Today we will discuss sufficiecy i more detail ad the begi to discuss some geeral strategies for costructig estimators.

More information

INFINITE SEQUENCES AND SERIES

INFINITE SEQUENCES AND SERIES 11 INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES 11.4 The Compariso Tests I this sectio, we will lear: How to fid the value of a series by comparig it with a kow series. COMPARISON TESTS

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D. ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Last time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object

Last time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object 6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

ENGI Series Page 6-01

ENGI Series Page 6-01 ENGI 3425 6 Series Page 6-01 6. Series Cotets: 6.01 Sequeces; geeral term, limits, covergece 6.02 Series; summatio otatio, covergece, divergece test 6.03 Stadard Series; telescopig series, geometric series,

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

2.2. Central limit theorem.

2.2. Central limit theorem. 36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard

More information

Stochastic Matrices in a Finite Field

Stochastic Matrices in a Finite Field Stochastic Matrices i a Fiite Field Abstract: I this project we will explore the properties of stochastic matrices i both the real ad the fiite fields. We first explore what properties 2 2 stochastic matrices

More information

STA Object Data Analysis - A List of Projects. January 18, 2018

STA Object Data Analysis - A List of Projects. January 18, 2018 STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio

More information

Lecture 7 Testing Nonlinear Inequality Restrictions 1

Lecture 7 Testing Nonlinear Inequality Restrictions 1 Eco 75 Lecture 7 Testig Noliear Iequality Restrictios I Lecture 6, we discussed te testig problems were te ull ypotesis is de ed by oliear equality restrictios: H : ( ) = versus H : ( ) 6= : () We sowed

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates

Investigating the Significance of a Correlation Coefficient using Jackknife Estimates Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY

COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY LIMIT THEORY FOR MODERATE DEVIATIONS FROM A UNIT ROOT By Peter C.B. Phillips ad Tassos Magdalios July 4 COWLES FOUNDATION DISCUSSION PAPER NO. 47 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

COINTEGRATING RANK SELECTION IN MODELS WITH TIME-VARYING VARIANCE. Xu Cheng and Peter C. B. Phillips. January 2009

COINTEGRATING RANK SELECTION IN MODELS WITH TIME-VARYING VARIANCE. Xu Cheng and Peter C. B. Phillips. January 2009 COINTEGRATING RANK SELECTION IN MODELS WITH TIME-VARYING VARIANCE By Xu Cheg ad Peter C. B. Phillips Jauary 29 COWLES FOUNDATION DISCUSSION PAPER NO. 688 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

ECON 3150/4150, Spring term Lecture 3

ECON 3150/4150, Spring term Lecture 3 Itroductio Fidig the best fit by regressio Residuals ad R-sq Regressio ad causality Summary ad ext step ECON 3150/4150, Sprig term 2014. Lecture 3 Ragar Nymoe Uiversity of Oslo 21 Jauary 2014 1 / 30 Itroductio

More information

Notes On Median and Quantile Regression. James L. Powell Department of Economics University of California, Berkeley

Notes On Median and Quantile Regression. James L. Powell Department of Economics University of California, Berkeley Notes O Media ad Quatile Regressio James L. Powell Departmet of Ecoomics Uiversity of Califoria, Berkeley Coditioal Media Restrictios ad Least Absolute Deviatios It is well-kow that the expected value

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

Week 10. f2 j=2 2 j k ; j; k 2 Zg is an orthonormal basis for L 2 (R). This function is called mother wavelet, which can be often constructed

Week 10. f2 j=2 2 j k ; j; k 2 Zg is an orthonormal basis for L 2 (R). This function is called mother wavelet, which can be often constructed Wee 0 A Itroductio to Wavelet regressio. De itio: Wavelet is a fuctio such that f j= j ; j; Zg is a orthoormal basis for L (R). This fuctio is called mother wavelet, which ca be ofte costructed from father

More information

CEU Department of Economics Econometrics 1, Problem Set 1 - Solutions

CEU Department of Economics Econometrics 1, Problem Set 1 - Solutions CEU Departmet of Ecoomics Ecoometrics, Problem Set - Solutios Part A. Exogeeity - edogeeity The liear coditioal expectatio (CE) model has the followig form: We would like to estimate the effect of some

More information

Notes on iteration and Newton s method. Iteration

Notes on iteration and Newton s method. Iteration Notes o iteratio ad Newto s method Iteratio Iteratio meas doig somethig over ad over. I our cotet, a iteratio is a sequece of umbers, vectors, fuctios, etc. geerated by a iteratio rule of the type 1 f

More information