UNIT ROOT MODEL SELECTION PETER C. B. PHILLIPS COWLES FOUNDATION PAPER NO. 1231
|
|
- Amelia Byrd
- 6 years ago
- Views:
Transcription
1 UNIT ROOT MODEL SELECTION BY PETER C. B. PHILLIPS COWLES FOUNDATION PAPER NO COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY Box New Have, Coecticut
2 J. Japa Statist. Soc. Vol. 38 No UNIT ROOT MODEL SELECTION * Peter C. B. Phillips** Some limit properties for iformatio based model selectio criteria are give i the cotext of uit root evaluatio ad various assumptios about iitial coditios. Allowig for a oparametric short memory compoet, stadard iformatio criteria are show to be weakly cosistet for a uit root provided the pealty coefficiet C ad C / as. Strog cosistecy holds whe C /(log log ) 3 uder covetioal assumptios o iitial coditios ad uder a slightly stroger coditio whe iitial coditios are ifiitely distat i the uit root model. The limit distributio of the AIC criterio is obtaied. Key words ad phrases: root. AIC, cosistecy, model selectio, oparametric, uit 1. Itroductio Followig Akaike (1969, 1973, 1977), iformatio criteria have bee systematically explored for order selectio purposes, ofte i the cotext of time series models like autoregressios. The methods have bee studied i both statioary ad ostatioary models (Tsay (1984), Pötscher (1989), Wei (1992), Nielse (26)) ad are widely used i practical work. A commoly occurig problem i moder time series, particularly ecoometrics, is model evaluatio that ivolves testig for a uit root ad coitegratio. Agai, order selectio methods have bee cosidered i this cotext (Phillips ad Ploberger (1996), Phillips (1996), Kim (1998)). If the focus is o these particular features of a time series the it is ot ecessary to build a complete model ad it is ofte desirable to perform the evaluatio i a semiparametriccotext allowig for a geeral short memory compoet i the series. The preset ote looks at the specific issue of uit root evaluatio by iformatio criteria. We seek to distiguish processes with a uit root (UR) from statioary series (SS). The UR model has the autoregressive form (1.1) X t = ρx t 1 + u t, ρ =1, t {1,...,}, where u t is a weakly depedet statioary time series with zero mea ad cotiuous spectral desity f u (λ). The series X t is iitialized at t = by some (possibly radom) quatity X. The SS model has the form X t = u t, so that ρ = i (1.1). We aim to treat (1.1) semiparametrically with regard to u t ad i this cotext ρ = is effectively equivalet to ρ < 1 i (1.1). Accepted December8, 27. *Thaks go to Xu Cheg ad a referee for commets o the origial versio. Partial support is ackowledge from a Kelly Fellowship ad from the NSF uder Grat No. SES **Uiversity of Aucklad, Uiversity of York, Sigapore Maagemet Uiversity, Yale Uiversity; Departmet of Ecoomics, Yale Uiversity, P.O. Box 28281, New Have, CT , U.S.A. peter.phillips@yale.edu
3 66 PETER C. B. PHILLIPS Stadard order selectio criteria may be used to evaluate whether ρ = 1 or ρ = i (1.1). The criteria have the followig form (1.2) IC k = log σ 2 k + kc with coefficiet C = log, log log, 2 correspodig to the BIC (Schwarz (1978), Akaike (1977), Rissae (1978)), Haa ad Qui (1979), ad Akaike (1973) pealties, respectively. Sample iformatio-based versios of the coefficiet C may also be employed, such as those i Wei s (1992) FIC criterio ad Phillips ad Ploberger s (1996) PIC criterio. I the uit root (UR) autoregressio, ρ = 1 ad there is o ukow autoregressive parameter to estimate, so i this case we set the parameter cout to k = i (1.2). I the statioary model (SS), a parametricautoregressive model may still be fitted by least squares regressio with / / ˆρ = X t X t 1 Xt 1 2 = u t u t 1 u 2 t 1, ad so i this case the parameter cout is set to k = 1. The residual variace estimates i (1.2) for the two models are formed i the usual maer, viz., σ 2 = 1 ( X t ) 2, σ 1 2 = 1 (X t ˆρX t 1 ) 2. Model evaluatio based o IC k the leads to the selectio criterio ˆk = arg mi k {,1} IC k. As show below, the iformatio criterio IC k is weakly cosistet for testig a uit root provided the pealty term i (1.2) satisfies the weak requiremets that C ad C / as. No specific expasio rate C is required. Strog cosistecy also holds provided C faster tha (log log ) 3 uder commoly used assumptios about iitial coditios. 2. Results The followig assumptios make specific the semiparametric ad iitializatio compoets of (1.1), the secod beig importat whe ρ = 1. Assumptio LP is a stadard liear process coditio of the type that is coveiet i developig partial sum limit theory (c.f., Phillips ad Solo (1992)). Assumptio IN gives, for the uit root case, a partial sum structure to the iitial observatio X i terms of past iovatios, makig X aalogous to later observatios X t of the series which take the form of partial sums measured from X. The sequece κ i (2.2) determies how may past iovatios are icluded i the iitializatio, with larger values of κ associated with the more distat past. This type of iitial coditio has bee used i other recet limit theory i ecoometrics (Phillips ad Magdalios (27)).
4 UNIT ROOT MODEL SELECTION 67 Assumptio LP. Let d(l) = j= d j L j, with d = 1 ad d(1), ad let u s have Wold represetatio (2.1) u s = d(l)ε s = d j ε s j, with j 1/2 d j <, j= where ε t is iid(,σ 2 ε). Defie λ = h=1 E(u t u t h ), ω 2 = h= E(u t u t h ), ad σ 2 = E{u 2 t }. Assumptio IN. form (2.2) j= The iitializatio of (1.1) whe ρ = 1 has the geeral X () = κ u j j= with u j satisfyig Assumptio LP ad κ a iteger valued sequece satisfyig κ ad κ (2.3) τ [, ] as. The followig cases are distiguished: (i) If τ =,X () is said to be a recet past iitializatio. (ii) If τ (, ), X () is said to be a distat past iitializatio. (iii) If τ =, X () is said to be a ifiite past iitializatio. Theorem 1. (a) Uder Assumptios LP ad IN, the criterio IC k is weakly cosistet for distiguishig uit root ad statioary time series provided C ad C / as. (b) The asymptotic distributio of the AIC criterio (IC k with coefficiet C = 2) is give by where lim P {ˆk AIC = k =1} =, lim P {ˆk AIC = k =} = P {ξ 2 < 2} lim P {ˆk AIC =1 k =} =1 P {ξ 2 < 2}, ( 1 ) 2 1 ) dbb + λ /(σ 2 B 2 ξ 2 ( = 1 ) 2 1 ) dbb τ + λ /(σ 2 Bτ 2 B(1) 2 /σ 2 B is Browia motio with variace ω 2, (2.4) B τ (s) =B(s)+ τb (1), lim P {ˆk AIC =1 k =1} =1, uder IN(i) uder IN(ii) uder IN(iii) ad B is a idepedet Browia motio with variace ω 2.,
5 68 PETER C. B. PHILLIPS Remarks. (1) The weak cosistecy results i part (a) of Theorem 1 show that iformatio criteria ca be used, essetially i their preset form, for distiguishig uit root ad statioary time series. This approach allows for a oparametrictreatmet of the short memory compoet i both the statioary ad ostatioary models. The simple coditios o the pealty coefficiet C that C ad C / as are miimal. Evidetly, BIC ad the Haa-Qui criterio are both cosistet. Similar argumets show that the FIC (Wei (1992)) ad PIC (Phillips ad Ploberger (1996)) criteria are also cosistet. (2) The AIC criterio (with fixed C = 2) is icosistet ad the limit distributio of ˆk is see i part (b) of the theorem to deped o the asymptotic distributio of the squared uit root t statistic ξ 2. This distributio ivolves uisace parameters. The limit variate ξ 2 has a uit root limit distributio uder IN(i) ad IN(ii) that depeds o ω 2, σ 2 ad λ, ad a scaled chi-squared distributio uder IN(iii) that depeds o ω 2 ad σ 2. Theorem 2. Uder Assumptios LP ad IN, the criterio IC k is strogly cosistet for distiguishig uit root ad statioary time series provided (2.5) C (log log ) 3 ad C / as. C κ (log log )2 log log κ uder IN(i) ad IN(ii) uder IN(iii) Remarks. (3) The rate coditio (2.5) implies that BIC is strogly cosistet i distiguishig uit root ad statioary models uder IN(i) ad IN(ii) ad strogly cosistet uder IN(iii) provided κ does ot icrease too fast relative to. The results complemet those of Wei (1992), who proved strog cosistecy of the BIC ad FIC criteria i order selectio for parametric autoregressios allowig for ostatioarity. (4) The proof of Theorem 2 depeds o the asymptoticbehavior of the quadraticform u P 1 u, which ivolves the projectio matrix P 1 = X 1 (X 1 X 1) 1 X 1, where X 1 =(X,X 1,...,X 1 ), ad u =(u 1,..., u ). The asymptoticproperties of projectios of this type arisig i stochastic regressio models were studied by Lai ad Wei (1982a) for martigale differeces u t i a geeral regressio settig. Their Lemma 2(ii) ad Theorem 3 (see, i particular, equatio (2.18)) give the followig order for u P 1 u whe X t is geerated by the uit root model UR ad u t is a martigale differece with uiform 2 + η momets with η > : ( )) u (2.6) P 1 u = O a.s. (log = O a.s. (log ). 1 X 2 t 1
6 UNIT ROOT MODEL SELECTION 69 (See also Lemma 2(iii) ad equatio (3.25) i Lai ad Wei (1982b).) I parametricstochasticregressio models that iclude ostatioary autoregressios, Pötscher (1989) used (2.6) to establish strog cosistecy of iformatio criteria of the form IC k uder a expasio rate for the pealty coefficiet C that requires C / log, thereby excludig BIC. I the proof of Theorem 2, we make explicit use of the fact that X t 1 = S t 1 +X, where S t is a partial sum of the u j, to establish that i this case (2.7) O a.s. ((log log ) 3 ) uder IN(i) ad IN(ii) ( ) u κ P 1 u = O a.s. (log log )2 log log κ, uder IN(iii) givig a sharper result tha (2.6). I provig (2.6), Lai ad Wei (1982a, Lemma 2) cosider the sample covariace of a martigale differece with a geeral radom sequece that is ot ecessarily a partial sum process of the iovatios. I view of the uit root structure, we ca make use of the followig explicit decompositio of the sample covariace S t 1 u t = 1 { } S 2 u 2 t = O a.s. ( log log ), 2 which, i cojuctio with a lower boud result for St 1 2, leads directly to (2.7) uder the commoly used iitial coditios IN(i) ad IN(ii). 3. Proofs Proof of Theorem 1. Part (a) Suppose the true model is a UR model with ρ = 1 i (1.1). The IC = log σ 2 = log { u } u. Defie P 1 = X 1 (X 1 X 1) 1 X 1, X 1 = (X,X 1,...,X 1 ), ad u = (u 1,...,u ). The behavior of IC 1 depeds o u P 1 u, which we ow ivestigate uder the various iitializatios. Uder IN(i), we have (Phillips (1987)) (3.1) ( 1 u P 1 u ) 2 / 1 dbb + λ B 2, as, where λ = h=1 E(u t u t h ), ad B is Browia motio with variace ω 2. Uder IN(ii) we have (e.g., Phillips ad Magdalios (27)) (3.2) ( 1 u P 1 u ) 2 / 1 dbb τ + λ Bτ 2,
7 7 PETER C. B. PHILLIPS where B τ (s) =B(s)+ τb (1), τ (, ), ad B is a Browia motio with variace ω 2 that is idepedet of B. Uder IC(iii) Phillips ad Magdalios (27, Theorem 2) show that ( ) 2 1 X t 1 u t κ u (3.3) P 1 u = B(1) 1 2. Xt 1 2 κ Thus, whether the iitializatio is recet, distat or ifiitely distat, we have u P 1 u = O p (1). It follows that { Hece, IC 1 = log σ C = log 1 } { 1 = log (u u u P 1 u) + C [ = log u u + log 1 u P 1 u u u [ = log u u + log 1 (X t ˆρX t 1 ) 2 } ] + C u P 1 u σ 2 {1+o a.s. (1)} = log u u + C u P 1 u σ 2 {1+o a.s. (1)}. ] + C + C IC IC 1 = C + u P 1 u σ 2 {1+o a.s. (1)} = C { ( )} 1 u P 1 u 1 (3.4) C σ 2 + o a.s. C < whe C as because u P 1 u C σ = O 2 p (C 1 ). Thus, criterio IC k correctly selects the uit root model i favor of the statioary model whe ρ =1. This is the case irrespective of the iitial coditio ad holds provided C. Next suppose the true model is statioary ad X t = u t. The we have / / ˆρ = X t X t 1 Xt 1 2 = u t u t 1 u 2 t 1 ρ = E(u tu t 1 ) a.s. E(u 2 t 1 ) := γ 1, γ where γ h = E{u t u t h }. Observe that i this case by the strog law of large umbers { } 1 IC = log σ 2 = log (u u 1) (u u 1 ) { u u = log u 1 2u + u 1 u } 1 = log{2γ 2γ 1 + o a.s. (1)} = log{2γ (1 ρ)} + o a.s. (1).
8 UNIT ROOT MODEL SELECTION 71 Also, 1 u P 1 u =( 1 u u 1 ) 2 /( 1 u 1 u 1) a.s. γ 2 1 /γ, ad the { } 1 IC 1 = log (u u u P 1 u) + C { (u ) u ( = log 1 1 u P 1 u 1 u u ( ) } {γ = log 1 γ2 1 γ 2 + o a.s. (1) )} + C + C It follows that = log{γ (1 ρ 2 )} + C + o a.s.(1). (3.5) IC IC 1 = log{2γ (1 ρ)} log{γ (1 ρ 2 )} C + o a.s.(1) 2 = log 1+ρ C + o a.s.(1) >, a.s. as provided C. Hece, the criterio IC k correctly selects the statioary model a.s. as for both fixed C ad C at a slower rate tha. Part (b) We seek to fid the limit distributio of the AIC criterio (i.e., IC k i (1.2) with C k = 2). Note from the above that AIC makes the correct choice whe the model is statioary as (3.5) holds whe C is fixed as. The (3.6) lim P {ˆk AIC = k =1} =, lim P {ˆk AIC =1 k =1} =1, as stated. O the other had, whe the model has a uit root, we have from (3.4) ad (3.1) (3.3) (IC IC 1 )= 2+ u P 1 u σ 2 {1+o a.s. (1)} 2+ξ 2, where It follows that ( 1 ) 2 1 ) dbb + λ /(σ 2 B 2 ξ 2 ( = 1 ) 2 1 ) dbb τ + λ /(σ 2 Bτ 2 B(1) 2 /σ 2 uder IN(i) uder IN(ii) uder IN(iii). lim P {ˆk AIC = k =} = lim P {(IC IC 1 ) < } = P {ξ 2 < 2} lim P {ˆk AIC =1 k =} =1 P {ξ 2 < 2}.
9 72 PETER C. B. PHILLIPS Combiig this with (3.6) gives the required limit distributio. Proof of Theorem 2. I view of (3.5), whe the statioary model is true the criterio IC k correctly selects the statioary model a.s. as for fixed C ad for C provided C /. To establish strog cosistecy we therefore eed oly cosider the limit behavior uder the uit root model. From (3.4) we have IC IC 1 = C ad so we eed to examie the limit behavior of { ( )} 1 u P 1 u 1 C σ 2 + o a.s., C u P 1 u C = (u X 1 ) 2 C (X 1 X 1). By a result of Dosker ad Varadha (1977, equatio (4.6) o p. 751) see also equatio (3.29) of Lai ad Wei (1982a) we have uder IN(i) (3.7) lim if log log 2 Xt 1 2 >, a.s., which gives a lower limit of O a.s. ( 2 log log ) to the fluctuatios of the sample iformatio Xt 1 2. I this case, 1/2 X t behaves i the limit like a Browia motio ad the lower limit (3.7) is obtaied i Dosker ad Varadha (1977, p. 751) by way of the lower limit of the correspodig limitig quatity log log 2 B(s)2 ds. Result (3.7) may also be show to hold uder IN(ii) ad IN(iii). I particular, ote that i both these cases we ca write X t = S t +X (), where S t = t 1 u j. The Xt 1 2 (X t 1 X 1 ) 2 = (S t 1 S 1 ) 2, 1 where X 1 = 1 X t 1 ad S 1 = 1 S t 1, so that (3.8) lim if log log 2 X 2 t 1 lim if log log 2 (S t 1 S 1 ) 2. The lower boud (3.8) is the same as (3.9) where lim if log log 2 = lim if 1 2 (B(s) B(s)ds) 1 ds ( 1 ) 2 B (p) B dp, ( ) log log 1/2 B (p) = B(p) for p 1
10 UNIT ROOT MODEL SELECTION 73 is Browia motio over [, 1] with variace (log log )ω 2. The lower limit of the variatio (3.9) therefore satisfies lim if 1 ( 1 ) 2 B (p) B dp > by virtue of the properties of Browia motio. Otherwise B (p) would ecessarily be costat with positive probability as. It follows that uder IN(ii) ad IN(iii) the same lower boud of order O a.s. ( 2 log log ) applies for 1 Xt 1 2. Next ote that (3.1) u t X t 1 = u t S t 1 + X u t = 1 { } S 2 u 2 t + X u t 2 = O a.s. ((log log )) + O a.s. (X () log log ), by virtue of the law of the iterated logarithm (e.g., Phillips ad Solo (1992)) for S. It follows that uder IN(i) ad IN(ii) ad i view of a further applicatio of the law of the iterated logarithm to X () ad usig (3.7) we fid that ( u 2 (log log ) 2 ) P 1 u = O a.s. 2 = O a.s. ((log log ) 3 ). / log log We deduce that wheever IC IC 1 = C a.s. { ( )} 1 u P 1 u 1 C σ 2 + o a.s. <, C (3.11) C (log log ) 3, as for the u P 1 u C σ = o 2 a.s. (1) ad IC < IC 1 a.s. as. This proves strog cosistecy uder the rate coditio (3.11) ad iitial coditios IN(i) ad IN(ii). Whe IN(iii) applies, (3.1) holds ad we have u t X t 1 = O a.s. ((log log )) + O a.s. (X () log log ) = O a.s. ( κ log log κ log log ), by the law of the iterated logarithm for X (). The, usig (3.7), we have ( ) ( ) u κ log log log log κ κ P 1 u = O a.s. 2 = O a.s. / log log (log log )2 log log κ,
11 74 PETER C. B. PHILLIPS ad deduce that wheever (3.12) IC IC 1 = C { ( )} 1 u P 1 u 1 C σ 2 + o a.s. < C C κ (log log )2 log log κ. This proves strog cosistecy uder the rate coditio (3.12) ad the iitial coditio IN(iii). Refereces Akaike, H. (1969). Fittig autoregressive models for predictio, Aals of the Itstitute of Statistical Mathematics, 21, Akaike, H. (1973). Iformatio theory ad a extesio of the maximum likelihood priciple, Secod Iteratioal Symposium o Iformatio Theory (eds. B. N. Petrov ad F. Csaki), Akademiai Kiado, Budapest. Akaike, H. (1977). O etropy maximizatio priciple, Applicatios of Statistics (ed. P. R. Krisharah), Amsterdam, North-Hollad. Dosker, M. D. ad Varadha, S. R. S. (1977). O laws of the iterated logarithm for local times, Commuicatios i Pure ad Applied Mathematics, 3, Haa, E. J. ad Qui, B. G. (1979). The determiatio of the order of a autoregressio, Joural of the Royal Statistical Society, Series B, 41, Kim, J.-Y. (1998). Large sample properties of posterior desities, Bayesia iformatio criterio ad the likelihood priciple i ostatioary time series models, Ecoometrica, 66, Lai, T. L. ad Wei, C. Z. (1982a). Asymptotic properties of projectios with applicatios to stochastic regressio problems, Joural of Multivariate Aalysis, 12, Lai, T. L. ad Wei, C. Z. (1982b). Least squares estimates i stochastic regressio models with applicatios to idetificatio ad cotrol of dyamic systems, Aals of Statistics, 1, Magdalios, T. ad Phillips, P. C. B. (26). Limit theory for coitegrated systems with moderately itegrated ad moderately explosive regressors, upublished paper, Yale Uiversity. Nielse, B. (26). Order determiatio i geeral vector autoregressios, IMS Lecture Notes- Moograph Series, 52, Phillips, P. C. B. (1987). Time series regressio with a uit root, Ecoometrica, 55, Phillips, P. C. B. (1996). Ecoometric model determiatio, Ecoometrica, 64, Phillips, P. C. B. ad Magdalios, T. (27). Uit root ad coitegratig limit theory whe iitializatio is i the ifiite past, upublished paper, Yale Uiversity. Phillips P. C. B. ad Ploberger, W. (1996). A asymptotic theory of Bayesia iferece for time series, Ecoometrica, 64, Phillips, P. C. B. ad Solo, V. (1992). Asymptotics for liear processes, Aals of Statistics, 2, Pötscher, B. M. (1989). Model selectio uder ostatioarity: Autoregressive models ad stochastic liear regressio models, Aals of Statistics, 17, Rissae, J. (1978). Modelig by shortest data descriptio, Automatica, 14, Schwarz, G. (1978). Estimatig the dimesio of a model, Aals of Statistics, 6, Tsay, R. S. (1984). Order selectio i ostatioary autoregressive models, Aals of Statistics, 12, Wei, C. Z. (1992). O predictive least squares priciples, Aals of Statistics, 2, 1 42.
Regression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationA note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors
Appl. Math. J. Chiese Uiv. 008, 3(): 97-0 A ote o self-ormalized Dickey-Fuller test for uit root i autoregressive time series with GARCH errors YANG Xiao-rog ZHANG Li-xi Abstract. I this article, the uit
More informationKolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data
Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationSlide Set 13 Linear Model with Endogenous Regressors and the GMM estimator
Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday
More informationBerry-Esseen bounds for self-normalized martingales
Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,
More informationA Weak Law of Large Numbers Under Weak Mixing
A Weak Law of Large Numbers Uder Weak Mixig Bruce E. Hase Uiversity of Wiscosi Jauary 209 Abstract This paper presets a ew weak law of large umbers (WLLN) for heterogeous depedet processes ad arrays. The
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationRank tests and regression rank scores tests in measurement error models
Rak tests ad regressio rak scores tests i measuremet error models J. Jurečková ad A.K.Md.E. Saleh Charles Uiversity i Prague ad Carleto Uiversity i Ottawa Abstract The rak ad regressio rak score tests
More informationQuantile regression with multilayer perceptrons.
Quatile regressio with multilayer perceptros. S.-F. Dimby ad J. Rykiewicz Uiversite Paris 1 - SAMM 90 Rue de Tolbiac, 75013 Paris - Frace Abstract. We cosider oliear quatile regressio ivolvig multilayer
More informationARIMA Models. Dan Saunders. y t = φy t 1 + ɛ t
ARIMA Models Da Sauders I will discuss models with a depedet variable y t, a potetially edogeous error term ɛ t, ad a exogeous error term η t, each with a subscript t deotig time. With just these three
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationTESTING FOR THE BUFFERED AUTOREGRESSIVE PROCESSES (SUPPLEMENTARY MATERIAL)
TESTING FOR THE BUFFERED AUTOREGRESSIVE PROCESSES SUPPLEMENTARY MATERIAL) By Ke Zhu, Philip L.H. Yu ad Wai Keug Li Chiese Academy of Scieces ad Uiversity of Hog Kog APPENDIX: PROOFS I this appedix, we
More informationLimit Theory for VARs with Mixed Roots Near Unity
Limit Theory for VARs with Mixed Roots Near Uity Peter C. B. Phillips Yale Uiversity, Uiversity of Aucklad, Sigapore Maagemet Uiversity & Uiversity of Southampto Ji Hyug Lee Yale Uiversity August, Abstract
More informationStrong consistency of log-likelihood-based information criterion in high-dimensional canonical correlation analysis
Strog cosistecy of log-likelihood-based iformatio criterio i high-dimesioal caoical correlatio aalysis Ryoya Oda, Hirokazu Yaagihara ad Yasuori Fujikoshi Departmet of Mathematics, Graduate School of Sciece,
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationON BARTLETT CORRECTABILITY OF EMPIRICAL LIKELIHOOD IN GENERALIZED POWER DIVERGENCE FAMILY. Lorenzo Camponovo and Taisuke Otsu.
ON BARTLETT CORRECTABILITY OF EMPIRICAL LIKELIHOOD IN GENERALIZED POWER DIVERGENCE FAMILY By Lorezo Campoovo ad Taisuke Otsu October 011 COWLES FOUNDATION DISCUSSION PAPER NO. 185 COWLES FOUNDATION FOR
More informationLECTURE 11 LINEAR PROCESSES III: ASYMPTOTIC RESULTS
PRIL 7, 9 where LECTURE LINER PROCESSES III: SYMPTOTIC RESULTS (Phillips ad Solo (99) ad Phillips Lecture Notes o Statioary ad Nostatioary Time Series) I this lecture, we discuss the LLN ad CLT for a liear
More informationLecture 24: Variable selection in linear models
Lecture 24: Variable selectio i liear models Cosider liear model X = Z β + ε, β R p ad Varε = σ 2 I. Like the LSE, the ridge regressio estimator does ot give 0 estimate to a compoet of β eve if that compoet
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationEntropy Rates and Asymptotic Equipartition
Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,
More informationInference for Alternating Time Series
Iferece for Alteratig Time Series Ursula U. Müller 1, Ato Schick 2, ad Wolfgag Wefelmeyer 3 1 Departmet of Statistics Texas A&M Uiversity College Statio, TX 77843-3143, USA (e-mail: uschi@stat.tamu.edu)
More informationAlgebra of Least Squares
October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationOn the Asymptotics of ADF Tests for Unit Roots 1
O the Asymptotics of ADF Tests for Uit Roots Yoosoo Chag Departmet of Ecoomics Rice Uiversity ad Joo Y. Park School of Ecoomics Seoul Natioal Uiversity Abstract I this paper, we derive the asymptotic distributios
More informationBull. Korean Math. Soc. 36 (1999), No. 3, pp. 451{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Seung Hoe Choi and Hae Kyung
Bull. Korea Math. Soc. 36 (999), No. 3, pp. 45{457 THE STRONG CONSISTENCY OF NONLINEAR REGRESSION QUANTILES ESTIMATORS Abstract. This paper provides suciet coditios which esure the strog cosistecy of regressio
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationPrecise Rates in Complete Moment Convergence for Negatively Associated Sequences
Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo
More informationKernel density estimator
Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I
More informationLecture 8: Convergence of transformations and law of large numbers
Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationSolution to Chapter 2 Analytical Exercises
Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =
More informationNotes 27 : Brownian motion: path properties
Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X
More informationAsymptotic Results for the Linear Regression Model
Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is
More informationMA Advanced Econometrics: Properties of Least Squares Estimators
MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationLecture Stat Maximum Likelihood Estimation
Lecture Stat 461-561 Maximum Likelihood Estimatio A.D. Jauary 2008 A.D. () Jauary 2008 1 / 63 Maximum Likelihood Estimatio Ivariace Cosistecy E ciecy Nuisace Parameters A.D. () Jauary 2008 2 / 63 Parametric
More informationEmpirical Processes: Glivenko Cantelli Theorems
Empirical Processes: Gliveko Catelli Theorems Mouliath Baerjee Jue 6, 200 Gliveko Catelli classes of fuctios The reader is referred to Chapter.6 of Weller s Torgo otes, Chapter??? of VDVW ad Chapter 8.3
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationUNIFORM INTERVAL ESTIMATION FOR AN AR(1) PROCESS WITH AR ERRORS
Statistica Siica 6 (06), 9-36 doi:http://dx.doi.org/0.5705/ss.04.5 UNIFORM INTERVAL ESTIMATION FOR AN AR() PROCESS WITH AR ERRORS Joatha Hill, Deyua Li ad Liag Peg Uiversity of North Carolia, Fuda Uiversity
More informationA New Solution Method for the Finite-Horizon Discrete-Time EOQ Problem
This is the Pre-Published Versio. A New Solutio Method for the Fiite-Horizo Discrete-Time EOQ Problem Chug-Lu Li Departmet of Logistics The Hog Kog Polytechic Uiversity Hug Hom, Kowloo, Hog Kog Phoe: +852-2766-7410
More informationLIMIT THEORY FOR EXPLOSIVELY COINTEGRATED SYSTEMS. PETER C. B. PHILLIPS and TASSOS MAGDALINOS COWLES FOUNDATION PAPER NO. 1244
LIMIT THEORY FOR EXPLOSIVELY COINTEGRATED SYSTEMS BY PETER C. B. PHILLIPS ad TASSOS MAGDALINOS COWLES FOUNDATION PAPER NO. 1244 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY Box 208281 New
More informationSTA6938-Logistic Regression Model
Dr. Yig Zhag STA6938-Logistic Regressio Model Topic -Simple (Uivariate) Logistic Regressio Model Outlies:. Itroductio. A Example-Does the liear regressio model always work? 3. Maximum Likelihood Curve
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More information1 Covariance Estimation
Eco 75 Lecture 5 Covariace Estimatio ad Optimal Weightig Matrices I this lecture, we cosider estimatio of the asymptotic covariace matrix B B of the extremum estimator b : Covariace Estimatio Lemma 4.
More informationFLOOR AND ROOF FUNCTION ANALOGS OF THE BELL NUMBERS. H. W. Gould Department of Mathematics, West Virginia University, Morgantown, WV 26506, USA
INTEGERS: ELECTRONIC JOURNAL OF COMBINATORIAL NUMBER THEORY 7 (2007), #A58 FLOOR AND ROOF FUNCTION ANALOGS OF THE BELL NUMBERS H. W. Gould Departmet of Mathematics, West Virgiia Uiversity, Morgatow, WV
More informationLinear Regression Models
Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect
More informationMi-Hwa Ko and Tae-Sung Kim
J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece
More informationEstablishing conditions for weak convergence to stochastic integrals
Establishig coditios for weak covergece to stochastic itegrals August 7, 26 Jiagya Peg School of Mathematical Scieces School of Maagemet ad Ecoomics Uiversity of Electroic Sciece ad Techology of Chia,
More informationA NECESSARY MOMENT CONDITION FOR THE FRACTIONAL FUNCTIONAL CENTRAL LIMIT THEOREM
Ecoometric Theory, 28, 2012, 671 679. doi:10.1017/s0266466611000697 A NECESSARY MOMENT CONDITION FOR THE FRACTIONAL FUNCTIONAL CENTRAL LIMIT THEOREM SØREN JOHANSEN Uiversity of Copehage ad CREATES MORTEN
More informationInformation Theory and Statistics Lecture 4: Lempel-Ziv code
Iformatio Theory ad Statistics Lecture 4: Lempel-Ziv code Łukasz Dębowski ldebowsk@ipipa.waw.pl Ph. D. Programme 203/204 Etropy rate is the limitig compressio rate Theorem For a statioary process (X i)
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationA Note on the Kolmogorov-Feller Weak Law of Large Numbers
Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu
More informationStatistical Inference Based on Extremum Estimators
T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0
More informationGoal. Adaptive Finite Element Methods for Non-Stationary Convection-Diffusion Problems. Outline. Differential Equation
Goal Adaptive Fiite Elemet Methods for No-Statioary Covectio-Diffusio Problems R. Verfürth Ruhr-Uiversität Bochum www.ruhr-ui-bochum.de/um1 Tübige / July 0th, 017 Preset space-time adaptive fiite elemet
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationNotes On Median and Quantile Regression. James L. Powell Department of Economics University of California, Berkeley
Notes O Media ad Quatile Regressio James L. Powell Departmet of Ecoomics Uiversity of Califoria, Berkeley Coditioal Media Restrictios ad Least Absolute Deviatios It is well-kow that the expected value
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationJ. Stat. Appl. Pro. Lett. 2, No. 1, (2015) 15
J. Stat. Appl. Pro. Lett. 2, No. 1, 15-22 2015 15 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.12785/jsapl/020102 Martigale Method for Rui Probabilityi
More informationA Note on Box-Cox Quantile Regression Estimation of the Parameters of the Generalized Pareto Distribution
A Note o Box-Cox Quatile Regressio Estimatio of the Parameters of the Geeralized Pareto Distributio JM va Zyl Abstract: Makig use of the quatile equatio, Box-Cox regressio ad Laplace distributed disturbaces,
More informationCOWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY
LIMIT THEORY FOR MODERATE DEVIATIONS FROM A UNIT ROOT By Peter C.B. Phillips ad Tassos Magdalios July 4 COWLES FOUNDATION DISCUSSION PAPER NO. 47 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY
More informationResearch Article Moment Inequality for ϕ-mixing Sequences and Its Applications
Hidawi Publishig Corporatio Joural of Iequalities ad Applicatios Volume 2009, Article ID 379743, 2 pages doi:0.55/2009/379743 Research Article Momet Iequality for ϕ-mixig Sequeces ad Its Applicatios Wag
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationOn the convergence rates of Gladyshev s Hurst index estimator
Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity
More informationOn forward improvement iteration for stopping problems
O forward improvemet iteratio for stoppig problems Mathematical Istitute, Uiversity of Kiel, Ludewig-Mey-Str. 4, D-24098 Kiel, Germay irle@math.ui-iel.de Albrecht Irle Abstract. We cosider the optimal
More informationMaximum Likelihood Estimation
Chapter 9 Maximum Likelihood Estimatio 9.1 The Likelihood Fuctio The maximum likelihood estimator is the most widely used estimatio method. This chapter discusses the most importat cocepts behid maximum
More informationCOINTEGRATING RANK SELECTION IN MODELS WITH TIME-VARYING VARIANCE. Xu Cheng and Peter C. B. Phillips. January 2009
COINTEGRATING RANK SELECTION IN MODELS WITH TIME-VARYING VARIANCE By Xu Cheg ad Peter C. B. Phillips Jauary 29 COWLES FOUNDATION DISCUSSION PAPER NO. 688 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE
More informationSummary and Discussion on Simultaneous Analysis of Lasso and Dantzig Selector
Summary ad Discussio o Simultaeous Aalysis of Lasso ad Datzig Selector STAT732, Sprig 28 Duzhe Wag May 4, 28 Abstract This is a discussio o the work i Bickel, Ritov ad Tsybakov (29). We begi with a short
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationSelf-normalized deviation inequalities with application to t-statistic
Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric
More informationSimilarity Solutions to Unsteady Pseudoplastic. Flow Near a Moving Wall
Iteratioal Mathematical Forum, Vol. 9, 04, o. 3, 465-475 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/0.988/imf.04.48 Similarity Solutios to Usteady Pseudoplastic Flow Near a Movig Wall W. Robi Egieerig
More informationECON 3150/4150, Spring term Lecture 3
Itroductio Fidig the best fit by regressio Residuals ad R-sq Regressio ad causality Summary ad ext step ECON 3150/4150, Sprig term 2014. Lecture 3 Ragar Nymoe Uiversity of Oslo 21 Jauary 2014 1 / 30 Itroductio
More informationLecture 7: October 18, 2017
Iformatio ad Codig Theory Autum 207 Lecturer: Madhur Tulsiai Lecture 7: October 8, 207 Biary hypothesis testig I this lecture, we apply the tools developed i the past few lectures to uderstad the problem
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationR. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State
Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com
More informationMarkov Decision Processes
Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes
More informationCointegration versus Spurious Regression and Heterogeneity in Large Panels
Coitegratio versus Spurious Regressio ad Heterogeeity i Large Paels Lorezo rapai Cass Busiess School Jauary 8, 009 Abstract his paper provides a estimatio ad testig framework to idetify the source(s) of
More informationBootstrapping Cointegrating Regressions 1
Bootstrappig Coitegratig Regressios Yoosoo Chag Departmet of Ecoomics Rice Uiversity Joo Y. Park School of Ecoomics Seoul Natioal Uiversity Kevi Sog Departmet of Ecoomics Yale Uiversity Abstract I this
More informationConditional-Sum-of-Squares Estimation of Models for Stationary Time Series with Long Memory
Coditioal-Sum-of-Squares Estimatio of Models for Statioary Time Series with Log Memory.M. Robiso Lodo School of Ecoomics The Sutory Cetre Sutory ad Toyota Iteratioal Cetres for Ecoomics ad Related Disciplies
More informationA Note on Matrix Rigidity
A Note o Matrix Rigidity Joel Friedma Departmet of Computer Sciece Priceto Uiversity Priceto, NJ 08544 Jue 25, 1990 Revised October 25, 1991 Abstract I this paper we give a explicit costructio of matrices
More informationStudy the bias (due to the nite dimensional approximation) and variance of the estimators
2 Series Methods 2. Geeral Approach A model has parameters (; ) where is ite-dimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite
More informationEntropy and Ergodic Theory Lecture 5: Joint typicality and conditional AEP
Etropy ad Ergodic Theory Lecture 5: Joit typicality ad coditioal AEP 1 Notatio: from RVs back to distributios Let (Ω, F, P) be a probability space, ad let X ad Y be A- ad B-valued discrete RVs, respectively.
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationGamma Distribution and Gamma Approximation
Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract
More informationLecture 3 The Lebesgue Integral
Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified
More information6a Time change b Quadratic variation c Planar Brownian motion d Conformal local martingales e Hints to exercises...
Tel Aviv Uiversity, 28 Browia motio 59 6 Time chage 6a Time chage..................... 59 6b Quadratic variatio................. 61 6c Plaar Browia motio.............. 64 6d Coformal local martigales............
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationRiesz-Fischer Sequences and Lower Frame Bounds
Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.
More information