Goodness-of-fit testing for fractional diffusions. Mark Podolskij and Katrin Wasmuth. CREATES Research Paper

Size: px
Start display at page:

Download "Goodness-of-fit testing for fractional diffusions. Mark Podolskij and Katrin Wasmuth. CREATES Research Paper"

Transcription

1 Goodess-of-fit testig for fractioal diffusios Mark odolskij ad Katri Wasmuth CREATES Research aper Departmet of Ecoomics ad Busiess Aarhus Uiversity Bartholis Allé 1 DK-8 Aarhus C Demark oekoomi@au.dk Tel:

2 Goodess-of-fit testig for fractioal diffusios Mark odolskij Katri Wasmuth April 16, 212 Abstract This paper presets a goodess-of-fit test for the volatility fuctio of a SDE drive by a Gaussia process with statioary ad cetered icremets. Uder rather weak assumptios o the Gaussia process, we provide a procedure for testig whether the ukow volatility fuctio lies i a give liear fuctioal space or ot. This testig problem is highly o-trivial, because the volatility fuctio is ot idetifiable i our model. The uderlyig fractioal diffusio is assumed to be observed at high frequecy o a fixed time iterval ad the test statistic is based o weighted power variatios. Our test statistic is cosistet agaist ay fixed alterative. Keywords: cetral limit theorem, goodess-of-fit tests, high frequecy observatios, fractioal diffusios, stable covergece. JEL Classificatio: C1, C13, C14. 1 Itroductio I this paper we cosider a stochastic differetial equatio dx t = a(t, X t dt + σ(t, X t dg t, X = x R, drive by a Gaussia process (G t t with statioary ad cetered icremets. Our aim is to derive a goodess-of-fit test for the volatility fuctio σ 2 : [, 1] R R + o the basis of discrete high frequecy observatios X i, i =,..., [1/ ], of the path (X t t [,1]. The otio of high frequecy refers to the ifill asymptotics settig, i.e.. More precisely, we will propose a procedure for testig whether the ukow volatility fuctio σ 2 lies i a liear subspace geerated by give volatility fuctios σ 2 k : [, 1] R R+, 1 k d. Mark odolskij gratefully ackowledges fiacial support from CREATES fuded by the Daish Natioal Research Foudatio. Departmet of Mathematics, Heidelberg Uiversity, INF 294, 6912 Heidelberg, Germay, m.podolskij@ui-heidelberg.de. Departmet of Mathematics, Heidelberg Uiversity, INF 294, 6912 Heidelberg, Germay, KatriWasmuth@aol.com. 1

3 Goodess-of-fit testig for fractioal diffusios 2 This type of goodess-of-fit testig has bee studied i the literature for the case of classical diffusios that are drive by a stadard Browia motio (see e.g. [6]; we also refer to [1] for similar testig problems uder a differet samplig scheme. Compared to the classical case, we will have to deal with additioal o-trivial theoretical challeges. First of all, uder our mild assumptios o the drivig Gaussia process G, the volatility fuctio σ 2 is ot idetifiable. This fact ca be easily see by observig that a multiplicatio of the volatility fuctio σ 2 by a costat ca ot be distiguished from the multiplicatio of G by the same costat. Secodly, the resultig test statistic should be robust to the presece of the drift process a (i.e. the limit theory should ot deped o a, because the drift a ca ot be estimated o a fixed time iterval [, 1]. The third theoretical problem is comig from the fact that the (stable cetral limit theorems for usual power variatio statistics, which will be the mai tool for hypothesis testig, oly hold for a subrage of smoothess parameters of G, while we would like to obtai a valid testig procedure for all smoothess parameters of G. Our test statistic is a fuctio of various weighted power variatios based o the secod order differeces of X. Higher order differeces is a key istrumet for obtaiig valid cetral limit theorems for all smoothess parameters of G, but more importatly they also isure the robustess to the drift process a (i cotrast to the first order differeces. The secod crucial issue of our test statistic is the self-scalig property, which makes it idepedet of the ukow variace of dg t. This solves the o-idetifiability problem that we metioed above. Our paper is orgaised as follows. I sectio 2 we preset the mai assumptios o the processes a, σ 2 ad G, which esure the existece of the uique solutio of the above SDE ad the validity of the asymptotic results. I sectio 3 we explai the testig problem ad costruct a distace measure, which eables us to make statistical decisios. I sectio 4 we derive our test statistic ad show its asymptotic mixed ormality. Sectio 5 is devoted to proofs. 2 Model ad assumptios We cosider a oe-dimesioal fractioal diffusio model of the form X t = x + t a(s, X s ds + t σ(s, X s dg s, t [, 1], (2.1 defied o a probability space (Ω, F, with x R. Here the fuctio a : [, 1] R R represets the drift, σ : [, 1] R R is the o-vaishig volatility fuctio ad G = (G t t [,1] is a Gaussia process with statioary ad cetered icremets. To esure the existece of the secod itegral i (2.1 (i the Riema-Stieltjes sese we eed to assume that the process G is Hölder cotiuous of order bigger tha 1/2. More precisely, we impose structural assumptios o the covariace kerel of the Gaussia driver G. Let R deote the variace fuctio of the icremets of G, i.e. R(t = E[ G t+s G s 2 ], t, (2.2

4 Goodess-of-fit testig for fractioal diffusios 3 which is idepedet of s sice G has statioary icremets. Below, the fuctios L R, L R (4 : R > R are assumed to be cotiuous ad slowly varyig at, f (k deotes the k-th derivative of a fuctio f ad H (1/2, 1. We assume that the followig coditios are satisfied: (i R(t = t 2H L R (t. (ii R (4 (t = t 2H 4 L R (4(t. (iii There exists a costat b (, 1 such that lim sup sup L R (4(y <. x L R (x y [x,x b ] We remark that coditio (i implies that G is Hölder cotiuous of all orders smaller tha H (1/2, 1. Of course, the whole set of coditios is ot required to guaratee the existece of a uique solutio of the SDE (2.1, but we do require assumptios (i-(iii for the cetral limit theorems that are preseted i sectio 4 (cf. [3]. Notice that coditio (i idicates that the local behaviour of the Gaussia process G is similar to the local behaviour of the fractioal Browia motio with Hurst parameter H (1/2, 1. This fact will be reflected i the cetral limit theorems preseted i sectio 4. Now, the results of [9] imply the existece of a uique solutio of the SDE (2.1, where the secod itegral i (2.1 is defied pathwise i the Riema-Stieltjes sese, give the followig set of coditios is satisfied: (iv The fuctio a(t, is Lipschitz, uiformly i t [, 1]. The fuctio a(, x is Hölder cotiuous of order γ H, uiformly i x R. Furthermore, it satisfies the growth coditio a(t, x C x + a (t for some C > ad a L p ([, 1] for some p > 1 1 H. (v The fuctio σ(t, is Lipschitz, uiformly i t [, 1], ad σ is cotiuously differetiable i x. Furthermore, there exist costats < α, β 1 with β > 1/2 ad α > 1 H 1 such that: (a xσ(t, is locally Hölder cotiuous of order α, uiformly i t [, 1], (b σ(, x ad xσ(, x are Hölder cotiuous of order β, uiformly i x R. The assumptios (iv ad (v iclude some coditios that are required to prove our asymptotic results; hece, they are slightly stroger tha cosidered i [9]. Furthermore, uder coditios (iv-(v, the uique solutio of (2.1 satisfies β X C 1 δ ([, 1] a.s., (2.3 for ay δ (1 H, mi{ 1 2, α, 1+β } (see agai [9]. Throughout this paper we assume that, for ay k N ad ay t 1,..., t k >, the radom vector (X t1,..., X tk has a Lebesgue desity. This techical coditios esures the ivertibility of the matrices Σ ad Σ defied by (3.6 ad (4.3, respectively.

5 Goodess-of-fit testig for fractioal diffusios 4 3 The test problem We assume that the process X defied i (2.1 is observed at time poits t i = i, i.e. the high frequecy observatios X, X, X 2,..., X [1/ ] are give ad. For d 1, let σ1 2,..., σ2 d : [, 1] R R be kow fuctios that satisfy the assumptio (v from sectio 2. We assume that the fuctios σ1 2,..., σ2 d are liearly idepedet o the sets of the form [, 1] [a, b], for all a < b, ad deote by V the vector space geerated by σ1 2,..., σ2 d, i.e. V = spa{σ1, 2..., σd 2 }. (3.1 Our mai aim is to decide, o the basis of the uderlyig observatios X i, whether the ukow volatility fuctio σ 2 is a liear combiatio of the kow fuctios σ 2 1,..., σ2 d. More precisely, the ull hypothesis is give by H : σ 2 (t, X t = d λ k σk 2 (t, X t for some λ k s ad a.s. all t [, 1], (3.2 k=1 while the alterative is defied as the complemet hypothesis. We remark that ay possible test procedure ca oly give pathwise coclusios. For istace, whe H holds for the observed path X(ω it does ot mea that it remais true for a differet path X(ω. Furthermore, H does ot imply the idetity σ 2 (t, x = d k=1 λ kσk 2(t, x for some (λ 1,..., λ d ad a.s. all (t, x [, 1] R. Our test procedure will be based o the estimatio of the L 2 -distace betwee the vector space V ad the volatility fuctio σ 2. For this purpose we itroduce the followig radom scalar product: for ay fuctios f, g : [, 1] R R we defie f, g := 1 f(s, X s g(s, X s ds. (3.3 We also set f := f, f ad deote by V f the distace betwee the vector space V ad the fuctio f, i.e. V f := if{ v f : v V}. Now, we ca reformulate the ull hypothesis ad the alterative as H : V σ 2 =, H 1 : V σ 2 >, (3.4 where the vector space V is defied i (3.1. The stadard argumets from the Hilbert space theory imply the idetity ( V σ 2 2 = σ 2 2 σ1, 2 σ 2,..., σd 2, σ2 Σ 1(, σ1, 2 σ 2,..., σd 2, σ2 (3.5 Σ = ( σk 2, σ2 l, (3.6 1 k,l d

6 Goodess-of-fit testig for fractioal diffusios 5 where v deotes the traspose of the vector v. I cotrast to the work of [6], who followed a similar approach for the goodess-of-fit testig for classical diffusios (that are drive by a Browia motio, the distace measure V σ 2 2 is ot the right quatity to estimate i the fractioal diffusio case. The mai reaso lies i the fact that the objects σ 2 ad σ 2 k, σ2, 1 k d, ca ot be idetified, because our assumptios are ot sufficiet to fully idetify the variace fuctio R. I order to obtai a feasible estimator, we defie a self-scalig measure T as T = V σ2 2 σ 2 2, (3.7 which turs out to be a crucial trasformatio of the origial distace measure V σ 2. We will see that the radom measure T ca be cosistetly estimated without a precise kowledge of the fuctio R. We also have the appealig property T 1, which describes the deviatio from the ull hypothesis T = i percet (i cotrast, it is ot clear whe the quatity V σ 2 ca be idetified as small. = 1, which correspods to the homoscedas- Remark 3.1 For the simple case d = 1, σ1 2 ticity testig, we obtai the idetity ( 1 σ2 (s, X s ds T = 1 1 σ4 (s, X s ds 2. 4 The testig procedure I this sectio we costruct a cosistet, asymptotically mixed ormal, estimator T of the radom variable T defied i (3.7. Our pla is to costruct empirical aalogues of the quatities σ 2 2, σk 2, σ2, σk 2, σ2 l, 1 k, l d, prove their asymptotic mixed ormality ad apply the delta-method. I the high frequecy settig (weighted power variatios based o icremets of X i X (i 1 are kow to be cosistet estimators of itegrated powers of volatility. However, i our framework of fractioal diffusios, it makes more sese to use higher order differeces. We set i,2x = X i 2X (i 1 + X (i 2, τ 2 = E[ i,2g 2 ].

7 Goodess-of-fit testig for fractioal diffusios 6 The empirical aalogues of σ 2 2, σk 2, σ2, σk 2, σ2 l, 1 k, l d, are defied as σ 2 2 = [1/ ] 3τ 4 i,2x 4, (4.1 σ 2 k, σ2 = τ 2 [1/ ] [1/ σk 2, σ2 l ] = i= σ 2 k,(i 2 i,2x 2, σ 2 k,i σ 2 l,i, where we use a shorthad otatio σ 2 k,s = σ2 k (s, X s. I our settig usig secod order differeces has the followig crucial advatages: (a The cetral limit theorem preseted below holds for all H (1/2, 1 while it would hold oly for H (1/2, 3/4 if we would use the stadard icremets of X; this effect of higher order differeces is kow i the literature i the pure Gaussia framework (see e.g. [8], (b More importatly, the cetral limit theorem is ot iflueced by the presece of the drift fuctio a, which would ot be true i the case of the stadard icremets of X (this is a less kow fact. Fially, we defie σ 2 2 ( σ1 2, σ2,..., σd 2, σ2 T = σ 2 2 Σ = Σ 1 ( σ 2 1, σ2,..., σ 2 d, σ2, (4.2 ( σk 2, σ2 l. (4.3 1 k,l d Remark 4.1 The statistics defied i (4.1 are ot feasible, because the ormalisig costat τ is ukow! However, it is easy to see that the test statistic T is feasible due to the self-scalig property. For istace, whe d = 1 ad σ1 2 = 1 we obtai the idetity ( [1/ ] 2 3 i,2 X 2 T = 1, i,2 X 4 which obviously does ot deped o the ukow costat τ. As it has bee metioed i e.g. [5], uder the assumptio (i of sectio 2, it holds that corr( 1,2G, 1+j,2G ρ(j = (j + 22H + 4(j + 1 2H 6j 2H + 4 j 1 2H j 2 2H, 2 (4 2 2H as, ad ρ = ρ H is the correlatio fuctio of the secod order fractioal oise ( i,2 BH i 1 with Hurst parameter H. Notice that ρ(j j 2H 4 as j, which implies that j=1 ρ(j < for all H (1/2, 1.

8 Goodess-of-fit testig for fractioal diffusios 7 I the ext theorem we demostrate a multivariate stable cetral limit theorem. Recall that a sequece of radom variables Y o (Ω, F, coverges stably i law towards Y st (Y Y, which is defied o the extesio (Ω, F, of the origial probability space (Ω, F,, iff lim E[f(Y Z] = E [f(y Z] for all bouded radom variables Z ad all bouded, cotiuous fuctios f (see e.g. [2] for more details. We call Y mixed ormal with mea ad coditioal covariace matrix V (Y = MN(, V whe, coditioally o F, Y has a ormal distributio with mea ad covariace matrix V. The ext results maily follow from the theory preseted i [3], [4] ad [5]. Theorem 4.2 Assume that the coditios (i-(v from sectio 2 hold. The we obtai the covergece σ 2 2 σ 2 2, σk 2, σ2 σk 2, σ2, σk 2, σ2 l σk 2, σ2 l. (4.4 Furthermore, we deduce the stable covergece σ 2 2 σ 2 2 σ1 2, σ2 σ1 2, σ2 1/2. σ 2 d, σ2 σ 2 d, σ2 st MN d+1 (, where V s R (d+1 (d+1 is a symmetric matrix defied as V 11 s = α H σ 8 s, V 1,k+1 s = β H σ 2 k,s σ6 s, 1 k d, 1 V k+1,l+1 s = γ H σ 2 k,s σ2 l,s σ4 s, 1 k, l d, ad the costats α H, β H ad γ H are give by α H = 1 9 β H = 1 3 ( 96 + γ H = {48ρ 4 (k + 144ρ 2 (k}, k=1 ( k=1 ρ 2 (k. k=1 ρ 2 (k, V s ds, (4.5 Fially, it holds that 1/2 (Σ Σ. (4.6

9 Goodess-of-fit testig for fractioal diffusios 8 Now, we wat to apply the delta-method. For a ivertible matrix A R d d ad x R d+1, we defie the fuctio g(x; A := x 1 (x 2,..., x d+1 A 1 (x 2,..., x d+1 x 1. The the idetity T T = g( σ 2 2, σ 2 1, σ 2,..., σ 2 d, σ2 ; Σ g( σ 2 2, σ 2 1, σ 2,..., σ 2 d, σ2 ; Σ holds. Notice that the matrices Σ ad Σ are ivertible a.s., because the fuctios σ1 2,..., σ2 d are liearly idepedet o the sets of the form [, 1] [a, b] for all a < b, ad the radom vector (X t1,..., X tk has a Lebesgue desity for all k N ad all t 1,..., t k >. Usig (4.6 we deduce that T T = g( σ 2 2, σ 2 1, σ 2,..., σ 2 d, σ2 ; Σ g( σ 2 2, σ 2 1, σ 2,..., σ 2 d, σ2 ; Σ + o ( 1/2. This decompositio will imply the mixed ormality of 1/2 (T T by the delta-method for stable covergece. However, to obtai a feasible test statistic we still eed to estimate the coditioal covariace matrix V = 1 V sds. This cosists of two subproblems: (a Estimatio of the parameter H (1/2, 1 ad (b Estimatio of itegrated products of various volatility fuctios. The first estimatio problem is solved via a chage-offrequecy method H := 1 2 log 2 ( i=4 X i 2X (i 2 + X (i 4 2, X i 2X (i 1 + X (i 2 2 which compares oe realised measure at two differet frequecies (log 2 deotes the logarithm with basis 2. Ideed, sectio 4.3 from [5] shows that H H. (4.7 Notice that the coefficiets α H, β H ad γ H are cotiuous i H, which implies that α H α H, β H β H, γ H γ H. Now, we are able to costruct a empirical (symmetric aalogue of the matrix V = 1 V sds: V 11 V 1,k+1 V k+1,l+1 = α H 15τ 8 = β H 15τ 6 [1/ ] = γ H 3τ 4 [1/ ] i,2x 8, [1/ ] σ 2 k,(i 2 i,2x 6, 1 k d, σ 2 k,(i 2 σ 2 l,(i 2 i,2x 4, 1 k, l d.

10 Goodess-of-fit testig for fractioal diffusios 9 Before we preset the ext theorem, we itroduce a shorthad otatio g = g( σ 2 2, σ 2 1, σ 2,..., σ 2 d, σ2 ; Σ, g = g( σ 2 2, σ 2 1, σ 2,..., σ 2 d, σ2 ; Σ. The ext result follows directly from Theorem 4.2 ad the delta-method for stable covergece (see e.g. ropositio 2.5 i [1]. Theorem 4.3 Assume that the coditios (i-(v from sectio 2 hold. The we obtai the followig results: (a It holds that 1/2 (T T st MN (, gv g with V = 1 V sds. (b We obtai the covergece i probability V 1/2 (T T g V g V ad d N (, 1. (4.8 As we have already metioed, part (a of Theorem 4.3 follows from Theorem 4.2 ad the delta-method for stable covergece. The stadard cetral limit theorem i (4.8 follows agai from the properties of stable covergece, part (a of Theorem 4.3 ad V V, g g. Remark 4.4 The statistic g V g is ideed feasible, i.e. it does ot deped o the ormalisig costat τ. For istace, whe d = 1 ad σ1 2 = 1 we deduce the idetities ( [1/ ] 2 i,2 X 2 Σ = 1, g = V = α H 15τ 8 β H 15τ 6 τ ( 2 3τ 4 i,2 X 4 2, i,2 X 8 β H 15τ 6 i,2 X 6 γ H 3τ 4 2 τ 2 3τ 4 i,2 X 2, i,2 X 4 i,2 X 6 i,2 X 4 which implies that ( [1/ ] 2 g V g 9 i,2 X 2 6 [1/ ] i,2 = ( [1/ ] 2, X 2 i,2 X 4 i,2 X 4 α H 15 β H 15 i,2 X 8 β H 15 i,2 X 6 γ H 3 ( [1/ ] 2 9 i,2 X 2 ( [1/ ] 2, i,2 X 4 i,2 X 6 i,2 X 4 6 [1/ ] i,2 X 2 i,2 X 4,

11 Goodess-of-fit testig for fractioal diffusios 1 Fially, we defie our test statistic as S = 1/2 T. (4.9 g V g The ext propositio follows directly from part (b of Theorem 4.3. ropositio 4.5 Assume that the coditios (i-(v from sectio 2 hold. We reject the ull hypothesis H : V σ 2 = if S > u 1 α, where u 1 α deotes the (1 α quatile of N (, 1. The it holds that H (S > u 1 α α, H1 (S > u 1 α 1. I other words, the test statistic S has asymptotic level α ad it is cosistet agaist ay fixed alterative. 5 roofs We cocetrate o the proof of Theorem 4.2 as all other theorems follow from this result. The justificatio of Theorem 4.2 relies o a combiatio of various methods preseted i [3], [4] ad [5], which we sketch below. Let us defie X t = X + t σ s dg s, (5.1 which correspods to the process X with a (recall the otatio σ s = σ(s, X s. (a We start by cosiderig the process X istead of the origial process X. The theory preseted i [3] ad [5] implies that the approximatio i,2x σ (i 2 i,2g does ot ifluece the limit behavior. The paper [3] oly deals with power variatios of the first order differeces of the process X, while [5] cosiders higher order differeces of Browia semi-statioary processes, which do ot have the form (5.1. However, the secod order differeces of both processes are well approximated by the same expressio σ (i 2 i,2g (we refer to (5.5 ad (5.1 i [5] for more details. For this reaso we ca rely o the methods of [3], [4] ad [5] from ow o, eve though the papers [4] ad [5] do ot deal with the process X directly.

12 Goodess-of-fit testig for fractioal diffusios 11 (b Usig part (a it ca be deduced that τ p [1/ ] i,2x p 1 m p σ s p ds, p >, with m p = E[ N (, 1 p ]. This result was show i [3] for the first order differeces (see Theorem 2 therei, but the proof remais true for higher order differeces (cf. Theorem 3.1 i [5]. Observig the approximatio of part (a ad followig the lies of the proof i [3] ad [4], we see that the above covergece i probability (ad also the associated cetral limit theorem remais valid if we itroduce weight processes σk 2 as log as they are Lebesgue itegrable. Thus, the covergece i probability stated i (4.4 ad the covergece V V from part (b of Theorem 4.3 are valid for the process X. (c It remais to justify the cetral limit theorem preseted i (4.5. Here we will rely o the multivariate cetral limit theorem for secod order differeces preseted i [5] (see Theorem 3.3 therei. First of all, we eed to show that the volatility process σ s = σ(s, X s is Hölder cotiuous of order > 1/2 to apply the aforemetioed result. But this is obviously true as σ s σ t σ(s, X s σ(t, X s + σ(t, X s σ(t, X t C 1 t s β + C 2 t s 1 δ, for some C 1, C 2 >, due to assumptio (v i sectio 2 ad (2.3. Sice β > 1/2 ad δ ca be chose to satisfy 1 δ > 1/2 (because H > 1/2, we deduce that (σ s s [,1] is Hölder cotiuous of order > 1/2. Now we are able to apply Theorem 3.3 from [5] for the process X. For simplicity we oly preset a joit cetral limit theorem for the vector 1/2 ( σk 2, σ2 σk 2, σ2, σl 2, σ2 σl 2, σ2 with 1 k, l d. Theorem 3.3 i [5] (applied to X states that with 1/2 ( σ 2 k, σ2 σ 2 k, σ2, σ 2 l, σ2 σ 2 l, σ2 st MN 2 (, V 11 s = µσ 4 k,s σ4 s, V 12 s = µσ 2 k,s σ2 l,s σ4 s, V 22 s = µσ 4 l,s σ4 s, 1 V s ds ad µ = lim 1 Var [1/ ] i,2 BH 2 Var( i,2 BH 2, where B H deotes a fractioal Browia motio with Hurst parameter H. A straightforward calculatio shows that µ = γ H. Hece, we obtai (4.5 for the process X. (d Fially, we eed to prove that Theorem 4.2 holds for the origial process X (rather

13 Goodess-of-fit testig for fractioal diffusios 12 tha oly for X. For simplicity, let us oly cosider the first estimator σ 2, σ 2. Sice Theorem 4.2 is valid for the process X, it suffices to show that 1/2 3τ 4 ( [1/ ] [1/ ] i,2x 4 i,2x 4. Let us set A t = t a(s, X sds. The mea value theorem implies that i,2x 4 i,2x 4 C i,2a ( i,2x 3 + i,2x 3 for some C >. Now, due to assumptios (i, (iv, (v from sectio 2 ad (2.3, we obtai for some ε > small eough ad K > : τ 4 K 4H ε, i,2a K 1+H ε, i,2x K H ε, i,2x K H ε. Thus, 1/2 3τ 4 ( [1/ ] [1/ ] i,2x 4 Choosig ε > small eough we deduce the desired result. i,2x 4 K 1/2 5ε. (e We are left to provig the covergece 1/2 (Σ Σ from (4.6. Sice the processes (σ k,s s [,1], k = 1,..., d, are Hölder cotiuous of order η > 1/2 (see step (c, we readily deduce that for all 1 k, l d. 1/2 Σ Σ 1/2 1 σk,s 2 σ2 l,s σ2 k,[s/ ] σl,[s/ 2 ds ] Refereces [1] Aït-Sahalia, Y. (1996: Testig cotiuous time models of the spot iterest rate. Review of Fiacial Studies 9, [2] Aldous, D.J., ad G.K. Eagleso (1978: O mixig ad stability of limit theorems. A. of rob. 6(2, [3] Bardorff-Nielse, O.E., J.M. Corcuera ad M. odolskij (29: ower variatio for Gaussia processes with statioary icremets. Stochastic rocesses ad Their Applicatios 119, [4] Bardorff-Nielse, O.E., J.M. Corcuera ad M. odolskij (211: Multipower variatio for Browia semistatioary processes. Beroulli 17(4,

14 Goodess-of-fit testig for fractioal diffusios 13 [5] Bardorff-Nielse, O.E., J.M. Corcuera ad M. odolskij (211: Limit theorems for fuctioals of higher order differeces of Browia semi-statioary processes. To appear i rokhorov ad Cotemporary robability Theory. [6] Dette, H., M. odolskij ad M. Vetter (26: Estimatio of itegrated volatility i cotiuous time fiacial models with applicatios to goodess-of-fit testig. Scadiavia Joural of Statistics 33, [7] Hall,. ad C.C. Heyde (198: Martigale limit theory ad its applicatio. Academic ress, New York. [8] Istas, J. ad G. Lag (1997: Quadratic variatios ad estimatio of the local Hölder idex of a Gaussia process. A. Ist. Heri oicaré, robabilités et statistiques, 33(4, [9] Nualart, D. ad A. Rascau (22: Differetial equatios drive by fractioal Browia motio. Collect. Math. 53(1, [1] odolskij, M. ad M. Vetter (21: Uderstadig limit theorems for semimartigales: a short survey. Statistica Nederladica 64(3,

15 Research apers : Torbe G. Aderse ad Oleg Bodareko: VIN ad the Flash Crash : Tim Bollerslev, Daiela Osterrieder, Natalia Sizova ad George Tauche: Risk ad Retur: Log-Ru Relatioships, Fractioal Coitegratio, ad Retur redictability : Lars Stetoft: What we ca lear from pricig 139,879 Idividual Stock Optios : Kim Christese, Mark odolskij ad Mathias Vetter: O covariatio estimatio for multivariate cotiuous Itô semimartigales with oise i o-sychroous observatio schemes 212-1: Matei Demetrescu ad Robiso Kruse: The ower of Uit Root Tests Agaist Noliear Local Alteratives 212-2: Matias D. Cattaeo, Michael Jasso ad Whitey K. Newey: Alterative Asymptotics ad the artially Liear Model with May Regressors 212-3: Matt. Dziubiski: Coditioally-Uiform Feasible Grid Search Algorithm 212-4: Jeroe V.K. Rombouts, Lars Stetoft ad Fracesco Violate: The Value of Multivariate Model Sophisticatio: A Applicatio to pricig Dow Joes Idustrial Average optios 212-5: Aders Bredahl Kock: O the Oracle roperty of the Adaptive LASSO i Statioary ad Nostatioary Autoregressios 212-6: Christia Bach ad Matt. Dziubiski: Commodity derivatives pricig with ivetory effects 212-7: Cristia Amado ad Timo Teräsvirta: Modellig Chages i the Ucoditioal Variace of Log Stock Retur Series 212-8: Ae Opschoor, Michel va der Wel, Dick va Dijk ad Nick Taylor: O the Effects of rivate Iformatio o Volatility 212-9: Aastiia Silveoie ad Timo Teräsvirta: Modellig coditioal correlatios of asset returs: A smooth trasitio approach 212-1: eter Exterkate: Model Selectio i Kerel Ridge Regressio : Torbe G. Aderse, Nicola Fusari ad Viktor Todorov: arametric Iferece ad Dyamic State Recovery from Optio aels : Mark odolskij ad Katri Wasmuth: Goodess-of-fit testig for fractioal diffusios

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

On the convergence rates of Gladyshev s Hurst index estimator

On the convergence rates of Gladyshev s Hurst index estimator Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity

More information

Efficient GMM LECTURE 12 GMM II

Efficient GMM LECTURE 12 GMM II DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

1 The Haar functions and the Brownian motion

1 The Haar functions and the Brownian motion 1 The Haar fuctios ad the Browia motio 1.1 The Haar fuctios ad their completeess The Haar fuctios The basic Haar fuctio is 1 if x < 1/2, ψx) = 1 if 1/2 x < 1, otherwise. 1.1) It has mea zero 1 ψx)dx =,

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

Notes 27 : Brownian motion: path properties

Notes 27 : Brownian motion: path properties Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales. A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it

More information

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula

Journal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

1 Approximating Integrals using Taylor Polynomials

1 Approximating Integrals using Taylor Polynomials Seughee Ye Ma 8: Week 7 Nov Week 7 Summary This week, we will lear how we ca approximate itegrals usig Taylor series ad umerical methods. Topics Page Approximatig Itegrals usig Taylor Polyomials. Defiitios................................................

More information

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences

Precise Rates in Complete Moment Convergence for Negatively Associated Sequences Commuicatios of the Korea Statistical Society 29, Vol. 16, No. 5, 841 849 Precise Rates i Complete Momet Covergece for Negatively Associated Sequeces Dae-Hee Ryu 1,a a Departmet of Computer Sciece, ChugWoo

More information

5.1 A mutual information bound based on metric entropy

5.1 A mutual information bound based on metric entropy Chapter 5 Global Fao Method I this chapter, we exted the techiques of Chapter 2.4 o Fao s method the local Fao method) to a more global costructio. I particular, we show that, rather tha costructig a local

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

A note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors

A note on self-normalized Dickey-Fuller test for unit root in autoregressive time series with GARCH errors Appl. Math. J. Chiese Uiv. 008, 3(): 97-0 A ote o self-ormalized Dickey-Fuller test for uit root i autoregressive time series with GARCH errors YANG Xiao-rog ZHANG Li-xi Abstract. I this article, the uit

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties

More information

STAT331. Example of Martingale CLT with Cox s Model

STAT331. Example of Martingale CLT with Cox s Model STAT33 Example of Martigale CLT with Cox s Model I this uit we illustrate the Martigale Cetral Limit Theorem by applyig it to the partial likelihood score fuctio from Cox s model. For simplicity of presetatio

More information

Appendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data

Appendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data Appedix to: Hypothesis Testig for Multiple Mea ad Correlatio Curves with Fuctioal Data Ao Yua 1, Hog-Bi Fag 1, Haiou Li 1, Coli O. Wu, Mig T. Ta 1, 1 Departmet of Biostatistics, Bioiformatics ad Biomathematics,

More information

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise

First Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5 Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You

More information

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator

Slide Set 13 Linear Model with Endogenous Regressors and the GMM estimator Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday

More information

Law of the sum of Bernoulli random variables

Law of the sum of Bernoulli random variables Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Algebra of Least Squares

Algebra of Least Squares October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal

More information

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain

Since X n /n P p, we know that X n (n. Xn (n X n ) Using the asymptotic result above to obtain an approximation for fixed n, we obtain Assigmet 9 Exercise 5.5 Let X biomial, p, where p 0, 1 is ukow. Obtai cofidece itervals for p i two differet ways: a Sice X / p d N0, p1 p], the variace of the limitig distributio depeds oly o p. Use the

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Rank tests and regression rank scores tests in measurement error models

Rank tests and regression rank scores tests in measurement error models Rak tests ad regressio rak scores tests i measuremet error models J. Jurečková ad A.K.Md.E. Saleh Charles Uiversity i Prague ad Carleto Uiversity i Ottawa Abstract The rak ad regressio rak score tests

More information

STA6938-Logistic Regression Model

STA6938-Logistic Regression Model Dr. Yig Zhag STA6938-Logistic Regressio Model Topic -Simple (Uivariate) Logistic Regressio Model Outlies:. Itroductio. A Example-Does the liear regressio model always work? 3. Maximum Likelihood Curve

More information

THE KALMAN FILTER RAUL ROJAS

THE KALMAN FILTER RAUL ROJAS THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider

More information

Riesz-Fischer Sequences and Lower Frame Bounds

Riesz-Fischer Sequences and Lower Frame Bounds Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Elements of Statistical Methods Lots of Data or Large Samples (Ch 8)

Elements of Statistical Methods Lots of Data or Large Samples (Ch 8) Elemets of Statistical Methods Lots of Data or Large Samples (Ch 8) Fritz Scholz Sprig Quarter 2010 February 26, 2010 x ad X We itroduced the sample mea x as the average of the observed sample values x

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

11 THE GMM ESTIMATION

11 THE GMM ESTIMATION Cotets THE GMM ESTIMATION 2. Cosistecy ad Asymptotic Normality..................... 3.2 Regularity Coditios ad Idetificatio..................... 4.3 The GMM Iterpretatio of the OLS Estimatio.................

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Lecture 20: Multivariate convergence and the Central Limit Theorem

Lecture 20: Multivariate convergence and the Central Limit Theorem Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece

More information

Geometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT

Geometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT OCTOBER 7, 2016 LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT Geometry of LS We ca thik of y ad the colums of X as members of the -dimesioal Euclidea space R Oe ca

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

MATHEMATICAL SCIENCES PAPER-II

MATHEMATICAL SCIENCES PAPER-II MATHEMATICAL SCIENCES PAPER-II. Let {x } ad {y } be two sequeces of real umbers. Prove or disprove each of the statemets :. If {x y } coverges, ad if {y } is coverget, the {x } is coverget.. {x + y } coverges

More information

Random Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices

Random Matrices with Blocks of Intermediate Scale Strongly Correlated Band Matrices Radom Matrices with Blocks of Itermediate Scale Strogly Correlated Bad Matrices Jiayi Tog Advisor: Dr. Todd Kemp May 30, 07 Departmet of Mathematics Uiversity of Califoria, Sa Diego Cotets Itroductio Notatio

More information

Lecture 6 Simple alternatives and the Neyman-Pearson lemma

Lecture 6 Simple alternatives and the Neyman-Pearson lemma STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

An Introduction to Asymptotic Theory

An Introduction to Asymptotic Theory A Itroductio to Asymptotic Theory Pig Yu School of Ecoomics ad Fiace The Uiversity of Hog Kog Pig Yu (HKU) Asymptotic Theory 1 / 20 Five Weapos i Asymptotic Theory Five Weapos i Asymptotic Theory Pig Yu

More information

Lecture 7: October 18, 2017

Lecture 7: October 18, 2017 Iformatio ad Codig Theory Autum 207 Lecturer: Madhur Tulsiai Lecture 7: October 8, 207 Biary hypothesis testig I this lecture, we apply the tools developed i the past few lectures to uderstad the problem

More information

A Weak Law of Large Numbers Under Weak Mixing

A Weak Law of Large Numbers Under Weak Mixing A Weak Law of Large Numbers Uder Weak Mixig Bruce E. Hase Uiversity of Wiscosi Jauary 209 Abstract This paper presets a ew weak law of large umbers (WLLN) for heterogeous depedet processes ad arrays. The

More information

MA Advanced Econometrics: Properties of Least Squares Estimators

MA Advanced Econometrics: Properties of Least Squares Estimators MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample

More information

Lecture 3. Properties of Summary Statistics: Sampling Distribution

Lecture 3. Properties of Summary Statistics: Sampling Distribution Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary

More information

Diagonal approximations by martingales

Diagonal approximations by martingales Alea 7, 257 276 200 Diagoal approximatios by martigales Jaa Klicarová ad Dalibor Volý Faculty of Ecoomics, Uiversity of South Bohemia, Studetsa 3, 370 05, Cese Budejovice, Czech Republic E-mail address:

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

Math Solutions to homework 6

Math Solutions to homework 6 Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there

More information

Asymptotic Results for the Linear Regression Model

Asymptotic Results for the Linear Regression Model Asymptotic Results for the Liear Regressio Model C. Fli November 29, 2000 1. Asymptotic Results uder Classical Assumptios The followig results apply to the liear regressio model y = Xβ + ε, where X is

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

Lecture 33: Bootstrap

Lecture 33: Bootstrap Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

Optimization Methods MIT 2.098/6.255/ Final exam

Optimization Methods MIT 2.098/6.255/ Final exam Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short

More information

1 Review of Probability & Statistics

1 Review of Probability & Statistics 1 Review of Probability & Statistics a. I a group of 000 people, it has bee reported that there are: 61 smokers 670 over 5 960 people who imbibe (drik alcohol) 86 smokers who imbibe 90 imbibers over 5

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { }

Joint Probability Distributions and Random Samples. Jointly Distributed Random Variables. Chapter { } UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

GG313 GEOLOGICAL DATA ANALYSIS

GG313 GEOLOGICAL DATA ANALYSIS GG313 GEOLOGICAL DATA ANALYSIS 1 Testig Hypothesis GG313 GEOLOGICAL DATA ANALYSIS LECTURE NOTES PAUL WESSEL SECTION TESTING OF HYPOTHESES Much of statistics is cocered with testig hypothesis agaist data

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Study the bias (due to the nite dimensional approximation) and variance of the estimators

Study the bias (due to the nite dimensional approximation) and variance of the estimators 2 Series Methods 2. Geeral Approach A model has parameters (; ) where is ite-dimesioal ad is oparametric. (Sometimes, there is o :) We will focus o regressio. The fuctio is approximated by a series a ite

More information