Statistics and high frequency data

Size: px
Start display at page:

Download "Statistics and high frequency data"

Transcription

1 Statistics ad high frequecy data Jea Jacod Itroductio This short course is devoted to a few statistical problems related to the observatio of a give process o a fixed time iterval, whe the observatios occur at regularly spaced discrete times. This kid of observatios may occur i may differet cotexts, but they are particularly relevat i fiace: we do have ow huge amouts of data o the prices of various assets, exchage rates, ad so o, typically tick data which are recorded at every trasactio time. So we are maily cocered with the problems which arise i this cotext, ad the cocrete applicatios we will give are all pertaiig to fiace. I some sese they are ot stadard statistical problems, for which we wat to estimate some ukow parameter. We are rather cocered with the estimatio of some radom quatities. This meas that we would like to have procedures that are as model-free as possible, ad also that they are i some sese more aki to oparametric statistics. Let us describe the geeral settig i some more details. We have a uderlyig process X = X t t, which may be multi-dimesioal its compoets are the deoted by X, X 2,. This process is defied o some probability space Ω, F,. We observe this process at discrete times, equally spaced, over some fixed fiite iterval [, T ], ad we are cocered with asymptotic properties as the time lag, deoted by, goes to. I practice, this meas that we are i the cotext of high frequecy data. The objects of iterest are various quatities related to the particular outcome ω which is partially observed. The mai object is the volatility, but other quatities or features are also of much iterest for modelig purposes, for example whether the observed path has jumps ad, whe this is the case, whether several compoets may jump at the same times or ot. All these quatities are related i some way to the probabilistic model which is assumed for X: we do ideed eed some model assumptio, otherwise othig ca be said. I fact, ay give set of observed values X, X,, X i,, with fixed, is of course compatible with may differet models for the cotiuous time process X: for example we ca suppose that X is piecewise costat betwee the observatio times, or that it Istitut de mathématiques de Jussieu, Uiversité ierre et Marie Curie aris-6 ad CNRS, UMR 7586, 4 place Jussieu, aris, Frace

2 is piecewise liear betwee these times. Of course either oe of these two models is i geeral compatible with the observatios if we modify the frequecy of the observatios. So i the sequel we will always assume that X is a Itô semimartigale, that is a semimartigale whose characteristics are absolutely cotiuous with respect to Lebesgue measure. This is compatible with virtually all semimartigale models used for modelig quatities like asset prices or log-prices, although it rules out some o-semimartigale models sometimes used i this cotext, like the fractioal Browia motio. Before statig more precisely the questios which we will cosider, ad i order to be able to formulate them i precise terms, we recall the structure of Itô semimartigales. We refer to [3], Chapter I, for more details. Semimartigales: We start with a basic filtered probability space Ω, F, F t t,, the family of sub-σ-fields F t of F beig icreasig ad right-cotiuous i t. A semimartigale is simply the sum of a local martigale o this space, plus a adapted process of fiite variatio meaig, its paths are right-cotiuous, with fiite variatio o ay fiite iterval. I the multidimesioal case it meas that each compoet is a real-valued semimartigale. Ay multidimesioal semimartigale ca be writte as t X t = X + B t + Xt c + κxµ νds, dx + R d I this formula we use the followig otatio: t R d κ xµds, dx.. - µ is the jump measure of X: if we deote by X t = X t X t the size of the jump of X at time t recall that X is right-cotiuous with left limits, the the set {t : X t ω } is at most coutable for each ω, ad µ is the radom measure o, R d defied by µω; dt, dx = ε s, Xs ωdt, dx, ε a = the Dirac measure sittig at a. s>: X s ω - ν is the compesator or, predictable compesator of µ. This is the uique radom measure o, R d such that, for ay Borel subset A of R d at a positive distace of, the process ν, t] A is predictable ad the differece µ, t] A ν, t] A is a local martigale. - κ is a trucatio fuctio, that is a fuctio: R d R d, bouded with compact support, such that κx = x for all x i a eighborhood of. This fuctio is fixed throughout, ad we choose it to be cotiuous for coveiece. - κ is the fuctio κ x = x κx. - B is a predictable process of fiite variatio, with B =. - X c is a cotiuous local martigale with X c =, called the cotiuous martigale part of X. With this otatio, the decompositio. is uique up to ull sets, but the process B depeds o the choice of the trucatio fuctio κ. The cotiuous martigale part 2

3 does ot deped o the choice of κ. Note that the first itegral i. is a stochastic itegral i geeral, whereas the secod oe is a pathwise itegral i fact for ay t is is simply the fiite sum s t κ X s. Of course. should be read compoetwise i the multidimesioal settig. I the sequel we use the shorthad otatio to deote the possibly stochastic itegral w.r.t. a radom measure, ad also for the possibly stochastic itegral of a process w.r.t. a semimartigale. For example,. may be writte more shortly as X = X + B + X c + κ µ ν + κ µ..2 The * symbol will also be used, as a superscript, to deote the traspose of a vector or matrix o cofusio may arise. Aother process is of great iterest, amely the quadratic variatio of the cotiuous martigale part X c, which is the followig R d R d -valued process: C = X c, X c, that is, compoetwise, C ij = X i,c, X j,c..3 This is a cotiuous adapted process with C =, which further is icreasig i the set M + d of symmetric oegative matrices, that is C t C s belogs to M + d for all t > s. The triple B, C, ν is called the triple of characteristics of X, this ame comig from the fact that i good cases it completely determies the law of X. The fudametal example of semimartigales is the case of Lévy processes. We say that X is a Lévy process if it is adapted to the filtratio, with right-cotiuous ad leftlimited paths ad X =, ad such that X t+s X t is idepedet of F t ad has the same law as X s for all s, t. Such a process is always a semimartigale, ad its characteristics B, C, ν are of the form B t ω = bt, C t = ct, νω; dt, dx = dt F dx..4 Here b R d ad c M + d ad F is a measure o Rd which does ot charge ad itegrates the fuctio x x 2. The triple b, c, F is coected with the law of the variables X t by the formula for all u R d Ee i u,xt = exp t i u, b 2 u, cu + F dx e i u,x i u, κx,.5 called Lévy-Khitchie s formula. So we sometimes call b, c, F the characteristics of X as well, ad it is the Lévy-Khitchie characteristics of the law of X i the cotext of ifiitely divisible distributios. b is called the drift, c is the covariace matrix of the Gaussia part, ad F is called the Lévy measure. As see above, for a Lévy process the characteristics B, C, ν are determiistic, ad they do characterize the law of the process. Coversely, if the characteristics of a semimartigale X are determiistic oe ca show that X has idepedet icremets, ad if they are of the form.4 the X is a Lévy process. Itô semimartigales. By defiitio, a Itô semimartigale is a semimartigale whose characteristics B, C, ν are absolutely cotiuous with respect to Lebesgue measure, i 3

4 the followig sese: B t ω = t b s ωds, C t ω = t c s ωds, νω; dt, dx = dt F ω,t dx..6 here we ca always choose a versio of the processes b or c which is optioal, or eve predictable, ad likewise choose F i such a way that F t A is optioal, or eve predictable, for all Borel subsets A of R d. It turs out that Itô semimartigales have a ice represetatio i terms of a Wieer process ad a oisso radom measure, ad this represetatio will be very useful for us. Namely, it ca be writte as follows where for example κ δ µ t deotes the value at time t of the itegral process κ δ µ: X t = X + t b s ds + t σ s dw s + κδ µ ν t + κ δ µ t..7 I this formula W is a stadard d -dimesioal Wieer process ad µ is a oisso radom measure o, E with itesity measure νdt, dx = dt λdx, where λ is a σ-fiite ad ifiite measure without atom o a auxiliary measurable set E, E. Of course the process b t is the same i.6 ad i.7, ad σ = σ ij i d, j d is a R d R d -valued optioal or predictable, as oe wishes to process such that c = σσ, ad δ = δω, t, x is a predictable fuctio o Ω [, E that is, measurable with respect to E, where is the predictable σ-field of Ω [,. The coectio betwee δ above ad F i.6 is that F t,ω is the image of the measure λ by the map x δω, t, x, ad restricted to R d \{}. Remark. Oe should be a bit more precise i characterizig W ad µ: W is a F t -Wieer process, meaig it is F t adapted ad W t+s W t is idepedet of F t o top of beig Wieer, of course. Likewise, µ is a F t -oisso measure, meaig that µ, t] A is F t -measurable ad µt, t + s] A is idepedet of F t, for all A E. Remark.2 The origial space Ω, F, o which X is defied may be too small to accommodate a Wieer process ad a oisso measure, so we may have to elarge the space. Such a elargemet is always possible. Remark.3 Whe the matrix c t ω is of full rak for all ω, t ad d = d, the it has a uique square-root σ t ω, which further is ivertible. I this case we have W = σ X c. Otherwise, there are may ways of choosig σ such that σσ = c, hece may ways of choosig W ad its dimesio d which ca always be take such that d d. I a similar way, we have a lot of freedom for the choice of µ. I particular we ca choose at will the space E, E ad the measure λ, subject to the above coditios, ad for example we ca always take E = R with λ the Lebesgue measure, although i the d-dimesioal case it is somewhat more ituitive to take E = R d. Of course a Lévy process is a Itô semimartigale compare.2 ad.6. I this case the two represetatios.2 ad.7 coicide if we take E = R d ad λ = F the 4

5 Lévy measure ad µ = µ the jump measure of a Lévy process is a oisso measure ad δω, t, x = x, ad also if we recall that i this case the cotiuous martigale or Gaussia part of X is always of the form X c = σw, with σσ = c. The settig of Itô semimartigales ecompasses most processes used for modelig purposes, at least i mathematical fiace. For example, solutios of stochastic differetial equatios drive by a Wieer process, or a by a Lévy process, or by a Wieer process plus a oisso radom measure, are all Itô semimartigales. Such solutios are obtaied directly i the form.7, which of course implies that X is a Itô semimartigale. The volatility. I a fiacial cotext, the process c t is called the volatility sometimes it is σ t which is thus called. This is by far the most importat quatity which eeds to be estimated, ad there are may ways to do so. A very widely spread way of doig so cosists i usig the so-called implied volatility, ad it is performed by usig the observed curret prices of optios draw o the stock uder cosideratio, by somehow ivertig the Black-Scholes equatio or extesios of it. However, this way usually assumes a give type of models, for example that the stock prices is a diffusio process of a certai type, with ukow coefficiets. Amog the coefficiets there is the volatility, which further may be stochastic, meaig that it depeds o some radom iputs other tha the Wieer process which drives the price itself. But the it is of primary importace to have a soud model, ad this ca be checked oly by statistical meas. That is, we have to make a statistical aalysis, based o series of ecessarily discrete observatios of the prices. I other words, there is a large body of work, essetially i the ecoometrical literature, about the statistical estimatio of the volatility. This meas fidig good methods for estimatig the path t c t ω for t [, T ], o the basis of the observatio of X i ω for all i =,,, [T/ ]. I a sese this is very similar to the o-parametric estimatio of a fuctio ct, say i the -dimesioal case, whe oe observes the Gaussia process Y t = t cs dws here W is a stadard -dimesioal Wieer process at the time i, ad whe is small that is, we cosider the asymptotic. As is well kow, this is possible oly uder some regularity assumptios o the fuctio ct, whereas the itegrated value t csds ca be estimated as i parametric statistics, sice it is just a umber. O the other had, if we kow t csds for all t, the we also kow the fuctio ct, up to a Lebesgue-ull set, of course: it should be emphasized that if we modify c o such a ull set, we do ot chage the process Y itself; the same commet applies to the volatility process c t i.6. This is why we maily cosider, as i most of the literature, the problem of estimatig the itegrated volatility, which with our otatio is the process C t. Oe has to be aware of the fact that i the case of a geeral Itô semimartigale, this meas estimatig the radom umber or matrix C t ω, for the observed ω, although of course ω is ideed ot fully observed. 5

6 Let us cosider for simplicity the -dimesioal case, whe further X is cotiuous, that is X t = X + t b s ds + t σ s dw s,.8 ad σ t equivaletly, c t = σ 2 t is radom. It may be of the form σ t ω = σx t ω, it ca also be by itself the solutio of aother stochastic differetial equatio, drive by W ad perhaps aother Wieer process W, ad perhaps also some oisso measures if it has jumps eve though X itself does ot jump. By far, the simplest thig to do is to cosider the realized itegrated volatility, or approximate quadratic variatio, that is the process B2, t = [t/ ] i X 2, where i X = X i X i..9 The if.8 holds, well kow results o the quadratic variatio goig back to Itô i this case, we kow that B2, t C t. covergece i probability, ad this covergece is eve uiform i t over fiite itervals. Further, as we will see later, we have a rate of covergece amely / uder some appropriate assumptios. Now what happes whe X is discotiuous? We o loger have., but rather B2, t C t + X s 2. s t the right side above is always fiite, ad is the quadratic variatio of the semimartigale X, also deoted [X, X] t. Nevertheless we do wat to estimate C t : a good part of these otes is devoted to this problem. For example, we will show that both quatities B,, t = [t/ ] i X i+x, B2, ϖ, α t = [t/ ] i X 2 { i X α ϖ }.2 coverge i probability to 2 π C t ad C t respectively, ad as soo as ϖ, /2 ad α > for the secod oe. Iferece for jumps. Now, whe X is discotiuous, there is also a lot of iterest about jumps ad, to begi with, are the observatios compatible with a model without jumps, or should we use a model with jumps? More complex questios may be posed: for a 2-dimesioal process, do the jumps occur at the same times for the two compoets or ot? Is there ifiitely may small jumps? I this case, what is the cocetratio of the jumps ear? Here agai, the aalysis is based o the asymptotic behavior of quatities ivolvig sums of fuctios of the icremets i X of the observed process. So, before goig to the mai results i a geeral situatio, we cosider first two very simple cases: whe X = σw 6

7 for a costat σ >, ad whe X = σw +Y whe Y is a compoud oisso process. It is also of primary importace to determie which quatities ca be cosistetly estimated whe, ad which oes caot be. We begi with the latter questio. 2 What ca be estimated? Recall that our uderlyig process X is observed at discrete times,, 2,, up to some fixed time T. Obviously, we caot have cosistet estimators, as, for quatities which caot be retrieved whe we observe the whole path t X t ω for t [, T ], a situatio referred to below as the complete observatio scheme. We begi with two simple observatios: The drift b t ca ever be idetified i the complete observatio scheme, except i some very special cases, like whe X t = X + t b sds. 2 The quadratic variatio of the process is fully kow i the complete observatio scheme, up to time T of course. This implies i particular that the itegrated volatility C t is kow for all t T, hece also the process c t this is of course up to a -ull set for C t, ad a dω dt-ull set for c t ω. 3 The jumps are fully kow i the complete observatio scheme, up to time T agai. Now, the jumps are ot so iterestig by themselves. More importat is the law of the jumps i some sese. For Lévy processes the law of jumps is i fact determied by the Lévy measure. I a similar way, for a semimartigale the law of jumps ca be cosidered as kow if we kow the measures F t,ω, sice these measures specify the jump coefficiet δ i.7. Warig: this specificatio is i a weak sese, exactly as c specifies σ; we may have several square-root of c, as well as several δ such that F t is the image of λ, but all choices of σ t ad δ which are compatible with a give c t ad F t give rise to equatios that have exactly the same weak solutios. Cosider Lévy processes first. Basically, the restrictio of F to the complemet of ay eighborhood of, after ormalizatio, is the law of the jumps of X lyig outside this eighborhood. Hece to cosistetly estimate F we eed potetially ifiitely may jumps far from, ad this possible oly if T. I our situatio with T fixed there is o way of cosistetly estimatig F. We ca still say somethig i the Lévy case: for the complete observatio scheme, if there is a jump the F is ot the zero measure; if we have ifiitely may jumps i [, T ] the F is a ifiite measure; i this case, we ca also determie for which r > the sum s T X s r is fiite, ad this is also the set of r s such that { x < } x r F dx <. The same statemets also hold for more geeral semimartigales: we ca decide for which r s the sum s T X s r is fiite, ad also if we have zero, or fiitely may, or ifiitely may jumps. Those are characteristics of the model which are of much iterest for modellig purposes. 7

8 Hece we will be iterested, whe comig back to the actual discrete observatio scheme, i estimatig C t for t T, ad whether there are zero or fiitely may or ifiitely may jumps i [, T ]. 3 Some simple limit theorems for Wieer plus compoud oisso processes This sectio is about a very particular case: the uderlyig process is X = σx + Y for some σ >, ad Y a compoud oisso process idepedet of W. Ad i the first subsectio we eve cosider the most elemetary case of X = σw. I these two cases we state all limit theorems that are available about sums of a fuctio of the icremets. We do ot give the full proofs, but heuristic reasos for the results to be true. The reaso for devotig a special sectio to this simple case is to show the variety of results that ca be obtaied, whereas the full proofs ca be easily recostructed without aoyig techical details. Before gettig started, we itroduce some otatio, to be used also for a geeral d- dimesioal semimartigale X later o. Recall the icremets i X i.9. First for ay p > ad j d we set Bp, j, t = [t/ ] i X j p. 3. I the -dimesioal case this is writte simply Bp, t. Next if f is a fuctio o R d, the state space of X i geeral, we set V f, t = [t/ ] f i X, V f, t = [t/ ] f i X/. 3.2 The reaso for itroducig the ormalizatio / will be clear below. These fuctioals are related oe of the other by the trivial idetity V f, = V f, with f x = fx/. Moreover, with the otatio y R h p y = y p, x = x j R d h j px = x j p, 3.3 we also have Bp, j, = V h j p, = p/2 V h j p,. Fially if we eed to emphasize the depedecy o the process X, we write these fuctioals as BX; p, j, or V X; f, or V X; f,. 3. The Wieer case. Here we suppose that X = σw for some costat σ >, so d =. Amog all the previous fuctioals, the simplest oes to study are the fuctioals V f, with f a fixed fuctio o R. We eed f to be Borel, of course, ad ot too big, for example with polyomial growth, or eve with expoetial growth. I this case, the results are 8

9 straightforward cosequeces of the usual law of large umbers LNN ad cetral limit theorem CLT. Ideed, for ay the variables i X/ : i are i.i.d. with law N, σ 2. I the formulas below we write ρ σ for the law N, σ 2 ad also ρ σ g the itegral of a fuctio g with respect to it. Therefore, with f as above, the variables f i X/ whe i varies are i.i.d. with momets of all orders, ad their first ad secod momets equal ρ σ f ad ρ σ f 2 respectively. The the classical LLN ad CLT give us that V f, t tρ σ f V f, t tρ σ g L N, tρ σ f 2 ρ σ f We clearly see here why we have put the ormalizig factor / iside the fuctio f. The reader will observe that, cotrary to the usual LNN, we get covergece i probability but ot almost surely i the first part of 3.4. The reaso is as follows: let ζ i be a sequece of i.i.d. variables with the same law tha fx. The LLN implies that t [t/ ] [t/ ] ζ i coverges a.s. to tρ σ f. Sice V f, t has the same law as Z = Z we deduce the covergece i probability i 3.4 because, for a determiistic limit, covergece i probability ad covergece i law are equivalet. However the variables V f, t are coected oe with the others i a way we do ot really cotrol whe varies, so we caot coclude to V f; t tρ σ f a.s..9 gives us the covergece for ay time t, but we also have fuctioal covergece: First, recall that a sequece g of oegative icreasig fuctios o R + covergig poitwise to a cotiuous fuctio g also coverges locally uiformly; the, from the first part of.9 applied separately for the positive ad egative parts f + ad f of f ad usig a subsequece priciple for the covergece i probability, we obtai V f, t u.c.p. tρ σ f 3.5 u.c.p. where Zt Z t meas covergece i probability, locally uiformly i time : that is, sup s t Zs Z s for all t fiite. 2 Next, if istead of the -dimesioal CLT we use the fuctioal CLT, or Dosker s Theorem, we obtai V f, t tρ σ f t L = ρ σ f 2 ρ s f 2 W 3.6 where W is aother stadard Wieer process, ad = L stads for the covergece i law of processes for the Skorokhod topology. Here we see a ew Wieer process W appear. What is its coectio with the basic uderlyig Wieer process W? To study that, oe ca try to prove the joit covergece of the processes o the left side of 3.6 together with W or equivaletly X itself. This is a easy task: cosider the 2-dimesioal process Z whose first compoet is the left side of 3.6 ad secod compoet is X [t/ ] the discretized versio of 9

10 X, which coverges poitwise to X. The Z takes the form Zt = [t/ ] ζi, where the ζi are 2-dimesioal i.i.d. variables as i varies, with the same distributio as g X, g 2 X, where g x = fx ρ σ f ad g 2 x = x. The the 2-dimesioal versio of Dosker s Theorem gives us that V L f; t tρ σ f, X t = B, X 3.7 t ad the pair B, X is a 2-dimesioal correlated Wieer process, characterized by its variace-covariace at time, which is the followig matrix: ρσ f 2 ρ s f 2 ρ σ fg 2 ρ σ fg 2 σ ote that σ 2 = ρ σ g 2 2 ad also ρ σg 2 =, so the above matrix is semi-defiite positive. Equivaletly, we ca write B as B = ρ σ f 2 ρ s f 2 W with W a stadard Browia motio as i 3.7 which is correlated with W, the correlatio coefficiet beig ρ σ fg 2 /σ ρ σ f 2 ρ s f 2. Now we tur to the processes Bp,. Sice Bp, = p/2 V h p, this is just a particular case of 3.5 ad 3.7, which we reformulate below m p deotes the pth absolute momet of the ormal law N, : p/2 Bp, p/2 Bp, t tσ p m p, X t t u.c.p. tσ p m p, 3.9 } L = B, X, 3. with B a Wieer process uit variace σ 2p m 2p m 2 p, idepedet of X the idepedece comes from that fact that ρ σ g =, where gx = x x p. Fially for the fuctioals V f,, the importat thig is the behavior of f ear, sice the icremets i X are all goig to as. I fact, sup i [t/ ] i X poitwise, so whe the fuctio f vaishes o a eighborhood of, for all bigger tha some radom fiite umber N depedig also o t we have V f, s = s t. 3. For a geeral fuctio f we ca combie 3.9 with 3.: we easily obtai that 3.9 holds with V f, istead of Bp, as soo as fx x p as x, ad the same holds for 3. if we further have fx = x p o a eighborhood of. Of course these results do ot exhaust all possibilities for the covergece of V f;. For example o may prove the followig: fx = x p log x p/2 log/ V f, u.c.p. 2 tσp m p, 3.2 ad a CLT is also available i this situatio. Or, we could cosider fuctios f which behave like x p as x ad like x p as x, with p p. However, we essetially restrict our attetio to fuctios behavig like h p : for simplicity first, ad sice more geeral fuctios do ot really occur i the applicatios we have i mid, ad also because the extesio to processes X more geeral tha the Browia motio is ot easy for other fuctios.

11 3.2 The Wieer plus compoud oisso case. Our secod example is whe the uderlyig process X has the form X = σw + Y, where as before σ > ad W is a Browia motio, ad Y is a compoud oisso process idepedet of W. We will write X = σw. Recall that Y has the form Y t = p Φ p {Tp t}, 3.3 where the T p s are the successive arrival times of a oisso process, say with parameter they are fiite stoppig times, positive, strictly icreasig with p ad goig to, ad the Φ p s are i.i.d. variables, idepedet of the T p s, ad with some law G. Note that i 3.3 the sum, for ay give t, is actually a fiite sum. The processes V f,, which were particularly easy to study whe X was a Wieer process, are ot so simple to aalyze ow. This is easy to uderstad: let us fix t; at stage, we have i X = i X for all i [t/ ], except for those fiitely may i s correspodig to a iterval i, i ] cotaiig at least oe of the T p s. Furthermore, all those exceptioal itervals cotai exactly oe T p, as soo as is large eough depedig o ω, t. Therefore for large we have V f, t = V X ; f, t + A t, where A t = [t/ ] p {i <T p i } fφ p + i X f i X /. 3.4 The double sum i A t is ideed a fiite sum, with as may o-zero etries as the umber of T p s less tha [t/ ]. Therefore the behavior of V f, depeds i a essetial way o the behavior of f ear ifiity. There are essetially two possibilities: The fuctio f is bouded, or more geerally satisfies fx K + x p for some p < 2. The A t above is essetially smaller tha K q:t + Φ q t p r p/2 for some costat K, ad thus A t. So obviously the covergece 3.5 holds. If further p < we eve have A t. Therefore 3.7 holds. Observe that i this situatio, the presece of the jumps does ot modify the results that held for the Browia case; this will be the rule for more geeral processes X as well. 2 The fuctio f is equivalet to x p at ifiity, for some p > 2. The i 3.4 the leadig term becomes A t, which is approximately equal to p/2 s t X s p. So V f, t coverges i probability to the variable p/2 Bp t = s t X s p 3.5 we have just proved the covergece for ay give t, but it is also a fuctioal covergece, for the Skorokhod topology, i probability. Agai, these cases do ot exhaust the possible behaviors of f, ad further we have ot give a CLT i the secod situatio above. But, whe f is ot bouded it looks a

12 bit strage to impose a specific behavior at ifiity, ad without this there is simply o covergece result for V f, t, ot to speak about CLTs. Now we tur to the processes V f,. To begi with, we observe that, similar to 3.4, we have V f, t = V X, f, t + A t, where A t = [t/ ] p 3.6 {i <T p i } fφ p + i X f i X. The first - fudametal - differece with the cotiuous case is that 3. fails ow whe f vaishes o a eighborhood of. I this case, though, for each give t ad all bigger tha some umber depedig o ω, t, we have V X ; f, s = for all s t by 3., hece V f, s = [s/ ] {i <T p i }fφ p + i X, s t. 3.7 p The, as soo as f is cotiuous ad vaishes o a eighborhood of, we get V f, t Sk V f t := f X s. 3.8 s t Here Sk meas covergece for the Skorokhod topology, poitwise i ω the reaso for which we have covergece i the Skorokhod sese will be explaied later; what is clear at this poit is that we have the - poitwise i ω - covergece for all t such that X is cotiuous at t; we also have for each t a almost sure covergece above. Next, we cosider the case where f is still cotiuous ad, say, coicides with h p for some p > o a eighborhood of. For ay give ε > we ca write f = f ε + f ε with f ε ad f ε cotiuous, ad f ε x = h p x if x ε/2 ad f ε x = if x ε ad f ε h p everywhere. Sice f ε vaishes aroud, we have V f ε, t V f ε t by 3.8, ad V f ε t coverges to V f t as ε. O the other had the process A associated with f ε by 3.6 is the sum of summads smaller tha 2ε p, the umber of them beig bouded for each ω, t by a umber idepedet of ε: hece A t is egligible ad V f ε, ad V X ; f ε, behave essetially i the same way. This meas heuristically that, with the symbol meaig approximately equal to, we have V f ε, t V f t, V f ε, t p/2 t σ p m p. 3.9 Addig these two expressios, we get V f, t V f, t Sk V f t if p > 2 Sk V f t + tσ 2 if p = 2 r/2 V f, t u.c.p. tσ p/2 m p if p < This type of LLN, which shows a variety of behaviors accordig to how f behaves ear, will be foud for much more geeral processes later, i almost exactly the same terms. 2

13 Now we tur to the CLT. Here agai we sigle out first the case where f vaishes i a eighborhood of. We eed to fid out what happes to the differece V f, V f. It is easier to evaluate is the differece V f, t V f [t/ ], sice by 3.7 we have V f, s V f [s/ ] = [s/ ] p {i <T p i } fφ p + i X fφ p 3.2 for all s t, as soo as is large eough. rovided f is C, with derivative f, the pth summad above is approximately f Φ p i X. Now the ormalized icremet i X /, for the value of i such that i < T p i, has the law N, σ 2 because X ad Y are idepedet, ad it is asymptotically idepedet of the process X more details are to be foud later. Thus if U p p deotes a sequece of i.i.d. N, variables, idepedet of X, it is ot difficult to see that V f, t V f [t/ ] L = Bf t := p:t p t f Φ p σu p, 3.22 ad i fact, this covergece i law for the Skorokhod topology is eve stable deoted L s =, a stroger property tha the mere covergece i law, which will be defied later oly but evertheless is used i the statemets below. Whe ow f coicide with h p for some p > o a eighborhood of ad is still C outside, exactly as for 3.9 we obtai heuristically that V f ε, t V f [t/ ] + U t, V f ε, t p/2 tσ p m p + p/2 /2 U t, where U ad U coverge stably i law to the right side of 3.22 ad to the process B of 3., respectively. We the have two coflictig rates, ad we ca ideed prove that, with Bf as i 3.22 ad B as i 3. thus depedig o r: V f, t V f [t/ ] L s = Bf t if p > 3 V f, t V f [t/ ] p/2 p/2 V f, t V f [t/ ] L s = tσ 3 m 3 + Bf t if p = 3 u.c.p. tσ p m p if 2 < p < 3 V f, t V f [t/ ] tσ 2 L s = B t + Bf t if p = 2 V f; t tσ p Sk m p V f t if < p < 2 p/2 V f, t tσm L s = V f t + B t if p = p/2 V f, t tσ p L s m p = B t if p < Hece we obtai a geuie CLT, relative to the LLN 3.2, i the cases p > 3, p = 2 ad p <. Whe p = 3 ad p = we still have a CLT, with a bias. Whe 2 < p < 3 or < p < 2 we have a secod order LNN, ad the associated geuie CLTs ru as follows: p/2 /2 V f, t V f [t/ ] p/2 tσ p L s m p = Bf t if 2 < p < 3 V f, t V f [t/ ] p/2 tσ p L s m p = B t if < p <

14 We see that these results exhibit agai a large variety of behavior. This will be ecoutered also for more geeral uderlyig processes X, with of course more complicated statemets ad proofs i the preset situatio we have ot really give the complete proof, of course, but it is relatively easy alog the lies outlied above. However, i the geeral situatio we will ot give such a complete picture, which is useless for practical applicatios. Oly 3.2 ad the cases r > 2 i 3.23 will be give. 4 Auxiliary limit theorems The aims of this sectio are twofold: first we defie the stable covergece i law, already metioed i the previous sectio. Secod, we recall a umber of limit theorems for partial sums of triagular arrays of radom variables. Stable covergece i law. This otio has bee itroduced by Réyi i [22], for the very same reasos as we eed it here. We refer to [4] for a very simple expositio ad to [3] for more details. It ofte happes that a sequece of statistics Z coverges i law to a limit Z which has, say, a mixed cetered ormal distributio: that is, Z = ΣU where U is a N, variable ad Σ is a positive variable idepedet of U. This poses o problem other tha computatioal whe the law of Σ is kow. However, i may istaces the law of Σ is ukow, but we ca fid a sequece of statistics Σ such that the pair Z, Σ coverges i law to Z, Σ; so although the law of the pair Z, Σ is ukow, the variable Z /Σ coverges i law to N, ad we ca base estimatio or testig procedures o this ew statistics Z /Σ. This is where the stable covergece i law comes ito play. The formal defiitio is a bit ivolved. It applies to a sequece of radom variables Z, all defied o the same probability space Ω, F,, ad takig their values i the same state space E, E, assumed to be olish = metric complete ad separable. We say that Z stably coverges i law if there is a probability measure η o the product Ω E, F E, such that ηa E = A for all A F ad EY fz Y ωfxηdω, dx 4. for all bouded cotiuous fuctios f o E ad bouded radom variables Y o Ω, F. This is a abstract defiitio, similar to the defiitio of the covergece i law which says that EfZ fxρdx for some probability measure ρ. Now for the L covergece i law we usually wat a limit, that is we say Z Z, ad the variable Z is ay variable with law ρ, of course. I a similar way it is coveiet to realize the limit Z for the stable covergece i law. We ca always realize Z i the followig way: take Ω = Ω E ad F = F E ad edow Ω, F with the probability η, ad put Zω, x = x. But, as for the simple covergece i law, we ca also cosider other extesios of Ω, F, : that is, we have a probability space Ω, F,, where Ω = Ω Ω ad F = F F for some auxiliary measurable space Ω, F ad is a probability measure o Ω, F whose first margial 4

15 is, ad we also have a radom variable Z o this extesio. The i this settig, 4. is equivalet to sayig with Ẽ deotig the expectatio w.r.t. EY fz ẼY fz 4.2 for all f ad Y as above, as soo as A {Z B} = ηa B for all A F ad B E. We the say that Z coverges stably to Z, ad this covergece is deoted by. L s Clearly, whe η is give, the property A {Z B} = ηa B for all A F ad B E simply amouts to specifyig the law of Z, coditioally o the σ-field F. L s Therefore, sayig Z Z amouts to sayig that we have the stable covergece i law towards a variable Z, defied o ay extesio Ω, F, of Ω, F,, ad with a specified coditioal law kowig F. Obviously, the stable covergece i law implies the covergece i law. But it implies L s much more, ad i particular the followig crucial result: if Z Z ad if Y ad Y are variables defied o Ω, F, ad with values i the same olish space F, the Y Y, Z L s Y, Z. 4.3 Y O the other had, there are criteria for stable covergece i law of a give sequece Z. The σ-field geerated by all Z is ecessarily separable, that is geerated by a coutable algebra, say G. The if for ay fiite family A p : p q i G, the sequece Z, Ap p q of E R q -valued variables coverges i law as, the ecessarily Z coverges stably i law. 2 Covergece of triagular arrays. Our aim is to prove the covergece of fuctioals like i 3. ad 3.2, which appear i a atural way as partial sums of triagular arrays. We really eed the covergece for the termial time T, but i most cases the available covergece criteria also give the covergece as processes, for the Skorokhod topology. So ow we provide a set of coditios implyig the covergece of partial sums of triagular arrays, all results beig i [3]. We are ot lookig for the most geeral situatio here, ad we restrict our attetio to the case where the filtered probability space Ω, F, F t t, is fixed. For each we have a sequece of R d -valued variables ζi : i, the compoets beig deoted by ζ,j i for j =,, d. The key assumptio is that for all, i the variable ζi is F i -measurable, ad this assumptio is i force i the remaider of this sectio. Coditioal expectatios w.r.t. F i will play a crucial role, ad to simplify otatio we write it E i istead of E. F i, ad likewise i is the coditioal probability. Lemma 4. If we have [t/ ] E i ζ i t >, 4.4 5

16 the [t/ ] ζ i u.c.p.. The same coclusio holds uder the followig two coditios: I particular whe ζi to imply [t/ ] ζi [t/ ] [t/ ] E i ζ i E i ζ i 2 u.c.p., 4.5 t >. 4.6 is a martigale differece, that is E i ζ i =, the 4.6 is eough u.c.p.. Lemma 4.2 If we have [t/ ] E i ζ i u.c.p. A t 4.7 for some cotiuous adapted R d -valued process of fiite variatio A, ad if further 4.6 holds, the we have [t/ ] ζi u.c.p. A t. Lemma 4.3 If we have 4.7 for some determiistic cotiuous R d -valued fuctio of fiite variatio A, ad also the followig two coditios: [t/ ] E i ζ,j i ζ,k i E i ζ,j i E i ζ,k i C jk t t >, j, k =,, d, 4.8 [t/ ] E i ζ i 4 t >, 4.9 where C = C jk is a determiistic fuctio, cotiuous ad icreasig i M + d, the the processes [t/ ] ζi coverge i law to A + B, where B is a cotiuous cetered Gaussia R d -valued process with idepedet icremets with EB j t Bk t = C jk 4.9 is a coditioal Lideberg coditio, whose aims is to esure that the limitig process is cotiuous; other, weaker, coditios of the same type are available, but ot eeded here. The coditios give above completely characterize, of course, the law of the process B. Equivaletly we could say that B is a Gaussia martigale relative to the filtratio it geerates, startig from, ad with quadratic variatio process C. t. 3 Stable covergece of triagular arrays. The reader will have observed that the coditios 4.7 ad 4.8 i Lemma 4.3 are very restrictive, because the limits are oradom. I the sequel, such a situatio rarely occurs, ad typically these coditios are satisfied with A ad C radom. But the we eed a additioal coditio, uder which it turs out that the covergece holds ot oly i law, but eve stably i law. Note that the stable covergece i law has bee defied for variables takig values i a olish space, so it also applies to right-cotiuous ad left limited d-dimesioal 6

17 processes: such a process ca be viewed as a variable takig its values i the Skorokhod space DR d of all fuctios from R + ito R d which are right-cotiuous with left limits, provided we edow this space with the Skorokhod topology which makes it a olish space. See [] or Chapter VI of [3] for details o this topology. I fact, i Lemma 4.3 the covergece i law is also relative to this Skorokhod topology. The stable covergece i law for processes is deoted as = L s below. I the previous results the fact that all variables were defied o the same space Ω, F, F t t, ad the ζ i s were F i -measurable was essetially irrelevat. This is o loger the case for the ext result, for which this settig is fudametal. Below we sigle out, amog all martigales o Ω, F, F t t,, a possibly multidimesioal Wieer process W. The followig lemma holds for ay choice of W, ad eve with o W at all i which case a martigale orthogoal to W below meas ay martigale but we will use it maily with the process W showig i.7. The followig is a particular case of Theorem IX.7.28 of [3]. Lemma 4.4 Assume 4.7 for some cotiuous adapted R d -valued process of fiite variatio A, ad 4.8 with some cotiuous adapted process C = C jk with values i M + d ad icreasig i this set, ad also 4.9. Assume also [t/ ] E i ζ i i N t > 4. wheever N is oe of the compoets of W or is a bouded martigale orthogoal to W. The the processes [t/ ] ζi coverge stably i law to A + B, where B is a cotiuous process defied o a extesio Ω, F, of the space Ω, F, ad which, coditioally o the σ-field F, is a cetered Gaussia R d -valued process with idepedet icremets satisfyig ẼBj t Bk t F = C jk t. The coditios stated above completely specify the coditioal law of B, kowig F, so we are exactly i the settig explaied i above ad the stable covergece i law is well defied. However oe ca say eve more: lettig F t be the smallest filtratio o Ω which make B adapted ad which cotais F t that is, A Ω F t wheever A F t, the B is a cotiuous local martigale o Ω, F, F t t, which is orthogoal i the martigale sese to ay martigale o the space Ω, F, F t t,, ad whose quadratic variatio process is C. Of course, o the exteded space B is o loger Gaussia. The coditio 4. could be substituted with weaker oes. For example if it holds whe N is orthogoal to W, whereas [t/ ] E i ζ i i W j coverges i probability to a cotiuous process for all idices j, we still have the stable covergece i law of [t/ ] ζi, but the limit has the form A + B + M, where the process M is a stochastic itegral with respect to W. Se [3] for more details. 7

18 5 A first LNN Law of Large Numbers At this stage we start givig the basic limit theorems which are used later for statistical applicatios. erhaps givig first all limit theorems i a purely probabilistic settig is ot the most pedagogical way of proceedig, but it is the most ecoomical i terms of space... We are i fact goig to provide a versio of the results of Sectio 3, ad other coected results, whe the basic process X is a Itô semimartigale. There are two kids of results: first some LNNs similar to 3.5, 3.9, 3.8 or 3.2; secod, some cetral limit theorems CLT similar to 3. or We will ot give a complete picture, ad rather restrict ourselves to those results which are used i the statistical applicatios. Warig: Below, ad i all these otes, the proofs are ofte sketchy ad sometimes abset; for the full proofs, which are sometimes a bit complicated, we refer essetially to [5] which is restricted to the -dimesioal case for X, but the multidimesioal extesio is straightforward. I this sectio, we provide some geeral results, valid for ay d-dimesioal semimartigale X = X j j d, ot ecessarily Itô. We also use the otatio 3. ad 3.2. We start by recallig the fudametal result about quadratic variatio, which says that for ay idices j, k, ad as recall : [t/ ] i X j i X k Sk [X j, X k ] t = C jk t + s t X j s X k s. 5. This is the covergece i probability, for the Skorokhod topology, ad we eve have the joit covergece for the Skorokhod topology for the d 2 -dimesioal processes, whe j, k d. Whe further X has o fixed times of discotiuity, for example whe it is a Itô semimartigale, we also have the covergece i probability for ay fixed t. Theorem 5. Let f be a cotiuous fuctio from R d ito R d. a If fx = o x 2 as x, the V f, t Sk f µ t = f X s. 5.2 s t b If f coicide o a eighborhood of with the fuctio gx = d j,k= γ jkx j x k here each γ jk is a vector i R d, the V f, t Sk d j,k= γ jk C jk t + f µ t. 5.3 Moreover both covergeces above also hold i probability for ay fixed t such that X t = = hece for all t whe X is a Itô semimartigale. roof. Suppose first that fx = whe x ε, for some ε >. Deote by S, S 2, the successive jump times of X correspodig to jumps of orm bigger tha 8

19 ε/2, so S p. Fix T >. For each ω Ω there are two itegers Q = QT, ω ad N = NT, ω such that S Q ω T < S Q+ ω ad for all N ad for ay iterval i, i ] i [, T ] the either there is o S q i this iterval ad i X ε, or there is exactly oe S q i it ad the we set αq = i X X S q. Sice fx = whe x ε we clearly have for all t T ad N: V f, t q: S q [t/ ] f X Sq The the cotiuity of f yields 5.2, because α q for all q. Q f X Sq + αq f X Sq. 2 We ow tur to the geeral case i a. For ay η > there is ε > such that we ca write f = f ε + f ε, where f ε is cotiuous ad vaishes for x ε, ad where f εx η x 2. By virtue of 5. ad the first part of the proof, we have q= V f ε, η [t/ ] i X 2 Sk η d j= [Xj, X j ], V f ε, Sk f ε µ Moreover, f ε µ u.c.p. f µ as ε follows easily from Lebesgue covergece theorem ad the property fx =o x 2 as x, because x 2 µ t < for all t. Sice η > ad ε > are arbitrarily small, we deduce 5.2 from V f, = V f ε, + V f ε,. 3 Now we prove b. Let f = f g, which vaishes o a eighborhood of. The if we combie 5. ad 5.2, plus a classical property of the Skorokhod covergece, we obtai that the pair V g,, V f, coverges for the 2d -dimesioal Skorokhod d topology, i probability to the pair j,k= γ jkc jk + g µ, f µ, ad by addig the two compoets we obtai 5.3. Fially the last claim comes from a classical property of the Skorokhod covergece, plus the fact that a Itô semimartigale has o fixed time of discotiuity. I particular, i the -dimesioal case we obtai recall 3.: p > 2 Bpr, Sk Bp t := X s p. 5.4 s t This result is due to Lépigle [8], who eve proved the almost sure covergece. completely fails whe r 2 except uder some special circumstaces. It 6 Some other LNNs 6. Hypotheses. So far we have geeralized 3.8 to ay semimartigale, uder appropriate coditios o f. If we wat to geeralize 3.5 or 3.4 we eed X to be a Itô semimartigale, plus the fact that the processes b t ad σ t ad the fuctio δ i.7 are locally bouded ad σ t is either right-cotiuous or left-cotiuous. 9

20 Whe it comes to the CLTs we eed eve more. So for a clearer expositio we gather all hypotheses eeded i the sequel, either for LNNs or CLTs, i a sigle assumptio. Assumptio H: The process X has the form.7, ad the volatility process σ t is also a Itô semimartigale of the form σ t = σ + t bs ds + t σ dw s + κ δ µ ν t + κ δ µ t. 6. I this formula, σ t a d d matrix is cosidered as a R dd -valued process; b t ω ad σ t ω are optioal processes, respectively dd ad dd 2 -dimesioal, ad δω, t, x id a dd - dimesioal predictable fuctio o Ω R + E; fially κ is a trucatio fuctio o R dd ad κ x = x κx. Moreover, we have: a The processes b t ω ad sup x E δω,t,x γx ad sup x E e δω,t,x eγx are locally bouded, where γ ad γ are o-radom oegative fuctios satisfyig E γx2 λdx < ad E γx2 λdx <. b All paths t b t ω, t σ t ω, t δω, t, x ad t δω, t, x are left-cotiuous with right limits. Recall that b t is locally bouded, for example, meas that there exists a icreasig sequece T of stoppig times, with T, ad such that each stopped process bt t = b t T is bouded by a costat depedig o, but ot o ω, t. Remark 6. For the LNNs, ad also for the CLTs i which there is a discotiuous limit below, we eed a weaker form of this assumptio, amely Assumptio H : this is as H, except that we do ot require σ t to be a Itô semimartigale but oly to be càdlàg the of course b, σ, δ are ot preset, ad b t is oly locally bouded. As a rule, we will state the results with the metio of this assumptio H, whe the full force of H is ot eeded. However, all proofs will be made assumig H, because it simplifies the expositio, ad because the most useful results eed it ayway. Apart from the regularity ad growth coditios a ad b, this assumptio amouts to sayig that both X ad the process σ i.7 are Itô semimartigales: sice the dimesio d is arbitrary large ad i particular may be bigger tha d, this accommodates the case where i.7 oly the first d compoets of W occur by takig σ ij t = whe j > d, whereas i 6. other compoets of W come i, thus allowig σ t to be drive by the same Wieer process tha X, plus a additioal multidimesioal process. I the same way, it is o restrictio to assume that both X ad σ are drive by the same oisso measure µ. So i fact this hypothesis accommodates virtually all models of stock prices or exchage rates or iterest rates, with stochastic volatility, icludig those with jumps, ad allows for correlatio betwee the volatility ad the asset price processes. For example if we cosider a q-dimesioal equatio dy t = fy t dz t 6.2 2

21 where Z is a multi-dimesioal Lévy process, ad f is a C 2 fuctio with at most liear growth, the if X cosists i a subset of the compoets of Y, it satisfies Assumptio H. The same holds for more geeral equatios drive by a Wieer process ad a oisso radom measure. 6.2 The results. Now we tur to the results. The first, ad most essetial, result is the followig; recall that we use the otatio ρ σ for the law N, σσ, ad ρ k σ deotes the k-fold tesor product. We also write ρ k σ f = fxρ k σ dx if f is a Borel fuctio o R d k. With such a fuctio f we also associate the followig processes V f, k, t = [t/ ] f i X/,, i+k X/. 6.3 Of course whe f is a fuctio o R d, the V f,, = V f,, as defied by 3.2. Theorem 6.2 Assume H or H oly, see Remark 6., ad let f be a cotiuous fuctio o R d k for some k, which satisfies fx,, x k K k + x j p 6.4 for some p ad K. If either X is cotiuous, or if p < 2, we have V f, k, t u.c.p. t ρ k σ u fdu. I particular, if X is cotiuous ad the fuctio f o R d satisfies fλx = λ p fx for all x R d ad λ, the p/2 V f, t u.c.p. j= t ρ σu fdu. 6.5 The last claim above may be viewed as a extesio of Theorem 5. to the case whe the limit i 5.2 vaishes. The cotiuity of f ca be somehow relaxed. The proof will be give later, after we state some other LLNs, of two kids, to be proved later also. Recallig that oe of our mai objective is to estimate the itegrated volatility C jk t, we observe that Theorem 5. does ot provide cosistet estimators for C t whe X is discotiuous. There are two ways to solve this problem, ad the first oe is as follows: whe X has jumps, 5. does ot give iformatio o C t because of the jumps, essetially the big oes. However a big jump gives rise to a big icremet i X. So a idea, followig Macii [9], [2], cosists i throwig away the big icremets. The cutoff level has to be chose carefully, so as to elimiate the jumps but keepig the icremets which are maily due to the cotiuous martigale part X c, ad those are of order. So we choose two umbers ϖ, /2 ad α >, ad for all idices j, k d we set V jk ϖ, α, t = [t/ ] i X j i X k { i X α ϖ }

22 More geerally oe ca cosider the trucated aalogue of V f, k, of 6.3. With ϖ ad α as above, ad if f is a fuctio o R d k, we set V ϖ, α; f, k, t = [t/ ] f i X/,, i+k X/ j=,,k { i+j X α ϖ }. 6.7 Theorem 6.3 Assume H or H oly, ad let f be a cotiuous fuctio o R d k for some k, which satisfies 6.4 for some p ad some K >. Let also ϖ, 2 ad α >. If either X is cotiuous, or X is discotiuous ad p 2 we have V u.c.p. ϖ, α; f, k, t t ρ k σ u fdu. I particular, V jk ϖ, α, u.c.p. C jk t. This result has o real iterest whe X is cotiuous. Whe X jumps, ad at the expese of a more complicated proof, oe could show that the result holds whe p 4, ad also whe p > 4 ad ϖ p 4 2p 2r 4 whe additioally we have γx r λdz < for some r [, 2 where γ is the fuctio occurrig i H. The slight improvemet o the coditio o p, upo the previous theorem, allows to easily estimate ot oly C t, but also the itegral t gc sds for ay polyomial g o the set of d d matrices. For example if we take fx,, x k = k x m j j x j j, 6.8 j= for arbitrary idices m j ad j i {,, d}, the we get V ϖ, α; f, k, t u.c.p. t k j= c m j j s ds. 6.9 The problem with this method is that we do ot really kow how to choose ϖ ad α a priori: empirical evidece from simulatio studies leads to choose ϖ to be very close to /2, like ϖ =.47 or.48, whereas α for estimatig C jj t, say, should be chose betwee 2 ad 5 times the average c jj recall c = σσ. So this requires a prelimiary rough estimate of the order of magitude of c jj : of course for fiacial data this order of magitude is usually pretty much well kow. Aother way, iitiated by Bardorff-Nielse ad Shephard see [6] ad [7] cosists i usig the so-called bipower, or more geerally multipower, variatios. This is i fact a particular case of the Theorem 6.2. Ideed, recallig that m r is the rth absolute momet of N,, we set for ay r,, r l, 2 with r + + r l = 2 hece l 2: V jk r,, r l, t = 4m r m rl [t/ ] l i+v X j + X k r v v= 22 l i+v X j X k r v 6. v=

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data

Kolmogorov-Smirnov type Tests for Local Gaussianity in High-Frequency Data Proceedigs 59th ISI World Statistics Cogress, 5-30 August 013, Hog Kog (Sessio STS046) p.09 Kolmogorov-Smirov type Tests for Local Gaussiaity i High-Frequecy Data George Tauche, Duke Uiversity Viktor Todorov,

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales. A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Seunghee Ye Ma 8: Week 5 Oct 28

Seunghee Ye Ma 8: Week 5 Oct 28 Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

Notes 27 : Brownian motion: path properties

Notes 27 : Brownian motion: path properties Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X

More information

Math 61CM - Solutions to homework 3

Math 61CM - Solutions to homework 3 Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig

More information

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series. .3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(

More information

The Growth of Functions. Theoretical Supplement

The Growth of Functions. Theoretical Supplement The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

lim za n n = z lim a n n.

lim za n n = z lim a n n. Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

7 Sequences of real numbers

7 Sequences of real numbers 40 7 Sequeces of real umbers 7. Defiitios ad examples Defiitio 7... A sequece of real umbers is a real fuctio whose domai is the set N of atural umbers. Let s : N R be a sequece. The the values of s are

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Empirical Processes: Glivenko Cantelli Theorems

Empirical Processes: Glivenko Cantelli Theorems Empirical Processes: Gliveko Catelli Theorems Mouliath Baerjee Jue 6, 200 Gliveko Catelli classes of fuctios The reader is referred to Chapter.6 of Weller s Torgo otes, Chapter??? of VDVW ad Chapter 8.3

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Singular Continuous Measures by Michael Pejic 5/14/10

Singular Continuous Measures by Michael Pejic 5/14/10 Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

Frequentist Inference

Frequentist Inference Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for

More information

The Borel hierarchy classifies subsets of the reals by their topological complexity. Another approach is to classify them by size.

The Borel hierarchy classifies subsets of the reals by their topological complexity. Another approach is to classify them by size. Lecture 7: Measure ad Category The Borel hierarchy classifies subsets of the reals by their topological complexity. Aother approach is to classify them by size. Filters ad Ideals The most commo measure

More information

Chapter IV Integration Theory

Chapter IV Integration Theory Chapter IV Itegratio Theory Lectures 32-33 1. Costructio of the itegral I this sectio we costruct the abstract itegral. As a matter of termiology, we defie a measure space as beig a triple (, A, µ), where

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

Measure and Measurable Functions

Measure and Measurable Functions 3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

MA131 - Analysis 1. Workbook 2 Sequences I

MA131 - Analysis 1. Workbook 2 Sequences I MA3 - Aalysis Workbook 2 Sequeces I Autum 203 Cotets 2 Sequeces I 2. Itroductio.............................. 2.2 Icreasig ad Decreasig Sequeces................ 2 2.3 Bouded Sequeces..........................

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

Lecture Notes for Analysis Class

Lecture Notes for Analysis Class Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios

More information

Efficient GMM LECTURE 12 GMM II

Efficient GMM LECTURE 12 GMM II DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1 Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity

More information

Rates of Convergence by Moduli of Continuity

Rates of Convergence by Moduli of Continuity Rates of Covergece by Moduli of Cotiuity Joh Duchi: Notes for Statistics 300b March, 017 1 Itroductio I this ote, we give a presetatio showig the importace, ad relatioship betwee, the modulis of cotiuity

More information

LECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if

LECTURE 14 NOTES. A sequence of α-level tests {ϕ n (x)} is consistent if LECTURE 14 NOTES 1. Asymptotic power of tests. Defiitio 1.1. A sequece of -level tests {ϕ x)} is cosistet if β θ) := E θ [ ϕ x) ] 1 as, for ay θ Θ 1. Just like cosistecy of a sequece of estimators, Defiitio

More information

Sequences I. Chapter Introduction

Sequences I. Chapter Introduction Chapter 2 Sequeces I 2. Itroductio A sequece is a list of umbers i a defiite order so that we kow which umber is i the first place, which umber is i the secod place ad, for ay atural umber, we kow which

More information

STAT331. Example of Martingale CLT with Cox s Model

STAT331. Example of Martingale CLT with Cox s Model STAT33 Example of Martigale CLT with Cox s Model I this uit we illustrate the Martigale Cetral Limit Theorem by applyig it to the partial likelihood score fuctio from Cox s model. For simplicity of presetatio

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

Solutions to HW Assignment 1

Solutions to HW Assignment 1 Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.

More information

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22 CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first

More information

4.3 Growth Rates of Solutions to Recurrences

4.3 Growth Rates of Solutions to Recurrences 4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker

SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker SOME THEORY AND PRACTICE OF STATISTICS by Howard G. Tucker CHAPTER 9. POINT ESTIMATION 9. Covergece i Probability. The bases of poit estimatio have already bee laid out i previous chapters. I chapter 5

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

Law of the sum of Bernoulli random variables

Law of the sum of Bernoulli random variables Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible

More information

Math 113, Calculus II Winter 2007 Final Exam Solutions

Math 113, Calculus II Winter 2007 Final Exam Solutions Math, Calculus II Witer 7 Fial Exam Solutios (5 poits) Use the limit defiitio of the defiite itegral ad the sum formulas to compute x x + dx The check your aswer usig the Evaluatio Theorem Solutio: I this

More information

6a Time change b Quadratic variation c Planar Brownian motion d Conformal local martingales e Hints to exercises...

6a Time change b Quadratic variation c Planar Brownian motion d Conformal local martingales e Hints to exercises... Tel Aviv Uiversity, 28 Browia motio 59 6 Time chage 6a Time chage..................... 59 6b Quadratic variatio................. 61 6c Plaar Browia motio.............. 64 6d Coformal local martigales............

More information

CHAPTER I: Vector Spaces

CHAPTER I: Vector Spaces CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

1 Approximating Integrals using Taylor Polynomials

1 Approximating Integrals using Taylor Polynomials Seughee Ye Ma 8: Week 7 Nov Week 7 Summary This week, we will lear how we ca approximate itegrals usig Taylor series ad umerical methods. Topics Page Approximatig Itegrals usig Taylor Polyomials. Defiitios................................................

More information

Stochastic Integration and Ito s Formula

Stochastic Integration and Ito s Formula CHAPTER 3 Stochastic Itegratio ad Ito s Formula I this chapter we discuss Itô s theory of stochastic itegratio. This is a vast subject. However, our goal is rather modest: we will develop this theory oly

More information

Sequences. Notation. Convergence of a Sequence

Sequences. Notation. Convergence of a Sequence Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer. 6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio

More information

On the convergence rates of Gladyshev s Hurst index estimator

On the convergence rates of Gladyshev s Hurst index estimator Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

An Introduction to Asymptotic Theory

An Introduction to Asymptotic Theory A Itroductio to Asymptotic Theory Pig Yu School of Ecoomics ad Fiace The Uiversity of Hog Kog Pig Yu (HKU) Asymptotic Theory 1 / 20 Five Weapos i Asymptotic Theory Five Weapos i Asymptotic Theory Pig Yu

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Advanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology

Advanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology Advaced Aalysis Mi Ya Departmet of Mathematics Hog Kog Uiversity of Sciece ad Techology September 3, 009 Cotets Limit ad Cotiuity 7 Limit of Sequece 8 Defiitio 8 Property 3 3 Ifiity ad Ifiitesimal 8 4

More information

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen) Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

5 Birkhoff s Ergodic Theorem

5 Birkhoff s Ergodic Theorem 5 Birkhoff s Ergodic Theorem Amog the most useful of the various geeralizatios of KolmogorovâĂŹs strog law of large umbers are the ergodic theorems of Birkhoff ad Kigma, which exted the validity of the

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Kernel density estimator

Kernel density estimator Jauary, 07 NONPARAMETRIC ERNEL DENSITY ESTIMATION I this lecture, we discuss kerel estimatio of probability desity fuctios PDF Noparametric desity estimatio is oe of the cetral problems i statistics I

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Output Analysis and Run-Length Control

Output Analysis and Run-Length Control IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

More information

Lecture Chapter 6: Convergence of Random Sequences

Lecture Chapter 6: Convergence of Random Sequences ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

32 estimating the cumulative distribution function

32 estimating the cumulative distribution function 32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio

More information

L = n i, i=1. dp p n 1

L = n i, i=1. dp p n 1 Exchageable sequeces ad probabilities for probabilities 1996; modified 98 5 21 to add material o mutual iformatio; modified 98 7 21 to add Heath-Sudderth proof of de Fietti represetatio; modified 99 11

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

Lecture 3: August 31

Lecture 3: August 31 36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,

More information

Lecture 2. The Lovász Local Lemma

Lecture 2. The Lovász Local Lemma Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio

More information

Metric Space Properties

Metric Space Properties Metric Space Properties Math 40 Fial Project Preseted by: Michael Brow, Alex Cordova, ad Alyssa Sachez We have already poited out ad will recogize throughout this book the importace of compact sets. All

More information

Math 2784 (or 2794W) University of Connecticut

Math 2784 (or 2794W) University of Connecticut ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

1 The Haar functions and the Brownian motion

1 The Haar functions and the Brownian motion 1 The Haar fuctios ad the Browia motio 1.1 The Haar fuctios ad their completeess The Haar fuctios The basic Haar fuctio is 1 if x < 1/2, ψx) = 1 if 1/2 x < 1, otherwise. 1.1) It has mea zero 1 ψx)dx =,

More information

Probability for mathematicians INDEPENDENCE TAU

Probability for mathematicians INDEPENDENCE TAU Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet

More information