Exact confidence intervals for the Hurst parameter of a fractional Brownian motion
|
|
- Basil Kennedy
- 5 years ago
- Views:
Transcription
1 Exact cofidece itervals for the Hurst parameter of a fractioal Browia motio by Jea-Christophe Breto 1, Iva Nourdi, ad Giovai Peccati 3 Uiversité de La Rochelle, Uiversité Paris VI ad Uiversité Paris Ouest Abstract: I this short ote, we show how to use cocetratio iequalities i order to build exact cofidece itervals for the Hurst parameter associated with a oe-dimesioal fractioal Browia motio. Key words: Cocetratio Iequalities; Exact cofidece itervals; Fractioal Browia motio; Hurst parameter. 000 Mathematics Subject Classificatio: 60F05; 60G15; 60H07. 1 Itroductio Let B = {B t : t 0} be a fractioal Browia motio with Hurst idex H 0, 1. Recall that this meas that B is a real-valued cotiuous cetered Gaussia process, with covariace give by EB t B s = 1 sh + t H t s H. The reader is referred e.g. to [1] for a comprehesive itroductio to fractioal Browia motio. We suppose that H is ukow ad verifies H H < 1, with H kow throughout the paper, this is the oly assumptio we will make o H. Also, for a fixed 1, we assume that oe observes B at the times belogig to the set {k/; k = 0,..., + 1}. The aim of this ote is to exploit the cocetratio iequality proved i [10], i order to derive a exact i.e., o-asymptotic cofidece iterval for H. Our formulae hige o the class of statistics 1 S = B k+ k=0 B k+1 We recall that, as ad for every H 0, 1, see e.g. [8], ad also k=0, + B k H1 S 4 4 H, a.s.p, 1. Z = H 1 S 4 4 H 1.3 = 1 1 H B k+ B k+1 + B k 4 4 H Law = N0, c H, Uiversité de La Rochelle, Laboratoire Mathématiques, Image et Applicatios, Aveue Michel Crépeau, 1704 La Rochelle Cedex, Frace. jea-christophe.breto@uiv-lr.fr Laboratoire de Probabilités et Modèles Aléatoires, Uiversité Pierre et Marie Curie Paris VI, Boîte courrier 188, 4 place Jussieu, 755 Paris Cedex 05, Frace. iva.ourdi@upmc.fr 3 Equipe Modal X, Uiversité Paris Ouest Naterre la Défese, 00 Aveue de la République, 9000 Naterre, ad LSTA, Uiversité Paris VI, Frace. giovai.peccati@gmail.com 1
2 where N0, c H idicates a cetered ormal radom variable, with fiite variace c H > 0 depedig oly o H the exact expressio of c H is ot importat for our discussio. We stress that the CLT 1.4 holds for every H 0, 1: this result should be cotrasted with the asymptotic behavior of other remarkable statistics associated with the paths of B see e.g. [3] ad [4], whose asymptotic ormality may ideed deped o H. The fact that Z verifies a CLT for every H is crucial i order to determie the asymptotic properties of our cofidece itervals: see Remark 3.3 for further details. The problem of estimatig the self-similarity idices, associated with Gaussia ad o-gaussia stochastic processes, is crucial i applicatios, ragig from time-series, to physics ad mathematical fiace see e.g. [11] for a survey. This issue has geerated a vast literature: see [1] ad [6] for some classic refereces, as well as [5], [7], [8], [15], ad the refereces therei, for more recet discussios. However, the results obtaied i our paper seems to be the first o-asymptotic costructio of a cofidece iterval for the Hurst parameter H. Observe that the kowledge of explicit oasymptotic cofidece itervals may be of great practical value, for istace i order to evaluate the accuracy of a give estimatio of H whe oly a fixed umber of observatios is available. I order to illustrate the ovelty of our approach i.e., replacig CLTs with cocetratio iequalities i the obte! tio of cofidece itervals, we also decided to keep thigs as simple as possible. I particular, we defer to a separate study the discussio of further techical poits, such as e.g. the optimizatio of the costats appearig i our proofs. The rest of this short ote is orgaized as follows. I Sectio we state a cocetratio iequality that is useful for the discussio to follow. I Sectio 3 we state ad prove our mai result. A cocetratio iequality for quadratic forms Cosider a fiite cetered Gaussia family X = {X k : k = 0,..., M}, ad write Rk, l = EX k X l. I what follows, we shall cosider two quadratic forms associated with X ad with some real coefficiet c. The first is obtaied by summig up the squares of the elemets of X, ad by subtractig the correspodig variaces: M Q 1 c, X = c Xk Rk, k;.1 the secod quadratic form is Q c, X = c k=0 M X k X l Rk, l.. Note that Q c, X 0. It is well kow that, if Q 1 c, X is ot a.s. zero, the the law of Q 1 c, X admits a desity with respect to the Lebesgue measure this claim ca be easily proved by observig that Q 1 c, X ca always be represeted as a liear combiatio of idepedet cetered χ radom variables see [14] for a geeral referece o similar results. The followig statemet, whose proof relies o the Malliavi calculus techiques developed i [10], characterizes the tail behavior of Q 1 c, X. Theorem.1. Let the above assumptios prevail, suppose that Q 1 c, X is ot a.s. zero ad fix α 0 ad β > 0. Assume that Q c, X αq 1 c, X + β, a.s.-p. The, for all z > 0, we have z P Q 1 c, X z exp αz + β I particular, P Q 1 c, X z exp z αz+β ad. P Q 1 c, X z exp z. β
3 Proof. I this proof, we freely use the laguage of isoormal Gaussia processes ad Malliavi calculus; the reader is referred to [11, Chapter 1] for ay uexplaied otio or result. Without loss of geerality, we ca assume that the Gaussia radom variables X k have the form X k = Xh k, where XH = {Xh : h H} is a isoormal Gaussia process over H = R M, ad {h k : k = 1,..., M} is a fiite subset of H verifyig E[Xh k Xh l ] = Rk, l = h k, h l H. It follows that Q 1 c, X = I c M k=0 h k h k, where I stads for a double Wieer-Itô stochastic itegral with respect to X, so that the H-valued Malliavi derivative of Q 1 c, X is give by DQ 1 c, X = c M Xh k h k. Now write L 1 for the pseudo-iverse of the Orstei-Uhlebeck geerator associated with XH. Sice Q 1 c, X is a elemet of the secod Wieer chaos of XH, oe has that L 1 Q 1 c, X = 1 Q 1c, X. Oe therefore ifers the relatio k=0 DQ 1 c, X, DL 1 Q 1 c, X H = 1 DQ 1c, X H = Q c, X. The coclusio is ow obtaied by usig the followig geeral result. Theorem.. See [10, Theorem 4.1]. Let XH = {Xh : h H} be a isoormal Gaussia process over some real separable Hilbert space H. Write D resp. L 1 to idicate the Malliavi derivative resp. the pseudo-iverse of the geerator L of the Orstei-Uhlebeck semigroup. Let Z be a cetered elemet of D 1, := domd, ad suppose moreover that the law of Z has a desity with respect to the Lebesgue measure. If, for some α > 0 ad β 0, we have DZ, DL 1 Z H αz + β, a.s.-p, the, for all z > 0, we have z P Z z exp αz + β ad P Z z exp z. β Remark.3. Oe of the advatages of the cocetratio iequality stated i Theorem.1 with respect to other estimates that could be obtaied by usig the geeral iequalities by Borell [] is that they oly ivolve explicit costats. 3 Mai result We go back to the assumptios ad otatio detailed i the Itroductio. I particular, B is a fractioal Browia motio with ukow Hurst parameter H 0, H ], with H < 1 kow. The followig result is the mai fidig of the preset ote. Theorem 3.1. Fix 1, defie S as i 1.1 ad fix a real a such that 0 < a < 4 4 H. For x 0, 1, set g x = x log44x log. The, with probability at least [ ] ϕa = 1 exp a 71 a + 3 +, 3.1 3
4 where [ ] + stads for the positive part fuctio, the ukow quatity g H belogs to the followig cofidece iterval: I = [I l, I r ] = 1 log S a log 1 log + 44 H ; 1 log log S a log 1 + log + 44 H. log Remark We have that lim g H = H. Moreover, it is easily see that the asymptotic relatio 1. implies that, a.s.-p, lim I l = lim I r = H, 3. that is, as, the cofidece iterval I collapses to the oe-poit set {H}.. I order to deduce from Theorem 3.1 a geuie cofidece iterval for H, it is sufficiet to umerically iverse the fuctio g. This is possible, sice oe has that g x 1 for every x 0, 1, thus yieldig that g is a cotiuous ad strictly icreasig bijectio from 0, 1 oto log 3/ log, +. It follows from Theorem 3.1 that, with probability at least ϕa, the parameter H belogs to the iterval J = [J l, J r ] = [ g 1 u ; g 1 Ir ], where u = max{i l ; log 3/ log }. Observe that, sice relatio 3. is verified, oe has that I l > log 3/ log, a.s.-p, for sufficietly large. Moreover, sice g 1 is 1- Lipschitz, we ifer that J r J l I r I l = H log log + a 4 4 H a so that, for every fixed a, the legth of the cofidece iterval J coverges a.s. to zero, as, at the rate O 1/ log. 3. We ow describe how to cocretely build a cofidece iterval by meas of Theorem 3.1. Start by fixig the error probability ε for istace, ε = 0, 05 or 0, 01. Oe has therefore two possible situatios: i If there are o restrictios o that is, if the umber of observatios ca be idefiitely icreased, select first a > 0 i such a way that a exp ε a + 3 esurig that ϕa 1 ε. The, choose large eough i order to have a 4 4 H < 1 ad H log log + a 4 4 H L, a where L is some fixed desired upper boud for the legth of the cofidece iterval. ii If is fixed, the oe has to select a > 0 such that exp a 71 a + 3 ε ad a < 4 4 H. If such a a exists that is, if is large eough, oe obtais a cofidece iterval for H of 1 legth less or equal to log log 44 H +a. 44 H a 4
5 4. The fact that we work i a o-asymptotic framework is reflected by the ecessity of choosig values of a i such a way that the relatio 3.3 is verified. O the other had, if oe uses directly the CLT 1.4 thus replacig Z with a suitable Gaussia radom variable, the oe ca defie a asymptotic cofidece iterval by selectig a value of a such that a coditio of the type expcst a ε is verified. 5. By a careful ispectio of the proof of Theorem 3.1, we see that the existece of H is ot required if we are oly iterested i testig H < H for a give H. Proof of Theorem 3.1. Defie X = {X,k : k = 0,..., 1}, where By settig X,k = B k+ B k+1 + B k. ρ H r = 1 r H + 4 r 1 H 6 r H + 4 r + 1 H r + H, r Z, oe ca prove by stadard computatios that the covariace structure of the Gaussia family X is described by the relatio EX,k X,l = ρ H k l/ H. Now let Z be defied as i 1.3: it easily see that Z = Q 1 H1/, X as defied i.1. We also have, see formula.: 1 Q H1/, X = 4H1 1 H1 1 H1 1 = H1 = X,k X,l ρ H k l H X,k X,l ρ H k l X,k + X,l ρ H k l 1 X,k ρ H k l H1 Z ρ H r H X,k k=0 ρ H r Z ρ H r + 3 = α Z + β 3.4 with α = ρ H r ad β = 6 ρ H r. 3.5 Sice Z 0, Theorem.1 applies, yieldig P Z > a exp a 4 ρ Hr a + 3 Now, let us fid bouds o ρ Hr that are idepedet of H. Fix r 3. Usig 1 + u α = 1 + k=1 αα 1... α k + 1 u k for 0 u < 1, k!
6 we ca write ρ H r = rh = rh + k=1 = r H + l=1 1 H H H 1 + H r r r r HH 1 H k + 1 k + 41 k + 4 k r k k! HH 1 H l l r l. l! Note that the sig of HH 1 H l + 1 is the same as that of H 1 ad HH 1 H l + 1 = H H 1 H l 1 H Hece, we ca write + ρ H r r H 4 l 4 l l=1 = 4r H log r l 1 1r r H log l 1!. 1 4 r sice log1 u = k=1 uk k 43 0 rh4 sice 4 log1 u log1 4u 43 0 u if 0 u r. Cosequetly, takig ito accout of the fact that ρ H is a eve fuctio, we get ρ H r ρ H 0 + ρ H 1 + ρ H + ρ H r = 4 4 H H 9 H H H 16 H Puttig this boud i 3.6 yields r=3 π = 17, , P Z > a exp a 71 a + 3 if 0 u < 1 ρ H r r= Note that the iterest of this ew boud is that the ukow parameter H does ot appear i the right-had side. Now we ca costruct the aouced cofidece iterval for g H. First, observe that Z = H 1 S 4 4 H. Usig the assumptio H H o the oe had, ad 3.7 o the other had, we get: P 1 log S log + log a 1 44 H g H 1 log log S log log + a H log 6
7 = P P 1 log S log log + 1 a 44 H log 1 4 log S log + log 4 4 H a log = P Z a 1 exp which is the desired result. a 71 a + 3 H log4 4H log H 1 4 log S log + log 1 log S a log 1 + log + 44 H log 4 4 H + a log Remark 3.3. The fact that Q H1/, X α Z + β see 3.4, where α 0 ad β > 0, Law is cosistet with the fact that Z = N0, c H, ad Q H1/, X = 1 DZ H, where DZ is the Malliavi derivative of Z see the proof of Theorem.1. Ideed, accordig to Nualart ad Law Ortiz-Latorre [13], oe has that Z = N0, c H if ad oly if 1 DZ H coverges to the costat c H i L. See also [9] for a proof of this fact based o Stei s method. Ackowledgmet. We are grateful to D. Mariucci for useful remarks. Refereces [1] J. Bera Statistics for Log-Memory Processes. Chapma ad Hall. [] Ch. Borell Tail probabilities i Gauss space. I Vector Space Measures ad Applicatios, Dubli, Lecture Notes i Math. 644, Spriger-Verlag. [3] J.-C. Breto ad I. Nourdi 008. Error bouds o the o-ormal approximatio of Hermite power variatios of fractioal Browia motio. Electroic Commuicatios i Probability 13, [4] P. Breuer ad P. Major Cetral limit theorems for oliear fuctioals of Gaussia fields. J. Multivariate Aal. 13 3, [5] J.F. Coeurjolly 001. Estimatig the parameters of a fractioal Browia motio by discrete variatios of its sample paths. Statistical Iferece for Stochastic Processes 4, [6] R. Fox ad M.S. Taqqu Large sample properties of parameter estimates for strogly depedet statioary Gaussia time series. A. Stat. 14, [7] L. Giraitis ad P.M. Robiso 003. Edgeworth expasio for semiparametric Whittle estimatio of log memory. A. Stat. 314, [8] J. Istas ad G. Lag Quadratic variatios ad estimatio of the local Hölder idex of a Gaussia process. Aales de l Istitut Heri Poicaré B Probabilités et Statistiques 334, [9] I. Nourdi ad G. Peccati 008. Stei s method o Wieer chaos. Probab. Theory Rel. Fields, to appear. [10] I. Nourdi ad F. G. Vies 008. Desity formula ad cocetratio iequalities with Malliavi calculus. Available at [11] D. Nualart 006. The Malliavi calculus ad related topics. Spriger-Verlag, Berli, d editio. 7
8 [1] V. Pipiras ad M.S. Taqqu 003. Fractioal calculus ad its coectio to fractioal Browia motio. I: Log Rage Depedece, , Birkhäuser, Basel. [13] D. Nualart ad S. Ortiz-Latorre 008. Cetral limit theorem for multiple stochastic itegrals ad Malliavi calculus. Stoch. Proc. Appl , [14] I. Shigekawa Absolute cotiuity of probability laws of Wieer fuctioals. Proc. Japa. Acad., 54A, [15] C.A. Tudor ad F. G. Vies 007. Variatios ad estimators for self-similarity parameters via Malliavi calculus. To appear i: A. Probab.. 8
On the convergence rates of Gladyshev s Hurst index estimator
Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity
More informationBerry-Esséen bounds and almost sure CLT for the quadratic variation of the bifractional Brownian motion
Berry-Essée bouds ad almost sure CLT for the quadratic variatio of the bifractioal Browia motio Soufiae Aazizi 3 ad Khalifa Es-Sebaiy 4 Uiversité Cadi Ayyad Abstract Let B be a bifractioal Browia motio
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationDimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector
Dimesio-free PAC-Bayesia bouds for the estimatio of the mea of a radom vector Olivier Catoi CREST CNRS UMR 9194 Uiversité Paris Saclay olivier.catoi@esae.fr Ilaria Giulii Laboratoire de Probabilités et
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationMath 113 Exam 3 Practice
Math Exam Practice Exam will cover.-.9. This sheet has three sectios. The first sectio will remid you about techiques ad formulas that you should kow. The secod gives a umber of practice questios for you
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More information1 The Haar functions and the Brownian motion
1 The Haar fuctios ad the Browia motio 1.1 The Haar fuctios ad their completeess The Haar fuctios The basic Haar fuctio is 1 if x < 1/2, ψx) = 1 if 1/2 x < 1, otherwise. 1.1) It has mea zero 1 ψx)dx =,
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationLaw of the sum of Bernoulli random variables
Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible
More informationMeasure and Measurable Functions
3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationAn alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.
A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it
More informationASYMPTOTIC CONSTANTS FOR MINIMAL DISTANCE IN THE CEN- TRAL LIMIT THEOREM
Elect. Comm. i Probab. 1 (211), 9 13 ELECTRONIC COMMUNICATIONS i PROBABILITY ASYMPTOTIC CONSTANTS FOR MINIMAL DISTANCE IN THE CEN- TRAL LIMIT THEOREM EMMANUEL RIO UMR 81 CNRS, Uiversité de Versailles Sait
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationThe random version of Dvoretzky s theorem in l n
The radom versio of Dvoretzky s theorem i l Gideo Schechtma Abstract We show that with high probability a sectio of the l ball of dimesio k cε log c > 0 a uiversal costat) is ε close to a multiple of the
More informationMath 2784 (or 2794W) University of Connecticut
ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really
More informationNotes 27 : Brownian motion: path properties
Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X
More informationDiagonal approximations by martingales
Alea 7, 257 276 200 Diagoal approximatios by martigales Jaa Klicarová ad Dalibor Volý Faculty of Ecoomics, Uiversity of South Bohemia, Studetsa 3, 370 05, Cese Budejovice, Czech Republic E-mail address:
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationCSE 527, Additional notes on MLE & EM
CSE 57 Lecture Notes: MLE & EM CSE 57, Additioal otes o MLE & EM Based o earlier otes by C. Grat & M. Narasimha Itroductio Last lecture we bega a examiatio of model based clusterig. This lecture will be
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More information17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15
17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationMath 113, Calculus II Winter 2007 Final Exam Solutions
Math, Calculus II Witer 7 Fial Exam Solutios (5 poits) Use the limit defiitio of the defiite itegral ad the sum formulas to compute x x + dx The check your aswer usig the Evaluatio Theorem Solutio: I this
More informationRegression with an Evaporating Logarithmic Trend
Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationMa 530 Introduction to Power Series
Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationRandom Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.
Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationChapter 7 Isoperimetric problem
Chapter 7 Isoperimetric problem Recall that the isoperimetric problem (see the itroductio its coectio with ido s proble) is oe of the most classical problem of a shape optimizatio. It ca be formulated
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More information32 estimating the cumulative distribution function
32 estimatig the cumulative distributio fuctio 4.6 types of cofidece itervals/bads Let F be a class of distributio fuctios F ad let θ be some quatity of iterest, such as the mea of F or the whole fuctio
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More informationINFINITE SEQUENCES AND SERIES
11 INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES 11.4 The Compariso Tests I this sectio, we will lear: How to fid the value of a series by comparig it with a kow series. COMPARISON TESTS
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 9 Multicolliearity Dr Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Multicolliearity diagostics A importat questio that
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationKLMED8004 Medical statistics. Part I, autumn Estimation. We have previously learned: Population and sample. New questions
We have previously leared: KLMED8004 Medical statistics Part I, autum 00 How kow probability distributios (e.g. biomial distributio, ormal distributio) with kow populatio parameters (mea, variace) ca give
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More informationMath 61CM - Solutions to homework 3
Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig
More information1 Approximating Integrals using Taylor Polynomials
Seughee Ye Ma 8: Week 7 Nov Week 7 Summary This week, we will lear how we ca approximate itegrals usig Taylor series ad umerical methods. Topics Page Approximatig Itegrals usig Taylor Polyomials. Defiitios................................................
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationLecture 3 The Lebesgue Integral
Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationEFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS
EFFECTIVE WLLN, SLLN, AND CLT IN STATISTICAL MODELS Ryszard Zieliński Ist Math Polish Acad Sc POBox 21, 00-956 Warszawa 10, Polad e-mail: rziel@impagovpl ABSTRACT Weak laws of large umbers (W LLN), strog
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationSingular Continuous Measures by Michael Pejic 5/14/10
Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationCentral limit theorem and almost sure central limit theorem for the product of some partial sums
Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics
More informationA Negative Result. We consider the resolvent problem for the scalar Oseen equation
O Osee Resolvet Estimates: A Negative Result Paul Deurig Werer Varhor 2 Uiversité Lille 2 Uiversität Kassel Laboratoire de Mathématiques BP 699, 62228 Calais cédex Frace paul.deurig@lmpa.uiv-littoral.fr
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationEstimation of the Mean and the ACVF
Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationLecture 7: Density Estimation: k-nearest Neighbor and Basis Approach
STAT 425: Itroductio to Noparametric Statistics Witer 28 Lecture 7: Desity Estimatio: k-nearest Neighbor ad Basis Approach Istructor: Ye-Chi Che Referece: Sectio 8.4 of All of Noparametric Statistics.
More informationLecture 19. sup y 1,..., yn B d n
STAT 06A: Polyomials of adom Variables Lecture date: Nov Lecture 19 Grothedieck s Iequality Scribe: Be Hough The scribes are based o a guest lecture by ya O Doell. I this lecture we prove Grothedieck s
More informationRiesz-Fischer Sequences and Lower Frame Bounds
Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationK. Grill Institut für Statistik und Wahrscheinlichkeitstheorie, TU Wien, Austria
MARKOV PROCESSES K. Grill Istitut für Statistik ud Wahrscheilichkeitstheorie, TU Wie, Austria Keywords: Markov process, Markov chai, Markov property, stoppig times, strog Markov property, trasitio matrix,
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationConfidence intervals for the Hurst parameter of a fractional Brownian motion based on concentration inequalities
Cofidece itervals for the Hurst parameter of a fractioal Browia motio based o cocetratio iequalities Jea-Christophe Breto, Jea-Fraçois Coeurjolly To cite this versio: Jea-Christophe Breto, Jea-Fraçois
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationBerry-Esseen bounds for self-normalized martingales
Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,
More informationIRRATIONALITY MEASURES, IRRATIONALITY BASES, AND A THEOREM OF JARNÍK 1. INTRODUCTION
IRRATIONALITY MEASURES IRRATIONALITY BASES AND A THEOREM OF JARNÍK JONATHAN SONDOW ABSTRACT. We recall that the irratioality expoet µα ( ) of a irratioal umber α is defied usig the irratioality measure
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationErratum to: An empirical central limit theorem for intermittent maps
Probab. Theory Relat. Fields (2013) 155:487 491 DOI 10.1007/s00440-011-0393-0 ERRATUM Erratum to: A empirical cetral limit theorem for itermittet maps J. Dedecker Published olie: 25 October 2011 Spriger-Verlag
More informationTHE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS
THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity
More informationGroupe de Recherche en Économie et Développement International. Cahier de Recherche / Working Paper 10-18
Groupe de Recherche e Écoomie et Développemet Iteratioal Cahier de Recherche / Workig Paper 0-8 Quadratic Pe's Parade ad the Computatio of the Gii idex Stéphae Mussard, Jules Sadefo Kamdem Fraçoise Seyte
More informationSlide Set 13 Linear Model with Endogenous Regressors and the GMM estimator
Slide Set 13 Liear Model with Edogeous Regressors ad the GMM estimator Pietro Coretto pcoretto@uisa.it Ecoometrics Master i Ecoomics ad Fiace (MEF) Uiversità degli Studi di Napoli Federico II Versio: Friday
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationA NOTE ON BOUNDARY BLOW-UP PROBLEM OF u = u p
A NOTE ON BOUNDARY BLOW-UP PROBLEM OF u = u p SEICK KIM Abstract. Assume that Ω is a bouded domai i R with 2. We study positive solutios to the problem, u = u p i Ω, u(x) as x Ω, where p > 1. Such solutios
More informationThe log-behavior of n p(n) and n p(n)/n
Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information