FUNCTIONAL LARGE DEVIATION PRINCIPLES FOR FIRST-PASSAGE-TIME PROCESSES

Size: px
Start display at page:

Download "FUNCTIONAL LARGE DEVIATION PRINCIPLES FOR FIRST-PASSAGE-TIME PROCESSES"

Transcription

1 The Aals of Applied Probability 1997, Vol. 7, No. 2, FUNCTIONAL LARGE DEVIATION PRINCIPLES FOR FIRST-PASSAGE-TIME PROCESSES By Aatolii A. Puhalskii ad Ward Whitt Istitute for Problems i Iformatio Trasmissio ad AT&T Bell Laboratories We apply a exteded cotractio priciple ad superexpoetial covergece i probability to show that a fuctioal large deviatio priciple for a sequece of stochastic processes implies a correspodig fuctioal large deviatio priciple for a associated sequece of first-passage-time or iverse processes. Large deviatio priciples are established for both iverse processes ad cetered iverse processes, based o correspodig results for the origial process. We apply these results to obtai fuctioal large deviatio priciples for reewal processes ad superpositios of idepedet reewal processes. 1. Itroductio. I this paper we ivestigate how a (fuctioal) large deviatio priciple (LDP) for a sequece of stochastic processes ca be used to deduce a correspodig (fuctioal) LDP for a associated sequece of firstpassage-time or iverse processes. Give a real-valued stochastic process X X t t with sample paths that are ubouded above ad satisfy X, the associated iverse process is defied by (1.1) X 1 t if s > X s > t t (We use to deote a defiitio.) Previous papers [6, 17, 25, 27, 28] have show how covergece i distributio i the fuctio space D D with oe of the Skorohod [22] topologies of X 1, where X X t t, is related to that of X 1 1. Those papers also show how covergece i distributio of the sequeces of cetered processes c X e 1 ad c e X 1 1 are related, where c as ad e is the idetity fuctio; that is, e t = t t. Our purpose here is to show that these results have fairly direct aalogs i the large deviatios cotext, with the cotractio priciple playig the role of the cotiuous mappig theorem ad a exteded cotractio priciple i [13] ad [18], Sectio 2 (also see [2] ad [24]), playig the role of extesios of the cotiuous mappig theorem i Theorem 5.5 of [1] ad o page 68 of [28]. The geeral theme of relatig LDP s to weak covergece is discussed by Puhalskii [13 16, 18, 19]. This paper exteds [3] ad [18]. Gly ad Whitt [3] established some correspodig relatios betwee oe-dimesioal LDP s Received Jauary 1996; revised November AMS 1991 subject classificatios. Primary 6F1; secodary 6G55, 6K5. Key words ad phrases. Large deviatios, large deviatio priciple, Skorohod topologies, cotractio priciple, first passage times, iverse processes, coutig processes, reewal processes, superpositios of reewal processes. 362

2 FIRST-PASSAGE-TIME PROCESSES 363 for iverse processes. Sectio 3 of [18] dealt with fuctioal LDP s for iverse processes for the weak topology ad established fuctioal LDP s for reewal processes. This paper corrects fuctioal LDP s for iverse processes correspodig to Theorems 3.2 ad 6.1 here that had bee give i a prelimiary draft of [3]. Here is how the preset paper is orgaized. I Sectio 2 we discuss fuctio space topologies ad restrictios o the limit fuctios uder which the iverse map (1.1) is cotiuous. I Sectio 3 we preset LDP s based directly o these cotiuity properties. I Sectio 4 we establish prelimiary results about superexpoetial covergece i probability, which plays the role with LDP s that ordiary covergece i probability plays with weak covergece, as i Theorem 4.1 of [1]. I Sectio 5 we use the results about superexpoetial covergece i probability to obtai LDP s for cetered first-passagetime processes. I Sectios 6 ad 7 we apply these results to obtai LDP s for reewal processes ad superpositios of reewal processes. The LDP s for cetered processes are established i a triagular array settig. The results i this paper are applied i [21]. There fuctioal LDP s are established for waitig times ad departure times i sigle-server queues with ulimited waitig space. (The results here ad i [21] are briefly summarized i [2].) Just as for the heavy-traffic diffusio limits i [5], the results for iverse processes help establish large deviatio priciples for processes stemmig from the basic etwork operatios of superpositio, splittig ad departure. We illustrate this pheomeo here by our treatmet of superpositio processes. More geerally, the large deviatio priciples are importat for determiig the probabilities of rare evets i the queueig model, such as hittig times of high levels. The large deviatio priciples also are itimately coected to the asymptotics of steady-state tail probabilities i the queueig model; for example, see [4] ad Sectio 6 of [18]. We close this itroductio by givig a illustrative applicatio. Suppose that N t t is a coutig process such that t 1 N t c > as t, ad we wat to approximate the probability P N t at, N 2t a + b t for large t, where a > c > b. Thus we are cosiderig the probability that N has uusually large values i the iterval t ad uusually small values i the iterval t 2t. By the methods here, it may be possible to show that 1 N t t, 1 obeys a LDP i fuctio space with rate fuctio I x = λ ẋ t dt for absolutely cotiuous x with x = ad I x = otherwise, where λ is a (oegative covex) local rate fuctio o R with λ c =. The we may apply the cotractio priciple with this LDP to deduce that lim sup t 1 log P t 1 N t a t 1 N 2t a + b λ a + λ b t

3 364 A. A. PUHALSKII AND W. WHITT ad lim if t t 1 log P t 1 N t > a t 1 N 2t < a + b λ a + λ b which supports the rough approximatio for large t. P t 1 N t a t 1 N 2t a + b exp t λ a + λ b 2. Fuctios ad topologies o D ad its subsets. This sectio largely follows Sectio 7 of [28], but there will be a few chages. I particular, there will be a correctio for treatig the iverse fuctio with the M 1 topology. (This correctio is relevat for covergece i distributio as well as for LDP s.) Let D be the space of all right-cotiuous real-valued fuctios x x t t o the oegative half lie with left limits everywhere i. Let E be the subset of fuctios x i D that are ubouded above ad satisfy x. Let D be the subset of odecreasig fuctios i D ad let E = E D. We are primarily iterested i the iverse fuctio, defied for ay x E by (1.1); there x is a sample path of X. Also defie the supremum fuctio for ay x D by (2.1) x t sup x s s t t Obviously, if x E, the x 1 E ad x E. We cosider the Skorohod [22] J 1 ad M 1 topologies o D ad a mior modificatio of the M 1 topology deoted by M 1. For these topologies, D is metrizable as a separable metric space. Let D have the Borel σ-field iduced by its topology. For the topologies we cosider, the Borel σ-fields coicide with the usual Kolmogorov σ-field geerated by the fiite-dimesioal projectio maps. The J 1 topology is quite familiar; it is as i [1], [7], [28]. Recall that the M 1 topology o D is defied i terms of the completed graph Ɣ x { u t R R + \ u x t x t x t x t } (2.2) x where x t deotes the left limit of x at t deotes the miimum ad deotes the maximum; see [12], [22], [27], [28]. We will call a pair of cotiuous fuctios u t u s t s s such that t s is odecreasig with t = a parameterizatio of Ɣ x if Ɣ x = u s t s s. A sequece x 1 i D coverges to x i D M 1 if there exist parameterizatios u t of x, 1, ad u t of x such that (2.3) sup u s u s + t s t s s T as for all T >. What we would like is for the iverse fuctio i (1.1) to be cotiuous o E, but we must impose costraits whe we work with the Skorohod [22] J 1

4 FIRST-PASSAGE-TIME PROCESSES 365 ad M 1 topologies with domai exteded from 1 to. We have the followig result. Lemma 2.1. (a) The supremum fuctio is cotiuous i the J 1 ad M 1 topologies. (b) The iverse fuctio i (1.1) is measurable o E, is cotiuous i the M 1 topology at those x for which x 1 =, ad is cotiuous i the J 1 topology at each strictly icreasig x. Part (a) is i Sectio 6 of [28]. The J 1 result i part (b) ad the eed for the J 1 coditio are give o page 82 of [28]. However, the M 1 coditio is missig i [27] ad Theorem 7.1 of [28]. To see that the M 1 coditio is eeded, let x t = t/, t < 1, ad x t = t 1, t 1. Clearly x x M 1 where x t =, t < 1 ad x t = t 1, t 1. However, x 1 = x 1 = 1 as, so that x 1 x 1 M 1 as. With the M 1 coditio added, the M 1 cotiuity proof is as i [27]. We look at the iverse as the compositio of the iverse ad supremum maps. Hece, it suffices to cosider the iverse map o E. Cotiuity is established by otig that, give the M 1 coditio, each parameterizatio u t of x ca serve as a parametric represetatio of x 1 whe the roles of u ad t are switched. Aother approach to the problem of the cotiuity of the iverse mappig o D is to chage the topology istead of addig the extra coditio. I [18] the cotiuity for the weak topology was proved. Here we use a weaker topology, which we call M 1 ad which is defied i the same way as M 1, except that we chage Ɣ x to (2.4) Ɣ x u t R R + u x t x t x t x t where x =. Stated aother way, Ɣ x is the exteded graph Ɣ x complemeted by addig the segmet x if x or x if x. We say that x x i D M 1 if (2.3) holds for some parameterizatios of Ɣ x ad Ɣ x. More rigorously, D M 1 is a metric space with metric d defied as follows. If x x t t ad y y t t are elemets of D, let (2.5) d k {sup x y if u s g k t p v s g k r s s k } + t s g k t s r s g k t s where g k t equals 1 for t less tha k, equals for t greater tha k + 1 ad is a liear iterpolatio betwee k ad k + 1, ad u s t s s ad v s r s s are parameterizatios of x ad y, respectively, ad the ifimum is take over all the parameterizatios. The (2.6) d x y k=1 d k x y 1 2 k metrizes M 1. It is ot difficult to show that D d is a separable metric space ad d iduces the Kolmogorov σ-field. I additio, the M 1 topology is

5 366 A. A. PUHALSKII AND W. WHITT stroger tha the M 1 topology; that is, overall the topologies are ordered by J 1 M 1 M 1. Covergece x x is equivalet for all three topologies at cotiuous x with x =. Moreover, o E with the M 1 topology x x is equivalet to poitwise covergece x t x t at all cotiuity poits except possibly for t =. The followig is the key lemma. Lemma 2.2. The supremum fuctio i (2.1) o D ad the iverse fuctio i (1.1) o E are cotiuous i the M 1 topology. Proof. The argumet for the supremum fuctio is straightforward. The claim for the iverse fuctio follows sice if u t is a Ɣ -parameterizatio of x E, the t u is a Ɣ -parameterizatio of x 1. We will eed aother basic lemma. Let e be the idetity fuctio; e t = t for t. Let c be ay real umber. Lemma 2.3. If x E, the d c x e c e x 1 d x e Proof. For ay k ad ε >, let u s t s s > ad t s t s s be Ɣ -parameterizatios of x ad e, respectively, so that sup u s t s + t s t s d k x e + ε s k Note that c u s t s t s s is a Ɣ -parameterizatio of c x e. Moreover, sice x E, c u s t s u s s is a Ɣ -parameterizatio of c e x 1. Usig these parameterizatios, we see that, for ay c, d k c x e c e x 1 sup u s t s s k sup u s t s + t s t s s k d k x e + ε Sice ε was arbitrary, d k c x e c e x 1 d k x e for each k, from which the coclusio follows. 3. Iitial large deviatio coclusios. We ow draw large deviatio coclusios from the cotiuity properties i Sectio 2. Recall that all spaces we cosider are separable metric spaces. Followig Varadha [23, 24], we say that a fuctio I x defied o a metric space S ad takig values i is a rate fuctio if the sets x S I x a are compact for all a, ad a sequece P 1 of probability measures o the Borel σ-field of S (or a sequece of radom elemets X 1 with values i S ad distributios P ) obeys the LDP with the rate fuctio I if lim sup 1 log P F if x F I x

6 for all closed F S, ad FIRST-PASSAGE-TIME PROCESSES 367 lim if 1 log P G if x G I x for all ope G S. We establish ew LDP s from previously established oes by applyig the cotractio priciple [23, 24] or a extesio [13] ad [18], Sectio 2. Here are statemets: the cotractio priciple states that if X 1 obeys a LDP with rate fuctio I ad if f is cotiuous, the f X 1 obeys a LDP with rate fuctio (3.1) I y if I x x f x =y Our exteded cotractio priciple states that if X 1 obeys a LDP with rate fuctio I, if f 1 is a sequece of measurable fuctios, if the fuctio f is cotiuous i restrictio to the sets x I x a a ad if f x f x as for all x for which x x as for all x for which I x <, the f X 1 obeys a LDP with rate fuctio (3.1). (This statemet is actually a cosequece of a more geeral result i [18]; see Theorem 2.1 ad followig Remarks 1 ad 2 there.) A importat special case is f = f, as i the cotractio priciple, where f is cotiuous at each x with I x <. I either case, if i additio f is a bijectio, the we ca write I y = I f 1 y. The applicatios here illustrate the importace of the exteded cotractio priciple. We cosider both sigle fuctios that are ot cotiuous everywhere ad sequeces of fuctios. The ext three theorems follow immediately from Lemmas 2.1 ad 2.2 ad the cotractio priciple or its extesio. Theorem 3.1. If X 1 obeys the LDP i E J 1 with rate fuctio I X, the X 1 obeys the LDP i E J 1 with rate fuctio (3.2) I X x if y E x=y I X y x E If i additio I X x = wheever x is ot strictly icreasig, the X 1 1 obeys the LDP i E J 1 with rate fuctio (3.3) I X 1 x if I X y = I X x 1 y E y y 1 =x [As a cosequece, I X 1 x = if x is ot cotiuous.] x E Theorem 3.2. If X 1 obeys the LDP i E M 1 with rate fuctio I X, the X 1 obeys the LDP i E M 1 with rate fuctio I X i (3.2). If I X x = wheever x 1 >, the X 1 1 obeys the LDP i E M 1 with rate fuctio I X 1 i (3.3). [As a cosequece I X 1 x = if x >.

7 368 A. A. PUHALSKII AND W. WHITT Theorem 3.3. If X 1 obeys the LDP i E M 1 with rate fuctio I X, the X 1 obeys the LDP i E M 1 with rate fuctio I X i (3.2) ad X 1 1 obeys the LDP i E M 1 with rate fuctio I X 1 i (3.3). I (3.3) we have used the fact that the iverse map is a bijectio o E i order to write I X 1 x = I X x 1. Remark 3.1. It may be coveiet to establish a LDP for a iverse process by applyig Theorems 3.2 or 3.3 for the M 1 or M 1 topology istead of the stroger J 1 topology, but the LDP exteds to the stroger J 1 topology from M 1 or M 1 if the rate fuctio I X 1 x is ifiite at discotiuous x ad for M 1 if i additio the rate fuctio I X 1 x = whe x. This is because covergece x x for cotiuous x with x = is equivalet for the three topologies ad we ca apply the exteded cotractio priciple to the idetity maps. Ideed, the LDP exteds to the stroger uiform topology, uder which D is oseparable, provided that X 1 remais a boafide radom elemet. However, i geeral this eed ot be the case sice the Borel σ-field is richer tha the Kolmogorov σ-field; see [1], Sectio 18. Ideed, measurability with respect to the Borel σ-field associated with the uiform topology fails eve for the Poisso process. Thus, for geeral LDP s o D it is ofte importat to work with topologies like the Skorohod topologies, for which the Borel ad Kolmogorov σ-fields coicide. X 1 I may (but ot all) cases, the rate fuctios I X x for X ad I X 1 x for have the form (3.4) I X x = λ X ẋ t dt if x is absolutely cotiuous ad x = ad I X x = otherwise, ad (3.5) I X 1 x = λ X 1 ẋ t dt if x is absolutely cotiuous ad x = ad I X 1 x = otherwise, where λ X ad λ X 1 are covex local rate fuctios o R. We ca the apply Theorems to deduce the relatio betwee the rate fuctios λ X ad λ X 1 o R, which is cosistet with what was established directly by [3]. Theorem 3.4. If X 1 obeys the LDP i E for oe of the topologies J 1, M 1 or M 1 with the rate fuctio I X satisfyig (3.4), where λ X =, the X 1 1 obeys the LDP i E J 1 with the rate fuctio I X 1 from (3.5), where (3.6) λ X 1 z = zλ X 1/z λ X 1 = If the fuctio λ X (respectively, λ X 1) is covex dowwards, the the sequece of radom variables X 1 1 (respectively, X ) obeys the LDP i R with rate fuctio λ X (respectively, λ X 1).

8 FIRST-PASSAGE-TIME PROCESSES 369 Proof. Sice λ X =, I X x = if x 1 is ot absolutely cotiuous (as follows from Lemma 3.6 i [18]). By Remark 3.1, the LDP for X 1 holds i E J 1. By Theorem 3.1 X 1 1 obeys the LDP i E J 1 with rate fuctio I X 1 which, for absolutely cotiuous x ad x 1 = y, is give by I X 1 x = I X x 1 = I X y = = = λ X ẏ x s ẋ s ds λ X 1 ẋ s ds λ X ẏ s ds sice y x = e by performig a chage of variables. Hece (3.6) holds. As idicated above, we ext apply the exteded cotractio priciple with the projectio map defied by π x = x 1 to obtai the LDP s i R. Sice λ X is covex, the ifimum over x such that x 1 = z is attaied at ẋ t = z for t 1. The relatio betwee λ X ad λ X 1 was established i [3]. It is importat to ote, however, that the rate fuctios I X of X 1 ad I X 1 of X 1 1 may ivolve fuctios with jumps, so that (3.4) ad (3.5) eed ot hold; see [9], [11], [18] ad Sectio 6 below. The the coectios to LDP s o R is more complicated, for example, because the projectio map is ot ecessarily cotiuous. Fuctios with jumps may play a role i either I X or I X 1 or both. However, Theorem 3.4 does apply to the reewal theory examples i Sectios 6 ad 7 uder regularity coditios. 4. Superexpoetial covergece i probability. As a basis for establishig relatios betwee LDP s for cetered processes ad associated cetered iverse processes, parallelig Theorems of [28], we establish some prelimiary results about superexpoetial covergece i probability. As i [16], we say that a sequece X 1 of radom elemets of a metric space S ρ coverges superexpoetially i probability to a elemet x S if, for all ε >, (4.1) lim P1/ ρ X x > ε = ad we write X P 1/ x. This mode of covergece plays a role i large deviatios similar to the role covergece i probability plays i weak covergece. We collect some simple properties of superexpoetial covergece i probability i the followig lemmas. The similarity with weak covergece should be evidet; for example, see [1], [28]. I the followig lemmas, S is the space D with ay of the topologies J 1, M 1 or M 1. Parts of the ext lemma ca obviously be exteded to geeral metric spaces; for example, see [15], [16]. Note the similarity of parts (b) ad (c) to Theorems 4.1 ad 4.4 of [1]. Part (c) follows directly from part (b) (also it is Lemma 3.3 i [16]).

9 37 A. A. PUHALSKII AND W. WHITT P Lemma 4.1. (a) X 1/ x if ad oly if X 1 obeys the LDP with rate fuctio { x = x (4.2) δ x x x x (b) If X 1 obeys the LDP i D for oe of the topologies J 1 M 1 ad P 1/ M 1 with rate fuctio I ad Y y, the X Y 1 obeys the LDP i D D for the product topology with rate fuctio I x + δ y y, ad X + Y 1 obeys the LDP i D for the same topology with rate fuctio I x y x D. (c) If X 1 obeys the LDP i D for metric m with rate fuctio I ad m X Y P1/, the Y 1 obeys the LDP i D for metric m with rate fuctio I. Lemma 4.2. (a) Let x x t t be cotiuous with x = if the P 1/ topology is M 1. The X x if ad oly if ) lim X t x t > ε = P1/( sup t T for all ε > ad T >. (b) If, for c, c X 1 obeys the LDP with some rate fuctio, P the X 1/ θ as, where θ t = t. P (c) If X has paths i E for 1 ad X 1/ e, the X 1 P 1/ e. Proof. For part (a), we do the proof oly for the J 1 topology; the proof for the other topologies is similar. By the triagle iequality, sup X t x t sup X t x λ t + x λ t x t t T t T where λ t, for t T, is ay homeomorphism of T. Hece, sup X t x t d T X x + w x d T X x t T where d T is the Skorohod J 1 metric o D T ad w x δ is the modulus of cotiuity of x as i [1], page 54. For ay x ad ε, let δ be such that w x δ ε, which is possible because x is cotiuous. The { d T X x δ ε sup t T } X t x t 2ε d T X x 2ε which implies the result. We also use the fact that a J 1 metric d o D ca be related to the metric d T o D T for large T; see (2.2) of [28]; that is, for ay ε >, d X x ε d T X x 2ε d X x 3ε for T suitably large. For (b), ote that by the defiitio of the LDP ad usig

10 FIRST-PASSAGE-TIME PROCESSES 371 that c, we have, for ε >, A >, ad metric m (associated with oe of the topologies J 1, M 1 or M 1 ), lim sup P 1/ m X θ > ε lim sup P 1/ m c X θ Aε sup exp I x x m x θ Aε ad the latter goes to as A sice the sets x I x a, a, are compact ad hece bouded. For part (c), we apply Lemmas 2.1, 2.2 ad part (a) of Lemma 4.1. We ow discuss the compositio map, deoted by. Recall that if x x t t D ad y y t t E, the x y = x y t t D; see [28]. Note the similarity of this lemma with [1], page 145. Lemma 4.3. Let X 1 obey a LDP for oe of the topologies J 1 M 1 ad M 1 with rate fuctio I, ad let Y 1 be a sequece of oegative processes with paths from E P such that Y 1/ y. If the topology is M, the let y be cotiuous. If the topology is M 1, the let y be cotiuous with y =. If I x = for discotiuous x, or y is cotiuous ad strictly icreasig, the X Y 1 obeys the LDP with rate fuctio I z if I x x x y =z z D Proof. By Lemma 4.2, X Y 1 obeys the LDP i D D with I x +δ y y. The claim the follows by Theorem 3.1 i [28] ad the exteded cotractio priciple. A aalog of Theorem 3.1 of [28] holds for M 1 ad M 1 if the limit y there is cotiuous. 5. LDPs for cetered processes. We ow apply the lemmas i Sectio 4 to deduce the followig results. For them, we assume that the processes X have paths i E ad c as. Theorem 5.1. If the sequece c X e 1 obeys the LDP i D for the J 1 topology with rate fuctio I such that I x = for fuctios x which have positive jumps or have x, the the sequece c e X 1 1 also obeys the LDP i D for the J 1 topology with the rate fuctio I. Proof. X P 1/ We follow the argumet i [28], Theorem 7.3. By Lemma 4.2(b), e ad by Lemma 4.2(c), X 1 e. Lemma 4.3 the implies that c X e X 1 1 obeys the LDP with I. Sice P 1/ c e X 1 = c X e X 1 by Lemma 4.1(b), the theorem would follow from c e X X 1 + c e X X 1 P1/

11 372 A. A. PUHALSKII AND W. WHITT which i tur, by Lemma 4.2(a), follows by (5.1) Sice (cf. [28]) sup t T sup t T c X X 1 P1/ t t X X 1 T > t t sup X t + T t X 1 where x t, for x = x t t, deotes the jump of x at t with x = x, we have for A >, ε >, that (5.2) P 1/( ) sup c X X 1 t t > ε t T P 1/ X 1 T > A + P1/( sup t A ) c X t + > ε Now it is ot difficult to see that the fuctio x sup t A x t + is cotiuous i the J 1 topology at each x with o positive jumps; for example, see [8], Chapter 6, Sectio 2. The, by the exteded cotractio priciple ad the LDP for c X e 1, lim sup P 1/( sup t A ) c X t + ε sup exp I x = x sup t A x t + ε provig that the secod term o the right-had side of (5.2) goes to as. The first term goes to as ad A sice X 1 e. Hece, the limit (5.1) has bee proved, so the theorem has bee proved. I order to obtai a result parallelig Theorem 5.1 for the M 1 topology, we first establish a result for cetered supremum processes. Theorem 5.2. If the sequece c X e 1 obeys the LDP i D for either M 1 or the M 1 topology with rate fuctio I, the c X e 1 obeys the LDP i D for the same topology with rate fuctio I. Proof. We ca use the exteded cotractio priciple with the fuctios f y = y + c e c e. Assume that y = c x e y x. Sice f y = c x e, it suffices to show that f y y wheever y y i D for the M 1 or M 1 topology, which follows by Theorem 6.3(ii) i [28]. (The proof there eeds chagig whe x has egative jumps.) Theorem 5.3. If the sequece c X e 1 obeys the LDP i D for the M 1 topology with rate fuctio I, the the sequece c e X 1 1 obeys the LDP i D for the M 1 topology with the rate fuctio I. Proof. P 1/ First apply Theorem 5.2 to see that it suffices to assume that X E for each. By Lemma 4.2(b), d X e P1/, so that d c X e c e X 1 P1/ by Lemma 2.3. Fially, apply Lemma 4.1(c).

12 FIRST-PASSAGE-TIME PROCESSES 373 The last result of the sectio is a straightforward extesio of Theorems 5.1 ad 5.3, but is quite useful i applicatios. Theorem 5.4. If the sequece c X a e 1, where a are real umbers covergig to a >, obeys the LDP i D for the M 1 topology with rate fuctio I x, the the sequece c X a e c X 1 a 1 e 1 obeys the LDP i D D for (the product topology associated with) the M 1 topology with rate fuctio I 1 x y = I x, whe y = a 1 x a 1 e, ad I 1 x y = otherwise. If the LDP for c X a e 1 holds for the J 1 topology with I equal to ifiity at fuctios x with positive jumps or with x, the the LDP for c X a e c X 1 a 1 e 1 holds for (the product topology associated with) the J 1 topology with the rate fuctio I 1. Proof. Notig that x 1 a 1 e = e a 1 x 1 a 1 e, we have as i the precedig argumet that d c X 1 a 1 e c a 1 X a e a 1 so that i the statemet of the theorem we ca replace c X a e c X 1 a 1e 1 by c X a e a 1 g c X a e a 1 e 1, where g x = x + c a e c a e. The claim follows by Lemma 4.3 ad the exteded cotractio priciple sice g x x as x x ad a a. O writig c a 1 e X 1 = c a 1 X a e X 1 + c a 1 e P1/ e X X 1 we ca apply for the case of the J 1 topology the argumet of the proof of Theorem Large deviatios for reewal processes. I this sectio, we apply the results of previous sectios to derive LDP s for sequeces of reewal processes. Correspodig results ca be established for cases i which the i.i.d. coditio is relaxed, drawig upo Zajic [29] ad refereces therei. We first assume that the X are defied by (6.1) X t 1 where ξ i, i 1, are i.i.d., oegative, Eξ 1 >. Let N t t be the reewal process with ξ 1 ξ 2 as the times betwee reewals; that is, { } k (6.2) N t max k 1 ξ i t t i=1 with N t = if ξ 1 > t, ad let N N t / t, 1. We are goig to derive the LDP for the sequece N 1. This will be doe by reducig this problem to the LDP for X 1 ad by ivokig earlier results for X 1. For this purpose, ote that (6.3) t i=1 ξ i N t / = X 1 t 1/

13 374 A. A. PUHALSKII AND W. WHITT The followig theorem is a versio of Theorem 3.1 i [18]. Part (b) is the same. Part (a) is also equivalet, because the M 1 topology here ad the weak topology i [18] coicide o E, sice both correspod to poitwise covergece at all cotiuity poits except. Theorem 6.1. Assume that E exp αξ 1 < for some α >. Let α = sup α E exp αξ 1 <. (a) The N 1 obeys the LDP i E for the topology with rate fuctio M 1 (6.4) I N x sup α<α { α ẋ l 1 t log E exp αξ 1 } dt log P ξ 1 = x l 2 where x = x l 1 + xl 2 is the Lebesgue decompositio of x with respect to Lebesgue measure; x l 1 is the absolutely cotiuous compoet with xl 1 =, xl 2 is the sigular compoet ad ẋ l 1 t is the derivative. I (6.4) it is assumed, that the product o the right-had side is if P ξ 1 = = ad x l 2 =. (b) If, i additio, P ξ 1 = =, the the LDP holds for the J 1 topology with I N x = if x is ot absolutely cotiuous, or x. Proof. By [18], Lemma 3.2, X 1 obeys the LDP o E for the weak (ad hece the M 1 topology with rate fuctio (6.5) I X x sup α<α { αẋ l 1 t log E exp αξ 1 } dt + α x l 2 where =. (Note that if α =, the I X x = wheever x is ot absolutely cotiuous, but otherwise this is ot the case.) The first part of the proof of part (a) is completed by applyig Theorem 3.3, Lemma 4.3 ad (6.3); see [18] for details. For part (b), ote that the extra coditio makes I N x = for discotiuous x or if x. The we use the fact that x x J 1 is equivalet to x x M 1 for cotiuous x with x =. Hece, we ca apply the exteded cotractio priciple with the idetity map to stregthe the topology, as oted i Sectio 3. Remark 6.1. I the settig of Theorem 6.1 assume, i additio, that E exp αξ 1 < for all α ad P ξ 1 = =. The we ca use Theorem 3.4 to get the familiar LDP s i R for the projectios at t = 1. Uder the assumptios, I X x =, whe x is either ot absolutely cotiuous, or x, or x is ot strictly icreasig for the rate fuctio (6.5), so that the coditios of Theorem 3.4 are satisfied with the local rate fuctios i R beig ad λ X z = sup αz log E exp αξ 1 α λ X 1 z = zλ X 1/z = sup α z log E exp αξ 1 α A applicatio of the theorem provides the oe-dimesioal LDP s.

14 FIRST-PASSAGE-TIME PROCESSES 375 We ow establish a LDP i D for cetered reewal processes, which is a form of moderate deviatios; see page 79 of [15]. Motivated by applicatios to queues i heavy traffic, we choose to work i the more geeral settig of triagular arrays. More specifically, we cosider a sequece of reewal processes idexed by ad deote by ξ i i 1 the times betwee reewals. We ext defie ) k (6.6) N (k t = max 1 ξ i t i=1 (6.7) N t = 1 a N a t where a /. For completeess, we first state the result of Example 7.2 [15] o the moderate deviatio ivariace priciple for partial sums of triagular arrays (prototypes for partial sums of r.v. are i [1] ad [26], Theorem 4.4.3). Lemma 6.1. Let ζ i i 1 1 be a triagular array of row-wise i.i.d. radom variables with Eζ 1 = Var ζ 1 σ 2. Defie Z t = 1 a t ζ i a i=1 Let at least oe of the followig coditios hold: (i) log a / ad sup E ζ 1 2+ε < for some ε >, (ii) for some β 1, a β / 2 β ad sup E exp α ζ 1 β < for some α >. The Z 1 obeys the LDP i D for the J 1 topology with rate fuctio 1 ẋ t 2 dt if x is absolutely cotiuous 2σ I X x 2 (6.8) ad x = otherwise The proof is i [15]. (Note that the case β = 1 which is ot icluded there is dealt with by the same argumet.) Theorem 6.2. Let N be defied by (6.6) ad (6.7). Let Var ξ 1 σ 2 ad Eξ 1 λ 1 as. Assume that at least oe of the followig coditios hold: (i) log a / ad sup Eξ 2+ε 1 < for some ε >, (ii) for some β 1, a β / 2 β ad sup E exp αξ β 1 < for some α >.

15 376 A. A. PUHALSKII AND W. WHITT The a / N e Eξ obeys the LDP i D for the J 1 topology with rate fuctio 1 ẋ t 2 dt if x is absolutely cotiuous 2σ I N x 2 λ 3 (6.9) ad x = otherwise. Proof. By Lemmas 6.1 ad 4.1(b), the sequece a / X eeξ 1 a t 1, where X t = 1/a i=1 ξ i, obeys the LDP i D for the J 1 topology with rate fuctio I X from (6.8). The proof is completed by observig that, i aalogy with (6.3), N = X 1 a 1 ad applyig Theorem 5.4 ad Lemma 4.1(b) ad the cotractio priciple. Corollary. Uder the assumptios of Theorem 6 2 a / N 1 Eξ obeys the LDP i R with rate fuctio λ N z = z2 2σ 2 λ 3 z R Proof. Apply the exteded cotractio priciple with the projectio map. By (6.9), the resultig rate fuctio is λ N z = if I N x = z2 x D 2σ 2 λ 3 x 1 =z 7. Superpositios of reewal processes. The results i Sectio 6 exted easily to superpositios of reewal fuctios provided that the compoet rate fuctios are fiite oly for cotiuous fuctios x. Otherwise, we have the difficulty that additio is ot cotiuous o D D [28]. However, from Theorem 6.1 we see that i geeral the rate fuctios ca be fiite for discotiuous x. We avoid this problem by makig additioal assumptios, as i Remark 6.1. Let ξ j i i 1, 1 j k, be k idepedet sequeces of i.i.d. oegative radom variables with Eξ j 1 >. Let Nj t t, 1 j k, be the associated k mutually idepedet reewal coutig processes, defied as i (6.2), ad let N = N N k. For each j, let X j be the ormalized partial sum process defied as i (6.1) ad let X be the ormalized partial sum process associated with the superpositio process, defied by (7.1) t X t 1 i=1 ξ i t where ξ i is the ith iterval betwee poits i the superpositio process N. Let N j ad N be associated ormalized coutig processes; that is, (7.2) N j t 1 N j t ad N t 1 N t t

16 FIRST-PASSAGE-TIME PROCESSES 377 We will derive LDP s for N 1 ad X 1. For this purpose, ote that N j t = X j 1 t 1, so that (7.3) ad (7.4) N j = Xj 1 1 N = X 1 X = N The followig theorem exteds Theorem Theorem 7.1. Assume that E exp αξ j 1 <, 1 j k, for some α >. Let α j sup α E exp αξj 1 < 1 j k ad α = k j=1 α j. Also assume that P ξ j 1 = = for all j, 1 j k. The the sequece N 1 i (7.2) obeys the LDP i E for the J 1 topology with rate fuctio (7.5) I N x = sup α ẋ t ψ α dt α<α (7.6) where (7.7) = ψ α = φ 1 α φ α = sup φ α αẋ t dt α<α k φ j α j=1 φ j α = ψj 1 α (7.8) α = mi lim 1 j k α α j ψ j α with ψ j α = log E exp αξ j 1 if x is absolutely cotiuous ad x =, while I N x = otherwise. If i additio there is oe j for which E exp αξ j 1 < for all α, the X 1 i (7.1) obeys the LDP i E for the J 1 topology with rate fuctio (7.9) I X x = I N x 1 = = sup αẋ t ψ α dt α R sup ẋ t φ α α dt α R if x is absolutely cotiuous with x =, ad I X x = otherwise. Proof. Sice the ormalized processes N j are idepedet, by Theorem 6.1 ad [9] the sequece N 1 N2 Nk 1 of radom elemets of D R k obeys the LDP for the J 1 topology with rate fuctio (7.1) I x 1 x k k j=1 sup α<α j α ẋ j t ψ j α dt whe x 1 x k are absolutely cotiuous with respect to Lebesgue measure ad x j = for all j, while I x 1 x k = otherwise. We start workig toward the first expressio i (7.5).

17 378 A. A. PUHALSKII AND W. WHITT By the exteded cotractio priciple, the superpositio N obeys the LDP for the J 1 topology with rate fuctio I N x, where I N x = if x is ot absolutely cotiuous or x. Usig a argumet as i [18] (icludig a miimax theorem o the third lie), if x is absolutely cotiuous ad x =, the (7.11) I N x = = = = if x 1 + +x k =x k j=1 if kj=1 ẋ j t =ẋ t sup α j <α j j=1 k sup α j <α j j=1 k sup α ẋ j t ψ j α dt α<α j { k sup α j <α j j=1 j=1 k { k if kj=1 ẋ j t =ẋ t j=1 { k α j α j α j ẋ t max j=1 k j=1 The required ow follows sice { ψ α = if max ψ j α j 1 j k k j=1 k j=1 } ẋ j t ψ j α j dt } ẋ j t ψ j α j dt } ψ j α j dt } k α j = α α j < α j with beig the ifimum over the empty set. [The ifimum is attaied at poits α j for which all the ψ j α j are equal, for if we have that ψ j α j > ψ j α j we ca make α j smaller ad α j larger keepig their sum uchaged.] The equality (7.6) is obvious. Turig to X, we observe that α = if there is a j for which E exp αξ j 1 < for all α >. Hece the local rate fuctio i (7.5) is at, ad a applicatio of Theorem 3.4 completes the proof. The secod equality agai is obvious. j=1 We ow establish a extesio of Theorem 6.2. Theorem 7.2. Let N t j t j = 1 k 1, be a sequece of k-tuples of idepedet reewal processes. Let ξ j i i 1 j = 1 k deote their respective iterreewal times. Assume that Var ξ j 1 σ2 j ad Eξ j 1 λ 1 j for j = 1 k as. Assume that oe of the coditios (i) or (ii) i Theorem 6.2 holds for all j, 1 j k. The the sequece a / N e k j=1 Eξ j 1 1, 1, where N t = 1/a kj=1 N a j t, obeys the LDP i D for the J 1 topology with rate fuctio (7.12) I N x 1 2 ( k σj 2 λ3 j j=1 ) 1 ẋ t 2 dt

18 FIRST-PASSAGE-TIME PROCESSES 379 for absolutely cotiuous x with x =, ad I N x = otherwise. Moreover, if ξ i i 1 are the times betwee evets i the superpositio process k j=1 N j a t ad X t = 1/a i=1 ξ i, the a / X e k j=1 Eξ j obeys the LDP i D for the J 1 topology with rate fuctio (7.13) ( k ) 3 ( k ) 1 I X x 1 λ 2 j σj 2 λ3 j ẋ t 2 dt j=1 j=1 for absolutely cotiuous x with x =, ad I X x = otherwise. Proof. By Theorem 6.2 ad i aalogy with the proof of Theorem 7.1, the sequece of processes a / N e k j=1 Eξ j i 1 1 obeys the LDP for the J 1 topology with rate fuctio I N x, which for absolutely cotiuous x has the form I N x = if k 1 x 1 + +x k =x j=1 2σj 2λ3 j = 1 2 = 1 2 ( k if k kj=1 ẋ j t =ẋ t j=1 σj 2λ3 j σj 2 λ3 j j=1 ẋ j t 2 dt 1 ) 1 ẋ t 2 dt ẋ j t 2 dt with the last lie followig from the Cauchy Schwarz iequality. By Theorem 5.4 ad Lemma 4.1(b), a correspodig limit holds for X. Remark. (7.14) The rate fuctios I N i (7.12) ad I X i (7.13) have the form I x = 1 2γ ẋ t 2 dt where γ is the asymptotic variace of the processes k j=1 N j ad X, respectively; that is, for (7.12), while for (7.13), k γ = lim a 1 Var N j a j=1 γ = lim a 1 a Var ξ i that is, the costat γ is the same as appears i the cetral limit theorems. The form of the coefficiet i the rate fuctio as a limit variace is typical i=1

19 38 A. A. PUHALSKII AND W. WHITT whe oe deals with quadratic rate fuctios (cf. [15], Corollaries 6.3, 6.4 ad 6.7). Ackowledgmet. The secod author was partly supported i this work by AT&T Bell Laboratories. REFERENCES [1] Billigsley, P. (1968). Covergece of Probability Measures. Wiley, New York. [2] Deuschel, J. D. ad Stroock, D. W. (1989). Large Deviatios. Academic Press, New York. [3] Gly, P. W. ad Whitt, W. (1994). Large deviatio behavior of coutig processes ad their iverses. Queueig Systems [4] Gly, P. W. ad Whitt, W. (1994). Logarithmic asymptotics for steady-state tail probabilities i a sigle-server queue. J. Appl. Probab. 31A [5] Iglehart, D. L. ad Whitt, W. (197). Multiple chael queues i heavy traffic, I ad II. Adv. i Appl. Probab ad [6] Iglehart, D. L. ad Whitt, W. (1971). The equivalece of fuctioal cetral limit theorems for coutig processes ad associated partial sums. A. Math. Statist [7] Lidvall, T. (1973). Weak covergece of probability measures ad radom fuctios i the fuctio space D. J. Appl. Probab [8] Liptser, R. Sh. ad Shiryaev, A. N. (1989). Theory of Martigales. Kluwer, Dordrecht. [9] Lych, J. ad Sethurama, J. (1987). Large deviatios for processes with idepedet icremets. A. Probab [1] Mogulskii, A. A. (1976). Large deviatios for trajectories of multidimesioal radom walks. Theory Probab. Appl [11] Mogulskii, A. A. (1993). Large deviatios for processes with idepedet icremets. A. Probab [12] Pomarede, J. L. (1976). A uified approach via graphs to Skorohod s topologies o the fuctio space D. Ph.D. dissertatio, Dept. Statistics, Yale Uiv. [13] Puhalskii, A. (1991). O fuctioal priciple of large deviatios. I New Treds i Probability ad Statistics (V. Sazoov ad T. Shervashidze, eds.) VSP/Mokslas. [14] Puhalskii, A. (1993). O the theory of large deviatios. Theory Probab. Appl [15] Puhalskii, A. (1994). Large deviatios of semimartigales via covergece of the predictable characteristics. Stochastics [16] Puhalskii, A. (1994). The method of stochastic expoetials for large deviatios. Stochastic Process. Appl [17] Puhalskii, A. (1994). O the ivariace priciple for the first passage time. Math. Oper. Res [18] Puhalskii, A. (1995). Large deviatio aalysis of the sigle server queue. Queueig Systems [19] Puhalskii, A. (1995). Large deviatios of semimartigales: a maxigale problem approach. I. Limits as solutios to a maxigale problem. Upublished mauscript. [2] Puhalskii, A. ad Whitt, W. (1996). Fuctioal large deviatio priciples for queues. I Proceedigs of the 34th Allerto Coferece o Commuicatio, Cotrol ad Computig. Uiv. Illiois, Urbaa. To appear. [21] Puhalskii, A. ad Whitt, W. (1996). Fuctioal large deviatio priciples for waitig ad departure processes i sigle-server queues. Upublished mauscript. [22] Skorohod, A. V. (1956). Limit theorems for stochastic processes. Theory Probab. Appl [23] Varadha, S. R. S. (1966). Asymptotic probabilities ad differetial equatios. Comm. Pure Appl. Math [24] Varadha, S. R. S. (1984). Large Deviatios ad Applicatios. SIAM, Philadelphia. [25] Vervaat, W. (1972). Fuctioal cetral limit theorems for processes with positive drift ad their iverses. Z. Wahrsch. Verw. Gebiete

20 FIRST-PASSAGE-TIME PROCESSES 381 [26] Wetzell, A. D. (1986). Limit Theorems o Large Deviatios for Markov Radom Processes. Nauka, Moscow (i Russia; Eglish traslatio, Reidel, 1989). [27] Whitt, W. (1971). Weak covergece of first passage time processes. J. Appl. Probab [28] Whitt, W. (198). Some useful fuctios for fuctioal limit theorems. Math. Oper. Res [29] Zajic, T. R. (1993). Large deviatios for sample path processes ad applicatios. Ph.D. dissertatio, Dept. Operatios Research, Staford Uiv. Istitute for Problems i Iformatio Trasmissio 19 Bolshoi Karetii Moscow Russia pukh@ippi.ac.msk.su AT&T Bell Laboratories Room 2C-178 Murray Hill, New Jersey wow@research.att.com

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

FLUID LIMIT FOR CUMULATIVE IDLE TIME IN MULTIPHASE QUEUES. Akademijos 4, LT-08663, Vilnius, LITHUANIA 1,2 Vilnius University

FLUID LIMIT FOR CUMULATIVE IDLE TIME IN MULTIPHASE QUEUES. Akademijos 4, LT-08663, Vilnius, LITHUANIA 1,2 Vilnius University Iteratioal Joural of Pure ad Applied Mathematics Volume 95 No. 2 2014, 123-129 ISSN: 1311-8080 (prited versio); ISSN: 1314-3395 (o-lie versio) url: http://www.ijpam.eu doi: http://dx.doi.org/10.12732/ijpam.v95i2.1

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

Singular Continuous Measures by Michael Pejic 5/14/10

Singular Continuous Measures by Michael Pejic 5/14/10 Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable

More information

Measure and Measurable Functions

Measure and Measurable Functions 3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies

More information

Notes 19 : Martingale CLT

Notes 19 : Martingale CLT Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales.

An alternative proof of a theorem of Aldous. concerning convergence in distribution for martingales. A alterative proof of a theorem of Aldous cocerig covergece i distributio for martigales. Maurizio Pratelli Dipartimeto di Matematica, Uiversità di Pisa. Via Buoarroti 2. I-56127 Pisa, Italy e-mail: pratelli@dm.uipi.it

More information

Application to Random Graphs

Application to Random Graphs A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

Lecture Notes for Analysis Class

Lecture Notes for Analysis Class Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

MAS111 Convergence and Continuity

MAS111 Convergence and Continuity MAS Covergece ad Cotiuity Key Objectives At the ed of the course, studets should kow the followig topics ad be able to apply the basic priciples ad theorems therei to solvig various problems cocerig covergece

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

Lecture 3 : Random variables and their distributions

Lecture 3 : Random variables and their distributions Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}

More information

The Wasserstein distances

The Wasserstein distances The Wasserstei distaces March 20, 2011 This documet presets the proof of the mai results we proved o Wasserstei distaces themselves (ad ot o curves i the Wasserstei space). I particular, triagle iequality

More information

Math Solutions to homework 6

Math Solutions to homework 6 Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there

More information

Complex Analysis Spring 2001 Homework I Solution

Complex Analysis Spring 2001 Homework I Solution Complex Aalysis Sprig 2001 Homework I Solutio 1. Coway, Chapter 1, sectio 3, problem 3. Describe the set of poits satisfyig the equatio z a z + a = 2c, where c > 0 ad a R. To begi, we see from the triagle

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

FUNDAMENTALS OF REAL ANALYSIS by

FUNDAMENTALS OF REAL ANALYSIS by FUNDAMENTALS OF REAL ANALYSIS by Doğa Çömez Backgroud: All of Math 450/1 material. Namely: basic set theory, relatios ad PMI, structure of N, Z, Q ad R, basic properties of (cotiuous ad differetiable)

More information

Probability for mathematicians INDEPENDENCE TAU

Probability for mathematicians INDEPENDENCE TAU Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

If a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?

If a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero? 2 Lebesgue Measure I Chapter 1 we defied the cocept of a set of measure zero, ad we have observed that every coutable set is of measure zero. Here are some atural questios: If a subset E of R cotais a

More information

Mi-Hwa Ko and Tae-Sung Kim

Mi-Hwa Ko and Tae-Sung Kim J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

The Central Limit Theorem

The Central Limit Theorem Chapter The Cetral Limit Theorem Deote by Z the stadard ormal radom variable with desity 2π e x2 /2. Lemma.. Ee itz = e t2 /2 Proof. We use the same calculatio as for the momet geeratig fuctio: exp(itx

More information

Lecture 2. The Lovász Local Lemma

Lecture 2. The Lovász Local Lemma Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio

More information

Beurling Integers: Part 2

Beurling Integers: Part 2 Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers

More information

Asymptotic distribution of products of sums of independent random variables

Asymptotic distribution of products of sums of independent random variables Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege

More information

On forward improvement iteration for stopping problems

On forward improvement iteration for stopping problems O forward improvemet iteratio for stoppig problems Mathematical Istitute, Uiversity of Kiel, Ludewig-Mey-Str. 4, D-24098 Kiel, Germay irle@math.ui-iel.de Albrecht Irle Abstract. We cosider the optimal

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.

More information

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios

More information

Introduction to Probability. Ariel Yadin

Introduction to Probability. Ariel Yadin Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.

1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series. .3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

STA Object Data Analysis - A List of Projects. January 18, 2018

STA Object Data Analysis - A List of Projects. January 18, 2018 STA 6557 Jauary 8, 208 Object Data Aalysis - A List of Projects. Schoeberg Mea glaucomatous shape chages of the Optic Nerve Head regio i aimal models 2. Aalysis of VW- Kedall ati-mea shapes with a applicatio

More information

Real Numbers R ) - LUB(B) may or may not belong to B. (Ex; B= { y: y = 1 x, - Note that A B LUB( A) LUB( B)

Real Numbers R ) - LUB(B) may or may not belong to B. (Ex; B= { y: y = 1 x, - Note that A B LUB( A) LUB( B) Real Numbers The least upper boud - Let B be ay subset of R B is bouded above if there is a k R such that x k for all x B - A real umber, k R is a uique least upper boud of B, ie k = LUB(B), if () k is

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Math 341 Lecture #31 6.5: Power Series

Math 341 Lecture #31 6.5: Power Series Math 341 Lecture #31 6.5: Power Series We ow tur our attetio to a particular kid of series of fuctios, amely, power series, f(x = a x = a 0 + a 1 x + a 2 x 2 + where a R for all N. I terms of a series

More information

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1 Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

An Introduction to Asymptotic Theory

An Introduction to Asymptotic Theory A Itroductio to Asymptotic Theory Pig Yu School of Ecoomics ad Fiace The Uiversity of Hog Kog Pig Yu (HKU) Asymptotic Theory 1 / 20 Five Weapos i Asymptotic Theory Five Weapos i Asymptotic Theory Pig Yu

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

On Weak and Strong Convergence Theorems for a Finite Family of Nonself I-asymptotically Nonexpansive Mappings

On Weak and Strong Convergence Theorems for a Finite Family of Nonself I-asymptotically Nonexpansive Mappings Mathematica Moravica Vol. 19-2 2015, 49 64 O Weak ad Strog Covergece Theorems for a Fiite Family of Noself I-asymptotically Noexpasive Mappigs Birol Güdüz ad Sezgi Akbulut Abstract. We prove the weak ad

More information

Empirical Processes: Glivenko Cantelli Theorems

Empirical Processes: Glivenko Cantelli Theorems Empirical Processes: Gliveko Catelli Theorems Mouliath Baerjee Jue 6, 200 Gliveko Catelli classes of fuctios The reader is referred to Chapter.6 of Weller s Torgo otes, Chapter??? of VDVW ad Chapter 8.3

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

Hyun-Chull Kim and Tae-Sung Kim

Hyun-Chull Kim and Tae-Sung Kim Commu. Korea Math. Soc. 20 2005), No. 3, pp. 531 538 A CENTRAL LIMIT THEOREM FOR GENERAL WEIGHTED SUM OF LNQD RANDOM VARIABLES AND ITS APPLICATION Hyu-Chull Kim ad Tae-Sug Kim Abstract. I this paper we

More information

Riesz-Fischer Sequences and Lower Frame Bounds

Riesz-Fischer Sequences and Lower Frame Bounds Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.

More information

A Proof of Birkhoff s Ergodic Theorem

A Proof of Birkhoff s Ergodic Theorem A Proof of Birkhoff s Ergodic Theorem Joseph Hora September 2, 205 Itroductio I Fall 203, I was learig the basics of ergodic theory, ad I came across this theorem. Oe of my supervisors, Athoy Quas, showed

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Properties of Fuzzy Length on Fuzzy Set

Properties of Fuzzy Length on Fuzzy Set Ope Access Library Joural 206, Volume 3, e3068 ISSN Olie: 2333-972 ISSN Prit: 2333-9705 Properties of Fuzzy Legth o Fuzzy Set Jehad R Kider, Jaafar Imra Mousa Departmet of Mathematics ad Computer Applicatios,

More information

6a Time change b Quadratic variation c Planar Brownian motion d Conformal local martingales e Hints to exercises...

6a Time change b Quadratic variation c Planar Brownian motion d Conformal local martingales e Hints to exercises... Tel Aviv Uiversity, 28 Browia motio 59 6 Time chage 6a Time chage..................... 59 6b Quadratic variatio................. 61 6c Plaar Browia motio.............. 64 6d Coformal local martigales............

More information

Notes 27 : Brownian motion: path properties

Notes 27 : Brownian motion: path properties Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Mathematical Methods for Physics and Engineering

Mathematical Methods for Physics and Engineering Mathematical Methods for Physics ad Egieerig Lecture otes Sergei V. Shabaov Departmet of Mathematics, Uiversity of Florida, Gaiesville, FL 326 USA CHAPTER The theory of covergece. Numerical sequeces..

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

f n (x) f m (x) < ɛ/3 for all x A. By continuity of f n and f m we can find δ > 0 such that d(x, x 0 ) < δ implies that

f n (x) f m (x) < ɛ/3 for all x A. By continuity of f n and f m we can find δ > 0 such that d(x, x 0 ) < δ implies that Lecture 15 We have see that a sequece of cotiuous fuctios which is uiformly coverget produces a limit fuctio which is also cotiuous. We shall stregthe this result ow. Theorem 1 Let f : X R or (C) be a

More information

A REMARK ON A PROBLEM OF KLEE

A REMARK ON A PROBLEM OF KLEE C O L L O Q U I U M M A T H E M A T I C U M VOL. 71 1996 NO. 1 A REMARK ON A PROBLEM OF KLEE BY N. J. K A L T O N (COLUMBIA, MISSOURI) AND N. T. P E C K (URBANA, ILLINOIS) This paper treats a property

More information

Regression with an Evaporating Logarithmic Trend

Regression with an Evaporating Logarithmic Trend Regressio with a Evaporatig Logarithmic Tred Peter C. B. Phillips Cowles Foudatio, Yale Uiversity, Uiversity of Aucklad & Uiversity of York ad Yixiao Su Departmet of Ecoomics Yale Uiversity October 5,

More information

An almost sure invariance principle for trimmed sums of random vectors

An almost sure invariance principle for trimmed sums of random vectors Proc. Idia Acad. Sci. Math. Sci. Vol. 20, No. 5, November 200, pp. 6 68. Idia Academy of Scieces A almost sure ivariace priciple for trimmed sums of radom vectors KE-ANG FU School of Statistics ad Mathematics,

More information

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n

We are mainly going to be concerned with power series in x, such as. (x)} converges - that is, lims N n Review of Power Series, Power Series Solutios A power series i x - a is a ifiite series of the form c (x a) =c +c (x a)+(x a) +... We also call this a power series cetered at a. Ex. (x+) is cetered at

More information

lim za n n = z lim a n n.

lim za n n = z lim a n n. Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget

More information

McGill University Math 354: Honors Analysis 3 Fall 2012 Solutions to selected problems

McGill University Math 354: Honors Analysis 3 Fall 2012 Solutions to selected problems McGill Uiversity Math 354: Hoors Aalysis 3 Fall 212 Assigmet 3 Solutios to selected problems Problem 1. Lipschitz fuctios. Let Lip K be the set of all fuctios cotiuous fuctios o [, 1] satisfyig a Lipschitz

More information

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution

Discrete-Time Systems, LTI Systems, and Discrete-Time Convolution EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [

More information

A Hadamard-type lower bound for symmetric diagonally dominant positive matrices

A Hadamard-type lower bound for symmetric diagonally dominant positive matrices A Hadamard-type lower boud for symmetric diagoally domiat positive matrices Christopher J. Hillar, Adre Wibisoo Uiversity of Califoria, Berkeley Jauary 7, 205 Abstract We prove a ew lower-boud form of

More information

The Choquet Integral with Respect to Fuzzy-Valued Set Functions

The Choquet Integral with Respect to Fuzzy-Valued Set Functions The Choquet Itegral with Respect to Fuzzy-Valued Set Fuctios Weiwei Zhag Abstract The Choquet itegral with respect to real-valued oadditive set fuctios, such as siged efficiecy measures, has bee used i

More information

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

Rademacher Complexity

Rademacher Complexity EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for

More information

ON POINTWISE BINOMIAL APPROXIMATION

ON POINTWISE BINOMIAL APPROXIMATION Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

y X F n (y), To see this, let y Y and apply property (ii) to find a sequence {y n } X such that y n y and lim sup F n (y n ) F (y).

y X F n (y), To see this, let y Y and apply property (ii) to find a sequence {y n } X such that y n y and lim sup F n (y n ) F (y). Modica Mortola Fuctioal 2 Γ-Covergece Let X, d) be a metric space ad cosider a sequece {F } of fuctioals F : X [, ]. We say that {F } Γ-coverges to a fuctioal F : X [, ] if the followig properties hold:

More information

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1 8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Law of the sum of Bernoulli random variables

Law of the sum of Bernoulli random variables Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Solution to Chapter 2 Analytical Exercises

Solution to Chapter 2 Analytical Exercises Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =

More information

On the convergence rates of Gladyshev s Hurst index estimator

On the convergence rates of Gladyshev s Hurst index estimator Noliear Aalysis: Modellig ad Cotrol, 2010, Vol 15, No 4, 445 450 O the covergece rates of Gladyshev s Hurst idex estimator K Kubilius 1, D Melichov 2 1 Istitute of Mathematics ad Iformatics, Vilius Uiversity

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Math 299 Supplement: Real Analysis Nov 2013

Math 299 Supplement: Real Analysis Nov 2013 Math 299 Supplemet: Real Aalysis Nov 203 Algebra Axioms. I Real Aalysis, we work withi the axiomatic system of real umbers: the set R alog with the additio ad multiplicatio operatios +,, ad the iequality

More information

5.1. The Rayleigh s quotient. Definition 49. Let A = A be a self-adjoint matrix. quotient is the function. R(x) = x,ax, for x = 0.

5.1. The Rayleigh s quotient. Definition 49. Let A = A be a self-adjoint matrix. quotient is the function. R(x) = x,ax, for x = 0. 40 RODICA D. COSTIN 5. The Rayleigh s priciple ad the i priciple for the eigevalues of a self-adjoit matrix Eigevalues of self-adjoit matrices are easy to calculate. This sectio shows how this is doe usig

More information

REGRESSION WITH QUADRATIC LOSS

REGRESSION WITH QUADRATIC LOSS REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d

More information

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5

Ma 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5 Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information