Sojourn times in the M/G/1 FB queue with light-tailed service times

Size: px
Start display at page:

Download "Sojourn times in the M/G/1 FB queue with light-tailed service times"

Transcription

1 Sojour times i the M/G/ FB queue with light-tailed service times M. Madjes M. Nuyes arxiv:math/032444v2 [math.pr] 23 Feb 2004 September 22, 2008 Abstract The asymptotic decay rate of the sojour time of a customer i the statioary M/G/ queue uder the Foregroud Backgroud (FB) service disciplie is studied. The FB disciplie gives service to those customers that have received the least service so far. We prove that for light-tailed service times the decay rate of the sojour time is equal to the decay rate of the busy period. It is show that FB miimises the decay rate i the class of work-coservig disciplies. Keywords: decay rate, sojour time, Foregroud Backgroud (FB), service disciplie, light tails, busy period AMS 2000 Subject Classificatio: Primary 60K25, Secodary 68M20; 90B22 Itroductio The sojour time of a customer, i.e. the time betwee his arrival ad departure, is a ofte used performace measure for queues. I this ote we study the asymptotic decay rate of the tail of the sojour-time distributio of the statioary M/G/ queue with the Foregroud Backgroud (FB) disciplie. The FB disciplie gives service to those customers who have received the least amout of service so far. If there are such customers, each of them is served at rate /. thus, whe the age of a customer is the CWI, 090 GB Amsterdam, The Netherlads, ad, Uiversity of Twete, Faculty of Mathematical Scieces, 7500 AE Eschede, The Netherlads KdV Istitute for Mathematics, Uiversity of Amsterdam, Platage Muidergracht 24, 08 TV, Amsterdam, The Netherlads

2 amout of service a customer has received, the FB disciplie gives priority to the yougest customers. Let V deote the sojour time of a customer i the statioary M/G/ FB queue, i.e. the time betwee his arrival ad departure. Núñez Queija [6] showed that for servicetime distributios with regularly varyig tails of ide η (, 2), the distributio of V satisfies P(V > ) P(B > ( ρ)),, () where ρ is the load of the system ad B is the geeric service time. Usig Núñez Queija s method, Nuyes [7] obtaied () uder weaker assumptios. I case of regularly varyig service times the tail behaviour of V uder other disciplies, like FIFO, LIFO, PS ad SRPT, has bee foud to be the same or worse, see Borst et al. []. Additioal support for the optimality of FB uder heavy tails is give by Righter ad Shathikumar [8, 9, 0]. They show that for certai classes of service times the FB disciplie miimises the queue legth, measured i umber of customers. For light-tailed service times, however, the FB disciplie does ot perform so well. For epoetial service times (ad also for a subclass of Gamma-distributed service times ) FB still miimises the queue legth, but for service times with a log-cocave desity the queue shows opposite behaviour ad the queue legth is maimal, see Righter ad Shathikumar [8], [9], [0]. This udesirable behaviour of the FB disciplie is very proouced for determiistic service times. I this etreme case i the FB queue all customers stay till the ed of the busy period. Hece the sojour time is maimal i the class of all work-coservig disciplies. I this ote we cosider the (asymptotic) decay rate of the sojour time, defied as follows. Furthermore, let the (asymptotic) decay rate of a radom variable X be defied by lim log P(X > ). The it may be see that i the M/D/ FB queue the sojour time ad the busy-period legth have the same decay rate. It turs out that this decay-rate property holds true for all service-time distributios with a epoetially fast decreasig tail, i the followig sese. Assume that the service times have a fiite epoetial momet, or equivaletly, the Laplace trasform is aalytic i a eighbourhood of zero. The mai theorem of this ote is the followig. Theorem Let V be the sojour time of a customer i the statioary M/G/ FB queue, ad let L be the legth of a busy period. If the service-time distributio has a fiite epoetial momet, the the followig limits eist ad lim log P(V > ) = lim log P(L > ). (2) 2

3 It is show below that the decay rate of V for ay work-coservig disciplie is bouded by the decay rate of the residual life of a busy period. For service times with a epoetial momet the latter decay rate is equal to that of a ormal busy period. Hece (2) is the lowest possible decay rate for a work-coservig disciplie. Usig the decay rate of V as a criterio to measure the performace of a service disciplie the leads to the followig coclusio. For service times with a epoetial momet, the FB disciplie is the worst disciplie i the class of work-coservig disciplies w.r.t. the decay rate of the sojour time. The chapter is orgaised as follows. I Sectio 2 we preset the otatio, some prelimiaries, ad show that the decay rate of the sojour time uder FB is pessimal, as described above. I Sectio 3 Theorem is proved. Sectio 4 discusses the result ad the decay rate of the sojour time i queues operatig uder other service disciplies. 2 Prelimiaries Throughout this ote we assume that the geeric service time B with distributio fuctio F i the M/G/ queue satisfies the followig assumptio. Assumptio 2 The geeric service time B has a epoetial momet, i.e. E ep(γb) < for some γ > 0. Let i additio the stability coditio ρ = λeb < hold, where λ is the rate of the Poisso arrival process. The proofs i this ote rely o some properties of the busyperiod legth L ad related radom variables, which we derive i this sectio. Uder assumptio 2, Co ad Smith [3] have show that P(L > ) b 3/2 e c for certai costats b, c > 0. I particular, L has decay rate c. I fact, by epressio (46) o page 54, c = λ ζ λg(ζ), where g is the Laplace trasform of the service-time distributio, ad ζ < 0 is such that g (ζ) = λ. Hece ζ is the root of the derivative of the fuctio m() = λ λg(). Sice m() attais its maimum i the poit ζ, we may write c i terms of the Legedre trasform of B, c = lim log P(L > ) = sup{θ λ(ee θb )}. (3) θ Remark Cosider a Poisso stream, with itesity λ, of i.i.d. jobs, where every job is distributed accordig to the radom variable B. Let A() deote the amout of work geerated i a arbitrary time widow of legth. It is a easy corollary of Cramér s 3

4 theorem that lim Notig that Ee θa() = log P(A() > ) = sup{θ log Ee θa() }. (4) θ k=0 ( ) k ( ) e λλk Ee θb = ep λ(ee θb ), k! we observe that P(L > ) ad P(A() > ) have the same decay rate. This is somewhat surprisig, as the evet {L > } relates to the arrival patter withi a iterval of legth (ad, i fact, also the jobs already preset at time 0), rather tha just A(). I reewal theory the otio of residual life, also kow as ecess or forward-recurrece time, is stadard. Let L be the residual life of a busy period. The P( L > ) = (EL) P(L > y)dy, see for istace Co [2]. Usig stadard calculus we fid lim log P( L > ) = lim log Hece L has the same decay rate as L. y 3/2 e cy dy = c. (5) Aother igrediet used i the proofs below is the M/G/ queue with trucated geeric service time B τ, τ > 0. Call this the τ-queue ad let L(τ) deote the legth of a busy period (a τ-busy period) i this queue. Let L(τ) be its the residual life ad defie L (τ) to be the legth of a τ-busy period that starts with a customer with service time at least τ, i.e. L (τ) = [L(τ) B τ]. These radom variables satisfy the followig relatio. Lemma 3 The radom variables L(τ), L(τ) ad L (τ) have the same decay rate c(τ), where c(τ) = lim log P(L(τ) > ). Proof Let B deote the first service time i the busy period, hece B d = B. The for τ such that P(B τ) > 0, P(B τ)p(l(τ) > B τ) = P(L(τ) >, B τ) P(L(τ) > ) P(L(τ) > B τ) = P(L (τ) > ), (6) where the iequality follows from the observatio that the value of B is maimal i the τ- queue, sice all service times are bouded by τ. The for every τ such that P(B τ) > 0, 4

5 we have by (5) ad (6) c(τ) = lim log P(L(τ) > ) = lim log P(L (τ) > ) = lim log P( L(τ) > ), (7) which was to be show. I this ote we eed the followig lemma about the decay rate of the sum of two idepedet radom variables. Lemma 4 Let X ad Y be o-egative, idepedet radom variables such that lim log P(X > ) = lim log P(Y > ) = c for some c > 0. The also lim log P(X + Y > ) = c. Proof The lower boud for the limif is obvious. For the upper boud let N be fied. Clearly, P(X + Y > ) i=0 ( P X i ) ( P Y ( i ) ). Fi ε > 0. For sufficietly large, for all i {0,..., }, Hece, ( P X i ) ( P Y lim sup ( i ) ) ( ep ( = ep (c ε) i (c ε) i ) (c ε) ( ) ). ( log P(X + Y > ) (c ε) ). (8) Sice (8) holds for every N ad ε > 0, we may take the limits ad ε 0, ad the result follows. Propositio 5 Whe a customer eters a statioary work-coservig queue, the time D till the system is empty agai satisfies D d = A L+L, where L is distributed like the residual life of a busy period, L is a ormal busy period legth, P(A = ) = ρ = P(A = 0) ad A, L ad L are idepedet. 5

6 Proof The radom variable D is idepedet of the service disciplie, ad ca be decomposed as follows. The customer fids the system empty with probability ρ. I that case D is just the legth L of the busy period started by the customer. If our customer eters a busy system, the the server may first fiish all the work i the system apart from the work of our tagged customer, see the Figure below. The momet this remaiig busy period of legth L is fiished, our customer starts a sub-busy period which is distributed like a ormal busy period L ad is idepedet of L. After this sub-busy period the system is empty agai. workload 0 L L + L time Figure A realisatio of the workload process Hece D = d A L + L, where L is the residual life of a busy period, L is a ormal busy period, P(A = ) = ρ = P(A = 0) ad A, L ad L are idepedet. For the τ-queue we have the followig corollary. Corollary 6 I the statioary τ-queue, the time D from the etrace of a customer till the system is empty agai satisfies D d = A L(τ) + L(τ). If the customer has service time τ, the D d = A L(τ) + L (τ). Sice the system is work-coservig, the sojour time of a customer is ot loger tha D, where D is the time till the system is empty agai. Hece V st D for every service disciplie. Sice A L ad L satisfy the coditios of Lemma 4, the followig corollary holds. Corollary 7 For every work-coservig service disciplie the sojour time V of a customer i the statioary queue satisfies lim sup log P(V > ) lim log P(A L + L > ) = c 6

7 Corollary 8 For service times with a epoetial momet, the FB disciplie miimises the decay rate of the sojour time i the class of work-coservig disciplies. I Sectio 4 we show that there are service disciplies with a strictly larger decay rate, e.g. FIFO. Iterestigly, for a subclass of Gamma-distributed service times the FB disciplie miimises the queue legth, but the sojour time has the smallest decay rate. This shows that optimisig oe characteristic i a queue may have a ill effect o other characteristics. The eistece of a fiite epoetial momet i the corollary is crucial: for heavytailed service times the tail of V caot be bouded by that of L. For eample, i the M/G/ FIFO queue with service times satisfyig P(B > ) = ν L(), where L() is a slowly varyig fuctio at ad ν >, De Meyer ad Teugels [4] showed that P(L > ) ( ρ) ν ν L(). It may be see that i this case the tail of L is oe degree heavier tha that of L. Now ote that for the FIFO disciplie we have V A L. Hece the tail of V is at least oe degree heavier tha that of L, see also Borst et al. [] for further refereces. I the lighttailed case this pheomeo is abset sice the tails of L ad L have the same decay rate. 3 Results The results i this sectio rely o the followig decompositio of V. Let V (τ) is the sojour time i the statioary queue of a customer with service time τ. The sojour time V of a arbitrary customer i the statioary queue satisfies P(V > ) = P(V (τ) > )df(τ). (9) Here F is the service-time distributio. Hece we may write P(V > ) = E B P(V (B) > ), where B is a geeric service time idepedet of V (τ), ad E B deotes the epectatio w.r.t. B. Theorem is proved usig this represetatio of V. I the et lemma we compute the decay rate of V (τ). Propositio 9 Let V (τ) be the sojour time of a customer with service time τ i the statioary queue. If the service-time distributio satisfies Assumptio 2, the for τ > 0, lim log P(V (τ) > ) = c(τ), 7

8 where c(τ) = lim log P(L(τ) > ). (0) Proof By the ature of the FB disciplie, the sojour time V (τ) of a customer with service time τ who eters a statioary queue is the time till the first epoch that o customers youger tha τ are preset. This is the time till the ed of the τ-busy period that he either fids i the τ-queue, or starts. By Corollary 6, V (τ) the satisfies V (τ) d = A(τ) L(τ) + L (τ), where L(τ) is the residual life of a τ-busy period, L (τ) is a τ busy period that starts with a customer with service time τ, P(A(τ) = ) = P(A(τ) = 0) = λe(b τ) ad A(τ), L(τ) ad L (τ) are idepedet. By (7) the radom variables A(τ) L(τ) ad L (τ) satisfy the coditio of Lemma 4. Hece lim log P(V (τ) > ) = lim log P(A(τ) L(τ) + L (τ) > ) = c(τ). () This fiishes the proof. The followig lemma provides the basis for fidig the eeded lower boud for the decay rate. The edpoit of the service-time distributio F is defied as F = if{u 0 : F(u) = }. Lemma 0 Let V be the sojour time of a customer i the statioary queue. Suppose the service-time distributio satisfies Assumptio 2. If τ 0 > 0 ad P(B τ 0 ) > 0, the lim if log P(V > ) P(B τ 0) F Here F is the distributio fuctio of the geeric service time B. τ 0 c(τ)df(τ). (2) Proof Let B 0 ad V deote the service time ad the sojour time of a customer i the statioary queue. Let τ 0 > 0 be such that P(B 0 τ 0 ) > 0. The P(V > ) P(V >, B 0 τ 0 ) = P(V > B 0 τ 0 )P(B 0 τ 0 ). (3) Usig the represetatio (9), we fid log P(V > B 0 τ 0 ) = log E B0 [P(V > ) B 0 τ 0 ]. (4) Sice log is a cocave fuctio, applyig Jese s iequality to the coditioal epectatio i (4) yields log E B0 [P(V > ) B 0 τ 0 ] E B0 [ log P(V > ) B 0 τ 0 ]. (5) 8

9 From (3), (4) ad (5) it follows that Θ := lim if log P(V > ) satisfies Θ lim if log F τ 0 log P(V (τ) > )df(τ)/( F(τ 0 )). (6) To iterchage limit ad itegral, we show that the itegrad is bouded ad the apply the Domiated covergece theorem. Sice lim log P(V (τ 0) > ) = c(τ 0 ) <, there is a γ R such that log P(V (τ 0) > ) < γ for all say. Sice log P(V (τ) > ) is decreasig i τ, the iequality log P(V (τ) > ) < γ holds for all τ τ 0 ad. From (6) it the follows Θ P(B τ 0 ) F which was to be show. τ 0 lim log P(V (τ) > )df(τ), Lemma Let c(τ) = lim log P(L(τ) > ). The c(τ) is decreasig i τ. Furthermore c(τ) c( F ) as τ F, where c( F ) = c. Proof The fuctio h τ (θ) = θ λ(ee θ(b τ) ) is cocave sice ay momet geeratig fuctio is cove. Furthermore lim θ h τ (θ) = lim θ h τ (θ) =. By defiitio of L(τ) ad (3), we may write c(τ) = sup θ {h τ (θ)}. The c(τ) is decreasig i τ, sice h τ (θ) is decreasig i τ. Sice c(τ) h τ (0) = 0 for all τ, ad c(τ) is decreasig, c(τ) coverges for τ F. Now ote that h τ (θ) is cotiuous i τ for all θ [0, sup{η : Ee ηb < }), eve if B has a discrete distributio. Sice the supremum of θ λ(ee θb ) is attaied i this iterval, we have lim τ F c(τ) = c( F ). Propositio 2 Let V be the sojour time of a customer i the statioary queue. If the service-time distributio satisfies Assumptio 2, the where lim if log P(V > ) c, (7) c = lim log P(L > ). Proof If P(B = F ) > 0, the choosig τ 0 = F i (2) yields lim if log P(V > ) c( F) = c ad (7) holds. Let ε > 0. If P(B = F ) = 0, the by Lemma there eists a (ε) < F such that c(u) c + ε for all u (ε). Choosig τ 0 = (ε) i (2) the yields lim if log P(V > ) P(B (ε)) F (ε) P(B (ε)) F 9 (ε) c(τ)df(τ) (c + ε)df(τ) = c ε.

10 Sice ε > 0 was arbitrary, the lower boud (7) follows. Proof of Theorem The upper boud is established i Corollary 7 ad the lower boud i Propositio 2. 4 Discussio The decay rate of V i the M/G/ FB queue is the same as for the preemptive LIFO queue. Ideed, the sojour time of a customer i the statioary M/G/ queue uder the preemptive LIFO disciplie is just the legth of the sub-busy period started by that customer. The sojour time of a customer i the statioary queue uder FIFO satisfies V = B + W, where W is the statioary workload. The decay rate of W is the positive root θ 0 of h(θ) = θ λ(ee θb ). Sice h(0) = 0, h (0) = λeb < ad h is cocave, we have c FB := c = sup θ h(θ) < θ 0, see also Figure 4 below. Furthermore, θ 0 is strictly smaller tha the decay rate c B of the geeric service time B, which is give by c B = if{θ : h(θ) = }. A aalogue of Lemma 4 yields that the decay rate c FIFO of the sojour time i the FIFO system is strictly larger tha c. Madjes e Zwart [5] cosider the PS queue with light-tailed service requests. They show that the decay rate of P(V > ) is c, uder the additioal requiremet that, for ay positive costat k, lim log P(B > k log ) = 0. For determiistic requests, clearly this criterio is ot met. Ideed, i [5] it is show that the decay rate i the M/D/ queue with PS is larger tha c. h(θ) 0 c, c FB c FIFO c B θ Figure 2 The decay rates of the sojour time uder FB ad FIFO. 0

11 Refereces [] Borst, S., Boma, O. J., Núñez Queija, R., ad Zwart, A. P. The impact of the service disciplie o delay asymptotics. Performace Evaluatio 54 (2003), [2] Co, D. R. Reewal theory. Methue, 962. [3] Co, D. R., ad Smith, W. L. Queues. Methue, 96. [4] De Meyer, A., ad Teugels, J. L. O the asymptotic behaviour of the distributios of the busy period ad service time i M/G/. Joural of Applied Probability 7, 3 (980), [5] Madjes, M., ad Zwart, A. P. Large deviatios for waitig times i processor sharig queues. Submitted. [6] Núñez Queija, R. Processor-Sharig Models for Itegrated-Services Networks. PhD thesis, Eidhove Uiversity, [7] Nuyes, M. The Foregroud-Backgroud queue. PhD thesis, Uiversity of Amsterdam, to appear i [8] Righter, R. Schedulig. I Stochastic orders ad their applicatios, M. Shaked ad R. Shathikumar, Eds. Academic Press, 994. [9] Righter, R., ad Shathikumar, J. G. Schedulig multiclass sigle server queueig systems to stochastically maimize the umber of succesful departures. Probability i the Egieerig ad Iformatioal Scieces 3 (989), [0] Righter, R., Shathikumar, J. G., ad Yamazaki, G. O etremal service disciplies i sigle-stage queueig systems. Joural of Applied Probability 27 (990),

Sojourn times in the M/G/1 FB queue with. light-tailed service times

Sojourn times in the M/G/1 FB queue with. light-tailed service times Sojourn times in the M/G/ FB queue with arxiv:math/032444v3 [math.pr] 9 Jun 2004 light-tailed service times M. Mandjes M. Nuyens November 2, 208 Keywords: decay rate, sojourn time, Foreground-Background

More information

B. Maddah ENMG 622 ENMG /27/07

B. Maddah ENMG 622 ENMG /27/07 B. Maddah ENMG 622 ENMG 5 3/27/7 Queueig Theory () What is a queueig system? A queueig system cosists of servers (resources) that provide service to customers (etities). A Customer requestig service will

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013. Large Deviations for i.i.d. Random Variables MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 2 9/9/2013 Large Deviatios for i.i.d. Radom Variables Cotet. Cheroff boud usig expoetial momet geeratig fuctios. Properties of a momet

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT

Introduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Entropy Rates and Asymptotic Equipartition

Entropy Rates and Asymptotic Equipartition Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,

More information

Self-normalized deviation inequalities with application to t-statistic

Self-normalized deviation inequalities with application to t-statistic Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric

More information

Ma 530 Introduction to Power Series

Ma 530 Introduction to Power Series Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power

More information

CS/ECE 715 Spring 2004 Homework 5 (Due date: March 16)

CS/ECE 715 Spring 2004 Homework 5 (Due date: March 16) CS/ECE 75 Sprig 004 Homework 5 (Due date: March 6) Problem 0 (For fu). M/G/ Queue with Radom-Sized Batch Arrivals. Cosider the M/G/ system with the differece that customers are arrivig i batches accordig

More information

Simulation of Discrete Event Systems

Simulation of Discrete Event Systems Simulatio of Discrete Evet Systems Uit 9 Queueig Models Fall Witer 2014/2015 Uiv.-Prof. Dr.-Ig. Dipl.-Wirt.-Ig. Christopher M. Schlick Chair ad Istitute of Idustrial Egieerig ad Ergoomics RWTH Aache Uiversity

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

Application to Random Graphs

Application to Random Graphs A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let

More information

Information Theory and Statistics Lecture 4: Lempel-Ziv code

Information Theory and Statistics Lecture 4: Lempel-Ziv code Iformatio Theory ad Statistics Lecture 4: Lempel-Ziv code Łukasz Dębowski ldebowsk@ipipa.waw.pl Ph. D. Programme 203/204 Etropy rate is the limitig compressio rate Theorem For a statioary process (X i)

More information

Lecture 4. We also define the set of possible values for the random walk as the set of all x R d such that P(S n = x) > 0 for some n.

Lecture 4. We also define the set of possible values for the random walk as the set of all x R d such that P(S n = x) > 0 for some n. Radom Walks ad Browia Motio Tel Aviv Uiversity Sprig 20 Lecture date: Mar 2, 20 Lecture 4 Istructor: Ro Peled Scribe: Lira Rotem This lecture deals primarily with recurrece for geeral radom walks. We preset

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

Lecture 8: Convergence of transformations and law of large numbers

Lecture 8: Convergence of transformations and law of large numbers Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges

More information

REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS

REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS 18th Feb, 016 Defiitio (Lipschitz fuctio). A fuctio f : R R is said to be Lipschitz if there exists a positive real umber c such that for ay x, y i the domai

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series

Comparison Study of Series Approximation. and Convergence between Chebyshev. and Legendre Series Applied Mathematical Scieces, Vol. 7, 03, o. 6, 3-337 HIKARI Ltd, www.m-hikari.com http://d.doi.org/0.988/ams.03.3430 Compariso Study of Series Approimatio ad Covergece betwee Chebyshev ad Legedre Series

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Increasing timing capacity using packet coloring

Increasing timing capacity using packet coloring 003 Coferece o Iformatio Scieces ad Systems, The Johs Hopkis Uiversity, March 4, 003 Icreasig timig capacity usig packet colorig Xi Liu ad R Srikat[] Coordiated Sciece Laboratory Uiversity of Illiois e-mail:

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

4. Basic probability theory

4. Basic probability theory Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

INFINITE SEQUENCES AND SERIES

INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES I geeral, it is difficult to fid the exact sum of a series. We were able to accomplish this for geometric series ad the series /[(+)]. This is

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1 Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity

More information

Sojourn times in the M/G/1 FB queue with light-tailed service times. Mandjes, M.R.H.; Nuijens, M.F.M.

Sojourn times in the M/G/1 FB queue with light-tailed service times. Mandjes, M.R.H.; Nuijens, M.F.M. UvA-DARE (Digital Academic Repository) Sojourn times in the M/G/ FB queue with light-tailed service times. Mandjes, M.R.H.; Nuijens, M.F.M. Published in: Probability in the Engineering and Informational

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Solutions to HW Assignment 1

Solutions to HW Assignment 1 Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.

More information

On groups of diffeomorphisms of the interval with finitely many fixed points II. Azer Akhmedov

On groups of diffeomorphisms of the interval with finitely many fixed points II. Azer Akhmedov O groups of diffeomorphisms of the iterval with fiitely may fixed poits II Azer Akhmedov Abstract: I [6], it is proved that ay subgroup of Diff ω +(I) (the group of orietatio preservig aalytic diffeomorphisms

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

SINGLE-CHANNEL QUEUING PROBLEMS APPROACH

SINGLE-CHANNEL QUEUING PROBLEMS APPROACH SINGLE-CHANNEL QUEUING ROBLEMS AROACH Abdurrzzag TAMTAM, Doctoral Degree rogramme () Dept. of Telecommuicatios, FEEC, BUT E-mail: xtamta@stud.feec.vutbr.cz Supervised by: Dr. Karol Molár ABSTRACT The paper

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

CHAPTER 5 SOME MINIMAX AND SADDLE POINT THEOREMS

CHAPTER 5 SOME MINIMAX AND SADDLE POINT THEOREMS CHAPTR 5 SOM MINIMA AND SADDL POINT THORMS 5. INTRODUCTION Fied poit theorems provide importat tools i game theory which are used to prove the equilibrium ad eistece theorems. For istace, the fied poit

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information

2.2. Central limit theorem.

2.2. Central limit theorem. 36.. Cetral limit theorem. The most ideal case of the CLT is that the radom variables are iid with fiite variace. Although it is a special case of the more geeral Lideberg-Feller CLT, it is most stadard

More information

BIRKHOFF ERGODIC THEOREM

BIRKHOFF ERGODIC THEOREM BIRKHOFF ERGODIC THEOREM Abstract. We will give a proof of the poitwise ergodic theorem, which was first proved by Birkhoff. May improvemets have bee made sice Birkhoff s orgial proof. The versio we give

More information

Berry-Esseen bounds for self-normalized martingales

Berry-Esseen bounds for self-normalized martingales Berry-Essee bouds for self-ormalized martigales Xiequa Fa a, Qi-Ma Shao b a Ceter for Applied Mathematics, Tiaji Uiversity, Tiaji 30007, Chia b Departmet of Statistics, The Chiese Uiversity of Hog Kog,

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

5.1 A mutual information bound based on metric entropy

5.1 A mutual information bound based on metric entropy Chapter 5 Global Fao Method I this chapter, we exted the techiques of Chapter 2.4 o Fao s method the local Fao method) to a more global costructio. I particular, we show that, rather tha costructig a local

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

Gamma Distribution and Gamma Approximation

Gamma Distribution and Gamma Approximation Gamma Distributio ad Gamma Approimatio Xiaomig Zeg a Fuhua (Frak Cheg b a Xiame Uiversity, Xiame 365, Chia mzeg@jigia.mu.edu.c b Uiversity of Ketucky, Leigto, Ketucky 456-46, USA cheg@cs.uky.edu Abstract

More information

MAS111 Convergence and Continuity

MAS111 Convergence and Continuity MAS Covergece ad Cotiuity Key Objectives At the ed of the course, studets should kow the followig topics ad be able to apply the basic priciples ad theorems therei to solvig various problems cocerig covergece

More information

MINIMAX RATES OF CONVERGENCE AND OPTIMALITY OF BAYES FACTOR WAVELET REGRESSION ESTIMATORS UNDER POINTWISE RISKS

MINIMAX RATES OF CONVERGENCE AND OPTIMALITY OF BAYES FACTOR WAVELET REGRESSION ESTIMATORS UNDER POINTWISE RISKS Statistica Siica 19 (2009) 1389 1406: Supplemet S1 S17 1 MINIMAX RATES OF ONVERGENE AND OPTIMALITY OF BAYES FATOR WAVELET REGRESSION ESTIMATORS UNDER POINTWISE RISKS Natalia Bochkia ad Theofais Sapatias

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Lecture 15: Learning Theory: Concentration Inequalities

Lecture 15: Learning Theory: Concentration Inequalities STAT 425: Itroductio to Noparametric Statistics Witer 208 Lecture 5: Learig Theory: Cocetratio Iequalities Istructor: Ye-Chi Che 5. Itroductio Recall that i the lecture o classificatio, we have see that

More information

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.

This exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam. Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the

More information

The log-behavior of n p(n) and n p(n)/n

The log-behavior of n p(n) and n p(n)/n Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity

More information

Appendix to Quicksort Asymptotics

Appendix to Quicksort Asymptotics Appedix to Quicksort Asymptotics James Alle Fill Departmet of Mathematical Scieces The Johs Hopkis Uiversity jimfill@jhu.edu ad http://www.mts.jhu.edu/~fill/ ad Svate Jaso Departmet of Mathematics Uppsala

More information

Queuing Theory. Basic properties, Markovian models, Networks of queues, General service time distributions, Finite source models, Multiserver queues

Queuing Theory. Basic properties, Markovian models, Networks of queues, General service time distributions, Finite source models, Multiserver queues Queuig Theory Basic properties, Markovia models, Networks of queues, Geeral service time distributios, Fiite source models, Multiserver queues Chapter 8 Kedall s Notatio for Queuig Systems A/B/X/Y/Z: A

More information

Sieve Estimators: Consistency and Rates of Convergence

Sieve Estimators: Consistency and Rates of Convergence EECS 598: Statistical Learig Theory, Witer 2014 Topic 6 Sieve Estimators: Cosistecy ad Rates of Covergece Lecturer: Clayto Scott Scribe: Julia Katz-Samuels, Brado Oselio, Pi-Yu Che Disclaimer: These otes

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

(I.D) THE PRIME NUMBER THEOREM

(I.D) THE PRIME NUMBER THEOREM (I.D) THE PRIME NUMBER THEOREM So far, i our discussio of the distributio of the primes, we have ot directly addressed the questio of how their desity i the atural umbers chages as oe keeps coutig. But

More information

ON POINTWISE BINOMIAL APPROXIMATION

ON POINTWISE BINOMIAL APPROXIMATION Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 6 9/23/2013. Brownian motion. Introduction MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 6 9/23/203 Browia motio. Itroductio Cotet.. A heuristic costructio of a Browia motio from a radom walk. 2. Defiitio ad basic properties

More information

There is no straightforward approach for choosing the warmup period l.

There is no straightforward approach for choosing the warmup period l. B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

1. (25 points) Use the limit definition of the definite integral and the sum formulas 1 to compute

1. (25 points) Use the limit definition of the definite integral and the sum formulas 1 to compute Math, Calculus II Fial Eam Solutios. 5 poits) Use the limit defiitio of the defiite itegral ad the sum formulas to compute 4 d. The check your aswer usig the Evaluatio Theorem. ) ) Solutio: I this itegral,

More information

University of Manitoba, Mathletics 2009

University of Manitoba, Mathletics 2009 Uiversity of Maitoba, Mathletics 009 Sessio 5: Iequalities Facts ad defiitios AM-GM iequality: For a, a,, a 0, a + a + + a (a a a ) /, with equality iff all a i s are equal Cauchy s iequality: For reals

More information

On forward improvement iteration for stopping problems

On forward improvement iteration for stopping problems O forward improvemet iteratio for stoppig problems Mathematical Istitute, Uiversity of Kiel, Ludewig-Mey-Str. 4, D-24098 Kiel, Germay irle@math.ui-iel.de Albrecht Irle Abstract. We cosider the optimal

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Modeling and Performance Analysis with Discrete-Event Simulation

Modeling and Performance Analysis with Discrete-Event Simulation Simulatio Modelig ad Performace Aalysis with Discrete-Evet Simulatio Chapter 5 Statistical Models i Simulatio Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous

More information

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p). Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

LECTURE 8: ASYMPTOTICS I

LECTURE 8: ASYMPTOTICS I LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece

More information

Probability for mathematicians INDEPENDENCE TAU

Probability for mathematicians INDEPENDENCE TAU Probability for mathematicias INDEPENDENCE TAU 2013 28 Cotets 3 Ifiite idepedet sequeces 28 3a Idepedet evets........................ 28 3b Idepedet radom variables.................. 33 3 Ifiite idepedet

More information

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15

17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15 17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig

More information

Approximation theorems for localized szász Mirakjan operators

Approximation theorems for localized szász Mirakjan operators Joural of Approximatio Theory 152 (2008) 125 134 www.elsevier.com/locate/jat Approximatio theorems for localized szász Miraja operators Lise Xie a,,1, Tigfa Xie b a Departmet of Mathematics, Lishui Uiversity,

More information

http://www.xelca.l/articles/ufo_ladigsbaa_houte.aspx imulatio Output aalysis 3/4/06 This lecture Output: A simulatio determies the value of some performace measures, e.g. productio per hour, average queue

More information

Subject: Differential Equations & Mathematical Modeling-III

Subject: Differential Equations & Mathematical Modeling-III Power Series Solutios of Differetial Equatios about Sigular poits Subject: Differetial Equatios & Mathematical Modelig-III Lesso: Power series solutios of differetial equatios about Sigular poits Lesso

More information

Lecture 2. The Lovász Local Lemma

Lecture 2. The Lovász Local Lemma Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities

Chapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other

More information

Detailed proofs of Propositions 3.1 and 3.2

Detailed proofs of Propositions 3.1 and 3.2 Detailed proofs of Propositios 3. ad 3. Proof of Propositio 3. NB: itegratio sets are geerally omitted for itegrals defied over a uit hypercube [0, s with ay s d. We first give four lemmas. The proof of

More information

Mi-Hwa Ko and Tae-Sung Kim

Mi-Hwa Ko and Tae-Sung Kim J. Korea Math. Soc. 42 2005), No. 5, pp. 949 957 ALMOST SURE CONVERGENCE FOR WEIGHTED SUMS OF NEGATIVELY ORTHANT DEPENDENT RANDOM VARIABLES Mi-Hwa Ko ad Tae-Sug Kim Abstract. For weighted sum of a sequece

More information

Monte Carlo Integration

Monte Carlo Integration Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1

1 = δ2 (0, ), Y Y n nδ. , T n = Y Y n n. ( U n,k + X ) ( f U n,k + Y ) n 2n f U n,k + θ Y ) 2 E X1 2 X1 8. The cetral limit theorems 8.1. The cetral limit theorem for i.i.d. sequeces. ecall that C ( is N -separatig. Theorem 8.1. Let X 1, X,... be i.i.d. radom variables with EX 1 = ad EX 1 = σ (,. Suppose

More information

A stochastic model for phylogenetic trees

A stochastic model for phylogenetic trees A stochastic model for phylogeetic trees by Thomas M. Liggett ad Rialdo B. Schiazi Uiversity of Califoria at Los Ageles, ad Uiversity of Colorado at Colorado Sprigs October 10, 2008 Abstract We propose

More information

Chapter 7 Isoperimetric problem

Chapter 7 Isoperimetric problem Chapter 7 Isoperimetric problem Recall that the isoperimetric problem (see the itroductio its coectio with ido s proble) is oe of the most classical problem of a shape optimizatio. It ca be formulated

More information