Some results on. Transient Queues. Shan XU

Size: px
Start display at page:

Download "Some results on. Transient Queues. Shan XU"

Transcription

1 Some results on Transient Queues by Shan XU A Major Paper Submitted to the Faculty of Graduate Studies through the Department of Mathematics and Statistics in Partial Fulfillment of the Requirements for the Degree of Master of Science at the University of Windsor Windsor, Ontario, Canada 21 c Shan XU

2 Some Results on Transient Queues by Shan Xu APPROVED BY: A. Hussein Department of Mathematics and Statistics M. Hlynka Department of Mathematics and Statistics November, 21

3 Author s Declaration of Originality iii I hereby certify that I am the sole author of this major paper and that no part of this major paper has been published or submitted for publication. I certify that, to the best of my knowledge, my major paper does not infringe upon anyone s copyright nor violate any proprietary rights and that any ideas, techniques, quotations, or any other material from the work of other people included in my thesis, published or otherwise, are fully acknowledged in accordance with the standard referencing practices. Furthermore, to the extent that I have included copyrighted material that surpasses the bounds of fair dealing within the meaning of the Canada Copyright Act, I certify that I have obtained a written permission from the copyright owner(s) to include such materials in my major paper and have included copies of such copyright clearances to my appendix. I declare that this is a true copy of my major paper, including any final revisions, as approved by my committee and the Graduate Studies office, and that this major paper has not been submitted for a higher degree to any other University or Institution.

4 Abstract iv This paper studies two jobs which must be performed in tandem, when the order of service of the two jobs is unimportant to the customer. One of the jobs requires waiting in an M/M/1 queue while the other job requires a fixed amount of time with no queueing. The paper gives a graphical illustration as to when it is better (in the sense of minimizing total system time for an arriving customer) to choose the queue and when it is better to choose the fixed time job. The paper extends and expands on results given by van de Coevering (1995).

5 Contents Author s Declaration of Originality iii Abstract iv List of Figures vi Chapter 1. Literature Review 1 Chapter 2. van de Coevering s result and extensions 7 Chapter 3. Task versus Queue? 38 Bibliography 42 v

6 List of Figures 2.1 p i2 (t) for i =... 4, λ = 3, µ = 4, < t < p i2 (t) for i =... 4, λ = 1, µ = 4, < t < p 22 (t) for i = 2, j = 2, λ = 3, µ = p i2 (t) for i =, 1, 3, 4, λ = 3, µ = 4, < t < p i2 (t) for i =, 1, 3, 4, λ = 1, µ = 4, < t < p 2 (t) for i =, j = 2, λ = 3, µ = 4, < t < p 2j (t) for j =... 4, λ = 3, µ = 4, < t < p 2j (t) for j =... 4, λ = 1, µ = 4, < t < p 2j (t) for i = 2, j =, 1, 3, 4,λ = 3, µ = 4, < t < p 2j (t) for j =, 1, 3, 4, λ = 1, µ = 4, < t < EL i (t) for λ = 3,µ = 4, i =, 1, 2, 3, 4, < t < EL i (t) for λ = 1, µ = 4, < t < EL 1 (t) for λ = 3,µ = 4, < t < EL 1 (t) for λ = 1, µ = 4, < t < EL 2 i(t) for λ = 3,µ = 4, < t < V ar i [L(t)] for λ = 3,µ = 4, < t < skew i [L(t)] for λ = 3,µ = 4,.1 < t < 1 29 vi

7 LIST OF FIGURES vii 3.1 Which is better? EL 1 (t) for λ = 3,µ = 4, < t <.5 41

8 CHAPTER 1 Literature Review To obtain limiting probability results for M/M/1 queues is relatively easy. To obtain transient results is much harder. Assume that the arrival rate is λ and the service rate is µ. Let ρ = λ µ be the traffic intensity. The earliest known formulas for transient queueing probabilities are given by Clarke (1953) and by Ledermann and Reuter (1954). Gross and Harris (1985) and Kleinrock (1975) present the Ledermann and Reuter result in terms of modified Bessel functions. Their expression is: p ij (t) = e (λ+µ)t [ρ (j i)/2 I j i (2t λµ) + ρ (j i 1)/2 I j+i+1 (2t λµ) + (1 ρ)ρ j ρ k/2 I k (2t λµ) k=j+i+2 where I k (x) = m= (x/2) k+2m (k + m)!m! is the modified Bessel function of the first kind of order k. (From Wikipedia, Daniel Bernoulli defined the Bessel functions, and they were then generalized by Friedrich Bessel. [Modified] Bessel functions of the first kind, denoted as J α (x), are solutions of the Bessel s differential equation that are finite at the origin (x = ) for non-negative integer α, and diverge as x approaches zero for 1

9 1. LITERATURE REVIEW 2 negative non-integer α. The solution type (e.g. integer or non-integer)and normalization of J α (x) are defined by its properties.... It is possible to define the function by its Taylor series expansion around x = : J α (x) = m= ( 1) m (m!)γ(m + α + 1) (x/2)(2m+α) where Γ(z) is the Gamma function. ) To obtain Clarke s expression, let q t be the queue length at time t. Let f t (q) be the probability that q t = q when q o is given. Then, for q q, Clarke obtains f t (q) = F t (q) F t (q + 1) = e (1+λ)t {λ 1 2 (q q) I q q (2λ 1 2 t) + λ 1 2 (q q 1) I q+q +1(2λ 1 2 t) + (1 λ)λ q λ 1 2 r I r (2λ 1 2 t)} r=q+q +2 For q < q f t (q) = F t (q) F t (q + 1) = e (1+λ)t {λ 1 2 (q q) I q q (2λ 1 2 t) + λ 1 2 (q q+1) I q+q +1(2λ 1 2 t) + (1 λ)λ q λ 1 2 r I r (2λ 1 2 t)} r=q+q +2 where I r (x) is the modified Bessel function of the first kind of order r. Champernowne (1956) gives a combinatorial argument to obtain the same expression as Clarke.

10 1. LITERATURE REVIEW 3 Sharma (199) presents some new formulas for transient queueing probabilities. p i (t n at time ) = (1 ρ)ρ i + e (λ+µ)t ρ i k= k= ( (λt) k k! i+k+n m= (k m) (µt)m 1 m! ( ) + e (λ+µ)t (λt) i+k n (µt) k 1 k!(i + k n)! 1. (i + k)!(k n)! ) We present Conolly and Langaris (1993) version of Sharma s result. Let ν = λ+µ. The probability of having n customers in an M/M/1 system at time t, given that there are customers at time, is given by p () n (t) = (1 ρ)ρ n + exp( νt)ρ n (λt) m m+n m= m! k= (m k) (µt)k 1 k!, where λ is the arrival rate, µ is the service rate, ρ = λ/µ, ν = λ + µ. Conolly and Langaris (1993) developed their own formula for which they claim computational improvements. It is given by p () n (λ + µ) (λ µ) (t) = (1 )ρ n + exp( νt) c (n) m 2µ tm. m where S(t) = ν 2µ m 1 ( 1/2 )( w2 2m 2 m ν )m 2 k= (νt) k, k! c () m is the coefficient of t m in S(t), c (1) m = m + 1 µ c() m 1 c () m, c (n) m = m + 1 µ (c(n 1) m+1 ρc (n 2) m ), for n = 2, 3,....

11 1. LITERATURE REVIEW 4 Karlin and McGregor (1958) and van Doorn (198) give a result for the M/M/1 queue and more general birth-and-death processes, which is called the spectral representation of the probability transition function P ij (t). It is given by p ij (t) = π j e xt q i (x)q j (x)dψ(x) where π = 1, π j = (λ λ j 1 /(µ 1 µ j ), where λ j is the birth rate in state j, µ j is the death rate in state j, q i (x) is a recursively defined system of polynomials in x satisfying orthogonality relations, ψ(x) is a non decreasing real valued function on [, ). Details can be found in van Doorn (198). Abate and Whitt (1988) give a spectral representation for the M/M/1 queue, namely: p in (t) = (1 ρ)ρ n + τ 1 1 τ 1 2 ρ n+1 q i (x)q n (x)φ(x)e xt dx. Here q i (x) are orthogonal polynomials for the M/M/1 system and the q i (x) form a recursively defined system of polynomials in x satisfying orthogonality relations q n (x) = ρ n/2 U n (α(x)) ρ (n+1)/2 U n 1 (α(x)), where U n (α) represents a polynomial in α of the form c n + c n1 α + + c nn α n for c = 1, c 1 =, c 11 = 2, c 2 = 1, c 21 =, c 22 = 4, c n+1,j = 2c n,j 1 c n 1,j for j n + 1 and n 3. U n (α) are the Chebyshev polynomials of the second kind, with U 1 (α) =, U (α) = 1, U 1 (α) = 2α, U 2 (α) = 4α 2 1, U 3 (α) = 8α 3 4α and U n+1 (α) = 2αU n (α) Un 1(α), n 1;

12 1. LITERATURE REVIEW 5 α(x) = 1 + ρ 2θ2 x 2. ρ Here where τ 1 = (1 ρ) 2 2 ; τ 2 = (1 + ρ) 2, 2 φ(x) = 1 ρ (1 τ1 x)(τ 2 x 1), τ2 1 x τ1 1. 2πρ x Leguesdron, Pellaumail, Rubino, and Sericola (1993) give a transient analysis of the M/M/1 queueing system. They present a new method based on the uniformization technique and on generating functions. For i j, the transient probabilities are: ( (j i)/2 λ p i,j (t) = e µ) (λ+µ)t [I j i (2t λµ) I i+j+2 (2t ( µ ) i+1 λµ)] + P,i+j+1 (t) λ for I k (x) as above, and the transient probabilities of the M/M/1 queue, given that the queue is empty at time t =, are: p,j (t) = pj q j n=j e (λ+µ)t(λ + µ)n t n n! (n j)/2 k= n + 1 2k n + 1 ( n + 1 k ) p k q n k Parthasarathy (1987) considers the M/M/1 queue system with Poisson arrivals and exponential service times by deriving the time-dependent solution in a direct way. It is given by: p n (t) = e (λ+µ)t µ n q k (t) k=1 ( ) n k λ + µ ( ) n λ p (t) µ

13 1. LITERATURE REVIEW 6 for p (t) = q 1 (y)e (λ+µ)y dy + δ a, α = 2 (λµ) and β = (λµ) where q n (t) = µβ(n α)(1 δ a )[I n a (αt) I n+a (αt)] + λβ n α 1 [I n+a+1 (αt) I n a 1 (αt)], and δ is the Kronecker delta.

14 CHAPTER 2 van de Coevering s result and extensions In this chapter, we consider results given in van de Covering (1995). We add additional explanations, correct one typo, add graphs, and extent his results. For an M/M/1 queue, van de Coevering presents the result p ij (t) = 2 π ρ(j i)/2 π e µtγ(y) γ(y) a i(y)a j (y)dy + (1 ρ)ρ j ρ < 1 ρ 1, (1) for γ(y) = 1 + ρ 2 ρcos(y) and a k (y) = sin(ky) ρsin((k + 1)y). He credits Morse (1955) and Takacs (1962, page 23) for this trigonometric version. It is difficult to find illustrations of this result. The closest (but not the same) seems to be in Morse (1958, p.66). For illustration, we fix j = 2. We present graphs of p i2 (t) for i =... 4, λ = 3 or 1, µ = 4, < t < 1 in Figures 2.1, 2.2. We stop at i = 4 arbitrarily. We note that one of the p i,2 (t) curves has p i,2 () = 1 while the others have p i,2 () =. Clearly p 2,2 (t) = 1. See Figure 2.3 We eliminate that curve and consider the other curves p i,2 (t), i =, 1, 2, 3, 4, and < t < 3 (for λ = 3) and < t < 1 (for λ = 1). This gives Figure 2.4,

15 2. VAN DE COEVERING S RESULT AND EXTENSIONS 8 Figure 2.1. p i2 (t) for i =... 4, λ = 3, µ = 4, < t < 1 Figure 2.2. p i2 (t) for i =... 4, λ = 1, µ = 4, < t < 1

16 2. VAN DE COEVERING S RESULT AND EXTENSIONS 9 Figure 2.3. p 22 (t) for i = 2, j = 2, λ = 3, µ = 4 Figure 2.4. p i2 (t) for i =, 1, 3, 4, λ = 3, µ = 4, < t < 3

17 2. VAN DE COEVERING S RESULT AND EXTENSIONS 1 Figure 2.5. p i2 (t) for i =, 1, 3, 4, λ = 1, µ = 4, < t < 1 Can we determine which curve corresponds to i =, 1, 3, 4 from Figures 2.4 and 2.5? The answer is Yes but some additional derivation is required. We could simply draw the graphs individually, and compare them. For example, Figure 2.6 shows p,2 (t) in the λ = 3, µ = 4 case.

18 2. VAN DE COEVERING S RESULT AND EXTENSIONS 11 Figure 2.6. p 2 (t) for i =, j = 2, λ = 3, µ = 4, < t < 1 However, we can get even more information without drawing the individual graphs. Property 2.1. (new result) For an M/M/1 queueing system with λ < µ, for small t, and fixed j >, we have p j+1,j ( t) > p j 1,j ( t) > p j+2,j ( t) > p j 2,j ( t). Proof. p j 1,j ( t) = λ t + o( t). p j+1,j ( t) = µ t + o( t). p j 2,j ( t) = o( t). Similarly, p j+2,j ( t) = o( t).

19 2. VAN DE COEVERING S RESULT AND EXTENSIONS 12 Thus, p j+1,j ( t) µ t + o( t) = p j 1,j ( t) λ t + o( t) = µ + o( t) t λ + o( t) t µ + λ + > 1, so, p j+1,j ( t) > p j 1,j ( t) for small t. Similarly, p j+2,j ( t) > 1 for small t. p j 2,j ( t) Also, p j 2,j ( t) p j+2,j ( t) = λ t + o( t) µ 2 ( t) 2 + o(( t) 2 ) = λ + o( t) t ( t) 2 µ + o(( t)2 ) ( t) 2 as t +. So, p j 2,j ( t) > p j+2,j ( t) for small t. Thus the graphs, in Figures 2.4 and 2.5, in order from largest to smallest, for small t, correspond to i = 3, 1, 4,. Note in addition that all of the graphs in Figure 2.1 must have the same limit π 2 as t. We compute π 2 = (1 ρ)ρ 2 = (1 3/4)(3/4) 2 = 9/64.

20 2. VAN DE COEVERING S RESULT AND EXTENSIONS 13 Figure 2.7. p 2j (t) for j =... 4, λ = 3, µ = 4, < t < 1 Next we consider the graphs p 2j (t) for λ = 3 or 1, µ = 4, and < t < 1 in Figures 2.7, 2.8. We know that the limits of the different curves will be π j for j =, 1, 2,.... We also know that π j = (1 ρ)ρ j for j =, 1, 2,.... Further π > π 1 > π 2 >.... Thus, if we look at the right hand side of Figure 2.7, we see that the curves, from largest to smallest, correspond to j =, 1, 2, 3,....

21 2. VAN DE COEVERING S RESULT AND EXTENSIONS 14 Figure 2.8. p 2j (t) for j =... 4, λ = 1, µ = 4, < t < 1 Figure 2.9. p 2j (t) for i = 2, j =, 1, 3, 4,λ = 3, µ = 4, < t < 1

22 2. VAN DE COEVERING S RESULT AND EXTENSIONS 15 Figure 2.1. p 2j (t) for j =, 1, 3, 4, λ = 1, µ = 4, < t < 1 Theorem 2.2. (van de Coevering) For an M/M/1 queueing system, let EL i (t) be the expected number of customers at time t if there are i customers at time. Then EL i (t) = 2 π ρ(j i)/2 π e µtγ(y) γ(y) 2 a i(y)sin(y)dy + ρ/(1 ρ) ρ < 1 i + (λ µ)t + ρ 1 /(ρ 1) ρ > 1. (2) Rather than the above version, we use the following (also given in van de Coevering) for computational purposes. Theorem 2.3. (van de Coevering) For an M/M/1 queueing system, for ρ < 1, EL i (t) = (λ µ)t + µ p i (x)dx + i. (3)

23 2. VAN DE COEVERING S RESULT AND EXTENSIONS 16 Proof. EL i (t) = jp ij (t). j= So, using Kolmogorov s forward differential equations, d dt EL i(t) = = jp ij(t) j= j(µp ij+1 (t) + λp ij 1 (t) (λ + µ)p ij (t)) j= = µ (j + 1)p ij+1 (t) µ p ij+1 (t) + λ (j 1)p ij 1 (t) + λ p ij 1 (t) j= (λ + µ) j= jp ij (t) j= j= = µ jp ij (t) µ(1 p i (t)) + λ jp ij (t) + λ(1) (λ + µ)el i (t) = µel i (t) µ(1 p i (t)) + λel i (t) + λ (λ + µ)el i (t) j= j= j= = λ µ + µp i (t). Integrate with respect to t. EL i (t) = (λ µ)t + µ p i (x)dx + K. Take t =. Then i = EL i () = (λ µ) + µ = EL i (t) = (λ µ)t + µ p i (x)dx + K = K p i (x)dx + i.

24 2. VAN DE COEVERING S RESULT AND EXTENSIONS 17 Figure EL i (t) for λ = 3,µ = 4, i =, 1, 2, 3, 4, < t < 1 Our results appear in Figure A graph of this type appears in Abate and Whitt (1988). They indicate that the only graphs of this type will be either (a) strictly increasing, (b) strictly decreasing, or (c) decreasing to a minimum and then increasing. Graphs of this type also appear in Yu et al. (26). Note that all of the curves EL(i, t) for i = 1, 2, 3, 4 have negative slope for t =. This is not so clear for i = 1 so we magnify that curve in Figure We prove the general result as follows.

25 2. VAN DE COEVERING S RESULT AND EXTENSIONS 18 Figure EL i (t) for λ = 1, µ = 4, < t < 1 Figure EL 1 (t) for λ = 3,µ = 4, < t <.5

26 2. VAN DE COEVERING S RESULT AND EXTENSIONS 19 Figure EL 1 (t) for λ = 1, µ = 4, < t < 1 Property 2.4. (new result) If λ < µ, then del i (t) dt = λ µ <, (4) t= for i = 1, 2... Proof. EL i () = i. EL i ( t) = all j jp ij ( t) = (i + 1)(λ t + o( t)) + i(1 λ t µ t + o( t)) + (i 1)(µ t + o( t)) + o( t)

27 2. VAN DE COEVERING S RESULT AND EXTENSIONS 2 d(el i (t)) dt = i + (λ µ) t + o( t) = lim t= t = λ µ <. EL i ( t) EL i () t Next we consider curves for EL 2 i (t). Theorem 2.5. (van de Coevering) For an M/M/1 queueing system, EL 2 i(t) = 2 π ρ(j i)/2 π e µtγ(y) γ(y) 3 a i(y)sin(y)dy 2ρ(1 ρ) 2 EL i (t) ρ < 1 + 2(ρ 1)it + (ρ 1) 2 t 2 + 2ρ i t + 2ρt EL i (t) + i + i 2 (5) [ρ (2i + 1)(ρ 1)]ρ i (ρ 1) 2 ρ 1. For computational purposes, we use the following. Theorem 2.6. (corrected version of van de Coevering s result) For an M/M/1 queueing system, with ρ < 1, EL 2 i(t) = 2(λ µ) EL i (t)dx + (λ + µ)t µ p i (x)dx + i 2. (6) Proof. EL 2 i(t) = j 2 p ij (t) j=

28 2. VAN DE COEVERING S RESULT AND EXTENSIONS 21 so, d dt EL2 i (t) = j 2 p ij (t) j= = j 2 (µp ij+1 (t) + λp ij 1 (t) (λ + µ)p ij (t)). j= Now if we simplify the summands j= j2 µp ij+1 (t) and j= j2 λp ij 1 (t), then j 2 µp ij+1 (t) = µ (j + 1) 2 p ij+1 (t) 2λ p ij+1 (t) + µ p ij+1 (t)) j= j= j= j= j= = µel 2 i (t) 2µ (j + 1)p ij+1 (t) + µ p ij+1 (t) = µel 2 i(t) 2µEL i (t) + µ(1 p i (t)) j= and j 2 λp ij 1 (t) = λ (j 1) 2 p ij 1 (t) + 2λ jp ij 1 (t) λ p ij 1 (t)) j= j= j= j= = λel 2 i (t) + 2λEL i (t) + λ p ij 1 (t) = λel 2 i (t) + 2λEL i(t) + λ. j= Thus, d dt EL2 i(t) = µel 2 i(t) 2µEL i (t) + µ µp i (t) + λel i (t) + λ (λ + µ)el 2 i(t) = 2(λ µ)el i (t) + (λ + µ) µp i (t).

29 2. VAN DE COEVERING S RESULT AND EXTENSIONS 22 Figure EL 2 i (t) for λ = 3,µ = 4, < t < 1 Integrate with respect to t to get EL 2 i(t) = 2(λ µ) EL i (t)dx + (λ + µ)t µ p i (x)dx + K. Take t = to show K = i 2 = i 2 = EL 2 i() = 2(λ µ) EL i (t)dx + (λ + µ) µ = EL 2 i (t) = 2(λ µ) EL i (t)dx + (λ + µ)t µ p i (x)dx + K = K p i (x)dx + i 2. A graph of E[L i (t) 2 ] appears in Figure 2.15 above.

30 2. VAN DE COEVERING S RESULT AND EXTENSIONS 23 Figure V ar i [L(t)] for λ = 3,µ = 4, < t < 1 From our results for E[L i (t) 2 ] and EL i (t), we can compute var i [L(t)] = E[L(i, t) 2 ] (EL i (t)) 2. The result appears in Figure 2.16 above. As expected, the variance is small for small t and increases as t gets larger. However, since the probabilities p ij (t) π j as t, we expect that the variance should approach a constant limit as t. This limit should be var(l) = E(L 2 ) (E(L)) 2 where E(L) = j= jπ j and E(L 2 ) = j= j2 π j. The result is well known to be var(l) = ρ (1 ρ) 2.

31 2. VAN DE COEVERING S RESULT AND EXTENSIONS 24 Next we consider results for EL 3 i(t)]. Theorem 2.7. (new result) For an M/M/1 queueing system, with ρ < 1, EL 3 i (t) = 3(λ µ) EL 2 i (x)dx + 3(λ + µ) EL i (t)dx + (λ µ)t + µ p i (x)dx + i 3. (7) Proof. EL 3 i (t) = j 3 p ij (t) j= so, d dt EL3 i(t) = j 3 p ij(t). j= Now we simplify the summands j= j3 µp ij+1 (t) and j= j3 λp ij 1 (t), then j 3 µp ij+1 (t) = µ (j + 1) 3 p ij+1 (t) µ 3(j + 1) 2 p ij+1 (t) j= + µ j= 3(j + 1)p ij+1 (t) j= j= p ij+1 (t) j= = µel 3 i (t) 3µEL2 i (t) + 3µEL i(t) µ(1 p i (t)) and j 3 λp ij 1 (t) = λ (j 1) 3 p ij 1 (t) + 3λ (j 1) 2 p ij 1 (t) j= j= j=

32 2. VAN DE COEVERING S RESULT AND EXTENSIONS λ (j 1)p ij 1 (t) + λ p ij 1 (t) j= j= = λel 3 i (t) + 3λEL2 i (t) + 3λEL i(t) + λ. Thus, d dt EL3 i (t) = j 3 (µp ij+1 (t) + λp ij 1 (t) (λ + µ)p ij (t)) j= = µel 3 i(t) 3µEL 2 i(t) + 3µEL i (t) µ(1 p i (t)) + λel 3 i(t) + 3λEL 2 i (t) + 3λEL i (t) + λ (λ + µ)el 3 i(t) = 3(λ µ)el 2 i(t) + 3(λ + µ)el i (t) + (λ µ) + µp i (t). Integrate with respect to t to get EL 3 i(t) = 3(λ µ) EL 2 i(x)dx+3(λ+µ) EL i (t)dx+(λ µ)t+µ p i (x)dx+k. Take t = to show K = i 3 = i 3 = EL 3 i(t) = 3(λ µ) + (λ µ)t + µ p i (x)dx + K = K = EL 3 i(t) = 3(λ µ) + µ p i (x)dx + i 3. EL 2 i(x)dx + 3(λ + µ) EL 2 i(x)dx + 3(λ + µ) EL i (t)dx EL i (t)dx + (λ µ)t

33 2. VAN DE COEVERING S RESULT AND EXTENSIONS 26 We can now obtain a graph for the skewness of L(i, t). (See Wikipedia.) Recall that for a random variable X, skewness(x) = E[(X E[X])3 ] (E[(X E[X]) 2 ]) 3/2. Thus skewness i (L(t)) = E i[(l(t) E i [L(t)]) 3 ] (E i [(L(t) E i [L(t)]) 2 ]) 3/2. First we find lim t + skewness i (L(t)) for i > and i =. Property 2.8. (new result) For an M/M/1 queueing system, with λ < µ, (a) lim t + skewness i(l(t)) = for i >, (b) lim t + skewness i (L(t)) = + for i =. Proof. (a) E(X( t)) = (i 1)p ii 1 ( t) + ip ii ( t) + (i + 1)p ii+1 ( t) + o( t) = (i 1)µ t + i(1 λ µ t) + (i + 1)(λ t) + o( t) = i (µ λ) t + o( t). E[(X( t) E(X( ))) 2 ] = i+1 j=i 1 (j (1 (µ λ) t)) 2 p ij ( t) + o( t)

34 2. VAN DE COEVERING S RESULT AND EXTENSIONS 27 = (1 (µ λ) t) 2 µ t + ((µ λ) t) 2 (1 λ t µ t) + (1 + (µ λ) t) 2 λ t + o( t) E[(X( t) E(X( t))) 3 ] = = (µ + λ) t + o( t). i+1 j=i 1 (j (1 (µ λ) t)) 3 p ij ( t) + o( t) = (1 (µ λ) t) 3 µ t + ((µ λ) t) 2 (i λ t µ t) + (1 + (µ λ) t) 3 λt + o( t) = ( µ + λ) t + o( t). So, E[X( t) E(X( t)) 3 ] (E[(X( t) E(X( )) 2 ]) 3/2 = = ( µ + λ) t + o( t) (µ + λ) 3/2 t 3/2 + o( t) µ + λ + o( t) t (µ + λ) 3/2 t 1/2 + o( t) t as t +. (b) If i =, E(X( t)) = λ t + o( t). E[(X( t) E(X( ))) 2 ] = i (j λ t) 2 p j ( t) + o( t) j= = (λ t) 2 (1 λ t) + (1 λ t) 2 λ t + o( t) = λ t + o( t).

35 2. VAN DE COEVERING S RESULT AND EXTENSIONS 28 E[(X( t) E(X( t))) 3 ] = 1 (j λ t) 3 p ij ( t) + o( t) j= = (λ t) 3 λ t + (1 λ t) 3 λ t + o( t) So, skewness i (L(t)) = = λ t + o( t). λ t + o( t) (λ t + o( t)) 3/2 + as t +.

36 2. VAN DE COEVERING S RESULT AND EXTENSIONS 29 Figure skew i [L(t)] for λ = 3,µ = 4,.1 < t < 1 Hence, we illustrate our graph on the interval (.1,1) rather than on the interval (,1). Skewness measures the lack of symmetry of the pdf. A pdf which is positively skewed has a long tail on the right. If the number of customers at time zero is i =, then the function must be positively skewed (and in fact is + according to our property). If t is large, it is possible that the number of customers is large, but the number of customers has a minimum of zero. In this case we expect the skewness to be positive, and this happens. If t is small and the initial number of customers is i >, then the algebra gives us a negative skewness for small values of t and this appears on the graph.

37 2. VAN DE COEVERING S RESULT AND EXTENSIONS 3 Van de Coevering obtains additional expressions for EL i (t), E i (L(t) 2 ), involving the functions A i (t) and B i (t) which are defined below. We add a function C i (t) so we can deal with E i (L(t) 3 ) as well. Define A i (t) = 2 π ρ(j i)/2 π e µtγ(y) sin(iy)sin(y)dy, (8) γ(y) 2 B i (t) = 2 π ρ(j i)/2 π C i (t) = 2 π ρ(j i)/2 π e µtγ(y) sin(iy)sin(y)dy, (9) γ(y) 3 e µtγ(y) sin(iy)sin(y)dy. (1) γ(y) 4 Property 2.9. For an M/M/1 queue, with λ < µ, EL i (t) = A i (t) ρa i+1 (t) + ρ/(1 ρ). (11) Proof. Recall from (1) that p ij (t) = 2 π ρ(j i)/2 π e µtγ(y) γ(y) a i(y)a j (y)dy + (1 ρ)ρ j ρ < 1 ρ 1, for γ(y) = 1 + ρ 2 ρcos(y) and a k (y) = sin(ky) ρsin((k + 1)y). Substituting the expression for p i (t) from (1) into (3) gives: EL i (t) = (λ µ)t + µ = (λ µ)t + µ p io (x)dx + i [ 2 π ρ i/2 π e µxγ(y) (sin(iy) γ(y)

38 2. VAN DE COEVERING S RESULT AND EXTENSIONS 31 ρ 1/2 sin((i + 1)y))( ρ 1/2 siny)dy + 1 ρ] dx + i = (λ µ)t + i + µ(1 ρ)t + µ 2 π ρ i/2 π e µxγ(y) γ(y) (sin(iy) ρ 1/2 sin((i + 1)y))( ρ 1/2 siny)dydx = (λ µ)t + i + µ(1 ρ)t µ 2 π ρ(1 i)/2 π ρ 1/2 sin((i + 1)y)siny)dxdy = (λ µ)t + i + µ(1 ρ)t 2 π ρ(1 i)/2 π [sin(iy)siny ρ 1/2 sin((i + 1)y)siny] dy = (λ µ)t + i + µ(1 ρ)t 2 π ρ(1 i)/2 π 2 π π ρ (2 i)/2e µtγ(y) 1 γ 2 (y) sin(iy)siny dy + 2 π ρ(2 i)/2 e µxγ(y) (sin(iy) sin y γ(y) [ e µtγ(y) γ 2 (y) + 1 γ 2 (y) ] e µtγ(y) γ 2 (y) γ 2 (y) sin((i + 1)y)siny dy 2 π ρ(1 i)/2 π sin(iy)siny dy π 1 sin((i + 1)y)siny dy γ 2 (y) = A i (t) ρa i+1 (t) A i () + ρa i+1 () + i. (12) As A i (t) as t we have EL i (t) ρ/(1 ρ) for all i, so EL i (t) = A i (t) ρa i+1 (t) A i () + ρa i+1 () + i ρ/(1 ρ) = A i + ρa i+1 () + i ρa i+1 () A i () = ρ/(1 ρ) + i. (13)

39 Substitute (12) into (11) to get 2. VAN DE COEVERING S RESULT AND EXTENSIONS 32 EL i (t) = A i (t) ρa i+1 (t) + ρ/(1 ρ) i (λ µ)t + i + (λ µ)t = A i (t) ρa i+1 (t) + ρ/(1 ρ). Lemma 2.1. For an M/M/1 queue with ρ < 1, lim t, EL 2 i(t) = (λµ + λ2 ) (µ λ) 2 = ρ2 + ρ (1 ρ) 2. Proof. As t, EL 2 i (t) E(L2 ). E(L 2 ) = i 2 π i = i= i 2 (1 ρ)ρ i = (1 ρ)ρ i 2 ρ i 1 i= = ρ(1 ρ)[ i(i 1)ρ i 2 ρ + = i= (i 2 i)ρ i 2 ρ + i= i= iρ i 1 2ρ = ρ(1 ρ)[ (1 ρ) (1 ρ) 2] = ρ2 + ρ (1 ρ) 2 iρ i 1 ] i= i=

40 2. VAN DE COEVERING S RESULT AND EXTENSIONS 33 Property For an M/M/1 queue, with λ < µ, EL 2 i (t) = 2(ρ 1)[ B i(t) + ρb i+1 (t)] EL i (t) + 2ρ (1 ρ) 2. (14) Proof. EL i (x)dx = A i (x) ρa i+1 (x) A i () + ρ/(1 ρ)dx = ρt/(1 ρ) + = ρt/(1 ρ) + ρt/(1 ρ) + A i (x) ρa i+1 (x)dx 2 π π ρ(1 i)/2 π 2 π ρi/2 e µtγ(y) γ 2 (y) e µtγ(y) γ 2 (y) sin(iy)siny dydx sin((i + 1)y)sin y dydx = ρt/(1 ρ) 1 µ (B i(t) B i ()) + ρ µ B i+1(t) 1 µ B i() = ρt/(1 ρ) + 1 µ [ Bi(t) + ρb i+1(t) + B i () ρb i+1 ()]. (15) By (3),(1) and (14) get: EL 2 i(t) = 2(λ µ) EL i (x)dx + (λ + µ)t µ p i (x)dx + i 2 = 2(λ µ) 1 µ [ B i(t) + ρb i+1 (t) + B i () ρb i+1 ()] + 2(λ µ)ρt/(1 ρ) + (λ + ρ)t + (λ µ)t + i EL i (t) + i 2 = 2(ρ 1) 1 µ [ B i(t) + ρb i+1 (t) + B i () ρb i+1 ()] ρ + 2(ρ 1) 1 ρ t + 2λt EL i(t) + i + i 2 ρ 1 ρ = λ/µ 1 (λ µ) = λ/µ (µ λ)/µ = λ µ λ

41 2. VAN DE COEVERING S RESULT AND EXTENSIONS 34 = 2(ρ 1) 1 µ [ B λ i(t) + ρb i+1 (t) + B i () ρb i+1 ()] 2(ρ 1) λ µ t + 2λt EL i (t) + i + i 2 = 2(ρ 1)[ B i (t) + ρb i+1 (t) + B i () ρb i+1 ()] EL i (t) + i + i 2. (16) Letting t and using that EL 2 i(t) (λµ + λ2 ) (µ λ) 2, (λµ + λ 2 ) (µ λ) 2 = 2(ρ 1)[ + + B i () ρb i+1 ()] ρ 1 ρ + i + i2 2(ρ 1)[B i () ρb i+1 ()] = (λµ + λ2 ) (µ λ) 2 + ρ 1 ρ i i2 = 2λµ (µ λ) 2 i i2 Thus, 2(ρ 1)[B i () ρb i+1 (t)()] = 2λµ (µ λ) 2 i i2. (17) Substituting (16) into (15) gets: EL 2 i(t) = 2(ρ 1)[ B i (t) + ρb i+1 (t)] + 2µλ (µ λ) 2 i i2 EL i (t) + i + i 2 = 2(ρ 1)[ B i (t) + ρb i+1 (t)] EL i (t) + 2ρ (1 ρ) 2. Lemma (new result) For an M/M/1 queue, with λ < µ, lim t EL 3 i(t) = E(L 3 ) = ρ3 + 4ρ 2 + ρ (1 ρ) 3.

42 2. VAN DE COEVERING S RESULT AND EXTENSIONS 35 Proof. E(L 3 ) = = i 3 π i i= i 3 (1 ρ)ρ i i= = (1 ρ)[ρ 3 i(i 1)(i 2)ρ i 3 + 3ρ 3 i 2 ρ i 3 2ρ 3 iρ i 3 ] i= = (1 ρ)[ρ 3 i(i 1)(i 2)ρ i i= i= i= i= i= i 2 ρ i 2ρ iρ i ] = (1 ρ)ρ 3 i(i 1)(i 2)ρ i 3 + 3(1 ρ) i 2 ρ i 2ρ(1 ρ) iρ i = (1 ρ)ρ 3 6 (1 ρ) 4 + (1 ρ)rho2 + ρ (1 ρ) 3 2ρ(1 ρ) 1 (1 ρ) 2 = ρ3 + 4ρ 2 + ρ (1 ρ) 3 i= i= i= Property (new result) For an M/M/1 queue, with λ < µ, EL 3 i (t) = 6µ(ρ 1)2 [ C i (t) + ρc i+1 (t)] + 5ρ3 ρ 2 + 2ρ (1 ρ) 3 3 ρ 1 EL2 i (t) 4 ρ ρ 1 EL i(t). (18) Proof. Together with (3), (5) and (13) get, EL 3 i(t) = 3(λ µ) + µ EL 2 i(x)dx + 3(λ + µ) p i (x)dx + i 3 EL i (x)dx + (λ µ)t

43 = 3(λ µ) 2. VAN DE COEVERING S RESULT AND EXTENSIONS (µ + λ) = 6(λ µ)(ρ 1) 2(ρ 1)[ B i (x) + ρb i+1 (x)] EL i (x) + 2ρ(1 ρ) 2 dx EL i (x)dx + (λ µ)t + EL i (t) (λ µ)t i + i 3 + 6(λ µ)ρ(1 ρ) 2 t + 3(µ + λ) (λ µ)t i + i 3 [ B i (x) + ρb i+1 (x)] dx 3(λ µ) = 6µ(ρ 1) 2 [ B i (x) + ρb i+1 (x)] dx 6µ + 6µ(ρ 1)ρ(1 ρ) 2 t + EL i (t) i + i 3 EL i (x)dx EL i (x)dx + (λ µ)t + EL i (t) EL(i, x)dx = 6µ(ρ 1) 2 [ B i (x) + ρb i+1 (x)] dx 6µ/µ[ B i (t) + ρb i+1 (t) + B i () ρb i+1 ()] 6µρt/(1 ρ) + 6µρt/(1 ρ) + EL i (t) i + i 3 = 6µ(ρ 1) 2 [ B i (x) + ρb i+1 (x)] dx 3(EL2 i (t) + EL i (t) 2ρ(1 ρ) 2 ) ρ 1 + EL i (t) i + i 3 = 6µ(ρ 1) 2 [ C i (t) + C i () + ρc i+1 (t) ρc i+1 ()] 3 ρ 1 EL2 i(t) 4 ρ ρ 1 EL i(t) i + i 3, when t, the equation becomes ρ 3 + 4ρ 2 + ρ = 6µ(ρ 1) 2 [C (1 ρ) 3 i () ρc i+1 ()] 3 λµ + λ 2 ρ 1 (µ λ) 2 4 ρ ρ ρ 1 1 ρ i + i3

44 2. VAN DE COEVERING S RESULT AND EXTENSIONS 37 6µ(ρ 1) 2 [C i () ρc i+1 ()] = ρ3 + 4ρ 2 + ρ 3ρ + 3ρ2 (1 ρ) 3 (1 ρ) 2 + 4ρ ρ2 (1 ρ) + i 2 i3 = ρ3 + 4ρ 2 + ρ 4ρ + ρ2 + (1 ρ) 3 (1 ρ) + i 2 i3 = 5ρ3 ρ 2 + 2ρ (1 ρ) 3 + i i 3. Thus, EL 3 i(t) = 6µ(ρ 1) 2 [ C i (t) + ρc i+1 (t)] + 5ρ3 ρ 2 + 2ρ (1 ρ) 3 + i i 3 3 ρ 1 EL2 i(t) 4 ρ ρ 1 EL i(t) i + i 3 = 6µ(ρ 1) 2 [ C i (t) + ρc i+1 (t)] + 5ρ3 ρ 2 + 2ρ (1 ρ) 3 3 ρ 1 EL2 i(t) 4 ρ ρ 1 EL i(t).

45 CHAPTER 3 Task versus Queue? MODEL: We have an M/M/1 queueing system. A customer arrives and sees i people in the system. This customer must receive service from the server and has to complete an additional task of fixed length D. The customer has two choices perform the task first or join the queue first. D S D S Figure 3.1. Which is better? 38

46 3. TASK VERSUS QUEUE? 39 (a) Let T QD be the total system time if the customer join Q first, then does the task (b) Let T DQ be the total system time if the customer join D first, then does the queue Assume i is the number of customers initially observed. Let p ij (t) = Prob(j customers at time t there are i customers at time ) Let E(T QD ) be the expected system time if the queue is done first; E(T DQ ) be the expected system time if the task is done first. This question was addressed by Hlynka and Molinaro (21). However, no graphical analysis. A graphical analysis provides an easy way of describing the results. Theorem 3.1. Given the setting above, (a) E(T QD ) = i + 1 µ + D (b) E(T DQ ) = D + EL i(d) + 1 µ Proof. Let X i, i = 1, 2, 3,... be independent and identically distributed service time random variables. (a) If the arriving customer joins the queue first, then the expected total time to complete the queue part is E( i+1 j=1 X j) because of the memoryless property and because the arriving customer must also be served. Then the customer must complete the task with time length D. Thus i+1 E(T QD ) = E( j=1 i+1 X i + D) = E(X i ) + D = j=1 i+1 j=1 1 µ + D = i + 1 µ + D. (b) If the arriving customer performs the task first, then upon completion of the task, the number of customers in the queueing system will be L i (D). Therefore, the time

47 to complete the queue part is L i (D)+1 j=1 X j. Hence, 3. TASK VERSUS QUEUE? 4 EL DQ = E(D + L i (D)+1 j=1 X j ) = D + E(L i (D) + 1)E(X j ) = D + E(L i(d) + 1). µ Theorem 3.2. (new result) For the setting above, E(T DQ ) < E(T QD ) iff EL i (D) < i. Proof. This follows immediately from the previous theorem. PROCEDURE: Suppose an arriving customer observes i customers in the M λ /M µ /1 queueing system upon arrival. (a) Draw the curve y = E(L i (t)). (b) Draw the line segment from (, i) until it intersects the curve (if it does) at (D, i). (c) If the task has time length D which is less than D, then perform the task first (in order to minimize the expected total system time for the arriving customer. Proof. From the previous theorem, E(T DQ ) < E(T QD ) iff EL i (D) < i. From Abate and Whitt (1987), the curve must have one of the three forms as illustrated by Diagram Hence if there is an intersection point (D, i), then EL i (D) < i iff D < D. We illustrate this in Figure 3.2.

48 3. TASK VERSUS QUEUE? 41 Figure 3.2. EL 1 (t) for λ = 3,µ = 4, < t <.5 All the diagrams are plotted by maple.

49 Bibliography [1] Abate, J. and Whitt, W. (1987) Transient behavior of the M/M/1 queue: Starting at the origin, Queueing Systems, 2, [2] Abate, J. and Whitt, W. (1988) Transient behavior of the M/M/1 queue via Laplace transforms, Advances in Applied Probability, 2, [3] Champernowne, D. G. (1956) An elementary method of solution of the queueing problem with a single server and constant parameters, Journal of the Royal Statistical Society, B18, [4] Conolly, B. W. and Langaris Christos (1993) On a New Formula for the Transient State Probabilities for M/M/1 Queue and Computational Implications. Journal of Applied Probability, Vol. 3, No. 1. Mar., [5] Clarke,A. B.(1953) The Time-Dependent. Waiting-Line Problem. University of Michigan. Engineering Research Institute, Report No. M72-1, R39. [6] Doorn, E. Van. (198) Stochastic Monotonicity and Queueing Applications of Birth-Death Processes. Lecture Notes in Statistics 4, Springer-Verlag, New York. [7] Gross, D., Shortle, J., Thompson, J., and Harris, C.M., (28) Fundamentals of Queueing Theory, 4th ed. New York: Wiley. [8] Hlynka, M. and Molinaro, S. (21) Comparing Expected Wait Times of a M/M/1 Queue. University of Windsor, Windsor, ON., N9B 3P4, Canada [9] Karlin, S. and McGregor, J.L., (1958) Many server queueing processes with Poisson input and exponential service times, Pacific Journal of Mathematics, 8, [1] Kleinrock, L. (1975) Queueing Systems, Vol.I. New York: Wiley. 42

50 BIBLIOGRAPHY 43 [11] Ledermann, W. and Reuter, G.E.H., (1954) Spectral theory for the differential equations of simple birth and death processes, Philosophical Transactions of the Royal Society, London, Ser. A, 246, [12] Leguesdron, P. Pellaumail, J. Rubino, G. Sericola,B. (1993) Transient Analysis of the M/M/1 Queue. Advances in Applied Probability, 25, No.3, [13] Morse, P.M. (1955). Stochastic properties of Waiting Lines. Operations Research, 3, [14] Morse, P.M. (1958). Queues, Inventories, and Maintenance. Wiley Publications. [15] Parthasarathy, P. R. (1987) A transient solution to an M/M/1 queue: a simple approach. Advances in Applied Probability, 19, [16] Sharma, O. P. (199) Markovian Queues. Ellis Horwood, Chichester. [17] Takacs, L. (1962) Introduction to the theory of queues. Oxford University Press, London. [18] Van de Coevering, M.C.T. (1995) Computing transient performance measures for the M/M/1 queue. OR Spektrum, 17, [19] Yu, H.B., He, Q.M., and Zhang, H. (26) Monotonicity and convexity of some functions. Probability and Engineering in the Information Sciences, 2,

Chapter 5. Continuous-Time Markov Chains. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan

Chapter 5. Continuous-Time Markov Chains. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Chapter 5. Continuous-Time Markov Chains Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Continuous-Time Markov Chains Consider a continuous-time stochastic process

More information

Continuous-Time Markov Chain

Continuous-Time Markov Chain Continuous-Time Markov Chain Consider the process {X(t),t 0} with state space {0, 1, 2,...}. The process {X(t),t 0} is a continuous-time Markov chain if for all s, t 0 and nonnegative integers i, j, x(u),

More information

M/M/1 Transient Queues and Path Counting

M/M/1 Transient Queues and Path Counting M/M/1 Transient Queues and Path Counting M.HlynaandL.M.Hurajt Department of Mathematics and Statistics University of Windsor Windsor, Ontario, Canada N9B 3P4 December 14, 006 Abstract We find combinatorially

More information

IEOR 6711, HMWK 5, Professor Sigman

IEOR 6711, HMWK 5, Professor Sigman IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.

More information

Introduction to Queuing Networks Solutions to Problem Sheet 3

Introduction to Queuing Networks Solutions to Problem Sheet 3 Introduction to Queuing Networks Solutions to Problem Sheet 3 1. (a) The state space is the whole numbers {, 1, 2,...}. The transition rates are q i,i+1 λ for all i and q i, for all i 1 since, when a bus

More information

A Queueing Model for Sleep as a Vacation

A Queueing Model for Sleep as a Vacation Applied Mathematical Sciences, Vol. 2, 208, no. 25, 239-249 HIKARI Ltd, www.m-hikari.com https://doi.org/0.2988/ams.208.8823 A Queueing Model for Sleep as a Vacation Nian Liu School of Mathematics and

More information

TCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis

TCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis TCOM 50: Networking Theory & Fundamentals Lecture 6 February 9, 003 Prof. Yannis A. Korilis 6- Topics Time-Reversal of Markov Chains Reversibility Truncating a Reversible Markov Chain Burke s Theorem Queues

More information

Laplace Transforms of Busy Periods in Queues

Laplace Transforms of Busy Periods in Queues Laplace Transforms of Busy Periods in Queues by Bingsen Yan A Major Paper Submitted to the Faculty of Graduate Studies through the Department of Mathematics and Statistics in Partial Fulfillment of the

More information

Continuous Time Markov Chains

Continuous Time Markov Chains Continuous Time Markov Chains Stochastic Processes - Lecture Notes Fatih Cavdur to accompany Introduction to Probability Models by Sheldon M. Ross Fall 2015 Outline Introduction Continuous-Time Markov

More information

Figure 10.1: Recording when the event E occurs

Figure 10.1: Recording when the event E occurs 10 Poisson Processes Let T R be an interval. A family of random variables {X(t) ; t T} is called a continuous time stochastic process. We often consider T = [0, 1] and T = [0, ). As X(t) is a random variable

More information

Solutions to Homework Discrete Stochastic Processes MIT, Spring 2011

Solutions to Homework Discrete Stochastic Processes MIT, Spring 2011 Exercise 6.5: Solutions to Homework 0 6.262 Discrete Stochastic Processes MIT, Spring 20 Consider the Markov process illustrated below. The transitions are labelled by the rate q ij at which those transitions

More information

Lecture 20: Reversible Processes and Queues

Lecture 20: Reversible Processes and Queues Lecture 20: Reversible Processes and Queues 1 Examples of reversible processes 11 Birth-death processes We define two non-negative sequences birth and death rates denoted by {λ n : n N 0 } and {µ n : n

More information

Stochastic process. X, a series of random variables indexed by t

Stochastic process. X, a series of random variables indexed by t Stochastic process X, a series of random variables indexed by t X={X(t), t 0} is a continuous time stochastic process X={X(t), t=0,1, } is a discrete time stochastic process X(t) is the state at time t,

More information

GI/M/1 and GI/M/m queuing systems

GI/M/1 and GI/M/m queuing systems GI/M/1 and GI/M/m queuing systems Dmitri A. Moltchanov moltchan@cs.tut.fi http://www.cs.tut.fi/kurssit/tlt-2716/ OUTLINE: GI/M/1 queuing system; Methods of analysis; Imbedded Markov chain approach; Waiting

More information

Stochastic Models in Computer Science A Tutorial

Stochastic Models in Computer Science A Tutorial Stochastic Models in Computer Science A Tutorial Dr. Snehanshu Saha Department of Computer Science PESIT BSC, Bengaluru WCI 2015 - August 10 to August 13 1 Introduction 2 Random Variable 3 Introduction

More information

Introduction to queuing theory

Introduction to queuing theory Introduction to queuing theory Queu(e)ing theory Queu(e)ing theory is the branch of mathematics devoted to how objects (packets in a network, people in a bank, processes in a CPU etc etc) join and leave

More information

reversed chain is ergodic and has the same equilibrium probabilities (check that π j =

reversed chain is ergodic and has the same equilibrium probabilities (check that π j = Lecture 10 Networks of queues In this lecture we shall finally get around to consider what happens when queues are part of networks (which, after all, is the topic of the course). Firstly we shall need

More information

Performance Modelling of Computer Systems

Performance Modelling of Computer Systems Performance Modelling of Computer Systems Mirco Tribastone Institut für Informatik Ludwig-Maximilians-Universität München Fundamentals of Queueing Theory Tribastone (IFI LMU) Performance Modelling of Computer

More information

Performance Evaluation of Queuing Systems

Performance Evaluation of Queuing Systems Performance Evaluation of Queuing Systems Introduction to Queuing Systems System Performance Measures & Little s Law Equilibrium Solution of Birth-Death Processes Analysis of Single-Station Queuing Systems

More information

Statistics 150: Spring 2007

Statistics 150: Spring 2007 Statistics 150: Spring 2007 April 23, 2008 0-1 1 Limiting Probabilities If the discrete-time Markov chain with transition probabilities p ij is irreducible and positive recurrent; then the limiting probabilities

More information

Link Models for Packet Switching

Link Models for Packet Switching Link Models for Packet Switching To begin our study of the performance of communications networks, we will study a model of a single link in a message switched network. The important feature of this model

More information

Probability and Statistics Concepts

Probability and Statistics Concepts University of Central Florida Computer Science Division COT 5611 - Operating Systems. Spring 014 - dcm Probability and Statistics Concepts Random Variable: a rule that assigns a numerical value to each

More information

Moments of first passage times in general birth death processes

Moments of first passage times in general birth death processes Moments of first passage times in general birth death processes Oualid Jouini, Yves Dallery To cite this version: Oualid Jouini, Yves Dallery. Moments of first passage times in general birth death processes.

More information

2905 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES

2905 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES 295 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES 16 Queueing Systems with Two Types of Customers In this section, we discuss queueing systems with two types of customers.

More information

Part I Stochastic variables and Markov chains

Part I Stochastic variables and Markov chains Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)

More information

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks Recap Probability, stochastic processes, Markov chains ELEC-C7210 Modeling and analysis of communication networks 1 Recap: Probability theory important distributions Discrete distributions Geometric distribution

More information

Other properties of M M 1

Other properties of M M 1 Other properties of M M 1 Přemysl Bejda premyslbejda@gmail.com 2012 Contents 1 Reflected Lévy Process 2 Time dependent properties of M M 1 3 Waiting times and queue disciplines in M M 1 Contents 1 Reflected

More information

M/G/1 and M/G/1/K systems

M/G/1 and M/G/1/K systems M/G/1 and M/G/1/K systems Dmitri A. Moltchanov dmitri.moltchanov@tut.fi http://www.cs.tut.fi/kurssit/elt-53606/ OUTLINE: Description of M/G/1 system; Methods of analysis; Residual life approach; Imbedded

More information

1 IEOR 4701: Continuous-Time Markov Chains

1 IEOR 4701: Continuous-Time Markov Chains Copyright c 2006 by Karl Sigman 1 IEOR 4701: Continuous-Time Markov Chains A Markov chain in discrete time, {X n : n 0}, remains in any state for exactly one unit of time before making a transition (change

More information

(b) What is the variance of the time until the second customer arrives, starting empty, assuming that we measure time in minutes?

(b) What is the variance of the time until the second customer arrives, starting empty, assuming that we measure time in minutes? IEOR 3106: Introduction to Operations Research: Stochastic Models Fall 2006, Professor Whitt SOLUTIONS to Final Exam Chapters 4-7 and 10 in Ross, Tuesday, December 19, 4:10pm-7:00pm Open Book: but only

More information

All models are wrong / inaccurate, but some are useful. George Box (Wikipedia). wkc/course/part2.pdf

All models are wrong / inaccurate, but some are useful. George Box (Wikipedia).  wkc/course/part2.pdf PART II (3) Continuous Time Markov Chains : Theory and Examples -Pure Birth Process with Constant Rates -Pure Death Process -More on Birth-and-Death Process -Statistical Equilibrium (4) Introduction to

More information

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974 LIMITS FOR QUEUES AS THE WAITING ROOM GROWS by Daniel P. Heyman Ward Whitt Bell Communications Research AT&T Bell Laboratories Red Bank, NJ 07701 Murray Hill, NJ 07974 May 11, 1988 ABSTRACT We study the

More information

2905 Queueing Theory and Simulation PART IV: SIMULATION

2905 Queueing Theory and Simulation PART IV: SIMULATION 2905 Queueing Theory and Simulation PART IV: SIMULATION 22 Random Numbers A fundamental step in a simulation study is the generation of random numbers, where a random number represents the value of a random

More information

1 Basic concepts from probability theory

1 Basic concepts from probability theory Basic concepts from probability theory This chapter is devoted to some basic concepts from probability theory.. Random variable Random variables are denoted by capitals, X, Y, etc. The expected value or

More information

Time Reversibility and Burke s Theorem

Time Reversibility and Burke s Theorem Queuing Analysis: Time Reversibility and Burke s Theorem Hongwei Zhang http://www.cs.wayne.edu/~hzhang Acknowledgement: this lecture is partially based on the slides of Dr. Yannis A. Korilis. Outline Time-Reversal

More information

Intro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin

Intro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin Queuing Networks Florence Perronnin Polytech Grenoble - UGA March 23, 27 F. Perronnin (UGA) Queuing Networks March 23, 27 / 46 Outline Introduction to Queuing Networks 2 Refresher: M/M/ queue 3 Reversibility

More information

Queueing Theory. VK Room: M Last updated: October 17, 2013.

Queueing Theory. VK Room: M Last updated: October 17, 2013. Queueing Theory VK Room: M1.30 knightva@cf.ac.uk www.vincent-knight.com Last updated: October 17, 2013. 1 / 63 Overview Description of Queueing Processes The Single Server Markovian Queue Multi Server

More information

A Result for a Counter Problem

A Result for a Counter Problem A Result for a Counter Problem M. Hlynka and P.H. Brill Department of Mathematics and Statistics University of Windsor Windsor, Ontario, Canada N9B 3P4 hlynka@uwindsor.ca January 2, 2008 Keywords: counter

More information

UNIVERSITY OF LONDON IMPERIAL COLLEGE LONDON

UNIVERSITY OF LONDON IMPERIAL COLLEGE LONDON UNIVERSITY OF LONDON IMPERIAL COLLEGE LONDON BSc and MSci EXAMINATIONS (MATHEMATICS) MAY JUNE 23 This paper is also taken for the relevant examination for the Associateship. M3S4/M4S4 (SOLUTIONS) APPLIED

More information

Lecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes

Lecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes Lecture Notes 7 Random Processes Definition IID Processes Bernoulli Process Binomial Counting Process Interarrival Time Process Markov Processes Markov Chains Classification of States Steady State Probabilities

More information

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem Wade Trappe Lecture Overview Network of Queues Introduction Queues in Tandem roduct Form Solutions Burke s Theorem What

More information

P (L d k = n). P (L(t) = n),

P (L d k = n). P (L(t) = n), 4 M/G/1 queue In the M/G/1 queue customers arrive according to a Poisson process with rate λ and they are treated in order of arrival The service times are independent and identically distributed with

More information

TMA4265 Stochastic processes ST2101 Stochastic simulation and modelling

TMA4265 Stochastic processes ST2101 Stochastic simulation and modelling Norwegian University of Science and Technology Department of Mathematical Sciences Page of 7 English Contact during examination: Øyvind Bakke Telephone: 73 9 8 26, 99 4 673 TMA426 Stochastic processes

More information

Class 11 Non-Parametric Models of a Service System; GI/GI/1, GI/GI/n: Exact & Approximate Analysis.

Class 11 Non-Parametric Models of a Service System; GI/GI/1, GI/GI/n: Exact & Approximate Analysis. Service Engineering Class 11 Non-Parametric Models of a Service System; GI/GI/1, GI/GI/n: Exact & Approximate Analysis. G/G/1 Queue: Virtual Waiting Time (Unfinished Work). GI/GI/1: Lindley s Equations

More information

Chapter 3 Balance equations, birth-death processes, continuous Markov Chains

Chapter 3 Balance equations, birth-death processes, continuous Markov Chains Chapter 3 Balance equations, birth-death processes, continuous Markov Chains Ioannis Glaropoulos November 4, 2012 1 Exercise 3.2 Consider a birth-death process with 3 states, where the transition rate

More information

Transient Solution of a Multi-Server Queue. with Catastrophes and Impatient Customers. when System is Down

Transient Solution of a Multi-Server Queue. with Catastrophes and Impatient Customers. when System is Down Applied Mathematical Sciences, Vol. 8, 2014, no. 92, 4585-4592 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2014.45388 Transient Solution of a Multi-Server Queue with Catastrophes and Impatient

More information

Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing

Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing Submitted to Management Science manuscript MS-251-27 Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing Rishi Talreja, Ward Whitt Department of

More information

Markov chains. 1 Discrete time Markov chains. c A. J. Ganesh, University of Bristol, 2015

Markov chains. 1 Discrete time Markov chains. c A. J. Ganesh, University of Bristol, 2015 Markov chains c A. J. Ganesh, University of Bristol, 2015 1 Discrete time Markov chains Example: A drunkard is walking home from the pub. There are n lampposts between the pub and his home, at each of

More information

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18. IEOR 6711: Stochastic Models I, Fall 23, Professor Whitt Solutions to Final Exam: Thursday, December 18. Below are six questions with several parts. Do as much as you can. Show your work. 1. Two-Pump Gas

More information

Economy of Scale in Multiserver Service Systems: A Retrospective. Ward Whitt. IEOR Department. Columbia University

Economy of Scale in Multiserver Service Systems: A Retrospective. Ward Whitt. IEOR Department. Columbia University Economy of Scale in Multiserver Service Systems: A Retrospective Ward Whitt IEOR Department Columbia University Ancient Relics A. K. Erlang (1924) On the rational determination of the number of circuits.

More information

Outline. Finite source queue M/M/c//K Queues with impatience (balking, reneging, jockeying, retrial) Transient behavior Advanced Queue.

Outline. Finite source queue M/M/c//K Queues with impatience (balking, reneging, jockeying, retrial) Transient behavior Advanced Queue. Outline Finite source queue M/M/c//K Queues with impatience (balking, reneging, jockeying, retrial) Transient behavior Advanced Queue Batch queue Bulk input queue M [X] /M/1 Bulk service queue M/M [Y]

More information

Time to Ruin for. Loss Reserves. Mubeen Hussain

Time to Ruin for. Loss Reserves. Mubeen Hussain Time to Ruin for Loss Reserves by Mubeen Hussain A Major Paper Submitted to the Faculty of Graduate Studies through the Department of Mathematics and Statistics in Partial Fulfillment of the Requirements

More information

Since D has an exponential distribution, E[D] = 0.09 years. Since {A(t) : t 0} is a Poisson process with rate λ = 10, 000, A(0.

Since D has an exponential distribution, E[D] = 0.09 years. Since {A(t) : t 0} is a Poisson process with rate λ = 10, 000, A(0. IEOR 46: Introduction to Operations Research: Stochastic Models Chapters 5-6 in Ross, Thursday, April, 4:5-5:35pm SOLUTIONS to Second Midterm Exam, Spring 9, Open Book: but only the Ross textbook, the

More information

Queuing Theory. Richard Lockhart. Simon Fraser University. STAT 870 Summer 2011

Queuing Theory. Richard Lockhart. Simon Fraser University. STAT 870 Summer 2011 Queuing Theory Richard Lockhart Simon Fraser University STAT 870 Summer 2011 Richard Lockhart (Simon Fraser University) Queuing Theory STAT 870 Summer 2011 1 / 15 Purposes of Today s Lecture Describe general

More information

Weighted Sums of Orthogonal Polynomials Related to Birth-Death Processes with Killing

Weighted Sums of Orthogonal Polynomials Related to Birth-Death Processes with Killing Advances in Dynamical Systems and Applications ISSN 0973-5321, Volume 8, Number 2, pp. 401 412 (2013) http://campus.mst.edu/adsa Weighted Sums of Orthogonal Polynomials Related to Birth-Death Processes

More information

Queueing. Chapter Continuous Time Markov Chains 2 CHAPTER 5. QUEUEING

Queueing. Chapter Continuous Time Markov Chains 2 CHAPTER 5. QUEUEING 2 CHAPTER 5. QUEUEING Chapter 5 Queueing Systems are often modeled by automata, and discrete events are transitions from one state to another. In this chapter we want to analyze such discrete events systems.

More information

ACM 116 Problem Set 4 Solutions

ACM 116 Problem Set 4 Solutions ACM 6 Problem Set 4 Solutions Lei Zhang Problem Answer (a) is correct. Suppose I arrive at time t, and the first arrival after t is bus N i + and occurs at time T Ni+. Let W t = T Ni+ t, which is the waiting

More information

LECTURE #6 BIRTH-DEATH PROCESS

LECTURE #6 BIRTH-DEATH PROCESS LECTURE #6 BIRTH-DEATH PROCESS 204528 Queueing Theory and Applications in Networks Assoc. Prof., Ph.D. (รศ.ดร. อน นต ผลเพ ม) Computer Engineering Department, Kasetsart University Outline 2 Birth-Death

More information

CDA5530: Performance Models of Computers and Networks. Chapter 4: Elementary Queuing Theory

CDA5530: Performance Models of Computers and Networks. Chapter 4: Elementary Queuing Theory CDA5530: Performance Models of Computers and Networks Chapter 4: Elementary Queuing Theory Definition Queuing system: a buffer (waiting room), service facility (one or more servers) a scheduling policy

More information

Lecture 4a: Continuous-Time Markov Chain Models

Lecture 4a: Continuous-Time Markov Chain Models Lecture 4a: Continuous-Time Markov Chain Models Continuous-time Markov chains are stochastic processes whose time is continuous, t [0, ), but the random variables are discrete. Prominent examples of continuous-time

More information

Probability Distributions

Probability Distributions Lecture : Background in Probability Theory Probability Distributions The probability mass function (pmf) or probability density functions (pdf), mean, µ, variance, σ 2, and moment generating function (mgf)

More information

Department of Applied Mathematics Faculty of EEMCS. University of Twente. Memorandum No Birth-death processes with killing

Department of Applied Mathematics Faculty of EEMCS. University of Twente. Memorandum No Birth-death processes with killing Department of Applied Mathematics Faculty of EEMCS t University of Twente The Netherlands P.O. Box 27 75 AE Enschede The Netherlands Phone: +3-53-48934 Fax: +3-53-48934 Email: memo@math.utwente.nl www.math.utwente.nl/publications

More information

M/M/1 Queueing System with Delayed Controlled Vacation

M/M/1 Queueing System with Delayed Controlled Vacation M/M/1 Queueing System with Delayed Controlled Vacation Yonglu Deng, Zhongshan University W. John Braun, University of Winnipeg Yiqiang Q. Zhao, University of Winnipeg Abstract An M/M/1 queue with delayed

More information

UNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours.

UNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours. UNIVERSITY OF YORK MSc Examinations 2004 MATHEMATICS Networks Time Allowed: 3 hours. Answer 4 questions. Standard calculators will be provided but should be unnecessary. 1 Turn over 2 continued on next

More information

Markovian N-Server Queues (Birth & Death Models)

Markovian N-Server Queues (Birth & Death Models) Markovian -Server Queues (Birth & Death Moels) - Busy Perio Arrivals Poisson (λ) ; Services exp(µ) (E(S) = /µ) Servers statistically ientical, serving FCFS. Offere loa R = λ E(S) = λ/µ Erlangs Q(t) = number

More information

T. Liggett Mathematics 171 Final Exam June 8, 2011

T. Liggett Mathematics 171 Final Exam June 8, 2011 T. Liggett Mathematics 171 Final Exam June 8, 2011 1. The continuous time renewal chain X t has state space S = {0, 1, 2,...} and transition rates (i.e., Q matrix) given by q(n, n 1) = δ n and q(0, n)

More information

ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS

ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS J.R. ARTALEJO, Department of Statistics and Operations Research, Faculty of Mathematics, Complutense University of Madrid,

More information

Examination paper for TMA4265 Stochastic Processes

Examination paper for TMA4265 Stochastic Processes Department of Mathematical Sciences Examination paper for TMA4265 Stochastic Processes Academic contact during examination: Andrea Riebler Phone: 456 89 592 Examination date: December 14th, 2015 Examination

More information

The Transition Probability Function P ij (t)

The Transition Probability Function P ij (t) The Transition Probability Function P ij (t) Consider a continuous time Markov chain {X(t), t 0}. We are interested in the probability that in t time units the process will be in state j, given that it

More information

Chapter 2: Random Variables

Chapter 2: Random Variables ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:

More information

Markov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains

Markov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains Markov Chains A random process X is a family {X t : t T } of random variables indexed by some set T. When T = {0, 1, 2,... } one speaks about a discrete-time process, for T = R or T = [0, ) one has a continuous-time

More information

Exponential Distribution and Poisson Process

Exponential Distribution and Poisson Process Exponential Distribution and Poisson Process Stochastic Processes - Lecture Notes Fatih Cavdur to accompany Introduction to Probability Models by Sheldon M. Ross Fall 215 Outline Introduction Exponential

More information

A Birth and Death Process Related to the Rogers-Ramanujan Continued Fraction

A Birth and Death Process Related to the Rogers-Ramanujan Continued Fraction A Birth and Death Process Related to the Rogers-Ramanujan Continued Fraction P. R. Parthasarathy, R. B. Lenin Department of Mathematics Indian Institute of Technology, Madras Chennai - 600 036, INDIA W.

More information

EXAM IN COURSE TMA4265 STOCHASTIC PROCESSES Wednesday 7. August, 2013 Time: 9:00 13:00

EXAM IN COURSE TMA4265 STOCHASTIC PROCESSES Wednesday 7. August, 2013 Time: 9:00 13:00 Norges teknisk naturvitenskapelige universitet Institutt for matematiske fag Page 1 of 7 English Contact: Håkon Tjelmeland 48 22 18 96 EXAM IN COURSE TMA4265 STOCHASTIC PROCESSES Wednesday 7. August, 2013

More information

Quantitative Model Checking (QMC) - SS12

Quantitative Model Checking (QMC) - SS12 Quantitative Model Checking (QMC) - SS12 Lecture 06 David Spieler Saarland University, Germany June 4, 2012 1 / 34 Deciding Bisimulations 2 / 34 Partition Refinement Algorithm Notation: A partition P over

More information

Continuous time Markov chains

Continuous time Markov chains Continuous time Markov chains Alejandro Ribeiro Dept. of Electrical and Systems Engineering University of Pennsylvania aribeiro@seas.upenn.edu http://www.seas.upenn.edu/users/~aribeiro/ October 16, 2017

More information

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1 Queueing systems Renato Lo Cigno Simulation and Performance Evaluation 2014-15 Queueing systems - Renato Lo Cigno 1 Queues A Birth-Death process is well modeled by a queue Indeed queues can be used to

More information

HEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES

HEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES HEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES by Peter W. Glynn Department of Operations Research Stanford University Stanford, CA 94305-4022 and Ward Whitt AT&T Bell Laboratories Murray Hill, NJ 07974-0636

More information

LIMITS AND APPROXIMATIONS FOR THE M/G/1 LIFO WAITING-TIME DISTRIBUTION

LIMITS AND APPROXIMATIONS FOR THE M/G/1 LIFO WAITING-TIME DISTRIBUTION LIMITS AND APPROXIMATIONS FOR THE M/G/1 LIFO WAITING-TIME DISTRIBUTION by Joseph Abate 1 and Ward Whitt 2 April 15, 1996 Revision: January 2, 1997 Operations Research Letters 20 (1997) 199 206 1 900 Hammond

More information

Chapter 8 Queuing Theory Roanna Gee. W = average number of time a customer spends in the system.

Chapter 8 Queuing Theory Roanna Gee. W = average number of time a customer spends in the system. 8. Preliminaries L, L Q, W, W Q L = average number of customers in the system. L Q = average number of customers waiting in queue. W = average number of time a customer spends in the system. W Q = average

More information

Birth-Death Processes

Birth-Death Processes Birth-Death Processes Birth-Death Processes: Transient Solution Poisson Process: State Distribution Poisson Process: Inter-arrival Times Dr Conor McArdle EE414 - Birth-Death Processes 1/17 Birth-Death

More information

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking Lecture 7: Simulation of Markov Processes Pasi Lassila Department of Communications and Networking Contents Markov processes theory recap Elementary queuing models for data networks Simulation of Markov

More information

Queueing Review. Christos Alexopoulos and Dave Goldsman 10/25/17. (mostly from BCNN) Georgia Institute of Technology, Atlanta, GA, USA

Queueing Review. Christos Alexopoulos and Dave Goldsman 10/25/17. (mostly from BCNN) Georgia Institute of Technology, Atlanta, GA, USA 1 / 26 Queueing Review (mostly from BCNN) Christos Alexopoulos and Dave Goldsman Georgia Institute of Technology, Atlanta, GA, USA 10/25/17 2 / 26 Outline 1 Introduction 2 Queueing Notation 3 Transient

More information

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems  M/M/1  M/M/m  M/M/1/K Queueing Theory I Summary Little s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K " Little s Law a(t): the process that counts the number of arrivals

More information

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations Chapter 5 Statistical Models in Simulations 5.1 Contents Basic Probability Theory Concepts Discrete Distributions Continuous Distributions Poisson Process Empirical Distributions Useful Statistical Models

More information

1 + lim. n n+1. f(x) = x + 1, x 1. and we check that f is increasing, instead. Using the quotient rule, we easily find that. 1 (x + 1) 1 x (x + 1) 2 =

1 + lim. n n+1. f(x) = x + 1, x 1. and we check that f is increasing, instead. Using the quotient rule, we easily find that. 1 (x + 1) 1 x (x + 1) 2 = Chapter 5 Sequences and series 5. Sequences Definition 5. (Sequence). A sequence is a function which is defined on the set N of natural numbers. Since such a function is uniquely determined by its values

More information

Exercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010

Exercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010 Exercises Stochastic Performance Modelling Hamilton Institute, Summer Instruction Exercise Let X be a non-negative random variable with E[X ]

More information

BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS

BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS Andrea Bobbio Anno Accademico 999-2000 Queueing Systems 2 Notation for Queueing Systems /λ mean time between arrivals S = /µ ρ = λ/µ N mean service time traffic

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 011 MODULE 3 : Stochastic processes and time series Time allowed: Three Hours Candidates should answer FIVE questions. All questions carry

More information

Part II: continuous time Markov chain (CTMC)

Part II: continuous time Markov chain (CTMC) Part II: continuous time Markov chain (CTMC) Continuous time discrete state Markov process Definition (Markovian property) X(t) is a CTMC, if for any n and any sequence t 1

More information

Universal examples. Chapter The Bernoulli process

Universal examples. Chapter The Bernoulli process Chapter 1 Universal examples 1.1 The Bernoulli process First description: Bernoulli random variables Y i for i = 1, 2, 3,... independent with P [Y i = 1] = p and P [Y i = ] = 1 p. Second description: Binomial

More information

CDA5530: Performance Models of Computers and Networks. Chapter 3: Review of Practical

CDA5530: Performance Models of Computers and Networks. Chapter 3: Review of Practical CDA5530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic ti process X = {X(t), t T} is a collection of random variables (rvs); one

More information

Queueing Review. Christos Alexopoulos and Dave Goldsman 10/6/16. (mostly from BCNN) Georgia Institute of Technology, Atlanta, GA, USA

Queueing Review. Christos Alexopoulos and Dave Goldsman 10/6/16. (mostly from BCNN) Georgia Institute of Technology, Atlanta, GA, USA 1 / 24 Queueing Review (mostly from BCNN) Christos Alexopoulos and Dave Goldsman Georgia Institute of Technology, Atlanta, GA, USA 10/6/16 2 / 24 Outline 1 Introduction 2 Queueing Notation 3 Transient

More information

Integrals for Continuous-time Markov chains

Integrals for Continuous-time Markov chains Integrals for Continuous-time Markov chains P.K. Pollett Abstract This paper presents a method of evaluating the expected value of a path integral for a general Markov chain on a countable state space.

More information

Markov Processes and Queues

Markov Processes and Queues MIT 2.853/2.854 Introduction to Manufacturing Systems Markov Processes and Queues Stanley B. Gershwin Laboratory for Manufacturing and Productivity Massachusetts Institute of Technology Markov Processes

More information

stochnotes Page 1

stochnotes Page 1 stochnotes110308 Page 1 Kolmogorov forward and backward equations and Poisson process Monday, November 03, 2008 11:58 AM How can we apply the Kolmogorov equations to calculate various statistics of interest?

More information

Photo: US National Archives

Photo: US National Archives ESD.86. Markov Processes and their Application to Queueing II Richard C. Larson March 7, 2007 Photo: US National Archives Outline Little s Law, one more time PASTA treat Markov Birth and Death Queueing

More information

Q = (c) Assuming that Ricoh has been working continuously for 7 days, what is the probability that it will remain working at least 8 more days?

Q = (c) Assuming that Ricoh has been working continuously for 7 days, what is the probability that it will remain working at least 8 more days? IEOR 4106: Introduction to Operations Research: Stochastic Models Spring 2005, Professor Whitt, Second Midterm Exam Chapters 5-6 in Ross, Thursday, March 31, 11:00am-1:00pm Open Book: but only the Ross

More information

Series Expansions in Queues with Server

Series Expansions in Queues with Server Series Expansions in Queues with Server Vacation Fazia Rahmoune and Djamil Aïssani Abstract This paper provides series expansions of the stationary distribution of finite Markov chains. The work presented

More information