arxiv: v1 [math.pr] 5 Aug 2013

Transcription

1 BRAVO for many-server QED systems with finite buffers Daryl J. Daley, Johan S.H. van Leeuwaarden, Yoni Nazarathy arxiv:38.933v [math.pr] 5 Aug 23 September 7, 28 Abstract This paper demonstrates the occurrence of the feature called BRAVO Balancing Reduces Asymptotic Variance of Output for the departure process of a finite-buffer Markovian manyserver system in the QED Quality and Efficiency-Driven heavy-traffic regime. The results are based on evaluating the limit of a formula for the asymptotic variance of death counts in finite birth death processes. Introduction The QED Quality and Efficiency Driven regime for many-server systems combines large capacity with high utilization while maintaining satisfactory system performance. In the QED regime the arrival rate λ and the number of servers s are scaled in such a way that while they both increase towards infinity, the traffic intensity ρ = ρ s = λ/µ assuming service rate µ/s per server approaches one and s s,,.. Halfin and Whitt [] introduced the QED regime for the GI/M/s system. Under the scaling., assuming >, the stationary probability of delay was shown to converge to a nondegenerate limit, bounded away from both zero and one. Limit theorems for other, more general systems were obtained in [, 3, 4, 5, 6, 2], and for all those cases, the limiting probability of delay remains in the interval,. In fact, not only the probability of delay, but several other performance characteristics or objective functions are shown to behave near optimally in the QED regime see [3, 9]. Associated with the near optimal behaviour is the fact that the process Q s that counts the total number of customers in the system at any time exhibits relatively small fluctuations. Department of Mathematics and Statistics, The University of Melbourne, dndaley@gmail.com. Department of Mathematics and CS, Eindhoven University of Technology. j.s.h.v.leeuwaarden@tue.nl. School of Mathematics and Physics, The University of Queensland. y.nazarathy@uq.edu.au.

2 Halfin and Whitt [] showed for the GI/M/s system that under. a sequence of standardized processes X s, with X s t := Q s t s/ s, converges as s to a diffusion process X. This diffusion process behaves like a Brownian motion with drift above zero and like an Ornstein Uhlenbeck process below zero. The interpretation of this scaled process is as follows: In case, X s t >, it represents the scaled number of customers waiting for service, whereas in case X s t <, it represents the scaled number of idle servers. This result shows that the natural scale that emerges is of the order s: Specifically, both the queue length and the number of idle servers in the system are of the order s. Due to its favorable behavior, the many-server QED regime has been a major focal point of applied probability and stochastic operations research in the past 3 years. The many extensions of the Halfin Whitt exposition in [] have lead to theoretical advances in the areas of stochasticprocess limits and asymptotic dimensioning. From an operational point of view, the QED regime has found many applications in the planning, analysis and optimization of queueing, inventory and service systems see for example [2]. In this paper we explore the presence of a BRAVO effect in the QED regime. BRAVO is short for Balancing Reduces Asymptotic Variance of Outputs. This again would be a favourable property of QED, this time for the departure process N dep, ], where N dep, t] counts the number of serviced customers during the time interval, t]. The study of departure or output processes of queues has a long tradition, see for example the classic surveys [5] and [7], yet only recently the surprising phenomenon of the BRAVO effect has been reported. The BRAVO effect is captured in terms of the asymptotic ratio of the variance and the mean of the departure process var Ndep, t] D := lim t E N dep, t]..2 For Poisson processes D =, and more generally for renewal processes, D equals the ratio of the variance of the renewal lifetime and the square of the mean lifetime. Thus it is initially surprising that for M/M//K systems, D is minimized when the arrival rate λ is equal to the service rate µ with a minimum equal to o K, where o K is a term that vanishes as K. This was shown in [9]. Further, when K =, it is well known that D = whenever λ µ, yet it was shown in [] that in the critical case that λ = µ, D = 2 2/π 2 3. The work in [] goes further, generalizing this M/M/ result to GI/GI/ systems and even multi-server GI/GI/s systems with a finite bounded number of servers s. Hence, by BRAVO we mean that D < when ρ =. For overviews of BRAVO results we refer to [6] and [8]. In this paper we study the BRAVO effect in the QED regime by equipping the many-server M/M/s system with a finite waiting capacity K. In order to create a finite-capacity effect in the QED regime that is neither dominant nor negligible, it is plausible to assume that K η s, because the natural scale of the queue length is s. More precisely, we study a sequence of systems in which both K and s grow in such a way that K s η.3 2

3 for some positive η. A similar threshold K η s in the context of many-server systems in the QED regime has been considered in [2, 2, 7, 23, 24]. Hence, in addition to the parameter in. describing the scaled shortfall from one in the system capacity, our system includes a parameter η describing the relative buffer size. Our result on the BRAVO effect in the QED regime is in terms of D,η := lim lim var N dep, t] s,k t E N dep, t],.4 where the outer limit is taken under the constraints at. and.3. Our analysis that leads to explicit representations for D,η is based on the following general result for output processes of birth death processes. Consider a finite, irreducible, birth death process Q on {,,..., J} with birth rates λ, λ,..., λ J and death rates µ, µ 2,..., µ J. Let {π i } denote the stationary distribution for Q with cumulative distribution P i = i j= π j, and let N dep, t] denote the number of deaths in, t]. Denote the departure rate by and write λ EN dep, t] := lim = t t Λ i = i j= µ jπ j λ J µ j π j, for what are cumulative probabilities. Then we know from [9, Theorem ] that var Ndep, t] J D π := lim = 2 P i Λ i λ P i Λ i..5 t EN dep, t] π i λ i Note that.5 is in a slightly different form from that appearing in [9]; the translation between the two forms is immediate. In this paper we use.5 so as to obtain explicit expressions for D,η in the case of M/M/s/K systems. To do so we use the fact that in birth death processes with λ i λ, we have i= j= λ = λ π J, Λ i = P i π J, P i Λ i = π i π J P i π J, and after basic manipulation,.5 can be represented as π J D π = 2 π J J i= P i π J P i π i..6 In the case of the M/M/s/K system, this elegant form proves amenable to manipulation and asymptotics under the QED regime, yielding our desired explicit formulae for D,η defined in.4. Carrying out these asymptotics is the main contribution of the current paper. A further virtue of the form.6, which is of independent interest, is that it demonstrates that for the 3

4 case λ i = λ, D π /2 π J π J..7 To see this observe that the function x x x is maximized at x = /4, so that 2 D π π J = J i= π J P i π i π JP i π i π i 4. The lower bound.7 implies that as long as π J, as in the M/M/s/K system, D,η /2. Our explicit expressions for D,η for ρ in fact establish that D,η is in the range.6, 2 3 with the exact value depending on η. Hence for QED systems, the magnitude of the BRAVO effect is not exactly the same as for single server systems, but it is in a similar range. Similar results are found for QED systems with non-zero for which is not too big. The remainder of this paper is structured as follows. In Section 2 we give our main theorem on the BRAVO effect for the M/M/s/K system, which presents an expression for the asymptotic ratio D,η for both the case ρ i.e. = and for the case i.e. ρ / s. The proofs for these two cases are presented in Sections 3 and 4, respectively. We present some conclusions and ideas for future work in Section 5. The appendix contains some needed asymptotic properties of Poisson probabilities. 2 Main result We now state the main theorem of this paper, which identifies the BRAVO effect in many-server QED systems in terms of the asymptotic output ratio. Let Φ and φ denote the distribution and density of a standard normal random variable. Theorem. Let s, K in such a way that K/ s η for some finite positive η. a Let ρ =. Then D,η = 2 Lη, 2. 3 where Lη = 2 π 2 η + 2π log 2 π 2 η + π where b Let ρ = / s for finite. Then D,η = 22 e η h 2 η, fη, + gη,, 2.3 φ hη, = e η + Φ φ, 2.4 4

5 Η Η and, with h = hη,, Figure : The asymptotic value of D,η as a function of η when ρ. fη, = e η hη, Φ u φu Φ u du, 2.5 gη, = 2e η h + e η h η e η + 2ηe η e 2η h. 2.6 We start by discussing Theorem a. Figure displays D,η as a function of η. Observe that as η which includes the case of a fixed finite number of servers with a large, but finite buffer, we have D,η 2 3. Further, for η = we have D,η = 4 log 2 π It is also easy to verify that as a function of η, D,η has a unique global minimum at 2πlog 8 2 η =.232, π yielding inf η D,η.68. We now turn to Theorem b. Figure 2 displays D,η as a function of and η. The figure suggests that, for fixed η, lim D,η = lim D,η = and indeed this follows from the exact expression in 2.3. In fact, this can also be explained using the following heuristic reasoning. As, the system becomes lightly loaded, and the process Q s behaves as an infinite-server system, which is reversible and therefore has an asymptotic output ratio equal to one. Also, as, the system becomes increasingly overloaded, so that the process Q s behaves like a single-server system in which all servers 5

6 Β Η..9.8 Η 2 Η Η Β Figure 2: The asymptotic value of D,η for various η values. work all the time. Such a single-server process is again a reversible birth death process, which has an asymptotic output ratio equal to one. For any finite, the behaviour of the process Q s resembles a mixture of an infinite-server system and a single-server system, and it is this alternation between two different stable systems that may explain the BRAVO effect. This effect is most pronounced for values of close to zero. We now present some further arguments about why the scaling relations in. and.3 are the precise scalings needed to create the BRAVO effect. We first show that the scaling relation in fact leads to a well-defined stochastic-process limit of the entire queue-length process. Then we establish, using Gaussian approximations for the Poisson distribution, non-degenerate limits for the stationary distribution. Let denote weak convergence in the space D[, or convergence in distribution. The following result is proved in [2, Thm..2]. Proposition 2 Weak convergence to a diffusion process. Assume. and.3. If X s X R, then for every t, as s, X s t Xt η, where the limit X is the diffusion process with infinitesimal drift when x > and x when x <, and constant infinitesimal variance 2. With minor abuse of notation, let X, X s and Q s without time arguments denote stationary random variables. One of the signature features of the QED regime is that, due to economies of scale, the stationary probability of delay PQ s s = K i=s π i converges to a limit that is neither zero nor one. This feature continues to exist for our model with the finite-capacity scaling. For convenience we state it formally below, showing the relation of hη, to the probability of delay the result appears at equation 4.7 of the unpublished manuscript [7]: 6

7 Proposition 3 Probability of delay in QED regime. Assume. and.3. Then lim PQ s s = s e η e η + Φ φ = e η hη,. 2.9 It can be shown that the right-hand side of 2.9 corresponds to the probability PX > that the stationary diffusion process is positive see [4], as suggested by Proposition 2. We choose, however, to give a direct derivation, starting from the exact expression for PQ s s. We do so in order to give insight into the crucial role played by Gaussian approximations of the Poisson distribution; approximations constitute an important ingredient for the proof of the main theorem. Recall the representation for the stationary distribution {π i } of the number in the manyserver queueing system M/M/s/K, arrival rate λ and service rate µ/s per server, sλ/µ i i! π for i =,,..., s, sρ i π i = λ/µ i s π s for i = s, s +,..., s + K, := i! π, ρ i s π s. 2. For finite κ >, let {ϖ i κ = e κ κ i /i!, i =,,...} denote the Poisson distribution with mean κ. Observe that for i =,..., s, where b s ρ := π e sρ. π i = π e sρ ϖ i sρ := b s ρϖ i sρ, 2. The stationary distribution {π i } has three parameters: ρ, K and s, but they must satisfy the constraint = s+k i= s π i = + i= s+k i=s+ π i. 2.2 Thus when λ = µ, i.e. ρ =, the latter sum equals Kπ s, and the former sum equals b s s i= ϖ i s = b s 2 + ψ ss s 2.3 by the central limit property for the Poisson distribution see Lemma 8 for constants ψ ss satisfying sup s ψ ss <. Using Stirling s formula, π s = ϖ ss π ϖ s = ss s! = s s s/e + ϑ s = [ + Os ]e s / 2πs, 2.4 s 2πs 2s for some ϑ s for which ϑ s <. So b s = π e s = π s 2πs [ + ϑs /2s], and [ = π s 2 + ψ ] ss 2πs 2πs + ϑ s /2s + K

8 Then K = π s s π/2 + s + o, 2.6 hence, using.3, π s s π/2 + η. 2.7 Also, b s = π s s 2π + ϑs /2s 2π/ π/2 + η =: b as s. More generally, for Theorem we examine M/M/s/K systems for which ρ s = λ/µ = / s and s, K as at.3. The sums of terms π i over i s and i > s now equal b s ρ s i= [ s sρ ] ϖ i sρ = b s ρ Φ + Os 2 sρ and π s K i= ρ i = π s ρρ K ρ 2.8 respectively. Here we have used the central limit property of a Poisson distribution with mean sρ as in Lemma 8. Substitution for ρ gives, correct to terms that are O/ s, π e sρ Φ and s πs e η / when s, K as in.3. The local asymptotic normality of Poisson probabilities cf. Lemma 7 implies b s ρ = π s π π s e sρ = π s e sρ sρ s/ s! sρ πs = φ s sρ/ sρ + Os s πs 2 = + Os 2. φ The terms on the left-hand sides of the relations in 2.8 add to, so that o = Φ s π s φ + e η s πs =: hη, 2.2 and s π s hη,. Also, lim s b s ρ = lim s π e sρ = hη, /φ. Proposition 3 follows from combining 2.8 and Proof of Theorem : the case ρ = Since π i = π s for i s, P i = K + s iπ s. Write.6 as π J D,η = 2π s J i= π J P i π J P i π s π i in which the last sum, for which π s = π i = π J, equals 2π s K i = s = 2π s + i= s+k i=s, 3. [K i ]π s K i π s = KK + πs 2 KK + 2K + π3 s, 3 η 2 2 π/2 + η 3 η3 2 π/2 + η = η2 π/2 + 3 η3 3 π/2 + η 3 8

9 when s, K as at.3, using also 2.7. It thus remains to consider the sum s S s := 2 π s P i π s P i, 3.2 π i i= which in terms of Poisson probabilities ϖ i := ϖ i s and the multiplier b s := b s becomes S s = 2b 2 s s i= Π s i s b s ϖ s ϖ s Π s i s. 3.3 ϖ s i Now both components of this sum for S s have finite limits see below, and b s b see also below 2.7, finite and positive; we use this limit in examining the expression at 3.3. Substitute from Lemmas 7 and 8 for the Poisson probabilities and assume for the moment that conditions for uniform convergence are met. Then S s 2b 2 s b e 2 x2 si Φ xsi Φ x si, 3.4 2π s i= where x si = i/ s. Recognize that this sum is an approximation to the Riemann integral 2b 2 s 2π [ ] b e 2 u2 Φ u Φ u du 3.5 based on the s intervals determined by the s + points {i/ s }, i =,..., s. These integrals certainly converge as s, because the improper Riemann integral is finite its integrand is non-negative and dominated by Φ u whose integral on R + equals / 2π. To prove that the improper integral based on 3.5 is indeed equal to lim s S s, there are essentially two tasks: one relates to the finiteness of the limit of the finite sum, and the other to the convergence of the summands to the function involving the normal distribution function Φ and its density φ. These two tasks overlap in the sense that the part of the argument in the latter requiring uniform convergence follows from truncating the infinite sum. It is convenient to rewrite the sum for S s as an integral, namely S s = g s x ν s dx, R where for each positive integer s, ν s is a purely atomic measure on R + with support set {x si } := {i/ s : i =,..., s } and mass 2b 2 sϖ s s Π s i s at i/ s, and g s x is a right-continuous simple function defined on R + equal to b s Π s s at and with upward jumps at each point i/ s, i =,..., s, where g s x si + = b s ϖ s /ϖ s i Π s i s. We first show that Π s i s/ϖ s i s is a monotone sequence in i, and that its analogue e 2 x2 Φ x is monotonic in x. For the former, recall that the partial sum Π i s is a tail integral 9

10 of a gamma density function e.g. Johnson et al. 993, equation 4.8, so Π i s ϖ i s = es i! s i s u ui e i! du = e v + v s i dv, 3.7 which is monotonic increasing in i, hence b s Π s s b s ϖ s Π s i s/ϖ s i s b s ϖ s for i s. This monotonicity implies that each function g s has all jumps upwards as asserted. For the size of the jumps we evaluate omitting here the common argument s [ Πi+ ϖ s Π ] [ ] i ϖ i Πi + ϖ i+ ϖi+ Π [ i = ϖ s = ϖ s i + ϖ i+ ϖ i ϖ i+ ϖ i s Πi ], 3.8 ϖ i so the jumps in g s x are bounded uniformly in x by b s ϖ s s b s [ + /2s ]/ 2π s B/ s, for a constant B, uniformly in s. For the putative limit function e 2 x2 Φ x in the integrand at 3.5, we have for x R +, 2π e 2 x2 Φ x = x e 2 x2 e 2 v2 dv = e 2 w2 wx dw, 3.9 which is monotonic in x, so b b e 2 x2 Φ x for x. Thus, omitting the multiplier b 2 / π/2, the improper integral based on 3.5 is dominated by Φ u du = / 2π, which is finite. Hence, given ɛ >, there exists U ɛ such that Uɛ Φ u [ b e 2 u2 Φ u ] du is within ɛ of the similar integral but over R +. We turn to the measures ν s. Consider the sums S sj integral representation for Π i s as in 3.7, := ϖ s j i= Π is. Using again the S si = ϖ s i j= = ϖ s s s u uj e j! du = ϖ s s du u v vi e i! dv v vi e i! v s dv = ϖ [ s i + Πi+ s sπ i s ] [ = ϖ s i + ϖi+ s s i Π i s ] [ = ϖ s sϖi s s i Π i s ] = s ϖ s ϖ i [ i + Πi s ] = sϖ 2 ϖ [ i s i + Πi s ]. 3. s ϖ i ϖ s s ϖ i In particular, for i = s, S s,s = sϖ s ϖ s = sϖ 2 s, = s i= ϖ sπ s i s = ν s R + /2b 2 s. From Stirling s formula see e.g. Appendix A we know that sϖ 2 s = [ + ϑ s /2s] 2 /2π for some ϑ s, so sup s ν s R + < uniformly in s. Therefore, given ɛ >, for every s there exists j s such that S s,js > S s,s ɛ. Proposition 4. The measures {ν s } introduced at 3.6 converge weakly to the limit measure

11 ν for which 2 ν [, x] = π/2 + η 2 x Φ v dv. 3. Remark: Because the limit function at 3. is continuous, sup x R+ ν s [, x] ν [, x] for s, i.e. we have not merely weak convergence but uniformity of that convergence on the domain of definition e.g. Problem 5 in III. in [22]. Proof. of Proposition 4 Let f : R + R be a bounded continuous function; without loss of generality suppose fx C f for x R + and finite C f. From our definitions, R + fx ν s dx = 2b 2 s s fx si ϖ s Π s i s, 3.2 where x si = i/ s as earlier. Because f is bounded and S si ν s R + /2b 2 s /2π as s, there exists {j s } such that the integral at 3.2, written as j s i= + s i=j s, is approximated arbitrarily closely for s large enough by the former of these sums; for example j s = s 5/8. Then using A.6, j s i= fx si ν s {i/ s } = 2b 2 s = 2b 2 s j s i= j s i= i= [ fx si ϖ s Φ x si + ψ ] si s fx si Φ x si ϖ s + 2b 2 s j s i= fx si ψ si s ϖ s, 3.3 where the constants ψ si are bounded uniformly in i and s, ψ si C ψ say. The last sum at 3.3 is bounded by j s C f C ψ /s 2π, and when j s = s 5/8, this bound is arbitrarily small for s sufficiently large. So the left-hand side of 3.2 is arbitrarily close to the sum at 3.3 involving Φ. Each of these sums is an approximation to the Riemann integral 2b 2 fv Φ v dv, which in turn is arbitrarily close for large enough s to the improper integral over R +. s /8 This weak convergence property of {ν s } is not directly applicable to the integral at 3.6 in which the functions g s are not continuous; but they are monotonic and bounded, and have bounded increments with g s x + / s g s x B/ s see around 3.8. We show that g x := lim s g s x exists and equals the bounded continuous function b e 2 x2 Φ x for x R +. To this end, consider x [, U ɛ ], where U ɛ is as defined below 3.8, and write Φ i s x / s + ψ s,isx/ s g s x = b s φ i s x / s [ + Os /8 ]/ φ, 3.4 where i s x = min x s, s. For given x, i s x/ s x as s, and thus g s x g x as defined. Further, because φi s x/ s is bounded away from on [, U ɛ ], this convergence

12 satisfies sup x [,Uɛ] g s x g x < B g / s for some finite constant B g. We can now write g s x ν s dx = R + U ɛ, + g s xν s dx + [g s x g x ] ν s dx [,U ɛ] g x [ν s dx ν dx] g x ν dx [,U ɛ] U ɛ, + g x ν dx R + := T + T 2 + T 3 T 4 + g x ν dx. 3.5 R + Each of the terms T,..., T 4 here can be made smaller than any given positive ɛ, first by the choice of U ɛ for T 4, then by choice of s for T 3 and T by appealing to weak convergence, and finally by choice of s for T 2 by the uniform convergence of g s x in [, U ɛ ]. It remains to demonstrate that the improper integral in 3.5 has the value as asserted. We do this in the proof of the next lemma. Lemma 5. I + := Φ u[ e 2 u2 Φ u] du = 2π log 2. Proof. Write Φ u du I + = e 2 u2 du2π u e 2 v2 dv u e 2 w2 dw, noting that the left-hand side equals / 2π I + =: J say. Use polar coordinates v, w = r cos θ, r sin θ so that dv dw r dr dθ and multiply by 2π, i.e. 2πJ := = = + 2 = 2 = 2 = 2 e 2 u2 du e 2 u2 du u e 2 v2 dv u 2 e 2 u2 du e 2 z2 cos 2θ z dz artan/ 2 artan/ 2 = 2π = 2π = 2π artan/ 2 / 2 2 u 2 π 2 arcsin u r u r 2 u 2 artan/ 2 e 2 w2 dw e 2 r2 r dr tan θ dθ e 2 z2 cos 2θ dz cos 2θ tan θ dθ cos 2θ tan θ dθ cos 2θ t dt t 2 t = tan θ, u2 /r 2 e 2 r2 dr integration by parts, z sin θ z cos θ z 2 cos 2θ dθ r, u = z cos θ, z sin θ, Fubini s theorem, e 2 y2 dy y = z cos 2θ, integration, 2 du u = 2 2π log / 2 = 2π log 2. Recalling the definition of J yields the expression for I +. 2

13 4 Proof of Theorem : the case ρ = / s We now have ρ = / s for finite. The proof is similar to the approach and methods used in the case ρ = above; the particular algebraic expressions differ. Start by breaking the sum at 3. into the two sums as before. Write the first of these as 2 s i= π J ϖ s sρ Π s isρ π J Π s i sρ = g s x ν s dx, 4. π s ϖ s i sρ R + where the measure ν s is atomic as before but now has mass 2b 2 sρϖ s sρ ρ K Π s i sρ located at x si = i/ s for i =,..., s, and the function g s is a right-continuous simple function defined on R + equal to b s ρρ K Π s sρ at and has jumps at each point x si, i =,..., s, where g s x si + = b s ρρ K Π s i sρ / [ϖ s i sρ/ϖ s sρ], so that g s is monotonic. To check that ν s has finite total mass, and that there is a bound on ν s R + that is uniform in s, note that lim s,k b 2 sρρ K is finite for finite and equal to [hη, /φ] 2 e η see around 2.7; for the rest, mimic the calculation leading to 3., now with ρ = / s, in computing S si := ϖ s sρ i j= so that [ S s,s = sρ ϖ s sρ ϖ s sρ [ Π j sρ = sρ ϖ s sρϖ i sρ ρ i + sρ ] Πi sρ ϖ i sρ ] [ Πs sρ = s ϖ 2 ϖ s sρ ssρ + ρ s which for given finite is bounded in s. Thus, sup s ν s R + <. Note that ] Π s sρ, ϖ s sρ ν s R + = 2b 2 sρρ K S s,s 2 h 2 η, e η π φ 2 + π/2 s. 4.2 From Lemma 8, for ρ = / s, i s and s large, Π s i sρ ψ si s i sρ = Φ = Φ x si + + Os 2 sρ sρ = Φ x si + + Os 2, 4.3 where o in the last term is uniform in i and s. Hence Π s i sρ = Φ x si + + ψ si / s, 4.4 where by Lemma 8 ψ si is uniformly bounded in i and s. 3

14 For x R + define i s x = x s so that i s x/ s x as s, and g s x = b sρρ K Π s isxsρ ϖ s isxsρ / ϖ s sρ = b s ρ ρk[ Φ x s,isx + + ψ s,isx/ s ] φ x s,isx + /φ [ + Os 2 ]. Then for given x and s, the right-hand side g x defined by g x := hη, e η Φ x + φ x at a uniform rate of convergence that is Os 2 for x on compact sets like U ɛ where the denominator above is bounded away from, b ρ := lim s b s ρ = hη, /φ as below 2.7, and sη lim / s = e η. 4.6 s Proposition 6. The measures {ν s } defined below 4. converge weakly to the limit measure ν for which ν [, x] = 2[hη, ]2 e η φ,x ] Φ v dv. 4.7 Proof. The same argument as used in establishing Proposition 4 holds, subject to using 4.4 in place of A.9 from Lemma 8. The analogue of 3.3 for, for bounded continuous f, is j s i= j s fx si ν s {i/ s } = i= [ fx si 2b 2 sρρ K ϖ s sρ Φ x si + + ψ si ]. 4.8 s Each term involving some ψ si is at most O/s, so when j s < Os their sum is negligibly small for large s. Since ϖ s sρ = e 2 2 / 2πs [ + Os 2 ] the other term is an approximation to the Riemann integral from which we deduce lim s b2 sρρ K φ js/ s fu Φ u + du, 4.9 An argument similar to that leading to 3.5 shows that the integrals at the right of 4. converge to the limit R + g x ν dx. It remains to consider the analogue of the last sum at 3. for which i s. As earlier, calculate P i via its tail which now reads P i = J j=i+ π j = π J J j=i+ ρ j J = i+ J π Jρ J i ρ = + ρπ J J i, 4

15 so π J P π i P i = J i P i P i i = + ρπ J J i [ J i + ρπ J J i ] = + ρπ J J i J i + ρπ J = + ρπ [ J J i + ρπ J 2 ρ J i ρ J i ]. 4. Hence, for the second part of the sum of 3. for the case ρ and i s we have 2π J J i=s π J P π i P i = 2π J + ρπ [ J K + + 2ρπ J i = 2π J + ρπ J ρk ρ K ρ [ K + K+ For ρ = / s and s, K as at.3 + ρπ J + ρπ J ρ K ρ K+ ρ + ] ρπ J K + K+ ρ K ] ρπj. 4. ρπ J s = πs ρ K+ s πs e η, 4.2 so the limit of the right-hand side of 4. is the same as the limit of 2π s ρ K s πs e η [ s e η + K s e η s π s e η ] + K + e η 2hη, e η + hη, e η [ η e η + η e η hη, e η ] e η = 2 C + C [ η e η + C + η e η e η s πs e η + hη, e η ] C, 4.3 where C = hη, e η. Combining 4.5 and 4.7, and 4.3, as required for the sum at 3., now yields D,η = 2 lim s πs e η s e η φ Φ u φu Φ u du + gη,. 4.4 We should like at this point to evaluate the integral at 4.4. For this purpose we have mimicked 5

16 the steps followed in establishing the expression for I + in Lemma 5, but have succeeded only in reaching the expressions in 4.5 and 4.6 below in which final quadratures are unresolved. Inspection of 4.4 shows that we must evaluate, for both positive and negative, J := [Φ u] 2 φu du = e 2 v2 +w 2 e 2 u2 du u u 2π dv dw. By following steps similar to those in the proof of Lemma 5 we deduced first that for >, J = Φ e 2 2 x 2 log 2 + 2π 2π log + x 2 dx. 4.5 For <, integration takes place cf. second line of the evaluation of J in the proof of Lemma 5 over < r <, with angular coordinate having arc-lengths 2π for r <, 2π 4 arccos /r = 4 arcsin /r for < r < 2, and 2 π + 2 arcsin /r for r > 2. Ultimately this yields J = J J + 5 Conclusion e 2 u2 du + 4 log 2 [ Φ 2 ] 2π e 2 2 x 2 2π log + x 2 dx. 4.6 The analysis presented in this paper both answers questions and raises further points that need clarification. Recall that in the setup in [9], Nazarathy and Weiss observed that for M/M//K systems with K, D π for < ρ < except when ρ =, for which they found D π 2 3. A similar effect occurs in multi-server M/M/s/K systems. This is illustrated in Figure 3. Our theorem shows that in the multi-server case, this discontinuity is merely a matter of scale: setting = s and considering D = lim t var Ndep, t] E N dep, t], ρ= / s the limit function is no longer discontinuous but reflects the asymptotic variance over a much finer range of values as in Figure 2 of Section 2. In turn, this emphasizes that, for the systems that we have considered, there exists some subtle interplay between the service facility on the one hand and customers on the other. In terms of customers there may be a deficit so some servers are idle or a surfeit so some customers are waiting, and when the system is balanced, meaning that ρ, the occasions when the system is either empty or full are rare i.e. both π and π J are small so that mostly periods with above or below average net arrivals are balanced by periods of above or below average productive service, and consequently the variability of throughput of the system as measured by the output N dep is to some extent smoothed. This intuitive explanation of the BRAVO effect is one we have not been able to translate into a mathematical explanation. 6

17 Π. s 2 s s s 3 2.6, Ρ Figure 3: M/M/s/K systems with K = s for increasing values of s. D π as a function of ρ. The black dot is D, corresponding to s with η =. In other work concurrently under preparation, we have examined the many-server M/M/s system with reneging to see whether it too exhibits the BRAVO effect. In studying a system with reneging, the departure process N dep, ] no longer consists precisely of the deaths in the birth death process Q s but only of a subset of those deaths. Consequently the second equality at.5 is no longer available as an expression for D π, but an independent computation, with the advantage from an expository viewpoint that it relies on more primitive results, yields a substitute expression J 2 P i Λ i q i+ λ P i Λ i, 5. π i λ i i= where q i is the probability of having a death at state i of Q s count as an increment of N dep, ]. A complete derivation of this result has been deferred from this paper, in which context the present work should have been more self-contained. The same substitute expression can also cope with a sequence of systems with balking, where we expect the BRAVO effect may still be observed, but whether such a system must be finite, with a buffer in place as well as the balking mechanism, remains to be discovered. Acknowledgment: DJD s work done while an Honorary Professorial Associate at the University of Melbourne. JvL is supported by a Starting Grant of the European Research Council. YN s work done in part while at the Department of Mathematics at the Swinburne University of Technology. YN is supported by Australian Research Council ARC grants DP356 and DE329. 7

18 A Asymptotic normality of Poisson probabilities In formulating the condition at.3 and establishing the double limit property.4 we use both local and central limit properties of the Poisson distribution with mean κ, here denoted {ϖ i } := {ϖ i κ} := {e κ κ i /i!} and write Π i k := j j= ϖ jκ for the corresponding distribution function. For convenience we state these properties with their respective rates of convergence in two lemmas below. We draw on the exposition in Feller [8] concerning Stirling s formula and limit results for the binomial distribution p.54 and p.83 respectively. For Stirling s formula Feller shows that for any positive integer, s, e /2s+ < s! 2πs s/e s < e/2s, A. from which it follows that s ss ϖ s s = e s! = γ s, A.2 2πs 2s where < γ s as s ; indeed, Feller notes that the ratio s! 2πs s/es e /2s = /2s2 + o. A.3 We use a local central limit theorem for Poisson probabilities, including a rate of convergence, as follows. Lemma 7. For i, s such that i/ s γ for fixed finite γ >, uniformly for i < s 5/8, ϖ s i s ϖ s s where the rate of convergence holds uniformly for i s 5/8. = φγ + O/s /8, A.4 φ Proof. Analogous to Feller s proof of the local asymptotic normality of binomial probabilities, write ϖ s s ϖ s i s = s i ss s i + = t t i, A.5 where for j =,..., s, t j = j/s. For t 2, / t = exp[ log t] = et+ 2 t2 +ϑ it 3, where ϑ t <. Then for positive integers i 2s, the ratio at A.5 equals i i i i2i exp + ϑ j 2s 6s 2, A.6 where < ϑ i. Let j s as s such that j 3 s /s 2. Then for i, s with i < j s, the quantity at A.6 differs from e 2 γ2 by a multiplicative factor that is dominated by exp ϑ i j 3 s /s 2, so for j s = s 5/8, this last term yields a factor O/s /8, whose expansion then completes the proof. 8

19 Lemma 8. There exist finite constants ψ sj that are uniformly bounded in both j and s such that j i= j s ϖ i s = Φ + ψ sj. s s A.7 Proof. Let X s denote a Poisson r.v. with mean s, so that X s is expressible as the sum of s i.i.d. Poisson r.v.s X with mean, variance, and third absolute moment about the mean 3 = + 2/e. C < 4/5, Then by the Berry Esseen theorem e.g. [22] p.342, for a positive constant sup i i s C Pr{X s i} Φ 3. s s A.8 A.7 follows, with an explicit bound for the constant, and we write this in the form, for uniformly bounded quantities ψ si, i s Π i s = Φ + ψ si. s s A.9 Corollary 9. The constants {ψ si } in the Berry Esseen expansion A.9 for the Poisson distribution satisfy s i= ψ si = os. Proof. From around 3., s S s,s = ϖ s sπ i s = sϖs 2 = + ϑ 2 s 2π 2s 2π i= s, A. where ϑ s, while substituting from A.9 into the expression for S s,s gives s [ i s S s,s = ϖ s s Φ + ψ ] si s s i= i= i= A. [ s = + ϑ s /2s Φ x si + s ] ψ si, A.2 2π s 2π s where x si = i/ s. Examining these last two sums, the former is an approximation, based on the s intervals determined by the s + points {i/ s} i =,..., s, to the integral s Φ udu/ 2π. This in turn is a finite portion of the integral Φ u du/ 2π; this improper Riemann integral exists because Φu is directly Riemann integrable on, and equals / 2π. This means that the Riemann integral approximations converge to /2π = lim s S s,s. This last equality implies that the last sum at A.2 for s. The Berry Esseen theorem is typically proved using Fourier techniques. We have not explored how such techniques would, presumably, provide another way of establishing the corol- 9

20 lary. Analogues of Lemmas 7 and 8 for general Poisson distributions {ϖ i λ} for large λ, not necessarily an integer, are readily constructed. References [] Al Hanbali, A., Mandjes, M., Nazarathy, Y. and Whitt, W. 2. The asymptotic variance of departures in critically loaded queues. Adv. Appl. Prob. 43, [2] Armony, M. and Maglaras, C. 24. On customer contact centers with a call-back option: customer decisions, routing rules, and system design. Oper. Res. 52, [3] Borst, S., Mandelbaum, A. and Reiman, M. I. 24. Dimensioning large call centers. Oper. Res. 52, [4] Browne, S. and Whitt, W Piecewise-linear diffusion processes. In J. H. Dshalaow Ed. Advances in queueing: Theory, methods, and open problems [5] Daley, D. J Queueing output processes. Adv. Appl. Prob. 8, [6] Daley, D. J. 2. Revisiting queueing output processes: a point process viewpoint. Queueing Sys. 68, [7] Disney, R. L. and Konig, D Queueing networks: A survey of their random processes. SIAM Review [8] Feller, W An Introduction to Probability Theory and its Applications Vol. I. New York: Wiley. [9] Gans, N., Koole, G. and Mandelbaum, A. 23. Telephone call centers: Tutorial, review, and research prospects. Manu. & Ser. Oper. Manage. 5, [] Garnett, O., Mandelbaum, A. and Reiman, M. 22. Designing a call center with impatient customers. Manu. & Ser. Oper. Manage. 4, [] Halfin, S. and Whitt, W. 98. Heavy-traffic limits for queues with many exponential servers. Oper. Res. 29, [2] Janssen, A. J. E. M., van Leeuwaarden, J. S. H. and Sanders, J. 23. Scaled control in the QED regime. To appear in Performance Evaluation. [3] Janssen, A. J. E. M., van Leeuwaarden, J. S. H. and Zwart, B. 2. Refining square-root safety staffing by expanding Erlang C. Oper. Res. 59, [4] Jelenković, P., Mandelbaum, A. and Momčilović, P. 24. Heavy traffic limits for queues with many deterministic servers. Queueing Sys. 47, [5] Maglaras, C. and Zeevi, A. 24. Diffusion approximations for a multiclass Markovian service system with guaranteed and best-effort service levels. Math. Oper. Res. 29, [6] Mandelbaum, A. and Momčilović, P. 28. Queues with many servers: The virtual waiting-time process in the QED regime. Math. Oper. Res. 33, [7] Massey, W. A. and Wallace, R. 25. An asymptotically optimal design of the M/M/c/K queue for call centers. Unpublished. 2

21 [8] Nazarathy, Y. 2. The variance of departure processes: puzzling behavior and open problems. Queueing Sys. 68, [9] Nazarathy, Y. and Weiss, G. 28. The asymptotic variance rate of finite capacity birth death queues. Queueing Sys. 59, [2] Pang, G., Talreja, R. and Whitt, W. 27. Martingale proofs of many-server heavy traffic limits for Markovian queues. Prob. Surv. 4, [2] Reed, J. 29. The G/GI/N queue in the Halfin Whitt regime. Ann. Appl. Prob. 9, [22] Shiryayev, A. N Probability. English translation by R.P. Boas from Russian edn, 979. Springer-Verlag, New York. [23] Whitt, W. 24. A diffusion approximation for the G/GI/n/m queue. Oper. Res. 52, [24] Whitt, W. 25. Heavy-Traffic limits for the G/H2 /n/m queue. Math. Oper. Res. 3, 27. 2