e - c o m p a n i o n

Size: px
Start display at page:

Download "e - c o m p a n i o n"

Transcription

1 OPERATIONS RESEARCH e - c o m p a n i o n ONLY AVAILABLE IN ELECTRONIC FORM 212 INFORMS Electronic Companion A Diffusion Regime with Nondegenerate Slowdown by Rami Atar, Operations Research,

2 A diffusion regime with non-degenerate slowdown: Appendix Rami Atar June 15, 211 Abstract In this appendix to A diffusion regime with non-degenerate slowdown, Op. Res. (212), we provide the proofs of the main results. Theorem 2.1 is proved in Subsection A.1 and Theorem 2.2 in Subsection A.2. For the notation used in this appendix, see the end of Section 1 of the main body of the paper. Equation and theorem numbers, such as (1), (2),..., Theorem 2.1, etc. refer to the main body of the paper. Literature citation such as [1], [2],... refers to the bibliographic list at the end of this appendix. A.1 Convergence of queue-length In this subsection we prove Theorem 2.1. Let us introduce some notation. Let T n (t) = k K n T kn (t), Tn (t) = n 1 T n (t), (A.1) Â n (t) = n 1/2 (A n (t) λ n t), V n (t) = n 1/2 k K n (D kn (t) T kn (t)) = n 1/2 (D n (t) T n (t)), (A.2) Zn(t) = n 1/2 Z(n 1/2 t) t, t, (A.3) t ) t F n (t) = Zn (γ n X n (s) + ds + (γ n γ) X n (s) + ds, (A.4) W n (t) = Ân(t) V n (t), Wn (t) = ( λ n µ n )t + W n (t) F n (t). (A.5) Lemma A.1. The following identities hold X n (t) = X n () + W n (t) + L n (t) γ T n (t) + nl n (t) = µ n t. t X n (s) + ds, (A.6) (A.7) 1

3 Proof. It follows from (11), (16), (18) and (2) that X n (t) = X n () + W n (t) + λ n t + n 1/2 λt n 1/2 (T n (t) µ n t) µ n t n 1/2 µt γ t X n (s) + ds F n (t). Noting by (1) that the fourth and seventh terms on the r.h.s. of the above display cancel out, and using the notation just introduced, we obtain (A.6). Next, (A.7) follows from the identity B kn + I kn = 1, along with definitions (6), (13), (22) and (A.1). Note the resemblance between (A.6) and the Skorohod equation (24). The main ingredient of the proof will be to show that W n converge to a Brownian motion, for which we use martingale convergence methods (see Lemma A.3). We then argue by continuity of the solution map to the Skorohod equation (see the proof of Theorem 2.1). It is well known that the scaled processes Ân converge in distribution, uniformly on compacts, to a Brownian motion starting from zero, with zero mean and diffusion coefficient λ 1/2 C IA [5, Section 17]. We denote this limit process by w A. It easily follows that Z n converges to zero in distribution, uniformly on compacts. In what follows fix u [1, ). Fix also ϱ (, 1 2 ). Let τ n = inf{t : L n (t) n ϱ } u. (A.8) We begin by proving some elementary estimates. Lemma A.2. With T (t) := µt, t [, u], one has T n T in probability, uniformly on [, u], (A.9) and sup E[( V n u) 2 ] <, n (A.1) the random variables X + n u are tight, (A.11) F n in probability, uniformly on [, u], (A.12) P(τ n < u), as n. (A.13) Proof. First, let us show sup{ T n (t) µt : t τ n } in probability, as n. (A.14) Note by (13), and since B kn take values in {, 1}, that T n (t) µ n t, for every t (recall (7)). By (A.8), for t τ n, L n (t) n ϱ. Hence by (13), (A.1) and (22), N n t T n (t) = n 1 µ kn (1 I kn (s))ds µ n t n ϱ 1/2, t τ n. k=1 2

4 As a result, the l.h.s. of (A.14) is bounded by µ n µ u + n ϱ 1/2, for every n. By (7), we have (A.14). We next show (A.1). We use the Burkholder-Davis-Gundy inequality, which states that for any local martingale M and p 1, E{( M t ) p } c p E{[M, M] p/2 t }, t [, ), where the constant c p depends only on p, and [M, M] is the quadratic variation process defined by [X, X] = X 2 2 X dx (see [8] p. 58, and p. 175); if X has piecewise smooth sample paths, null at zero, then [X, X] t is given by s t X(s)2 (see for example [8], Theorem 22(ii), p. 59). It follows from the martingale assumption that V n is an F n -martingale. Since each of its jumps is of size n 1/2 and the number of jumps by time t is D n (t), it follows that and by (7) follows (A.1). We now prove E[( V n u) 2 ] c n E[D n(u)] = c n E[T n(u)] = c [ n E u ] µ kn B kn (s)ds k cu µ n n, the random variables X + n τ n are tight. (A.15) Let r > be given. Consider the event { X + n τ n > 2r}. On this event there exist σ n θ n τ n such that X n (σ n ) r, Xn (θ n ) 2r, while X n (t) > for t [σ n, θ n ]. Note that the last assertion, in view of (11) and (2), implies that I n (t) = for t [σ n, θ n ]. Hence by (22), L n (θ n ) = L n (σ n ). We can now use (A.6) to bound the probability of the specified event. Indeed, by (16), (17), (21), (A.3) and (A.4), we have that t γ t X n (s) + ds + F n (t) n 1/2 Z (γ n n 1/2 ) X n (s) + ds = n 1/2 Z n (t) (A.16) is nondecreasing in t. Hence by (A.5) and (A.6), we have, on the event alluded to above, that there exist σ n θ n τ n such that This shows ( λ n µ n )(θ n σ n ) + W n (θ n ) W n (σ n ) X n (θ n ) X n (σ n ) r. P( X + n τ n > 2r) P(there exist σ n θ n τ n such that W n (θ n ) W n (σ n ) r c 1 ), (A.17) where c 1 = u sup λ n µ n. n (A.18) 3

5 Note that c 1 is finite by (5) and (8). However, W n u Ân u + V n u, and since Ân converge and (A.1) holds, it follows that W n u are tight random variables. This shows that the r.h.s. of (A.17) tends to zero as r, whence follows (A.15). Now we will use (A.15) to show (A.13). First, (A.15), the convergence of Z n to zero, and (15) imply F n τ n, in probability. (A.19) By (A.6), P(τ n < u) P ( [ X n ( ) X n ()] + τ n n ϱ /4 ) ( + P( W n τ n n ϱ /4) + P γ τn (A.2) ) X n (s) + ds n ϱ /4. The tightness of X n () (23) and of X + n τ n implies that the first and last terms on the r.h.s. converge to zero. We have already argued that W n τ n are tight, thus (A.5) and (A.19) imply that the second term converges to zero as well. This proves (A.13). Finally, in view of (A.13), (A.14) implies (A.9), (A.15) implies (A.11), and (A.19) implies (A.12). The first part of the following result is key to the proof of Theorem 2.1. The second part will only be used in the next subsection, in proving Theorem 2.2. Lemma A.3. i. The sequence ( X n (), Ân, V n ) converges in distribution to (ξ, w A, w S ), where w S is a Brownian motion that starts from zero and has zero drift and diffusion coefficient µ 1/2. In addition, the random variable ξ, the process w A and the process w S and are mutually independent. ii. Let t [, u) and let t (n) [t, u], n N, be a sequence satisfying t (n) t. For some positive integer r let G n and G be random variables with values in (R +) r, where, for each n, G n is measurable on F n (t (n) ). Assume, in addition, that (G n, V n, Ân) converge in distribution to (G, w S, w A ). Denote ˇw S (s) = w S (t + s) w S (t), ˇw A (s) = w A (t + s) w A (t), s [, u t]. Then G, ˇw S, and ˇw A are mutually independent. Proof. i. Let us begin by commenting that the convergence of V n to w S can be shown in a straightforward manner using the martingale central limit theorem [6]. This, however, does not conveniently lead to an argument that w A and w S are mutually independent, for which one has to exploit the independence of the primitives A n and {S k }. We prove the convergence and the independence of w A and w S via an argument that a suitable error term (E n defined below) converges to zero in finite dimensional distributions. Toward this argument we will use a theorem of Aldous [1], stating that a sequence M n of martingales converges in distribution to M uniformly over [, u], provided that M is a continuous 4

6 martingale, M n (t) are uniformly integrable in n for each t, and the finite-dimensional distributions of M n converge to those of M. Uniform integrability of V n (t) follows from (A.1). Thus to apply the above result it suffices that we prove convergence in finite-dimensional distributions of V n to w S. To this end we write V n (t) = Ŝn(t) E n (t), where Ŝ n (t) = n 1/2 k (S k (µ kn t) µ kn t), E n (t) = n 1/2 k [S k (µ kn t) S k (T kn (t)) µ kn t + T kn (t)]. Note that, for each n, k S k(µ kn t) is itself a Poisson process of rate µ n. Also, as follows from the assumption regarding independence of primitive processes and initial conditions, noting that X n () = Q n ()+ k B kn(), the Poisson process alluded to above, the process A n, and the random variable X n () are mutually independent. Thus ( X n (), Ân, Ŝn) converge to (ξ, w A, w S ), and ξ, w A and w S are mutually independent. It remains to prove that E n converge to zero in the sense of finite-dimensional distributions. To this end, it suffices to show that for each v [, u], E n (v) in probability. Fix v. Recall that, for each n and k, R kn (t) := S k (T kn (t)) T kn (t) is an F n -martingale. Let τ kn = inf{t : T kn (t) = µ kn v}. Since B kn 1, it is easy to verify that τ kn v. Also, it follows from standard ergodic considerations that τ kn < a.s., for each k, n. To see that, fix n. Let L > be such that P(A n (L) > N n ) >. Then with probability 1, there are infinitely many disjoint intervals of the form [σ, σ + L + 1] [v, ) with the properties (a) there are at least N n + 1 arrivals within [σ, σ + L], (b) there are no abandonments and no service completions within [σ, σ + L + 1]. Clearly, within each of these intervals there are more customers than servers in the system for a unit of time, and since the policy is work conserving, all servers are necessarily occupied for a unit of time. Since there are infinitely many such intervals, this shows τ kn < for all k, a.s. Set E n(t) = n 1/2 k (R kn (τ kn t) R kn (v)), and note that E n (v) = lim t E n(t). Also, E n(t) is an F n -martingale for t [v, ), with E n(v) =. To use the Burkholder-Davis-Gundy inequality the way we did before, note that the number of jumps of E n over [v, ) is given by (S k (µ kn v) S kn (T kn (v))) = S k (T kn (τ kn ) S k (T kn (v))). k k Since for each n and k, τ kn is a stopping time on F n, the expected number of jumps is given by E[ k (T kn (τ kn ) T kn (v))] = E[ k (µ kn v T kn (v))]. 5

7 Hence E[E n (v) 2 ] E[ sup E n(t) 2 ] t [v, ) c n E[ k (µ kn v T kn (v))] = c n E[ k v µ kn I kn (t)dt] = c n E[L n (v)]. It follows from (22), (A.8) and (A.13) that n 1/2 L n (v) converges in probability to zero. In addition, using (22), it is bounded by the constant v sup n µ n /n <. Hence the last expression in the above display converges to zero. This shows that E n (v) in probability. Since v [, u] is arbitrary, the result follows. ii. Using Assumption 2.1(iv), for each n, ˇV n, Ǎ n and G n are mutually independent, where Ǎ n (s) = n 1/2 [A n (AT n (t (n) ) + s) A n (AT n (t (n) )) λ n s], s, ˇV n (s) = V n (t (n) + s) V n (t (n) ), s. Note that Ǎn(s) = Ân(AT n (t) + s) Ân(AT n (t)) for s. It is easy to see that AT n (t (n) ) t in probability. Since the limit in distribution of (V n, Ân) is a process with continuous sample paths, it follows that (G n, ˇV n, Ǎn) converges in distribution, and has the same limit as that of (G n, V n (t + ) V n (t), Ân(t + ) Ân(t)), namely (G, ˇw S, ˇw A ). It follows that the three components are mutually independent. Proof of Theorem 2.1. Recall that u (, ) is fixed, but arbitrary. Hence it suffices to prove the convergence in distribution in the uniform topology over [, u]. By Lemma A.3(i), ( X n (), Ân, V n ) converges in distribution to (ξ, w A, w S ), where the latter three elements are mutually independent. Using equation (A.5), the convergence of the term F n to zero (A.12) and of the term λ n µ n to λ µ = β (5), (8), it follows that ( X n (), W n ) converges in distribution to (ξ, w) where w is a Brownian motion with drift β and diffusion coefficient σ, independent of ξ. Using the tightness of the random variables X + n u in equation (A.6), and the positivity of L n, shows that L n u, and in turn, X n u, are tight random variables. We argue that Given ε >, consider the event X n u in probability. (A.21) Ω ε n = { X n () ε, X n u > 3ε}. On this event there exist σ n < θ n u such that X n (σ n ) 2ε, X n (θ n ) 3ε, and X n (t) ε for t [σ n, θ n ] (this uses the fact that the jumps of Xn are a.s. bounded by cn 1/2 ). Using (11), we have I n (t) εn 1/2 for t [σ n, θ n ]. Hence by (9) and (22), L n (θ n ) L n (σ n ) µ min n ε(θ n σ n ). Next, let us use equation (A.6). Note that the last term on the r.h.s. of this equation does not vary between the times σ n and θ n because X n is negative. Also, the process L n is nondecreasing, and so ε X n (θ n ) X n (σ n ) W n (θ n ) W n (σ n ). 6

8 Denote w u (x, δ) = for x : [, u] R, δ >. We obtain, for each ε and n, sup x(t) x(s), s,t [,u]; s t δ P(Ω ε n) P(there exists δ > such that w u ( W n, δ) ε, εδµ min n L n u). By tightness of L n u, there is a function g such that lim r g(r) =, and, for every r >, ( P(Ωn) ε r ) ) g(r) + P w u ( Wn, εµ min ε. n A sequence of processes defined on [, u], with sample paths in the Skorohod space, is said to be C-tight if it is tight, and every subsequential limit has continuous sample paths with probability one. C-tightness of, say {U n }, implies the convergence in probability of w u (U n, δ), for every δ. As processes that converge to a Brownian motion, W n are C-tight. Since µ min n (9) it therefore follows that the last term on the r.h.s. of the above display converges to zero as n. Sending r shows that lim n P(Ωn) ε =. Finally, since the weak limit ξ of Xn () is nonnegative (23), it follows that lim n P( X n u > 3ε) =. This shows (A.21). For an RCLL path y from [, ) to R, a pair ( ξ, l) is regarded a solution to the Skorohod equation t ξ(t) = y(t) γ ξ(s)ds + l(t), (A.22) provided that the equation above holds for all t, that ξ(t) for all t, l is nondecreasing, and [, ) 1 { ξ(t)>} dl(t) =. Note that the process ξ, that is a solution to the Skorohod equation (24) is, with probability one, a solution to the Skorohod equation (A.22) with data y(t) = ξ + βt + σw(t). It is well known that existence and uniqueness hold for the equation (A.22) for y in the space of RCLL paths, and that the solution map is continuous in the topology of uniform convergence on compacts (for example, this statement follows from the results of [3]). Now, by (A.6), t X n (t) + = Y n (y) γ X n (s) + ds + L n (t), (A.23) where Y n (t) = X n () + W n (t) + X n (t). It follows from (21) and (22) that d dt L n(t) > if and only if Xn (t) <. Hence ( X + n, L n ) form a solution to the Skorohod equation for Y n. Recall that ( X n (), W n ) (ξ, w) in distribution. Thus by (A.21), Y n ξ + w in distribution. As a result of the continuity of the solution map, we obtain convergence in distribution, uniformly on compacts, of X + n, and in turn, of X n, to the solution to (A.22) with y = ξ + w. If w is a standard Brownian motion independent of ξ, then (ξ, w) is equal in law to (ξ, {βt + σw(t), t }). Thus, with (ξ, l) denoting the unique solution to (24) with data (ξ, w), we have shown that X n ξ. Recalling that ˆQ n and În are the positive and, resp., negative parts of X n (21), and noting that L n is, by (A.23), given explicitly in terms of X n, shows ( X n, L n, Q n, În) (ξ, l, ξ, ). 7

9 A.2 Convergence of delay and service time This subsection contains the proof of Theorem 2.2. Lemma A.4(iv) below shows that µ n is close to Q n, that is the positive part of X n. This translates the problem into that of analyzing the joint limit law of X n and Σ n, where X n ξ is already established by Theorem 2.1. The main ingredient of the proof is an argument that the η i s, which represent the limit law of the scaled service times, are independent across i and independent of ξ. Intuitively, given some t 1 < t 2, the value that the delay experienced by the customer C n (t 1 ) takes should have nearly no effect on the delay and service time experienced by C n (t 2 ) because the system contains many customers. However this intuition does not appear to lead to an efficient way of proving independence. We approach this problem via an argument by induction on the number of customers. Among other considerations, the argument crucially uses the independence result of Lemma A.3(ii) and the uniqueness of solutions to the Skorohod equation. Throughout, let u (, ), j N and < t 1 < < t j < u be fixed. To simplify the notation we write X i n for X n (t i ), 1 i j, and use similar convention for Q i n, i n and Σ i n, 1 i j. Xn () will be denoted by X n. Recall that AT n (t) and RT n (t) denote the arrival and, resp., routing time of the customer C n (t). Given t, let Ω n (t) denote the event that the customer C n (t) does not abandon, namely Ω n (t) = {AB n (t) = } = { n (t) < }. Since the process Q n is right-continuous, the quantity Q n (AT n (t)) represents the number of customers in the queue at the time of arrival of the customer C n (t), including this customer. The first item of the lemma below shows that abandonment of an individual customer occurs according to an exponential clock. The combination of items (ii) (iv) shows that abandonment occurs with small probability, and that µ n is close to Q n. In what follows we use the notation M[s, t] := M(t) M(s) for any process M. Lemma A.4. Let t be fixed. Then one has the following. i. Write AB n = AB n (t) AT n (t) and n = n (t) RT n (t) AT n (t). Then ii. On Ω n (t), P(AB n > s) P(AB n > s n ) = E[e γ n(s n ) ], s. Q n (AT n (t)) µ n n (t) J n (t) := V n [AT n, RT n ] + L n [AT n, RT n ] + n 1/2 Z n [AT n, RT n ]. iii. P(Ω n (t)) 1. iv. Q n (AT n (t)) µ n n (t) in probability. Proof. i. Using the representation where N s = [t,t+s] P(AB n > s) = P( N s = ), 1 {UZn(v) Q n (v ) [POS n (t,v ),POS n (t,v )+1)}dZ n (v), the claim follows from a standard result on thinning of a Poisson point process (cf. [9, Proposition 1.13]). 8

10 ii. On the event Ω n (t), RT n (t) represents the time when C n (t) starts being served. Equivalently, this is the time when all the Q n (AT n (t)) customers that are in the queue at time AT n (t), have left the queue, either by starting service or by abandoning. As a result, we have on Ω n (t), D n [AT n, RT n ] Q n (AT n ) D n [AT n, RT n ] + Z n [AT n, RT n ], (A.24) where we omit the dependence of AT n and RT n on t from the notation. Using (A.2) and then (A.7), n 1/2 D n [AT n, RT n ] = V n [AT n, RT n ] + n 1/2 T n [AT n, RT n ] holds on the event Ω n (t). This shows (ii). iii. Let = V n [AT n, RT n ] L n [AT n, RT n ] + µ n n n (t), θ n = θ n (t) = inf{s AT n : D n [AT n, s] Q n (AT n )}. Let us first argue that θ n AT n in probability. Roughly speaking, this should hold since the queue-length is of order n 1/2 while the rate at which the departure process increases is of order n. Toward a rigorous argument, note that Q(AT n ) = D[AT n, θ n ]. Thus given ε >, P(θ n AT n > ε) P(θ n > t + 2ε, AT n < t + ε) + P(AT n t + ε) ( Dn [t + ε, t + 2ε] P Q n ) u + P(AT n t + ε). n n Recall from Lemma A.2 the notation T (s) = µs, s. By (A.2), (A.9), (A.1), we have that n 1 D n T in probability, uniformly in [, u]. Hence D n [t + ε, t + 2ε]/n εµ in probability. By Theorem 2.1, Q n u are tight r.v.s, hence Q n u/n in probability, and the first term on the r.h.s. of the above display converges to zero. So does the second term, by the fact that AT n t (as follows from the speeding up of the inter-arrival times). Since ε is arbitrary, this shows that θ n AT n in probability, as claimed. Note that on the event Ω n (t) c = {AB n (t) < }, one necessarily has AB n θ n AT n. Hence, given ε >, there exist α n, such that P(Ω n (t) c ) P(AB n θ n AT n ) P(AB n ε) + α n = 1 P(AB n = ) P(AB n (ε, )) + α n = 1 P(AB n = ) P(AB n > ε n, n = ) + α n, where we used the fact that n = if and only if AB n <. Thus, using item (i), P(Ω n (t) c ) 1 P(AB n > ε n ) + α n = 1 E[e γ n(ε n ) ] + α n 1 e γ nε + α n 1 e γε + α n, where γ = sup n γ n <. Taking n and then ε gives zero on the r.h.s. This proves item (iii). 9

11 iv. In view of items (ii) and (iii), it suffices to prove that J n (t) in probability. An argument as in item (iii) above, using the fact D n [AT n, RT n ] Q n (AT n ) on Ω n (t) (A.24), shows that RT n AT n in probability. Hence by item (ii) of the lemma, the convergence of J n (t) to zero will follow provided C-tightness of the processes V n, L n and n 1/2 Z n. And indeed, V n are C-tight as processes that converge to a Brownian motion (Lemma A.3(i)), and so are L n as processes that converge to the boundary term l of equation (24) (Theorem 2.1). Finally, by (A.11), (A.12) and (A.16), the processes n 1/2 Z n are C-tight. This shows J n (t) in probability and establishes item (iv). The theorem will be proved by first showing ( X 1 n, Σ 1 n, X 2 n, Σ 2 n..., X j n, Σ j n) (ξ(t 1 ), η 1, ξ(t 2 ), η 2,..., ξ(t j ), η j ). (A.25) Once the above is established, the result will follow by an easy implementation of Lemma A.4. Toward proving (A.25), consider the statements X 1 n ξ(t 1 ), (A.26) ( X 1 n, Σ 1 n, X 2 n, Σ 2 n,..., X i n) (ξ(t 1 ), η 1, ξ(t 2 ), η 2,..., ξ(t i )), (A.27) ( X 1 n, Σ 1 n, X 2 n, Σ 2 n,..., X i n, Σ i n) (ξ(t 1 ), η 1, ξ(t 2 ), η 2,..., ξ(t i ), η i ), (A.28) where ξ and η are as in the statement of the theorem. Claim A. (A.26) holds. Claim B. Given i {1, 2,..., j}, if (A.27) holds then (A.28) holds. Claim C. Given i {1, 2,..., j 1}, if (A.28) holds then (A.27) holds for i + 1. Clearly, by induction on i, Claims A C imply (A.25). In what follows we shall prove these claims. First, note that Claim A follows directly from Theorem 2.1. To prove Claim C we will need the following. Lemma A.5. Let ξ be a solution to the Skorohod equation (24) with data (ξ, w). Given t < u there exists a measurable map H : R C([t, u] : R) C([t, u] : R) such that, with probability one, ξ [t,u] = H(ξ(t), (w [t,u] w(t))). Proof. It is well-known that the result follows from pathwise uniqueness and weak existence of solutions (cf. [7, Cor ]). By [2], pathwise uniqueness and, in fact, strong existence do hold for equation (24). Let us now prove Claim C. Fix 1 i j 1. We are given that (A.28) holds and are required to prove that ( X n, 1 Σ n, 1 X n, 2 Σ n, 2 i+1..., X n ) (ξ(t 1 ), η 1, ξ(t 2 ), η 2,..., ξ(t i+1 )). (A.29) Moreover, by Lemma A.3(i) and Theorem 2.1, we have (X n, V n, Ân) (ξ, w S, w A ). We write w for the standard Brownian motion related to w S and w A by w S w A = σw (note that βs+σw(s) is what 1

12 we denoted by w(s) in the previous section). As a result, every subsequence of ( X n, V n, Ân, ( Σ n) l i l=1 ) has a further subsequence that is convergent, and if (ξ, ws, w A, (η l )i l=1 ) is a subsequential limit then the following relations must hold: (ξ, w S, w A ) has the same law as (ξ, w S, w A ); in particular, ξ is a solution to the Skorohod equation with data (ξ (), w ), (ξ (), w ) is equal in law to (ξ, w), and w A w S = σw ; ((ξ (t l )) i l=1, (η l )i l=1 ) has the same law as ((ξ(t l)) i l=1, (η l) i l=1 ). Clearly, Claim C will follow once we show that ((ξ (t l )) i+1 l=1, (η l )i l=1 ) and ((ξ(t l)) i+1 l=1, (η l) i l=1 ) are equal in law, which, in view of the second bullet, is equivalent to the statement (ξ (t l )) i+1 l=1 and (η l )i l=1 are mutually independent. (A.3) And indeed by Lemma A.5 and the first bullet, there exists a map H such that, with probability one, ξ (t i+1 ) = H (ξ (t i ), ˇw ) and ξ(t i+1 ) = H (ξ(t i ), ˇw), where ˇw = w [ti,u] wt i and a similar definition is used for ˇw. Thus by the second bullet, (A.3) will follow provided we show that ˇw and ((ξ (t l )) i l=1, (η l )i l=1 ) are mutually independent. This is established in the following lemma, which completes the argument. Lemma A.6. Let (G, w S, w A ), where G = (ξ(t l ), η l ) i l=1, be a limit in distribution of a convergent subsequence of (( X n, l Σ n) l i l=1, V n, Ân). Then G, ˇw S := w S [ti,u] w S (t i ) and ˇw A := w A [ti,u] w A (t i ) are mutually independent. Proof. The result will follow from Lemma A.3(ii) once its hypotheses are verified. To this end, for each n, let t (n) = t i + n γ, where γ ( 1/2, ) is a constant. All statements regarding convergence will be understood as convergence along the given subsequence. Recall that EX n (t) denotes the time when customer C n (t) leaves the system (either by completing service or by abandoning), namely EX n (t) = DEP n (t) AB n (t). (A.31) Define, for 1 l i, E l n = {EX n (t l ) < t (n) }, Σl n = Σ l n1 E l n, where we interpret infinity times zero as zero. It will be convenient to work with the random variables Σ n l because they are (as we will show) measurable on F n (t (n) ), and at the same time close to the original quantities Σ n. l The assumptions of the lemma imply G n := ( X 1 n, Σ 1 n, X 2 n, Σ 2 n..., X i n, Σ i n) G = (ξ(t 1 ), η 1, ξ(t 2 ), η 2,..., ξ(t i ), η i ), (A.32) provided we show, for 1 l i, P(E l n) 1. (A.33) 11

13 Let us then argue that (A.33) holds. Fix l. By (A.31), it suffices to show that (i) P(AT n (t l ) t l < n γ /3) 1, (ii) P( n (t l ) < n γ /3) 1 and (iii) P(Σ n (t l ) < n γ /3) 1. Claim (i) is an easy consequence of the fact that the acceleration parameter λ n of the arrival process A n is of the order of n (5). Claim (iii) holds due to the validity of (A.28), by which P(n 1/2 Σ n (t l ) > a n ), for any sequence a n. To see that claim (ii) holds, note that Q n X n (by (11)), hence using the fact AT n (t l ) t l and Theorem 2.1, we have that Q n (AT n ) form a tight sequence of random variables. By Lemma A.4 and the fact µ n µ (7), it follows that l n are tight. As a result, n γ n (t l ) in probability, which gives (ii). We have thus shown that items (i) (iii) hold. This implies (A.33) and, in turn, (A.32). Next we show that all components of G n are measurable on F n (t (n) ), which, for this discussion we abbreviate by F. We also fix l and drop the l and t l from the notation of X l n, Σl n, E l n, n (t l ), etc. By Assumption 2.1(i), Xn is F-measurable. To show that so is Σ n, note that for arbitrary a [, ), { Σ n < a} = (E n { Σ n < a}) E c n, where one uses the fact that, on the specified event, EX n = DEP n (because n = in case the minimizer on the r.h.s. of (A.31) is the second term). First, by Assumption 2.2, {DEP n δ} {AB n δ} are both in F provided δ < t (n), hence so is the union of these events over δ = δ k t (n). This shows E n F. Next, denoting a n = an 1/2, note that E n { Σ n < a} = {RT n + Σ n < t (n), Σ n < a n } = {RT n > b} {RT n + Σ n < b + a n }. b Q: b<t (n) a n By Assumption 2.2, each of the sets over which the union is taken, is F-measurable. Consequently, so is the event on the l.h.s. of the above display. This shows Σ n is F-measurable. We can now apply Lemma A.3(ii). We have (G n, V n, Ân) (G, w S, w A ), and, for each n, G n is F n (t (n) )-measurable. Consequently, G, ˇw S and ˇw A are mutually independent. As argued above, this completes the proof of Claim C. Finally we turn to the proof of Claim B. Recall that t i is fixed. The main idea of the proof is that if C n (t i ) ever gets to be the first in line, since service time and abandonment are exponential, the probability that it is routed to server k is proportional to µ k. Another important part of the proof is to show that, with probability tending to one, this customer indeed reaches the head of the line (recall that in Subsection 2.2 we have imposed the first-come-first-served discipline). Recall that POS n (s, t) represents the position {1, 2, 3,...} at time t of C n (s) if this customer is in the queue at time t, and it takes the value otherwise. Define Lemma A.7. i. κ n is a finite F n -stopping time. ii. One has {κ n < } F n ( κ n ). iii. P(κ n < ) 1. κ n = inf{t : POS n (t i, t) = 1}, κ n = κ n EX n (t i ). 12

14 Proof. i. Since EX n (t i ) < a.s., κ n is finite a.s. By assumption, POS n (t i, t) F n (t), and therefore {κ n < t} F n (t) for every t. Hence κ n is a stopping time, and since we have already shown that EX n is a stopping time, so is κ n. ii. To prove the statement we need to show that, for any u, E u = {κ n < } { κ n < u} F n (u). Now, E u = {κ n < u} {κ n <, EX n < u} = {κ n < u}, since clearly κ n < implies κ n EX n. Since we have already shown that κ n is a stopping time, it follows that E u F n (u). iii. Given t >, denote by Ω n(t) the event {Q n (AT n (t)) > }, namely that, at the time when the customer C n (t) arrives, the queue is non-empty. Let us show that the probability of this event, for fixed t, tends to one. Indeed, P(Ω n(t) c ) = P(Q n (AT n ) = ) = P( X n (AT n ) ), and, since X n (AT n ) ξ(t), lim sup n P(Ω n(t) c ) P(ξ(t) ) = P(ξ(t) = ). It is well-known for a non-degenerate reflected diffusion such as (24) that P(ξ(t) = ) =, for every t >. As a result, P(Ω n(t)) 1, t >. (A.34) Now, P(κ n < ) P(Ω n(t i ) {AB n (t i ) = }), because any customer that arrives to a non-empty queue and never abandons, will, with probability one, eventually get to position 1. Hence by (A.34) and Lemma A.4, P(κ n < ) 1. As mentioned earlier, the calculation of the chances that customer C n (t i ) is routed to each of the servers is based on the fact that, starting at κ n, a competition between exponentials takes place. Note however that it is the conditional distribution of the service time given G n that we are required to compute, and there is no guarantee that the service times that are elements of G n correspond to services completed earlier than κ n. We need a truncated version of service times. Let Write Ēl n = {EX n (t l ) < t i }, for 1 i i 1. An argument similar to the one that proves (A.33) gives P(Ēl n) 1, 1 l i 1. (A.35) Ḡ n = ( X 1 n, Σ 1 n1 Ē 1 n, X 2 n, Σ 2 n1 Ē 2 n,..., X i n), Ḡ = (ξ(t 1 ), η 1, ξ(t 2 ), η 2,..., ξ(t i )). Recall that we are given that (A.27) holds. Because the measure induced by Ḡ on R2i 1 does not charge the boundary of any set of the form M = (, a 1 ] (, a 2 ] (, a 2i 1 ], and in view of (A.35), we have, for every such set M, with the notation M n = {Ḡn M}, P(M n ) P(Ḡ M) =: p(m). (A.36) We are required to prove (A.28). For a similar reason, (A.28) is equivalent to the statement that, for every M as above, and a [, ), P(M n { Σ i n > a}) p(m)p(η i > a). (A.37) 13

15 We will prove (A.37) in what follows. To this end, write M n = M n {κ n < }, and note that P( Σ i n > a M n) = k K n P( Σ i n > a M n, RD n = k)p(rd n = k M n). Toward computing P(RD n = k M n) for some fixed k K n, denote, for r K n, v rn = T rn ( κ n ), and set τ rn = inf{s > v rn : S r (s) > }, τ rn = µ 1 rn (τ rn v rn ). On the event {κ n < }, the routing decision RD n takes the value k if and only if τ kn < τ rn for all r k, and AB n <. Now, since κ n is a finite stopping time (Lemma A.7(i)), it follows from Assumption 2.1(iii) that, conditioned on F n ( κ n ), the random variables (τ r v r ) are i.i.d. standard exponentials. Using this along with Lemma A.4(i), we have a.s. on {κ n < }, P(RD n = k F n ( κ n )) = µ kn γ n + r K n µ rn = µ kn γ n + µ n. Let us argue that M n F n ( κ n ). First, the argument provided in the proof of Lemma A.6 which shows that G n are measurable on F n (t (n) ) can be used, with small modifications, to show that Ḡn are measurable on F n (t i ). Since κ n t i a.s., it follows by P-completeness of the filtration that Ḡ n F n (t i ) F n ( κ n ). Also, {κ n < } F n ( κ n ) by Lemma A.7. Thus M n F n ( κ n ). It follows that P(RD n = k M n) = µ kn. γ n + µ n Next, Denote RT n = RT n EX n. Since κ n RT n, clearly κ n RT n. Thus M n F n (RT n ). Now, RT n is a finite stopping time, and so S k (T k (RT n ) + ) S k (T k (RT n )), under the conditioning on F n (RT n ), is a Poisson process with rate µ k. In addition, on {RD n = k}, RT n = RT n. Hence a.s. on {RD n = k}, P(Σ i n > a F n (RT n )) = e aµ kn. Therefore As a result, P( Σ i n > a M n) = k P(Σ i n > a M n, RD n = k) = e aµ kn. e aµ kn n µ kn γ n + µ n = 1 µ n + n 1 γ n N n n 1 Using (7), (15), and (25), the limit of the above expression is ν e ay ym(dy). µ e a µ kn µ kn. N n k 14

16 We have thus shown convergence in distribution to a nonnegative r.v., say η, for which P(η > a) = (a, ) f(x)dx, a >, where f(a) = ν e ay y 2 m(dy). µ In other words, comparing with (3) (31), we have shown P( Σ n > a M n) P(η i > a). In view of (A.36) and P(κ n < ) 1 (Lemma A.7(ii)), this implies (A.37). This completes the proof of Claim B. Proof of Theorem 2.2. Claims A C establish (A.25). Since Q n and X n both converge in distribution to the same limit, and since AT n (t) t in probability for each t, the theorem follows by Lemma A.4(iv) and the fact µ n µ. References [1] D. Aldous. Stopping times and tightness, II. Ann. Probab., 17, No. 2, (1989) [2] R. F. Anderson and S. Orey. Small random perturbation of dynamical systems with reflecting boundary. Nagoya Math. J. Vol. 6 (1976), [3] R. Atar, A. Budhiraja and K. Ramanan. Deterministic and stochastic differential inclusions with multiple surfaces of discontinuity. Probab. Theory Related Fields 142 (28), no. 1-2, [4] R. Atar and M. I. Reiman. Asymptotically optimal dynamic pricing for network revenue management. Work in progress. [5] P. Billingsley. Convergence of probability measures. Second edition. Wiley, New York, [6] S. N. Ethier and T. G. Kurtz. Markov processes. Characterization and convergence. Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics. John Wiley & Sons, Inc., New York, 1986 [7] I. Karatzas and S. E. Shreve. Brownian motion and stochastic calculus. Second edition. Springer-Verlag, New York, [8] P. E. Protter. Stochastic integration and differential equations. Second edition. Springer-Verlag, Berlin, 24 [9] P. Robert. Stochastic networks and queues. Applications of Mathematics (New York), 52. Stochastic Modelling and Applied Probability. Springer-Verlag, Berlin, 23. Department of Electrical Engineering Technion Israel Institute of Technology Haifa 32, Israel 15

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974 LIMITS FOR QUEUES AS THE WAITING ROOM GROWS by Daniel P. Heyman Ward Whitt Bell Communications Research AT&T Bell Laboratories Red Bank, NJ 07701 Murray Hill, NJ 07974 May 11, 1988 ABSTRACT We study the

More information

SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES

SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES RUTH J. WILLIAMS October 2, 2017 Department of Mathematics, University of California, San Diego, 9500 Gilman Drive,

More information

Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals

Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Functional Limit theorems for the quadratic variation of a continuous time random walk and for certain stochastic integrals Noèlia Viles Cuadros BCAM- Basque Center of Applied Mathematics with Prof. Enrico

More information

Stability of Stochastic Differential Equations

Stability of Stochastic Differential Equations Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010

More information

Convergence at first and second order of some approximations of stochastic integrals

Convergence at first and second order of some approximations of stochastic integrals Convergence at first and second order of some approximations of stochastic integrals Bérard Bergery Blandine, Vallois Pierre IECN, Nancy-Université, CNRS, INRIA, Boulevard des Aiguillettes B.P. 239 F-5456

More information

for all f satisfying E[ f(x) ] <.

for all f satisfying E[ f(x) ] <. . Let (Ω, F, P ) be a probability space and D be a sub-σ-algebra of F. An (H, H)-valued random variable X is independent of D if and only if P ({X Γ} D) = P {X Γ}P (D) for all Γ H and D D. Prove that if

More information

Selected Exercises on Expectations and Some Probability Inequalities

Selected Exercises on Expectations and Some Probability Inequalities Selected Exercises on Expectations and Some Probability Inequalities # If E(X 2 ) = and E X a > 0, then P( X λa) ( λ) 2 a 2 for 0 < λ

More information

Point Process Control

Point Process Control Point Process Control The following note is based on Chapters I, II and VII in Brémaud s book Point Processes and Queues (1981). 1 Basic Definitions Consider some probability space (Ω, F, P). A real-valued

More information

Brownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539

Brownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539 Brownian motion Samy Tindel Purdue University Probability Theory 2 - MA 539 Mostly taken from Brownian Motion and Stochastic Calculus by I. Karatzas and S. Shreve Samy T. Brownian motion Probability Theory

More information

Technical Appendix for: When Promotions Meet Operations: Cross-Selling and Its Effect on Call-Center Performance

Technical Appendix for: When Promotions Meet Operations: Cross-Selling and Its Effect on Call-Center Performance Technical Appendix for: When Promotions Meet Operations: Cross-Selling and Its Effect on Call-Center Performance In this technical appendix we provide proofs for the various results stated in the manuscript

More information

OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS

OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS APPLICATIONES MATHEMATICAE 29,4 (22), pp. 387 398 Mariusz Michta (Zielona Góra) OPTIMAL SOLUTIONS TO STOCHASTIC DIFFERENTIAL INCLUSIONS Abstract. A martingale problem approach is used first to analyze

More information

CONTINUITY OF A QUEUEING INTEGRAL REPRESENTATION IN THE M 1 TOPOLOGY. Department of Industrial Engineering and Operations Research Columbia University

CONTINUITY OF A QUEUEING INTEGRAL REPRESENTATION IN THE M 1 TOPOLOGY. Department of Industrial Engineering and Operations Research Columbia University Submitted to the Annals of Applied Probability CONTINUITY OF A QUEUEING INTEGRAL REPRESENTATION IN THE M 1 TOPOLOGY By Guodong Pang and Ward Whitt Department of Industrial Engineering and Operations Research

More information

Branching Processes II: Convergence of critical branching to Feller s CSB

Branching Processes II: Convergence of critical branching to Feller s CSB Chapter 4 Branching Processes II: Convergence of critical branching to Feller s CSB Figure 4.1: Feller 4.1 Birth and Death Processes 4.1.1 Linear birth and death processes Branching processes can be studied

More information

Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network. Haifa Statistics Seminar May 5, 2008

Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network. Haifa Statistics Seminar May 5, 2008 Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network Yoni Nazarathy Gideon Weiss Haifa Statistics Seminar May 5, 2008 1 Outline 1 Preview of Results 2 Introduction Queueing

More information

1 Brownian Local Time

1 Brownian Local Time 1 Brownian Local Time We first begin by defining the space and variables for Brownian local time. Let W t be a standard 1-D Wiener process. We know that for the set, {t : W t = } P (µ{t : W t = } = ) =

More information

1. Stochastic Processes and filtrations

1. Stochastic Processes and filtrations 1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S

More information

Filtrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition

Filtrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition Filtrations, Markov Processes and Martingales Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition David pplebaum Probability and Statistics Department,

More information

Finite-time Ruin Probability of Renewal Model with Risky Investment and Subexponential Claims

Finite-time Ruin Probability of Renewal Model with Risky Investment and Subexponential Claims Proceedings of the World Congress on Engineering 29 Vol II WCE 29, July 1-3, 29, London, U.K. Finite-time Ruin Probability of Renewal Model with Risky Investment and Subexponential Claims Tao Jiang Abstract

More information

Managing Service Systems with an Offline Waiting Option and Customer Abandonment: Companion Note

Managing Service Systems with an Offline Waiting Option and Customer Abandonment: Companion Note Managing Service Systems with an Offline Waiting Option and Customer Abandonment: Companion Note Vasiliki Kostami Amy R. Ward September 25, 28 The Amusement Park Ride Setting An amusement park ride departs

More information

Krzysztof Burdzy University of Washington. = X(Y (t)), t 0}

Krzysztof Burdzy University of Washington. = X(Y (t)), t 0} VARIATION OF ITERATED BROWNIAN MOTION Krzysztof Burdzy University of Washington 1. Introduction and main results. Suppose that X 1, X 2 and Y are independent standard Brownian motions starting from 0 and

More information

The Uniform Integrability of Martingales. On a Question by Alexander Cherny

The Uniform Integrability of Martingales. On a Question by Alexander Cherny The Uniform Integrability of Martingales. On a Question by Alexander Cherny Johannes Ruf Department of Mathematics University College London May 1, 2015 Abstract Let X be a progressively measurable, almost

More information

Exercises in stochastic analysis

Exercises in stochastic analysis Exercises in stochastic analysis Franco Flandoli, Mario Maurelli, Dario Trevisan The exercises with a P are those which have been done totally or partially) in the previous lectures; the exercises with

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 7 9/25/2013

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 7 9/25/2013 MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.65/15.070J Fall 013 Lecture 7 9/5/013 The Reflection Principle. The Distribution of the Maximum. Brownian motion with drift Content. 1. Quick intro to stopping times.

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 22 12/09/2013. Skorokhod Mapping Theorem. Reflected Brownian Motion

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 22 12/09/2013. Skorokhod Mapping Theorem. Reflected Brownian Motion MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.7J Fall 213 Lecture 22 12/9/213 Skorokhod Mapping Theorem. Reflected Brownian Motion Content. 1. G/G/1 queueing system 2. One dimensional reflection mapping

More information

MATH 6605: SUMMARY LECTURE NOTES

MATH 6605: SUMMARY LECTURE NOTES MATH 6605: SUMMARY LECTURE NOTES These notes summarize the lectures on weak convergence of stochastic processes. If you see any typos, please let me know. 1. Construction of Stochastic rocesses A stochastic

More information

{σ x >t}p x. (σ x >t)=e at.

{σ x >t}p x. (σ x >t)=e at. 3.11. EXERCISES 121 3.11 Exercises Exercise 3.1 Consider the Ornstein Uhlenbeck process in example 3.1.7(B). Show that the defined process is a Markov process which converges in distribution to an N(0,σ

More information

Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk

Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk ANSAPW University of Queensland 8-11 July, 2013 1 Outline (I) Fluid

More information

A Concise Course on Stochastic Partial Differential Equations

A Concise Course on Stochastic Partial Differential Equations A Concise Course on Stochastic Partial Differential Equations Michael Röckner Reference: C. Prevot, M. Röckner: Springer LN in Math. 1905, Berlin (2007) And see the references therein for the original

More information

Poisson random measure: motivation

Poisson random measure: motivation : motivation The Lévy measure provides the expected number of jumps by time unit, i.e. in a time interval of the form: [t, t + 1], and of a certain size Example: ν([1, )) is the expected number of jumps

More information

Technical Appendix for: When Promotions Meet Operations: Cross-Selling and Its Effect on Call-Center Performance

Technical Appendix for: When Promotions Meet Operations: Cross-Selling and Its Effect on Call-Center Performance Technical Appendix for: When Promotions Meet Operations: Cross-Selling and Its Effect on Call-Center Performance In this technical appendix we provide proofs for the various results stated in the manuscript

More information

On pathwise stochastic integration

On pathwise stochastic integration On pathwise stochastic integration Rafa l Marcin Lochowski Afican Institute for Mathematical Sciences, Warsaw School of Economics UWC seminar Rafa l Marcin Lochowski (AIMS, WSE) On pathwise stochastic

More information

Change detection problems in branching processes

Change detection problems in branching processes Change detection problems in branching processes Outline of Ph.D. thesis by Tamás T. Szabó Thesis advisor: Professor Gyula Pap Doctoral School of Mathematics and Computer Science Bolyai Institute, University

More information

A Diffusion Approximation for Stationary Distribution of Many-Server Queueing System In Halfin-Whitt Regime

A Diffusion Approximation for Stationary Distribution of Many-Server Queueing System In Halfin-Whitt Regime A Diffusion Approximation for Stationary Distribution of Many-Server Queueing System In Halfin-Whitt Regime Mohammadreza Aghajani joint work with Kavita Ramanan Brown University APS Conference, Istanbul,

More information

The Skorokhod problem in a time-dependent interval

The Skorokhod problem in a time-dependent interval The Skorokhod problem in a time-dependent interval Krzysztof Burdzy, Weining Kang and Kavita Ramanan University of Washington and Carnegie Mellon University Abstract: We consider the Skorokhod problem

More information

Stochastic Processes. Winter Term Paolo Di Tella Technische Universität Dresden Institut für Stochastik

Stochastic Processes. Winter Term Paolo Di Tella Technische Universität Dresden Institut für Stochastik Stochastic Processes Winter Term 2016-2017 Paolo Di Tella Technische Universität Dresden Institut für Stochastik Contents 1 Preliminaries 5 1.1 Uniform integrability.............................. 5 1.2

More information

Solving the Poisson Disorder Problem

Solving the Poisson Disorder Problem Advances in Finance and Stochastics: Essays in Honour of Dieter Sondermann, Springer-Verlag, 22, (295-32) Research Report No. 49, 2, Dept. Theoret. Statist. Aarhus Solving the Poisson Disorder Problem

More information

Lecture 17 Brownian motion as a Markov process

Lecture 17 Brownian motion as a Markov process Lecture 17: Brownian motion as a Markov process 1 of 14 Course: Theory of Probability II Term: Spring 2015 Instructor: Gordan Zitkovic Lecture 17 Brownian motion as a Markov process Brownian motion is

More information

EULER MARUYAMA APPROXIMATION FOR SDES WITH JUMPS AND NON-LIPSCHITZ COEFFICIENTS

EULER MARUYAMA APPROXIMATION FOR SDES WITH JUMPS AND NON-LIPSCHITZ COEFFICIENTS Qiao, H. Osaka J. Math. 51 (14), 47 66 EULER MARUYAMA APPROXIMATION FOR SDES WITH JUMPS AND NON-LIPSCHITZ COEFFICIENTS HUIJIE QIAO (Received May 6, 11, revised May 1, 1) Abstract In this paper we show

More information

The Skorokhod reflection problem for functions with discontinuities (contractive case)

The Skorokhod reflection problem for functions with discontinuities (contractive case) The Skorokhod reflection problem for functions with discontinuities (contractive case) TAKIS KONSTANTOPOULOS Univ. of Texas at Austin Revised March 1999 Abstract Basic properties of the Skorokhod reflection

More information

An essay on the general theory of stochastic processes

An essay on the general theory of stochastic processes Probability Surveys Vol. 3 (26) 345 412 ISSN: 1549-5787 DOI: 1.1214/1549578614 An essay on the general theory of stochastic processes Ashkan Nikeghbali ETHZ Departement Mathematik, Rämistrasse 11, HG G16

More information

Proofs of the martingale FCLT

Proofs of the martingale FCLT Probability Surveys Vol. 4 (2007) 268 302 ISSN: 1549-5787 DOI: 10.1214/07-PS122 Proofs of the martingale FCLT Ward Whitt Department of Industrial Engineering and Operations Research Columbia University,

More information

LECTURE 2: LOCAL TIME FOR BROWNIAN MOTION

LECTURE 2: LOCAL TIME FOR BROWNIAN MOTION LECTURE 2: LOCAL TIME FOR BROWNIAN MOTION We will define local time for one-dimensional Brownian motion, and deduce some of its properties. We will then use the generalized Ray-Knight theorem proved in

More information

Lecture 9. d N(0, 1). Now we fix n and think of a SRW on [0,1]. We take the k th step at time k n. and our increments are ± 1

Lecture 9. d N(0, 1). Now we fix n and think of a SRW on [0,1]. We take the k th step at time k n. and our increments are ± 1 Random Walks and Brownian Motion Tel Aviv University Spring 011 Lecture date: May 0, 011 Lecture 9 Instructor: Ron Peled Scribe: Jonathan Hermon In today s lecture we present the Brownian motion (BM).

More information

1 Sequences of events and their limits

1 Sequences of events and their limits O.H. Probability II (MATH 2647 M15 1 Sequences of events and their limits 1.1 Monotone sequences of events Sequences of events arise naturally when a probabilistic experiment is repeated many times. For

More information

The multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications

The multidimensional Ito Integral and the multidimensional Ito Formula. Eric Mu ller June 1, 2015 Seminar on Stochastic Geometry and its applications The multidimensional Ito Integral and the multidimensional Ito Formula Eric Mu ller June 1, 215 Seminar on Stochastic Geometry and its applications page 2 Seminar on Stochastic Geometry and its applications

More information

Stochastic Differential Equations.

Stochastic Differential Equations. Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)

More information

The Pedestrian s Guide to Local Time

The Pedestrian s Guide to Local Time The Pedestrian s Guide to Local Time Tomas Björk, Department of Finance, Stockholm School of Economics, Box 651, SE-113 83 Stockholm, SWEDEN tomas.bjork@hhs.se November 19, 213 Preliminary version Comments

More information

Deterministic and Stochastic Differential Inclusions with Multiple Surfaces of Discontinuity

Deterministic and Stochastic Differential Inclusions with Multiple Surfaces of Discontinuity Deterministic and Stochastic Differential Inclusions with Multiple Surfaces of Discontinuity Rami Atar, Amarjit Budhiraja and Kavita Ramanan Abstract: We consider a class of deterministic and stochastic

More information

arxiv:math/ v4 [math.pr] 12 Apr 2007

arxiv:math/ v4 [math.pr] 12 Apr 2007 arxiv:math/612224v4 [math.pr] 12 Apr 27 LARGE CLOSED QUEUEING NETWORKS IN SEMI-MARKOV ENVIRONMENT AND ITS APPLICATION VYACHESLAV M. ABRAMOV Abstract. The paper studies closed queueing networks containing

More information

A MODEL FOR THE LONG-TERM OPTIMAL CAPACITY LEVEL OF AN INVESTMENT PROJECT

A MODEL FOR THE LONG-TERM OPTIMAL CAPACITY LEVEL OF AN INVESTMENT PROJECT A MODEL FOR HE LONG-ERM OPIMAL CAPACIY LEVEL OF AN INVESMEN PROJEC ARNE LØKKA AND MIHAIL ZERVOS Abstract. We consider an investment project that produces a single commodity. he project s operation yields

More information

Stochastic integration. P.J.C. Spreij

Stochastic integration. P.J.C. Spreij Stochastic integration P.J.C. Spreij this version: April 22, 29 Contents 1 Stochastic processes 1 1.1 General theory............................... 1 1.2 Stopping times...............................

More information

An introduction to Mathematical Theory of Control

An introduction to Mathematical Theory of Control An introduction to Mathematical Theory of Control Vasile Staicu University of Aveiro UNICA, May 2018 Vasile Staicu (University of Aveiro) An introduction to Mathematical Theory of Control UNICA, May 2018

More information

E-Companion to Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments

E-Companion to Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments E-Companion to Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments Jun Luo Antai College of Economics and Management Shanghai Jiao Tong University

More information

Weak convergence and Brownian Motion. (telegram style notes) P.J.C. Spreij

Weak convergence and Brownian Motion. (telegram style notes) P.J.C. Spreij Weak convergence and Brownian Motion (telegram style notes) P.J.C. Spreij this version: December 8, 2006 1 The space C[0, ) In this section we summarize some facts concerning the space C[0, ) of real

More information

Notes 1 : Measure-theoretic foundations I

Notes 1 : Measure-theoretic foundations I Notes 1 : Measure-theoretic foundations I Math 733-734: Theory of Probability Lecturer: Sebastien Roch References: [Wil91, Section 1.0-1.8, 2.1-2.3, 3.1-3.11], [Fel68, Sections 7.2, 8.1, 9.6], [Dur10,

More information

A Barrier Version of the Russian Option

A Barrier Version of the Russian Option A Barrier Version of the Russian Option L. A. Shepp, A. N. Shiryaev, A. Sulem Rutgers University; shepp@stat.rutgers.edu Steklov Mathematical Institute; shiryaev@mi.ras.ru INRIA- Rocquencourt; agnes.sulem@inria.fr

More information

Large number of queues in tandem: Scaling properties under back-pressure algorithm

Large number of queues in tandem: Scaling properties under back-pressure algorithm Queueing Syst (2011) 67: 111 126 DOI 10.1007/s11134-010-9203-0 Large number of queues in tandem: Scaling properties under back-pressure algorithm Alexander L. Stolyar Received: 30 October 2009 / Revised:

More information

THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, R. M. Dudley

THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, R. M. Dudley THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, 2011 R. M. Dudley 1 A. Dvoretzky, J. Kiefer, and J. Wolfowitz 1956 proved the Dvoretzky Kiefer Wolfowitz

More information

The Cameron-Martin-Girsanov (CMG) Theorem

The Cameron-Martin-Girsanov (CMG) Theorem The Cameron-Martin-Girsanov (CMG) Theorem There are many versions of the CMG Theorem. In some sense, there are many CMG Theorems. The first version appeared in ] in 944. Here we present a standard version,

More information

Functional Limit Theorems for A New Class of Non-Stationary Shot Noise Processes

Functional Limit Theorems for A New Class of Non-Stationary Shot Noise Processes Functional Limit Theorems for A New Class of Non-Stationary Shot Noise Processes GUODONG PANG AND YUHANG ZHOU Abstract. We study a class of non-stationary shot noise processes which have a general arrival

More information

Randomization in the First Hitting Time Problem

Randomization in the First Hitting Time Problem Randomization in the First Hitting Time Problem Ken Jacson Alexander Kreinin Wanhe Zhang February 1, 29 Abstract In this paper we consider the following inverse problem for the first hitting time distribution:

More information

Stochastic Processes II/ Wahrscheinlichkeitstheorie III. Lecture Notes

Stochastic Processes II/ Wahrscheinlichkeitstheorie III. Lecture Notes BMS Basic Course Stochastic Processes II/ Wahrscheinlichkeitstheorie III Michael Scheutzow Lecture Notes Technische Universität Berlin Sommersemester 218 preliminary version October 12th 218 Contents

More information

Harmonic Functions and Brownian motion

Harmonic Functions and Brownian motion Harmonic Functions and Brownian motion Steven P. Lalley April 25, 211 1 Dynkin s Formula Denote by W t = (W 1 t, W 2 t,..., W d t ) a standard d dimensional Wiener process on (Ω, F, P ), and let F = (F

More information

(2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS

(2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS (2m)-TH MEAN BEHAVIOR OF SOLUTIONS OF STOCHASTIC DIFFERENTIAL EQUATIONS UNDER PARAMETRIC PERTURBATIONS Svetlana Janković and Miljana Jovanović Faculty of Science, Department of Mathematics, University

More information

Simulation methods for stochastic models in chemistry

Simulation methods for stochastic models in chemistry Simulation methods for stochastic models in chemistry David F. Anderson anderson@math.wisc.edu Department of Mathematics University of Wisconsin - Madison SIAM: Barcelona June 4th, 21 Overview 1. Notation

More information

Lecture 12. F o s, (1.1) F t := s>t

Lecture 12. F o s, (1.1) F t := s>t Lecture 12 1 Brownian motion: the Markov property Let C := C(0, ), R) be the space of continuous functions mapping from 0, ) to R, in which a Brownian motion (B t ) t 0 almost surely takes its value. Let

More information

Figure 10.1: Recording when the event E occurs

Figure 10.1: Recording when the event E occurs 10 Poisson Processes Let T R be an interval. A family of random variables {X(t) ; t T} is called a continuous time stochastic process. We often consider T = [0, 1] and T = [0, ). As X(t) is a random variable

More information

A NOTE ON STOCHASTIC INTEGRALS AS L 2 -CURVES

A NOTE ON STOCHASTIC INTEGRALS AS L 2 -CURVES A NOTE ON STOCHASTIC INTEGRALS AS L 2 -CURVES STEFAN TAPPE Abstract. In a work of van Gaans (25a) stochastic integrals are regarded as L 2 -curves. In Filipović and Tappe (28) we have shown the connection

More information

ONLINE APPENDIX TO: NONPARAMETRIC IDENTIFICATION OF THE MIXED HAZARD MODEL USING MARTINGALE-BASED MOMENTS

ONLINE APPENDIX TO: NONPARAMETRIC IDENTIFICATION OF THE MIXED HAZARD MODEL USING MARTINGALE-BASED MOMENTS ONLINE APPENDIX TO: NONPARAMETRIC IDENTIFICATION OF THE MIXED HAZARD MODEL USING MARTINGALE-BASED MOMENTS JOHANNES RUF AND JAMES LEWIS WOLTER Appendix B. The Proofs of Theorem. and Proposition.3 The proof

More information

Universal examples. Chapter The Bernoulli process

Universal examples. Chapter The Bernoulli process Chapter 1 Universal examples 1.1 The Bernoulli process First description: Bernoulli random variables Y i for i = 1, 2, 3,... independent with P [Y i = 1] = p and P [Y i = ] = 1 p. Second description: Binomial

More information

Optimal Stopping under Adverse Nonlinear Expectation and Related Games

Optimal Stopping under Adverse Nonlinear Expectation and Related Games Optimal Stopping under Adverse Nonlinear Expectation and Related Games Marcel Nutz Jianfeng Zhang First version: December 7, 2012. This version: July 21, 2014 Abstract We study the existence of optimal

More information

Richard F. Bass Krzysztof Burdzy University of Washington

Richard F. Bass Krzysztof Burdzy University of Washington ON DOMAIN MONOTONICITY OF THE NEUMANN HEAT KERNEL Richard F. Bass Krzysztof Burdzy University of Washington Abstract. Some examples are given of convex domains for which domain monotonicity of the Neumann

More information

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3 Brownian Motion Contents 1 Definition 2 1.1 Brownian Motion................................. 2 1.2 Wiener measure.................................. 3 2 Construction 4 2.1 Gaussian process.................................

More information

Other properties of M M 1

Other properties of M M 1 Other properties of M M 1 Přemysl Bejda premyslbejda@gmail.com 2012 Contents 1 Reflected Lévy Process 2 Time dependent properties of M M 1 3 Waiting times and queue disciplines in M M 1 Contents 1 Reflected

More information

Convergence of Markov Processes. Amanda Turner University of Cambridge

Convergence of Markov Processes. Amanda Turner University of Cambridge Convergence of Markov Processes Amanda Turner University of Cambridge 1 Contents 1 Introduction 2 2 The Space D E [, 3 2.1 The Skorohod Topology................................ 3 3 Convergence of Probability

More information

Doléans measures. Appendix C. C.1 Introduction

Doléans measures. Appendix C. C.1 Introduction Appendix C Doléans measures C.1 Introduction Once again all random processes will live on a fixed probability space (Ω, F, P equipped with a filtration {F t : 0 t 1}. We should probably assume the filtration

More information

STAT 331. Martingale Central Limit Theorem and Related Results

STAT 331. Martingale Central Limit Theorem and Related Results STAT 331 Martingale Central Limit Theorem and Related Results In this unit we discuss a version of the martingale central limit theorem, which states that under certain conditions, a sum of orthogonal

More information

Preliminary Exam: Probability 9:00am 2:00pm, Friday, January 6, 2012

Preliminary Exam: Probability 9:00am 2:00pm, Friday, January 6, 2012 Preliminary Exam: Probability 9:00am 2:00pm, Friday, January 6, 202 The exam lasts from 9:00am until 2:00pm, with a walking break every hour. Your goal on this exam should be to demonstrate mastery of

More information

A Review of Basic FCLT s

A Review of Basic FCLT s A Review of Basic FCLT s Ward Whitt Department of Industrial Engineering and Operations Research, Columbia University, New York, NY, 10027; ww2040@columbia.edu September 10, 2016 Abstract We briefly review

More information

Control of Fork-Join Networks in Heavy-Traffic

Control of Fork-Join Networks in Heavy-Traffic in Heavy-Traffic Asaf Zviran Based on MSc work under the guidance of Rami Atar (Technion) and Avishai Mandelbaum (Technion) Industrial Engineering and Management Technion June 2010 Introduction Network

More information

Logarithmic scaling of planar random walk s local times

Logarithmic scaling of planar random walk s local times Logarithmic scaling of planar random walk s local times Péter Nándori * and Zeyu Shen ** * Department of Mathematics, University of Maryland ** Courant Institute, New York University October 9, 2015 Abstract

More information

Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of. F s F t

Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of. F s F t 2.2 Filtrations Let (Ω, F) be a measureable space. A filtration in discrete time is a sequence of σ algebras {F t } such that F t F and F t F t+1 for all t = 0, 1,.... In continuous time, the second condition

More information

Brownian Motion. Chapter Definition of Brownian motion

Brownian Motion. Chapter Definition of Brownian motion Chapter 5 Brownian Motion Brownian motion originated as a model proposed by Robert Brown in 1828 for the phenomenon of continual swarming motion of pollen grains suspended in water. In 1900, Bachelier

More information

STAT Sample Problem: General Asymptotic Results

STAT Sample Problem: General Asymptotic Results STAT331 1-Sample Problem: General Asymptotic Results In this unit we will consider the 1-sample problem and prove the consistency and asymptotic normality of the Nelson-Aalen estimator of the cumulative

More information

The G/GI/N Queue in the Halfin-Whitt Regime I: Infinite Server Queue System Equations

The G/GI/N Queue in the Halfin-Whitt Regime I: Infinite Server Queue System Equations The G/GI/ Queue in the Halfin-Whitt Regime I: Infinite Server Queue System Equations J. E Reed School of Industrial and Systems Engineering Georgia Institute of Technology October 17, 27 Abstract In this

More information

LogFeller et Ray Knight

LogFeller et Ray Knight LogFeller et Ray Knight Etienne Pardoux joint work with V. Le and A. Wakolbinger Etienne Pardoux (Marseille) MANEGE, 18/1/1 1 / 16 Feller s branching diffusion with logistic growth We consider the diffusion

More information

Cross-Selling in a Call Center with a Heterogeneous Customer Population. Technical Appendix

Cross-Selling in a Call Center with a Heterogeneous Customer Population. Technical Appendix Cross-Selling in a Call Center with a Heterogeneous Customer opulation Technical Appendix Itay Gurvich Mor Armony Costis Maglaras This technical appendix is dedicated to the completion of the proof of

More information

MATH 56A: STOCHASTIC PROCESSES CHAPTER 6

MATH 56A: STOCHASTIC PROCESSES CHAPTER 6 MATH 56A: STOCHASTIC PROCESSES CHAPTER 6 6. Renewal Mathematically, renewal refers to a continuous time stochastic process with states,, 2,. N t {,, 2, 3, } so that you only have jumps from x to x + and

More information

2905 Queueing Theory and Simulation PART IV: SIMULATION

2905 Queueing Theory and Simulation PART IV: SIMULATION 2905 Queueing Theory and Simulation PART IV: SIMULATION 22 Random Numbers A fundamental step in a simulation study is the generation of random numbers, where a random number represents the value of a random

More information

SMSTC (2007/08) Probability.

SMSTC (2007/08) Probability. SMSTC (27/8) Probability www.smstc.ac.uk Contents 12 Markov chains in continuous time 12 1 12.1 Markov property and the Kolmogorov equations.................... 12 2 12.1.1 Finite state space.................................

More information

On the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem

On the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem On the martingales obtained by an extension due to Saisho, Tanemura and Yor of Pitman s theorem Koichiro TAKAOKA Dept of Applied Physics, Tokyo Institute of Technology Abstract M Yor constructed a family

More information

Chapter 1. Measure Spaces. 1.1 Algebras and σ algebras of sets Notation and preliminaries

Chapter 1. Measure Spaces. 1.1 Algebras and σ algebras of sets Notation and preliminaries Chapter 1 Measure Spaces 1.1 Algebras and σ algebras of sets 1.1.1 Notation and preliminaries We shall denote by X a nonempty set, by P(X) the set of all parts (i.e., subsets) of X, and by the empty set.

More information

The Fluid Limit of an Overloaded Processor Sharing Queue

The Fluid Limit of an Overloaded Processor Sharing Queue MATHEMATICS OF OPERATIONS RESEARCH Vol. 31, No. 2, May 26, pp. 316 35 issn 364-765X eissn 1526-5471 6 312 316 informs doi 1.1287/moor.15.181 26 INFORMS The Fluid Limit of an Overloaded Processor Sharing

More information

STOCHASTIC CALCULUS JASON MILLER AND VITTORIA SILVESTRI

STOCHASTIC CALCULUS JASON MILLER AND VITTORIA SILVESTRI STOCHASTIC CALCULUS JASON MILLER AND VITTORIA SILVESTRI Contents Preface 1 1. Introduction 1 2. Preliminaries 4 3. Local martingales 1 4. The stochastic integral 16 5. Stochastic calculus 36 6. Applications

More information

Spatial Ergodicity of the Harris Flows

Spatial Ergodicity of the Harris Flows Communications on Stochastic Analysis Volume 11 Number 2 Article 6 6-217 Spatial Ergodicity of the Harris Flows E.V. Glinyanaya Institute of Mathematics NAS of Ukraine, glinkate@gmail.com Follow this and

More information

Lecture 21 Representations of Martingales

Lecture 21 Representations of Martingales Lecture 21: Representations of Martingales 1 of 11 Course: Theory of Probability II Term: Spring 215 Instructor: Gordan Zitkovic Lecture 21 Representations of Martingales Right-continuous inverses Let

More information

Math 6810 (Probability) Fall Lecture notes

Math 6810 (Probability) Fall Lecture notes Math 6810 (Probability) Fall 2012 Lecture notes Pieter Allaart University of North Texas September 23, 2012 2 Text: Introduction to Stochastic Calculus with Applications, by Fima C. Klebaner (3rd edition),

More information

Multiple points of the Brownian sheet in critical dimensions

Multiple points of the Brownian sheet in critical dimensions Multiple points of the Brownian sheet in critical dimensions Robert C. Dalang Ecole Polytechnique Fédérale de Lausanne Based on joint work with: Carl Mueller Multiple points of the Brownian sheet in critical

More information