Regularity and optimization

Size: px
Start display at page:

Download "Regularity and optimization"

Transcription

1 Regularity and optimization Bruno Gaujal INRIA SDA2, 2007 B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

2 Majorization x = (x 1,, x n ) R n, x is a permutation of x with decreasing coordinates. { k x y si i=1 x i k i=1 y i k, 1 k n 1, n i=1 x = n i=1 y Marshall Olkin, 1979 i i. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

3 Majorization x = (x 1,, x n ) R n, x is a permutation of x with decreasing coordinates. { k x y si i=1 x i k i=1 y i k, 1 k n 1, n i=1 x = n i=1 y i Marshall Olkin, 1979 If x = (0, 1, 3, 1) and y = (3, 1, 8, 1), x = (1, 0, 1, 3), y = (3, 1, 1, 8), partial sums verify : = , which implies x y. i. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

4 Majorization (II) If P is a doubly stochastic matrix, y = x P y x. Using Birkhoff Theorem (doubly stochastic matrices are convex combination of permutation matrices). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

5 Majorization (II) If P is a doubly stochastic matrix, y = x P y x. Using Birkhoff Theorem (doubly stochastic matrices are convex combination of permutation matrices). x e 3 e 1 e 2 B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

6 Schur convexity f : R n R is Schur-convex if x y f (x) f (y). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

7 Schur convexity f : R n R is Schur-convex if x y f (x) f (y). Theorem If f (x) f (y) for all Schur convex functions f, then x y. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

8 Schur convexity f : R n R is Schur-convex if x y f (x) f (y). Theorem If f (x) f (y) for all Schur convex functions f, then x y. Let φ : R n R and g : R R such that ψ : R n R is such that ψ(x 1,..., x n ) = φ(g(x 1 ),..., g(x n )). If φ is increasing and Schur convex and g is convex, then ψ est Schur-decreasing. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

9 Some applications Polygons with n vertices inside a disk. A 3 A 4 A 2 θ 4 θ 3 O θ 2 θ 1 θ 5 θ 6 A 1 A 5 A 6 The surface is 1/2 n i=1 sin(θ i), which is Schur-concave. (θ 1,... θ n ) (α 1,... α n ) implies that the surfaces S θ S α. The polygon with the largest surface S is regular. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

10 Some applications Polygon with n vertices outside a disk, with the smallest k-th moment, for all k. h r A 2 θ 2 θ 1 C(r) A 3 θ 3 θ 4 θ 5 A 4 A 5 A 1 h r = r n i=1 max(0, θ i 2 cos 1 (1/r)). is Schur convex. The polygon with the smallest k-th moment is regular, for all k. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

11 Application in Networks Bandwidth allocation in Networks Eitan Altman Using Shannon SINR Formula, The total throughput is a sum of a convex function of the emited power, so that it is maximized by small (w.r.t.majorization)power allocation. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

12 Application in Networks Bandwidth allocation in Networks Eitan Altman Using Shannon SINR Formula, The total throughput is a sum of a convex function of the emited power, so that it is maximized by small (w.r.t.majorization)power allocation. Structure of optimal control Ger Koole B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

13 Routing applications Majorization and Schur convexity cannot be used when the problem depends on the actual sequence and is not invariant up to permutations. Actually, the following applications will be invariant up to cyclic permutations. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

14 Mechanical words This talk will now focus on finite or periodic mechanical words. 1 Extremal properties of rational mechanical words for scheduling problems 2 Factorizations of mechanical words using Continued Fractions and their consequences on computational problems 3 Compute the extremal points in the scheduling problems. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

15 Mechanical words This talk will now focus on finite or periodic mechanical words. 1 Extremal properties of rational mechanical words for scheduling problems 2 Factorizations of mechanical words using Continued Fractions and their consequences on computational problems 3 Compute the extremal points in the scheduling problems. There exist many ways to link continued fraction decompositions with mechanical words. Here, we will exhibit a link which has some algorithmic and computational interest. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

16 Mechanical words Definition (Mechanical words) A mechanical word with slope (density) 0 α 1 and intercept ρ is the infinite word w α,ρ whose letters are n 0, w α,ρ (n) = (n + 1)α + ρ nα + ρ, or n 0, w α,ρ (n) = (n + 1)α + ρ nα + ρ B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

17 Mechanical words Definition (Mechanical words) A mechanical word with slope (density) 0 α 1 and intercept ρ is the infinite word w α,ρ whose letters are n 0, w α,ρ (n) = (n + 1)α + ρ nα + ρ, or n 0, w α,ρ (n) = (n + 1)α + ρ nα + ρ When α is a rational number (α = p/q), then w α,ρ is periodic of period q (i.e. n 0, w α,ρ (n) = w α,ρ (n + q)) Definition (Finite mechanical words) A finite word m is mechanical if w = m is a mechanical word. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

18 Optimal properties of rational mechanical words λ w µ 1 µ λ 1 λ 2 w µ 2 The arrival rate(s) λ (λ 1 and λ 2 ) are arbitrary positive real numbers, the service rates µ 1, µ 2 (µ) are also arbitrary. They verify the stability property : µ 1 + µ 2 λ (µ > λ 1 + λ 2 ). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

19 Optimal properties of rational mechanical words µ 1 µ λ w λ 1 λ 2 w µ 2 The arrival rate(s) λ (λ 1 and λ 2 ) are arbitrary positive real numbers, the service rates µ 1, µ 2 (µ) are also arbitrary. They verify the stability property : µ 1 + µ 2 λ (µ > λ 1 + λ 2 ). Theorem G.-Hyon 03, G.-Hordijk-Van der Laan 06 The routing (allocation) sequence minimizing the workload is a mechanical word with a rational density α. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

20 Workload If σ n is the size of packet n, δ n the time between the nth arrival and the n 1th arrival, and a n {0, 1}, the routing decision to Queue 1, then the workload verifies : W n = max (W n 1 + a n 1 σ n 1 δ n, 0). a a a a a a 6 δ 1 W(t) δ δ δ δ δ σ 4 σ 2 σ 3 σ 5 σ 1 σ t B. Gaujal (INRIA ) d 1 Regularity andd Optimization 2 d3 d4 d5 SDA2, / 39

21 Optimality (II) Under routing sequence w, let W 1 n (w) be the workload in queue 1 at the n-th decision and W 1 (w) = lim sup 1 N N Wn 1 (w). n=1 Theorem (AGH) Altman, G., Hordijk, 2000 Over all sequences w of density at least α, W 1 (w) is minimal when w = m α, the mechanical sequence of density α. Based on multimodularity properties. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

22 Convexity of α αw 1 (m α ) Let α 1 = p 1 q 1 and α 2 = p 2 Let m = m q 2 α 1 m q 1 α 2. q 2 in the stability interval,j = [1 µ 2, µ 1 ]. Let N(m) be the average number of packets in queue 1 under the routing sequence m. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

23 Convexity of α αw 1 (m α ) Let α 1 = p 1 q 1 and α 2 = p 2 Let m = m q 2 α 1 m q 1 α 2. q 2 in the stability interval,j = [1 µ 2, µ 1 ]. Let N(m) be the average number of packets in queue 1 under the routing sequence m. N(m) = q 1q 2 N(m 1 )+q 2 q 1 N(m 2 ) q 1 q 2 +q 2 q 1. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

24 Convexity of α αw 1 (m α ) Let α 1 = p 1 q 1 and α 2 = p 2 Let m = m q 2 α 1 m q 1 α 2. q 2 in the stability interval,j = [1 µ 2, µ 1 ]. Let N(m) be the average number of packets in queue 1 under the routing sequence m. N(m) = q 1q 2 N(m 1 )+q 2 q 1 N(m 2 ) q 1 q 2 +q 2 q 1. Let α = p 1q 2 +p 2 q 1 q 1 q 2 +q 2 q 1 (note that α = α 1 /2 + α 2 /2 is the density of m). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

25 Convexity of α αw 1 (m α ) Let α 1 = p 1 q 1 and α 2 = p 2 Let m = m q 2 α 1 m q 1 α 2. q 2 in the stability interval,j = [1 µ 2, µ 1 ]. Let N(m) be the average number of packets in queue 1 under the routing sequence m. N(m) = q 1q 2 N(m 1 )+q 2 q 1 N(m 2 ) q 1 q 2 +q 2 q 1. Let α = p 1q 2 +p 2 q 1 q 1 q 2 +q 2 q 1 (note that α = α 1 /2 + α 2 /2 is the density of m). Using Theorem [AGH], N(m α ) N(m) = 1/2N(m α1 ) + 1/2N(m α2 ), and λ [0, 1] N(m λα1 +(1 λ)α 2 ) λn(m α1 ) + (1 λ)n(m α2 ). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

26 Convexity of α αw 1 (m α ) Let α 1 = p 1 q 1 and α 2 = p 2 Let m = m q 2 α 1 m q 1 α 2. q 2 in the stability interval,j = [1 µ 2, µ 1 ]. Let N(m) be the average number of packets in queue 1 under the routing sequence m. N(m) = q 1q 2 N(m 1 )+q 2 q 1 N(m 2 ) q 1 q 2 +q 2 q 1. Let α = p 1q 2 +p 2 q 1 q 1 q 2 +q 2 q 1 (note that α = α 1 /2 + α 2 /2 is the density of m). Using Theorem [AGH], N(m α ) N(m) = 1/2N(m α1 ) + 1/2N(m α2 ), and λ [0, 1] N(m λα1 +(1 λ)α 2 ) λn(m α1 ) + (1 λ)n(m α2 ). Using Little s Formula, N(m α ) = α(w 1 (m α ) + 1/µ). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

27 Linearity over Farey intervals The interval [d 1, d 2 ] (d i = p i q i ) is called a Farey interval if q 1 p 2 p 1 q 2 = 1. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

28 Linearity over Farey intervals The interval [d 1, d 2 ] (d i = p i q i ) is called a Farey interval if q 1 p 2 p 1 q 2 = 1. Proposition Let I = [α 1, α 2 ] be a Farey interval, then for all α I, m α can be factorized into m α1 and m α2. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

29 Linearity over Farey intervals The interval [d 1, d 2 ] (d i = p i q i ) is called a Farey interval if q 1 p 2 p 1 q 2 = 1. Proposition Let I = [α 1, α 2 ] be a Farey interval, then for all α I, m α can be factorized into m α1 and m α2. Using the greatest integer continued fraction expansion of α and the associated factorization of m α (below) one can show that the queue is empty at the end of each period of a mechanical word with intercept 0. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

30 Linearity over Farey interals(ii) B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

31 Linearity over Farey interals(ii) Corollary The function α αw 1 (m α ) is linear over any Farey interal I J. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

32 Construction of the best control sequence The global cost function in both queues is C(α) = αw 1 (m α ) + (1 α)w 2 (m 1 α ). Inside the stability interval J = [1 µ 2, µ 1 ], let us consider the successive convergents of the lower continued fraction decomposition of µ 1 and of the upper continued fraction decomposition of 1 µ 2. They form Farey intervals over which the function C(α) is linear. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

33 Construction of the best control sequence The global cost function in both queues is C(α) = αw 1 (m α ) + (1 α)w 2 (m 1 α ). Inside the stability interval J = [1 µ 2, µ 1 ], let us consider the successive convergents of the lower continued fraction decomposition of µ 1 and of the upper continued fraction decomposition of 1 µ 2. They form Farey intervals over which the function C(α) is linear. By convexity and piecewise linearity, the function C(α) is minimal at one of these convergents. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

34 Construction of the best control sequence The global cost function in both queues is C(α) = αw 1 (m α ) + (1 α)w 2 (m 1 α ). Inside the stability interval J = [1 µ 2, µ 1 ], let us consider the successive convergents of the lower continued fraction decomposition of µ 1 and of the upper continued fraction decomposition of 1 µ 2. They form Farey intervals over which the function C(α) is linear. By convexity and piecewise linearity, the function C(α) is minimal at one of these convergents. Furthermore, using the recursive factorisation of mechanical words shown below (Theorem 7) one can compute the function C at all those points. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

35 Numerical computations(i) g 0.2 B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39 α

36 Numerical computations(ii) 2 1/S α = 0 opt α = 1/4 opt α = 1/3 opt α opt= 1/2 1/S 2 = c 1/S 1 α =1 opt Instability domain 1 1/S B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

37 Numerical computations(iii) 2 1/S Double cusp optimal Instability domain (0,0) 1 1/S The number of convergents browsed by the algorithm before reaching the minimum point is small (as show in the figure). More numerical evidences show that for 99% of the stability polytope, the optimal sequence has a period less than 10. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

38 Nearest Integer Continued fraction A semi regular continued fraction (SRCF)-expansion of a number s [0, 1) is a finite or infinite fraction s = 0 + ɛ 1 ɛ 2 b 1 + b ɛ n. b n +... where, b n N and ɛ n { 1, 1}. (b n + ε n 1, b n + ε n+1 1 and b n + ε n+1 2 infinitely often.), B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

39 Nearest Integer Continued fraction A semi regular continued fraction (SRCF)-expansion of a number s [0, 1) is a finite or infinite fraction s = 0 + ɛ 1 ɛ 2 b 1 + b ɛ n. b n +... where, b n N and ɛ n { 1, 1}. (b n + ε n 1, b n + ε n+1 1 and b n + ε n+1 2 infinitely often.) Let U γ : [0, 1] [0, 1], U γ (s) = γ if s 0 and U γ (0) = 0 otherwise. s s The coefficients of the SRCF-expansion are ( ) ɛ n (s) = sign (s) ; b n (s) = U n 1 γ Uγ n 1, γ. (s) B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

40 Nearest Integer Continued fraction (II) Some SRCFs are quite remarkable. γ = 1 corresponds to the regular continued fraction expansion (RCF). γ = 0 corresponds to an expansion where, for all n, ɛ n = 1. It appears in the litterature under the name greatest integer continued fraction (GICF). γ = 1/2 is the Nearest Integer Continued Fraction (NICF), on which we will mainly focus. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

41 Nearest Integer Continued fraction (III) Let α = 13/31. U 1/2 (13/31) = = 5 13, b 1 = = 2, ɛ 2 = 1. Continuing the expansion gives U 2 1/2 = 2/5, b 2 = 3, ɛ 3 = 1 and U 3 1/2 = 1/2, b 3 = 3, ɛ 4 = 1 finally b 4 = 2. The NICF expansion of 13/31 is 2, 3, 3, 2. The sequence of convergents is 2 =1/2, 2, 3 =3/7, 2, 3, 3 =8/19 and 2, 3, 3, 2 =13/31. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

42 NICF and word factorization Let α (0, 1/2) such that its partial NICF of order n + 1 is 0, b 1, ɛ 2 b 2,..., ɛ n b n, ɛ n+1 b n+1 +ɛ n+2 α n+1. Let I(n) = n+1 i=2 1 {ɛ i =+1}. Theorem The mechanical word m α can be factorized only using two factors x n and y n for all n defined by x 0 = 1, y 0 = 0 and for n 1, ( ) bn 1 ( ) bn x n = x n 1 yn 1, yn = x n 1 yn 1 if I(n) even ɛn+2 =+1, ( ) bn 2 ( ) bn 1 x n = x n 1 yn 1, yn = x n 1 yn 1 if I(n) even ɛ n+2 = 1, x n = ( ) bn x n 1 y n 1, y n = ( ) bn 1 x n 1 yn 1 if I(n) odd ɛ n+2 = +1, x n = ( ) bn 1 x n 1 yn 1, y n = ( ) bn 2 x n 1 yn 1 if I(n) odd ɛ n+2 = 1. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

43 example Let α be equal to 13/31, its partial remainders are 5/13, 2/5 and 1/2 and its convergents are 1/2, 3/7 and 8/19. It comes x 3 { }} {{ }} { x 1 x 1 y 1 x 1 x 1 y 1 x 1 y 1 x 1 x 1 y 1 x 1 y 1 {}}{{}}{{}}{{}}{{}}{{}}{{}}{{}}{{}}{{}}{{}}{{}}{{}}{ m 13/31 = } {{ 100 }} {{ 100 }} 10 {{ 100 }} {{ 100 }} 10 {{ 100 }, } x 2 x 2 y 2 {{ x 2 y 2 } x 4 since Φ(m 13/31 ) = m 1 5/13, Φ(m 8/13 ) = m 1 2/5, Φ(m 3/5 ) = m 1/2 and Φ(m 1/2 ) = m 1. y 3 B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

44 Algorithmic considerations B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

45 Algorithmic considerations Result Let α = p/q 1/2 be a rational number. The number of iterations to reach the complete expansion in NICF is upper bounded by log η (1 + q 8) with η = B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

46 Algorithmic considerations Result Let α = p/q 1/2 be a rational number. The number of iterations to reach the complete expansion in NICF is upper bounded by log η (1 + q 8) with η = Corollary The maximal number of regular reductions used to test if a word w is balanced is bounded by log η (1 + w 8) with η = B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

47 Extension 1 : The stochastic case The cost is now the Cesaro limit of the expected worloads. The optimal polling between two queues can be computed when the service is exponential (with rate µ i in queue i) and the inter-arrivals are exponential (with rate λ in both queues). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

48 Extension 1 : The stochastic case The cost is now the Cesaro limit of the expected worloads. The optimal polling between two queues can be computed when the service is exponential (with rate µ i in queue i) and the inter-arrivals are exponential (with rate λ in both queues). The continuous time Markov chain X t is a quasi birth and death process whose generator Q is given by C A A 2 A 1 A Q = 0 A 2 A 1 A 0..., 0 0 A 2 A B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

49 Extension 1 : The stochastic case The cost is now the Cesaro limit of the expected worloads. The optimal polling between two queues can be computed when the service is exponential (with rate µ i in queue i) and the inter-arrivals are exponential (with rate λ in both queues). The continuous time Markov chain X t is a quasi birth and death process whose generator Q is given by C A A 2 A 1 A Q = 0 A 2 A 1 A 0..., 0 0 A 2 A The stationary measure can be computed using the Kernel method : Π(z)K (z) = π 0 µ(1 z)m. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

50 The stochastic case(ii) B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

51 EXtension 2 : Multidimensional routing problems A natural extension of the routing problem is to consider a routing to N > 2 queues. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

52 EXtension 2 : Multidimensional routing problems A natural extension of the routing problem is to consider a routing to N > 2 queues. The control sequence can be seen as a word over N letters. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

53 EXtension 2 : Multidimensional routing problems A natural extension of the routing problem is to consider a routing to N > 2 queues. The control sequence can be seen as a word over N letters. The optimization problem is to minimize the average waiting time of all incoming packets : W (a) = N i=1 p iw i (1 i (a)). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

54 EXtension 2 : Multidimensional routing problems A natural extension of the routing problem is to consider a routing to N > 2 queues. The control sequence can be seen as a word over N letters. The optimization problem is to minimize the average waiting time of all incoming packets : W (a) = N i=1 p iw i (1 i (a)). The problem is still open. One of the main difficulties : the sequences 1 i (a) cannot be all balanced (Fraenkel Conjecture Altman, G.,Hordijk, 2000 ; Tijdeman 2004). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

55 The multimodular ordering D (n + 1) n of rank N s. t. the rows s s n = 0. The Mesh M D is the set {a 0 s a n s n, a i Z}. D M D B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

56 The multimodular ordering D (n + 1) n of rank N s. t. the rows s s n = 0. The Mesh M D is the set {a 0 s a n s n, a i Z}. D M D Definition (AGH, 2003) A function f is D-multimodular if a Z n and i j, f (a + s i ) + f (a + s j ) f (a) + f (a + s i + s k ) B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

57 The multimodular ordering D (n + 1) n of rank N s. t. the rows s s n = 0. The Mesh M D is the set {a 0 s a n s n, a i Z}. D M D Definition (AGH, 2003) A function f is D-multimodular if a Z n and i j, f (a + s i ) + f (a + s j ) f (a) + f (a + s i + s k ) f is D-mm iff its linear interpolation over the atoms of M D is convex. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

58 The multimodular ordering (II) Let F(D, r) be the set of all D-mm functions minimum at r M D. Definition x mm y if f (x) f (y) for all f F(D, r). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

59 The multimodular ordering (II) Let F(D, r) be the set of all D-mm functions minimum at r M D. Definition x mm y if f (x) f (y) for all f F(D, r). Theorem x mm y iff there exists a path over M D from x to y, away from r. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

60 The multimodular ordering (II) Let F(D, r) be the set of all D-mm functions minimum at r M D. Definition x mm y if f (x) f (y) for all f F(D, r). Theorem x mm y iff there exists a path over M D from x to y, away from r. y x r D M D B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

61 Multimodular order and shifts Let P(T, S) be the set of all integer sequences of size T that sum to S. D is the mesh induced from D over the hyperplane i a i = S. P(T, S) is the set of conjugacy classes w.r.t. cyclic permutations. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

62 Multimodular order and shifts Let P(T, S) be the set of all integer sequences of size T that sum to S. D is the mesh induced from D over the hyperplane i a i = S. P(T, S) is the set of conjugacy classes w.r.t. cyclic permutations. Definition x mms y in P(T, S), if f (x) f (y) for all D -mm function f which is invariant by cyclic permutations. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

63 Multimodular order and shifts Let P(T, S) be the set of all integer sequences of size T that sum to S. D is the mesh induced from D over the hyperplane i a i = S. P(T, S) is the set of conjugacy classes w.r.t. cyclic permutations. Definition x mms y in P(T, S), if f (x) f (y) for all D -mm function f which is invariant by cyclic permutations. Theorem The balanced word w(t, S) is minimal over P(T, S) for the mms-order. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

64 Multimodular order and shifts Let P(T, S) be the set of all integer sequences of size T that sum to S. D is the mesh induced from D over the hyperplane i a i = S. P(T, S) is the set of conjugacy classes w.r.t. cyclic permutations. Definition x mms y in P(T, S), if f (x) f (y) for all D -mm function f which is invariant by cyclic permutations. Theorem The balanced word w(t, S) is minimal over P(T, S) for the mms-order. Corollary x mms y if the cone -distance to w(t, S) over mesh M D is larger for y. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

65 Unbalance in P(T, S). Partial sums : k s (n) = s i + + s n Discrepancy : φ s (n) = k s (n) ns/t. Theorem If T, S are co-prime, among all cyclic permutations of s, only one verifies n, φ s (n) 0 and only one verifies n, φ s (n) 0, called s and s respectively. The discrepancy also induces orders over P(T, S) : Definition u g v if n, φ u (n) φ v (n). u g v if n, φ u (n) φ v (n). u g v if u g v and u g v. Theorem w = w(t, S) is minimal over P(T, S) for the orders g, g, g. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

66 Unbalance(II) The upper unbalance of a sequence u in P(T, S) is I(u) = 1 T T k u (n) k w (n) n=1 The lower unbalance of a sequence u in P(T, S) is I(u) = 1 T T k u (n) k w (n) n= unbalance: 15/ B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

67 Links between the orders In Z n : u mm v Path u v away from r In P(T, S), Path u v away from w u mms v Path u v away from w u g u g u mms v B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

68 Links between the orders In Z n : u mm v Path u v away from r In P(T, S), Path u v away from w u mms v Path u v away from w u g u g u mms v Therefore, the g-order does not look very useful. However, the unbalance provides the good measure of the gap with an optimal sequence w.r.t. waiting times. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

69 Unbalance and waiting times If W (u) is the long run average waiting time in a queue, where interarrival times and service times and iid sequences. then B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

70 Unbalance and waiting times If W (u) is the long run average waiting time in a queue, where interarrival times and service times and iid sequences. then Theorem W is D -mm over P(T, S) when D is the set of left shifts. W is invariant by cyclic permutations. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

71 Unbalance and waiting times If W (u) is the long run average waiting time in a queue, where interarrival times and service times and iid sequences. then Theorem W is D -mm over P(T, S) when D is the set of left shifts. W is invariant by cyclic permutations. Therefore, u mms v implies W (u) W (v). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

72 Unbalance and waiting times If W (u) is the long run average waiting time in a queue, where interarrival times and service times and iid sequences. then Theorem W is D -mm over P(T, S) when D is the set of left shifts. W is invariant by cyclic permutations. Therefore, u mms v implies W (u) W (v). The density of u P(T, S) is d = S/T. Theorem W (u) W (w) + E(δ) d I(u). Moreover, if the system is deterministic and δ = dσ, then W (u) = W (w) + δ d I(u). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

73 Routing to parallel queues We consider all routing sequences a where the frequency of routing in queue i is d i. The admission sequence in queue i, u i = 1 i (a) is a binary sequence with density d i. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

74 Routing to parallel queues We consider all routing sequences a where the frequency of routing in queue i is d i. The admission sequence in queue i, u i = 1 i (a) is a binary sequence with density d i. The average waiting time of all packets can be written as C(a) = d i W (u i ). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

75 Routing to parallel queues We consider all routing sequences a where the frequency of routing in queue i is d i. The admission sequence in queue i, u i = 1 i (a) is a binary sequence with density d i. The average waiting time of all packets can be written as C(a) = d i W (u i ). Theorem Let L = n i=1 d iw (w(d i )), then L C(a) L + E(δ) n I(u i ). i=1 B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

76 Routing to parallel queues We consider all routing sequences a where the frequency of routing in queue i is d i. The admission sequence in queue i, u i = 1 i (a) is a binary sequence with density d i. The average waiting time of all packets can be written as C(a) = d i W (u i ). Theorem Let L = n i=1 d iw (w(d i )), then L C(a) L + E(δ) n I(u i ). i=1 Moreover, in the deterministic case, under load one, C(a) = L + E(δ) n i=1 I(u i). B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

77 Billiard sequences m = B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

78 Billiards and unbalance In dimension n, there exists an optimal starting point for rational billiard sequences in terms of unbalance Van der Laan, 2004 B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

79 Billiards and unbalance In dimension n, there exists an optimal starting point for rational billiard sequences in terms of unbalance Van der Laan, 2004 The optimal starting point can be computed using an integer program. The optimal unbalance of a rational billiard sequence is n/2 1. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

80 Billiards and unbalance In dimension n, there exists an optimal starting point for rational billiard sequences in terms of unbalance Van der Laan, 2004 The optimal starting point can be computed using an integer program. The optimal unbalance of a rational billiard sequence is n/2 1. This provides in polynomial time a routing sequence which cost is at most d i W (w(d i )) + E(δ)n/2 1. B. Gaujal (INRIA ) Regularity and Optimization SDA2, / 39

THE STRUCTURE AND PERFORMANCE OF OPTIMAL ROUTING SEQUENCES. Proefschrift

THE STRUCTURE AND PERFORMANCE OF OPTIMAL ROUTING SEQUENCES. Proefschrift THE STRUCTURE AND PERFORMANCE OF OPTIMAL ROUTING SEQUENCES Proefschrift ter verkrijging van de graad van Doctor aan de Universiteit Leiden, op gezag van de Rector Magnificus Dr. D. D. Breimer, hoogleraar

More information

Input-queued switches: Scheduling algorithms for a crossbar switch. EE 384X Packet Switch Architectures 1

Input-queued switches: Scheduling algorithms for a crossbar switch. EE 384X Packet Switch Architectures 1 Input-queued switches: Scheduling algorithms for a crossbar switch EE 84X Packet Switch Architectures Overview Today s lecture - the input-buffered switch architecture - the head-of-line blocking phenomenon

More information

Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk

Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk ANSAPW University of Queensland 8-11 July, 2013 1 Outline (I) Fluid

More information

Optimal Routing in Deterministic Queues in Tandem

Optimal Routing in Deterministic Queues in Tandem ISTITUT ATIOAL D RCHRCH IORMATIQU T AUTOMATIQU Optimal Routing in Deterministic Queues in Tandem Bruno Gaujal mmanuel Hyon 393 Mars THÈM 1 ISS 9-6399 ISR IRIA/RR--393--R+G apport de recherche Optimal

More information

Logistics. All the course-related information regarding

Logistics. All the course-related information regarding Logistics All the course-related information regarding - grading - office hours - handouts, announcements - class project: this is required for 384Y is posted on the class website Please take a look at

More information

On the static assignment to parallel servers

On the static assignment to parallel servers On the static assignment to parallel servers Ger Koole Vrije Universiteit Faculty of Mathematics and Computer Science De Boelelaan 1081a, 1081 HV Amsterdam The Netherlands Email: koole@cs.vu.nl, Url: www.cs.vu.nl/

More information

Optimal Routing Policy in Two Deterministic Queues

Optimal Routing Policy in Two Deterministic Queues INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE Optimal Routing Policy in Two Deterministic Queues Bruno Gaujal Emmanuel Hyon N 3997 Septembre 2000 THÈME 1 ISSN 0249-6399 ISRN INRIA/RR--3997--FR+ENG

More information

On the Pathwise Optimal Bernoulli Routing Policy for Homogeneous Parallel Servers

On the Pathwise Optimal Bernoulli Routing Policy for Homogeneous Parallel Servers On the Pathwise Optimal Bernoulli Routing Policy for Homogeneous Parallel Servers Ger Koole INRIA Sophia Antipolis B.P. 93, 06902 Sophia Antipolis Cedex France Mathematics of Operations Research 21:469

More information

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems  M/M/1  M/M/m  M/M/1/K Queueing Theory I Summary Little s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K " Little s Law a(t): the process that counts the number of arrivals

More information

Optimal Routing Policy in Two Deterministic Queues

Optimal Routing Policy in Two Deterministic Queues Optimal Routing Policy in Two Deterministic Queues Bruno Gaujal, Emmanuel Hyon To cite this version: Bruno Gaujal, Emmanuel Hyon. Optimal Routing Policy in Two Deterministic Queues. [Research Report] RR-37,

More information

OPEN-LOOP ROUTEING TO M PARALLEL SERVERS WITH NO BUFFERS

OPEN-LOOP ROUTEING TO M PARALLEL SERVERS WITH NO BUFFERS J. Appl. Prob. 37, 668 684 (2000) Printed in Israel Applied Probability Trust 2000 OPEN-LOOP ROUTEING TO M PARALLEL SERVERS WITH NO BUFFERS EITAN ALTMAN, INRIA SANDJAI BHULAI, Vrije Universiteit Amsterdam

More information

Mean-field dual of cooperative reproduction

Mean-field dual of cooperative reproduction The mean-field dual of systems with cooperative reproduction joint with Tibor Mach (Prague) A. Sturm (Göttingen) Friday, July 6th, 2018 Poisson construction of Markov processes Let (X t ) t 0 be a continuous-time

More information

A Starvation-free Algorithm For Achieving 100% Throughput in an Input- Queued Switch

A Starvation-free Algorithm For Achieving 100% Throughput in an Input- Queued Switch A Starvation-free Algorithm For Achieving 00% Throughput in an Input- Queued Switch Abstract Adisak ekkittikul ick ckeown Department of Electrical Engineering Stanford University Stanford CA 9405-400 Tel

More information

Some open problems related to stability. 1 Multi-server queue with First-Come-First-Served discipline

Some open problems related to stability. 1 Multi-server queue with First-Come-First-Served discipline 1 Some open problems related to stability S. Foss Heriot-Watt University, Edinburgh and Sobolev s Institute of Mathematics, Novosibirsk I will speak about a number of open problems in queueing. Some of

More information

Analysis of an M/G/1 queue with customer impatience and an adaptive arrival process

Analysis of an M/G/1 queue with customer impatience and an adaptive arrival process Analysis of an M/G/1 queue with customer impatience and an adaptive arrival process O.J. Boxma 1, O. Kella 2, D. Perry 3, and B.J. Prabhu 1,4 1 EURANDOM and Department of Mathematics & Computer Science,

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.262 Discrete Stochastic Processes Midterm Quiz April 6, 2010 There are 5 questions, each with several parts.

More information

CS 798: Homework Assignment 3 (Queueing Theory)

CS 798: Homework Assignment 3 (Queueing Theory) 1.0 Little s law Assigned: October 6, 009 Patients arriving to the emergency room at the Grand River Hospital have a mean waiting time of three hours. It has been found that, averaged over the period of

More information

Open Loop Optimal Control of Base Station Activation for Green Networks

Open Loop Optimal Control of Base Station Activation for Green Networks Open Loop Optimal Control of Base Station Activation for Green etworks Sreenath Ramanath, Veeraruna Kavitha,2 and Eitan Altman IRIA, Sophia-Antipolis, France, 2 Universite d Avignon, Avignon, France Abstract

More information

Markov processes and queueing networks

Markov processes and queueing networks Inria September 22, 2015 Outline Poisson processes Markov jump processes Some queueing networks The Poisson distribution (Siméon-Denis Poisson, 1781-1840) { } e λ λ n n! As prevalent as Gaussian distribution

More information

OPTIMALITY OF RANDOMIZED TRUNK RESERVATION FOR A PROBLEM WITH MULTIPLE CONSTRAINTS

OPTIMALITY OF RANDOMIZED TRUNK RESERVATION FOR A PROBLEM WITH MULTIPLE CONSTRAINTS OPTIMALITY OF RANDOMIZED TRUNK RESERVATION FOR A PROBLEM WITH MULTIPLE CONSTRAINTS Xiaofei Fan-Orzechowski Department of Applied Mathematics and Statistics State University of New York at Stony Brook Stony

More information

Data analysis and stochastic modeling

Data analysis and stochastic modeling Data analysis and stochastic modeling Lecture 7 An introduction to queueing theory Guillaume Gravier guillaume.gravier@irisa.fr with a lot of help from Paul Jensen s course http://www.me.utexas.edu/ jensen/ormm/instruction/powerpoint/or_models_09/14_queuing.ppt

More information

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974 LIMITS FOR QUEUES AS THE WAITING ROOM GROWS by Daniel P. Heyman Ward Whitt Bell Communications Research AT&T Bell Laboratories Red Bank, NJ 07701 Murray Hill, NJ 07974 May 11, 1988 ABSTRACT We study the

More information

Series Expansions in Queues with Server

Series Expansions in Queues with Server Series Expansions in Queues with Server Vacation Fazia Rahmoune and Djamil Aïssani Abstract This paper provides series expansions of the stationary distribution of finite Markov chains. The work presented

More information

A.Piunovskiy. University of Liverpool Fluid Approximation to Controlled Markov. Chains with Local Transitions. A.Piunovskiy.

A.Piunovskiy. University of Liverpool Fluid Approximation to Controlled Markov. Chains with Local Transitions. A.Piunovskiy. University of Liverpool piunov@liv.ac.uk The Markov Decision Process under consideration is defined by the following elements X = {0, 1, 2,...} is the state space; A is the action space (Borel); p(z x,

More information

Stability of the two queue system

Stability of the two queue system Stability of the two queue system Iain M. MacPhee and Lisa J. Müller University of Durham Department of Mathematical Science Durham, DH1 3LE, UK (e-mail: i.m.macphee@durham.ac.uk, l.j.muller@durham.ac.uk)

More information

Stochastic process. X, a series of random variables indexed by t

Stochastic process. X, a series of random variables indexed by t Stochastic process X, a series of random variables indexed by t X={X(t), t 0} is a continuous time stochastic process X={X(t), t=0,1, } is a discrete time stochastic process X(t) is the state at time t,

More information

Math 3121, A Summary of Sections 0,1,2,4,5,6,7,8,9

Math 3121, A Summary of Sections 0,1,2,4,5,6,7,8,9 Math 3121, A Summary of Sections 0,1,2,4,5,6,7,8,9 Section 0. Sets and Relations Subset of a set, B A, B A (Definition 0.1). Cartesian product of sets A B ( Defintion 0.4). Relation (Defintion 0.7). Function,

More information

Feedback Capacity of a Class of Symmetric Finite-State Markov Channels

Feedback Capacity of a Class of Symmetric Finite-State Markov Channels Feedback Capacity of a Class of Symmetric Finite-State Markov Channels Nevroz Şen, Fady Alajaji and Serdar Yüksel Department of Mathematics and Statistics Queen s University Kingston, ON K7L 3N6, Canada

More information

Waiting time characteristics in cyclic queues

Waiting time characteristics in cyclic queues Waiting time characteristics in cyclic queues Sanne R. Smits, Ivo Adan and Ton G. de Kok April 16, 2003 Abstract In this paper we study a single-server queue with FIFO service and cyclic interarrival and

More information

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks Recap Probability, stochastic processes, Markov chains ELEC-C7210 Modeling and analysis of communication networks 1 Recap: Probability theory important distributions Discrete distributions Geometric distribution

More information

Queueing Networks and Insensitivity

Queueing Networks and Insensitivity Lukáš Adam 29. 10. 2012 1 / 40 Table of contents 1 Jackson networks 2 Insensitivity in Erlang s Loss System 3 Quasi-Reversibility and Single-Node Symmetric Queues 4 Quasi-Reversibility in Networks 5 The

More information

Operations Research Letters. Instability of FIFO in a simple queueing system with arbitrarily low loads

Operations Research Letters. Instability of FIFO in a simple queueing system with arbitrarily low loads Operations Research Letters 37 (2009) 312 316 Contents lists available at ScienceDirect Operations Research Letters journal homepage: www.elsevier.com/locate/orl Instability of FIFO in a simple queueing

More information

Performance Evaluation of Queuing Systems

Performance Evaluation of Queuing Systems Performance Evaluation of Queuing Systems Introduction to Queuing Systems System Performance Measures & Little s Law Equilibrium Solution of Birth-Death Processes Analysis of Single-Station Queuing Systems

More information

1 Markov decision processes

1 Markov decision processes 2.997 Decision-Making in Large-Scale Systems February 4 MI, Spring 2004 Handout #1 Lecture Note 1 1 Markov decision processes In this class we will study discrete-time stochastic systems. We can describe

More information

Markov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains

Markov Chains CK eqns Classes Hitting times Rec./trans. Strong Markov Stat. distr. Reversibility * Markov Chains Markov Chains A random process X is a family {X t : t T } of random variables indexed by some set T. When T = {0, 1, 2,... } one speaks about a discrete-time process, for T = R or T = [0, ) one has a continuous-time

More information

RANDOM WALKS, LARGE DEVIATIONS, AND MARTINGALES

RANDOM WALKS, LARGE DEVIATIONS, AND MARTINGALES Chapter 7 RANDOM WALKS, LARGE DEVIATIONS, AND MARTINGALES 7.1 Introduction Definition 7.1. Let {X i ; i 1} be a sequence of IID random variables, and let S n = X 1 + X 2 + + X n. The integer-time stochastic

More information

IEOR 6711, HMWK 5, Professor Sigman

IEOR 6711, HMWK 5, Professor Sigman IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.

More information

Point Process Control

Point Process Control Point Process Control The following note is based on Chapters I, II and VII in Brémaud s book Point Processes and Queues (1981). 1 Basic Definitions Consider some probability space (Ω, F, P). A real-valued

More information

On the smoothness of the conjugacy between circle maps with a break

On the smoothness of the conjugacy between circle maps with a break On the smoothness of the conjugacy between circle maps with a break Konstantin Khanin and Saša Kocić 2 Department of Mathematics, University of Toronto, Toronto, ON, Canada M5S 2E4 2 Department of Mathematics,

More information

NEW FRONTIERS IN APPLIED PROBABILITY

NEW FRONTIERS IN APPLIED PROBABILITY J. Appl. Prob. Spec. Vol. 48A, 209 213 (2011) Applied Probability Trust 2011 NEW FRONTIERS IN APPLIED PROBABILITY A Festschrift for SØREN ASMUSSEN Edited by P. GLYNN, T. MIKOSCH and T. ROLSKI Part 4. Simulation

More information

Queuing Theory. Richard Lockhart. Simon Fraser University. STAT 870 Summer 2011

Queuing Theory. Richard Lockhart. Simon Fraser University. STAT 870 Summer 2011 Queuing Theory Richard Lockhart Simon Fraser University STAT 870 Summer 2011 Richard Lockhart (Simon Fraser University) Queuing Theory STAT 870 Summer 2011 1 / 15 Purposes of Today s Lecture Describe general

More information

P (A G) dp G P (A G)

P (A G) dp G P (A G) First homework assignment. Due at 12:15 on 22 September 2016. Homework 1. We roll two dices. X is the result of one of them and Z the sum of the results. Find E [X Z. Homework 2. Let X be a r.v.. Assume

More information

Ergodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R.

Ergodic Theorems. Samy Tindel. Purdue University. Probability Theory 2 - MA 539. Taken from Probability: Theory and examples by R. Ergodic Theorems Samy Tindel Purdue University Probability Theory 2 - MA 539 Taken from Probability: Theory and examples by R. Durrett Samy T. Ergodic theorems Probability Theory 1 / 92 Outline 1 Definitions

More information

Chapter 2 SOME ANALYTICAL TOOLS USED IN THE THESIS

Chapter 2 SOME ANALYTICAL TOOLS USED IN THE THESIS Chapter 2 SOME ANALYTICAL TOOLS USED IN THE THESIS 63 2.1 Introduction In this chapter we describe the analytical tools used in this thesis. They are Markov Decision Processes(MDP), Markov Renewal process

More information

Matrix analytic methods. Lecture 1: Structured Markov chains and their stationary distribution

Matrix analytic methods. Lecture 1: Structured Markov chains and their stationary distribution 1/29 Matrix analytic methods Lecture 1: Structured Markov chains and their stationary distribution Sophie Hautphenne and David Stanford (with thanks to Guy Latouche, U. Brussels and Peter Taylor, U. Melbourne

More information

Albert W. Marshall. Ingram Olkin Barry. C. Arnold. Inequalities: Theory. of Majorization and Its Applications. Second Edition.

Albert W. Marshall. Ingram Olkin Barry. C. Arnold. Inequalities: Theory. of Majorization and Its Applications. Second Edition. Albert W Marshall Ingram Olkin Barry C Arnold Inequalities: Theory of Majorization and Its Applications Second Edition f) Springer Contents I Theory of Majorization 1 Introduction 3 A Motivation and Basic

More information

25.1 Ergodicity and Metric Transitivity

25.1 Ergodicity and Metric Transitivity Chapter 25 Ergodicity This lecture explains what it means for a process to be ergodic or metrically transitive, gives a few characterizes of these properties (especially for AMS processes), and deduces

More information

QUEUING SYSTEM. Yetunde Folajimi, PhD

QUEUING SYSTEM. Yetunde Folajimi, PhD QUEUING SYSTEM Yetunde Folajimi, PhD Part 2 Queuing Models Queueing models are constructed so that queue lengths and waiting times can be predicted They help us to understand and quantify the effect of

More information

7 Asymptotics for Meromorphic Functions

7 Asymptotics for Meromorphic Functions Lecture G jacques@ucsd.edu 7 Asymptotics for Meromorphic Functions Hadamard s Theorem gives a broad description of the exponential growth of coefficients in power series, but the notion of exponential

More information

Capacity of the Discrete Memoryless Energy Harvesting Channel with Side Information

Capacity of the Discrete Memoryless Energy Harvesting Channel with Side Information 204 IEEE International Symposium on Information Theory Capacity of the Discrete Memoryless Energy Harvesting Channel with Side Information Omur Ozel, Kaya Tutuncuoglu 2, Sennur Ulukus, and Aylin Yener

More information

LECTURE 3. Last time:

LECTURE 3. Last time: LECTURE 3 Last time: Mutual Information. Convexity and concavity Jensen s inequality Information Inequality Data processing theorem Fano s Inequality Lecture outline Stochastic processes, Entropy rate

More information

Introduction to Markov Chains, Queuing Theory, and Network Performance

Introduction to Markov Chains, Queuing Theory, and Network Performance Introduction to Markov Chains, Queuing Theory, and Network Performance Marceau Coupechoux Telecom ParisTech, departement Informatique et Réseaux marceau.coupechoux@telecom-paristech.fr IT.2403 Modélisation

More information

HEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES

HEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES HEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES by Peter W. Glynn Department of Operations Research Stanford University Stanford, CA 94305-4022 and Ward Whitt AT&T Bell Laboratories Murray Hill, NJ 07974-0636

More information

1 Continuous-time chains, finite state space

1 Continuous-time chains, finite state space Université Paris Diderot 208 Markov chains Exercises 3 Continuous-time chains, finite state space Exercise Consider a continuous-time taking values in {, 2, 3}, with generator 2 2. 2 2 0. Draw the diagramm

More information

Minimizing response times and queue lengths in systems of parallel queues

Minimizing response times and queue lengths in systems of parallel queues Minimizing response times and queue lengths in systems of parallel queues Ger Koole Department of Mathematics and Computer Science, Vrije Universiteit, De Boelelaan 1081a, 1081 HV Amsterdam, The Netherlands

More information

2905 Queueing Theory and Simulation PART IV: SIMULATION

2905 Queueing Theory and Simulation PART IV: SIMULATION 2905 Queueing Theory and Simulation PART IV: SIMULATION 22 Random Numbers A fundamental step in a simulation study is the generation of random numbers, where a random number represents the value of a random

More information

Decentralized Control of Stochastic Systems

Decentralized Control of Stochastic Systems Decentralized Control of Stochastic Systems Sanjay Lall Stanford University CDC-ECC Workshop, December 11, 2005 2 S. Lall, Stanford 2005.12.11.02 Decentralized Control G 1 G 2 G 3 G 4 G 5 y 1 u 1 y 2 u

More information

Solutions to Homework Discrete Stochastic Processes MIT, Spring 2011

Solutions to Homework Discrete Stochastic Processes MIT, Spring 2011 Exercise 6.5: Solutions to Homework 0 6.262 Discrete Stochastic Processes MIT, Spring 20 Consider the Markov process illustrated below. The transitions are labelled by the rate q ij at which those transitions

More information

Commuting birth-and-death processes

Commuting birth-and-death processes Commuting birth-and-death processes Caroline Uhler Department of Statistics UC Berkeley (joint work with Steven N. Evans and Bernd Sturmfels) MSRI Workshop on Algebraic Statistics December 18, 2008 Birth-and-death

More information

Stochastic Realization of Binary Exchangeable Processes

Stochastic Realization of Binary Exchangeable Processes Stochastic Realization of Binary Exchangeable Processes Lorenzo Finesso and Cecilia Prosdocimi Abstract A discrete time stochastic process is called exchangeable if its n-dimensional distributions are,

More information

Consistency of the maximum likelihood estimator for general hidden Markov models

Consistency of the maximum likelihood estimator for general hidden Markov models Consistency of the maximum likelihood estimator for general hidden Markov models Jimmy Olsson Centre for Mathematical Sciences Lund University Nordstat 2012 Umeå, Sweden Collaborators Hidden Markov models

More information

Transient Analysis of a Series Configuration Queueing System

Transient Analysis of a Series Configuration Queueing System Transient Analysis of a Series Configuration Queueing System Yu-Li Tsai*, Daichi Yanagisawa, and Katsuhiro Nishinari Abstract In this paper, we consider the transient analysis of a popular series configuration

More information

Definitions. Notations. Injective, Surjective and Bijective. Divides. Cartesian Product. Relations. Equivalence Relations

Definitions. Notations. Injective, Surjective and Bijective. Divides. Cartesian Product. Relations. Equivalence Relations Page 1 Definitions Tuesday, May 8, 2018 12:23 AM Notations " " means "equals, by definition" the set of all real numbers the set of integers Denote a function from a set to a set by Denote the image of

More information

B Sc MATHEMATICS ABSTRACT ALGEBRA

B Sc MATHEMATICS ABSTRACT ALGEBRA UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION B Sc MATHEMATICS (0 Admission Onwards) V Semester Core Course ABSTRACT ALGEBRA QUESTION BANK () Which of the following defines a binary operation on Z

More information

Lecture 20: Reversible Processes and Queues

Lecture 20: Reversible Processes and Queues Lecture 20: Reversible Processes and Queues 1 Examples of reversible processes 11 Birth-death processes We define two non-negative sequences birth and death rates denoted by {λ n : n N 0 } and {µ n : n

More information

57:022 Principles of Design II Final Exam Solutions - Spring 1997

57:022 Principles of Design II Final Exam Solutions - Spring 1997 57:022 Principles of Design II Final Exam Solutions - Spring 1997 Part: I II III IV V VI Total Possible Pts: 52 10 12 16 13 12 115 PART ONE Indicate "+" if True and "o" if False: + a. If a component's

More information

Alternative Characterization of Ergodicity for Doubly Stochastic Chains

Alternative Characterization of Ergodicity for Doubly Stochastic Chains Alternative Characterization of Ergodicity for Doubly Stochastic Chains Behrouz Touri and Angelia Nedić Abstract In this paper we discuss the ergodicity of stochastic and doubly stochastic chains. We define

More information

Convergence Rates for Renewal Sequences

Convergence Rates for Renewal Sequences Convergence Rates for Renewal Sequences M. C. Spruill School of Mathematics Georgia Institute of Technology Atlanta, Ga. USA January 2002 ABSTRACT The precise rate of geometric convergence of nonhomogeneous

More information

One important issue in the study of queueing systems is to characterize departure processes. Study on departure processes was rst initiated by Burke (

One important issue in the study of queueing systems is to characterize departure processes. Study on departure processes was rst initiated by Burke ( The Departure Process of the GI/G/ Queue and Its MacLaurin Series Jian-Qiang Hu Department of Manufacturing Engineering Boston University 5 St. Mary's Street Brookline, MA 2446 Email: hqiang@bu.edu June

More information

Advanced Queueing Theory

Advanced Queueing Theory Advanced Queueing Theory 1 Networks of queues (reversibility, output theorem, tandem networks, partial balance, product-form distribution, blocking, insensitivity, BCMP networks, mean-value analysis, Norton's

More information

Exact Simulation of the Stationary Distribution of M/G/c Queues

Exact Simulation of the Stationary Distribution of M/G/c Queues 1/36 Exact Simulation of the Stationary Distribution of M/G/c Queues Professor Karl Sigman Columbia University New York City USA Conference in Honor of Søren Asmussen Monday, August 1, 2011 Sandbjerg Estate

More information

ON ESSENTIAL INFORMATION IN SEQUENTIAL DECISION PROCESSES

ON ESSENTIAL INFORMATION IN SEQUENTIAL DECISION PROCESSES MMOR manuscript No. (will be inserted by the editor) ON ESSENTIAL INFORMATION IN SEQUENTIAL DECISION PROCESSES Eugene A. Feinberg Department of Applied Mathematics and Statistics; State University of New

More information

Session-Based Queueing Systems

Session-Based Queueing Systems Session-Based Queueing Systems Modelling, Simulation, and Approximation Jeroen Horters Supervisor VU: Sandjai Bhulai Executive Summary Companies often offer services that require multiple steps on the

More information

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem Wade Trappe Lecture Overview Network of Queues Introduction Queues in Tandem roduct Form Solutions Burke s Theorem What

More information

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009

LMI MODELLING 4. CONVEX LMI MODELLING. Didier HENRION. LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ. Universidad de Valladolid, SP March 2009 LMI MODELLING 4. CONVEX LMI MODELLING Didier HENRION LAAS-CNRS Toulouse, FR Czech Tech Univ Prague, CZ Universidad de Valladolid, SP March 2009 Minors A minor of a matrix F is the determinant of a submatrix

More information

Overload Analysis of the PH/PH/1/K Queue and the Queue of M/G/1/K Type with Very Large K

Overload Analysis of the PH/PH/1/K Queue and the Queue of M/G/1/K Type with Very Large K Overload Analysis of the PH/PH/1/K Queue and the Queue of M/G/1/K Type with Very Large K Attahiru Sule Alfa Department of Mechanical and Industrial Engineering University of Manitoba Winnipeg, Manitoba

More information

#A2 INTEGERS 11B (2011) MULTIDIMENSIONAL EUCLIDEAN ALGORITHMS, NUMERATION AND SUBSTITUTIONS

#A2 INTEGERS 11B (2011) MULTIDIMENSIONAL EUCLIDEAN ALGORITHMS, NUMERATION AND SUBSTITUTIONS #A2 INTEGERS 11B (2011) MULTIDIMENSIONAL EUCLIDEAN ALGORITHMS, NUMERATION AND SUBSTITUTIONS Valerie Berthé Laboratoire d Informatique Algorithmique : Fondements et Applications Université Paris Diderot,

More information

ALGEBRA I (LECTURE NOTES 2017/2018) LECTURE 9 - CYCLIC GROUPS AND EULER S FUNCTION

ALGEBRA I (LECTURE NOTES 2017/2018) LECTURE 9 - CYCLIC GROUPS AND EULER S FUNCTION ALGEBRA I (LECTURE NOTES 2017/2018) LECTURE 9 - CYCLIC GROUPS AND EULER S FUNCTION PAVEL RŮŽIČKA 9.1. Congruence modulo n. Let us have a closer look at a particular example of a congruence relation on

More information

On Smooth Sets of Integers

On Smooth Sets of Integers On Smooth Sets of Integers Dedicated to the memory of Professor Shimon Even for his inspiration and encouragement Ami Litman Shiri Moran-Schein Abstract This work studies evenly distributed sets of integers

More information

Department of Mathematics, University of California, Berkeley. GRADUATE PRELIMINARY EXAMINATION, Part A Fall Semester 2014

Department of Mathematics, University of California, Berkeley. GRADUATE PRELIMINARY EXAMINATION, Part A Fall Semester 2014 Department of Mathematics, University of California, Berkeley YOUR 1 OR 2 DIGIT EXAM NUMBER GRADUATE PRELIMINARY EXAMINATION, Part A Fall Semester 2014 1. Please write your 1- or 2-digit exam number on

More information

Elements with Square Roots in Finite Groups

Elements with Square Roots in Finite Groups Elements with Square Roots in Finite Groups M. S. Lucido, M. R. Pournaki * Abstract In this paper, we study the probability that a randomly chosen element in a finite group has a square root, in particular

More information

Managing Service Systems with an Offline Waiting Option and Customer Abandonment: Companion Note

Managing Service Systems with an Offline Waiting Option and Customer Abandonment: Companion Note Managing Service Systems with an Offline Waiting Option and Customer Abandonment: Companion Note Vasiliki Kostami Amy R. Ward September 25, 28 The Amusement Park Ride Setting An amusement park ride departs

More information

Multi Stage Queuing Model in Level Dependent Quasi Birth Death Process

Multi Stage Queuing Model in Level Dependent Quasi Birth Death Process International Journal of Statistics and Systems ISSN 973-2675 Volume 12, Number 2 (217, pp. 293-31 Research India Publications http://www.ripublication.com Multi Stage Queuing Model in Level Dependent

More information

Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network. Haifa Statistics Seminar May 5, 2008

Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network. Haifa Statistics Seminar May 5, 2008 Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network Yoni Nazarathy Gideon Weiss Haifa Statistics Seminar May 5, 2008 1 Outline 1 Preview of Results 2 Introduction Queueing

More information

PERIODIC POINTS OF THE FAMILY OF TENT MAPS

PERIODIC POINTS OF THE FAMILY OF TENT MAPS PERIODIC POINTS OF THE FAMILY OF TENT MAPS ROBERTO HASFURA-B. AND PHILLIP LYNCH 1. INTRODUCTION. Of interest in this article is the dynamical behavior of the one-parameter family of maps T (x) = (1/2 x

More information

Notation. 0,1,2,, 1 with addition and multiplication modulo

Notation. 0,1,2,, 1 with addition and multiplication modulo Notation Q,, The set of all natural numbers 1,2,3, The set of all integers The set of all rational numbers The set of all real numbers The group of permutations of distinct symbols 0,1,2,,1 with addition

More information

Large number of queues in tandem: Scaling properties under back-pressure algorithm

Large number of queues in tandem: Scaling properties under back-pressure algorithm Queueing Syst (2011) 67: 111 126 DOI 10.1007/s11134-010-9203-0 Large number of queues in tandem: Scaling properties under back-pressure algorithm Alexander L. Stolyar Received: 30 October 2009 / Revised:

More information

1. Group Theory Permutations.

1. Group Theory Permutations. 1.1. Permutations. 1. Group Theory Problem 1.1. Let G be a subgroup of S n of index 2. Show that G = A n. Problem 1.2. Find two elements of S 7 that have the same order but are not conjugate. Let π S 7

More information

Other properties of M M 1

Other properties of M M 1 Other properties of M M 1 Přemysl Bejda premyslbejda@gmail.com 2012 Contents 1 Reflected Lévy Process 2 Time dependent properties of M M 1 3 Waiting times and queue disciplines in M M 1 Contents 1 Reflected

More information

A Mean Field Approach for Optimization in Discrete Time

A Mean Field Approach for Optimization in Discrete Time oname manuscript o. will be inserted by the editor A Mean Field Approach for Optimization in Discrete Time icolas Gast Bruno Gaujal the date of receipt and acceptance should be inserted later Abstract

More information

The Status Update Problem: Optimal Strategies for Pseudo-Deterministic Systems

The Status Update Problem: Optimal Strategies for Pseudo-Deterministic Systems The Status Update Problem: Optimal Strategies for Pseudo-Deterministic Systems Jared Tramontano under the direction of Dr. Shan-Yuan Ho Mr. Siddharth Venkatesh Department of Mathematics Massachusetts Institute

More information

UNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours.

UNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours. UNIVERSITY OF YORK MSc Examinations 2004 MATHEMATICS Networks Time Allowed: 3 hours. Answer 4 questions. Standard calculators will be provided but should be unnecessary. 1 Turn over 2 continued on next

More information

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking Lecture 7: Simulation of Markov Processes Pasi Lassila Department of Communications and Networking Contents Markov processes theory recap Elementary queuing models for data networks Simulation of Markov

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science Transmission of Information Spring 2006

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science Transmission of Information Spring 2006 MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.44 Transmission of Information Spring 2006 Homework 2 Solution name username April 4, 2006 Reading: Chapter

More information

TRANSCENDENTAL NUMBERS AND PERIODS. Contents

TRANSCENDENTAL NUMBERS AND PERIODS. Contents TRANSCENDENTAL NUMBERS AND PERIODS JAMES CARLSON Contents. Introduction.. Diophantine approximation I: upper bounds 2.2. Diophantine approximation II: lower bounds 4.3. Proof of the lower bound 5 2. Periods

More information

Stationary Probabilities of Markov Chains with Upper Hessenberg Transition Matrices

Stationary Probabilities of Markov Chains with Upper Hessenberg Transition Matrices Stationary Probabilities of Marov Chains with Upper Hessenberg Transition Matrices Y. Quennel ZHAO Department of Mathematics and Statistics University of Winnipeg Winnipeg, Manitoba CANADA R3B 2E9 Susan

More information

BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS

BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS Andrea Bobbio Anno Accademico 999-2000 Queueing Systems 2 Notation for Queueing Systems /λ mean time between arrivals S = /µ ρ = λ/µ N mean service time traffic

More information

Congestion In Large Balanced Fair Links

Congestion In Large Balanced Fair Links Congestion In Large Balanced Fair Links Thomas Bonald (Telecom Paris-Tech), Jean-Paul Haddad (Ernst and Young) and Ravi R. Mazumdar (Waterloo) ITC 2011, San Francisco Introduction File transfers compose

More information

Structured Markov chains solver: tool extension

Structured Markov chains solver: tool extension Structured Markov chains solver: tool extension D. A. Bini, B. Meini, S. Steffé Dipartimento di Matematica Università di Pisa, Pisa, Italy bini, meini, steffe @dm.unipi.it B. Van Houdt Department of Mathematics

More information