S Queueing Theory, II/2007 Exercises. Virtamo / Penttinen. 10th December Discrete and Continuous Distributions 1

Size: px
Start display at page:

Download "S Queueing Theory, II/2007 Exercises. Virtamo / Penttinen. 10th December Discrete and Continuous Distributions 1"

Transcription

1 S Queueing Theory, II/007 Exercises Virtamo / Penttinen 0th December 007 Contents Discrete and Continuous Distributions Distributions and Markov Chains 5 3 Birth&death- and Poisson-processes, Little s result 8 4 Loss Systems 5 Queuing Systems 6 6 Priority queues, queuing networks 0 ABTEKNILLINEN KORKEAKOULU

2 Helsinki University of Technology Department of Electrical and Communications Engineering Networking Laboratory P.O. Box 3000 FIN-005 HUT

3 Exercise DISCRETE AND CONTINUOUS DISTRIBUTIONS EX : Discrete and Continuous Distributions. There are two coins one of which is normal and the other one has head on both sides. One of the coins is chosen randomly and tossed m times and each time the result is head. What is the probability that the chosen coin is the normal one. Calculate also the numerical value for m,, 3. Denote the possible event with the following symbols: X the normal coin is chosen, P{X} / Y the fake coin is chosen, P{Y } / C m tossing the chosen coin m times gives m heads in a row Then the conditional probabilities for getting m heads in a row are P{C m X} (/) m, P{C m Y }. The asked quantity is P{X C m }, so we can apply the Bayes formula: P{A j B} P{B A j}p{a j } i P{B A i}p{a i }, where i A i S and A i Aj i j. So in this case we get P{X C m } P{C m X}P{X} P{C m X}P{X} +P{C m Y }P{Y } (/) m (/) (/) m (/) + (/) m +. For m,, 3 we get m P{X C m } /3 /5 3 /9. In a Bernoulli trial is obtained with probability p and 0 with probability q p. Thevalue of p is unknown, but it is known that it is drawn from a uniform distribution in (0,), i.e. all values in this interval are aprioriequally likely. The Bernoulli trial is repeated in order to estimate the real value of p. In the trials result 0 occurs n 0 times and result n times. What is the posterior distribution (Bayes) of p according to the trials? Where is the maximum of the distribution? Let n n 0 + n. The probability, that after n trials we have gotten result exactly n times is ( ) n P{n p} p n ( p) n n n Denote with f(p) the conditional pdf of p and with f 0 (p) the aprioripdf of p. THe Bayes formula gives f(p) P{n p}f 0 (p) 0 P{n p}f 0 (p)dp P{n p} 0 P{n p}dp pn ( p)n n 0 pn ( p) n n dp, as f 0 (p) (uniform distribution). Denote C(n,n) 0 pn ( p) n n dp, when f(p) pn ( p) n n. C(n,n)

4 S Queueing Theory, II/007 Virtamo / Penttinen The maximum of distribution is obtained by taking the derivate: f (p) [ n p n ( p) n 0 n 0 p n ( p) n 0 ] C f (p ) 0 n ( p )n 0 p p n. n 0 + n Next we deduce C(n,n): n ( ) n C(n,n)z n n 0 n 0 n 0 0 n ( ) n (zp) n ( p) n n dp n ((zp)+( p)) n dp / ((z )p +)n+ n +z 0 ( z n+ ) n z n, n + z n + 0 ((z )p +) n dp n 0 and comparing the factors of z n one sees that C(n,n) ( n + n ) n!(n n )! n (n +)! [ ( n (n +) n )]. Hence, the conditional distribution of p is ( ) n f(p) (n +) p n ( p) n 0. Furthermore, the expected value of p on condition that n is known, is E[p n ] 3. Apply the conditioning rules 0 n ( ) { }}{ n pf(p) dp (n +) p n+ ( p) n n dp n ) n 0 C(n +,n+) (n +)( n (n +) ( n+ ) (n +)n!(n +)!(n n )! (n +)n n +!(n n )!(n +)! n + n +. E[X] E[E[X Y ]] V[X] E[V[X Y ]] + V [E [X Y ]] to the case X X X N,wheretheX i are independent and identically distributed (i.i.d.) random variables with mean m and variance σ,andn is a positive integer valued random variable with mean n and variance ν. Hint: Condition on the value of N. By applying the given conditioning rules we get E[X] E[E[X N]] E [Nm]nm. V[X] E[V[X N]] + V [E [X N]] E [ σ N ] +V[mN] nσ + m ν.

5 Exercise DISCRETE AND CONTINUOUS DISTRIBUTIONS 4. Five different applications are transmitting packets in a LAN. For each application i, i,...,5, measurements are carried out to determine the mean, m i, and the standard deviation, σ i, of the packet lengths. The measurements provide also a classification of the packets giving the proportion of packets belonging to each application i (denoted by p i ). The results of the measurements are summarized in the following table. Compute the mean and the standard deviation of the lengths of all packets in the network. application p i m i σ i Let the random variable X denote the packet length and Y denote the application in which the packet belongs to. Apply the chain rule of expectation and variance: m i {}}{ E[X] E[ E[X Y ]] p i m i 50.5 i σ i m i {}}{{}}{ V[X] E[ V[X Y ]] + V[ E[X Y ]] i p i σ i + i p i m i ( i p i m i ) Thus the packet length in the network has the mean 50.5 and standard deviation Assume that the traffic process in a LAN is stationary, whence periods of equal length are statistically identical. Denote the amount of traffic (kb) carried in the network in consecutive 0 min periods by X, X and X 3 (random variables). In measurements over a long time one has observed that the variance of the traffic in periods of 0 min, 0 min and 30 min are v, v ja v 3, respectively. In other words, v V[X ]V[X ]V[X 3 ], v V[X + X ] V[X + X 3 ] and v 3 V[X + X + X 3 ]. Determine Cov[X,X ]Cov[X,X 3 ] and Cov[X,X 3 ] in terms of v, v and v 3. Hint: e.g. the previous one can be obtained by expanding v V[X + X ]Cov[X + X,X + X ]. X X X 3 Definition: Cov[A, B] E[(A E[A]) (B E[B])] E [AB] E[A]E[B]. Thus e.g. Cov[A + B,C]E[AC + BC] E[A + B]E[C] Cov[A, C]+Cov[B,C] etc. (i) Stationary Cov[X,X ]Cov[X,X 3 ] v Cov[X + X,X + X ]Cov[X,X ]+Cov[X,X ]+Cov[X,X ] v +Cov[X,X ] Cov[X,X ]v / v. (ii) v 3 Cov[X + X + X 3,X + X + X 3 ] V[X ]+V[X ]+V[X 3 ]+Cov[X,X ]+Cov[X,X 3 ]+Cov[X,X 3 ] 3v +4(v / v )+Cov[X,X 3 ] Cov[X,X 3 ]v / v + v 3 /. 3

6 S Queueing Theory, II/007 Virtamo / Penttinen Hence, measuring variances v, v and v 3 is enough to determine covariances. 6. The length of the packet (in bytes) arriving to a router is assumed to obey geometric distribution. The mean length of packet is 00 bytes. Each packet is first read into an input buffer. How large the input buffer should be in order that an arriving packet fits there with probability of 95 % or higher? Let random variable X denote the length of the packet. The packet length was assumed to obey a geometric distribution with mean 00, and thus P{X n} ( p) n p q n p, where p /00. Let the input buffer length be N. The probability that a random packet overflows is then, N n P{X N} q i p p q i p qn qn q from what N can be obtained: i i0 P{X N} 0.95 q N 0.05 N ln q ln 0.05 (ln q<0) N ln 0.05/ ln q 98., thus when the buffer length is 99 bytes or more, the arriving packet fits in the buffer with probability of 95 % or more. 4

7 Exercise DISTRIBUTIONS AND MARKOV CHAINS EX : Distributions and Markov Chains. Let S X X N,whereX i Exp(), be i.i.d. and N an independent geometrically distributed random variable, P{N k} ( p)p k, k,,... Determine the tail distribution of S, G(x) P{S >x}. First we derive the generating function of geometrical distribution: ( ) p G N (z) z k ( p)p k (pz) k p pz p p pz z p pz. k k Similarly, the generating function of exponential distribution is G X (s) The generating function of random sum is S(s) G N (G X (s)) ( p) 0 e t e st dt +s p +s 0 e (+s)t dt + s. ( p) + s p ( p) ( p) + s. In other words, the sum S obeys the exponential distribution with parameter ( p). Hence, the tail distribution is / P{S >x} ( p)e ( p)t dt e ( p)t e ( p)x. x. Prove (without using the generating function), that the sum of two Poisson random variables, N Poisson(a )andn Poisson(a ), is also Poisson distributed: (N +N ) Poisson(a + a ). Prove the same result with the aid of generating functions. Poisson-distribution: P {N i n} (a i) n n! e a i. x P{N n} P{N + N n} n (a ) j j0 j! n P{N j} P{N n j} j0 e a (a ) n j (n j)! e a e (a+a) n! n j0 n! j!(n j)! (a ) j (a ) n j (a + a ) n e (a +a ), (binomial theorem) n! thus the sum N N + N is Poisson(a + a ). On the other hand, let X Poisson(a). Then the generating function of the random variable X is GX(z) E[z X ] j0 z j aj j! e a e a (az) j e a e az e (z )a. j! Let N(z) denote the generating function of sum N + N, for which we obtain j0 N(z) N (z) N (z) e (z )a e (z )a e (z )(a +a ). Hence, N obeys Poisson distribution with parameter a + a. 5

8 S Queueing Theory, II/007 Virtamo / Penttinen 3. Let X be an exponential random variable. Without any computations, tell which one of the following is correct. Explain your answer. a) E [ X X> ] E [ (X +) ] b) E [ X X> ] E [ X ] + c) E [ X X> ] (+E[X]) Clearly a) is true, as from the lack of memory property of exponential distribution it follows that on condition X > the random variable X is similarly distributed as X The transition probability matrix of a four state Markov chain is P / / B A Draw the state transition diagram of the chain and deduce which states are transient and which are recurrent. Clearly, all the states of the chain are recurrent (process returns to each state with probability of ) and there are no transient states (probability of return is less than ). Formally, let Thus, p n def P{ chain returns to state 3 during 3n steps} p and at the limit n we get, p +( ) + ( ) p n n i ( ) i p ( ) i /. i0 Thus the chain returns to state 3 with probability of and the state is recurrent. Similarly for state Time to absorption. A three state Markov chain (with states i,...,3) has the state transition probability matrix: P 0 /4 / / /4 /4A. 0 0 State 3 is an absorbing state. Let T i denote the average time (number of steps) needed by a system in state i to reach the absorbing state 3 (T 3 0). Write equations for T i, i,, based on the facts that the next transition i j takes one step and due to the Markovian property it takes T j steps on the average to reach the absorbing state from state j. Solve the equations. 6

9 Exercise DISTRIBUTIONS AND MARKOV CHAINS From symmetry it follows that T T, and thus T p ( + T )+p ( + T )+p 3 ( + T 3 ) +p T + p T (symmetry) T T 4. /4 / / /4 /4 6. Define the state of the system at the n th trial of an infinite sequence of Bernoulli(p) trialstobe the number of consecutive succesful trials preceeding and the current trial, i.e. the state is the distance to previous unsuccesful trial. If the n th trial is unsuccesful, then X n 0; if it succeeds but the previous one was unsuccesful, then X n, etc. a) What is the state space of the system? b) Argue that X n forms a Markov chain. c) Write down the transition probability matrix of the Markov chain (give its structure). /4 (a) X n can be any integer from 0 to (b) The experiments are independent: { Xn + with probability of p, X n+ 0 with probability of p, that is the state of the system at time n+depends only on the state at time n. That is the Markov property and hence the system is a Markov chain. (c) p p 0 0 p 0 p 0 P p 0 0 p

10 S Queueing Theory, II/007 Virtamo / Penttinen EX 3: Birth&death- and Poisson-processes, Little s result. Determine the probability distribution in equilibrium for birth-death processes (state space i 0,,,...), which transition intensities are a) λ i λ, i i, b)λ i λ/(i +), i, where λ and are constants. λ i i+ i i+ (i+) Figure : Transition intensities between the states i and i +. λ i+ (a) From fig. it can be seen that (i +)π i+ λπ i π i+ λ i + π i a i + π i. That is Furthermore, i π i,i.e. π aπ 0, π a π a! π 0,. π i ai i! π 0. π i π 0 i So π i ai i! e a. (that is a Poisson-distribution with parameter a λ/) (b) In this case we obtain i a i i! π 0e a π 0 e a. λ i + π i π i+ π i+ a i + π i that is the probability distribution in equilibrium is the same as in (a).. In a game audio signals arrive in the interval (0,T) according to a Poisson process with rate λ, where T > /λ. The player wins only if there will be at least one audio signal in that interval and he pushes a button (only one push allowed) upon the last of the signals. The player uses the following strategy: he pushes the button upon the arrival of the first (if any) signal after a fixed time s T. a) What is the probability that the player wins? b) What value of s maximizes the probability of winning, and what is the probability in this case? 8

11 Exercise 3 BIRTH&DEATH- AND POISSON-PROCESSES, LITTLE S RESULT Player bets on that during the time (s, T ) there is exactly one arrival (what happened during (0,s) has no effect here). Let τ T s, when the number of arrivals obeys Poisson distribution with parameter a λτ. Here, 0 τ T,i.e.0 a λt where λt >. a) p v P{N(T ) N(s) } a! e a ae a, where a λ(t s). b) Maximum can be found by taking the first derivate in relative to a: d da p v(a) e a ae a ( a)e a. The derivate has clearly exactly one root, a, which is also the maximum of the function (first strictly increasing and then stricly decreasing function). a λ(t s) s T /λ, which also lies inside the allowed interval. The maximum probability of winning is hence /e. 3. It has been observed that in the interval (0,t) one arrival has occurred from a Poisson process, i.e. N(0,t). Prove that conditioned on this information, the arrival time τ is uniformly distributed in (0,t). Hint: determine the conditional cumulative distribution function of the arrival time P{τ s one arrival during (0,t)}. P{τ s N(0,t)} P{τ s and N(0,t)} P{N(0,t)} λs (λ(t! e λs s))0 0! e λ(t s) P{N(0,s)and N(s, t) 0} P{N(0,t)} s/t, Thus, τ Uniform(0,t). λt! e λt 4. Customers arrive at the system according to a Poisson process with the intensity λ. Eachcus- tomer brings in a revenue Y (independently of other customers), which is assumed be an integer with the distribution p i P{Y i}, i,,...letx t denote the total revenue gained during the time interval (0,t). a) Derive expressions for E[X t ] and V[X t ]. b) Deduce that X t E +E +3E 3 +,wherethee i are independent random variables with the distributions E i Poisson(p i λt). Denote X t total revenue on the interval (0,t), N t number of customers on the interval (0,t), N t Poisson(λt). (a) Clearly, the system revenue is a random sum X t Y Y Nt, 9

12 S Queueing Theory, II/007 Virtamo / Penttinen where the Y i are i.i.d. random variables. Conditioning on the value of N t we can apply the chain rules for expectation and variance: Variance: E[X t ]E[E[X t N t ]] E [ N t Y ] E[N t ]E[Y ]λt E[Y ]. V[X t ] V[E[X t N t ]] + E [V [X t N t ]] V [ N t Y ] +E[N t V[Y ]] ( ) V[N t ]E[Y ] +E[N t ]V[Y ]λt E[Y ] +V[Y ] λt E [ Y ]. λt t p λt t p λt t Figure : Random splitting of the Poisson process (b) On the interval (0,t) the customers arrive according to the Poisson process N t. Random splitting of this process with probabilities p i leads to new independent Poisson processes E i with the respective parameters p i λt. The customers of "class i" brought in the revenue i. Thus, X t i i E i. 5. Million (0 6 ) data packets per second arrive at a network from different sources. The lengths of routes, defined by the source and destination addresses, vary considerably. The time a packet spends in the network depends on the length of the route, but also on the congestion of the network. The distribution of the time a packet spends in the network is assumed to have the following distribution: ms (90 %), 0 ms (7 %), 00 ms (3 %). How many packets there are in the network on average? etc. transport delay proportion arrival intensity ms 90% /s 0ms 7% /s 00ms 3% /s So arrival intensity and average transport delay is known for for each traffic class. Next Little s result, N λt, can be applied: N ms /s 900, N 0 ms /s 700, N 3 00 ms /s 3000, The process is first split into two processes with the probability p of which the latter is split again with the probability p / X i p i 0

13 Exercise 3 BIRTH&DEATH- AND POISSON-PROCESSES, LITTLE S RESULT 6. The states of some irreducible Markov-process, which steady state probabilities π i are assumed to be known, can be partioned into two disjoint sets, A {,,...,n} and B {n +,n+,...}, so that the transition rates between the sets are non-zero only from state n to state n + and the opposite direction, i.e. q n,n+ λ and q n+,n. Using the Little s result write down an equation for the average time it takes from the transition n n +to the time the system returns back to set A (transition n + n), i.e. for the average time the system spends at set B. Define a new system to which a customer arrives when the original system moves from state n to state n +, i.e. a transition A B is interpreted as an arrival of a customer in a new system. Similarly, the transition B A in the original system is interpreted as a departure of the customer in the new system. Little s formula: N λ T, where λ is the arrival rate of customers. In the new system the average number of customers is clearly, A n λ n+ B N P{B} in+ Similarly, the average sojourn time T in the new system is the time from event A B to event B A, i.e. the quantity asked. The arrival intensity of the customers, λ,is λ λπ n. π i. Thus, T N λ in+ π i λπ n n i π i. λπ n

14 S Queueing Theory, II/007 Virtamo / Penttinen EX 4: Loss Systems. Consider a car-inspection center where cars arrive at a rate of one every 50 seconds and wait for an average of 5 minutes (inclusive of inspection time) to receive their inspections. After an inspection, 0 % of the car owners stay back an average of 0 minutes having their meals at the center s cafeteria. What is the average number of cars within the premises of the inspection center (inclusive of the cafeteria)? Little s theorem: N λw. The average time spent in the system is W 5min min 7min, and thus, N 50s 7min 6 7min min. Consider a communications link with unbounded capacity. At t 0 the link is empty and calls start arriving according to Poisson process with the intensity λ. The call holding times are assumed to be independent and exponentially distributed with the mean /. Consider the number of on-going calls N t at the time instant t 0. Determine the distribution of N t and, in particular, its mean as a function of time t. Hint: The number of on-going calls equals the number of arrivals between (0,t) from a certain inhomogeneous Poisson process, which can be obtained from the original Poisson process with a suitable random selection. p(x) 0 t Figure 3: Random selection from a Poisson process. The original process is a Poisson process with the intensity λ. We make a random selection of the original process by selecting calls with the probability that they are still in the system at the time t. In other words, p(x) P{call arriving at time x is still in the system at time t} e (t x). The resulting inhomogeneous Poisson process has the intensity λ (t) λp(x) λe (t x). According to the lecture notes, the number of arrivals on an interval (0,t) in an inhomogeneous Poisson process obeys the Poisson distribution with the parameter a(t) t 0 / t λe (t x) dx λe t ex λ ( e t e t ) λ ( e t ). 0 The mean of the distribution is the parameter itself, so the mean number of active calls at time t is given by λ ( e t ), which has the limit value λ, as it should. arrival intesity is a deterministic function of time

15 Exercise 4 LOSS SYSTEMS 3. A mail order company has 3 persons serving incoming calls. The calls arrive according to a Poisson process with intensity of /min and the average call duration is min. a) What is the probability that an incoming call is blocked, when blocked calls are lost? b) Is it profitable to hire a 4 th person if the total expenses per person are 00 /h and the average revenue per order is 0? The system is Erlang s loss system with 3 or 4 servers (M/M/K/K-system, where K 3or 4). The offered load a is a λ x /min min. Because we are considering a Poisson process, the call blocking and time blocking are the same. a) The probability of state 3 (K 3) can be obtained by calculating or by looking from a graph approximately: a 3 /3! E(3,a) +a/! + a /! + a 3 /3! b) In this case K 4. The fourth person is useful when there are 4 persons in service. The probability of system being in state 4 is E(4,a) a 4 /4! +a/! + a /! + a 3 /3! + a 4 /4! The blocked traffic lowers, i.e. the served traffic grows, with amount λ (E(3,a) E(4,a)). Thus, the net change is Hence, the 4 th person is worth hiring. λ (E(3,a) E(4,a)) 0 00 /h 38.3 /h. 4. Use recursive Erlang s blocking formula to calculate E(n, 6) for n 0,...,6. Recursive Erlang s blocking formula: E(n, a) Applying the recursive formula gives: a E(n,a), and E(0,a). n + a E(n,a) E(0, 6), E(4, 6) 6 36/ /6 54/5, E(, 6) /7, E(5, 6) 6 54/ /5 34/899, E(, 6) 6 6/7 +6 6/7 8/5, E(6, 6) 6 34/ /899 34/3. E(3, 6) 6 8/ /5 36/6, 5. Consider Erlang s loss system with n servers, where the intensity of the offered traffic is a. a) Show by direct calculations based on the steady state probabilities, that the mean number of customers in the system N is equal to ( E(n, a))a. Explain this by using Little s theorem. b) By using Little s theorem, deduce the mean time the system stays at state N n at a time. (Hint: How often the system moves to state N n? The mean number of customers in a given state is the same as steady state probability of the same state; the system either is in that particular state or not.) Deduce the same result directly from the properties of the exponential distribution. 3

16 S Queueing Theory, II/007 Virtamo / Penttinen a) For the steady state distribution of Erlang s blocking system it holds that π k a k /k! n j0 aj /j! For N one gets, N n k π k k0 n a k /k! n k n j0 aj /j! k0 k ak /k! n j0 aj /j! k0 n k ak /(k )! n j0 aj /j! a a n k0 ak+ /k! n a n k0 ak /k! a n+ /n! j0 aj /j! n j0 aj /j! a n /n! n a( E(n, a)). j0 aj /j! b) Define first a new stochastic process Y t as follows. Let X t denote the state of the original system at time t and let Y t denote { the occupancy of state n:, when Xt n, Y t 0, otherwise. Then, a transition to state n in the original process π X t corresponds to an arrival in Y t, and similarly a n n πn transition away from state n corresponds to a departure in Y t. In the equilibrium the arriving traffic to n n state n is λ Y π n λ. On the hand, the average λ occupancy of process Y t is Figure 4: Transitions to and from state n. N Y 0 ( π n )+ π n π n. For this we can apply Little s result: N λw π n π n λ W Y W Y π n π n λ a n /n! P n j0 aj /j! P a n /n! n j0 aj /j! λ a n /n! a n /n! λ a nλ n. On the other hand, the sojourn time in state n is exponentially distributed with parameter n (no higher states), and thus the mean sojourn time must be equal, W Y n. 6. Consider - and4 -concentrators, where for each input port calls arrive according to independent Poisson-processes with intensities γ. The mean call holding time is denoted by / and the offered load by â γ/ 0.. Compare in these two concentrators the probabilities that a call arriving to a free input port gets blocked because all the output ports are busy. The system corresponds to an Engset s system with n sources and s servers, 0 s n. Letπ j [n], j 0,...,s, denote the steady state probabilities. Similarly, let πj [n], j 0,...,s, denote the state probabilities seen by an arriving customer. 4

17 Exercise 4 LOSS SYSTEMS Time blocking in Engset s system is generally the same as the steady state probability of state s, π s [n] ( n s s k0 ) â s ( n k ) â k ( n s s k0 ) p s ( p) n s ( n k â, where p )p k ( p) n k +â. Similarly, for call blocking it holds that π s [n] π s[n ] ( ) n â s s s (. n )â k k0 k Substituting n and s to above gives (p 0.09) n s time blocking call blocking 6.7% 9.% 4 4.%.3% 5

18 S Queueing Theory, II/007 Virtamo / Penttinen EX 5: Queuing Systems. Assume that there is always one doctor at a clinic (4 hours a day) and that customers arrive according to a Poisson process with intensity λ. The service time of each customer obeys an exponential distribution with mean 30 minutes. Determine the maximum arrival intensity that allows 95% of the customers to be served within 7 hours from (the first) arrival. For the M/M/ queue, we know that (see lectures) which now yields the constraint P{W >t} ρ e ( λ)t, P{W >7} λ/ e ( λ) 7 5/00 λe 7λ e 44 /0. The maximum λ is obtained from the corresponding equality which can be solved numerically (it may be wise to take the logarithm on both sides of the equality first). The solution is λ max Show that in an M/G/-LIFO queue the equilibrium distribution of the queue length, π n ( ρ)ρ n, is insensitive to the holding time distribution. Hint: Reason that a customer who upon arrival finds j customers in the system will be exclusively served when the system is in state N j. Thus, the time the system spends in the state N j is completely composed of the full service times of the customers who arrive to the system in the state N j. Howmany such arrivals occur in a long interval of time T? During a long time interval T there is on average λπ j T arrivals to the state j. Because those customers are only served when the system is in state j, the system remains in that state on average the time λπ j T S, wheres is the average service time of one customer. That must be the same Tπ j,and it follows that Tπ j λπ j T S π j ρπ j, which is the same as with the ordinary M/M/-queue. 3. Consider an M/M//K queue with states 0,,...,K. Find the probability P n that the queue which initially is in the state n becomes empty before flowing over. Hint: Add an imaginary state K +to the system; a transition to the state K +corresponds to the queue flowing over. We have P 0 and P K+ 0. For states n,...,k, write the probability P n in terms of P n ja P n+. Solve the equations. State n is followed by state n with probability /(λ + ) andbystaten +with probability λ/(λ + ). By the Markov property, conditioning on the next state yields P n λ + P n + λ λ + P n+ λ(p n P n+ )(P n P n ). 6

19 Exercise 5 QUEUING SYSTEMS Defining D n P n P n+ allows writing this in the form D n λ D n ρd n D K i ρ i D K. On the other hand, we have K n i0 D K i (P K P K+ )+(P K P K )+...+(P n+ P n+ )+(P n P n+ )P n P K+ K n P n D K which, when written for P 0, allows determining D K : i0 ρ i, D K K i0 ρ i P 0 D K { ρ, ρ K+ ρ K+, ρ. 4. Customers arrive at a two-server system according to a Poisson process having rate λ 5/min. An arrival finding server free will begin service with that server. An arrival finding server busy and server free will enter service with server. An arrival finding both servers busy goes away. Once a customer is served by either server, he departs the system. The service times of the servers are exponential with rates 4/min and /min. a) What is the average time an entering customer spends in the system? b) What proportion of time is server busy? From the Fig. it can obtained the following equations: (π + π 3 )5π (5.) 4(π + π 3 )5(π 0 + π ) (5.) π +4π 5π 0 (5.3) Furthermore, the normalization condition, λ 3 λ λ 0 π 0 + π + π + π 3 (5.4) By combining (5.) and (5.4) one gets 3 4(π + π 3 )5( (π + π 3 )) π + π 3 5/9 π 0 + π 4/9. Similarly from (5.) gives, (π + π 3 )5π (π 0 + π )5π π 0 +7π, 3 Server itself behaves like normal M/M// system. 7

20 S Queueing Theory, II/007 Virtamo / Penttinen and from (5.) and (5.4), From what it follows, π +4π 5π 0 (π 0 + π )+4π 7π 0 8/9+4π 7π π 6π 0 π , π a) The average time spent in system: T 6 + 7π 6 44π π and π b) The server is reserved: π + π Customers arrive at an M/Erlang(k, )/ system according to a Poisson process with rate λ. Find the mean waiting and sojourn times of a customer in the system? Erlang(k, )-distributed random variable is a sum of k Exp()-random variables. Thus, E[X ]k/, V[X ]k/, E [ X ] V[X ]+E[X ] k/ + k / (k + k )/. In this case we have a M/G/-queue so we can apply Pollaczek-Khinchin mean value formulas. The offered load is ρ λx k λ and thus the mean sojourn time is T x + λx ( ρ) k + λ k+k ( kλ) k Similarly, the mean waiting time is ( + ) λ(k +). kλ W λx ( ρ) λ k+k ( kλ) λk(k +) ( kλ). 6. If in a single server system each customer has to pay a fee to the system according to some rule, then the average revenue rate of the system λ (average fee), whereλ is the mean rate of arriving customers. Apply this to the M/G/ system with the following charging rule: each customer in the system pays at rate which is the same as the customer s remaining service time. What is the average fee? Show by equating the above average revenue rate with the average charging rate (time charging) that W λ (X W + X /), where W and X are the waiting and service times. Solve W. What is this result? 8

21 Exercise 5 QUEUING SYSTEMS Let, { W unfinished work in the queue when customer arrives, and U unfinished work in the queue at an arbitary moment. We have a M/G/ queue and the fee rate is equal to the remaining service time. The average fee is X W + X, where X and W are independent random variables (the fee rate during the waiting is equal to the service time, and the fee rate drops linearly to zero when customer is under service) and thus the average revenue rate is λ(x W + X ). On the other hand, this is the same as the virtual waiting time, i.e. the waiting time of the customer if he would arrive to the system at the given moment of time. It follows from the PASTA property that the real waiting times W obey the same distribution, i.e. U W and U W. Thus, from which it can be deduced that W U λ(x W + X ), W ( λx) λx W λx ( λx) λx ( ρ), which is P-K mean value formula. 9

22 S Queueing Theory, II/007 Virtamo / Penttinen EX 6: Priority queues, queuing networks. Carloads of customers arrive at a single-server station in accordance with a Poisson process with rate 4 per hour. The service times are exponentially distributed with mean 3 min. If each carload contains either,, or 3 customers with respective probabilities 4,,, compute the average 4 customer waiting time in the queue. Hint: The waiting time of the first customer of each group can be obtained from an appropriate M/G/ queue. Consider separately the internal waiting time in the group. Consider first the whole batch as one unit and later the waiting time inside batch can be added to it. For the whole batch one can apply M/G/-queue model. It was given that The service time of the batch is, λ 4/h /5min, and / 3min. S X X N, where N is, or 3. For the number of customers, N, in one group it holds that, E[N] (/4) + (/) + 3 (/4) V[N] E [ (N E[N]) ] (/4) + 0 (/) + (/4) /. from which, by using the conditioning rule (or tower property), one gets for the service time S that, E[S]E[E[S N]] E [N 3min] 6min, V[S] E[V[S N]] + V [E [S N]] E [ N 9min ] +V[N 3min] 8min + 9 min 45/min E [ S ] V[S]+E[S] 45/min + 36min 7 min. The average waiting time of batch can be obtained by using the Pollaczek-Khinchin formula, E[W g ] λe [ S ] 7 ( λe[s]) 5min min ( 5min 6min) min 3 min 3min 5s. 4 5 In addition the customer sometimes have to wait within his batch. This is easiest to obtain by determining the total waiting time inside one batch and then dividing that by the average size of the batch: E[W c ](/4 0+/ +/4 3) 3min/ 5/8min min 5.5s. (Note. When batch size is 3, the average waiting time is (0++) 3min 3 3min.) By adding the waiting times together one gets the total average waiting time of customer, which is E[W ]E[W g ]+E[W c ]5min7.5s.. Persons arrive at a copying machine according to a Poisson process with rate /min. The number of copies to be made by each person is uniformly distributed between and 0. Each copy takes 3 s. Find the average waiting time in the queue when a) Each person uses the machine on a first-come first-served basis. b) Persons with no more than copies to make are given non-preemptive priority over other persons. 0

23 Exercise 6 PRIORITY QUEUES, QUEUING NETWORKS a) We will apply the P-K formula. Now S X 3s, where X is the number of copies needed. We have E[S] E[X] 3s 0 + 3s 33 s, E [ S ] E [ X ] 9s 0 0 i i 9s 77 9 s. The load of the system is ρ λ E[S] , and the average waiting time of a customer is W R/( ρ), wherer λe [ S ] / 77 9/( 60)s 3/80s is the average amount of unfinished work (service time) in the server. Thus, W s 3 58 s 3.98s. b) Customers have two priority classes (m 0,n and m,n 8): λ k E[S k ] ρ k 9 class 300 s 3/00 4 class 300 s 3( + 9 ) 39 56/600 3/50 In the prioritized system, the class-specific mean waiting times are W W R ρ.93s, R ( ρ )( ρ ρ ) W 4.04s. ρ ρ (R is the same as above; the order in which customers are served does not affect the average residual work.) The average waiting time is W λ W + λ W λ + λ 3.8s. 3. Consider a priority queue with two classes and preemptive resume priority. Customers arrive according to two independent Poisson processes with intensities λ and λ. Service times in both classes are independent and exponentially distributed with a joint mean /. Determine the mean sojourn times T and T for both classes. For preemptive priority queue it holds that (cf. lecture notes), T ( ρ )S + R ρ, T ( ρ ρ )S + R ( ρ )( ρ ρ ),

24 S Queueing Theory, II/007 Virtamo / Penttinen where R k k i λ i Si. In this case, and thus, from what one obtains, S S /, ρ λ /, S S /, ρ λ /, R λ / λ /, R T ( λ /)(/)+λ / λ / ( λ / + λ / ) (λ + λ )/, λ + λ λ λ, T ( (λ + λ )/)(/)+(λ + λ )/ ( λ /)( (λ + λ )/) ( λ )( λ λ ). λ λ + λ + λ ( λ )( λ λ ) Note that T is equal to the mean sojourn time in M/M/-queue, as it should be. 4. The Pollaczek-Khinchin formula for the Laplace transform of the waiting time W is W (s) s( ρ) s λ + λs (s) where S (s) is the Laplace transform of the service time S and ρ λs. Using this result, rederive the PK mean formula for the waiting time. The mean of random variable W is W Similarly, for the service time S it holds that [ S d ] ds S (s) Taylor serie of S (s) is Thus, S (s) S (0) }{{} W (s) from which it follows that [ d + s0 ] ds S (s) s0 }{{} S [ d ] ds W (s) s0 and S [ ] d ds S (s). s0 s + [ ] d ds S (s) s S s + s0 S s }{{} S s( ρ) s λ + λs (s) s( ρ) s λ + λ( S s + S s ) s( ρ) s( ρ)+ λs s W + λs [ d ] ds W (s) s0 ρ s, λs ρ.

25 Exercise 6 PRIORITY QUEUES, QUEUING NETWORKS 5. Queues and of the open Jackson queueing network depicted in the figure receive Poissonian arrival streams with rates and (customers/s). Service times are exponentially distributed with the given rates (customers/s). Calculate a) customer streams through each of the queues, b) average occupancies of the queues and the average total number of customers in the network, c) mean delays in the network of customers arriving at queues and as well as the delay of an arriving customer chosen at random. queue 3 queue 6 queue 3 0 / / a) Let the traffic stream fed back to system be x customers per second. Then the traffic stream to server 3 is x, from which half goes out. The traffic flow in and out of the system must be equal. Hence, x 3and λ λ 4 λ 3 6 ρ /3 ρ /3 ρ 3 3/5 b) Jacksons theorem states that queues of the network behave like they were independent and the offered traffic were Poissonian, i.e. P{N n} i P{N i n i }, where P{N i n i } ( ρ i )ρ n i i. In this problem, { P{N i} P{N i} 3 ( i 3), P{N 3 i} 5 ( 3 i 5), so the average number of customers in each server are { N N ρ ρ, N 3 ρ N N 3 ρ 3 3/. + N + N 3 /. c) The average sojourn times in each network node is T i N i λ i T T / T 3 /4 A customer arriving to the queue i sojourn time in the network is T i,d, for which it holds that T i,d T i + j q ij T j,d, where q ij is the probability that a customer leaving from queue i enters to queue j. Denote T i,d {a, b, c }. Then the set of linear equations can be written as a +c T,d b + c T,d 3/ c 4 + b T 3,d 3

26 S Queueing Theory, II/007 Virtamo / Penttinen Furthermore, a random customer stays in the network on average (Little s result) T N/λ /6. 6. Consider a cyclic closed network consisting of two queues. The service times in the queues are exponentially distributed with parameters and. There are three customers circulating in the network. a) Draw the state transition diagram of the network (four states). b) Determine the equilibrium probabilities and calculate the mean queue lengths. c) Calculate the customer stream in the network (e.g. the customer stream departing from queue ). d) Rederive the results of b) and c) by means of the mean value analysis (MVA). 3,0,, 0,3 Figure 5: State diagram of the system. a) State diagram of the system is depicted in Fig. 5. b) In steady state it holds that π 0 π π ρπ 0 π π π ρ π 0 π π 3 π 3 ρ 3 π 0 Normalization: The average queue lengths are ( + ρ + ρ + ρ 3 )π 0 π 0 N (3+ρ + ρ )π 0 3+ρ + ρ +ρ + ρ + ρ 3 +ρ + ρ + ρ 3. N (3ρ 3 +ρ + ρ)π 0 3ρ3 +ρ + ρ +ρ + ρ + ρ 3. (N + N 3) c) The traffic flow is λ (π 0 + π + π ) d) Mean value analysis (MVA): Here, N[0] [0, 0] T [] [ / [,ρ] ] N[] +ρ, ρ +ρ +ρ + ρ +ρ + ρ + ρ 3 ρ3 ρ ρ ρ 4 ρ3 ρ 4. T i [k] (+N i [k ]) / N i [k] k P λ it i [k] j λ jt j [k] λ i [k] N i [k]/t i [k] [ T [] / +ρ [ N[] +ρ, +ρ +ρ +ρ+ρ, +ρ ρ ] (+ρ) ρ+ρ +ρ+ρ ] [ ] T [3] / +ρ+ρ ++ρ, +ρ + ρ +ρ+ρ + ρ +ρ +ρ + ρ ρ [ (+ρ+ρ ) 3+ρ + ρ,ρ+ρ +3ρ [ ] 3] 3+ρ+ρ N[3] 3 ρ+ρ 3+3ρ+3ρ +3ρ, +3ρ ρ+3ρ +3ρ 3 [ 3+ρ + ρ,ρ+ρ +3ρ 3] π 0 4 [ +ρ, ρ +ρ ] [ +ρ +ρ+ρ, ] ρ+ρ +ρ+ρ

27 Exercise 6 Similarly, the traffic flow becomes λ λ [3] 3+ρ + ρ ( + ρ + ρ ) +ρ + ρ + ρ 3 3+ρ + ρ ( + ρ + ρ ) +ρ + ρ + ρ 3 ρ3 ρ 4. 5

Part I Stochastic variables and Markov chains

Part I Stochastic variables and Markov chains Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)

More information

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems  M/M/1  M/M/m  M/M/1/K Queueing Theory I Summary Little s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K " Little s Law a(t): the process that counts the number of arrivals

More information

Chapter 2 Queueing Theory and Simulation

Chapter 2 Queueing Theory and Simulation Chapter 2 Queueing Theory and Simulation Based on the slides of Dr. Dharma P. Agrawal, University of Cincinnati and Dr. Hiroyuki Ohsaki Graduate School of Information Science & Technology, Osaka University,

More information

Queueing Theory and Simulation. Introduction

Queueing Theory and Simulation. Introduction Queueing Theory and Simulation Based on the slides of Dr. Dharma P. Agrawal, University of Cincinnati and Dr. Hiroyuki Ohsaki Graduate School of Information Science & Technology, Osaka University, Japan

More information

M/G/1 and M/G/1/K systems

M/G/1 and M/G/1/K systems M/G/1 and M/G/1/K systems Dmitri A. Moltchanov dmitri.moltchanov@tut.fi http://www.cs.tut.fi/kurssit/elt-53606/ OUTLINE: Description of M/G/1 system; Methods of analysis; Residual life approach; Imbedded

More information

P (L d k = n). P (L(t) = n),

P (L d k = n). P (L(t) = n), 4 M/G/1 queue In the M/G/1 queue customers arrive according to a Poisson process with rate λ and they are treated in order of arrival The service times are independent and identically distributed with

More information

Queueing Theory. VK Room: M Last updated: October 17, 2013.

Queueing Theory. VK Room: M Last updated: October 17, 2013. Queueing Theory VK Room: M1.30 knightva@cf.ac.uk www.vincent-knight.com Last updated: October 17, 2013. 1 / 63 Overview Description of Queueing Processes The Single Server Markovian Queue Multi Server

More information

Data analysis and stochastic modeling

Data analysis and stochastic modeling Data analysis and stochastic modeling Lecture 7 An introduction to queueing theory Guillaume Gravier guillaume.gravier@irisa.fr with a lot of help from Paul Jensen s course http://www.me.utexas.edu/ jensen/ormm/instruction/powerpoint/or_models_09/14_queuing.ppt

More information

Lecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes

Lecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes Lecture Notes 7 Random Processes Definition IID Processes Bernoulli Process Binomial Counting Process Interarrival Time Process Markov Processes Markov Chains Classification of States Steady State Probabilities

More information

Introduction to Markov Chains, Queuing Theory, and Network Performance

Introduction to Markov Chains, Queuing Theory, and Network Performance Introduction to Markov Chains, Queuing Theory, and Network Performance Marceau Coupechoux Telecom ParisTech, departement Informatique et Réseaux marceau.coupechoux@telecom-paristech.fr IT.2403 Modélisation

More information

Stochastic process. X, a series of random variables indexed by t

Stochastic process. X, a series of random variables indexed by t Stochastic process X, a series of random variables indexed by t X={X(t), t 0} is a continuous time stochastic process X={X(t), t=0,1, } is a discrete time stochastic process X(t) is the state at time t,

More information

THE QUEEN S UNIVERSITY OF BELFAST

THE QUEEN S UNIVERSITY OF BELFAST THE QUEEN S UNIVERSITY OF BELFAST 0SOR20 Level 2 Examination Statistics and Operational Research 20 Probability and Distribution Theory Wednesday 4 August 2002 2.30 pm 5.30 pm Examiners { Professor R M

More information

Exercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010

Exercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010 Exercises Stochastic Performance Modelling Hamilton Institute, Summer Instruction Exercise Let X be a non-negative random variable with E[X ]

More information

Link Models for Circuit Switching

Link Models for Circuit Switching Link Models for Circuit Switching The basis of traffic engineering for telecommunication networks is the Erlang loss function. It basically allows us to determine the amount of telephone traffic that can

More information

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking Lecture 7: Simulation of Markov Processes Pasi Lassila Department of Communications and Networking Contents Markov processes theory recap Elementary queuing models for data networks Simulation of Markov

More information

CPSC 531: System Modeling and Simulation. Carey Williamson Department of Computer Science University of Calgary Fall 2017

CPSC 531: System Modeling and Simulation. Carey Williamson Department of Computer Science University of Calgary Fall 2017 CPSC 531: System Modeling and Simulation Carey Williamson Department of Computer Science University of Calgary Fall 2017 Motivating Quote for Queueing Models Good things come to those who wait - poet/writer

More information

Performance Evaluation of Queuing Systems

Performance Evaluation of Queuing Systems Performance Evaluation of Queuing Systems Introduction to Queuing Systems System Performance Measures & Little s Law Equilibrium Solution of Birth-Death Processes Analysis of Single-Station Queuing Systems

More information

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks Recap Probability, stochastic processes, Markov chains ELEC-C7210 Modeling and analysis of communication networks 1 Recap: Probability theory important distributions Discrete distributions Geometric distribution

More information

57:022 Principles of Design II Final Exam Solutions - Spring 1997

57:022 Principles of Design II Final Exam Solutions - Spring 1997 57:022 Principles of Design II Final Exam Solutions - Spring 1997 Part: I II III IV V VI Total Possible Pts: 52 10 12 16 13 12 115 PART ONE Indicate "+" if True and "o" if False: + a. If a component's

More information

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1 Queueing systems Renato Lo Cigno Simulation and Performance Evaluation 2014-15 Queueing systems - Renato Lo Cigno 1 Queues A Birth-Death process is well modeled by a queue Indeed queues can be used to

More information

MARKOV PROCESSES. Valerio Di Valerio

MARKOV PROCESSES. Valerio Di Valerio MARKOV PROCESSES Valerio Di Valerio Stochastic Process Definition: a stochastic process is a collection of random variables {X(t)} indexed by time t T Each X(t) X is a random variable that satisfy some

More information

Name of the Student:

Name of the Student: SUBJECT NAME : Probability & Queueing Theory SUBJECT CODE : MA 6453 MATERIAL NAME : Part A questions REGULATION : R2013 UPDATED ON : November 2017 (Upto N/D 2017 QP) (Scan the above QR code for the direct

More information

Figure 10.1: Recording when the event E occurs

Figure 10.1: Recording when the event E occurs 10 Poisson Processes Let T R be an interval. A family of random variables {X(t) ; t T} is called a continuous time stochastic process. We often consider T = [0, 1] and T = [0, ). As X(t) is a random variable

More information

IEOR 6711, HMWK 5, Professor Sigman

IEOR 6711, HMWK 5, Professor Sigman IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.

More information

CDA5530: Performance Models of Computers and Networks. Chapter 4: Elementary Queuing Theory

CDA5530: Performance Models of Computers and Networks. Chapter 4: Elementary Queuing Theory CDA5530: Performance Models of Computers and Networks Chapter 4: Elementary Queuing Theory Definition Queuing system: a buffer (waiting room), service facility (one or more servers) a scheduling policy

More information

Probability and Statistics Concepts

Probability and Statistics Concepts University of Central Florida Computer Science Division COT 5611 - Operating Systems. Spring 014 - dcm Probability and Statistics Concepts Random Variable: a rule that assigns a numerical value to each

More information

Continuous Time Processes

Continuous Time Processes page 102 Chapter 7 Continuous Time Processes 7.1 Introduction In a continuous time stochastic process (with discrete state space), a change of state can occur at any time instant. The associated point

More information

Part II: continuous time Markov chain (CTMC)

Part II: continuous time Markov chain (CTMC) Part II: continuous time Markov chain (CTMC) Continuous time discrete state Markov process Definition (Markovian property) X(t) is a CTMC, if for any n and any sequence t 1

More information

Chapter 2. Poisson Processes. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan

Chapter 2. Poisson Processes. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Chapter 2. Poisson Processes Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Outline Introduction to Poisson Processes Definition of arrival process Definition

More information

Queues and Queueing Networks

Queues and Queueing Networks Queues and Queueing Networks Sanjay K. Bose Dept. of EEE, IITG Copyright 2015, Sanjay K. Bose 1 Introduction to Queueing Models and Queueing Analysis Copyright 2015, Sanjay K. Bose 2 Model of a Queue Arrivals

More information

The story of the film so far... Mathematics for Informatics 4a. Continuous-time Markov processes. Counting processes

The story of the film so far... Mathematics for Informatics 4a. Continuous-time Markov processes. Counting processes The story of the film so far... Mathematics for Informatics 4a José Figueroa-O Farrill Lecture 19 28 March 2012 We have been studying stochastic processes; i.e., systems whose time evolution has an element

More information

Non Markovian Queues (contd.)

Non Markovian Queues (contd.) MODULE 7: RENEWAL PROCESSES 29 Lecture 5 Non Markovian Queues (contd) For the case where the service time is constant, V ar(b) = 0, then the P-K formula for M/D/ queue reduces to L s = ρ + ρ 2 2( ρ) where

More information

Queueing Systems: Lecture 3. Amedeo R. Odoni October 18, Announcements

Queueing Systems: Lecture 3. Amedeo R. Odoni October 18, Announcements Queueing Systems: Lecture 3 Amedeo R. Odoni October 18, 006 Announcements PS #3 due tomorrow by 3 PM Office hours Odoni: Wed, 10/18, :30-4:30; next week: Tue, 10/4 Quiz #1: October 5, open book, in class;

More information

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem Wade Trappe Lecture Overview Network of Queues Introduction Queues in Tandem roduct Form Solutions Burke s Theorem What

More information

CS 798: Homework Assignment 3 (Queueing Theory)

CS 798: Homework Assignment 3 (Queueing Theory) 1.0 Little s law Assigned: October 6, 009 Patients arriving to the emergency room at the Grand River Hospital have a mean waiting time of three hours. It has been found that, averaged over the period of

More information

Contents Preface The Exponential Distribution and the Poisson Process Introduction to Renewal Theory

Contents Preface The Exponential Distribution and the Poisson Process Introduction to Renewal Theory Contents Preface... v 1 The Exponential Distribution and the Poisson Process... 1 1.1 Introduction... 1 1.2 The Density, the Distribution, the Tail, and the Hazard Functions... 2 1.2.1 The Hazard Function

More information

Queueing Networks and Insensitivity

Queueing Networks and Insensitivity Lukáš Adam 29. 10. 2012 1 / 40 Table of contents 1 Jackson networks 2 Insensitivity in Erlang s Loss System 3 Quasi-Reversibility and Single-Node Symmetric Queues 4 Quasi-Reversibility in Networks 5 The

More information

2905 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES

2905 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES 295 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES 16 Queueing Systems with Two Types of Customers In this section, we discuss queueing systems with two types of customers.

More information

Readings: Finish Section 5.2

Readings: Finish Section 5.2 LECTURE 19 Readings: Finish Section 5.2 Lecture outline Markov Processes I Checkout counter example. Markov process: definition. -step transition probabilities. Classification of states. Example: Checkout

More information

M/G/1 and Priority Queueing

M/G/1 and Priority Queueing M/G/1 and Priority Queueing Richard T. B. Ma School of Computing National University of Singapore CS 5229: Advanced Compute Networks Outline PASTA M/G/1 Workload and FIFO Delay Pollaczek Khinchine Formula

More information

Part IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015

Part IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015 Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.

More information

UNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours.

UNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours. UNIVERSITY OF YORK MSc Examinations 2004 MATHEMATICS Networks Time Allowed: 3 hours. Answer 4 questions. Standard calculators will be provided but should be unnecessary. 1 Turn over 2 continued on next

More information

Markov processes and queueing networks

Markov processes and queueing networks Inria September 22, 2015 Outline Poisson processes Markov jump processes Some queueing networks The Poisson distribution (Siméon-Denis Poisson, 1781-1840) { } e λ λ n n! As prevalent as Gaussian distribution

More information

Queueing Theory II. Summary. ! M/M/1 Output process. ! Networks of Queue! Method of Stages. ! General Distributions

Queueing Theory II. Summary. ! M/M/1 Output process. ! Networks of Queue! Method of Stages. ! General Distributions Queueing Theory II Summary! M/M/1 Output process! Networks of Queue! Method of Stages " Erlang Distribution " Hyperexponential Distribution! General Distributions " Embedded Markov Chains M/M/1 Output

More information

Class 11 Non-Parametric Models of a Service System; GI/GI/1, GI/GI/n: Exact & Approximate Analysis.

Class 11 Non-Parametric Models of a Service System; GI/GI/1, GI/GI/n: Exact & Approximate Analysis. Service Engineering Class 11 Non-Parametric Models of a Service System; GI/GI/1, GI/GI/n: Exact & Approximate Analysis. G/G/1 Queue: Virtual Waiting Time (Unfinished Work). GI/GI/1: Lindley s Equations

More information

Classical Queueing Models.

Classical Queueing Models. Sergey Zeltyn January 2005 STAT 99. Service Engineering. The Wharton School. University of Pennsylvania. Based on: Classical Queueing Models. Mandelbaum A. Service Engineering course, Technion. http://iew3.technion.ac.il/serveng2005w

More information

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18. IEOR 6711: Stochastic Models I, Fall 23, Professor Whitt Solutions to Final Exam: Thursday, December 18. Below are six questions with several parts. Do as much as you can. Show your work. 1. Two-Pump Gas

More information

Little s result. T = average sojourn time (time spent) in the system N = average number of customers in the system. Little s result says that

Little s result. T = average sojourn time (time spent) in the system N = average number of customers in the system. Little s result says that J. Virtamo 38.143 Queueing Theory / Little s result 1 Little s result The result Little s result or Little s theorem is a very simple (but fundamental) relation between the arrival rate of customers, average

More information

Assignment 3 with Reference Solutions

Assignment 3 with Reference Solutions Assignment 3 with Reference Solutions Exercise 3.: Poisson Process Given are k independent sources s i of jobs as shown in the figure below. The interarrival time between jobs for each source is exponentially

More information

Introduction to Queuing Networks Solutions to Problem Sheet 3

Introduction to Queuing Networks Solutions to Problem Sheet 3 Introduction to Queuing Networks Solutions to Problem Sheet 3 1. (a) The state space is the whole numbers {, 1, 2,...}. The transition rates are q i,i+1 λ for all i and q i, for all i 1 since, when a bus

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.262 Discrete Stochastic Processes Midterm Quiz April 6, 2010 There are 5 questions, each with several parts.

More information

Simple queueing models

Simple queueing models Simple queueing models c University of Bristol, 2012 1 M/M/1 queue This model describes a queue with a single server which serves customers in the order in which they arrive. Customer arrivals constitute

More information

Lecture 20: Reversible Processes and Queues

Lecture 20: Reversible Processes and Queues Lecture 20: Reversible Processes and Queues 1 Examples of reversible processes 11 Birth-death processes We define two non-negative sequences birth and death rates denoted by {λ n : n N 0 } and {µ n : n

More information

Solutions to Homework Discrete Stochastic Processes MIT, Spring 2011

Solutions to Homework Discrete Stochastic Processes MIT, Spring 2011 Exercise 6.5: Solutions to Homework 0 6.262 Discrete Stochastic Processes MIT, Spring 20 Consider the Markov process illustrated below. The transitions are labelled by the rate q ij at which those transitions

More information

Chapter 1. Introduction. 1.1 Stochastic process

Chapter 1. Introduction. 1.1 Stochastic process Chapter 1 Introduction Process is a phenomenon that takes place in time. In many practical situations, the result of a process at any time may not be certain. Such a process is called a stochastic process.

More information

Kendall notation. PASTA theorem Basics of M/M/1 queue

Kendall notation. PASTA theorem Basics of M/M/1 queue Elementary queueing system Kendall notation Little s Law PASTA theorem Basics of M/M/1 queue 1 History of queueing theory An old research area Started in 1909, by Agner Erlang (to model the Copenhagen

More information

Stochastic Models in Computer Science A Tutorial

Stochastic Models in Computer Science A Tutorial Stochastic Models in Computer Science A Tutorial Dr. Snehanshu Saha Department of Computer Science PESIT BSC, Bengaluru WCI 2015 - August 10 to August 13 1 Introduction 2 Random Variable 3 Introduction

More information

Introduction to queuing theory

Introduction to queuing theory Introduction to queuing theory Claude Rigault ENST claude.rigault@enst.fr Introduction to Queuing theory 1 Outline The problem The number of clients in a system The client process Delay processes Loss

More information

Queueing Networks G. Rubino INRIA / IRISA, Rennes, France

Queueing Networks G. Rubino INRIA / IRISA, Rennes, France Queueing Networks G. Rubino INRIA / IRISA, Rennes, France February 2006 Index 1. Open nets: Basic Jackson result 2 2. Open nets: Internet performance evaluation 18 3. Closed nets: Basic Gordon-Newell result

More information

Poisson Processes. Stochastic Processes. Feb UC3M

Poisson Processes. Stochastic Processes. Feb UC3M Poisson Processes Stochastic Processes UC3M Feb. 2012 Exponential random variables A random variable T has exponential distribution with rate λ > 0 if its probability density function can been written

More information

Answers to selected exercises

Answers to selected exercises Answers to selected exercises A First Course in Stochastic Models, Henk C. Tijms 1.1 ( ) 1.2 (a) Let waiting time if passengers already arrived,. Then,, (b) { (c) Long-run fraction for is (d) Let waiting

More information

Introduction to Queueing Theory

Introduction to Queueing Theory Introduction to Queueing Theory Raj Jain Washington University in Saint Louis Jain@eecs.berkeley.edu or Jain@wustl.edu A Mini-Course offered at UC Berkeley, Sept-Oct 2012 These slides and audio/video recordings

More information

STAT 516 Midterm Exam 2 Friday, March 7, 2008

STAT 516 Midterm Exam 2 Friday, March 7, 2008 STAT 516 Midterm Exam 2 Friday, March 7, 2008 Name Purdue student ID (10 digits) 1. The testing booklet contains 8 questions. 2. Permitted Texas Instruments calculators: BA-35 BA II Plus BA II Plus Professional

More information

Intro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin

Intro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin Queuing Networks Florence Perronnin Polytech Grenoble - UGA March 23, 27 F. Perronnin (UGA) Queuing Networks March 23, 27 / 46 Outline Introduction to Queuing Networks 2 Refresher: M/M/ queue 3 Reversibility

More information

1.1 Review of Probability Theory

1.1 Review of Probability Theory 1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,

More information

EE126: Probability and Random Processes

EE126: Probability and Random Processes EE126: Probability and Random Processes Lecture 18: Poisson Process Abhay Parekh UC Berkeley March 17, 2011 1 1 Review 2 Poisson Process 2 Bernoulli Process An arrival process comprised of a sequence of

More information

GI/M/1 and GI/M/m queuing systems

GI/M/1 and GI/M/m queuing systems GI/M/1 and GI/M/m queuing systems Dmitri A. Moltchanov moltchan@cs.tut.fi http://www.cs.tut.fi/kurssit/tlt-2716/ OUTLINE: GI/M/1 queuing system; Methods of analysis; Imbedded Markov chain approach; Waiting

More information

1 IEOR 4701: Continuous-Time Markov Chains

1 IEOR 4701: Continuous-Time Markov Chains Copyright c 2006 by Karl Sigman 1 IEOR 4701: Continuous-Time Markov Chains A Markov chain in discrete time, {X n : n 0}, remains in any state for exactly one unit of time before making a transition (change

More information

Derivation of Formulas by Queueing Theory

Derivation of Formulas by Queueing Theory Appendices Spectrum Requirement Planning in Wireless Communications: Model and Methodology for IMT-Advanced E dite d by H. Takagi and B. H. Walke 2008 J ohn Wiley & Sons, L td. ISBN: 978-0-470-98647-9

More information

Lecture 4a: Continuous-Time Markov Chain Models

Lecture 4a: Continuous-Time Markov Chain Models Lecture 4a: Continuous-Time Markov Chain Models Continuous-time Markov chains are stochastic processes whose time is continuous, t [0, ), but the random variables are discrete. Prominent examples of continuous-time

More information

NICTA Short Course. Network Analysis. Vijay Sivaraman. Day 1 Queueing Systems and Markov Chains. Network Analysis, 2008s2 1-1

NICTA Short Course. Network Analysis. Vijay Sivaraman. Day 1 Queueing Systems and Markov Chains. Network Analysis, 2008s2 1-1 NICTA Short Course Network Analysis Vijay Sivaraman Day 1 Queueing Systems and Markov Chains Network Analysis, 2008s2 1-1 Outline Why a short course on mathematical analysis? Limited current course offering

More information

CDA5530: Performance Models of Computers and Networks. Chapter 3: Review of Practical

CDA5530: Performance Models of Computers and Networks. Chapter 3: Review of Practical CDA5530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic ti process X = {X(t), t T} is a collection of random variables (rvs); one

More information

Exact Simulation of the Stationary Distribution of M/G/c Queues

Exact Simulation of the Stationary Distribution of M/G/c Queues 1/36 Exact Simulation of the Stationary Distribution of M/G/c Queues Professor Karl Sigman Columbia University New York City USA Conference in Honor of Søren Asmussen Monday, August 1, 2011 Sandbjerg Estate

More information

Introduction to Queueing Theory

Introduction to Queueing Theory Introduction to Queueing Theory Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 Jain@cse.wustl.edu Audio/Video recordings of this lecture are available at: 30-1 Overview Queueing Notation

More information

Engineering Mathematics : Probability & Queueing Theory SUBJECT CODE : MA 2262 X find the minimum value of c.

Engineering Mathematics : Probability & Queueing Theory SUBJECT CODE : MA 2262 X find the minimum value of c. SUBJECT NAME : Probability & Queueing Theory SUBJECT CODE : MA 2262 MATERIAL NAME : University Questions MATERIAL CODE : SKMA104 UPDATED ON : May June 2013 Name of the Student: Branch: Unit I (Random Variables)

More information

J. MEDHI STOCHASTIC MODELS IN QUEUEING THEORY

J. MEDHI STOCHASTIC MODELS IN QUEUEING THEORY J. MEDHI STOCHASTIC MODELS IN QUEUEING THEORY SECOND EDITION ACADEMIC PRESS An imprint of Elsevier Science Amsterdam Boston London New York Oxford Paris San Diego San Francisco Singapore Sydney Tokyo Contents

More information

Solution: The process is a compound Poisson Process with E[N (t)] = λt/p by Wald's equation.

Solution: The process is a compound Poisson Process with E[N (t)] = λt/p by Wald's equation. Solutions Stochastic Processes and Simulation II, May 18, 217 Problem 1: Poisson Processes Let {N(t), t } be a homogeneous Poisson Process on (, ) with rate λ. Let {S i, i = 1, 2, } be the points of the

More information

Tom Salisbury

Tom Salisbury MATH 2030 3.00MW Elementary Probability Course Notes Part V: Independence of Random Variables, Law of Large Numbers, Central Limit Theorem, Poisson distribution Geometric & Exponential distributions Tom

More information

CS418 Operating Systems

CS418 Operating Systems CS418 Operating Systems Lecture 14 Queuing Analysis Textbook: Operating Systems by William Stallings 1 1. Why Queuing Analysis? If the system environment changes (like the number of users is doubled),

More information

1 Presessional Probability

1 Presessional Probability 1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional

More information

IEOR 3106: Second Midterm Exam, Chapters 5-6, November 7, 2013

IEOR 3106: Second Midterm Exam, Chapters 5-6, November 7, 2013 IEOR 316: Second Midterm Exam, Chapters 5-6, November 7, 13 SOLUTIONS Honor Code: Students are expected to behave honorably, following the accepted code of academic honesty. You may keep the exam itself.

More information

Irreducibility. Irreducible. every state can be reached from every other state For any i,j, exist an m 0, such that. Absorbing state: p jj =1

Irreducibility. Irreducible. every state can be reached from every other state For any i,j, exist an m 0, such that. Absorbing state: p jj =1 Irreducibility Irreducible every state can be reached from every other state For any i,j, exist an m 0, such that i,j are communicate, if the above condition is valid Irreducible: all states are communicate

More information

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations Chapter 5 Statistical Models in Simulations 5.1 Contents Basic Probability Theory Concepts Discrete Distributions Continuous Distributions Poisson Process Empirical Distributions Useful Statistical Models

More information

2. Variance and Covariance: We will now derive some classic properties of variance and covariance. Assume real-valued random variables X and Y.

2. Variance and Covariance: We will now derive some classic properties of variance and covariance. Assume real-valued random variables X and Y. CS450 Final Review Problems Fall 08 Solutions or worked answers provided Problems -6 are based on the midterm review Identical problems are marked recap] Please consult previous recitations and textbook

More information

Exercises Solutions. Automation IEA, LTH. Chapter 2 Manufacturing and process systems. Chapter 5 Discrete manufacturing problems

Exercises Solutions. Automation IEA, LTH. Chapter 2 Manufacturing and process systems. Chapter 5 Discrete manufacturing problems Exercises Solutions Note, that we have not formulated the answers for all the review questions. You will find the answers for many questions by reading and reflecting about the text in the book. Chapter

More information

Computer Systems Modelling

Computer Systems Modelling Computer Systems Modelling Computer Laboratory Computer Science Tripos, Part II Michaelmas Term 2003 R. J. Gibbens Problem sheet William Gates Building JJ Thomson Avenue Cambridge CB3 0FD http://www.cl.cam.ac.uk/

More information

Q = (c) Assuming that Ricoh has been working continuously for 7 days, what is the probability that it will remain working at least 8 more days?

Q = (c) Assuming that Ricoh has been working continuously for 7 days, what is the probability that it will remain working at least 8 more days? IEOR 4106: Introduction to Operations Research: Stochastic Models Spring 2005, Professor Whitt, Second Midterm Exam Chapters 5-6 in Ross, Thursday, March 31, 11:00am-1:00pm Open Book: but only the Ross

More information

Classification of Queuing Models

Classification of Queuing Models Classification of Queuing Models Generally Queuing models may be completely specified in the following symbol form:(a/b/c):(d/e)where a = Probability law for the arrival(or inter arrival)time, b = Probability

More information

ECE-517: Reinforcement Learning in Artificial Intelligence. Lecture 4: Discrete-Time Markov Chains

ECE-517: Reinforcement Learning in Artificial Intelligence. Lecture 4: Discrete-Time Markov Chains ECE-517: Reinforcement Learning in Artificial Intelligence Lecture 4: Discrete-Time Markov Chains September 1, 215 Dr. Itamar Arel College of Engineering Department of Electrical Engineering & Computer

More information

Since D has an exponential distribution, E[D] = 0.09 years. Since {A(t) : t 0} is a Poisson process with rate λ = 10, 000, A(0.

Since D has an exponential distribution, E[D] = 0.09 years. Since {A(t) : t 0} is a Poisson process with rate λ = 10, 000, A(0. IEOR 46: Introduction to Operations Research: Stochastic Models Chapters 5-6 in Ross, Thursday, April, 4:5-5:35pm SOLUTIONS to Second Midterm Exam, Spring 9, Open Book: but only the Ross textbook, the

More information

Probability Models. 4. What is the definition of the expectation of a discrete random variable?

Probability Models. 4. What is the definition of the expectation of a discrete random variable? 1 Probability Models The list of questions below is provided in order to help you to prepare for the test and exam. It reflects only the theoretical part of the course. You should expect the questions

More information

Statistics 253/317 Introduction to Probability Models. Winter Midterm Exam Monday, Feb 10, 2014

Statistics 253/317 Introduction to Probability Models. Winter Midterm Exam Monday, Feb 10, 2014 Statistics 253/317 Introduction to Probability Models Winter 2014 - Midterm Exam Monday, Feb 10, 2014 Student Name (print): (a) Do not sit directly next to another student. (b) This is a closed-book, closed-note

More information

Continuous-time Markov Chains

Continuous-time Markov Chains Continuous-time Markov Chains Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ October 23, 2017

More information

Computer Networks More general queuing systems

Computer Networks More general queuing systems Computer Networks More general queuing systems Saad Mneimneh Computer Science Hunter College of CUNY New York M/G/ Introduction We now consider a queuing system where the customer service times have a

More information

Markov Processes and Queues

Markov Processes and Queues MIT 2.853/2.854 Introduction to Manufacturing Systems Markov Processes and Queues Stanley B. Gershwin Laboratory for Manufacturing and Productivity Massachusetts Institute of Technology Markov Processes

More information

TCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis

TCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis TCOM 50: Networking Theory & Fundamentals Lecture 6 February 9, 003 Prof. Yannis A. Korilis 6- Topics Time-Reversal of Markov Chains Reversibility Truncating a Reversible Markov Chain Burke s Theorem Queues

More information

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes CDA6530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic process X = {X(t), t2 T} is a collection of random variables (rvs); one rv

More information

MATH 56A: STOCHASTIC PROCESSES CHAPTER 6

MATH 56A: STOCHASTIC PROCESSES CHAPTER 6 MATH 56A: STOCHASTIC PROCESSES CHAPTER 6 6. Renewal Mathematically, renewal refers to a continuous time stochastic process with states,, 2,. N t {,, 2, 3, } so that you only have jumps from x to x + and

More information

λ λ λ In-class problems

λ λ λ In-class problems In-class problems 1. Customers arrive at a single-service facility at a Poisson rate of 40 per hour. When two or fewer customers are present, a single attendant operates the facility, and the service time

More information