CHAPTER 4. Networks of queues. 1. Open networks Suppose that we have a network of queues as given in Figure 4.1. Arrivals
|
|
- Amberly Perkins
- 5 years ago
- Views:
Transcription
1 CHAPTER 4 Networks of queues. Open networks Suppose that we have a network of queues as given in Figure 4.. Arrivals Figure 4.. An open network can occur from outside of the network to any subset of nodes. Arrivals from outside to node i are assumed to follow a Poisson process with rate γ i. There is a single server at each node with an infinite queue. The processing times at node i are assumed to be exponentially distributed with rate µ i. Routing is random, i.e. jobs departing from node i proceed to node j with probability r ij. We assume that the routing is such that all arriving jobs eventually leave the system. We first write down a set of equations that determines the arrival rate to each node i, λ i, if the system were stable: λ i = γ i + r ji λ j, i =, 2..., N, j= where N is the number of nodes (queues) in the network. This system of equations is known as the traffic equations. 37
2 38 4. NETWORKS OF QUEUES If we let the state of the system be an N-dimensional vector consisting of the number of jobs at each node, we could write the balance equations for each state. This is somewhat cumbersome, but doable. First, let ē i = (0, 0, 0,..., 0,, 0,..., 0) be an all zero vector, except for a in the ith position. Also, let n = (n, n 2,..., n n ). Suppose that all n i > 0, then the balance equation for state n is (γ i +µ i ( r ii ))p( n) = γ i p( n ē i )+ µ i r i0 p( n+ē i )+ µ j r ji p( n+ē j ē i ) i= i= i= i= j= where p( n) is the steady-state probability that there are n i jobs at node i, i =,..., N and r i0 = is the probability that a job departing node i leaves the network. In addition to this equation, there are all of the boundary states (all combinations of n i = 0) to take into account. It turns out that we have the following solution p( n) = p i (n i ) = j= r ij N p i (n i ) i= ( λ ) ( i λi µ i µ i This is a so-called product form solution - the steady-state probabilities are a product of quantities at one queue only (of course, there is dependence through the traffic equations). Note that if there are c i servers at node i, it turns out that p i (n i ) is the corresponding steady-state distribution for an M/M/c i system. This suggests that the queues are independent of each other, but that is a bit misleading. It turns out that if you take a snapshot of such a network at a particular instant of time, the number of jobs found in each queue are independent of one another, However, if you took snapshots of the network at two close time instants, you would find strong correlations between the number of jobs in the queues between those two time instants. Example. N = 3 nodes, mean processing times /µ = 0.04 seconds, /µ 2 = 0.06 seconds, /µ 3 = 0.04 seconds. From outside, jobs arrive exclusively to the first node, according to a Poisson process with rate γ = 4 jobs per second. The routing probabilities are r = 0.2, r 2 = 0.4, r 3 = 0.4, r 2 =, r 3 = 0.5. (a) Find the steady-state probability that there are exactly 4 jobs at node, exactly 3 jobs at node 2, and exactly 2 jobs at node 3. ) ni
3 We first solve the traffic equations: 2. CLOSED NETWORKS. 39 λ = λ + λ λ 3 λ 2 = 0.4λ λ 3 = 0.4λ The solution of this is λ = 20, λ 2 = 8, λ 3 = 8, from which we can compute ρ = 0.8, ρ 2 = 0.48, ρ 3 = Thus, the required probability is p((4, 3, 2)) = ( ρ )ρ 4 ( ρ 2 )ρ 3 2( ρ 3 )ρ 2 3 = (b) Find the expected number of jobs in the network: ρ ρ + ρ 2 ρ 2 + ρ 3 ρ 3 = = What is the bottleneck in this network? Here, it is the node with the highest load. A general rule of thumb is: improving the situation at the bottleneck maximizes performance improvement. For example, suppose that we can only improve one processing rate, by 0 percent, i.e. choice of µ = 27.5, µ 2 = 8.34, µ 3 = If we improve µ 3, we get L = 5.33, if we improve µ 2, we get L = 5.26 and if we improve µ we get L = Improving the non-bottleneck nodes yields negligible improvement, whereas there is a dramatic improvement if we improve the bottleneck. 2. Closed networks. Suppose that we start with M jobs in the system, none of them leave and no new jobs enter. In other words, we assume that for all i, γ i = 0 and N j= r ij =. Here, the traffic equations are λ i = r ji λ j. j= There is a problem with this set of equations. There is no unique solution. It turns out that we still have a product form solution, using any non-zero solution to the traffic equations: p( n) = G(M) N i= ( λi µ i ) ni. We need to calculate G(M). It is maybe best to see how to do this through an example. Example. N = 3 nodes, M = 3 jobs. There is a single processor at each node. The routing probabilities are r = 0.6, r 2 = 0.5, r 3 = 0.4, r 2 = 0.3, r 32 = 0.6, r 3 = 0., r 23 = 0.5. Processing times are exponentially distributed with rates µ = 0.8 per second, µ 2 = 0.6 per second, and µ 3 = 0.3 per second.
4 40 4. NETWORKS OF QUEUES (a) What is the steady-state probability that there are exactly two jobs at node two? We first solve the traffic equations: λ = 0.6λ + 0.5λ λ 3 λ 2 = 0.3λ + 0.6λ 3 λ 3 = 0.λ + 0.5λ 2 There is no unique solution, so arbitrarily set λ =. Solving for the remaining arrival rates gives λ 3 = 0.386, λ 2 = To solve for G(3), we need to calculate G(3) = n +n 2 +n 3 =3 ( 0.8 ) n ( ) n2 ( ).386 n3..3 Note that the summation is a summation over ten terms, of all possible combinations of 3 jobs over 3 nodes: (3, 0, 0), (2,, 0),.... In this case, doing the summation gives G(3) = 5.33, so p((n, n 2, n 3 )) = 5.33 The required probability is ( 0.8 ) n ( ) n2 ( ).386 n3..3 p((, 2, 0)) + p((0, 2, )) = ( ) = (b) Determine the throughput at node. This is the processing rate at node, multiplied by the probability that it is busy, i.e. µ ( (p((0, 3, 0) + p((0, 0, 3)) + p((0, 2, )) + p((0,, 2)) = BCMP Networks The furthest that we can push the product for solution is a class of networks known as BCMP networks. There are N nodes and R classes (or types) of job. For each class, we must specify routing probabilities through the network (these can be class dependent). A class can either be open (jobs enter from outside and eventually leave) or closed (jobs never leave). As discussed in class, the nodes are allowed to be one of four types: : FCFS Here, jobs are served in a first come, first served order. Multiple classes may visit a node, but in this case the service time distributions must be the same (and exponentially distributed) for all classes. The service rates may be load-dependent. 2: PS Here jobs are served using processor sharing, with each waiting job getting an equal share of capacity. Jobs of different classes may have different service requirements and the service rates (for each class) may depend on the queue length at the node. The service distributions must be so-called Coxian type (essentially a combination of exponential distributions), but only the expected value needs to be determined.
5 3. BCMP NETWORKS 4 3: IS or delay Here an infinite number of servers is available, or equivalently, each job is served by their own server. Jobs of different classes may have different service requirements and the service rates (for each class) may depend on the queue length at the node. The service distributions must be so-called Coxian type (essentially a combination of exponential distributions), but only the expected value needs to be determined. 4: LCFS-PR Here jobs are served on a last come first serve basis, with preemption (also, work done on preempted jobs is not lost). Further restrictions are the same as in the previous two cases. At this point, let me indicate that the results below depend only on the mean service times. This is why I have not discussed Coxian distributions. It will suffice at this point to note that we can approximate most distributions by a Coxian distribution and thus when the nodes are of the last 3 types, there is no practical limitation on the service time distributions. Upon leaving node i, a job of class r goes to node j and becomes a job of class s with probability r i,r;j,s. A job will leave the network with probability r i,r;0. Of course, there can only be arrivals from outside of the system for classes that are open. In this case, there are two possibilities which are allowed. The first possibility is that there is a single Poisson process with rate λ(k) where k is the total population in the network. Upon arrival to the system, a job goes to node i as a class r job with probability r 0;i,r. The second possibility is that each routing chain has its own arrival stream, with a rate that depends only on the population of that chain (which we will give by λ c (k c ), with c C, where C is the set of routing chains and k c is the population in routing chain c. For each stream, with probability r 0;i,c an arrival joins node i. For each routing chain c, we want to write an equation for the net arrival rate to node i of class r jobs. This can be written as λ i,r = λ i,r + (j,s) λ j,s r j,s;i,r. Here, λ i,r is the arrival rate of jobs from outside of the system. For closed networks it is 0; for open networks it equals λr 0;i,c (one arrival process) or λ r r 0;i,r (arrivals per chain/class). This equation has a very simple intuitive explanation. The left side is the arrival rate to (i, r), the first term on the right hand side is the arrival rate to (i, r) from outside, and the final term is the sum of the arrival rates to (i, r) from all other (node,class) pairs in the network. Using this equation, assuming the system is stable, one can calculate the throughputs for open chains λ i,r, and visit ratios for closed chains V i,r. Of course, it is not uncommon that for closed systems, the visit ratios are given directly (think of what we have done in class and that you have done in assignments).
6 42 4. NETWORKS OF QUEUES The main result is now stated (the proof is really beyond the scope of the course, but is not particularly difficult... if anybody is interested, just ask). We need a couple of definitions, to define what the state of the queueing network is. Let N i be the vector (N i,, N i,2,..., N i,r ) denote the state of node i, where N i,r gives the number of class r jobs at node i. The state of the system is the vector N = ( N, N 2,..., N N ) and the total number of jobs in the system is K. BCMP Theorem The steady-state probability distribution in a BCMP network has the following product form: P ( N = n) = N G A( n) p i ( n i ), where G is a normalizing constant (it assures that the probabilities sum to one), A( n) is a function of the external arrival processes only, and the functions p i ( n i ) are the per-node steady-state distributions. The important point of this result is that there are explicit expressions for the p functions. They are as follows (note that n i is R r= n i,r) When node i is of type FCFS, we have in the load-independent case p i ( n i ) = n i! ( R r= and in the load-dependent case ( R p i ( n i ) = n i! r= i= n i,r! V n i,r i,r ) ( ) ni, µ i ) n i,r! V n ni i,r i,r j= µ i (j) When node i is of type PS or LCFS-PR, we have in the load-independent case R ( ) ni,r Vi,r p i ( n i ) = n i!, n i,r! and in the load-dependent case p i ( n i ) = n i! R r= r= n i,r! V n i,r i,r µ i,r n i j= µ i,r (j). When node i is of type IS, we have in the load-independent case R ( ) ni,r Vi,r p i ( n i ) =, n i,r! and in the load-dependent case R p i ( n i ) = r= r= n i,r! V n i,r i,r µ i,r n i j= µ i,r (j).
7 3. BCMP NETWORKS 43 Finally, the term A( n) is determined by the arrival processes in the following manner. If all chains are closed, then A( n) =. If the arrivals depend on the total system population, then it is equal to A( n) = k j=0 λ(j), where k is the network population. If the arrivals are per chain, then A( n) = kc j=0 λ c(j), where N C is the number of routing chains and k c is the NC c= population in routing chain c. At this point, all of this notation may seem a bit much, so there will be two examples given at this point which are special cases of the BCMP theorem which are of great practical interest. Example. Single-class, load-independent open networks. Here, the arrival process is Poisson of constant rate λ (there is no load dependence for the arrivals). Also, the service rates are fixed. If the node is FCFS, PS or LCFSPR, there is only one server. Then where P ( N = n) = N p i (n i ), i= p i (n i ) = { ( ρi )ρ n i e ρ i ρn i i n i!, i, FCFS, PS, LCFSPR type, IS type, where ρ i is defined as { r R ρ i = i, λv i,r µ i FCFS type, λv i,r r R i µ i,r, IS, PS, LCFSPR type, where R i is the set of classes that require service at node i. You should be able to verify this result yourself, it is a decent exercise to get used to all of the notation. Note that A( n) has been absorbed into the definition of ρ i. This result should be somewhat intuitive. It says that the the system decomposes into M/M/ (or M/M/ ) queues with the appropriate arrival rates. Example. Closed, multi-class, load-independent BCMP networks. A lot of computer systems examples have load-independent servers, multiple customer classes (but no class changes) and fixed populations per class. Here, P ( N = n) = G N p i ( n i ), i=
8 44 4. NETWORKS OF QUEUES with p i ( n i ) = ( ) ni n i! R µi r= n i! R R r= r= n i,r! n i,r! n i,r! V i,r, ( Vi,r FCFS type, ) ni,r µ i,r, PS, LCFSPR type, ( ) ni,r Vi,r µ i,r, IS type. Note that n i = R r= n i,r. Example. Client Server System with Ethernet connection. Here we consider a client server system with a fixed number m of client workstations that are connected by an Ethernet network to a server. The server consists of a single disk and a single CPU. The Ethernet connection between the terminals and the server can be modelled as a server with the load dependent service rate µ(k) = ( N p ( N p L p ) B + S C(), k =, ) L p B + S C(k + ), k >, where C(k) = ( A(k))/A(k) is the average number of collisions per request and A(k) = ( /k) k is the probability of a successful transmission and k the number of workstations that desire the use of the network. The other parameters in the expression for µ(k) are: N p, the average number of packets generated per request, B, the network bandwidth in bits per second, S, the slot duration (in other words, the time for collision detection) and L p, the average packet length in bits. 4. Numerical Solutions for Product Form Networks For a closed, product form (i.e. closed BCMP) queueing network, we know that p( n) = G(M) f (n )f 2 (n 2 ) f n (n N ) where either f i (n i ) = ( ) ni θi of the note has state independent processing, or f i (n i ) = µ i θ n i ni k= µ i(k) and the set {θ i } is a solution to the traffic equations θ i = θ k r ki. k=
9 5. MEAN VALUE ANALYSIS 45 (Here we have assumed a single class network.) There is a difficulty in evaluating G(M), as we have G(M) = n N f i (n i ) i= and this expression does not simplify. So, for a network with M jobs and N nodes, the sum is over ( ) M + N N possibilities. For example, for 0 nodes and 25 jobs, one gets 34! = 52, 45, !9! terms. The issues here are that there are a large number of multiplications, also the summation of a large number of terms can be problematic, due to either overflow or underflow errors. There are many ways to circumvent this. We will do one, which allows the calculation of some performance measures without explicitly calculating the normalization constant. 5. Mean Value Analysis We start with a simple model, a closed, cyclic queueing network with N nodes and M jobs. The ith node has a processing rate of µ i. We can decompose the mean waiting time at node i, W i as follows. W i = µ i + µ i (mean number of jobs present upon arrival) The memoryless property is crucial here, otherwise we need to know something about the elapsed time of a job in service. We need the following key result, presented here without proof. Define W i (m) to be the mean waiting time at node i for a network with m jobs. Similarly, L i (m) is the mean number of jobs at node i for a network with m jobs. We then have W i (m) = µ i + µ i L i (m ). Now, for the entire network, if Y (m) is the throughput, then by Little s Law Y (m) W i (m) = m. i= For each node, Little s Law also yields Y (m)w i (m) = L i (m). Putting these all together yields the basic MVA algorithm: () L i (0) = 0, i =, 2,..., N
10 46 4. NETWORKS OF QUEUES (2) W i (m) = µ i + µ i L i (m ), i =, 2,..., N (3) Y (m) = m/ N i= W i(m) (4) L i (m) = Y (m)w i (m), i =, 2,..., N Steps 2-4 are repeated for m =, 2,..., M. Example. We look at the network in Figure 4.2. Figure 4.2. Example for basic MVA. L i (0) = 0, i =, 2, 3 2. W () = 0.5, W 2 () = 0.333, W 3 () = Y () = /( ) =.0 4. L () = (.0)(0.500) = 0.500, L 2 () = (.0)(0.333) = 0.333, L 3 () = (.0)(0.66) = W (2) = (0.500)(0.500) = 0.750, W 2 (2) = (0.333)(0.333) = 0.444, W 3 (2) = (0.66)(0.66) = Y (2) = 2/( ) = L (2) = (.44)(0.75) =.08, L 2 (2) = (.44)(0.444) = 0.639, L 3 (2) = (.44)(0.94) = W (3) = (0.500)(.08) =.04, W 2 (3) = (0.333)(0.639) = 0.546, W 3 (3) = (0.66)(0.279) = Y (3) = 3/( ) = L (3) = (.67)(.04) =.74, L 2 (3) = (.67)(0.546) = 0.92, L 3 (3) = (.67)(0.22) = W (4) = (0.500)(.74) =.37, W 2 (4) = (0.333)(0.92) = 0.637, W 3 (4) = (0.66)(0.354) = Y (4) = 4/( ) = L (4) = (.79)(.37) = 2.45, L 2 (4) = (.79)(0.637) =.4, L 3 (4) = (.79)(0.225) = 0.40 There are several ways to generalize this. One is of particular interest, but we will defer this for a bit, as it requires some concepts to be introduced first. We would like to see how much we can get from just knowing averages (from data). This leads us to study what is known as operational analysis. 6. Operational Analysis Operational analysis is the use of a number of laws that various averages satisfy. These can often be used to make very quick calculations of various performance measures. Suppose that we have the following data: T, the length of a time interval over which observations are made, A i, the number
11 6. OPERATIONAL ANALYSIS 47 of arrivals to device i, C i, the number of completions at device i and B i, the amount of time that device i was busy. From these we can quickly derive the following quantities: () Arrival rate at device i - λ i = A i /T (2) Throughput at device i - X i = C i /T (3) Utilization of device i - U i = B i /T (4) Average processing time at device i - S i = B i /C i We can also derive the following laws. Utilization Law. U i = X i S i. This follows from B i T = C i B i. T C i Forced Flow Law. Suppose that A i = C i (or at least approximately). Let V i be the visit ratio to device i. i.e. the average number of visits to node i for every visit to a reference device (device 0), where V 0 =, by definition. So, we have C i = C 0 V i which implies V i = C i. C 0 So, if the system throughput is measured at node 0, then the throughput of node i is X i = C i T = C i C 0 C 0 T = V ix. Now, we can combine the Utilization Law and the Forced Flow Law to get U i = X i S i = XV i S i = XD i, where D i = V i S i is the total processing demand on device i for all visits of a job. So, the bottleneck is equivalently the device with highest D i. Little s Law. Q i = X i R i. This has already been shown, where Q i is the average number of jobs at device i and R i is the average response time at device i. The General Response Time Law refers to the system in Figure 4.3. Inside the box, we have an average number of jobs Q satisfying Figure 4.3. Network for General Response Time Law
12 48 4. NETWORKS OF QUEUES Q = XR = Q + Q Q N XR = X R + X 2 R X N R N R = V R + V 2 R V N R N = V i R i. i= Next, we have the Interactive Response Time Law. The total average cycle time of a client request is R + Z. So, each client generates T/(R + Z) requests, on average, in time T. So, X = = N(T/(R + Z)) T N R + Z R = N X Z Finally, we can get bounds on performance by doing a Bottleneck Analysis. Let D = D + D D N be the average total demandand D max be the bottleneck device demand. The main bounds that we have are, with M clients X(M) min { D max, } M D + Z R(M) max{d, MD max Z} It is straightforward to prove these. First, at the bottleneck, U max = XD max or X. D max Also, R() = D + D D n = D which implies R(N) D. Finally, from the Interactive Response Time Law R(M) = X(M) = M X(M) Z MD max Z M R(M) + Z M D + Z Example. Suppose we have the system in Figure 4.4. Suppose D a = 2 seconds, D b = 3 seconds, D c = second, Z = 30 seconds. Then we can use the bottleneck analysis bounds to derive the curves in Figures 4.5 and 4.6. The dotted lines are the bounds given by the bottleneck analysis. The solid line is the actual value (we can determine this by MVA, see the next section). Note that the breakpoint for both of the curves is the same, this
13 6. OPERATIONAL ANALYSIS 49 Figure 4.4. Network for Operational Analysis Example Figure 4.5. Bounds on throughput Figure 4.6. Bounds on response time value is often known as the number of clients that the system can support. Below this number, performance scales well, above this number, performance degrades considerably. Suppose that we had the choice to allow D a, D b, D c to be any (nonnegative) values that add to six. What would be a good choice? If we let D a = D b = D c = 2, we get a balanced load on each device, and the maximum number of supported clients becomes 8. In Figures 4.5 and 4.6, the dotted lines were easy to get. To obtain the solid lines, we need to do a little more work - generalize the MVA algorithm. If we are interested in the system in Figure 4.3, we first convert it to a system of the of the form of that in Figure 4.4, by replacing each node through N by a node with visit ratio but average processing time D i. Note that
14 50 4. NETWORKS OF QUEUES this preserves the demand at each node. Now, the MVA algorithm simply becomes () L i (0) = 0, i = 0,, 2,..., N (2) W i (m) = D i + D i L i (m ), i =, 2,..., N (3) Y (m) = m/(z + N i= W i(m)) (4) L i (m) = Y (m)w i (m), i =, 2,..., N, L 0 (m) = Y (m)z. Suppose that we have a system that we cannot analyze using any of the techniques to this point. A possibility is to simulate the system, which is the subject of the next chapter.
Buzen s algorithm. Cyclic network Extension of Jackson networks
Outline Buzen s algorithm Mean value analysis for Jackson networks Cyclic network Extension of Jackson networks BCMP network 1 Marginal Distributions based on Buzen s algorithm With Buzen s algorithm,
More informationIntro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin
Queuing Networks Florence Perronnin Polytech Grenoble - UGA March 23, 27 F. Perronnin (UGA) Queuing Networks March 23, 27 / 46 Outline Introduction to Queuing Networks 2 Refresher: M/M/ queue 3 Reversibility
More informationCOMP9334: Capacity Planning of Computer Systems and Networks
COMP9334: Capacity Planning of Computer Systems and Networks Week 2: Operational analysis Lecturer: Prof. Sanjay Jha NETWORKS RESEARCH GROUP, CSE, UNSW Operational analysis Operational: Collect performance
More informationConvolution Algorithm
Convolution Algorithm Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 Jain@cse.wustl.edu Audio/Video recordings of this lecture are available at: http://www.cse.wustl.edu/~jain/cse567-08/
More informationPerformance Evaluation of Queuing Systems
Performance Evaluation of Queuing Systems Introduction to Queuing Systems System Performance Measures & Little s Law Equilibrium Solution of Birth-Death Processes Analysis of Single-Station Queuing Systems
More informationIntroduction to Markov Chains, Queuing Theory, and Network Performance
Introduction to Markov Chains, Queuing Theory, and Network Performance Marceau Coupechoux Telecom ParisTech, departement Informatique et Réseaux marceau.coupechoux@telecom-paristech.fr IT.2403 Modélisation
More informationQueueing Networks and Insensitivity
Lukáš Adam 29. 10. 2012 1 / 40 Table of contents 1 Jackson networks 2 Insensitivity in Erlang s Loss System 3 Quasi-Reversibility and Single-Node Symmetric Queues 4 Quasi-Reversibility in Networks 5 The
More informationAnalysis of Software Artifacts
Analysis of Software Artifacts System Performance I Shu-Ngai Yeung (with edits by Jeannette Wing) Department of Statistics Carnegie Mellon University Pittsburgh, PA 15213 2001 by Carnegie Mellon University
More informationOperational Laws Raj Jain
Operational Laws 33-1 Overview What is an Operational Law? 1. Utilization Law 2. Forced Flow Law 3. Little s Law 4. General Response Time Law 5. Interactive Response Time Law 6. Bottleneck Analysis 33-2
More informationQueuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe
Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem Wade Trappe Lecture Overview Network of Queues Introduction Queues in Tandem roduct Form Solutions Burke s Theorem What
More informationLink Models for Circuit Switching
Link Models for Circuit Switching The basis of traffic engineering for telecommunication networks is the Erlang loss function. It basically allows us to determine the amount of telephone traffic that can
More information6 Solving Queueing Models
6 Solving Queueing Models 6.1 Introduction In this note we look at the solution of systems of queues, starting with simple isolated queues. The benefits of using predefined, easily classified queues will
More informationQueueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "
Queueing Theory I Summary Little s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K " Little s Law a(t): the process that counts the number of arrivals
More informationQueueing Networks G. Rubino INRIA / IRISA, Rennes, France
Queueing Networks G. Rubino INRIA / IRISA, Rennes, France February 2006 Index 1. Open nets: Basic Jackson result 2 2. Open nets: Internet performance evaluation 18 3. Closed nets: Basic Gordon-Newell result
More informationOperational Laws 33-1
Operational Laws Raj Jain Washington University in Saint Louis Jain@eecs.berkeley.edu or Jain@wustl.edu A Mini-Course offered at UC Berkeley, Sept-Oct 2012 These slides and audio/video recordings are available
More informationA Simple Solution for the M/D/c Waiting Time Distribution
A Simple Solution for the M/D/c Waiting Time Distribution G.J.Franx, Universiteit van Amsterdam November 6, 998 Abstract A surprisingly simple and explicit expression for the waiting time distribution
More informationQueuing Networks. - Outline of queuing networks. - Mean Value Analisys (MVA) for open and closed queuing networks
Queuing Networks - Outline of queuing networks - Mean Value Analisys (MVA) for open and closed queuing networks 1 incoming requests Open queuing networks DISK CPU CD outgoing requests Closed queuing networks
More informationSolutions to Homework Discrete Stochastic Processes MIT, Spring 2011
Exercise 6.5: Solutions to Homework 0 6.262 Discrete Stochastic Processes MIT, Spring 20 Consider the Markov process illustrated below. The transitions are labelled by the rate q ij at which those transitions
More informationIntroduction to Queueing Theory
Introduction to Queueing Theory Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 Jain@cse.wustl.edu Audio/Video recordings of this lecture are available at: http://www.cse.wustl.edu/~jain/cse567-11/
More informationCSM: Operational Analysis
CSM: Operational Analysis 2016-17 Computer Science Tripos Part II Computer Systems Modelling: Operational Analysis by Ian Leslie Richard Gibbens, Ian Leslie Operational Analysis Based on the idea of observation
More information15 Closed production networks
5 Closed production networks In the previous chapter we developed and analyzed stochastic models for production networks with a free inflow of jobs. In this chapter we will study production networks for
More informationIntroduction to Queueing Theory
Introduction to Queueing Theory Raj Jain Washington University in Saint Louis Jain@eecs.berkeley.edu or Jain@wustl.edu A Mini-Course offered at UC Berkeley, Sept-Oct 2012 These slides and audio/video recordings
More information15 Closed production networks
5 Closed production networks In the previous chapter we developed and analyzed stochastic models for production networks with a free inflow of jobs. In this chapter we will study production networks for
More informationrequests/sec. The total channel load is requests/sec. Using slot as the time unit, the total channel load is 50 ( ) = 1
Prof. X. Shen E&CE 70 : Examples #2 Problem Consider the following Aloha systems. (a) A group of N users share a 56 kbps pure Aloha channel. Each user generates at a Passion rate of one 000-bit packet
More informationQueueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1
Queueing systems Renato Lo Cigno Simulation and Performance Evaluation 2014-15 Queueing systems - Renato Lo Cigno 1 Queues A Birth-Death process is well modeled by a queue Indeed queues can be used to
More informationIntroduction to Queueing Theory
Introduction to Queueing Theory Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 Jain@cse.wustl.edu Audio/Video recordings of this lecture are available at: 30-1 Overview Queueing Notation
More informationGI/M/1 and GI/M/m queuing systems
GI/M/1 and GI/M/m queuing systems Dmitri A. Moltchanov moltchan@cs.tut.fi http://www.cs.tut.fi/kurssit/tlt-2716/ OUTLINE: GI/M/1 queuing system; Methods of analysis; Imbedded Markov chain approach; Waiting
More informationLecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking
Lecture 7: Simulation of Markov Processes Pasi Lassila Department of Communications and Networking Contents Markov processes theory recap Elementary queuing models for data networks Simulation of Markov
More informationBIRTH DEATH PROCESSES AND QUEUEING SYSTEMS
BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS Andrea Bobbio Anno Accademico 999-2000 Queueing Systems 2 Notation for Queueing Systems /λ mean time between arrivals S = /µ ρ = λ/µ N mean service time traffic
More informationChapter 2 Queueing Theory and Simulation
Chapter 2 Queueing Theory and Simulation Based on the slides of Dr. Dharma P. Agrawal, University of Cincinnati and Dr. Hiroyuki Ohsaki Graduate School of Information Science & Technology, Osaka University,
More informationOperational Laws. Operational Laws. Overview. Operational Quantities
Operational Laws Raj Jain Washington University in Saint Louis Jain@eecs.berkeley.edu or Jain@wustl.edu Mini-Course offered at UC erkeley, Sept-Oct 2012 These slides and audio/video recordings are available
More informationLink Models for Packet Switching
Link Models for Packet Switching To begin our study of the performance of communications networks, we will study a model of a single link in a message switched network. The important feature of this model
More informationCDA5530: Performance Models of Computers and Networks. Chapter 4: Elementary Queuing Theory
CDA5530: Performance Models of Computers and Networks Chapter 4: Elementary Queuing Theory Definition Queuing system: a buffer (waiting room), service facility (one or more servers) a scheduling policy
More informationIntroduction to queuing theory
Introduction to queuing theory Claude Rigault ENST claude.rigault@enst.fr Introduction to Queuing theory 1 Outline The problem The number of clients in a system The client process Delay processes Loss
More informationQueues and Queueing Networks
Queues and Queueing Networks Sanjay K. Bose Dept. of EEE, IITG Copyright 2015, Sanjay K. Bose 1 Introduction to Queueing Models and Queueing Analysis Copyright 2015, Sanjay K. Bose 2 Model of a Queue Arrivals
More informationContents Preface The Exponential Distribution and the Poisson Process Introduction to Renewal Theory
Contents Preface... v 1 The Exponential Distribution and the Poisson Process... 1 1.1 Introduction... 1 1.2 The Density, the Distribution, the Tail, and the Hazard Functions... 2 1.2.1 The Hazard Function
More informationChapter 10. Queuing Systems. D (Queuing Theory) Queuing theory is the branch of operations research concerned with waiting lines.
Chapter 10 Queuing Systems D. 10. 1. (Queuing Theory) Queuing theory is the branch of operations research concerned with waiting lines. D. 10.. (Queuing System) A ueuing system consists of 1. a user source.
More informationLecture 20: Reversible Processes and Queues
Lecture 20: Reversible Processes and Queues 1 Examples of reversible processes 11 Birth-death processes We define two non-negative sequences birth and death rates denoted by {λ n : n N 0 } and {µ n : n
More informationNATCOR: Stochastic Modelling
NATCOR: Stochastic Modelling Queueing Theory II Chris Kirkbride Management Science 2017 Overview of Today s Sessions I Introduction to Queueing Modelling II Multiclass Queueing Models III Queueing Control
More informationGlossary availability cellular manufacturing closed queueing network coefficient of variation (CV) conditional probability CONWIP
Glossary availability The long-run average fraction of time that the processor is available for processing jobs, denoted by a (p. 113). cellular manufacturing The concept of organizing the factory into
More informationHITTING TIME IN AN ERLANG LOSS SYSTEM
Probability in the Engineering and Informational Sciences, 16, 2002, 167 184+ Printed in the U+S+A+ HITTING TIME IN AN ERLANG LOSS SYSTEM SHELDON M. ROSS Department of Industrial Engineering and Operations
More informationPerformance analysis of queueing systems with resequencing
UNIVERSITÀ DEGLI STUDI DI SALERNO Dipartimento di Matematica Dottorato di Ricerca in Matematica XIV ciclo - Nuova serie Performance analysis of queueing systems with resequencing Candidato: Caraccio Ilaria
More informationCS418 Operating Systems
CS418 Operating Systems Lecture 14 Queuing Analysis Textbook: Operating Systems by William Stallings 1 1. Why Queuing Analysis? If the system environment changes (like the number of users is doubled),
More informationNon Markovian Queues (contd.)
MODULE 7: RENEWAL PROCESSES 29 Lecture 5 Non Markovian Queues (contd) For the case where the service time is constant, V ar(b) = 0, then the P-K formula for M/D/ queue reduces to L s = ρ + ρ 2 2( ρ) where
More informationQueueing Theory and Simulation. Introduction
Queueing Theory and Simulation Based on the slides of Dr. Dharma P. Agrawal, University of Cincinnati and Dr. Hiroyuki Ohsaki Graduate School of Information Science & Technology, Osaka University, Japan
More informationExercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010
Exercises Stochastic Performance Modelling Hamilton Institute, Summer Instruction Exercise Let X be a non-negative random variable with E[X ]
More informationCOMP9334 Capacity Planning for Computer Systems and Networks
COMP9334 Capacity Planning for Computer Systems and Networks Week 2: Operational Analysis and Workload Characterisation COMP9334 1 Last lecture Modelling of computer systems using Queueing Networks Open
More informationMarkov Chain Model for ALOHA protocol
Markov Chain Model for ALOHA protocol Laila Daniel and Krishnan Narayanan April 22, 2012 Outline of the talk A Markov chain (MC) model for Slotted ALOHA Basic properties of Discrete-time Markov Chain Stability
More informationComputer Networks More general queuing systems
Computer Networks More general queuing systems Saad Mneimneh Computer Science Hunter College of CUNY New York M/G/ Introduction We now consider a queuing system where the customer service times have a
More information16:330:543 Communication Networks I Midterm Exam November 7, 2005
l l l l l l l l 1 3 np n = ρ 1 ρ = λ µ λ. n= T = E[N] = 1 λ µ λ = 1 µ 1. 16:33:543 Communication Networks I Midterm Exam November 7, 5 You have 16 minutes to complete this four problem exam. If you know
More informationData analysis and stochastic modeling
Data analysis and stochastic modeling Lecture 7 An introduction to queueing theory Guillaume Gravier guillaume.gravier@irisa.fr with a lot of help from Paul Jensen s course http://www.me.utexas.edu/ jensen/ormm/instruction/powerpoint/or_models_09/14_queuing.ppt
More informationPart I Stochastic variables and Markov chains
Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)
More informationCPSC 531: System Modeling and Simulation. Carey Williamson Department of Computer Science University of Calgary Fall 2017
CPSC 531: System Modeling and Simulation Carey Williamson Department of Computer Science University of Calgary Fall 2017 Motivating Quote for Queueing Models Good things come to those who wait - poet/writer
More informationλ λ λ In-class problems
In-class problems 1. Customers arrive at a single-service facility at a Poisson rate of 40 per hour. When two or fewer customers are present, a single attendant operates the facility, and the service time
More informationElementary queueing system
Elementary queueing system Kendall notation Little s Law PASTA theorem Basics of M/M/1 queue M/M/1 with preemptive-resume priority M/M/1 with non-preemptive priority 1 History of queueing theory An old
More informationComputer Systems Modelling
Computer Systems Modelling Computer Laboratory Computer Science Tripos, Part II Michaelmas Term 2003 R. J. Gibbens Problem sheet William Gates Building JJ Thomson Avenue Cambridge CB3 0FD http://www.cl.cam.ac.uk/
More informationreversed chain is ergodic and has the same equilibrium probabilities (check that π j =
Lecture 10 Networks of queues In this lecture we shall finally get around to consider what happens when queues are part of networks (which, after all, is the topic of the course). Firstly we shall need
More informationChapter 5. Continuous-Time Markov Chains. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan
Chapter 5. Continuous-Time Markov Chains Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Continuous-Time Markov Chains Consider a continuous-time stochastic process
More informationChapter 5. Elementary Performance Analysis
Chapter 5 Elementary Performance Analysis 1 5.0 2 5.1 Ref: Mischa Schwartz Telecommunication Networks Addison-Wesley publishing company 1988 3 4 p t T m T P(k)= 5 6 5.2 : arrived rate : service rate 7
More informationOperations Research II, IEOR161 University of California, Berkeley Spring 2007 Final Exam. Name: Student ID:
Operations Research II, IEOR161 University of California, Berkeley Spring 2007 Final Exam 1 2 3 4 5 6 7 8 9 10 7 questions. 1. [5+5] Let X and Y be independent exponential random variables where X has
More informationKendall notation. PASTA theorem Basics of M/M/1 queue
Elementary queueing system Kendall notation Little s Law PASTA theorem Basics of M/M/1 queue 1 History of queueing theory An old research area Started in 1909, by Agner Erlang (to model the Copenhagen
More informationDynamic resource sharing
J. Virtamo 38.34 Teletraffic Theory / Dynamic resource sharing and balanced fairness Dynamic resource sharing In previous lectures we have studied different notions of fair resource sharing. Our focus
More informationStatistics 150: Spring 2007
Statistics 150: Spring 2007 April 23, 2008 0-1 1 Limiting Probabilities If the discrete-time Markov chain with transition probabilities p ij is irreducible and positive recurrent; then the limiting probabilities
More informationA Study on Performance Analysis of Queuing System with Multiple Heterogeneous Servers
UNIVERSITY OF OKLAHOMA GENERAL EXAM REPORT A Study on Performance Analysis of Queuing System with Multiple Heterogeneous Servers Prepared by HUSNU SANER NARMAN husnu@ou.edu based on the papers 1) F. S.
More informationSession-Based Queueing Systems
Session-Based Queueing Systems Modelling, Simulation, and Approximation Jeroen Horters Supervisor VU: Sandjai Bhulai Executive Summary Companies often offer services that require multiple steps on the
More informationReadings: Finish Section 5.2
LECTURE 19 Readings: Finish Section 5.2 Lecture outline Markov Processes I Checkout counter example. Markov process: definition. -step transition probabilities. Classification of states. Example: Checkout
More informationMarkov Processes and Queues
MIT 2.853/2.854 Introduction to Manufacturing Systems Markov Processes and Queues Stanley B. Gershwin Laboratory for Manufacturing and Productivity Massachusetts Institute of Technology Markov Processes
More informationM/G/1 and M/G/1/K systems
M/G/1 and M/G/1/K systems Dmitri A. Moltchanov dmitri.moltchanov@tut.fi http://www.cs.tut.fi/kurssit/elt-53606/ OUTLINE: Description of M/G/1 system; Methods of analysis; Residual life approach; Imbedded
More informationQUEUING MODELS AND MARKOV PROCESSES
QUEUING MODELS AND MARKOV ROCESSES Queues form when customer demand for a service cannot be met immediately. They occur because of fluctuations in demand levels so that models of queuing are intrinsically
More informationScheduling I. Today. Next Time. ! Introduction to scheduling! Classical algorithms. ! Advanced topics on scheduling
Scheduling I Today! Introduction to scheduling! Classical algorithms Next Time! Advanced topics on scheduling Scheduling out there! You are the manager of a supermarket (ok, things don t always turn out
More informationA TANDEM QUEUEING SYSTEM WITH APPLICATIONS TO PRICING STRATEGY. Wai-Ki Ching. Tang Li. Sin-Man Choi. Issic K.C. Leung
Manuscript submitted to AIMS Journals Volume X, Number 0X, XX 00X Website: http://aimsciences.org pp. X XX A TANDEM QUEUEING SYSTEM WITH APPLICATIONS TO PRICING STRATEGY WAI-KI CHING SIN-MAN CHOI TANG
More informationTCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis
TCOM 50: Networking Theory & Fundamentals Lecture 6 February 9, 003 Prof. Yannis A. Korilis 6- Topics Time-Reversal of Markov Chains Reversibility Truncating a Reversible Markov Chain Burke s Theorem Queues
More informationQUEUING SYSTEM. Yetunde Folajimi, PhD
QUEUING SYSTEM Yetunde Folajimi, PhD Part 2 Queuing Models Queueing models are constructed so that queue lengths and waiting times can be predicted They help us to understand and quantify the effect of
More informationOutline. Finite source queue M/M/c//K Queues with impatience (balking, reneging, jockeying, retrial) Transient behavior Advanced Queue.
Outline Finite source queue M/M/c//K Queues with impatience (balking, reneging, jockeying, retrial) Transient behavior Advanced Queue Batch queue Bulk input queue M [X] /M/1 Bulk service queue M/M [Y]
More informationChapter 3 Balance equations, birth-death processes, continuous Markov Chains
Chapter 3 Balance equations, birth-death processes, continuous Markov Chains Ioannis Glaropoulos November 4, 2012 1 Exercise 3.2 Consider a birth-death process with 3 states, where the transition rate
More information5/15/18. Operations Research: An Introduction Hamdy A. Taha. Copyright 2011, 2007 by Pearson Education, Inc. All rights reserved.
The objective of queuing analysis is to offer a reasonably satisfactory service to waiting customers. Unlike the other tools of OR, queuing theory is not an optimization technique. Rather, it determines
More informationCS 798: Homework Assignment 3 (Queueing Theory)
1.0 Little s law Assigned: October 6, 009 Patients arriving to the emergency room at the Grand River Hospital have a mean waiting time of three hours. It has been found that, averaged over the period of
More informationCover Page. The handle holds various files of this Leiden University dissertation
Cover Page The handle http://hdl.handle.net/1887/39637 holds various files of this Leiden University dissertation Author: Smit, Laurens Title: Steady-state analysis of large scale systems : the successive
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.262 Discrete Stochastic Processes Midterm Quiz April 6, 2010 There are 5 questions, each with several parts.
More information57:022 Principles of Design II Final Exam Solutions - Spring 1997
57:022 Principles of Design II Final Exam Solutions - Spring 1997 Part: I II III IV V VI Total Possible Pts: 52 10 12 16 13 12 115 PART ONE Indicate "+" if True and "o" if False: + a. If a component's
More informationA Generalized Processor Sharing Approach to Flow Control in Integrated Services Networks: The Single Node Case. 1
A Generalized Processor Sharing Approach to Flow Control in Integrated Services Networks: The Single Node Case 1 Abhay K Parekh 2 3 and Robert G Gallager 4 Laboratory for Information and Decision Systems
More informationIntroduction to queuing theory
Introduction to queuing theory Queu(e)ing theory Queu(e)ing theory is the branch of mathematics devoted to how objects (packets in a network, people in a bank, processes in a CPU etc etc) join and leave
More informationQueueing Systems: Lecture 3. Amedeo R. Odoni October 18, Announcements
Queueing Systems: Lecture 3 Amedeo R. Odoni October 18, 006 Announcements PS #3 due tomorrow by 3 PM Office hours Odoni: Wed, 10/18, :30-4:30; next week: Tue, 10/4 Quiz #1: October 5, open book, in class;
More informationThis lecture is expanded from:
This lecture is expanded from: HIGH VOLUME JOB SHOP SCHEDULING AND MULTICLASS QUEUING NETWORKS WITH INFINITE VIRTUAL BUFFERS INFORMS, MIAMI Nov 2, 2001 Gideon Weiss Haifa University (visiting MS&E, Stanford)
More informationChe-Wei Chang Department of Computer Science and Information Engineering, Chang Gung University
Che-Wei Chang chewei@mail.cgu.edu.tw Department of Computer Science and Information Engineering, Chang Gung University } 2017/11/15 Midterm } 2017/11/22 Final Project Announcement 2 1. Introduction 2.
More informationQueuing Theory. Using the Math. Management Science
Queuing Theory Using the Math 1 Markov Processes (Chains) A process consisting of a countable sequence of stages, that can be judged at each stage to fall into future states independent of how the process
More informationQueueing Review. Christos Alexopoulos and Dave Goldsman 10/6/16. (mostly from BCNN) Georgia Institute of Technology, Atlanta, GA, USA
1 / 24 Queueing Review (mostly from BCNN) Christos Alexopoulos and Dave Goldsman Georgia Institute of Technology, Atlanta, GA, USA 10/6/16 2 / 24 Outline 1 Introduction 2 Queueing Notation 3 Transient
More information11 The M/G/1 system with priorities
11 The M/G/1 system with priorities In this chapter we analyse queueing models with different types of customers, where one or more types of customers have priority over other types. More precisely we
More informationAnalysis of A Single Queue
Analysis of A Single Queue Raj Jain Washington University in Saint Louis Jain@eecs.berkeley.edu or Jain@wustl.edu A Mini-Course offered at UC Berkeley, Sept-Oct 2012 These slides and audio/video recordings
More informationQueueing Review. Christos Alexopoulos and Dave Goldsman 10/25/17. (mostly from BCNN) Georgia Institute of Technology, Atlanta, GA, USA
1 / 26 Queueing Review (mostly from BCNN) Christos Alexopoulos and Dave Goldsman Georgia Institute of Technology, Atlanta, GA, USA 10/25/17 2 / 26 Outline 1 Introduction 2 Queueing Notation 3 Transient
More informationMassachusetts Institute of Technology
.203J/6.28J/3.665J/5.073J/6.76J/ESD.26J Quiz Solutions (a)(i) Without loss of generality we can pin down X at any fixed point. X 2 is still uniformly distributed over the square. Assuming that the police
More informationPart II: continuous time Markov chain (CTMC)
Part II: continuous time Markov chain (CTMC) Continuous time discrete state Markov process Definition (Markovian property) X(t) is a CTMC, if for any n and any sequence t 1
More informationUNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours.
UNIVERSITY OF YORK MSc Examinations 2004 MATHEMATICS Networks Time Allowed: 3 hours. Answer 4 questions. Standard calculators will be provided but should be unnecessary. 1 Turn over 2 continued on next
More informationMITOCW MIT6_041F11_lec17_300k.mp4
MITOCW MIT6_041F11_lec17_300k.mp4 The following content is provided under a Creative Commons license. Your support will help MIT OpenCourseWare continue to offer high-quality, educational resources for
More informationMultiaccess Problem. How to let distributed users (efficiently) share a single broadcast channel? How to form a queue for distributed users?
Multiaccess Problem How to let distributed users (efficiently) share a single broadcast channel? How to form a queue for distributed users? z The protocols we used to solve this multiaccess problem are
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.262 Discrete Stochastic Processes Midterm Quiz April 6, 2010 There are 5 questions, each with several parts.
More informationSandwich shop : a queuing net work with finite disposable resources queue and infinite resources queue
Sandwich shop : a queuing net work with finite disposable resources queue and infinite resources queue Final project for ISYE 680: Queuing systems and Applications Hongtan Sun May 5, 05 Introduction As
More informationStochastic Models in Computer Science A Tutorial
Stochastic Models in Computer Science A Tutorial Dr. Snehanshu Saha Department of Computer Science PESIT BSC, Bengaluru WCI 2015 - August 10 to August 13 1 Introduction 2 Random Variable 3 Introduction
More informationIntroduction to Queuing Networks Solutions to Problem Sheet 3
Introduction to Queuing Networks Solutions to Problem Sheet 3 1. (a) The state space is the whole numbers {, 1, 2,...}. The transition rates are q i,i+1 λ for all i and q i, for all i 1 since, when a bus
More informationNetworks of Queues Models with Several. Classes of Customers and Exponential. Service Times
Applied Mathematical Sciences, Vol. 9, 2015, no. 76, 3789-3796 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2015.53287 Networks of Queues Models with Several Classes of Customers and Exponential
More information