G-networks with synchronized partial ushing. PRi SM, Universite de Versailles, 45 av. des Etats Unis, Versailles Cedex,France

Size: px
Start display at page:

Download "G-networks with synchronized partial ushing. PRi SM, Universite de Versailles, 45 av. des Etats Unis, Versailles Cedex,France"

Transcription

1 G-networks with synchronized partial ushing Jean-Michel FOURNEAU ;a, Dominique VERCH ERE a;b a PRi SM, Universite de Versailles, 45 av. des Etats Unis, Versailles Cedex,France b CERMSEM, Universite Pantheon-Sorbonne, 90 rue de Tolbiac, Paris, France Abstract We study generalized networks of queues with a new type of signals which deletes customers in an ordered circular list of queues. By solving the balance equations, we prove that the steady-state distribution of the queue sizes has a product form. This model could be used to analyse assembly line systems and polling mechanisms. Keywords : Queueing networks; Product form solution; Synchronised transitions. 1 Introduction We present a new type of generalized network of queues (G-networks for short) with a steadystate product form solution. G-networks have been dened by Gelenbe in [4] and have received since this seminal paper a lot of attention (see for instance [7,, 9, 11]). G-networks consist of queues, ordinary customers and signals. Signals interact with the queues at their arrival but they are never queued and they do not receive service. At the completion of their service, a customer may join another queue as a signal. Thus G-networks exhibit much more general synchronized transitions than the Jackson networks. A lot of interactions due to signal have been studied and shown to preserve a product form solution. The rst eect, studied by Gelenbe, was the destruction of a customer [4]. Then, in [6] the product form was generalized to networks where a signal trigger a customer movement to a third queue. Several extensions have been studied; some of them are related to this work and are mentioned here. Signals which implies a batch destruction have been independently studied by Gelenbe [5] and Henderson & al. [10]. If the batch size is innite, a signal ushes out, with probability 1, the queue it enters. This eect has been studied in [1]. A generalization to networks with multiple classes of customer, one type of signal and Processor-Sharing discipline appeared in [1]. In this paper, we present a new eect of signal such that the steady-state distribution still has a product form. The signals try to ush every queue in an ordered list, deleting one customer at a time for all the queues. And it stops the deletion as soon as it visits an empty queue. This eect is denoted as a synchronized partial ushing. The paper is organized as follows. In the next section we present the model and prove the product form solution in section. Examples and links to related works are presented in section 4. Corresponding author 1

2 Markovian network with synchronized partial ushing The model consists of an open G-network with N single server queues a single class of customers and two types of signals. At its arrival to an empty queue, a signal of type 1 or will have no eect and will just disappear. The behavior of type 1 signal is usual. At its arrival in an non-empty queue i f1; ; ; N g, it triggers a customer movement from queue i to some other queue j f1; ; ; N g with probability Q ij. Type signals are associated to synchronized partial ushing which are formally described in the following. The set of queues is partitioned into A subsets. It is assumed that the queues in each subset are ordered into a rooted directed cycle denoted as C a where a is the index of the subset. These rooted directed cycles are the fundamental structures used to describe the eect of the new type of signal we study. The root of C a is a queue whose index is denoted as c(a; 1). The length of the cycle (or the size of the subset) is denoted as L a. The queues in C a are numbered from c(a; 1) (i.e. the root) to c(a; L a ) according to the ordering of the cycle. The structure of a rooted directed cycle is used to emphasis that type signals will enter at the root and will loop inside the directed cycle. If the subset is a singleton, then we consider that the cycle has length 1 and consists of a directed loop on the queue. The external arrivals to the queues of this G-network follow independent Poisson processes. The external arrivals of customers to queue i is denoted by i and? i for signals of type 1. Without loss of generality we assume that there no external arrivals of type signals. Customers at queue i request a negative exponentially distributed service time with mean 1 i. Once emitted from queue i, a customer will be transferred as a customer to queue j f1; ; ; N g with probability P? i;j, as a type 1 signal to another queue j f1; ; ; N g with probability P, will i;j leave the system with probability d i or will join as a type signal the root of a subset of queues C a with probability R i;a. These transition probabilities satisfy : P i;j N X P? i;j A X a=1 R i;a d i = 1 and Q i;j = 1 8 i (1) Note that the partition of the set of queues is only used to describe the eect of type signals. The matrices P and P?, which model the routing of customers and type 1 signals do not necessarily satisfy the same constraints. Let ~n(t) be the state vector of the G-network at time t, and ~n = (n 1 ; n ; ; n N ) be one value of queue lengths. Let p(~n) denote the stationary probability distribution i.e. p(~n) = lim t!1 P r (~n (t) = ~n). Whenever a signal of type arrives at queue c(a; 1), it deletes a customer in this queue and it goes immediately to the next queue in cycle C a, says c(a; ). If queue c(a; ) contains some customers then it deletes a customer in c(a; ) and goes to the next queue in C a. The signal loops inside the cycle C a until it reaches an empty queue where it vanishes. All these deletions and movements are instantaneous. Roughly, a type signal deletes the same number of customers in all the queues of the cycle. And this number is the size of the smallest queue in the cycle C a. More precisely, the number of deleted customers are not always equal, because the signal visits the directed cycle beginning with the root. Consider an arbitrary directed cycle C a, and let be the smallest index of queue in C a such that : n (t) = min ica n i (t). Assume that a type signal enters the root of cycle C a at time t, then at time t we have : 8 >< >: 1 i < n i (t ) = n i (t)? n (t)? 1 n (t ) = 0 n i (t ) = n i (t)? n (t) < i L a ()

3 Queue is ushed while the other queues are only partially emptied. These deletions are synchronized. It may be worthy to remark that if the partition of the set of queues consists only of singletons, then type signals have exactly the same eect as the one considered by Chao in [1]. With more general partitions, the synchronized transitions are much more complex. However, we prove in the next section that these G-networks still have product form solution. The equilibrium distribution First, under the assumptions we made, ~n(t) is clearly a Markov chain. Assume that the steadystate distribution exists, the following theorem establishes that it has a product form if a xed point system satises the stability constraints. Let i be an arbitrary queue, in the following we denote by b(i) the index of the ordered cycle of queues which contains queue i. As we have made a partition of the set of queues in cycles, there is one and only one cycle which contains queue i. Let f(i) be the function which gives the index of queue i in the cycle b(i). Theorem 1 Consider the following trac equations : i = i P N j j P j;i P N (? j P N k=1 k k P? k;j ) jq j;i i? i P N j j P? j;i P N j j R j;b(i) 1? b(i) () where : 8>< >: 8a; a = YL a `=1 8i if f(i) 6= 1 = 8i if f(i) = 1 = 1 c(a;`) f (i)?1 Y `=1 c(b(i);`) If there exists a positive vector solution = ( 1 ; ; ; N ) to the system such that i < 1 then the network has a steady-state distribution with product form solution : p(~n) = NY (1? i ) n i i (4) Proof : The state space is S = f~n : n i IN 8ig and the global balance equations relating ux into and out of each state ~n of S are : P N p(~n)? P i i? i 1lfni>0g = N p(~n ~e i) i d P i N p(~n? ~e i) 1l i fn P i>0g N P N p(~n ~e j?? ~e i ) j P j;i? j Q ji P 1lfni>0g N P N P N k=1 p(~n ~e k ~e j? ~e i ) k P? kj Q ji1l P fni>0g N p(~n ~e j) j P? 1l j;i fn i=0g P N P N P N P 1 r=0 p ~n ~e j r P L b(i) `=1 ~e c(b(i);`) P f(i)?1 `=1 ~e c(b(i);`) j R j;b(i) 1l fni=0g As usual, we denote by ~e i the vector having all its components equal to zero except the i th one, which is equal to one and 1l f:g the characteristic function. First we divide by p(~n) and use the solution (4) to simplify the ratios and we group the terms with the same characteristic functions : i ( i? )1l i fn i >0g = i i d i

4 1l fni >0g 4 i i r=0 j j P? j;i 1l fn i =0g 1X j j P j;i N X 0 j j R j;b(i) 4@ L b(i) Y `=1 r c(b(i);`1 A? j Q j;i f (i)?1 Y `=1 k=1 k k P? k;j jq j;i 5 c(b(i);` 5 1lfni =0g If for all queue i the load i is smaller than 1, then we have a < 1 for all cycle C a. Therefore P 1 r=0 (QL b(i) `=1 c(b(i);`) r is well dened and is equal to 1=(1? b(i) ). We substitute b(i) and in the equations and we remark that 1l fni =0g = 1? 1l fni >0g. Thus after some permutation of terms, we get : i 4 i? i i i d i 1l fni >0g i 4 i j j P? j;i N X j j P? j;i N X j j P j;i N X j j R j;b(i) j j R j;b(i) k=1 5 1lfni >0g = k k P? k;j jq j;i? j jq j;i 5 Using denition of i, after substitution, all the characteristic functions disappear to obtain a ow equation (see next Lemma). And the proof of the lemma will conclude the proof of the theorem. Lemma 1 The following ow equation is consistent with the denition of i. i = i i d i j j P? j;i N X j j R j;b(i) (5) Proof : First consider i dened by equation, multiply both sides of equation by the denominator and sum up for all queues i : i i i j j P j;i N X? i i? j jq j;i j j R j;b(i) i k=1 k k j P? k;j Q j;i = j j i P? j;i Remember that for all i, we have : P N Q i;j = 1 and P N P i;j P N P? i;j P A a=1 R i;ad i = 1. Thus after substitution and cancellation, we obtain : i = i i d i j j P? j;i N X AX a=1 j j R j;a j j R j;b(i) i (6) 4

5 First, we slightly change the index in the last term of the RHS : Then, as for all cycle C a, we have : = 1 X ic a AX X a=1 ic a? a 1? a P? a ic i = a? a (7) 1? a 1? a we nd again equation (5). Therefore, this equation is a ow equation and is consistent with the denition of i. This concludes the proof of the lemma and the theorem. It remains to prove that indeed equation (5) have positive solutions which satisfy the stationarity constraints. It is quite clear now that G-networks exhibits non linear ow equations. In [7], Gelenbe and Shassberger have presented a method to prove that, under some assumptions, these ow equations have a positive solution. But the stationarity constraints (i.e. i < 1) have to be veried after numerical resolution. Applying this method to G-networks with ushing is not straightforward because of some continuity arguments. Furthermore, we conjecture that the stationarity constraints are always satised for G-networks with ushing if the routing matrices implies that type signals may enter all queues. To conclude, the existence of positive solutions to ow equation which satisfy stationarity constraints is a dicult problem which will be investigated in a forthcoming paper. 4 Examples and related works 4.1 A small example Consider the following example, one of the smallest with non trivial synchronized transitions. The network consists of 4 queues (depicted in gure 1). To focus on type signals, we assume that there is no type 1 signals in the network : 8i? i = 0, matrix P? is a null matrix, matrix Q is not dened and matrix P is an arbitrary irreducible sub-stochastic matrix. The queues are divided into a two subsets partition : ff1; ; g; f4gg. The roots of cycle C 1 and C are respectively queue 1 and 4. In gure 1 the cycles are depicted as plain black lines. Type signals are represented by dotted lines joining queue 1 and queue 4, while the routing of customers is omitted to simplify the presentation. Note that a queue may send a type signal to the root of a cycle of which it belongs. To put more emphasis on the non linearity of the ow equations, we write them with more details. 8>< 1 = 1 P 4 j j P j;1 1 P 4 j j R j;1 1 1? 1 = = P 4 j j P j; P 4 j j R j;1 P 4 j j P j; P 4 j j R j;1 1 1? 1 1 1? 1 (8) >: 4 = 4 P 4 j j P j;4 4 P 4 j j R j; 1 1? 4 5

6 1 4 cycle signal Figure 1: A small network with partial synchronized ushing on queues Such a model may represent a production system and more specically an assembly subsystem where items queued in several lines are packed together to produce only one item. It is assumed that one item from every queue in a cycle is necessary to produce one object. The production is delaied until an order arrives (i.e. a signal in our model). The order asks to produce as much as possible and the production takes place until an empty queue stops the production process. Others application include the join operation in parallel systems where tasks in several queues wait to leave together a set of queues. One could also remark that type signals poll the cycle of queues and take advantage of this remark to model systems based on polling mechanisms. 4. Model with synchronized batch deletion In [14], Henderson, Northcote and Taylor have introduced a model of G-networks with batch arrivals and services such that any event occurring in the network can trigger a batch of customers to be routed through the network. They proved, that under some assumptions, their networks have product form solution. The key idea is that the service rate and the probability of trigger success can be described with the same set of functions. More precisely, they have to verify the following assumptions : When the system is in state ~n, a positive vector ~a is released with rate q(~n; ~a). Component a i of ~a is the number of customers served in queue i. The queue labeled 0 represents the outside of the G-network. The customers that compose vector ~a attempt to trigger the service completion of the customers distributed in vector ~a 0, if they succeed, the customers of ~a 0 join the queues according to vector ~a 00 with the probability P (~a; ~a 0 ; ~a 00 ). Denote A to be the set of all possible vectors ~a, ~a 0 and ~a 00 which are transferred in the G-network. It is assumed that q(~n; ~a) has the form : q(~n; ~a) = (~n? ~a)(~a) (~n) (9) where functions, and are non-negative and dened on IZ N. Furthermore, functions is positive and functions must satisfy : 8~n S 8~a A (~n) (~n? ~a) (10) 6

7 When ~a is served from state ~n, with probability P (~a; ~a 0 ; ~a 00 ) it succeed to trigger the vector ~a 0 with state dependent probability (~n?~a?~a0 ) ; thus state ~n? ~a? ~a 0 ~a 00 is reached. With (~n?~a) probability 1? (~n?~a?~a0 ), the trigger fails and and state ~n? ~a is reached. (~n?~a) Consider the trac equations for this class of G-network for all ~a 6= ~ 0 : X X (~a)f(~a) = ~a 0 A ~a 00 A (~a 0 )f(~a 0 ) f(~a 00 )P (~a 0 ; ~a 00 ; ~a)? f(~a)p (~a 0 ; ~a; ~a 00 ) (11) If the solution function f() of the equation (11) is geometric (i.e. f(~n) = Q N n i i with i < 1) then the G-network has a product form steady-state distribution : p(~n) = (~n)f(~n) 8~n S. The function related to the service in the G-network may put some restriction on the state space S. Clearly, the behavior of G-networks with synchronized partial ushing may be captured by Henderson's model, even if such a complex example is not presented. However, to prove product form, one have to exhibit functions, and in accordance with the dynamic of our model. This is quite complex. First, remark that the set of transfer vectors A is innite and the number of customers that constitute a batch vector is state-dependent. To nd the solutions ff(~a) : ~a A g of \trac equations", we have to express the sets of served/released, triggered and deposited vectors. On state space IZ N without truncations, these service functions are arbitrary positive. On a truncated state space such as IN N, the service functions are much more complex. Furthermore, to determine completely the functions f(), we have to express all solutions i for 1 i N. But solving the trac equations (11) in Henderson's model has roughly the same complexity than solving the global balance equation for our model. Despite our model belongs to the class of G-networks with batches dened in [14], building the various functions concerned with their model is as dicult as substitution of the solution in Chapman-Kolmogorov equation. 5 Conclusion G-network were originally designed to model neural networks []. Signals and customers respectively represent inhibitory and excitatory signals in models of neural networks, while queue lengths represent the neurons input potentials. Recently, new applications of these networks have been proposed in the eld of reliability of performability (see [1], [8] for instance). In these models the deletion capabilities of signals is used to model breakdowns which cause the loss of some customers (or even all the customers) in a queue. It may be worthy to remark that in [1] a G-network with triggers in a loop is used to approximate a network of queues with ushing. Clearly, our result allows to model complex joint departures processes and G-networks with partial synchronized ushing may provide a new approximation for assembly lines, parallel systems or for some new polling mechanisms. We also expect that it will possible to generalize this result to more complex synchronized transitions. References [1] X. Chao. A queueing network model with catastrophes and product form solution. Operations Research Letters, 18:75{79,

8 [] P. Glynn E. Gelenbe and K. Sigmann. Queues with negative customers. Journal of Applied Probability, 8:45{50, [] E. Gelenbe. Random neural networks with negative and positive signals and product form solution. Neural Computation, 1(4):50{510, [4] E. Gelenbe. Product form queueing networks with negative and positive customers. Journal of Applied Probability, 8:656{66, [5] E. Gelenbe. G-networks with signals and batch removal. Probability in the Engineering and Informational Sciences, 7:5{4, 199. [6] E. Gelenbe. G-networks with triggered customer movement. Journal of Applied Probability, 0:74{748, 199. [7] E. Gelenbe and R. Schassberger. Stability of G-networks. Probability in the Engineering and Informational Sciences, 6:71{76, 199. [8] P.G. Harrison and E. Pittel. Breakdowns modelled by G-queues. In QMIPS Workshop, Newcastle, England, october [9] W. Henderson. Queueing networks with negative customers and negative queue lengths. Journal of Applied Probability, 0:91{94, 199. [10] W. Henderson, B.S. Northcote, and P.G. Taylor. Networks of customer queues and ressource queues. In ITC 14, [11] W. Henderson, B.S. Northcote, and P.G. Taylor. State-dependent signalling in queueing networks. Journal of Applied Probability, 6:46{455, [1] M. Hernandez and J-M. Fourneau. Modelling defective parts in a ow using G-networks. In Second International Workshop on Performability Modelling of Computer and Communication Systems, Mont Saint-Michel (France), June 199. [1] L. Kloul J.M. Fourneau and F. Quessette. Multiple class G-networks with jumps back to zero. In Mascots '95, Durham, North Carolina, USA, Janvier [14] W. Henderson B.S. Northcote and P.G. Taylor. Triggered batch movement in queueing networks. Queueing Systems, 1:15{141,

Flow Equivalence and Stochastic Equivalence in G-Networks

Flow Equivalence and Stochastic Equivalence in G-Networks Flow Equivalence and Stochastic Equivalence in G-Networks Jean-Michel Fourneau Laboratoire PRISM Univ. de Versailles Saint-Quentin 45 Avenue des Etats-Unis 78000 Versailles, France jmf@prism.uvsq.fr Erol

More information

Introduction to Queuing Networks Solutions to Problem Sheet 3

Introduction to Queuing Networks Solutions to Problem Sheet 3 Introduction to Queuing Networks Solutions to Problem Sheet 3 1. (a) The state space is the whole numbers {, 1, 2,...}. The transition rates are q i,i+1 λ for all i and q i, for all i 1 since, when a bus

More information

Chapter 5. Continuous-Time Markov Chains. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan

Chapter 5. Continuous-Time Markov Chains. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Chapter 5. Continuous-Time Markov Chains Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Continuous-Time Markov Chains Consider a continuous-time stochastic process

More information

Lecture 20: Reversible Processes and Queues

Lecture 20: Reversible Processes and Queues Lecture 20: Reversible Processes and Queues 1 Examples of reversible processes 11 Birth-death processes We define two non-negative sequences birth and death rates denoted by {λ n : n N 0 } and {µ n : n

More information

Statistics 150: Spring 2007

Statistics 150: Spring 2007 Statistics 150: Spring 2007 April 23, 2008 0-1 1 Limiting Probabilities If the discrete-time Markov chain with transition probabilities p ij is irreducible and positive recurrent; then the limiting probabilities

More information

Stochastic models in product form: the (E)RCAT methodology

Stochastic models in product form: the (E)RCAT methodology Stochastic models in product form: the (E)RCAT methodology 1 Maria Grazia Vigliotti 2 1 Dipartimento di Informatica Università Ca Foscari di Venezia 2 Department of Computing Imperial College London Second

More information

ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS

ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS J.R. ARTALEJO, Department of Statistics and Operations Research, Faculty of Mathematics, Complutense University of Madrid,

More information

N.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a

N.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a WHEN IS A MAP POISSON N.G.Bean, D.A.Green and P.G.Taylor Department of Applied Mathematics University of Adelaide Adelaide 55 Abstract In a recent paper, Olivier and Walrand (994) claimed that the departure

More information

The Transition Probability Function P ij (t)

The Transition Probability Function P ij (t) The Transition Probability Function P ij (t) Consider a continuous time Markov chain {X(t), t 0}. We are interested in the probability that in t time units the process will be in state j, given that it

More information

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem Wade Trappe Lecture Overview Network of Queues Introduction Queues in Tandem roduct Form Solutions Burke s Theorem What

More information

Performance Evaluation of Queuing Systems

Performance Evaluation of Queuing Systems Performance Evaluation of Queuing Systems Introduction to Queuing Systems System Performance Measures & Little s Law Equilibrium Solution of Birth-Death Processes Analysis of Single-Station Queuing Systems

More information

Continuous-Time Markov Chain

Continuous-Time Markov Chain Continuous-Time Markov Chain Consider the process {X(t),t 0} with state space {0, 1, 2,...}. The process {X(t),t 0} is a continuous-time Markov chain if for all s, t 0 and nonnegative integers i, j, x(u),

More information

Markov Chain Model for ALOHA protocol

Markov Chain Model for ALOHA protocol Markov Chain Model for ALOHA protocol Laila Daniel and Krishnan Narayanan April 22, 2012 Outline of the talk A Markov chain (MC) model for Slotted ALOHA Basic properties of Discrete-time Markov Chain Stability

More information

IEOR 6711, HMWK 5, Professor Sigman

IEOR 6711, HMWK 5, Professor Sigman IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.

More information

Queueing Networks G. Rubino INRIA / IRISA, Rennes, France

Queueing Networks G. Rubino INRIA / IRISA, Rennes, France Queueing Networks G. Rubino INRIA / IRISA, Rennes, France February 2006 Index 1. Open nets: Basic Jackson result 2 2. Open nets: Internet performance evaluation 18 3. Closed nets: Basic Gordon-Newell result

More information

Data analysis and stochastic modeling

Data analysis and stochastic modeling Data analysis and stochastic modeling Lecture 7 An introduction to queueing theory Guillaume Gravier guillaume.gravier@irisa.fr with a lot of help from Paul Jensen s course http://www.me.utexas.edu/ jensen/ormm/instruction/powerpoint/or_models_09/14_queuing.ppt

More information

Stochastic process. X, a series of random variables indexed by t

Stochastic process. X, a series of random variables indexed by t Stochastic process X, a series of random variables indexed by t X={X(t), t 0} is a continuous time stochastic process X={X(t), t=0,1, } is a discrete time stochastic process X(t) is the state at time t,

More information

2905 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES

2905 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES 295 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES 16 Queueing Systems with Two Types of Customers In this section, we discuss queueing systems with two types of customers.

More information

Exercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010

Exercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010 Exercises Stochastic Performance Modelling Hamilton Institute, Summer Instruction Exercise Let X be a non-negative random variable with E[X ]

More information

Queuing Analysis of Markovian Queue Having Two Heterogeneous Servers with Catastrophes using Matrix Geometric Technique

Queuing Analysis of Markovian Queue Having Two Heterogeneous Servers with Catastrophes using Matrix Geometric Technique International Journal of Statistics and Systems ISSN 0973-2675 Volume 12, Number 2 (2017), pp. 205-212 Research India Publications http://www.ripublication.com Queuing Analysis of Markovian Queue Having

More information

Introduction to Markov Chains, Queuing Theory, and Network Performance

Introduction to Markov Chains, Queuing Theory, and Network Performance Introduction to Markov Chains, Queuing Theory, and Network Performance Marceau Coupechoux Telecom ParisTech, departement Informatique et Réseaux marceau.coupechoux@telecom-paristech.fr IT.2403 Modélisation

More information

Time Reversibility and Burke s Theorem

Time Reversibility and Burke s Theorem Queuing Analysis: Time Reversibility and Burke s Theorem Hongwei Zhang http://www.cs.wayne.edu/~hzhang Acknowledgement: this lecture is partially based on the slides of Dr. Yannis A. Korilis. Outline Time-Reversal

More information

Link Models for Circuit Switching

Link Models for Circuit Switching Link Models for Circuit Switching The basis of traffic engineering for telecommunication networks is the Erlang loss function. It basically allows us to determine the amount of telephone traffic that can

More information

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1 Queueing systems Renato Lo Cigno Simulation and Performance Evaluation 2014-15 Queueing systems - Renato Lo Cigno 1 Queues A Birth-Death process is well modeled by a queue Indeed queues can be used to

More information

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks Recap Probability, stochastic processes, Markov chains ELEC-C7210 Modeling and analysis of communication networks 1 Recap: Probability theory important distributions Discrete distributions Geometric distribution

More information

Stochastic Processes

Stochastic Processes MTHE/STAT455, STAT855 Fall 202 Stochastic Processes Final Exam, Solutions (5 marks) (a) (0 marks) Condition on the first pair to bond; each of the n adjacent pairs is equally likely to bond Given that

More information

[4] T. I. Seidman, \\First Come First Serve" is Unstable!," tech. rep., University of Maryland Baltimore County, 1993.

[4] T. I. Seidman, \\First Come First Serve is Unstable!, tech. rep., University of Maryland Baltimore County, 1993. [2] C. J. Chase and P. J. Ramadge, \On real-time scheduling policies for exible manufacturing systems," IEEE Trans. Automat. Control, vol. AC-37, pp. 491{496, April 1992. [3] S. H. Lu and P. R. Kumar,

More information

STOCHASTIC PROCESSES Basic notions

STOCHASTIC PROCESSES Basic notions J. Virtamo 38.3143 Queueing Theory / Stochastic processes 1 STOCHASTIC PROCESSES Basic notions Often the systems we consider evolve in time and we are interested in their dynamic behaviour, usually involving

More information

On-line Bin-Stretching. Yossi Azar y Oded Regev z. Abstract. We are given a sequence of items that can be packed into m unit size bins.

On-line Bin-Stretching. Yossi Azar y Oded Regev z. Abstract. We are given a sequence of items that can be packed into m unit size bins. On-line Bin-Stretching Yossi Azar y Oded Regev z Abstract We are given a sequence of items that can be packed into m unit size bins. In the classical bin packing problem we x the size of the bins and try

More information

Solutions to Homework Discrete Stochastic Processes MIT, Spring 2011

Solutions to Homework Discrete Stochastic Processes MIT, Spring 2011 Exercise 6.5: Solutions to Homework 0 6.262 Discrete Stochastic Processes MIT, Spring 20 Consider the Markov process illustrated below. The transitions are labelled by the rate q ij at which those transitions

More information

Name of the Student:

Name of the Student: SUBJECT NAME : Probability & Queueing Theory SUBJECT CODE : MA 6453 MATERIAL NAME : Part A questions REGULATION : R2013 UPDATED ON : November 2017 (Upto N/D 2017 QP) (Scan the above QR code for the direct

More information

NEW FRONTIERS IN APPLIED PROBABILITY

NEW FRONTIERS IN APPLIED PROBABILITY J. Appl. Prob. Spec. Vol. 48A, 209 213 (2011) Applied Probability Trust 2011 NEW FRONTIERS IN APPLIED PROBABILITY A Festschrift for SØREN ASMUSSEN Edited by P. GLYNN, T. MIKOSCH and T. ROLSKI Part 4. Simulation

More information

Lecture Notes of Communication Network I y: part 5. Lijun Qian. Rutgers The State University of New Jersey. 94 Brett Road. Piscataway, NJ

Lecture Notes of Communication Network I y: part 5. Lijun Qian. Rutgers The State University of New Jersey. 94 Brett Road. Piscataway, NJ Lecture Notes of Communication Network I y: part 5 Lijun Qian Department of Electrical Engineering Rutgers The State University of New Jersey 94 Brett Road Piscataway, NJ 08854-8058 October 6, 1998 Abstract

More information

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems  M/M/1  M/M/m  M/M/1/K Queueing Theory I Summary Little s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K " Little s Law a(t): the process that counts the number of arrivals

More information

GI/M/1 and GI/M/m queuing systems

GI/M/1 and GI/M/m queuing systems GI/M/1 and GI/M/m queuing systems Dmitri A. Moltchanov moltchan@cs.tut.fi http://www.cs.tut.fi/kurssit/tlt-2716/ OUTLINE: GI/M/1 queuing system; Methods of analysis; Imbedded Markov chain approach; Waiting

More information

On the Pathwise Optimal Bernoulli Routing Policy for Homogeneous Parallel Servers

On the Pathwise Optimal Bernoulli Routing Policy for Homogeneous Parallel Servers On the Pathwise Optimal Bernoulli Routing Policy for Homogeneous Parallel Servers Ger Koole INRIA Sophia Antipolis B.P. 93, 06902 Sophia Antipolis Cedex France Mathematics of Operations Research 21:469

More information

Non Markovian Queues (contd.)

Non Markovian Queues (contd.) MODULE 7: RENEWAL PROCESSES 29 Lecture 5 Non Markovian Queues (contd) For the case where the service time is constant, V ar(b) = 0, then the P-K formula for M/D/ queue reduces to L s = ρ + ρ 2 2( ρ) where

More information

Online Companion for. Decentralized Adaptive Flow Control of High Speed Connectionless Data Networks

Online Companion for. Decentralized Adaptive Flow Control of High Speed Connectionless Data Networks Online Companion for Decentralized Adaptive Flow Control of High Speed Connectionless Data Networks Operations Research Vol 47, No 6 November-December 1999 Felisa J Vásquez-Abad Départment d informatique

More information

Queueing Networks and Insensitivity

Queueing Networks and Insensitivity Lukáš Adam 29. 10. 2012 1 / 40 Table of contents 1 Jackson networks 2 Insensitivity in Erlang s Loss System 3 Quasi-Reversibility and Single-Node Symmetric Queues 4 Quasi-Reversibility in Networks 5 The

More information

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18. IEOR 6711: Stochastic Models I, Fall 23, Professor Whitt Solutions to Final Exam: Thursday, December 18. Below are six questions with several parts. Do as much as you can. Show your work. 1. Two-Pump Gas

More information

6 Solving Queueing Models

6 Solving Queueing Models 6 Solving Queueing Models 6.1 Introduction In this note we look at the solution of systems of queues, starting with simple isolated queues. The benefits of using predefined, easily classified queues will

More information

M/M/1 Retrial Queueing System with Negative. Arrival under Erlang-K Service by Matrix. Geometric Method

M/M/1 Retrial Queueing System with Negative. Arrival under Erlang-K Service by Matrix. Geometric Method Applied Mathematical Sciences, Vol. 4, 21, no. 48, 2355-2367 M/M/1 Retrial Queueing System with Negative Arrival under Erlang-K Service by Matrix Geometric Method G. Ayyappan Pondicherry Engineering College,

More information

TCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis

TCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis TCOM 50: Networking Theory & Fundamentals Lecture 6 February 9, 003 Prof. Yannis A. Korilis 6- Topics Time-Reversal of Markov Chains Reversibility Truncating a Reversible Markov Chain Burke s Theorem Queues

More information

2. Transience and Recurrence

2. Transience and Recurrence Virtual Laboratories > 15. Markov Chains > 1 2 3 4 5 6 7 8 9 10 11 12 2. Transience and Recurrence The study of Markov chains, particularly the limiting behavior, depends critically on the random times

More information

Stability, Queue Length and Delay of Deterministic and Stochastic Queueing Networks Cheng-Shang Chang IBM Research Division T.J. Watson Research Cente

Stability, Queue Length and Delay of Deterministic and Stochastic Queueing Networks Cheng-Shang Chang IBM Research Division T.J. Watson Research Cente Stability, Queue Length and Delay of Deterministic and Stochastic Queueing Networks Cheng-Shang Chang IBM Research Division T.J. Watson Research Center P.O. Box 704 Yorktown Heights, NY 10598 cschang@watson.ibm.com

More information

Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing

Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing Submitted to Management Science manuscript MS-251-27 Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing Rishi Talreja, Ward Whitt Department of

More information

CHAPTER 4. Networks of queues. 1. Open networks Suppose that we have a network of queues as given in Figure 4.1. Arrivals

CHAPTER 4. Networks of queues. 1. Open networks Suppose that we have a network of queues as given in Figure 4.1. Arrivals CHAPTER 4 Networks of queues. Open networks Suppose that we have a network of queues as given in Figure 4.. Arrivals Figure 4.. An open network can occur from outside of the network to any subset of nodes.

More information

Synchronized Queues with Deterministic Arrivals

Synchronized Queues with Deterministic Arrivals Synchronized Queues with Deterministic Arrivals Dimitra Pinotsi and Michael A. Zazanis Department of Statistics Athens University of Economics and Business 76 Patission str., Athens 14 34, Greece Abstract

More information

Stability of the two queue system

Stability of the two queue system Stability of the two queue system Iain M. MacPhee and Lisa J. Müller University of Durham Department of Mathematical Science Durham, DH1 3LE, UK (e-mail: i.m.macphee@durham.ac.uk, l.j.muller@durham.ac.uk)

More information

Session-Based Queueing Systems

Session-Based Queueing Systems Session-Based Queueing Systems Modelling, Simulation, and Approximation Jeroen Horters Supervisor VU: Sandjai Bhulai Executive Summary Companies often offer services that require multiple steps on the

More information

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes CDA6530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic process X = {X(t), t2 T} is a collection of random variables (rvs); one rv

More information

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking Lecture 7: Simulation of Markov Processes Pasi Lassila Department of Communications and Networking Contents Markov processes theory recap Elementary queuing models for data networks Simulation of Markov

More information

Networks of Queues Models with Several. Classes of Customers and Exponential. Service Times

Networks of Queues Models with Several. Classes of Customers and Exponential. Service Times Applied Mathematical Sciences, Vol. 9, 2015, no. 76, 3789-3796 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2015.53287 Networks of Queues Models with Several Classes of Customers and Exponential

More information

reversed chain is ergodic and has the same equilibrium probabilities (check that π j =

reversed chain is ergodic and has the same equilibrium probabilities (check that π j = Lecture 10 Networks of queues In this lecture we shall finally get around to consider what happens when queues are part of networks (which, after all, is the topic of the course). Firstly we shall need

More information

Cover Page. The handle holds various files of this Leiden University dissertation

Cover Page. The handle  holds various files of this Leiden University dissertation Cover Page The handle http://hdl.handle.net/1887/39637 holds various files of this Leiden University dissertation Author: Smit, Laurens Title: Steady-state analysis of large scale systems : the successive

More information

1. Introduction. Consider a single cell in a mobile phone system. A \call setup" is a request for achannel by an idle customer presently in the cell t

1. Introduction. Consider a single cell in a mobile phone system. A \call setup is a request for achannel by an idle customer presently in the cell t Heavy Trac Limit for a Mobile Phone System Loss Model Philip J. Fleming and Alexander Stolyar Motorola, Inc. Arlington Heights, IL Burton Simon Department of Mathematics University of Colorado at Denver

More information

HITTING TIME IN AN ERLANG LOSS SYSTEM

HITTING TIME IN AN ERLANG LOSS SYSTEM Probability in the Engineering and Informational Sciences, 16, 2002, 167 184+ Printed in the U+S+A+ HITTING TIME IN AN ERLANG LOSS SYSTEM SHELDON M. ROSS Department of Industrial Engineering and Operations

More information

Lecture 20 : Markov Chains

Lecture 20 : Markov Chains CSCI 3560 Probability and Computing Instructor: Bogdan Chlebus Lecture 0 : Markov Chains We consider stochastic processes. A process represents a system that evolves through incremental changes called

More information

57:022 Principles of Design II Final Exam Solutions - Spring 1997

57:022 Principles of Design II Final Exam Solutions - Spring 1997 57:022 Principles of Design II Final Exam Solutions - Spring 1997 Part: I II III IV V VI Total Possible Pts: 52 10 12 16 13 12 115 PART ONE Indicate "+" if True and "o" if False: + a. If a component's

More information

Proxel-Based Simulation of Stochastic Petri Nets Containing Immediate Transitions

Proxel-Based Simulation of Stochastic Petri Nets Containing Immediate Transitions Electronic Notes in Theoretical Computer Science Vol. 85 No. 4 (2003) URL: http://www.elsevier.nl/locate/entsc/volume85.html Proxel-Based Simulation of Stochastic Petri Nets Containing Immediate Transitions

More information

Product-form in G-networks

Product-form in G-networks PROBABILITY IN THE ENGINEERING AND INFORMATIONAL SCIENCES Product-form in G-networks Andrea Marin Abstract The introduction of the class of queueing networks called G-networks by Gelenbe has been a breakthrough

More information

Upper and Lower Bounds on the Number of Faults. a System Can Withstand Without Repairs. Cambridge, MA 02139

Upper and Lower Bounds on the Number of Faults. a System Can Withstand Without Repairs. Cambridge, MA 02139 Upper and Lower Bounds on the Number of Faults a System Can Withstand Without Repairs Michel Goemans y Nancy Lynch z Isaac Saias x Laboratory for Computer Science Massachusetts Institute of Technology

More information

An M/M/1 Queue in Random Environment with Disasters

An M/M/1 Queue in Random Environment with Disasters An M/M/1 Queue in Random Environment with Disasters Noam Paz 1 and Uri Yechiali 1,2 1 Department of Statistics and Operations Research School of Mathematical Sciences Tel Aviv University, Tel Aviv 69978,

More information

Lecture 3: Markov chains.

Lecture 3: Markov chains. 1 BIOINFORMATIK II PROBABILITY & STATISTICS Summer semester 2008 The University of Zürich and ETH Zürich Lecture 3: Markov chains. Prof. Andrew Barbour Dr. Nicolas Pétrélis Adapted from a course by Dr.

More information

Counting and Constructing Minimal Spanning Trees. Perrin Wright. Department of Mathematics. Florida State University. Tallahassee, FL

Counting and Constructing Minimal Spanning Trees. Perrin Wright. Department of Mathematics. Florida State University. Tallahassee, FL Counting and Constructing Minimal Spanning Trees Perrin Wright Department of Mathematics Florida State University Tallahassee, FL 32306-3027 Abstract. We revisit the minimal spanning tree problem in order

More information

M/M/1 Retrial Queueing System with N-Policy. Multiple Vacation under Non-Pre-Emtive Priority. Service by Matrix Geometric Method

M/M/1 Retrial Queueing System with N-Policy. Multiple Vacation under Non-Pre-Emtive Priority. Service by Matrix Geometric Method Applied Mathematical Sciences, Vol. 4, 2010, no. 23, 1141 1154 M/M/1 Retrial Queueing System with N-Policy Multiple Vacation under Non-Pre-Emtive Priority Service by Matrix Geometric Method G. AYYAPPAN

More information

15 Closed production networks

15 Closed production networks 5 Closed production networks In the previous chapter we developed and analyzed stochastic models for production networks with a free inflow of jobs. In this chapter we will study production networks for

More information

Multiserver Queueing Model subject to Single Exponential Vacation

Multiserver Queueing Model subject to Single Exponential Vacation Journal of Physics: Conference Series PAPER OPEN ACCESS Multiserver Queueing Model subject to Single Exponential Vacation To cite this article: K V Vijayashree B Janani 2018 J. Phys.: Conf. Ser. 1000 012129

More information

Interlude: Practice Final

Interlude: Practice Final 8 POISSON PROCESS 08 Interlude: Practice Final This practice exam covers the material from the chapters 9 through 8. Give yourself 0 minutes to solve the six problems, which you may assume have equal point

More information

M/G/1 and M/G/1/K systems

M/G/1 and M/G/1/K systems M/G/1 and M/G/1/K systems Dmitri A. Moltchanov dmitri.moltchanov@tut.fi http://www.cs.tut.fi/kurssit/elt-53606/ OUTLINE: Description of M/G/1 system; Methods of analysis; Residual life approach; Imbedded

More information

1 Introduction It will be convenient to use the inx operators a b and a b to stand for maximum (least upper bound) and minimum (greatest lower bound)

1 Introduction It will be convenient to use the inx operators a b and a b to stand for maximum (least upper bound) and minimum (greatest lower bound) Cycle times and xed points of min-max functions Jeremy Gunawardena, Department of Computer Science, Stanford University, Stanford, CA 94305, USA. jeremy@cs.stanford.edu October 11, 1993 to appear in the

More information

Irreducibility. Irreducible. every state can be reached from every other state For any i,j, exist an m 0, such that. Absorbing state: p jj =1

Irreducibility. Irreducible. every state can be reached from every other state For any i,j, exist an m 0, such that. Absorbing state: p jj =1 Irreducibility Irreducible every state can be reached from every other state For any i,j, exist an m 0, such that i,j are communicate, if the above condition is valid Irreducible: all states are communicate

More information

Figure 10.1: Recording when the event E occurs

Figure 10.1: Recording when the event E occurs 10 Poisson Processes Let T R be an interval. A family of random variables {X(t) ; t T} is called a continuous time stochastic process. We often consider T = [0, 1] and T = [0, ). As X(t) is a random variable

More information

Intro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin

Intro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin Queuing Networks Florence Perronnin Polytech Grenoble - UGA March 23, 27 F. Perronnin (UGA) Queuing Networks March 23, 27 / 46 Outline Introduction to Queuing Networks 2 Refresher: M/M/ queue 3 Reversibility

More information

Modelling Complex Queuing Situations with Markov Processes

Modelling Complex Queuing Situations with Markov Processes Modelling Complex Queuing Situations with Markov Processes Jason Randal Thorne, School of IT, Charles Sturt Uni, NSW 2795, Australia Abstract This article comments upon some new developments in the field

More information

Performance analysis of queueing systems with resequencing

Performance analysis of queueing systems with resequencing UNIVERSITÀ DEGLI STUDI DI SALERNO Dipartimento di Matematica Dottorato di Ricerca in Matematica XIV ciclo - Nuova serie Performance analysis of queueing systems with resequencing Candidato: Caraccio Ilaria

More information

1 IEOR 4701: Continuous-Time Markov Chains

1 IEOR 4701: Continuous-Time Markov Chains Copyright c 2006 by Karl Sigman 1 IEOR 4701: Continuous-Time Markov Chains A Markov chain in discrete time, {X n : n 0}, remains in any state for exactly one unit of time before making a transition (change

More information

Queuing Theory. Using the Math. Management Science

Queuing Theory. Using the Math. Management Science Queuing Theory Using the Math 1 Markov Processes (Chains) A process consisting of a countable sequence of stages, that can be judged at each stage to fall into future states independent of how the process

More information

CS 798: Homework Assignment 3 (Queueing Theory)

CS 798: Homework Assignment 3 (Queueing Theory) 1.0 Little s law Assigned: October 6, 009 Patients arriving to the emergency room at the Grand River Hospital have a mean waiting time of three hours. It has been found that, averaged over the period of

More information

15 Closed production networks

15 Closed production networks 5 Closed production networks In the previous chapter we developed and analyzed stochastic models for production networks with a free inflow of jobs. In this chapter we will study production networks for

More information

λ λ λ In-class problems

λ λ λ In-class problems In-class problems 1. Customers arrive at a single-service facility at a Poisson rate of 40 per hour. When two or fewer customers are present, a single attendant operates the facility, and the service time

More information

BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS

BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS Andrea Bobbio Anno Accademico 999-2000 Queueing Systems 2 Notation for Queueing Systems /λ mean time between arrivals S = /µ ρ = λ/µ N mean service time traffic

More information

UNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours.

UNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours. UNIVERSITY OF YORK MSc Examinations 2004 MATHEMATICS Networks Time Allowed: 3 hours. Answer 4 questions. Standard calculators will be provided but should be unnecessary. 1 Turn over 2 continued on next

More information

Vector Space Basics. 1 Abstract Vector Spaces. 1. (commutativity of vector addition) u + v = v + u. 2. (associativity of vector addition)

Vector Space Basics. 1 Abstract Vector Spaces. 1. (commutativity of vector addition) u + v = v + u. 2. (associativity of vector addition) Vector Space Basics (Remark: these notes are highly formal and may be a useful reference to some students however I am also posting Ray Heitmann's notes to Canvas for students interested in a direct computational

More information

A tutorial on some new methods for. performance evaluation of queueing networks. P. R. Kumar. Coordinated Science Laboratory. University of Illinois

A tutorial on some new methods for. performance evaluation of queueing networks. P. R. Kumar. Coordinated Science Laboratory. University of Illinois A tutorial on some new methods for performance evaluation of queueing networks P. R. Kumar Dept. of Electrical and Computer Engineering, and Coordinated Science Laboratory University of Illinois 1308 West

More information

Part I Stochastic variables and Markov chains

Part I Stochastic variables and Markov chains Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)

More information

Environment (E) IBP IBP IBP 2 N 2 N. server. System (S) Adapter (A) ACV

Environment (E) IBP IBP IBP 2 N 2 N. server. System (S) Adapter (A) ACV The Adaptive Cross Validation Method - applied to polling schemes Anders Svensson and Johan M Karlsson Department of Communication Systems Lund Institute of Technology P. O. Box 118, 22100 Lund, Sweden

More information

Optimal Rejuvenation for. Tolerating Soft Failures. Andras Pfening, Sachin Garg, Antonio Puliato, Miklos Telek, Kishor S. Trivedi.

Optimal Rejuvenation for. Tolerating Soft Failures. Andras Pfening, Sachin Garg, Antonio Puliato, Miklos Telek, Kishor S. Trivedi. Optimal Rejuvenation for Tolerating Soft Failures Andras Pfening, Sachin Garg, Antonio Puliato, Miklos Telek, Kishor S. Trivedi Abstract In the paper we address the problem of determining the optimal time

More information

VARIANCE REDUCTION IN SIMULATIONS OF LOSS MODELS

VARIANCE REDUCTION IN SIMULATIONS OF LOSS MODELS VARIANCE REDUCTION IN SIMULATIONS OF LOSS MODELS by Rayadurgam Srikant 1 and Ward Whitt 2 October 20, 1995 Revision: September 26, 1996 1 Coordinated Science Laboratory, University of Illinois, 1308 W.

More information

2 RODNEY G. DOWNEY STEFFEN LEMPP Theorem. For any incomplete r.e. degree w, there is an incomplete r.e. degree a > w such that there is no r.e. degree

2 RODNEY G. DOWNEY STEFFEN LEMPP Theorem. For any incomplete r.e. degree w, there is an incomplete r.e. degree a > w such that there is no r.e. degree THERE IS NO PLUS-CAPPING DEGREE Rodney G. Downey Steffen Lempp Department of Mathematics, Victoria University of Wellington, Wellington, New Zealand downey@math.vuw.ac.nz Department of Mathematics, University

More information

A TANDEM QUEUEING SYSTEM WITH APPLICATIONS TO PRICING STRATEGY. Wai-Ki Ching. Tang Li. Sin-Man Choi. Issic K.C. Leung

A TANDEM QUEUEING SYSTEM WITH APPLICATIONS TO PRICING STRATEGY. Wai-Ki Ching. Tang Li. Sin-Man Choi. Issic K.C. Leung Manuscript submitted to AIMS Journals Volume X, Number 0X, XX 00X Website: http://aimsciences.org pp. X XX A TANDEM QUEUEING SYSTEM WITH APPLICATIONS TO PRICING STRATEGY WAI-KI CHING SIN-MAN CHOI TANG

More information

T. Liggett Mathematics 171 Final Exam June 8, 2011

T. Liggett Mathematics 171 Final Exam June 8, 2011 T. Liggett Mathematics 171 Final Exam June 8, 2011 1. The continuous time renewal chain X t has state space S = {0, 1, 2,...} and transition rates (i.e., Q matrix) given by q(n, n 1) = δ n and q(0, n)

More information

Mean-Field Analysis of Coding Versus Replication in Large Data Storage Systems

Mean-Field Analysis of Coding Versus Replication in Large Data Storage Systems Electrical and Computer Engineering Publications Electrical and Computer Engineering 2-28 Mean-Field Analysis of Coding Versus Replication in Large Data Storage Systems Bin Li University of Rhode Island

More information

Continuous Time Markov Chains

Continuous Time Markov Chains Continuous Time Markov Chains Stochastic Processes - Lecture Notes Fatih Cavdur to accompany Introduction to Probability Models by Sheldon M. Ross Fall 2015 Outline Introduction Continuous-Time Markov

More information

Linear Algebra March 16, 2019

Linear Algebra March 16, 2019 Linear Algebra March 16, 2019 2 Contents 0.1 Notation................................ 4 1 Systems of linear equations, and matrices 5 1.1 Systems of linear equations..................... 5 1.2 Augmented

More information

Chapter 16 focused on decision making in the face of uncertainty about one future

Chapter 16 focused on decision making in the face of uncertainty about one future 9 C H A P T E R Markov Chains Chapter 6 focused on decision making in the face of uncertainty about one future event (learning the true state of nature). However, some decisions need to take into account

More information

A GENERALIZED MARKOVIAN QUEUE TO MODEL AN OPTICAL PACKET SWITCHING MULTIPLEXER

A GENERALIZED MARKOVIAN QUEUE TO MODEL AN OPTICAL PACKET SWITCHING MULTIPLEXER A GENERALIZED MARKOVIAN QUEUE TO MODEL AN OPTICAL PACKET SWITCHING MULTIPLEXER RAM CHAKKA Department of Computer Science Norfolk State University, USA TIEN VAN DO, ZSOLT PÁNDI Department of Telecommunications

More information

A general algorithm to compute the steady-state solution of product-form cooperating Markov chains

A general algorithm to compute the steady-state solution of product-form cooperating Markov chains A general algorithm to compute the steady-state solution of product-form cooperating Markov chains Università Ca Foscari di Venezia Dipartimento di Informatica Italy 2009 Presentation outline 1 Product-form

More information

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space

Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) 1.1 The Formal Denition of a Vector Space Linear Algebra (part 1) : Vector Spaces (by Evan Dummit, 2017, v. 1.07) Contents 1 Vector Spaces 1 1.1 The Formal Denition of a Vector Space.................................. 1 1.2 Subspaces...................................................

More information