A comment on Boucherie product-form results

Size: px
Start display at page:

Download "A comment on Boucherie product-form results"

Transcription

1 A comment on Boucherie product-form results Andrea Marin Dipartimento di Informatica Università Ca Foscari di Venezia Via Torino 155, Venezia Mestre, Italy Abstract. This is a sketch about Boucherie paper on product form. It is quite informal, for a deeper view we suggest to study the interesting paper [2]. Our aim is just to point out the main main conditions for this product form. 1 The Boucherie result on the product form The starting CTMCs In this section we summarize the results presented in [2]. Let us consider K stable and regular CTMCs. The state spaces S 1,... S K of the CTMCs are finite or countable. Let q k (n k, n k ) be the transition rate from state n k to n k of k-th CTMC. Let π k : S k [0, 1] denote the normalized stationary probability function, i.e., n k S k π k (n k ) = 1. Let n = (n 1,..., n K ) with n k S k and k = 1,..., K be a state of the composed process. Clearly if the CTMCs are independent we have product form, i.e., π(n) = K k=1 π k(n k ). The competition Let use introduce an index set I. Intuitively I is a set which labels the resources. In each state a CTMC uses one and only one resource. So we can partition a state space S k in I mutually exclusive sets A ki such that: i I A ki = S k A ki If CTMCs k 1 and k 2 compete over resources i then this means that the combined process does not reach the state n where components n k1 A k1 i and n k2 A k2 i. We denote with C ki the set of CTMCs which compete with CTMC k on the resource i I. The product form condition Let us study the process with state space S = S 1... S k and let us define the following transition matrix for the CTMC on S: q(n, n ) = K k=1 [ q k (n k, n k) K r=1,r k Note that the definition of q is such that: ] 1(n r = n r)1(n r A ri = k / C ri ). (1)

2 It is impossible to reach a state where two CTMCs use a resource i I if they are in conflict on i. This means that the state space of the composed process can be reduced excluding the no-reachable states. Given two adjacent states n and n then just a single CTMC k changes its state, i.e., state n and state n differ just by the component k which changes from n k to n k, with k = 1,..., K. The transition rate from n to n is determined only by the transition rate between states n k and n k of the k th Markov chain. Suppose that CTMCs k, k conflict on resource i. Then when one of the two CTMCs is in a state belonging to the set A ki or A k i the other Markov chain cannot change its state at all. This is probably the main limit of this approach to the product form. We shall comment this condition in the conclusions. Boucherie gives the following important result on the stationary distribution of the composed process: K π(n) = B π k (n k ), (2) k=1 where n is a reachable state and B a normalizing constant. 2 An example Let us consider two identical CTMCs as showed in Figure 1. Fig. 1. Example CTMC Clearly the Markov chain is ergodic and its stationary probabilities are π(n) = 1 3 for n = a, b, c. Let us now define the competition. Suppose I = {1, 2}

3 and A k1 = {a, c}, A k2 = {b} and C 12 = {2}, C 22 = {1}, C k1 =, with k = 1, 2. In Figure 1 we use orange to denote the states which use resource 1 and blue for the state which uses resource 2. Note that competition is just over resource 2. The composed process on S = S 1 S 2 with the transition rates defined by formula 1 has 8 reachable states. By the result expressed by equation 2 we can conclude that the stationary probability of each state is the same, i.e Figure 2 shows the composed process S. Fig. 2. Composed process S. Read the picture as dotted lines are not present. All the transition rates are equal to v. It is easy to see that π(n) = 1 8 CTMC on space S. for all n satisfies the set of GBEs for the 3 Conclusions Boucherie product form condition is very interesting for various reasons. First of all it gives conditions on the Markov Chains so the result can be used as framework for studying the product form conditions for different stochastic model

4 formalisms, such as stochastic process algebra, stochastic Petri nets (SPN), and so on. If we apply Boucherie approach to SPNs, as pointed out in the original work [2], we note a second strength of the result. In fact if we consider Coleman et al. product form on SPNs [6, 3] the authors aim to give a stationary solution which is expressed in terms of product of functions of the number of tokens in each place. This means that, given a SPN, the authors give a set of sufficient conditions for the product form. Boucherie framework, on the other hand, is more suitable for hierarchical modelling. In fact, the idea is that given a set of SPNs (let us call them agent), each one with its associated CTMC, a set of sufficient conditions for the product form solution is defined on the interaction of the agents. However given an SPN it does not appear an easy task identifying algorithmically Boucherie product form: this would require to identify the agents and checking the interaction, but for the low level expressive power of SPNs this would be quite hard. It is worthwhile exploring the consequences of Boucherie conditions for product form. In the following we comment them one by one: The conditions on the single CTMC. These are very general, indeed it is just asked them to be ergodic and to have a unique stationary distribution. The conditions on the composed process state space. The exclusion mechanism appears to be very flexible. Defining a partition on the state space is a really general approach. In the original paper the author gives an example where he shows how the exclusion mechanism can model the availability of multiple resources. The conditions on the composed process transition rates. We think that it is important to understand well the meaning of this key-condition for the product form. Suppose that CTMCs k, k conflict on resource i. Then when one of the two CTMCs is in a state belonging to the set A ki or A k i the other Markov chain cannot change its state at all. In practice suppose you have two identical process which do this task: think }{{} print }{{} a b input data think }{{} c The printing state requires to use of the shared resource printer so there is a competition on that resource. This is basically the CTMC of the example of Section 2 where it is assumed that all the tasks has an exponential distributed duration with the same mean. The point is that Boucherie framework requires that when a process is printing the other one is stopped, independently on the state it is. There are no reasons, from a modelling point of view, for stopping a process which is performing an input action when the other process is printing. In Figure 2, by adding the dotted arcs, one obtains the process how it should be from a modelling point of view. But the product form is lost. It does not appear clear the relation between the class of product form SPNs (PFSPNs). As far as we know we can identify three classes of PFSPNs:

5 1. Lazar an Robertazzi product form [7, 8], 2. Coleman, Henderson, Taylor product form [6, 3] which includes also the product form defined in [5], 3. Boucherie product form [2]. As Boucherie points out in his paper, product form 3 generalizes product form 1, but the relations with 2 should be explored. In fact, even if some conditions are equivalent (e.g. each transition input vector has a correspondent transition output vector [4]) the product form model class is different. For example in [6, 3] the product form condition depends on the transition rate (this problem is overcome in [5] but the model class is smaller) and this has not an equivalent condition on product form 1 and 3. Finally we think that the relation between this conditions on product form and Muntz s M M [9] property should be explored. In [1] are showed some GSPN, i.e. they allow immediate transitions, with an associated Markov chain. It is proved that their composition is in product form, even if they do not fit any of the classes of product form cited here.

6 References 1. Balsamo, S., and Marin, A. On representing multiclass M/M/k queues by generalized stochastic Petri nets. In Proc. of ECMS/ASMTA-2007 conference. To appear. 2. Boucherie, R. J. A characterisation of independence for competing Markov chains with applications to stochastic Petri nets. Tech. Rep. RR Coleman, J. L., Henderson, W., and Taylor, P. G. Product form equilibrium distributions and a convolution algorithm for Stochastic Petri nets. Performance Evaluation 26 (1996), Donatelli, S., and Sereno, M. On the product form solution for stochastic petri nets. In Proceedings of the 13th International Conference on Application and Theory of Petri Nets (London, UK, 1992), Springer-Verlag, pp Haddad, S., Moreaux, P., Sereno, M., and Silva, M. Product-form and stochastic Petri nets: a structural approach. Perform. Eval. 59, 4 (2005), Henderson, W., Lucic, D., and Taylor, P. G. A net level performance analysis of Stochastic Petri Nets. J. Austral. Math. Soc. Ser. B 31 (1989), Lazar, A. A., and Robertazzi, T. G. Markovian Petri Net Protocols with Product Form Solution. In IEEE INFOCOM 87, The Conf. on Computer Communications, Proc., Sixth Annual Conference - Global Networks: Concept to Realization (Washington, DC, 1987), IEEE Computer Society Press, pp NewsletterInfo: Lazar, A. A., and Robertazzi, T. G. Markovian Petri Net Protocols with Product Form Solution. Performance Evaluation 12, 1 (jan 1991), NewsletterInfo: Muntz, R. R. Poisson departure processes and queueing networks. Tech. Rep. IBM Research Report RC4145, Yorktown Heights, New York, 1972.

Stochastic models in product form: the (E)RCAT methodology

Stochastic models in product form: the (E)RCAT methodology Stochastic models in product form: the (E)RCAT methodology 1 Maria Grazia Vigliotti 2 1 Dipartimento di Informatica Università Ca Foscari di Venezia 2 Department of Computing Imperial College London Second

More information

Composition of product-form Generalized Stochastic Petri Nets: a modular approach

Composition of product-form Generalized Stochastic Petri Nets: a modular approach Composition of product-form Generalized Stochastic Petri Nets: a modular approach Università Ca Foscari di Venezia Dipartimento di Informatica Italy October 2009 Markov process: steady state analysis Problems

More information

A tool for the numerical solution of cooperating Markov chains in product-form

A tool for the numerical solution of cooperating Markov chains in product-form HET-NETs 2010 ISBN XXX XXX pp. xx xx A tool for the numerical solution of cooperating Markov chains in product-form SIMONETTA BALSAMO GIAN-LUCA DEI ROSSI ANDREA MARIN a a Università Ca Foscari di Venezia

More information

A general algorithm to compute the steady-state solution of product-form cooperating Markov chains

A general algorithm to compute the steady-state solution of product-form cooperating Markov chains A general algorithm to compute the steady-state solution of product-form cooperating Markov chains Università Ca Foscari di Venezia Dipartimento di Informatica Italy 2009 Presentation outline 1 Product-form

More information

Stochastic Petri Net. Ben, Yue (Cindy) 2013/05/08

Stochastic Petri Net. Ben, Yue (Cindy) 2013/05/08 Stochastic Petri Net 2013/05/08 2 To study a formal model (personal view) Definition (and maybe history) Brief family tree: the branches and extensions Advantages and disadvantages for each Applications

More information

MODELLING DYNAMIC RELIABILITY VIA FLUID PETRI NETS

MODELLING DYNAMIC RELIABILITY VIA FLUID PETRI NETS MODELLING DYNAMIC RELIABILITY VIA FLUID PETRI NETS Daniele Codetta-Raiteri, Dipartimento di Informatica, Università di Torino, Italy Andrea Bobbio, Dipartimento di Informatica, Università del Piemonte

More information

A REACHABLE THROUGHPUT UPPER BOUND FOR LIVE AND SAFE FREE CHOICE NETS VIA T-INVARIANTS

A REACHABLE THROUGHPUT UPPER BOUND FOR LIVE AND SAFE FREE CHOICE NETS VIA T-INVARIANTS A REACHABLE THROUGHPUT UPPER BOUND FOR LIVE AND SAFE FREE CHOICE NETS VIA T-INVARIANTS Francesco Basile, Ciro Carbone, Pasquale Chiacchio Dipartimento di Ingegneria Elettrica e dell Informazione, Università

More information

The decoupling assumption in large stochastic system analysis Talk at ECLT

The decoupling assumption in large stochastic system analysis Talk at ECLT The decoupling assumption in large stochastic system analysis Talk at ECLT Andrea Marin 1 1 Dipartimento di Scienze Ambientali, Informatica e Statistica Università Ca Foscari Venezia, Italy (University

More information

Product-form in G-networks

Product-form in G-networks PROBABILITY IN THE ENGINEERING AND INFORMATIONAL SCIENCES Product-form in G-networks Andrea Marin Abstract The introduction of the class of queueing networks called G-networks by Gelenbe has been a breakthrough

More information

Stochastic Petri Nets. Jonatan Lindén. Modelling SPN GSPN. Performance measures. Almost none of the theory. December 8, 2010

Stochastic Petri Nets. Jonatan Lindén. Modelling SPN GSPN. Performance measures. Almost none of the theory. December 8, 2010 Stochastic Almost none of the theory December 8, 2010 Outline 1 2 Introduction A Petri net (PN) is something like a generalized automata. A Stochastic Petri Net () a stochastic extension to Petri nets,

More information

STRUCTURED SOLUTION OF STOCHASTIC DSSP SYSTEMS

STRUCTURED SOLUTION OF STOCHASTIC DSSP SYSTEMS STRUCTURED SOLUTION OF STOCHASTIC DSSP SYSTEMS J. Campos, S. Donatelli, and M. Silva Departamento de Informática e Ingeniería de Sistemas Centro Politécnico Superior, Universidad de Zaragoza jcampos,silva@posta.unizar.es

More information

Proxel-Based Simulation of Stochastic Petri Nets Containing Immediate Transitions

Proxel-Based Simulation of Stochastic Petri Nets Containing Immediate Transitions Electronic Notes in Theoretical Computer Science Vol. 85 No. 4 (2003) URL: http://www.elsevier.nl/locate/entsc/volume85.html Proxel-Based Simulation of Stochastic Petri Nets Containing Immediate Transitions

More information

From Stochastic Processes to Stochastic Petri Nets

From Stochastic Processes to Stochastic Petri Nets From Stochastic Processes to Stochastic Petri Nets Serge Haddad LSV CNRS & ENS Cachan & INRIA Saclay Advanced Course on Petri Nets, the 16th September 2010, Rostock 1 Stochastic Processes and Markov Chains

More information

The Need for and the Advantages of Generalized Tensor Algebra for Kronecker Structured Representations

The Need for and the Advantages of Generalized Tensor Algebra for Kronecker Structured Representations The Need for and the Advantages of Generalized Tensor Algebra for Kronecker Structured Representations Leonardo Brenner, Paulo Fernandes, and Afonso Sales PUCRS, Av Ipiranga, 6681-90619-900 - Porto Alegre,

More information

ADVANCED ROBOTICS. PLAN REPRESENTATION Generalized Stochastic Petri nets and Markov Decision Processes

ADVANCED ROBOTICS. PLAN REPRESENTATION Generalized Stochastic Petri nets and Markov Decision Processes ADVANCED ROBOTICS PLAN REPRESENTATION Generalized Stochastic Petri nets and Markov Decision Processes Pedro U. Lima Instituto Superior Técnico/Instituto de Sistemas e Robótica September 2009 Reviewed April

More information

On the relations among product-form stochastic models

On the relations among product-form stochastic models Università Ca Foscari di Venezia Dipartimento di Informatica Dottorato di Ricerca in Informatica, 21 o Ciclo (A.A. 2005/2006 2007/2008) Tesi di dottorato: TD-2009-2 Settore scientifico disciplinare: INF/01

More information

Stochastic Petri Net

Stochastic Petri Net Stochastic Petri Net Serge Haddad LSV ENS Cachan, Université Paris-Saclay & CNRS & INRIA haddad@lsv.ens-cachan.fr Petri Nets 2016, June 20th 2016 1 Stochastic Petri Net 2 Markov Chain 3 Markovian Stochastic

More information

Analysis and Optimization of Discrete Event Systems using Petri Nets

Analysis and Optimization of Discrete Event Systems using Petri Nets Volume 113 No. 11 2017, 1 10 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu Analysis and Optimization of Discrete Event Systems using Petri Nets

More information

THROUGHPUT ANALYSIS OF MANUFACTURING CELLS USING TIMED PETRI NETS

THROUGHPUT ANALYSIS OF MANUFACTURING CELLS USING TIMED PETRI NETS c 1994 IEEE. Published in the Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, San Antonio, TX, October 2 5, 1994. Personal use of this material is permitted. However,

More information

Markovian Agents: A New Quantitative Analytical Framework for Large-Scale Distributed Interacting Systems

Markovian Agents: A New Quantitative Analytical Framework for Large-Scale Distributed Interacting Systems Markovian Agents: A New Quantitative Analytical Framework for Large-Scale Distributed Interacting Systems Andrea Bobbio, Dipartimento di Informatica, Università del Piemonte Orientale, 15121 Alessandria,

More information

Varieties of Stochastic Calculi

Varieties of Stochastic Calculi Research is what I'm doing when I don't know what I'm doing. Wernher Von Braun. Artificial Biochemistry Varieties of Stochastic Calculi Microsoft Research Trento, 26-5-22..26 www.luca.demon.co.uk/artificialbiochemistry.htm

More information

Lecture 20: Reversible Processes and Queues

Lecture 20: Reversible Processes and Queues Lecture 20: Reversible Processes and Queues 1 Examples of reversible processes 11 Birth-death processes We define two non-negative sequences birth and death rates denoted by {λ n : n N 0 } and {µ n : n

More information

Networks of Queues Models with Several. Classes of Customers and Exponential. Service Times

Networks of Queues Models with Several. Classes of Customers and Exponential. Service Times Applied Mathematical Sciences, Vol. 9, 2015, no. 76, 3789-3796 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2015.53287 Networks of Queues Models with Several Classes of Customers and Exponential

More information

LIMITING PROBABILITY TRANSITION MATRIX OF A CONDENSED FIBONACCI TREE

LIMITING PROBABILITY TRANSITION MATRIX OF A CONDENSED FIBONACCI TREE International Journal of Applied Mathematics Volume 31 No. 18, 41-49 ISSN: 1311-178 (printed version); ISSN: 1314-86 (on-line version) doi: http://dx.doi.org/1.173/ijam.v31i.6 LIMITING PROBABILITY TRANSITION

More information

Petri Net Modeling of Irrigation Canal Networks

Petri Net Modeling of Irrigation Canal Networks Petri Net Modeling of Irrigation Canal Networks Giorgio Corriga, Alessandro Giua, Giampaolo Usai DIEE: Dip. di Ingegneria Elettrica ed Elettronica Università di Cagliari P.zza d Armi 09123 CAGLIARI, Italy

More information

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems  M/M/1  M/M/m  M/M/1/K Queueing Theory I Summary Little s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K " Little s Law a(t): the process that counts the number of arrivals

More information

Reward Based Congruences: Can We Aggregate More?

Reward Based Congruences: Can We Aggregate More? Reward Based Congruences: Can We Aggregate More? Marco Bernardo and Mario Bravetti 2 Università di Torino, Dipartimento di Informatica Corso Svizzera 85, 049 Torino, Italy bernardo@di.unito.it 2 Università

More information

Control of Hybrid Petri Nets using Max-Plus Algebra

Control of Hybrid Petri Nets using Max-Plus Algebra Control of Hybrid Petri Nets using Max-Plus Algebra FABIO BALDUZZI*, ANGELA DI FEBBRARO*, ALESSANDRO GIUA, SIMONA SACONE^ *Dipartimento di Automatica e Informatica Politecnico di Torino Corso Duca degli

More information

Population models from PEPA descriptions

Population models from PEPA descriptions Population models from PEPA descriptions Jane Hillston LFCS, The University of Edinburgh, Edinburgh EH9 3JZ, Scotland. Email: jeh@inf.ed.ac.uk 1 Introduction Stochastic process algebras (e.g. PEPA [10],

More information

Q = (c) Assuming that Ricoh has been working continuously for 7 days, what is the probability that it will remain working at least 8 more days?

Q = (c) Assuming that Ricoh has been working continuously for 7 days, what is the probability that it will remain working at least 8 more days? IEOR 4106: Introduction to Operations Research: Stochastic Models Spring 2005, Professor Whitt, Second Midterm Exam Chapters 5-6 in Ross, Thursday, March 31, 11:00am-1:00pm Open Book: but only the Ross

More information

AN INTRODUCTION TO DISCRETE-EVENT SIMULATION

AN INTRODUCTION TO DISCRETE-EVENT SIMULATION AN INTRODUCTION TO DISCRETE-EVENT SIMULATION Peter W. Glynn 1 Peter J. Haas 2 1 Dept. of Management Science and Engineering Stanford University 2 IBM Almaden Research Center San Jose, CA CAVEAT: WE ARE

More information

Stochastic Petri Net

Stochastic Petri Net Stochastic Petri Net Serge Haddad LSV ENS Cachan & CNRS & INRIA haddad@lsv.ens-cachan.fr Petri Nets 2013, June 24th 2013 1 Stochastic Petri Net 2 Markov Chain 3 Markovian Stochastic Petri Net 4 Generalized

More information

Modeling Continuous Systems Using Modified Petri Nets Model

Modeling Continuous Systems Using Modified Petri Nets Model Journal of Modeling & Simulation in Electrical & Electronics Engineering (MSEEE) 9 Modeling Continuous Systems Using Modified Petri Nets Model Abbas Dideban, Alireza Ahangarani Farahani, and Mohammad Razavi

More information

MQNA - Markovian Queueing Networks Analyser

MQNA - Markovian Queueing Networks Analyser FACULDADE DE INFORMÁTICA PUCRS - Brazil http://www.pucrs.br/inf/pos/ MQNA - Markovian Queueing Networks Analyser L. Brenner, P. Fernandes, A. Sales Technical Report Series Number 030 September, 2003 Contact:

More information

SPN 2003 Preliminary Version. Translating Hybrid Petri Nets into Hybrid. Automata 1. Dipartimento di Informatica. Universita di Torino

SPN 2003 Preliminary Version. Translating Hybrid Petri Nets into Hybrid. Automata 1. Dipartimento di Informatica. Universita di Torino SPN 2003 Preliminary Version Translating Hybrid Petri Nets into Hybrid Automata 1 Marco Gribaudo 2 and Andras Horvath 3 Dipartimento di Informatica Universita di Torino Corso Svizzera 185, 10149 Torino,

More information

(implicitly assuming time-homogeneity from here on)

(implicitly assuming time-homogeneity from here on) Continuous-Time Markov Chains Models Tuesday, November 15, 2011 2:02 PM The fundamental object describing the dynamics of a CTMC (continuous-time Markov chain) is the probability transition (matrix) function:

More information

STA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008

STA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008 Name STA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008 There are five questions on this test. DO use calculators if you need them. And then a miracle occurs is not a valid answer. There

More information

MQNA - Markovian Queueing Networks Analyser

MQNA - Markovian Queueing Networks Analyser MQNA - Markovian Queueing Networks Analyser Leonardo Brenner Paulo Fernandes Afonso Sales PUCRS, Brazil PUCRS, Brazil PUCRS, Brazil lbrenner@inf.pucrs.br paulof@inf.pucrs.br asales@inf.pucrs.br Abstract

More information

DES. 4. Petri Nets. Introduction. Different Classes of Petri Net. Petri net properties. Analysis of Petri net models

DES. 4. Petri Nets. Introduction. Different Classes of Petri Net. Petri net properties. Analysis of Petri net models 4. Petri Nets Introduction Different Classes of Petri Net Petri net properties Analysis of Petri net models 1 Petri Nets C.A Petri, TU Darmstadt, 1962 A mathematical and graphical modeling method. Describe

More information

OPTIMAL TOKEN ALLOCATION IN TIMED CYCLIC EVENT GRAPHS

OPTIMAL TOKEN ALLOCATION IN TIMED CYCLIC EVENT GRAPHS OPTIMAL TOKEN ALLOCATION IN TIMED CYCLIC EVENT GRAPHS Alessandro Giua, Aldo Piccaluga, Carla Seatzu Department of Electrical and Electronic Engineering, University of Cagliari, Italy giua@diee.unica.it

More information

MULTI-ORDERED POSETS. Lisa Bishop Department of Mathematics, Occidental College, Los Angeles, CA 90041, United States.

MULTI-ORDERED POSETS. Lisa Bishop Department of Mathematics, Occidental College, Los Angeles, CA 90041, United States. INTEGERS: ELECTRONIC JOURNAL OF COMBINATORIAL NUMBER THEORY 7 (2007), #A06 MULTI-ORDERED POSETS Lisa Bishop Department of Mathematics, Occidental College, Los Angeles, CA 90041, United States lbishop@oxy.edu

More information

Rapporto di Ricerca CS G. Busetto, E. Jabara

Rapporto di Ricerca CS G. Busetto, E. Jabara UNIVERSITÀ CA FOSCARI DI VENEZIA Dipartimento di Informatica Technical Report Series in Computer Science Rapporto di Ricerca CS-2005-12 Ottobre 2005 G. Busetto, E. Jabara Some observations on factorized

More information

A fixed-point approximation accounting for link interactions in a loss network

A fixed-point approximation accounting for link interactions in a loss network A fixed-point approximation accounting for link interactions in a loss network MR Thompson PK Pollett Department of Mathematics The University of Queensland Abstract This paper is concerned with evaluating

More information

reversed chain is ergodic and has the same equilibrium probabilities (check that π j =

reversed chain is ergodic and has the same equilibrium probabilities (check that π j = Lecture 10 Networks of queues In this lecture we shall finally get around to consider what happens when queues are part of networks (which, after all, is the topic of the course). Firstly we shall need

More information

of Business Workows using Generalized Stochastic Petri Nets A. Ferscha Institut fur Angewandte Informatik und Informationssysteme Universitat Wien

of Business Workows using Generalized Stochastic Petri Nets A. Ferscha Institut fur Angewandte Informatik und Informationssysteme Universitat Wien Qualitative and Quantitative Analysis of Business Workows using Generalized Stochastic Petri Nets A. Ferscha Institut fur Angewandte Informatik und Informationssysteme Universitat Wien Lenaugasse 2/8,

More information

6 Solving Queueing Models

6 Solving Queueing Models 6 Solving Queueing Models 6.1 Introduction In this note we look at the solution of systems of queues, starting with simple isolated queues. The benefits of using predefined, easily classified queues will

More information

Countable state discrete time Markov Chains

Countable state discrete time Markov Chains Countable state discrete time Markov Chains Tuesday, March 18, 2014 2:12 PM Readings: Lawler Ch. 2 Karlin & Taylor Chs. 2 & 3 Resnick Ch. 1 Countably infinite state spaces are of practical utility in situations

More information

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1 Queueing systems Renato Lo Cigno Simulation and Performance Evaluation 2014-15 Queueing systems - Renato Lo Cigno 1 Queues A Birth-Death process is well modeled by a queue Indeed queues can be used to

More information

7. Queueing Systems. 8. Petri nets vs. State Automata

7. Queueing Systems. 8. Petri nets vs. State Automata Petri Nets 1. Finite State Automata 2. Petri net notation and definition (no dynamics) 3. Introducing State: Petri net marking 4. Petri net dynamics 5. Capacity Constrained Petri nets 6. Petri net models

More information

Proceedings of the 2012 Winter Simulation Conference C. Laroque, J. Himmelspach, R. Pasupathy, O. Rose, and A. M. Uhrmacher, eds.

Proceedings of the 2012 Winter Simulation Conference C. Laroque, J. Himmelspach, R. Pasupathy, O. Rose, and A. M. Uhrmacher, eds. Proceedings of the 2012 Winter Simulation Conference C. Laroque, J. Himmelspach, R. Pasupathy, O. Rose, and A. M. Uhrmacher, eds. EFFICIENT SIMULATION OF STOCHASTIC WELL-FORMED NETS THROUGH SYMMETRY EXPLOITATION

More information

Minicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics

Minicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics Minicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics Eric Slud, Statistics Program Lecture 1: Metropolis-Hastings Algorithm, plus background in Simulation and Markov Chains. Lecture

More information

CS 798: Homework Assignment 3 (Queueing Theory)

CS 798: Homework Assignment 3 (Queueing Theory) 1.0 Little s law Assigned: October 6, 009 Patients arriving to the emergency room at the Grand River Hospital have a mean waiting time of three hours. It has been found that, averaged over the period of

More information

DISCRETE-TIME MARKOVIAN STOCHASTIC PETRI NETS

DISCRETE-TIME MARKOVIAN STOCHASTIC PETRI NETS 20 DISCRETE-TIME MARKOVIAN STOCHASTIC PETRI NETS Gianfranco Ciardo 1 Department of Computer Science, College of William and Mary Williamsburg, VA 23187-8795, USA ciardo@cs.wm.edu ABSTRACT We revisit and

More information

Markov Chain Model for ALOHA protocol

Markov Chain Model for ALOHA protocol Markov Chain Model for ALOHA protocol Laila Daniel and Krishnan Narayanan April 22, 2012 Outline of the talk A Markov chain (MC) model for Slotted ALOHA Basic properties of Discrete-time Markov Chain Stability

More information

CRAS TECHNICAL REPOR~

CRAS TECHNICAL REPOR~ STATE UNIVERSITY OF NEW YORK AT STONY BROOK CRAS TECHNICAL REPOR~ Fast Decomposable Solution for a Class of Non-Product Queueing Networks Form R.-X. Ni and T.G. Robertazzi August 7, 1991 Fast Decomposable

More information

A review of Continuous Time MC STA 624, Spring 2015

A review of Continuous Time MC STA 624, Spring 2015 A review of Continuous Time MC STA 624, Spring 2015 Ruriko Yoshida Dept. of Statistics University of Kentucky polytopes.net STA 624 1 Continuous Time Markov chains Definition A continuous time stochastic

More information

NONBLOCKING CONTROL OF PETRI NETS USING UNFOLDING. Alessandro Giua Xiaolan Xie

NONBLOCKING CONTROL OF PETRI NETS USING UNFOLDING. Alessandro Giua Xiaolan Xie NONBLOCKING CONTROL OF PETRI NETS USING UNFOLDING Alessandro Giua Xiaolan Xie Dip. Ing. Elettrica ed Elettronica, U. di Cagliari, Italy. Email: giua@diee.unica.it INRIA/MACSI Team, ISGMP, U. de Metz, France.

More information

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes CDA6530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic process X = {X(t), t2 T} is a collection of random variables (rvs); one rv

More information

Introduction to Markov Chains, Queuing Theory, and Network Performance

Introduction to Markov Chains, Queuing Theory, and Network Performance Introduction to Markov Chains, Queuing Theory, and Network Performance Marceau Coupechoux Telecom ParisTech, departement Informatique et Réseaux marceau.coupechoux@telecom-paristech.fr IT.2403 Modélisation

More information

TPN are devoted to specify and verify properties of systems where timing is a critical parameter that may affect the behavior of the system. In this l

TPN are devoted to specify and verify properties of systems where timing is a critical parameter that may affect the behavior of the system. In this l URL: http://www.elsevier.nl/locate/entcs/volume52.html 8 pages Petri Nets with Discrete Phase Type Timing: A Bridge Between Stochastic and Functional Analysis Andrea Bobbio DISTA, Universit a del Piemonte

More information

UNIVERSITÀ CA FOSCARI DI VENEZIA Dipartimento di Informatica Technical Report Series in Computer Science. Rapporto di Ricerca CS

UNIVERSITÀ CA FOSCARI DI VENEZIA Dipartimento di Informatica Technical Report Series in Computer Science. Rapporto di Ricerca CS UNIVERSITÀ CA FOSCARI DI VENEZIA Dipartimento di Informatica Technical Report Series in Computer Science Rapporto di Ricerca CS-2005-2 Marzo 2005 Paolo Baldan, Andrea Corradini, Ugo Montanari, Leila Ribeiro

More information

Stochastic2010 Page 1

Stochastic2010 Page 1 Stochastic2010 Page 1 Extinction Probability for Branching Processes Friday, April 02, 2010 2:03 PM Long-time properties for branching processes Clearly state 0 is an absorbing state, forming its own recurrent

More information

Contents Preface The Exponential Distribution and the Poisson Process Introduction to Renewal Theory

Contents Preface The Exponential Distribution and the Poisson Process Introduction to Renewal Theory Contents Preface... v 1 The Exponential Distribution and the Poisson Process... 1 1.1 Introduction... 1 1.2 The Density, the Distribution, the Tail, and the Hazard Functions... 2 1.2.1 The Hazard Function

More information

Queuing Theory. Using the Math. Management Science

Queuing Theory. Using the Math. Management Science Queuing Theory Using the Math 1 Markov Processes (Chains) A process consisting of a countable sequence of stages, that can be judged at each stage to fall into future states independent of how the process

More information

Intro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin

Intro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin Queuing Networks Florence Perronnin Polytech Grenoble - UGA March 23, 27 F. Perronnin (UGA) Queuing Networks March 23, 27 / 46 Outline Introduction to Queuing Networks 2 Refresher: M/M/ queue 3 Reversibility

More information

Time(d) Petri Net. Serge Haddad. Petri Nets 2016, June 20th LSV ENS Cachan, Université Paris-Saclay & CNRS & INRIA

Time(d) Petri Net. Serge Haddad. Petri Nets 2016, June 20th LSV ENS Cachan, Université Paris-Saclay & CNRS & INRIA Time(d) Petri Net Serge Haddad LSV ENS Cachan, Université Paris-Saclay & CNRS & INRIA haddad@lsv.ens-cachan.fr Petri Nets 2016, June 20th 2016 1 Time and Petri Nets 2 Time Petri Net: Syntax and Semantic

More information

HYPENS Manual. Fausto Sessego, Alessandro Giua, Carla Seatzu. February 7, 2008

HYPENS Manual. Fausto Sessego, Alessandro Giua, Carla Seatzu. February 7, 2008 HYPENS Manual Fausto Sessego, Alessandro Giua, Carla Seatzu February 7, 28 HYPENS is an open source tool to simulate timed discrete, continuous and hybrid Petri nets. It has been developed in Matlab to

More information

A NOTE ON FAITHFUL TRACES ON A VON NEUMANN ALGEBRA

A NOTE ON FAITHFUL TRACES ON A VON NEUMANN ALGEBRA A NOTE ON FAITHFUL TRACES ON A VON NEUMANN ALGEBRA F. BAGARELLO, C. TRAPANI, AND S. TRIOLO Abstract. In this short note we give some techniques for constructing, starting from a sufficient family F of

More information

Queueing Networks G. Rubino INRIA / IRISA, Rennes, France

Queueing Networks G. Rubino INRIA / IRISA, Rennes, France Queueing Networks G. Rubino INRIA / IRISA, Rennes, France February 2006 Index 1. Open nets: Basic Jackson result 2 2. Open nets: Internet performance evaluation 18 3. Closed nets: Basic Gordon-Newell result

More information

TAYLOR POLYNOMIALS DARYL DEFORD

TAYLOR POLYNOMIALS DARYL DEFORD TAYLOR POLYNOMIALS DARYL DEFORD 1. Introduction We have seen in class that Taylor polynomials provide us with a valuable tool for approximating many different types of functions. However, in order to really

More information

Applications of Petri Nets

Applications of Petri Nets Applications of Petri Nets Presenter: Chung-Wei Lin 2010.10.28 Outline Revisiting Petri Nets Application 1: Software Syntheses Theory and Algorithm Application 2: Biological Networks Comprehensive Introduction

More information

Faithful couplings of Markov chains: now equals forever

Faithful couplings of Markov chains: now equals forever Faithful couplings of Markov chains: now equals forever by Jeffrey S. Rosenthal* Department of Statistics, University of Toronto, Toronto, Ontario, Canada M5S 1A1 Phone: (416) 978-4594; Internet: jeff@utstat.toronto.edu

More information

THE simulation of a continuous or discrete time system

THE simulation of a continuous or discrete time system 770 IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART B: CYBERNETICS, VOL. 28, NO. 6, DECEMBER 1998 Discrete Event Representation of Qualitative Models Using Petri Nets Alessandra Fanni, Member,

More information

4452 Mathematical Modeling Lecture 16: Markov Processes

4452 Mathematical Modeling Lecture 16: Markov Processes Math Modeling Lecture 16: Markov Processes Page 1 4452 Mathematical Modeling Lecture 16: Markov Processes Introduction A stochastic model is one in which random effects are incorporated into the model.

More information

Markov chains. Randomness and Computation. Markov chains. Markov processes

Markov chains. Randomness and Computation. Markov chains. Markov processes Markov chains Randomness and Computation or, Randomized Algorithms Mary Cryan School of Informatics University of Edinburgh Definition (Definition 7) A discrete-time stochastic process on the state space

More information

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18. IEOR 6711: Stochastic Models I, Fall 23, Professor Whitt Solutions to Final Exam: Thursday, December 18. Below are six questions with several parts. Do as much as you can. Show your work. 1. Two-Pump Gas

More information

Lecture 4 The stochastic ingredient

Lecture 4 The stochastic ingredient Lecture 4 The stochastic ingredient Luca Bortolussi 1 Alberto Policriti 2 1 Dipartimento di Matematica ed Informatica Università degli studi di Trieste Via Valerio 12/a, 34100 Trieste. luca@dmi.units.it

More information

Markov Chains. Chapter 16. Markov Chains - 1

Markov Chains. Chapter 16. Markov Chains - 1 Markov Chains Chapter 16 Markov Chains - 1 Why Study Markov Chains? Decision Analysis focuses on decision making in the face of uncertainty about one future event. However, many decisions need to consider

More information

Math 304 Handout: Linear algebra, graphs, and networks.

Math 304 Handout: Linear algebra, graphs, and networks. Math 30 Handout: Linear algebra, graphs, and networks. December, 006. GRAPHS AND ADJACENCY MATRICES. Definition. A graph is a collection of vertices connected by edges. A directed graph is a graph all

More information

DECOMPOSITION OF PETRI NETS

DECOMPOSITION OF PETRI NETS Cybernetics and Systems Analysis, Vol. 40, No. 5, 2004 DECOMPOSITION OF PETRI NETS D. A. Zaitsev UDC 519.74 The problem of splitting any given Petri net into functional subnets is considered. The properties

More information

Toward a Definition of Modeling Power for Stochastic Petri Net Models

Toward a Definition of Modeling Power for Stochastic Petri Net Models Toward a Definition of Modeling Power for Stochastic Petri Net Models Gianfranco Ciardo Duke University Proc. of the Int. Workshop on Petri Nets and Performance Models, Madison, Wisconsin, August 1987

More information

On Quadratic Stochastic Operators Having Three Fixed Points

On Quadratic Stochastic Operators Having Three Fixed Points Journal of Physics: Conference Series PAPER OPEN ACCESS On Quadratic Stochastic Operators Having Three Fixed Points To cite this article: Mansoor Saburov and Nur Atikah Yusof 2016 J. Phys.: Conf. Ser.

More information

On Polynomial Cases of the Unichain Classification Problem for Markov Decision Processes

On Polynomial Cases of the Unichain Classification Problem for Markov Decision Processes On Polynomial Cases of the Unichain Classification Problem for Markov Decision Processes Eugene A. Feinberg Department of Applied Mathematics and Statistics State University of New York at Stony Brook

More information

Solution of the Inverse Frobenius Perron Problem for Semi Markov Chaotic Maps via Recursive Markov State Disaggregation

Solution of the Inverse Frobenius Perron Problem for Semi Markov Chaotic Maps via Recursive Markov State Disaggregation Solution of the Inverse Frobenius Perron Problem for Semi Markov Chaotic Maps via Recursive Markov State Disaggregation Andre McDonald Council for Scientific and Industrial Research Brummeria, South Africa

More information

Stochastic Simulation.

Stochastic Simulation. Stochastic Simulation. (and Gillespie s algorithm) Alberto Policriti Dipartimento di Matematica e Informatica Istituto di Genomica Applicata A. Policriti Stochastic Simulation 1/20 Quote of the day D.T.

More information

ON MAIN CHARACTERISTICS OF THE M/M/1/N QUEUE WITH SINGLE AND BATCH ARRIVALS AND THE QUEUE SIZE CONTROLLED BY AQM ALGORITHMS

ON MAIN CHARACTERISTICS OF THE M/M/1/N QUEUE WITH SINGLE AND BATCH ARRIVALS AND THE QUEUE SIZE CONTROLLED BY AQM ALGORITHMS K Y B E R N E T I K A V O L U M E 4 7 ( 2 0 1 1 ), N U M B E R 6, P A G E S 9 3 0 9 4 3 ON MAIN CHARACTERISTICS OF THE M/M/1/N QUEUE WITH SINGLE AND BATCH ARRIVALS AND THE QUEUE SIZE CONTROLLED BY AQM

More information

Many proofs that the primes are infinite J. Marshall Ash 1 and T. Kyle Petersen

Many proofs that the primes are infinite J. Marshall Ash 1 and T. Kyle Petersen Many proofs that the primes are infinite J. Marshall Ash and T. Kyle Petersen Theorem. There are infinitely many prime numbers. How many proofs do you know that there are infinitely many primes? Nearly

More information

Neural Networks for Machine Learning. Lecture 11a Hopfield Nets

Neural Networks for Machine Learning. Lecture 11a Hopfield Nets Neural Networks for Machine Learning Lecture 11a Hopfield Nets Geoffrey Hinton Nitish Srivastava, Kevin Swersky Tijmen Tieleman Abdel-rahman Mohamed Hopfield Nets A Hopfield net is composed of binary threshold

More information

Part I Stochastic variables and Markov chains

Part I Stochastic variables and Markov chains Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)

More information

SAMPLING AND INVERSION

SAMPLING AND INVERSION SAMPLING AND INVERSION Darryl Veitch dveitch@unimelb.edu.au CUBIN, Department of Electrical & Electronic Engineering University of Melbourne Workshop on Sampling the Internet, Paris 2005 A TALK WITH TWO

More information

N.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a

N.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a WHEN IS A MAP POISSON N.G.Bean, D.A.Green and P.G.Taylor Department of Applied Mathematics University of Adelaide Adelaide 55 Abstract In a recent paper, Olivier and Walrand (994) claimed that the departure

More information

The Markov Decision Process (MDP) model

The Markov Decision Process (MDP) model Decision Making in Robots and Autonomous Agents The Markov Decision Process (MDP) model Subramanian Ramamoorthy School of Informatics 25 January, 2013 In the MAB Model We were in a single casino and the

More information

Homework 4 due on Thursday, December 15 at 5 PM (hard deadline).

Homework 4 due on Thursday, December 15 at 5 PM (hard deadline). Large-Time Behavior for Continuous-Time Markov Chains Friday, December 02, 2011 10:58 AM Homework 4 due on Thursday, December 15 at 5 PM (hard deadline). How are formulas for large-time behavior of discrete-time

More information

Time and Timed Petri Nets

Time and Timed Petri Nets Time and Timed Petri Nets Serge Haddad LSV ENS Cachan & CNRS & INRIA haddad@lsv.ens-cachan.fr DISC 11, June 9th 2011 1 Time and Petri Nets 2 Timed Models 3 Expressiveness 4 Analysis 1/36 Outline 1 Time

More information

IEOR 6711, HMWK 5, Professor Sigman

IEOR 6711, HMWK 5, Professor Sigman IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.

More information

On Stability and Sojourn Time of Peer-to-Peer Queuing Systems

On Stability and Sojourn Time of Peer-to-Peer Queuing Systems On Stability and Sojourn Time of Peer-to-Peer Queuing Systems Taoyu Li Minghua Chen Tony Lee Xing Li Tsinghua University, Beijing, China. {ldy03@mails.tsinghua.edu.cn,xing@cernet.edu.cn} The Chinese University

More information

The Scale Factor: A New Degree of Freedom in Phase Type Approximation

The Scale Factor: A New Degree of Freedom in Phase Type Approximation The Scale Factor: A New Degree of Freedom in Phase Type Approximation Andrea Bobbio DISTA, Università del Piemonte Orientale, Alessandria, Italy,bobbio@unipmn.it András Horváth, Miklós Telek Dept. of Telecommunications,

More information

Specification models and their analysis Petri Nets

Specification models and their analysis Petri Nets Specification models and their analysis Petri Nets Kai Lampka December 10, 2010 1 30 Part I Petri Nets Basics Petri Nets Introduction A Petri Net (PN) is a weighted(?), bipartite(?) digraph(?) invented

More information

ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS

ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS J.R. ARTALEJO, Department of Statistics and Operations Research, Faculty of Mathematics, Complutense University of Madrid,

More information