A comment on Boucherie product-form results
|
|
- Meghan Day
- 6 years ago
- Views:
Transcription
1 A comment on Boucherie product-form results Andrea Marin Dipartimento di Informatica Università Ca Foscari di Venezia Via Torino 155, Venezia Mestre, Italy Abstract. This is a sketch about Boucherie paper on product form. It is quite informal, for a deeper view we suggest to study the interesting paper [2]. Our aim is just to point out the main main conditions for this product form. 1 The Boucherie result on the product form The starting CTMCs In this section we summarize the results presented in [2]. Let us consider K stable and regular CTMCs. The state spaces S 1,... S K of the CTMCs are finite or countable. Let q k (n k, n k ) be the transition rate from state n k to n k of k-th CTMC. Let π k : S k [0, 1] denote the normalized stationary probability function, i.e., n k S k π k (n k ) = 1. Let n = (n 1,..., n K ) with n k S k and k = 1,..., K be a state of the composed process. Clearly if the CTMCs are independent we have product form, i.e., π(n) = K k=1 π k(n k ). The competition Let use introduce an index set I. Intuitively I is a set which labels the resources. In each state a CTMC uses one and only one resource. So we can partition a state space S k in I mutually exclusive sets A ki such that: i I A ki = S k A ki If CTMCs k 1 and k 2 compete over resources i then this means that the combined process does not reach the state n where components n k1 A k1 i and n k2 A k2 i. We denote with C ki the set of CTMCs which compete with CTMC k on the resource i I. The product form condition Let us study the process with state space S = S 1... S k and let us define the following transition matrix for the CTMC on S: q(n, n ) = K k=1 [ q k (n k, n k) K r=1,r k Note that the definition of q is such that: ] 1(n r = n r)1(n r A ri = k / C ri ). (1)
2 It is impossible to reach a state where two CTMCs use a resource i I if they are in conflict on i. This means that the state space of the composed process can be reduced excluding the no-reachable states. Given two adjacent states n and n then just a single CTMC k changes its state, i.e., state n and state n differ just by the component k which changes from n k to n k, with k = 1,..., K. The transition rate from n to n is determined only by the transition rate between states n k and n k of the k th Markov chain. Suppose that CTMCs k, k conflict on resource i. Then when one of the two CTMCs is in a state belonging to the set A ki or A k i the other Markov chain cannot change its state at all. This is probably the main limit of this approach to the product form. We shall comment this condition in the conclusions. Boucherie gives the following important result on the stationary distribution of the composed process: K π(n) = B π k (n k ), (2) k=1 where n is a reachable state and B a normalizing constant. 2 An example Let us consider two identical CTMCs as showed in Figure 1. Fig. 1. Example CTMC Clearly the Markov chain is ergodic and its stationary probabilities are π(n) = 1 3 for n = a, b, c. Let us now define the competition. Suppose I = {1, 2}
3 and A k1 = {a, c}, A k2 = {b} and C 12 = {2}, C 22 = {1}, C k1 =, with k = 1, 2. In Figure 1 we use orange to denote the states which use resource 1 and blue for the state which uses resource 2. Note that competition is just over resource 2. The composed process on S = S 1 S 2 with the transition rates defined by formula 1 has 8 reachable states. By the result expressed by equation 2 we can conclude that the stationary probability of each state is the same, i.e Figure 2 shows the composed process S. Fig. 2. Composed process S. Read the picture as dotted lines are not present. All the transition rates are equal to v. It is easy to see that π(n) = 1 8 CTMC on space S. for all n satisfies the set of GBEs for the 3 Conclusions Boucherie product form condition is very interesting for various reasons. First of all it gives conditions on the Markov Chains so the result can be used as framework for studying the product form conditions for different stochastic model
4 formalisms, such as stochastic process algebra, stochastic Petri nets (SPN), and so on. If we apply Boucherie approach to SPNs, as pointed out in the original work [2], we note a second strength of the result. In fact if we consider Coleman et al. product form on SPNs [6, 3] the authors aim to give a stationary solution which is expressed in terms of product of functions of the number of tokens in each place. This means that, given a SPN, the authors give a set of sufficient conditions for the product form. Boucherie framework, on the other hand, is more suitable for hierarchical modelling. In fact, the idea is that given a set of SPNs (let us call them agent), each one with its associated CTMC, a set of sufficient conditions for the product form solution is defined on the interaction of the agents. However given an SPN it does not appear an easy task identifying algorithmically Boucherie product form: this would require to identify the agents and checking the interaction, but for the low level expressive power of SPNs this would be quite hard. It is worthwhile exploring the consequences of Boucherie conditions for product form. In the following we comment them one by one: The conditions on the single CTMC. These are very general, indeed it is just asked them to be ergodic and to have a unique stationary distribution. The conditions on the composed process state space. The exclusion mechanism appears to be very flexible. Defining a partition on the state space is a really general approach. In the original paper the author gives an example where he shows how the exclusion mechanism can model the availability of multiple resources. The conditions on the composed process transition rates. We think that it is important to understand well the meaning of this key-condition for the product form. Suppose that CTMCs k, k conflict on resource i. Then when one of the two CTMCs is in a state belonging to the set A ki or A k i the other Markov chain cannot change its state at all. In practice suppose you have two identical process which do this task: think }{{} print }{{} a b input data think }{{} c The printing state requires to use of the shared resource printer so there is a competition on that resource. This is basically the CTMC of the example of Section 2 where it is assumed that all the tasks has an exponential distributed duration with the same mean. The point is that Boucherie framework requires that when a process is printing the other one is stopped, independently on the state it is. There are no reasons, from a modelling point of view, for stopping a process which is performing an input action when the other process is printing. In Figure 2, by adding the dotted arcs, one obtains the process how it should be from a modelling point of view. But the product form is lost. It does not appear clear the relation between the class of product form SPNs (PFSPNs). As far as we know we can identify three classes of PFSPNs:
5 1. Lazar an Robertazzi product form [7, 8], 2. Coleman, Henderson, Taylor product form [6, 3] which includes also the product form defined in [5], 3. Boucherie product form [2]. As Boucherie points out in his paper, product form 3 generalizes product form 1, but the relations with 2 should be explored. In fact, even if some conditions are equivalent (e.g. each transition input vector has a correspondent transition output vector [4]) the product form model class is different. For example in [6, 3] the product form condition depends on the transition rate (this problem is overcome in [5] but the model class is smaller) and this has not an equivalent condition on product form 1 and 3. Finally we think that the relation between this conditions on product form and Muntz s M M [9] property should be explored. In [1] are showed some GSPN, i.e. they allow immediate transitions, with an associated Markov chain. It is proved that their composition is in product form, even if they do not fit any of the classes of product form cited here.
6 References 1. Balsamo, S., and Marin, A. On representing multiclass M/M/k queues by generalized stochastic Petri nets. In Proc. of ECMS/ASMTA-2007 conference. To appear. 2. Boucherie, R. J. A characterisation of independence for competing Markov chains with applications to stochastic Petri nets. Tech. Rep. RR Coleman, J. L., Henderson, W., and Taylor, P. G. Product form equilibrium distributions and a convolution algorithm for Stochastic Petri nets. Performance Evaluation 26 (1996), Donatelli, S., and Sereno, M. On the product form solution for stochastic petri nets. In Proceedings of the 13th International Conference on Application and Theory of Petri Nets (London, UK, 1992), Springer-Verlag, pp Haddad, S., Moreaux, P., Sereno, M., and Silva, M. Product-form and stochastic Petri nets: a structural approach. Perform. Eval. 59, 4 (2005), Henderson, W., Lucic, D., and Taylor, P. G. A net level performance analysis of Stochastic Petri Nets. J. Austral. Math. Soc. Ser. B 31 (1989), Lazar, A. A., and Robertazzi, T. G. Markovian Petri Net Protocols with Product Form Solution. In IEEE INFOCOM 87, The Conf. on Computer Communications, Proc., Sixth Annual Conference - Global Networks: Concept to Realization (Washington, DC, 1987), IEEE Computer Society Press, pp NewsletterInfo: Lazar, A. A., and Robertazzi, T. G. Markovian Petri Net Protocols with Product Form Solution. Performance Evaluation 12, 1 (jan 1991), NewsletterInfo: Muntz, R. R. Poisson departure processes and queueing networks. Tech. Rep. IBM Research Report RC4145, Yorktown Heights, New York, 1972.
Stochastic models in product form: the (E)RCAT methodology
Stochastic models in product form: the (E)RCAT methodology 1 Maria Grazia Vigliotti 2 1 Dipartimento di Informatica Università Ca Foscari di Venezia 2 Department of Computing Imperial College London Second
More informationComposition of product-form Generalized Stochastic Petri Nets: a modular approach
Composition of product-form Generalized Stochastic Petri Nets: a modular approach Università Ca Foscari di Venezia Dipartimento di Informatica Italy October 2009 Markov process: steady state analysis Problems
More informationA tool for the numerical solution of cooperating Markov chains in product-form
HET-NETs 2010 ISBN XXX XXX pp. xx xx A tool for the numerical solution of cooperating Markov chains in product-form SIMONETTA BALSAMO GIAN-LUCA DEI ROSSI ANDREA MARIN a a Università Ca Foscari di Venezia
More informationA general algorithm to compute the steady-state solution of product-form cooperating Markov chains
A general algorithm to compute the steady-state solution of product-form cooperating Markov chains Università Ca Foscari di Venezia Dipartimento di Informatica Italy 2009 Presentation outline 1 Product-form
More informationStochastic Petri Net. Ben, Yue (Cindy) 2013/05/08
Stochastic Petri Net 2013/05/08 2 To study a formal model (personal view) Definition (and maybe history) Brief family tree: the branches and extensions Advantages and disadvantages for each Applications
More informationMODELLING DYNAMIC RELIABILITY VIA FLUID PETRI NETS
MODELLING DYNAMIC RELIABILITY VIA FLUID PETRI NETS Daniele Codetta-Raiteri, Dipartimento di Informatica, Università di Torino, Italy Andrea Bobbio, Dipartimento di Informatica, Università del Piemonte
More informationA REACHABLE THROUGHPUT UPPER BOUND FOR LIVE AND SAFE FREE CHOICE NETS VIA T-INVARIANTS
A REACHABLE THROUGHPUT UPPER BOUND FOR LIVE AND SAFE FREE CHOICE NETS VIA T-INVARIANTS Francesco Basile, Ciro Carbone, Pasquale Chiacchio Dipartimento di Ingegneria Elettrica e dell Informazione, Università
More informationThe decoupling assumption in large stochastic system analysis Talk at ECLT
The decoupling assumption in large stochastic system analysis Talk at ECLT Andrea Marin 1 1 Dipartimento di Scienze Ambientali, Informatica e Statistica Università Ca Foscari Venezia, Italy (University
More informationProduct-form in G-networks
PROBABILITY IN THE ENGINEERING AND INFORMATIONAL SCIENCES Product-form in G-networks Andrea Marin Abstract The introduction of the class of queueing networks called G-networks by Gelenbe has been a breakthrough
More informationStochastic Petri Nets. Jonatan Lindén. Modelling SPN GSPN. Performance measures. Almost none of the theory. December 8, 2010
Stochastic Almost none of the theory December 8, 2010 Outline 1 2 Introduction A Petri net (PN) is something like a generalized automata. A Stochastic Petri Net () a stochastic extension to Petri nets,
More informationSTRUCTURED SOLUTION OF STOCHASTIC DSSP SYSTEMS
STRUCTURED SOLUTION OF STOCHASTIC DSSP SYSTEMS J. Campos, S. Donatelli, and M. Silva Departamento de Informática e Ingeniería de Sistemas Centro Politécnico Superior, Universidad de Zaragoza jcampos,silva@posta.unizar.es
More informationProxel-Based Simulation of Stochastic Petri Nets Containing Immediate Transitions
Electronic Notes in Theoretical Computer Science Vol. 85 No. 4 (2003) URL: http://www.elsevier.nl/locate/entsc/volume85.html Proxel-Based Simulation of Stochastic Petri Nets Containing Immediate Transitions
More informationFrom Stochastic Processes to Stochastic Petri Nets
From Stochastic Processes to Stochastic Petri Nets Serge Haddad LSV CNRS & ENS Cachan & INRIA Saclay Advanced Course on Petri Nets, the 16th September 2010, Rostock 1 Stochastic Processes and Markov Chains
More informationThe Need for and the Advantages of Generalized Tensor Algebra for Kronecker Structured Representations
The Need for and the Advantages of Generalized Tensor Algebra for Kronecker Structured Representations Leonardo Brenner, Paulo Fernandes, and Afonso Sales PUCRS, Av Ipiranga, 6681-90619-900 - Porto Alegre,
More informationADVANCED ROBOTICS. PLAN REPRESENTATION Generalized Stochastic Petri nets and Markov Decision Processes
ADVANCED ROBOTICS PLAN REPRESENTATION Generalized Stochastic Petri nets and Markov Decision Processes Pedro U. Lima Instituto Superior Técnico/Instituto de Sistemas e Robótica September 2009 Reviewed April
More informationOn the relations among product-form stochastic models
Università Ca Foscari di Venezia Dipartimento di Informatica Dottorato di Ricerca in Informatica, 21 o Ciclo (A.A. 2005/2006 2007/2008) Tesi di dottorato: TD-2009-2 Settore scientifico disciplinare: INF/01
More informationStochastic Petri Net
Stochastic Petri Net Serge Haddad LSV ENS Cachan, Université Paris-Saclay & CNRS & INRIA haddad@lsv.ens-cachan.fr Petri Nets 2016, June 20th 2016 1 Stochastic Petri Net 2 Markov Chain 3 Markovian Stochastic
More informationAnalysis and Optimization of Discrete Event Systems using Petri Nets
Volume 113 No. 11 2017, 1 10 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu Analysis and Optimization of Discrete Event Systems using Petri Nets
More informationTHROUGHPUT ANALYSIS OF MANUFACTURING CELLS USING TIMED PETRI NETS
c 1994 IEEE. Published in the Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, San Antonio, TX, October 2 5, 1994. Personal use of this material is permitted. However,
More informationMarkovian Agents: A New Quantitative Analytical Framework for Large-Scale Distributed Interacting Systems
Markovian Agents: A New Quantitative Analytical Framework for Large-Scale Distributed Interacting Systems Andrea Bobbio, Dipartimento di Informatica, Università del Piemonte Orientale, 15121 Alessandria,
More informationVarieties of Stochastic Calculi
Research is what I'm doing when I don't know what I'm doing. Wernher Von Braun. Artificial Biochemistry Varieties of Stochastic Calculi Microsoft Research Trento, 26-5-22..26 www.luca.demon.co.uk/artificialbiochemistry.htm
More informationLecture 20: Reversible Processes and Queues
Lecture 20: Reversible Processes and Queues 1 Examples of reversible processes 11 Birth-death processes We define two non-negative sequences birth and death rates denoted by {λ n : n N 0 } and {µ n : n
More informationNetworks of Queues Models with Several. Classes of Customers and Exponential. Service Times
Applied Mathematical Sciences, Vol. 9, 2015, no. 76, 3789-3796 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2015.53287 Networks of Queues Models with Several Classes of Customers and Exponential
More informationLIMITING PROBABILITY TRANSITION MATRIX OF A CONDENSED FIBONACCI TREE
International Journal of Applied Mathematics Volume 31 No. 18, 41-49 ISSN: 1311-178 (printed version); ISSN: 1314-86 (on-line version) doi: http://dx.doi.org/1.173/ijam.v31i.6 LIMITING PROBABILITY TRANSITION
More informationPetri Net Modeling of Irrigation Canal Networks
Petri Net Modeling of Irrigation Canal Networks Giorgio Corriga, Alessandro Giua, Giampaolo Usai DIEE: Dip. di Ingegneria Elettrica ed Elettronica Università di Cagliari P.zza d Armi 09123 CAGLIARI, Italy
More informationQueueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "
Queueing Theory I Summary Little s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K " Little s Law a(t): the process that counts the number of arrivals
More informationReward Based Congruences: Can We Aggregate More?
Reward Based Congruences: Can We Aggregate More? Marco Bernardo and Mario Bravetti 2 Università di Torino, Dipartimento di Informatica Corso Svizzera 85, 049 Torino, Italy bernardo@di.unito.it 2 Università
More informationControl of Hybrid Petri Nets using Max-Plus Algebra
Control of Hybrid Petri Nets using Max-Plus Algebra FABIO BALDUZZI*, ANGELA DI FEBBRARO*, ALESSANDRO GIUA, SIMONA SACONE^ *Dipartimento di Automatica e Informatica Politecnico di Torino Corso Duca degli
More informationPopulation models from PEPA descriptions
Population models from PEPA descriptions Jane Hillston LFCS, The University of Edinburgh, Edinburgh EH9 3JZ, Scotland. Email: jeh@inf.ed.ac.uk 1 Introduction Stochastic process algebras (e.g. PEPA [10],
More informationQ = (c) Assuming that Ricoh has been working continuously for 7 days, what is the probability that it will remain working at least 8 more days?
IEOR 4106: Introduction to Operations Research: Stochastic Models Spring 2005, Professor Whitt, Second Midterm Exam Chapters 5-6 in Ross, Thursday, March 31, 11:00am-1:00pm Open Book: but only the Ross
More informationAN INTRODUCTION TO DISCRETE-EVENT SIMULATION
AN INTRODUCTION TO DISCRETE-EVENT SIMULATION Peter W. Glynn 1 Peter J. Haas 2 1 Dept. of Management Science and Engineering Stanford University 2 IBM Almaden Research Center San Jose, CA CAVEAT: WE ARE
More informationStochastic Petri Net
Stochastic Petri Net Serge Haddad LSV ENS Cachan & CNRS & INRIA haddad@lsv.ens-cachan.fr Petri Nets 2013, June 24th 2013 1 Stochastic Petri Net 2 Markov Chain 3 Markovian Stochastic Petri Net 4 Generalized
More informationModeling Continuous Systems Using Modified Petri Nets Model
Journal of Modeling & Simulation in Electrical & Electronics Engineering (MSEEE) 9 Modeling Continuous Systems Using Modified Petri Nets Model Abbas Dideban, Alireza Ahangarani Farahani, and Mohammad Razavi
More informationMQNA - Markovian Queueing Networks Analyser
FACULDADE DE INFORMÁTICA PUCRS - Brazil http://www.pucrs.br/inf/pos/ MQNA - Markovian Queueing Networks Analyser L. Brenner, P. Fernandes, A. Sales Technical Report Series Number 030 September, 2003 Contact:
More informationSPN 2003 Preliminary Version. Translating Hybrid Petri Nets into Hybrid. Automata 1. Dipartimento di Informatica. Universita di Torino
SPN 2003 Preliminary Version Translating Hybrid Petri Nets into Hybrid Automata 1 Marco Gribaudo 2 and Andras Horvath 3 Dipartimento di Informatica Universita di Torino Corso Svizzera 185, 10149 Torino,
More information(implicitly assuming time-homogeneity from here on)
Continuous-Time Markov Chains Models Tuesday, November 15, 2011 2:02 PM The fundamental object describing the dynamics of a CTMC (continuous-time Markov chain) is the probability transition (matrix) function:
More informationSTA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008
Name STA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008 There are five questions on this test. DO use calculators if you need them. And then a miracle occurs is not a valid answer. There
More informationMQNA - Markovian Queueing Networks Analyser
MQNA - Markovian Queueing Networks Analyser Leonardo Brenner Paulo Fernandes Afonso Sales PUCRS, Brazil PUCRS, Brazil PUCRS, Brazil lbrenner@inf.pucrs.br paulof@inf.pucrs.br asales@inf.pucrs.br Abstract
More informationDES. 4. Petri Nets. Introduction. Different Classes of Petri Net. Petri net properties. Analysis of Petri net models
4. Petri Nets Introduction Different Classes of Petri Net Petri net properties Analysis of Petri net models 1 Petri Nets C.A Petri, TU Darmstadt, 1962 A mathematical and graphical modeling method. Describe
More informationOPTIMAL TOKEN ALLOCATION IN TIMED CYCLIC EVENT GRAPHS
OPTIMAL TOKEN ALLOCATION IN TIMED CYCLIC EVENT GRAPHS Alessandro Giua, Aldo Piccaluga, Carla Seatzu Department of Electrical and Electronic Engineering, University of Cagliari, Italy giua@diee.unica.it
More informationMULTI-ORDERED POSETS. Lisa Bishop Department of Mathematics, Occidental College, Los Angeles, CA 90041, United States.
INTEGERS: ELECTRONIC JOURNAL OF COMBINATORIAL NUMBER THEORY 7 (2007), #A06 MULTI-ORDERED POSETS Lisa Bishop Department of Mathematics, Occidental College, Los Angeles, CA 90041, United States lbishop@oxy.edu
More informationRapporto di Ricerca CS G. Busetto, E. Jabara
UNIVERSITÀ CA FOSCARI DI VENEZIA Dipartimento di Informatica Technical Report Series in Computer Science Rapporto di Ricerca CS-2005-12 Ottobre 2005 G. Busetto, E. Jabara Some observations on factorized
More informationA fixed-point approximation accounting for link interactions in a loss network
A fixed-point approximation accounting for link interactions in a loss network MR Thompson PK Pollett Department of Mathematics The University of Queensland Abstract This paper is concerned with evaluating
More informationreversed chain is ergodic and has the same equilibrium probabilities (check that π j =
Lecture 10 Networks of queues In this lecture we shall finally get around to consider what happens when queues are part of networks (which, after all, is the topic of the course). Firstly we shall need
More informationof Business Workows using Generalized Stochastic Petri Nets A. Ferscha Institut fur Angewandte Informatik und Informationssysteme Universitat Wien
Qualitative and Quantitative Analysis of Business Workows using Generalized Stochastic Petri Nets A. Ferscha Institut fur Angewandte Informatik und Informationssysteme Universitat Wien Lenaugasse 2/8,
More informationMarkov Chains. X(t) is a Markov Process if, for arbitrary times t 1 < t 2 <... < t k < t k+1. If X(t) is discrete-valued. If X(t) is continuous-valued
Markov Chains X(t) is a Markov Process if, for arbitrary times t 1 < t 2
More information6 Solving Queueing Models
6 Solving Queueing Models 6.1 Introduction In this note we look at the solution of systems of queues, starting with simple isolated queues. The benefits of using predefined, easily classified queues will
More informationCountable state discrete time Markov Chains
Countable state discrete time Markov Chains Tuesday, March 18, 2014 2:12 PM Readings: Lawler Ch. 2 Karlin & Taylor Chs. 2 & 3 Resnick Ch. 1 Countably infinite state spaces are of practical utility in situations
More informationQueueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1
Queueing systems Renato Lo Cigno Simulation and Performance Evaluation 2014-15 Queueing systems - Renato Lo Cigno 1 Queues A Birth-Death process is well modeled by a queue Indeed queues can be used to
More information7. Queueing Systems. 8. Petri nets vs. State Automata
Petri Nets 1. Finite State Automata 2. Petri net notation and definition (no dynamics) 3. Introducing State: Petri net marking 4. Petri net dynamics 5. Capacity Constrained Petri nets 6. Petri net models
More informationProceedings of the 2012 Winter Simulation Conference C. Laroque, J. Himmelspach, R. Pasupathy, O. Rose, and A. M. Uhrmacher, eds.
Proceedings of the 2012 Winter Simulation Conference C. Laroque, J. Himmelspach, R. Pasupathy, O. Rose, and A. M. Uhrmacher, eds. EFFICIENT SIMULATION OF STOCHASTIC WELL-FORMED NETS THROUGH SYMMETRY EXPLOITATION
More informationMinicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics
Minicourse on: Markov Chain Monte Carlo: Simulation Techniques in Statistics Eric Slud, Statistics Program Lecture 1: Metropolis-Hastings Algorithm, plus background in Simulation and Markov Chains. Lecture
More informationCS 798: Homework Assignment 3 (Queueing Theory)
1.0 Little s law Assigned: October 6, 009 Patients arriving to the emergency room at the Grand River Hospital have a mean waiting time of three hours. It has been found that, averaged over the period of
More informationDISCRETE-TIME MARKOVIAN STOCHASTIC PETRI NETS
20 DISCRETE-TIME MARKOVIAN STOCHASTIC PETRI NETS Gianfranco Ciardo 1 Department of Computer Science, College of William and Mary Williamsburg, VA 23187-8795, USA ciardo@cs.wm.edu ABSTRACT We revisit and
More informationMarkov Chain Model for ALOHA protocol
Markov Chain Model for ALOHA protocol Laila Daniel and Krishnan Narayanan April 22, 2012 Outline of the talk A Markov chain (MC) model for Slotted ALOHA Basic properties of Discrete-time Markov Chain Stability
More informationCRAS TECHNICAL REPOR~
STATE UNIVERSITY OF NEW YORK AT STONY BROOK CRAS TECHNICAL REPOR~ Fast Decomposable Solution for a Class of Non-Product Queueing Networks Form R.-X. Ni and T.G. Robertazzi August 7, 1991 Fast Decomposable
More informationA review of Continuous Time MC STA 624, Spring 2015
A review of Continuous Time MC STA 624, Spring 2015 Ruriko Yoshida Dept. of Statistics University of Kentucky polytopes.net STA 624 1 Continuous Time Markov chains Definition A continuous time stochastic
More informationNONBLOCKING CONTROL OF PETRI NETS USING UNFOLDING. Alessandro Giua Xiaolan Xie
NONBLOCKING CONTROL OF PETRI NETS USING UNFOLDING Alessandro Giua Xiaolan Xie Dip. Ing. Elettrica ed Elettronica, U. di Cagliari, Italy. Email: giua@diee.unica.it INRIA/MACSI Team, ISGMP, U. de Metz, France.
More informationCDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes
CDA6530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes Definition Stochastic process X = {X(t), t2 T} is a collection of random variables (rvs); one rv
More informationIntroduction to Markov Chains, Queuing Theory, and Network Performance
Introduction to Markov Chains, Queuing Theory, and Network Performance Marceau Coupechoux Telecom ParisTech, departement Informatique et Réseaux marceau.coupechoux@telecom-paristech.fr IT.2403 Modélisation
More informationTPN are devoted to specify and verify properties of systems where timing is a critical parameter that may affect the behavior of the system. In this l
URL: http://www.elsevier.nl/locate/entcs/volume52.html 8 pages Petri Nets with Discrete Phase Type Timing: A Bridge Between Stochastic and Functional Analysis Andrea Bobbio DISTA, Universit a del Piemonte
More informationUNIVERSITÀ CA FOSCARI DI VENEZIA Dipartimento di Informatica Technical Report Series in Computer Science. Rapporto di Ricerca CS
UNIVERSITÀ CA FOSCARI DI VENEZIA Dipartimento di Informatica Technical Report Series in Computer Science Rapporto di Ricerca CS-2005-2 Marzo 2005 Paolo Baldan, Andrea Corradini, Ugo Montanari, Leila Ribeiro
More informationStochastic2010 Page 1
Stochastic2010 Page 1 Extinction Probability for Branching Processes Friday, April 02, 2010 2:03 PM Long-time properties for branching processes Clearly state 0 is an absorbing state, forming its own recurrent
More informationContents Preface The Exponential Distribution and the Poisson Process Introduction to Renewal Theory
Contents Preface... v 1 The Exponential Distribution and the Poisson Process... 1 1.1 Introduction... 1 1.2 The Density, the Distribution, the Tail, and the Hazard Functions... 2 1.2.1 The Hazard Function
More informationQueuing Theory. Using the Math. Management Science
Queuing Theory Using the Math 1 Markov Processes (Chains) A process consisting of a countable sequence of stages, that can be judged at each stage to fall into future states independent of how the process
More informationIntro Refresher Reversibility Open networks Closed networks Multiclass networks Other networks. Queuing Networks. Florence Perronnin
Queuing Networks Florence Perronnin Polytech Grenoble - UGA March 23, 27 F. Perronnin (UGA) Queuing Networks March 23, 27 / 46 Outline Introduction to Queuing Networks 2 Refresher: M/M/ queue 3 Reversibility
More informationTime(d) Petri Net. Serge Haddad. Petri Nets 2016, June 20th LSV ENS Cachan, Université Paris-Saclay & CNRS & INRIA
Time(d) Petri Net Serge Haddad LSV ENS Cachan, Université Paris-Saclay & CNRS & INRIA haddad@lsv.ens-cachan.fr Petri Nets 2016, June 20th 2016 1 Time and Petri Nets 2 Time Petri Net: Syntax and Semantic
More informationHYPENS Manual. Fausto Sessego, Alessandro Giua, Carla Seatzu. February 7, 2008
HYPENS Manual Fausto Sessego, Alessandro Giua, Carla Seatzu February 7, 28 HYPENS is an open source tool to simulate timed discrete, continuous and hybrid Petri nets. It has been developed in Matlab to
More informationA NOTE ON FAITHFUL TRACES ON A VON NEUMANN ALGEBRA
A NOTE ON FAITHFUL TRACES ON A VON NEUMANN ALGEBRA F. BAGARELLO, C. TRAPANI, AND S. TRIOLO Abstract. In this short note we give some techniques for constructing, starting from a sufficient family F of
More informationQueueing Networks G. Rubino INRIA / IRISA, Rennes, France
Queueing Networks G. Rubino INRIA / IRISA, Rennes, France February 2006 Index 1. Open nets: Basic Jackson result 2 2. Open nets: Internet performance evaluation 18 3. Closed nets: Basic Gordon-Newell result
More informationTAYLOR POLYNOMIALS DARYL DEFORD
TAYLOR POLYNOMIALS DARYL DEFORD 1. Introduction We have seen in class that Taylor polynomials provide us with a valuable tool for approximating many different types of functions. However, in order to really
More informationApplications of Petri Nets
Applications of Petri Nets Presenter: Chung-Wei Lin 2010.10.28 Outline Revisiting Petri Nets Application 1: Software Syntheses Theory and Algorithm Application 2: Biological Networks Comprehensive Introduction
More informationFaithful couplings of Markov chains: now equals forever
Faithful couplings of Markov chains: now equals forever by Jeffrey S. Rosenthal* Department of Statistics, University of Toronto, Toronto, Ontario, Canada M5S 1A1 Phone: (416) 978-4594; Internet: jeff@utstat.toronto.edu
More informationTHE simulation of a continuous or discrete time system
770 IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART B: CYBERNETICS, VOL. 28, NO. 6, DECEMBER 1998 Discrete Event Representation of Qualitative Models Using Petri Nets Alessandra Fanni, Member,
More information4452 Mathematical Modeling Lecture 16: Markov Processes
Math Modeling Lecture 16: Markov Processes Page 1 4452 Mathematical Modeling Lecture 16: Markov Processes Introduction A stochastic model is one in which random effects are incorporated into the model.
More informationMarkov chains. Randomness and Computation. Markov chains. Markov processes
Markov chains Randomness and Computation or, Randomized Algorithms Mary Cryan School of Informatics University of Edinburgh Definition (Definition 7) A discrete-time stochastic process on the state space
More informationIEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.
IEOR 6711: Stochastic Models I, Fall 23, Professor Whitt Solutions to Final Exam: Thursday, December 18. Below are six questions with several parts. Do as much as you can. Show your work. 1. Two-Pump Gas
More informationLecture 4 The stochastic ingredient
Lecture 4 The stochastic ingredient Luca Bortolussi 1 Alberto Policriti 2 1 Dipartimento di Matematica ed Informatica Università degli studi di Trieste Via Valerio 12/a, 34100 Trieste. luca@dmi.units.it
More informationMarkov Chains. Chapter 16. Markov Chains - 1
Markov Chains Chapter 16 Markov Chains - 1 Why Study Markov Chains? Decision Analysis focuses on decision making in the face of uncertainty about one future event. However, many decisions need to consider
More informationMath 304 Handout: Linear algebra, graphs, and networks.
Math 30 Handout: Linear algebra, graphs, and networks. December, 006. GRAPHS AND ADJACENCY MATRICES. Definition. A graph is a collection of vertices connected by edges. A directed graph is a graph all
More informationDECOMPOSITION OF PETRI NETS
Cybernetics and Systems Analysis, Vol. 40, No. 5, 2004 DECOMPOSITION OF PETRI NETS D. A. Zaitsev UDC 519.74 The problem of splitting any given Petri net into functional subnets is considered. The properties
More informationToward a Definition of Modeling Power for Stochastic Petri Net Models
Toward a Definition of Modeling Power for Stochastic Petri Net Models Gianfranco Ciardo Duke University Proc. of the Int. Workshop on Petri Nets and Performance Models, Madison, Wisconsin, August 1987
More informationOn Quadratic Stochastic Operators Having Three Fixed Points
Journal of Physics: Conference Series PAPER OPEN ACCESS On Quadratic Stochastic Operators Having Three Fixed Points To cite this article: Mansoor Saburov and Nur Atikah Yusof 2016 J. Phys.: Conf. Ser.
More informationOn Polynomial Cases of the Unichain Classification Problem for Markov Decision Processes
On Polynomial Cases of the Unichain Classification Problem for Markov Decision Processes Eugene A. Feinberg Department of Applied Mathematics and Statistics State University of New York at Stony Brook
More informationSolution of the Inverse Frobenius Perron Problem for Semi Markov Chaotic Maps via Recursive Markov State Disaggregation
Solution of the Inverse Frobenius Perron Problem for Semi Markov Chaotic Maps via Recursive Markov State Disaggregation Andre McDonald Council for Scientific and Industrial Research Brummeria, South Africa
More informationStochastic Simulation.
Stochastic Simulation. (and Gillespie s algorithm) Alberto Policriti Dipartimento di Matematica e Informatica Istituto di Genomica Applicata A. Policriti Stochastic Simulation 1/20 Quote of the day D.T.
More informationON MAIN CHARACTERISTICS OF THE M/M/1/N QUEUE WITH SINGLE AND BATCH ARRIVALS AND THE QUEUE SIZE CONTROLLED BY AQM ALGORITHMS
K Y B E R N E T I K A V O L U M E 4 7 ( 2 0 1 1 ), N U M B E R 6, P A G E S 9 3 0 9 4 3 ON MAIN CHARACTERISTICS OF THE M/M/1/N QUEUE WITH SINGLE AND BATCH ARRIVALS AND THE QUEUE SIZE CONTROLLED BY AQM
More informationMany proofs that the primes are infinite J. Marshall Ash 1 and T. Kyle Petersen
Many proofs that the primes are infinite J. Marshall Ash and T. Kyle Petersen Theorem. There are infinitely many prime numbers. How many proofs do you know that there are infinitely many primes? Nearly
More informationNeural Networks for Machine Learning. Lecture 11a Hopfield Nets
Neural Networks for Machine Learning Lecture 11a Hopfield Nets Geoffrey Hinton Nitish Srivastava, Kevin Swersky Tijmen Tieleman Abdel-rahman Mohamed Hopfield Nets A Hopfield net is composed of binary threshold
More informationPart I Stochastic variables and Markov chains
Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)
More informationSAMPLING AND INVERSION
SAMPLING AND INVERSION Darryl Veitch dveitch@unimelb.edu.au CUBIN, Department of Electrical & Electronic Engineering University of Melbourne Workshop on Sampling the Internet, Paris 2005 A TALK WITH TWO
More informationN.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a
WHEN IS A MAP POISSON N.G.Bean, D.A.Green and P.G.Taylor Department of Applied Mathematics University of Adelaide Adelaide 55 Abstract In a recent paper, Olivier and Walrand (994) claimed that the departure
More informationThe Markov Decision Process (MDP) model
Decision Making in Robots and Autonomous Agents The Markov Decision Process (MDP) model Subramanian Ramamoorthy School of Informatics 25 January, 2013 In the MAB Model We were in a single casino and the
More informationHomework 4 due on Thursday, December 15 at 5 PM (hard deadline).
Large-Time Behavior for Continuous-Time Markov Chains Friday, December 02, 2011 10:58 AM Homework 4 due on Thursday, December 15 at 5 PM (hard deadline). How are formulas for large-time behavior of discrete-time
More informationTime and Timed Petri Nets
Time and Timed Petri Nets Serge Haddad LSV ENS Cachan & CNRS & INRIA haddad@lsv.ens-cachan.fr DISC 11, June 9th 2011 1 Time and Petri Nets 2 Timed Models 3 Expressiveness 4 Analysis 1/36 Outline 1 Time
More informationIEOR 6711, HMWK 5, Professor Sigman
IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.
More informationOn Stability and Sojourn Time of Peer-to-Peer Queuing Systems
On Stability and Sojourn Time of Peer-to-Peer Queuing Systems Taoyu Li Minghua Chen Tony Lee Xing Li Tsinghua University, Beijing, China. {ldy03@mails.tsinghua.edu.cn,xing@cernet.edu.cn} The Chinese University
More informationThe Scale Factor: A New Degree of Freedom in Phase Type Approximation
The Scale Factor: A New Degree of Freedom in Phase Type Approximation Andrea Bobbio DISTA, Università del Piemonte Orientale, Alessandria, Italy,bobbio@unipmn.it András Horváth, Miklós Telek Dept. of Telecommunications,
More informationSpecification models and their analysis Petri Nets
Specification models and their analysis Petri Nets Kai Lampka December 10, 2010 1 30 Part I Petri Nets Basics Petri Nets Introduction A Petri Net (PN) is a weighted(?), bipartite(?) digraph(?) invented
More informationON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS
ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS J.R. ARTALEJO, Department of Statistics and Operations Research, Faculty of Mathematics, Complutense University of Madrid,
More information