Advanced Queueing Theory

Similar documents
Advanced Queueing Theory

Contents Preface The Exponential Distribution and the Poisson Process Introduction to Renewal Theory

Modelling Complex Queuing Situations with Markov Processes

Queueing Theory II. Summary. ! M/M/1 Output process. ! Networks of Queue! Method of Stages. ! General Distributions

Readings: Finish Section 5.2

Matrix analytic methods. Lecture 1: Structured Markov chains and their stationary distribution

Multi Stage Queuing Model in Level Dependent Quasi Birth Death Process

LECTURE #6 BIRTH-DEATH PROCESS

Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk

GI/M/1 and GI/M/m queuing systems

J. MEDHI STOCHASTIC MODELS IN QUEUEING THEORY

Queuing Theory. Richard Lockhart. Simon Fraser University. STAT 870 Summer 2011

Overload Analysis of the PH/PH/1/K Queue and the Queue of M/G/1/K Type with Very Large K

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

Time Reversibility and Burke s Theorem

Performance Evaluation of Queuing Systems

TCOM 501: Networking Theory & Fundamentals. Lecture 6 February 19, 2003 Prof. Yannis A. Korilis

Networking = Plumbing. Queueing Analysis: I. Last Lecture. Lecture Outline. Jeremiah Deng. 29 July 2013

Markov Chains. X(t) is a Markov Process if, for arbitrary times t 1 < t 2 <... < t k < t k+1. If X(t) is discrete-valued. If X(t) is continuous-valued

Introduction to queuing theory

M/M/1 Retrial Queueing System with Negative. Arrival under Erlang-K Service by Matrix. Geometric Method

Performance Modelling of Computer Systems

57:022 Principles of Design II Final Exam Solutions - Spring 1997

A FAST MATRIX-ANALYTIC APPROXIMATION FOR THE TWO CLASS GI/G/1 NON-PREEMPTIVE PRIORITY QUEUE

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.

reversed chain is ergodic and has the same equilibrium probabilities (check that π j =

Structured Markov chains solver: tool extension

Characterizing the BMAP/MAP/1 Departure Process via the ETAQA Truncation 1

Censoring Technique in Studying Block-Structured Markov Chains

(b) What is the variance of the time until the second customer arrives, starting empty, assuming that we measure time in minutes?

Statistics 150: Spring 2007

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe

Contents LIST OF TABLES... LIST OF FIGURES... xvii. LIST OF LISTINGS... xxi PREFACE. ...xxiii

Non Markovian Queues (contd.)

Analysis of a tandem queueing model with GI service time at the first queue

Cover Page. The handle holds various files of this Leiden University dissertation

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Link Models for Circuit Switching

6 Solving Queueing Models

On Successive Lumping of Large Scale Systems

Cover Page. The handle holds various files of this Leiden University dissertation

Data analysis and stochastic modeling

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking

P (L d k = n). P (L(t) = n),

BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS

Elementary queueing system

A Joining Shortest Queue with MAP Inputs

Part I Stochastic variables and Markov chains

Lecture 20: Reversible Processes and Queues

Outline. Finite source queue M/M/c//K Queues with impatience (balking, reneging, jockeying, retrial) Transient behavior Advanced Queue.

Part II: continuous time Markov chain (CTMC)

2905 Queueing Theory and Simulation PART III: HIGHER DIMENSIONAL AND NON-MARKOVIAN QUEUES

Chapter 1. Introduction. 1.1 Stochastic process

The shortest queue problem

IEOR 6711, HMWK 5, Professor Sigman

QUEUING SYSTEM. Yetunde Folajimi, PhD

Queues and Queueing Networks

CS 798: Homework Assignment 3 (Queueing Theory)

Matrix Analytic Methods for Stochastic Fluid Flows

A Queueing Model for Sleep as a Vacation

Introduction to Queueing Theory

Kendall notation. PASTA theorem Basics of M/M/1 queue

Stationary Probabilities of Markov Chains with Upper Hessenberg Transition Matrices

Departure Processes of a Tandem Network

Quasi-birth-death processes with an explicit rate matrix

On the Class of Quasi-Skip Free Processes: Stability & Explicit solutions when successively lumpable

Queueing systems in a random environment with applications

NATCOR: Stochastic Modelling

Introduction to Queuing Networks Solutions to Problem Sheet 3

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1

CHUN-HUA GUO. Key words. matrix equations, minimal nonnegative solution, Markov chains, cyclic reduction, iterative methods, convergence rate

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974

N.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a

Introduction to Queueing Theory

Exercises Stochastic Performance Modelling. Hamilton Institute, Summer 2010

Approximate analysis of single-server tandem queues with finite buffers

Solutions to Homework Discrete Stochastic Processes MIT, Spring 2011

Structured Markov Chains

Answers to selected exercises

An Introduction to Stochastic Modeling

Queueing Networks and Insensitivity

Assignment 3 with Reference Solutions

Chapter 3: Markov Processes First hitting times

IMPORTANCE SAMPLING SIMULATIONS OF PHASE-TYPE QUEUES

Stationary Analysis of a Multiserver queue with multiple working vacation and impatient customers

QUASI-BIRTH-AND-DEATH PROCESSES, LATTICE PATH COUNTING, AND HYPERGEOMETRIC FUNCTIONS

DES and RES Processes and their Explicit Solutions

Simultaneous Transient Analysis of QBD Markov Chains for all Initial Configurations using a Level Based Recursion

ECE-517: Reinforcement Learning in Artificial Intelligence. Lecture 4: Discrete-Time Markov Chains

THE ON NETWORK FLOW EQUATIONS AND SPLITTG FORMULAS TRODUCTION FOR SOJOURN TIMES IN QUEUEING NETWORKS 1 NO FLOW EQUATIONS

arxiv: v2 [math.pr] 2 Nov 2017

1 IEOR 4701: Continuous-Time Markov Chains

Examples of Countable State Markov Chains Thursday, October 16, :12 PM

HITTING TIME IN AN ERLANG LOSS SYSTEM

Queueing Systems: Lecture 3. Amedeo R. Odoni October 18, Announcements

IEOR 8100: Topics in OR: Asymptotic Methods in Queueing Theory. Fall 2009, Professor Whitt. Class Lecture Notes: Wednesday, September 9.

A Queueing System with Queue Length Dependent Service Times, with Applications to Cell Discarding in ATM Networks

Since D has an exponential distribution, E[D] = 0.09 years. Since {A(t) : t 0} is a Poisson process with rate λ = 10, 000, A(0.

Classical Queueing Models.

A Heterogeneous Two-Server Queueing System with Balking and Server Breakdowns

Transcription:

Advanced Queueing Theory 1 Networks of queues (reversibility, output theorem, tandem networks, partial balance, product-form distribution, blocking, insensitivity, BCMP networks, mean-value analysis, Norton's theorem, sojourn times) Analytical-numerical techniques (matrix-analytical methods, compensation method, error bound method, approximate decomposition method) Polling systems (cycle times, queue lengths, waiting times, conservation laws, service policies, visit orders) Richard J. Boucherie department of Applied Mathematics University of Twente http://wwwhome.math.utwente.nl/~boucherierj/onderwijs/advanced Queueing Theory/AQT.html

2 Doe na de m/m/1 eerst even de M/E_r/1 expliciet uit notes Laat dan expliciet zien dat generator een blok structuur heeft Ga dan pas naar QBD

Advanced Queueing Theory Today (lecture 7): Matrix analytical techniques 3 G. Latouche, V Ramaswami. Introduction to Matrix Analytic Methods in Stochastic Modeling, SIAM, Philadelphia, 1999 Tutorial on Matrix analytic methods: http://www-net.cs.umass.edu/pe2002/papers/nelson.pdf M/M/1 queue Quasi birth death process Generalisations

M/M/1 queue 4 Poisson arrival process rate, single server, exponential service times, mean 1/ State space S={0,1,2, } transition rates : Global balance Detailed balance Equilibrium distribution

0 = 5

6

Advanced Queueing Theory Today (lecture 7): Matrix analytical techniques 7 G. Latouche, V Ramaswami. Introduction to Matrix Analytic Methods in Stochastic Modeling, SIAM, Philadelphia, 1999 Tutorial on Matrix analytic methods: http://www-net.cs.umass.edu/pe2002/papers/nelson.pdf M/M/1 queue Quasi birth death process Generalisations

8 Vector state process: example M/E_k/1 Let service requirement in single server queue be Erlang (k,apple) Augment state description with phase of Erlang distribution State (n,j): n= # customers, j = #remaining phases Transitions (n,j) (n+1,j) arrival (rate apple) (n,j) (n,j-1) completion of phase (j>1) (rate apple) (n,j) (n-1,k) completion in last phase, dept (n>1,j=1) (rate apple) (n,j) (0) completion for n=1, (j=1) (rate apple) (0) (1,k) arrival to empty system (rate apple) Picture Generator in block structure M/Ph/1

Phase and level 9

10 Quasi-birth-death process (QBD) Q i blocks of size M x M

11

π i blocks of size M 12

Theorem: equilibrium distribution 13

14 Stability Behaviour in phase direction x stat distrib over phases downward drift

15 QBD: Proof of equilibrium distribution For the discrete time case, R(i,j) is the expected number of visits to phase j in level 1 before absorption in level 0 for the process that starts at level 0 in phase i

16

17

Proof, ctd 18

19 Computing R For computation of R, rearrange Note that Q 1 is indeed invertible, since it is a transient generator Fixed point equation solved by successive substitution It can be shown that

20 Example: E k /M/1 queue Let service requirement in single server queue be Exp(apple) Let interarrival time be Erlang (k, apple) Augment state description with phase of Erlang distribution State (n,j): n=# customers, j =#remaining phases Transitions (n,1) (n+1,k) arrival (rate apple) (n,j) (n,j-1) completion of phase (j>1) (rate apple) (n,j) (n-1,j) service completion (n>1) (rate apple) Picture Generator in block structure

Advanced Queueing Theory Today (lecture 7): Matrix analytical techniques 21 G. Latouche, V Ramaswami. Introduction to Matrix Analytic Methods in Stochastic Modeling, SIAM, Philadelphia, 1999 Tutorial on Matrix analytic methods: http://www-net.cs.umass.edu/pe2002/papers/nelson.pdf M/M/1 queue Quasi birth death process Generalisations

Generalisations: different first row 22

23

24 Generalisations: GI/M/1-type Markov chains Consider GI/M/1 at arrival epochs Interarrival time has general distribution F A with mean 1/ apple Service time exponential with rate apple Probability exactly n customers served during intarr time Probability more than n served during intarr time

Generalisations: GI/M/1-type Markov chains 25 Prob n cust served during intarr time Prob more than n served during intarr time Transition probability matrix Equilibrium probabilities Where is unique root in (0,1) of where A has distribution F A

26 Generalisations: GI/M/1-type Markov chains Markov chain with transition matrix (suitably ordered states) of the form is called Markov chain of the GI/M/1 type

27 Generalisations: GI/M/1-type Markov chains Equilibrium distribution Where R is minimal non-negative solution of Computation: truncate And use successive approximation

28 Generalisations: M/G/1 type Markov chains Embedding of M/Q/1 at departure epochs gives upper triangular structure for transition matrix

29 Generalisations: Level dependent rates For Markov chain of the GI/M/1 type, we may generalise to allow for level dependent matrices, i.e. A i (n) at level n, i=0,1,2,, n=0,1,2,

30 References and Exercise http://www.ms.unimelb.edu.au/~pgt/stochworkshop2004.pdf http://www.ms.unimelb.edu.au/~pgt/stochworkshop2004-2.pdf Exercise: Consider the Ph/Ph/1 queue. Formulate as Matrix Analytic queue (i.e. specify the transition matrix, and the blocks in that matrix). For the E 2 /E 2 /1 queue, obtain explicit expression for R, and give the equilibrium distribution