FINAL REPORT. Project Title: Extreme Values of Queues, Point Processes and Stochastic Networks

Similar documents
IW IIIIL2 5-_6. -, ~IIIl IIII'nll MICROCOPY RESOLUTION TEST CHART NAI IONAL BUIREAU O( STANDARDS 1963 A

CS 798: Homework Assignment 3 (Queueing Theory)

Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk

Markov Chains. X(t) is a Markov Process if, for arbitrary times t 1 < t 2 <... < t k < t k+1. If X(t) is discrete-valued. If X(t) is continuous-valued

Stochastic Models. Edited by D.P. Heyman Bellcore. MJ. Sobel State University of New York at Stony Brook

STA 624 Practice Exam 2 Applied Stochastic Processes Spring, 2008

57:022 Principles of Design II Final Exam Solutions - Spring 1997

HEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES

Synchronized Queues with Deterministic Arrivals

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

ATLANTA SCHOOL OF INDUSTRIAL AND SYSTEMS ENGINEERING R F SERFOZO DEC 87 AFOSR-TR OFOSR UNCLASSIFIED F/O /3N L

Advanced Queueing Theory

COPYRIGHTED MATERIAL CONTENTS. Preface Preface to the First Edition

Performance Evaluation of Queuing Systems

At the boundary states, we take the same rules except we forbid leaving the state space, so,.

Electronic Companion Fluid Models for Overloaded Multi-Class Many-Server Queueing Systems with FCFS Routing

An Introduction to Probability Theory and Its Applications

Data analysis and stochastic modeling

BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS

An Introduction to Stochastic Modeling

Contents Preface The Exponential Distribution and the Poisson Process Introduction to Renewal Theory

Cover Page. The handle holds various files of this Leiden University dissertation

Queueing Networks and Insensitivity

ON THE NON-EXISTENCE OF PRODUCT-FORM SOLUTIONS FOR QUEUEING NETWORKS WITH RETRIALS

The Transition Probability Function P ij (t)

J. MEDHI STOCHASTIC MODELS IN QUEUEING THEORY

Outline. Finite source queue M/M/c//K Queues with impatience (balking, reneging, jockeying, retrial) Transient behavior Advanced Queue.

Chapter 3 Balance equations, birth-death processes, continuous Markov Chains

Stability of the two queue system

Overload Analysis of the PH/PH/1/K Queue and the Queue of M/G/1/K Type with Very Large K

Exact Simulation of the Stationary Distribution of M/G/c Queues

Session-Based Queueing Systems

Statistics 150: Spring 2007

A review of Continuous Time MC STA 624, Spring 2015

On Existence of Limiting Distribution for Time-Nonhomogeneous Countable Markov Process

Stochastic process. X, a series of random variables indexed by t

UNIVERSITY OF YORK. MSc Examinations 2004 MATHEMATICS Networks. Time Allowed: 3 hours.

STOCHASTIC PROCESSES Basic notions

reversed chain is ergodic and has the same equilibrium probabilities (check that π j =

Chapter 5. Continuous-Time Markov Chains. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan

Two-sided Bounds for the Convergence Rate of Markov Chains

Markov Model. Model representing the different resident states of a system, and the transitions between the different states

Central limit theorems for ergodic continuous-time Markov chains with applications to single birth processes

Classification of Countable State Markov Chains

1. Numerical Methods for Stochastic Control Problems in Continuous Time (with H. J. Kushner), Second Revised Edition, Springer-Verlag, New York, 2001.

Lecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes

A Queueing System with Queue Length Dependent Service Times, with Applications to Cell Discarding in ATM Networks

Dynamic network sampling

Matrix analytic methods. Lecture 1: Structured Markov chains and their stationary distribution

QUEUING SYSTEM. Yetunde Folajimi, PhD

Birth-Death Processes

ECE-517: Reinforcement Learning in Artificial Intelligence. Lecture 4: Discrete-Time Markov Chains

Online Companion for. Decentralized Adaptive Flow Control of High Speed Connectionless Data Networks

Examples of Countable State Markov Chains Thursday, October 16, :12 PM

Exercises Solutions. Automation IEA, LTH. Chapter 2 Manufacturing and process systems. Chapter 5 Discrete manufacturing problems

NEW FRONTIERS IN APPLIED PROBABILITY

Non-homogeneous random walks on a semi-infinite strip

LIST OF MATHEMATICAL PAPERS

Queueing systems. Renato Lo Cigno. Simulation and Performance Evaluation Queueing systems - Renato Lo Cigno 1

Readings: Finish Section 5.2

MS&E 321 Spring Stochastic Systems June 1, 2013 Prof. Peter W. Glynn Page 1 of 10. x n+1 = f(x n ),

STABILIZATION OF AN OVERLOADED QUEUEING NETWORK USING MEASUREMENT-BASED ADMISSION CONTROL

SOLUTIONS IEOR 3106: Second Midterm Exam, Chapters 5-6, November 8, 2012

Multi Stage Queuing Model in Level Dependent Quasi Birth Death Process

INDEX. production, see Applications, manufacturing

SIMILAR MARKOV CHAINS

Budapest University of Tecnology and Economics. AndrásVetier Q U E U I N G. January 25, Supported by. Pro Renovanda Cultura Hunariae Alapítvány

TMA4265 Stochastic processes ST2101 Stochastic simulation and modelling

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974

Q = (c) Assuming that Ricoh has been working continuously for 7 days, what is the probability that it will remain working at least 8 more days?

RELATING TIME AND CUSTOMER AVERAGES FOR QUEUES USING FORWARD COUPLING FROM THE PAST

Queueing Systems: Lecture 3. Amedeo R. Odoni October 18, Announcements

Stochastic relations of random variables and processes

Irreducibility. Irreducible. every state can be reached from every other state For any i,j, exist an m 0, such that. Absorbing state: p jj =1

HANDBOOK OF APPLICABLE MATHEMATICS

Faithful couplings of Markov chains: now equals forever

Discrete time Markov chains. Discrete Time Markov Chains, Limiting. Limiting Distribution and Classification. Regular Transition Probability Matrices

Math Homework 5 Solutions

Inventory Ordering Control for a Retrial Service Facility System Semi- MDP

Stationary Probabilities of Markov Chains with Upper Hessenberg Transition Matrices

GI/M/1 and GI/M/m queuing systems

Part I Stochastic variables and Markov chains

Probability Models in Electrical and Computer Engineering Mathematical models as tools in analysis and design Deterministic models Probability models

Section Notes 9. Midterm 2 Review. Applied Math / Engineering Sciences 121. Week of December 3, 2018

Modelling Complex Queuing Situations with Markov Processes

Markov chains. 1 Discrete time Markov chains. c A. J. Ganesh, University of Bristol, 2015

Ana María Cetto, Luis de la Peña and Andrea Valdés Hernández

IEOR 8100: Topics in OR: Asymptotic Methods in Queueing Theory. Fall 2009, Professor Whitt. Class Lecture Notes: Wednesday, September 9.

A Joining Shortest Queue with MAP Inputs

Stationary remaining service time conditional on queue length

PERTURBATION ANALYSIS FOR DENUMERABLE MARKOV CHAINS WITH APPLICATION TO QUEUEING MODELS

A Heterogeneous Two-Server Queueing System with Balking and Server Breakdowns

Chapter 1. Introduction. 1.1 Stochastic process

Contents LIST OF TABLES... LIST OF FIGURES... xvii. LIST OF LISTINGS... xxi PREFACE. ...xxiii

Chapter 16 focused on decision making in the face of uncertainty about one future

Stochastic Processes. Theory for Applications. Robert G. Gallager CAMBRIDGE UNIVERSITY PRESS

STA 4273H: Statistical Machine Learning

An Application of Graph Theory in Markov Chains Reliability Analysis

IEOR 6711, HMWK 5, Professor Sigman

Transcription:

FINAL REPORT Project Title: Extreme Values of Queues, Point Processes and Stochastic Networks Grant No.: AFOSR 84-0367 Project Director: Professor Richard F. Serfozo Industrial and Systems Engineering Georgia Institute of Technology November 1986

Extreme Values of Queues, Point Processes and Stochastic Networks This two-year research grant consisted of several themes. The following is a summary of our results. 1. Compound Poisson Approximations Our work on this topic just appeared in Serfozo, R.F. (1986). Compound Poisson Approximations for Sums of Random Variables Ann. Probability, October issue. During the last 20 years, several theorems have been proved on the convergence of sums of independent random variables to compound Poisson variables. Little was known about how close the sums are to being compound Poisson. Examples were published that seemed to indicate that one could not develop compound Poisson approximations that would be as natural as normal or Poisson approximations. However, we have been able to develop such approximations. We have proved that a sum of dependent random elements is approximately compound Poisson when the variables are rarely nonzero and, given they are nonzero, their conditional distributions are nearly identical. We have given several upper bounds on the total-variation distance between the distribution of such a sum and a compound Poisson distribution. These bounds are analogous to Berry-Esseen bounds for normal approximations. Our results apply to general random elements such as unions of random sets and sums of random measures or point processes. Our results appear to be useful for characterizing high-level exceedances of dependent variables. We hope to pursue this in the near future.

2. Partitions of Point Processes Our work on this appeared in Serfozo, R.F. (1985). Partitions of Point Processes: Multivariate Poisson Approximations. Stoch. Process Appl. 20, 281-294. We proved that when a point process is partitioned into certain sparse subprocesses, then the subprocesses are asymptotically multivariate Poisson or compound Poisson. Using results described above, we derived bounds for the total-variation distance between the subprocesses and their limits. We did this for several types of partitioning rules including independent, Markovian and batch assignment of points. Partitions of point processes are omnipresent in flows of parts in manufacturing networks and distribution systems, and flows of data packets in computer networks. 3. Extreme Values of Birth and Death Processes and Queues Our work on this has been documented in: Serfozo, R.F. (1987). Extreme Values of Birth and Death Processes and Queues. Stoch. Processes Appl. (to appear). Serfozo, R.F. (1986). Extreme Values of Queue Lengths in M/G/1 and GI/M/1 Systems. Technical Report. In these papers, we solve the long-standing problem of characterizing the asymptotic behavior of the maximum values of birth and death processes and queues over large time intervals. When these processes are positive recurrent, the distributions of their maxima do not converge to a non-degenerate distribution, in the usual way under linear normalizations. We show, however, that by varying the process parameters in a certain way as the time interval grows, then these maxima

do indeed have three possible limit distributions. Two of them are classical extreme value distributions and the other one is a new distribution. Our results on birth and death processes include conditional limit theorems for maxima of transient processes conditioned that they are finite. For the M/G/1 and GI/M/1 queues, the analysis was more complicated since a certain basic distribution was known only indirectly in terms of ratios of integrals of complex valued functions. 4. Stationary and Reversible Processes Our work on this appeared in Serfozo, R.F. (1986). Heredity of Stationary and Reversible Processes. Adv. Appl. Probability. The notion of reversibility plays an important role in characterizing the equilibrium behavior of a network of queues. There are a number of processes associated with a queueing network that are important by themselves. Examples are the number of customers in a certain sector of the network and the point processes of customer flows between pairs of nodes. One frequently confronts the problem: Are these related processes stationary, reversible or ergodic when the network process has these properties? In other words, if a process is stationary, reversible or ergodic, then what functionals of the process have these properties. We answer this by identifying a large class of such functionals. In doing so, we generalize a fundamental result for the heredity of stationarity and we provide an efficient characterization of reversibility that can be used for general random elements such as point processes and random sets.

5. Extremal Problems in Stochast Networks Our work on this will soon appear in Weiss, G. (1987). Stochastic Bounds on Distributions of Optimal Value Functions With Applications to PERT, Network Flows and Reliability. Operations Research, to appear. It is generally impossible to obtain tractable expressions for the probability distributions of (1) Critical path lengths in a PERT network, (2) Maximal flows in a network, or (3) Lifetimes of complicated systems. Consequently, it is natural to seek partial information on worse-case bounds of these variables. This can be formulated as a mathematical programming problem. We present an algorithm for solving this problem. The solution can then be used to obtain bounds for general networks.