Tales of Time Scales. Ward Whitt AT&T Labs Research Florham Park, NJ

Similar documents
MODELING WEBCHAT SERVICE CENTER WITH MANY LPS SERVERS

THE HEAVY-TRAFFIC BOTTLENECK PHENOMENON IN OPEN QUEUEING NETWORKS. S. Suresh and W. Whitt AT&T Bell Laboratories Murray Hill, New Jersey 07974

USING DIFFERENT RESPONSE-TIME REQUIREMENTS TO SMOOTH TIME-VARYING DEMAND FOR SERVICE

Economy of Scale in Multiserver Service Systems: A Retrospective. Ward Whitt. IEOR Department. Columbia University

Dynamic Control of Parallel-Server Systems

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

HEAVY-TRAFFIC EXTREME-VALUE LIMITS FOR QUEUES

Non Markovian Queues (contd.)

Queueing Theory II. Summary. ! M/M/1 Output process. ! Networks of Queue! Method of Stages. ! General Distributions

Stochastic-Process Limits

Asymptotic Coupling of an SPDE, with Applications to Many-Server Queues

Class 11 Non-Parametric Models of a Service System; GI/GI/1, GI/GI/n: Exact & Approximate Analysis.

A Robust Queueing Network Analyzer Based on Indices of Dispersion

Lecture 9: Deterministic Fluid Models and Many-Server Heavy-Traffic Limits. IEOR 4615: Service Engineering Professor Whitt February 19, 2015

LIMITS FOR QUEUES AS THE WAITING ROOM GROWS. Bell Communications Research AT&T Bell Laboratories Red Bank, NJ Murray Hill, NJ 07974

TOWARDS BETTER MULTI-CLASS PARAMETRIC-DECOMPOSITION APPROXIMATIONS FOR OPEN QUEUEING NETWORKS

OPEN MULTICLASS HL QUEUEING NETWORKS: PROGRESS AND SURPRISES OF THE PAST 15 YEARS. w 1. v 2. v 3. Ruth J. Williams University of California, San Diego

Maximum pressure policies for stochastic processing networks

Control of Fork-Join Networks in Heavy-Traffic

Advanced Computer Networks Lecture 3. Models of Queuing

Multivariate Risk Processes with Interacting Intensities

Stability and Rare Events in Stochastic Models Sergey Foss Heriot-Watt University, Edinburgh and Institute of Mathematics, Novosibirsk

NEW FRONTIERS IN APPLIED PROBABILITY

ENGINEERING SOLUTION OF A BASIC CALL-CENTER MODEL

LIMITS AND APPROXIMATIONS FOR THE M/G/1 LIFO WAITING-TIME DISTRIBUTION

Linear Model Predictive Control for Queueing Networks in Manufacturing and Road Traffic

Intro to Queueing Theory

On the Resource/Performance Tradeoff in Large Scale Queueing Systems

IEOR 8100: Topics in OR: Asymptotic Methods in Queueing Theory. Fall 2009, Professor Whitt. Class Lecture Notes: Wednesday, September 9.

Introduction to queuing theory

Stability and Asymptotic Optimality of h-maxweight Policies

Positive Harris Recurrence and Diffusion Scale Analysis of a Push Pull Queueing Network. Haifa Statistics Seminar May 5, 2008

A Diffusion Approximation for Stationary Distribution of Many-Server Queueing System In Halfin-Whitt Regime

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.

Designing load balancing and admission control policies: lessons from NDS regime

Queueing Review. Christos Alexopoulos and Dave Goldsman 10/6/16. (mostly from BCNN) Georgia Institute of Technology, Atlanta, GA, USA

COMPUTING DISTRIBUTIONS AND MOMENTS IN POLLING MODELS BY NUMERICAL TRANSFORM INVERSION

Glossary availability cellular manufacturing closed queueing network coefficient of variation (CV) conditional probability CONWIP

Dynamic Control of a Tandem Queueing System with Abandonments

Load Balancing in Distributed Service System: A Survey

Data analysis and stochastic modeling

OPTIMAL CONTROL OF A FLEXIBLE SERVER

J. MEDHI STOCHASTIC MODELS IN QUEUEING THEORY

Some open problems related to stability. 1 Multi-server queue with First-Come-First-Served discipline

STABILITY AND STRUCTURAL PROPERTIES OF STOCHASTIC STORAGE NETWORKS 1

A Fluid Approximation for Service Systems Responding to Unexpected Overloads

Operations Research Letters. Instability of FIFO in a simple queueing system with arbitrarily low loads

Baltzer Journals Received 7 January 1997; revised 16 April 1997 An Interpolation Approximation for the GI/G/1 Queue Based on Multipoint Pade Approxima

Figure 10.1: Recording when the event E occurs

Queueing Review. Christos Alexopoulos and Dave Goldsman 10/25/17. (mostly from BCNN) Georgia Institute of Technology, Atlanta, GA, USA

Advanced Queueing Theory

5 Lecture 5: Fluid Models

BRAVO for QED Queues

A Diffusion Approximation for the G/GI/n/m Queue

Erlang-C = M/M/N. agents. queue ACD. arrivals. busy ACD. queue. abandonment BACK FRONT. lost calls. arrivals. lost calls

Asymptotic Delay Distribution and Burst Size Impact on a Network Node Driven by Self-similar Traffic

Synchronized Queues with Deterministic Arrivals

CPSC 531: System Modeling and Simulation. Carey Williamson Department of Computer Science University of Calgary Fall 2017

P (L d k = n). P (L(t) = n),

Asymptotically Optimal Inventory Control For Assemble-to-Order Systems

Link Models for Circuit Switching

Designing a Telephone Call Center with Impatient Customers

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 22 12/09/2013. Skorokhod Mapping Theorem. Reflected Brownian Motion

State Space Collapse in Many-Server Diffusion Limits of Parallel Server Systems and Applications. Tolga Tezcan

Stochastic Models 3 (1998)

Periodic Load Balancing

Single-Server Service-Station (G/G/1)

Numerical Transform Inversion to Analyze Teletraffic Models

A monotonic property of the optimal admission control to an M/M/1 queue under periodic observations with average cost criterion

ISyE 2030 Practice Test 2

Stochastic relations of random variables and processes

CDA5530: Performance Models of Computers and Networks. Chapter 4: Elementary Queuing Theory

Making Delay Announcements

M/G/1 and Priority Queueing

Performance Evaluation of Queuing Systems

CONVERGENCE TO FRACTIONAL BROWNIAN MOTION AND LOSS PROBABILITY. Jin-Chun Kim and Hee-Choon Lee

Queuing Networks: Burke s Theorem, Kleinrock s Approximation, and Jackson s Theorem. Wade Trappe

Hyperbolic Models for Large Supply Chains. Christian Ringhofer (Arizona State University) Hyperbolic Models for Large Supply Chains p.

Advanced Queueing Theory

Classical Queueing Models.

Stochastic process. X, a series of random variables indexed by t

QUEUING SYSTEM. Yetunde Folajimi, PhD

Stochastic Network Calculus

A STAFFING ALGORITHM FOR CALL CENTERS WITH SKILL-BASED ROUTING: SUPPLEMENTARY MATERIAL

Contents Preface The Exponential Distribution and the Poisson Process Introduction to Renewal Theory

System occupancy of a two-class batch-service queue with class-dependent variable server capacity

One important issue in the study of queueing systems is to characterize departure processes. Study on departure processes was rst initiated by Burke (

The Performance Impact of Delay Announcements

LIMITS AND APPROXIMATIONS FOR THE BUSY-PERIOD DISTRIBUTION IN SINGLE-SERVER QUEUES

A Review of Basic FCLT s

Quiz 1 EE 549 Wednesday, Feb. 27, 2008

Tutorial: Optimal Control of Queueing Networks

Introduction to Queueing Theory with Applications to Air Transportation Systems

THIELE CENTRE. The M/M/1 queue with inventory, lost sale and general lead times. Mohammad Saffari, Søren Asmussen and Rasoul Haji

Answers to selected exercises

Stationary Probabilities of Markov Chains with Upper Hessenberg Transition Matrices

Networking = Plumbing. Queueing Analysis: I. Last Lecture. Lecture Outline. Jeremiah Deng. 29 July 2013

HEAVY-TRAFFIC ASYMPTOTIC EXPANSIONS FOR THE ASYMPTOTIC DECAY RATES IN THE BMAP/G/1 QUEUE

/department of mathematics and computer science 1/46

NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MH4702/MAS446/MTH437 Probabilistic Methods in OR

Transcription:

Tales of Time Scales Ward Whitt AT&T Labs Research Florham Park, NJ

New Book Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001

I won t waste a minute to read that book. - Felix Pollaczek

Ideal for anyone working on their third Ph.D. in queueing theory - Agner Krarup Erlang

Flow Modification

Flow Modification

Multiple Classes 1 2 m Single Server m

Whitt, W. (1988) A light-traffic approximation for single-class departure processes from multi-class queues. Management Science 34, 1333-1346. Wischik, D. (1999) The output of a switch, or, effective bandwidths for networks. Queueing Systems 32, 383-396.

M/G/1 Queue in a Random Environment Let the arrival rate be a stochastic process with two states. MMPP/G/1 is a special case.

environment state 1 2 mean holding time (in environment state) 1 5 arrival rate 0.92 0.50 mean service time 1 1 Overall Traffic Intensity ρ = 0.57

environment state 1 2 mean holding time (in environment state) 1 5 arrival rate 2.00 0.50 mean service time 1 1 Overall Traffic Intensity ρ = 0.75

A Slowly Changing Environment

environment state 1 2 mean holding time (in environment state) arrival rate 1M 0.92 5M 0.50 mean service time 1 1 Overall Traffic Intensity ρ = 0.57

What Matters? Environment Process? Arrival and Service Processes? M?

Nearly Completely Decomposable Markov Chains P. J. Courtois, Decomposability, 1977

What if the queue is unstable in one of the environment states?

environment state 1 2 mean holding time (in environment state) arrival rate 1M 2.00 5M 0.50 mean service time 1 1 Overall Traffic Intensity ρ = 0.75

What Matters? Environment Process? Arrival and Service Processes? M?

Change Time Units Measure time in units of M i.e., divide time by M

environment state 1 2 mean holding time (in environment state) 1 5 arrival rate 2.00M 0.50M mean service time 1/M 1/M Overall Traffic Intensity ρ = 0.75

Workload in Remaining Service Time With Deterministic Holding Times 1

Steady-state workload tail probabilities in the MMPP/G/1 queue size factor M 10 10 10 10 2 3 4 service-time distribution D E4 M b 2 H2, c = 4 D E4 M b 2 H2, c = 4 D E4 M b 2 H2, c = 4 D E4 M b 2 H2, c = 4 tail probability P( W > x) x = 0.5 x = 2.5 x = 4.5 x = 6.5 0.40260 0.13739 0.04695 0.01604 0.41100 0.14350 0.05040 0.01770 0.44246 0.16168 0.06119 0.02316 0.52216 0.23002 0.01087 0.05168 0.37376 0.11418 0.03488 0.01066 0.37383 0.11425 0.03492 0.01067 0.37670 0.11669 0.03614 0.01120 0.38466 0.12398 0.03997 0.01289 0.37075 0.11183 0.03373 0.01017 0.37082 0.11189 0.03376 0.01019 0.37105 0.11208 0.03385 0.01023 0.37186 0.11281 0.03422 0.01038 0.37044 0.11159 0.03362 0.01013 0.37045 0.11160 0.03362 0.01013 0.37047 0.11164 0.03363 0.01013 0.37055 0.11169 0.03366 0.01015

G. L. Choudhury, A. Mandelbaum, M. I. Reiman and W. Whitt, Fluid and diffusion limits for queues in slowly changing environments. Stochastic Models 13 (1997) 121-146.

Thesis: Heavy-traffic limits for queues can help expose phenomena occurring at different time scales. Asymptotically, there may be a separation of time scales.

Network Status Probe

Heavy-Traffic Perspective n -H W n (nt) W(t) 0 < H < 1 n = (1 - ρ ) -1/(1-H) Snapshot Principle

Server Scheduling With Delay and Switching Costs Multiple Classes Single Server

Heavy-Traffic Limit for Workload W n W W n (t) = n -H W n (nt) 0 < H < 1 n = (1 - ρ ) -1/(1-H)

One Approach: Polling Multiple Classes Single Server

Heavy-Traffic Averaging Principle s+h h -1 f(w i,n (t)) dt s s+h 1 h -1 ( f(a i uw(t)) du ) dt s 0 W i,n (t) = n -H W i,n (nt)

Coffman, E. G., Jr., Puhalskii, A. A. and Reiman, M. I. (1995) Polling systems with zero switchover times: a heavy-traffic averaging principle. Ann. Appl. Prob. 5, 681-719. Markowitz, D. M. and Wein, L. M. (2001) Heavy-traffic analysis of dynamic cyclic policies: a unified treatment of the single machine scheduling problem. Operations Res. 49, 246-270. Kushner, H. J. (2001) Heavy Traffic Analysis of Controlled Queueing and Communication Networks, Springer, New York.

My thesis has been that one path to the construction of a nontrivial theory of complex systems is by way of a theory of hierarchy. - H. A. Simon Holt, Modigliani, Muth and Simon, Planning Production, Inventories and Workforce, 1960. Simon and Ando, Aggregation of variables in dynamic systems. Econometrica, 1961. Ando, Fisher and Simon, Essays on the Structure of Social Science Models, 1963.

Application to Manufacturing MRP

mrp material requirements planning Management information system Expand bill of materials Orlicky (1975) MRP Manufacturing Resources Planning Long-Range Planning (Strategic) Intermediate-Range Planning (Tactical) Short-Term Control (Operational)

Hierarchical Decision Making in Stochastic Manufacturing Systems - Suresh P. Sethi and Qing Zhang, 1994 inf E e [ h( x( t)) + c( u( t))] dt u A 0 ρt xt &() = ut () zt (), 0 ut ( ) Kt ( )