Bernoulli Counting Process with p=0.1

Similar documents
Markov Chains. X(t) is a Markov Process if, for arbitrary times t 1 < t 2 <... < t k < t k+1. If X(t) is discrete-valued. If X(t) is continuous-valued

Queuing Theory. Richard Lockhart. Simon Fraser University. STAT 870 Summer 2011

Probability and Statistics Concepts

Networking = Plumbing. Queueing Analysis: I. Last Lecture. Lecture Outline. Jeremiah Deng. 29 July 2013

λ λ λ In-class problems

Queueing Theory. VK Room: M Last updated: October 17, 2013.

Readings: Finish Section 5.2

Since D has an exponential distribution, E[D] = 0.09 years. Since {A(t) : t 0} is a Poisson process with rate λ = 10, 000, A(0.

Chapter 5: Special Types of Queuing Models

Poisson population distribution X P(

Queuing Theory. Using the Math. Management Science

EE126: Probability and Random Processes

IEOR 6711, HMWK 5, Professor Sigman

Introduction to queuing theory

MARKOV PROCESSES. Valerio Di Valerio

CDA5530: Performance Models of Computers and Networks. Chapter 4: Elementary Queuing Theory

Review of Queuing Models

Continuous-time Markov Chains

Statistics 150: Spring 2007

Q = (c) Assuming that Ricoh has been working continuously for 7 days, what is the probability that it will remain working at least 8 more days?

QUEUING SYSTEM. Yetunde Folajimi, PhD

CPSC 531: System Modeling and Simulation. Carey Williamson Department of Computer Science University of Calgary Fall 2017

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

GI/M/1 and GI/M/m queuing systems

Stochastic process. X, a series of random variables indexed by t

Queueing Theory and Simulation. Introduction

Performance Evaluation of Queuing Systems

Introduction to Queueing Theory

NICTA Short Course. Network Analysis. Vijay Sivaraman. Day 1 Queueing Systems and Markov Chains. Network Analysis, 2008s2 1-1

Stochastic Models of Manufacturing Systems

16:330:543 Communication Networks I Midterm Exam November 7, 2005

SOLUTIONS IEOR 3106: Second Midterm Exam, Chapters 5-6, November 8, 2012

M/G/1 and M/G/1/K systems

LECTURE #6 BIRTH-DEATH PROCESS

Queuing Analysis. Chapter Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.

Lecture Notes 7 Random Processes. Markov Processes Markov Chains. Random Processes

Lecture Notes of Communication Network I y: part 5. Lijun Qian. Rutgers The State University of New Jersey. 94 Brett Road. Piscataway, NJ

Computer Networks More general queuing systems

Chapter 3 Balance equations, birth-death processes, continuous Markov Chains

Random Walk on a Graph

CDA6530: Performance Models of Computers and Networks. Chapter 3: Review of Practical Stochastic Processes

Part I Stochastic variables and Markov chains

ISyE 2030 Practice Test 2

Chapter 2 Queueing Theory and Simulation

Solutions to COMP9334 Week 8 Sample Problems

Name of the Student:

CS418 Operating Systems

Introduction to Queueing Theory

Data analysis and stochastic modeling

Stochastic Models in Computer Science A Tutorial

Homework 4 due on Thursday, December 15 at 5 PM (hard deadline).

The exponential distribution and the Poisson process

Queueing Theory II. Summary. ! M/M/1 Output process. ! Networks of Queue! Method of Stages. ! General Distributions

YORK UNIVERSITY FACULTY OF ARTS DEPARTMENT OF MATHEMATICS AND STATISTICS MATH , YEAR APPLIED OPTIMIZATION (TEST #4 ) (SOLUTIONS)

EECS 126 Probability and Random Processes University of California, Berkeley: Fall 2014 Kannan Ramchandran November 13, 2014.

Continuous-Time Markov Chain

Outline. Finite source queue M/M/c//K Queues with impatience (balking, reneging, jockeying, retrial) Transient behavior Advanced Queue.

(b) What is the variance of the time until the second customer arrives, starting empty, assuming that we measure time in minutes?

PBW 654 Applied Statistics - I Urban Operations Research

IOE 202: lectures 11 and 12 outline

M.Sc. (MATHEMATICS WITH APPLICATIONS IN COMPUTER SCIENCE) M.Sc. (MACS)

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Slides 8: Statistical Models in Simulation

4.7 Finite Population Source Model

King Fahd University of Petroleum & Minerals Computer Engineering Dept

NATCOR: Stochastic Modelling

Sandwich shop : a queuing net work with finite disposable resources queue and infinite resources queue

Continuous time Markov chains

ACM 116 Problem Set 4 Solutions

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

Systems Simulation Chapter 6: Queuing Models

EE126: Probability and Random Processes

Introduction to Queuing Networks Solutions to Problem Sheet 3

Chapter 10. Queuing Systems. D (Queuing Theory) Queuing theory is the branch of operations research concerned with waiting lines.

IEOR 3106: Second Midterm Exam, Chapters 5-6, November 7, 2013

Closed book and notes. 120 minutes. Cover page, five pages of exam. No calculators.

ECE-517: Reinforcement Learning in Artificial Intelligence. Lecture 4: Discrete-Time Markov Chains

Statistics 253/317 Introduction to Probability Models. Winter Midterm Exam Friday, Feb 8, 2013

Common Discrete Distributions

Figure 10.1: Recording when the event E occurs

Birth-Death Processes

CDA5530: Performance Models of Computers and Networks. Chapter 3: Review of Practical

h(x) = f(x)/g(x) = (1 + x)e (1/2)x.

Math 597/697: Solution 5

Introduction to Queuing Theory. Mathematical Modelling

Computer Systems Modelling

BIRTH DEATH PROCESSES AND QUEUEING SYSTEMS

Massachusetts Institute of Technology

Random Variables Example:

Continuous Time Processes

Chapter 3. Discrete Random Variables and Their Probability Distributions

ISyE 6650 Test 2 Solutions

CS 798: Homework Assignment 3 (Queueing Theory)

Page 0 of 5 Final Examination Name. Closed book. 120 minutes. Cover page plus five pages of exam.

Reading: Karlin and Taylor Ch. 5 Resnick Ch. 3. A renewal process is a generalization of the Poisson point process.

Introduction to Markov Chains, Queuing Theory, and Network Performance

Answers to selected exercises

Simulating events: the Poisson process

Transcription:

Stat 28 October 29, 21 Today: More Ch 7 (Sections 7.4 and part of 7.) Midterm will cover Ch 7 to section 7.4 Review session will be Nov. Exercises to try (answers in book): 7.1-, 7.2-3, 7.3-3, 7.4-7 Where were we last Wednesday? Sec 7.1: Bernoulli Counting Process: modeled X(t), the number of events occurring in time 1,2,3,., t Bernoulli Counting Process with p=.1 6 4 3 2 1 1 2 3 4 frame Example: frame, 1 minute Number of accidents in a large city, 8: am to 8:4 am.

Sec 7.2: The Poisson Process: modeled N(t), the number of events occurring in time (,t). Poisson Process with lambda = 1 1 time-sec 1 In both cases, we assume the average rate of arrival, λ, is constant, but the rate of arrival will of course vary in particular outcomes. (So X(t) and N(t) are random variables.) Ex 7.1-4 Two researchers A and B use different frames to model customer arrivals at a grocery store, during a one hour period. A uses frames of 1 second B uses frames of 1 minute Customers arrive at the store at the average rate of 36 customers per hour a) For a single frame, what is P(an arrival)? P(arrival in a frame )=36/36=.1 for A = 36/6 =.6 for B Reasonable because Bs frames are 6 times larger. b) Number of customers arriving in an hour? Mean and SD? Mean is still 36 for one hour in both cases. Number of frames * P(arrival) = 36 Var is np(1-p) = 36 *.1 *.99 = 3.64 for A and =6*.6*.4 = 14.4 for B SD is.9 for A 3.8 for B c) How would the two simulations compare? B s would be too stable, and not reflect the true variability of the arrival process. Q: What would comparable SD of Poisson model?

Mean for 1 hour is 36. SD of Poisson(36) is 6. A s simulation was close. Exercise 7.2-4 Artic equipment. One service every 2 hours, on average. Rate is. services per hour. a) Mission takes 24 hours. P(no service) =? Mean number of services for 24 hours is 24 *. =.12, so P(no service in 24 hours) = e.12 =.89 is the probability that the mission can be completed without a service break. b) If e λt =.9 with λ =. then -.t=ln(.9) t=1.26 hours The mission would have to be completed in 1.26 hours. Section 7.4 The Bernoulli Single server Queuing Process Arrivals Process: In each frame, P(arrival) = P A Service Process: In each frame, P(departure at least one in queue) = P S Easy to simulate with two Bernoulli processes running in the same time-frames. Note Markov transitions from one frame to next, for queue length. ->: conditional probability of such a transition = 1- P A ->1: = P A i->i-1 when i 1: = P S (1- P A ) i->i when i 1: = (1-P A )(1-P S ) + P A P S i->i+1 when i 1: = P A (1-P S ) Could simulate this queue using the Markov Chain simulator. Do we need an infinite dimensional 1-step transition matrix? Use max queue = 6 for this one: Matrix M1.9.1.....13.78.8.....13.78.8.....13.78.8.....13.78.8.....13.86

2 1 step 1 We were OK assuming queue length <6. Section 7. The M/M/1 Queue This section is about some queuing processes in continuous time. Of course the queue length that we model is still discrete:,1,2,. F/G/s notation for queues: F is cdf of interarrival time G is CDF of service time s is number of servers M is used to denote the exponential CDF because of its Memoryless property. M/M/1 means exponential interarrival times, exponential service times, and 1 server. The arrival rate is denoted λ A and the service rate λ S. Note that the service rate λ S is greater than the rate at which customers are served since if there is nobody in the queue, the service rate is until a customer arrives. We can use the Bernoulli Queuing Process as a starting point for defining a continuous time Queuing Process. Just let the frame size ->. (see p 292 for details) to get the M/M/1 queuing process.

Note how the indepence of Bernoulli trials implies the memoryless property of the exponential interarrival times, assuming the limiting process works as claimed. Preparation for next time: Read the important development of the steady-state distributions for the M/M/1 queue. The idea in this section applies more generally to queuing processes. Note also how impotant it is that in a queue, the transitions out of state i are limited to either i+1 or i-1. Appix: Here is the program that generated the Markov Queuing Process in Example 7.4-1 (p 28). Gmacro MChain # Here is a program that will simulate a Markov Chain: To adapt # it to any Markov chain, just specify the size of the state space, k1, # the transition matrix, c1-ck1, the number of time points to # simulate, k4, and the start state, k2. The program produces a plot # of the k4 values of the chain, and also an estimate of the steady # state distribution. # # To use this program, Type %MChain after the MTB> prompt. # # We begin with the initialization # let k4=1 # length of chain to be simulated let k2= # set start state for Markov chain let k1=6 # set size of state space of Markov chain read c1-ck1 # read in k1 by k1 transition matrix.9.1.13.78.8.13.78.8.13.78.8.13.78.8.13.86 copy c1-ck1 m1 # we want the columns to be the distributions trans m1 m2 # to generate so have to transpose transition copy m2 c1-ck1 # matrix (See rand & discrete below) let k6=k2+1 # we will want to change this "from" state at each loop Let k1=k1-1 # We want our states to be,1,2,...,k1-1 set c1 # the column that makes up part of the table used # to define the discrete probability distribution

:k1 Let k4=k4-1 # We already have one of the k4 values from k2 set c2 # this stores resulting chain # We just fill it with any numbers for now 1:k4 name c2 'chain' do k=1:k4 rand 1 c11; # This uses the ck6 probabilities to generate a value discrete c1 ck6. # c1 is just,1,2,3,...,m-1 for m state MC let c2(k)=c11(1) # capture generated state let k6=c11(1)+1 # record result for input to next loop # Note that c1 holds probs for transition from state, c2 from state 1... do set c21 # this sets up the time variable in plot :k4 name c21 'step' stack k2 c2 c2 # puts start value at beginning of chain print c21 c2 table c2; # this just computes the proportion of time spent in # each state. Compare with the steady state # probabilities colp. # column percents subcommand to table plot c2*c21; # Plot of Markov Chain connect. # joins the points by lines # To get the output, just copy and paste from the MINITAB # Session window to a word processor, OR, select a portion of the # Session window and under the File menu select "Print Selection". # The graph can be printed either by COPY GRAPH in the EDIT menu, and # then paste to a word processor, OR by "Print Window" under the # File menu - but for either of these, one has to find the graph at # the bottom of the WINDOW menu. Endmacro Here is the graph of a longer simulation.

4 3 2 1 step 1 Maybe a 6 by 6 transition matrix was not big enough after all!