A Result for a Counter Problem

Size: px
Start display at page:

Download "A Result for a Counter Problem"

Transcription

1 A Result for a Counter Problem M. Hlynka and P.H. Brill Department of Mathematics and Statistics University of Windsor Windsor, Ontario, Canada N9B 3P4 hlynka@uwindsor.ca January 2, 2008 Keywords: counter model, stochastic, M/D/1/1 queue Date: January 2, Do not quote without the authors permission. Abstract We present present a solution for the probability of a Type I counter being free at time t if the locked time is constant and the arrivals follows a Poisson process, and the system is free at time zero. This is the same as finding the probability of zero customers at time t in an M/D/1/1 queueing system, if the system starts empty. 1

2 1 Introduction Several authors in stochastic processes discuss electronic counter problems (such as Geiger counters). Examples include [2] and [1]. In [1], electronic counters are classified as one of two types. Signals, in the form of pulses, arrive at the electronic counter according to some process. A type I counter is either free or locked (dead) at any time t. If it is free then, it can accept an arriving signal. Once a signal is accepted, the counter is locked and no further signals can be accepted until the counter becomes free again. Any signals arriving, while the counter is locked, are lost to the system. For this paper, we assume that the locked time is a fixed positive constant D (for dead time). A type II counter, does not count signals that arrive during the locked time, but the locked time is extended by each arrival, even those during locked time. If the locked time contributed by each arrival is a constant D, then the counter remains locked for D time units after an arrival and that locked time may be extended if there is an arrival during a locked time.

3 Assume that a counter is free at time zero. Assume pulses arrive at a counter according to a Poisson process at rate λ. Let p(t) be probability that the counter is free at time t. For a type II counter, [1] indicates that p(t) = e λt e λd if 0 <t<d if t>d. This is reasonable. If t D, then the counter is unlocked if there are no arrivals in the period (0,D]. If t>d, then the counter is free at time t iff there are no arrivals in the previous D time units. Thus p(t) =e Dλ in that case. In section 2, we consider the Type II counter model. In Section 3, we give some numerical results. 2 Type I counter Solution We next consider the more complex Type I counter case. Property 2.1. For a type I counter, assume that signals arrive according to a Poisson process at rate λ. The counter is either locked or free at any time t. If the signal arrives when the counter is free, then the counter becomes locked for a time D. Any arriving signals

4 during the locked time do not count and do not affect the locked time. After the counter becomes free again, the next arriving signal will lock the counter for time D and so on. Let p(t) be the probability that the counter is free at time t. Thenp(t) = e λt p 1 (t) if 0 <t D (λ(t D)) 0 e λ(t D) p 1 (D)+ (λ(t D))1 e λ(t D) p 2 (t) if D<t D i 1 j=0 (λ(t id))j e λ(t id) p i j ((i j)d)+ (λ(t id))i e λ(t id) j! i! p i+1 (t) if id < t (i +1)D, i =1, 2,... Proof. Assume that the counter is free at time 0. CASE 1: 0 <t D. The counter will be locked at time t iff there is an arrival before t. So the probability that it is free at time t is the probability of no arrivals before t, namely p 1 (t) =e λt. CASE 2: D<t 2D. In this case, there are two ways that the counter could be free at time t. One way: There could be no arrivals over the entire interval (0,t). This could be viewed as 0 arrivals in (0,t D) and no arrivals in

5 the interval (t D, t) oflengthd. The numbers of arrivals in these nonoverlapping intervals are independent so the probability is (λ(t D)) 0 e λ(t D) p 1 (D) Second way: There could be at least one arrival in (0,t D), after which the counter is locked for an interval of length D. Let the first such arrival be at time s. After clearing, in the remaining time interval (D + s, t) oflengtht (D + s), there can be no arrivals (because an arrival would lock the counter at time t). But the intervals (0,s) and (D + s, t) have total length t D. So we are really getting the probability of exactly one arrival in an interval of length t D. This has probability (λ(t D))1 e λ(t D). Thus our total probability for case 2 is p 2 (t) = (λ(t D))0 e λ(t D) p 1 (D)+ (λ(t D))1 e λ(t D). Note that p 2 (D) =p 1 (D) so we can extend both functions to include the endpoints. CASE 3: 2D <t<3d In this case, there could be 0 or 1 or 2 arrivals while the counter is free. One way: There could be 0 arrivals in (0,t 2D) followed by the situation in Case 2. The probability is

6 (λ(t 2D)) 0 e λ(t 2D) p 2 (2D). Second way: There could be at least one arrival in (0,t 2D), the first at time s, then the counter is locked for the interval (s, s + D), followed by no arrivals in (s + D, t D), followed by no arrivals in the interval (t D, t). But the intervals (0,s)and(s + D, t D) have total length t 2D. This situation is equivalent to exactly one arrival in an interval of length t 2D followed by locking time D, and no arrivals in the final interval of length D. The probability of this second way is (λ(t 2D)) 1 e λ(t 2D) p 1 (D). Third way. There could be at least one arrival in (0,t 2D), say the first is at s, then the counter is locked until time s + D, then at least another arrival in (s + D, t D), say the first is at r, then counter is locked until r + D, followed by no arrival in the final interval (r + D, t). But the three small intervals (0,s), (s + D, r), (r + D, t) have total length t 2D so this is equivalent to getting exactly 2 arrivals in an interval of length t 2D. The probability of the third way is (λ(t 2D)) 2 e λ(t 2D). 2!

7 Summing the probabilities of the three ways gives p 3 (t) = (λ(t 2D))0 e λ(t 2D) p 2 (2D)+ (λ(t 2D))1 e λ(t 2D) p 1 (D)+ (λ(t 2D)) 2 e λ(t 2D). 2! The pattern is clear at this point. 3 Numerical Results We give a partial check of the results using the statstical language R by considering a specific case. Let D =2,λ = 1. We compute p 1 (D), p 2 (2D), p 3 (2D), p 4 (4D), p 5 (5D), p 6 (6D), p 7 (7D). We know that the limiting result should be are the results. 1/λ D +1/λ =1/3. Here >D=2;L=1 >test=(1/l)/(d+1/l); test >p1=exp(-l*d);p >p2=exp(-l*d)*p1+l*d*exp(-l*d):p >p3=exp(-l*d)*p2+l*d*exp(-l*d)*p1+((l*d)ˆ2)*exp(-l*d)/2;p

8 >p4=exp(-l*d)*p3+l*d*exp(-l*d)*p2+p1*((l*d)ˆ2)*exp(-l*d)/2 +((L*D)ˆ3)*exp(-L*D)/6 >p >p5=exp(-l*d)*p4+l*d*exp(-l*d)*p3+p2*((l*d)ˆ2)*exp(-l*d)/2 +p1*((l*d)ˆ3)*exp(-l*d)/6+((l*d)ˆ4)*exp(-l*d)/24 >p >p6=exp(-l*d)*p5+l*d*exp(-l*d)*p4+p3*((l*d)ˆ2)*exp(-l*d)/2 +p2*((l*d)ˆ3)*exp(-l*d)/6+p1*((l*d)ˆ4)*exp(-l*d)/24 +((L*D)ˆ5)*exp(-L*D)/120 >p >p7= exp(-l*d)*p6+l*d*exp(-l*d)*p5+p4*((l*d)ˆ2)*exp(-l*d)/2+ p3*((l*d)ˆ3)*exp(-l*d)/6+p2*((l*d)ˆ4)*exp(-l*d)/24+ p1*((l*d)ˆ5)*exp(-l*d)/120+((l*d)ˆ6)*exp(-l*d)/720 >p

9 References [1] S. Karlin and H.M. Taylor. A First Course in Stochastic Processes. Second Edition Academic Press. [2] E. Parzen. Stochastic Processes Holden Day.

The Geiger Counter. Gavin Cheung. April 10, 2011

The Geiger Counter. Gavin Cheung. April 10, 2011 The Geiger Counter Gavin Cheung 0938173 April 10, 011 Abstract The half life of indium-116 was found using a Geiger counter. The half life was found to be 3300 ± 50s. The dead time of the Geiger counter

More information

Nonhomogeneous Geometric Distribution Representations and Queueing

Nonhomogeneous Geometric Distribution Representations and Queueing Nonhomogeneous Geometric Distribution Representations and Queueing Marvin Mandelbaum, Department of Computer Science, York University, Toronto, Ontario, Canada M3J P3 mandel@cse.yorku.ca Myron Hlynka,

More information

Radioactivity. PC1144 Physics IV. 1 Objectives. 2 Equipment List. 3 Theory

Radioactivity. PC1144 Physics IV. 1 Objectives. 2 Equipment List. 3 Theory PC1144 Physics IV Radioactivity 1 Objectives Investigate the analogy between the decay of dice nuclei and radioactive nuclei. Determine experimental and theoretical values of the decay constant λ and the

More information

Manual for SOA Exam MLC.

Manual for SOA Exam MLC. Chapter 10. Poisson processes. Section 10.5. Nonhomogenous Poisson processes Extract from: Arcones Fall 2009 Edition, available at http://www.actexmadriver.com/ 1/14 Nonhomogenous Poisson processes Definition

More information

M/M/1 Transient Queues and Path Counting

M/M/1 Transient Queues and Path Counting M/M/1 Transient Queues and Path Counting M.HlynaandL.M.Hurajt Department of Mathematics and Statistics University of Windsor Windsor, Ontario, Canada N9B 3P4 December 14, 006 Abstract We find combinatorially

More information

Simulating events: the Poisson process

Simulating events: the Poisson process Simulating events: te Poisson process p. 1/15 Simulating events: te Poisson process Micel Bierlaire micel.bierlaire@epfl.c Transport and Mobility Laboratory Simulating events: te Poisson process p. 2/15

More information

Chapter 2. Poisson Processes. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan

Chapter 2. Poisson Processes. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Chapter 2. Poisson Processes Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Outline Introduction to Poisson Processes Definition of arrival process Definition

More information

Statistics 262: Intermediate Biostatistics Non-parametric Survival Analysis

Statistics 262: Intermediate Biostatistics Non-parametric Survival Analysis Statistics 262: Intermediate Biostatistics Non-parametric Survival Analysis Jonathan Taylor & Kristin Cobb Statistics 262: Intermediate Biostatistics p.1/?? Overview of today s class Kaplan-Meier Curve

More information

Exponential Distribution and Poisson Process

Exponential Distribution and Poisson Process Exponential Distribution and Poisson Process Stochastic Processes - Lecture Notes Fatih Cavdur to accompany Introduction to Probability Models by Sheldon M. Ross Fall 215 Outline Introduction Exponential

More information

The exponential distribution and the Poisson process

The exponential distribution and the Poisson process The exponential distribution and the Poisson process 1-1 Exponential Distribution: Basic Facts PDF f(t) = { λe λt, t 0 0, t < 0 CDF Pr{T t) = 0 t λe λu du = 1 e λt (t 0) Mean E[T] = 1 λ Variance Var[T]

More information

Optimization and Simulation

Optimization and Simulation Optimization and Simulation Simulating events: the Michel Bierlaire Transport and Mobility Laboratory School of Architecture, Civil and Environmental Engineering Ecole Polytechnique Fédérale de Lausanne

More information

A Queueing Model for Sleep as a Vacation

A Queueing Model for Sleep as a Vacation Applied Mathematical Sciences, Vol. 2, 208, no. 25, 239-249 HIKARI Ltd, www.m-hikari.com https://doi.org/0.2988/ams.208.8823 A Queueing Model for Sleep as a Vacation Nian Liu School of Mathematics and

More information

Introduction to queuing theory

Introduction to queuing theory Introduction to queuing theory Claude Rigault ENST claude.rigault@enst.fr Introduction to Queuing theory 1 Outline The problem The number of clients in a system The client process Delay processes Loss

More information

POISSON PROCESSES 1. THE LAW OF SMALL NUMBERS

POISSON PROCESSES 1. THE LAW OF SMALL NUMBERS POISSON PROCESSES 1. THE LAW OF SMALL NUMBERS 1.1. The Rutherford-Chadwick-Ellis Experiment. About 90 years ago Ernest Rutherford and his collaborators at the Cavendish Laboratory in Cambridge conducted

More information

(implicitly assuming time-homogeneity from here on)

(implicitly assuming time-homogeneity from here on) Continuous-Time Markov Chains Models Tuesday, November 15, 2011 2:02 PM The fundamental object describing the dynamics of a CTMC (continuous-time Markov chain) is the probability transition (matrix) function:

More information

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K "

Queueing Theory I Summary! Little s Law! Queueing System Notation! Stationary Analysis of Elementary Queueing Systems  M/M/1  M/M/m  M/M/1/K Queueing Theory I Summary Little s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems " M/M/1 " M/M/m " M/M/1/K " Little s Law a(t): the process that counts the number of arrivals

More information

Math/Stat 352 Lecture 8

Math/Stat 352 Lecture 8 Math/Stat 352 Lecture 8 Sections 4.3 and 4.4 Commonly Used Distributions: Poisson, hypergeometric, geometric, and negative binomial. 1 The Poisson Distribution Poisson random variable counts the number

More information

Sources of randomness

Sources of randomness Random Number Generator Chapter 7 In simulations, we generate random values for variables with a specified distribution Ex., model service times using the exponential distribution Generation of random

More information

Chapter 3: Markov Processes First hitting times

Chapter 3: Markov Processes First hitting times Chapter 3: Markov Processes First hitting times L. Breuer University of Kent, UK November 3, 2010 Example: M/M/c/c queue Arrivals: Poisson process with rate λ > 0 Example: M/M/c/c queue Arrivals: Poisson

More information

Convergence Rates for Renewal Sequences

Convergence Rates for Renewal Sequences Convergence Rates for Renewal Sequences M. C. Spruill School of Mathematics Georgia Institute of Technology Atlanta, Ga. USA January 2002 ABSTRACT The precise rate of geometric convergence of nonhomogeneous

More information

Lectures prepared by: Elchanan Mossel Yelena Shvets

Lectures prepared by: Elchanan Mossel Yelena Shvets Introduction to probability Stat 134 FAll 2005 Berkeley Lectures prepared by: Elchanan Mossel Yelena Shvets Follows Jim Pitman s book: Probability Section 4.2 Random Times Random times are often described

More information

Point Process Control

Point Process Control Point Process Control The following note is based on Chapters I, II and VII in Brémaud s book Point Processes and Queues (1981). 1 Basic Definitions Consider some probability space (Ω, F, P). A real-valued

More information

Some results on. Transient Queues. Shan XU

Some results on. Transient Queues. Shan XU Some results on Transient Queues by Shan XU A Major Paper Submitted to the Faculty of Graduate Studies through the Department of Mathematics and Statistics in Partial Fulfillment of the Requirements for

More information

CDA6530: Performance Models of Computers and Networks. Chapter 8: Discrete Event Simulation (DES)

CDA6530: Performance Models of Computers and Networks. Chapter 8: Discrete Event Simulation (DES) CDA6530: Performance Models of Computers and Networks Chapter 8: Discrete Event Simulation (DES) Simulation Studies Models with analytical formulas Calculate the numerical solutions Differential equations

More information

Math 416 Lecture 11. Math 416 Lecture 16 Exam 2 next time

Math 416 Lecture 11. Math 416 Lecture 16 Exam 2 next time Math 416 Lecture 11 Math 416 Lecture 16 Exam 2 next time Birth and death processes, queueing theory In arrival processes, the state only jumps up. In a birth-death process, it can either jump up or down

More information

Springer Texts in Statistics. Advisors: Stephen Fienberg Ingram Olkin

Springer Texts in Statistics. Advisors: Stephen Fienberg Ingram Olkin Springer Texts in Statistics Advisors: Stephen Fienberg Ingram Olkin Springer Texts in Statistics Alfred Berger Blom Chow and Teicher Christensen Christensen Christensen du Toit, Steyn and Stumpf Finkelstein

More information

Stochastic Processes and Advanced Mathematical Finance. Stochastic Processes

Stochastic Processes and Advanced Mathematical Finance. Stochastic Processes Steven R. Dunbar Department of Mathematics 203 Avery Hall University of Nebraska-Lincoln Lincoln, NE 68588-0130 http://www.math.unl.edu Voice: 402-472-3731 Fax: 402-472-8466 Stochastic Processes and Advanced

More information

ON THE MOMENTS OF ITERATED TAIL

ON THE MOMENTS OF ITERATED TAIL ON THE MOMENTS OF ITERATED TAIL RADU PĂLTĂNEA and GHEORGHIŢĂ ZBĂGANU The classical distribution in ruins theory has the property that the sequence of the first moment of the iterated tails is convergent

More information

Laplace Transforms of Busy Periods in Queues

Laplace Transforms of Busy Periods in Queues Laplace Transforms of Busy Periods in Queues by Bingsen Yan A Major Paper Submitted to the Faculty of Graduate Studies through the Department of Mathematics and Statistics in Partial Fulfillment of the

More information

Part I Stochastic variables and Markov chains

Part I Stochastic variables and Markov chains Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)

More information

Quantitative Model Checking (QMC) - SS12

Quantitative Model Checking (QMC) - SS12 Quantitative Model Checking (QMC) - SS12 Lecture 06 David Spieler Saarland University, Germany June 4, 2012 1 / 34 Deciding Bisimulations 2 / 34 Partition Refinement Algorithm Notation: A partition P over

More information

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation

Chapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation Chapter 11 Output Analysis for a Single Model Banks, Carson, Nelson & Nicol Discrete-Event System Simulation Purpose Objective: Estimate system performance via simulation If q is the system performance,

More information

IEOR 6711, HMWK 5, Professor Sigman

IEOR 6711, HMWK 5, Professor Sigman IEOR 6711, HMWK 5, Professor Sigman 1. Semi-Markov processes: Consider an irreducible positive recurrent discrete-time Markov chain {X n } with transition matrix P (P i,j ), i, j S, and finite state space.

More information

Note special lecture series by Emmanuel Candes on compressed sensing Monday and Tuesday 4-5 PM (room information on rpinfo)

Note special lecture series by Emmanuel Candes on compressed sensing Monday and Tuesday 4-5 PM (room information on rpinfo) Formulation of Finite State Markov Chains Friday, September 23, 2011 2:04 PM Note special lecture series by Emmanuel Candes on compressed sensing Monday and Tuesday 4-5 PM (room information on rpinfo)

More information

Survival Analysis I (CHL5209H)

Survival Analysis I (CHL5209H) Survival Analysis Dalla Lana School of Public Health University of Toronto olli.saarela@utoronto.ca January 7, 2015 31-1 Literature Clayton D & Hills M (1993): Statistical Models in Epidemiology. Not really

More information

Solutions to COMP9334 Week 8 Sample Problems

Solutions to COMP9334 Week 8 Sample Problems Solutions to COMP9334 Week 8 Sample Problems Problem 1: Customers arrive at a grocery store s checkout counter according to a Poisson process with rate 1 per minute. Each customer carries a number of items

More information

Markov Processes and Queues

Markov Processes and Queues MIT 2.853/2.854 Introduction to Manufacturing Systems Markov Processes and Queues Stanley B. Gershwin Laboratory for Manufacturing and Productivity Massachusetts Institute of Technology Markov Processes

More information

Non Markovian Queues (contd.)

Non Markovian Queues (contd.) MODULE 7: RENEWAL PROCESSES 29 Lecture 5 Non Markovian Queues (contd) For the case where the service time is constant, V ar(b) = 0, then the P-K formula for M/D/ queue reduces to L s = ρ + ρ 2 2( ρ) where

More information

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18.

IEOR 6711: Stochastic Models I, Fall 2003, Professor Whitt. Solutions to Final Exam: Thursday, December 18. IEOR 6711: Stochastic Models I, Fall 23, Professor Whitt Solutions to Final Exam: Thursday, December 18. Below are six questions with several parts. Do as much as you can. Show your work. 1. Two-Pump Gas

More information

Chapter 3 Balance equations, birth-death processes, continuous Markov Chains

Chapter 3 Balance equations, birth-death processes, continuous Markov Chains Chapter 3 Balance equations, birth-death processes, continuous Markov Chains Ioannis Glaropoulos November 4, 2012 1 Exercise 3.2 Consider a birth-death process with 3 states, where the transition rate

More information

Quiz Queue II. III. ( ) ( ) =1.3333

Quiz Queue II. III. ( ) ( ) =1.3333 Quiz Queue UMJ, a mail-order company, receives calls to place orders at an average of 7.5 minutes intervals. UMJ hires one operator and can handle each call in about every 5 minutes on average. The inter-arrival

More information

Examination paper for TMA4265 Stochastic Processes

Examination paper for TMA4265 Stochastic Processes Department of Mathematical Sciences Examination paper for TMA4265 Stochastic Processes Academic contact during examination: Andrea Riebler Phone: 456 89 592 Examination date: December 14th, 2015 Examination

More information

Chapter 1. Introduction. 1.1 Stochastic process

Chapter 1. Introduction. 1.1 Stochastic process Chapter 1 Introduction Process is a phenomenon that takes place in time. In many practical situations, the result of a process at any time may not be certain. Such a process is called a stochastic process.

More information

MODELING WEBCHAT SERVICE CENTER WITH MANY LPS SERVERS

MODELING WEBCHAT SERVICE CENTER WITH MANY LPS SERVERS MODELING WEBCHAT SERVICE CENTER WITH MANY LPS SERVERS Jiheng Zhang Oct 26, 211 Model and Motivation Server Pool with multiple LPS servers LPS Server K Arrival Buffer. Model and Motivation Server Pool with

More information

IEOR 4106: Spring Solutions to Homework Assignment 7: Due on Tuesday, March 22.

IEOR 4106: Spring Solutions to Homework Assignment 7: Due on Tuesday, March 22. IEOR 46: Spring Solutions to Homework Assignment 7: Due on Tuesday, March. More of Chapter 5: Read the rest of Section 5.3, skipping Examples 5.7 (Coupon Collecting), 5. (Insurance claims)and Subsection

More information

Queueing Theory II. Summary. ! M/M/1 Output process. ! Networks of Queue! Method of Stages. ! General Distributions

Queueing Theory II. Summary. ! M/M/1 Output process. ! Networks of Queue! Method of Stages. ! General Distributions Queueing Theory II Summary! M/M/1 Output process! Networks of Queue! Method of Stages " Erlang Distribution " Hyperexponential Distribution! General Distributions " Embedded Markov Chains M/M/1 Output

More information

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks

Recap. Probability, stochastic processes, Markov chains. ELEC-C7210 Modeling and analysis of communication networks Recap Probability, stochastic processes, Markov chains ELEC-C7210 Modeling and analysis of communication networks 1 Recap: Probability theory important distributions Discrete distributions Geometric distribution

More information

Simplification of finite automata

Simplification of finite automata Simplification of finite automata Lorenzo Clemente (University of Warsaw) based on joint work with Richard Mayr (University of Edinburgh) Warsaw, November 2016 Nondeterministic finite automata We consider

More information

IEOR 6711: Stochastic Models I SOLUTIONS to the First Midterm Exam, October 7, 2008

IEOR 6711: Stochastic Models I SOLUTIONS to the First Midterm Exam, October 7, 2008 IEOR 6711: Stochastic Models I SOLUTIONS to the First Midterm Exam, October 7, 2008 Justify your answers; show your work. 1. A sequence of Events. (10 points) Let {B n : n 1} be a sequence of events in

More information

3. Poisson Processes (12/09/12, see Adult and Baby Ross)

3. Poisson Processes (12/09/12, see Adult and Baby Ross) 3. Poisson Processes (12/09/12, see Adult and Baby Ross) Exponential Distribution Poisson Processes Poisson and Exponential Relationship Generalizations 1 Exponential Distribution Definition: The continuous

More information

1 Delayed Renewal Processes: Exploiting Laplace Transforms

1 Delayed Renewal Processes: Exploiting Laplace Transforms IEOR 6711: Stochastic Models I Professor Whitt, Tuesday, October 22, 213 Renewal Theory: Proof of Blackwell s theorem 1 Delayed Renewal Processes: Exploiting Laplace Transforms The proof of Blackwell s

More information

Continuous-Time Markov Chain

Continuous-Time Markov Chain Continuous-Time Markov Chain Consider the process {X(t),t 0} with state space {0, 1, 2,...}. The process {X(t),t 0} is a continuous-time Markov chain if for all s, t 0 and nonnegative integers i, j, x(u),

More information

Birth-Death Processes

Birth-Death Processes Birth-Death Processes Birth-Death Processes: Transient Solution Poisson Process: State Distribution Poisson Process: Inter-arrival Times Dr Conor McArdle EE414 - Birth-Death Processes 1/17 Birth-Death

More information

2905 Queueing Theory and Simulation PART IV: SIMULATION

2905 Queueing Theory and Simulation PART IV: SIMULATION 2905 Queueing Theory and Simulation PART IV: SIMULATION 22 Random Numbers A fundamental step in a simulation study is the generation of random numbers, where a random number represents the value of a random

More information

b) Connect the oscilloscope across the potentiometer that is on the breadboard. Your instructor will draw the circuit diagram on the board.

b) Connect the oscilloscope across the potentiometer that is on the breadboard. Your instructor will draw the circuit diagram on the board. Geiger Counter Experiments and The Statistics of Nuclear Decay Using a Geiger Mueller tube, there are a number of experiments we can do. In the classroom there are two different types of Geiger Counters:

More information

Continuous case Discrete case General case. Hazard functions. Patrick Breheny. August 27. Patrick Breheny Survival Data Analysis (BIOS 7210) 1/21

Continuous case Discrete case General case. Hazard functions. Patrick Breheny. August 27. Patrick Breheny Survival Data Analysis (BIOS 7210) 1/21 Hazard functions Patrick Breheny August 27 Patrick Breheny Survival Data Analysis (BIOS 7210) 1/21 Introduction Continuous case Let T be a nonnegative random variable representing the time to an event

More information

CSEE W3827 Fundamentals of Computer Systems Homework Assignment 3

CSEE W3827 Fundamentals of Computer Systems Homework Assignment 3 CSEE W3827 Fundamentals of Computer Systems Homework Assignment 3 Prof. Martha A. Kim Columbia University Due October 10, 2013 at 10:10 AM Write your name and UNI on your solutions Show your work for each

More information

Poisson Point Processes

Poisson Point Processes Poisson Point Processes Tuesday, April 22, 2014 2:00 PM Homework 4 posted; due Wednesday, May 7. We'll begin with Poisson point processes in one dimension which actually are an example of both a Poisson

More information

Intro to Queueing Theory

Intro to Queueing Theory 1 Intro to Queueing Theory Little s Law M/G/1 queue Conservation Law 1/31/017 M/G/1 queue (Simon S. Lam) 1 Little s Law No assumptions applicable to any system whose arrivals and departures are observable

More information

Stochastic Processes

Stochastic Processes Elements of Lecture II Hamid R. Rabiee with thanks to Ali Jalali Overview Reading Assignment Chapter 9 of textbook Further Resources MIT Open Course Ware S. Karlin and H. M. Taylor, A First Course in Stochastic

More information

So in terms of conditional probability densities, we have by differentiating this relationship:

So in terms of conditional probability densities, we have by differentiating this relationship: Modeling with Finite State Markov Chains Tuesday, September 27, 2011 1:54 PM Homework 1 due Friday, September 30 at 2 PM. Office hours on 09/28: Only 11 AM-12 PM (not at 3 PM) Important side remark about

More information

Markov processes and queueing networks

Markov processes and queueing networks Inria September 22, 2015 Outline Poisson processes Markov jump processes Some queueing networks The Poisson distribution (Siméon-Denis Poisson, 1781-1840) { } e λ λ n n! As prevalent as Gaussian distribution

More information

A Note on the Event Horizon for a Processor Sharing Queue

A Note on the Event Horizon for a Processor Sharing Queue A Note on the Event Horizon for a Processor Sharing Queue Robert C. Hampshire Heinz School of Public Policy and Management Carnegie Mellon University hamp@andrew.cmu.edu William A. Massey Department of

More information

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking

Lecture 7: Simulation of Markov Processes. Pasi Lassila Department of Communications and Networking Lecture 7: Simulation of Markov Processes Pasi Lassila Department of Communications and Networking Contents Markov processes theory recap Elementary queuing models for data networks Simulation of Markov

More information

Introduction to Queuing Networks Solutions to Problem Sheet 3

Introduction to Queuing Networks Solutions to Problem Sheet 3 Introduction to Queuing Networks Solutions to Problem Sheet 3 1. (a) The state space is the whole numbers {, 1, 2,...}. The transition rates are q i,i+1 λ for all i and q i, for all i 1 since, when a bus

More information

Data analysis and stochastic modeling

Data analysis and stochastic modeling Data analysis and stochastic modeling Lecture 7 An introduction to queueing theory Guillaume Gravier guillaume.gravier@irisa.fr with a lot of help from Paul Jensen s course http://www.me.utexas.edu/ jensen/ormm/instruction/powerpoint/or_models_09/14_queuing.ppt

More information

Chapter 4 Continuous Random Variables and Probability Distributions

Chapter 4 Continuous Random Variables and Probability Distributions Chapter 4 Continuous Random Variables and Probability Distributions Part 3: The Exponential Distribution and the Poisson process Section 4.8 The Exponential Distribution 1 / 21 Exponential Distribution

More information

CSEE W3827 Fundamentals of Computer Systems Homework Assignment 3 Solutions

CSEE W3827 Fundamentals of Computer Systems Homework Assignment 3 Solutions CSEE W3827 Fundamentals of Computer Systems Homework Assignment 3 Solutions Prof. Martha A. Kim Columbia University Due October 10, 2013 at 10:10 AM Write your name and UNI on your solutions Show your

More information

Review of Queuing Models

Review of Queuing Models Review of Queuing Models Recitation, Apr. 1st Guillaume Roels 15.763J Manufacturing System and Supply Chain Design http://michael.toren.net/slides/ipqueue/slide001.html 2005 Guillaume Roels Outline Overview,

More information

L = λ W time average number in Line or system arrival rate W average Waiting time per customer

L = λ W time average number in Line or system arrival rate W average Waiting time per customer IEOR 4615, Lecture 3, January 27, 2015 L λ Little s Law* L = λ W time average number in Line or system arrival rate W average Waiting time per customer *J. D. C. Little, A proof of the queueing formula:

More information

Introduction to queuing theory

Introduction to queuing theory Introduction to queuing theory Queu(e)ing theory Queu(e)ing theory is the branch of mathematics devoted to how objects (packets in a network, people in a bank, processes in a CPU etc etc) join and leave

More information

IEOR 4404: Homework 6

IEOR 4404: Homework 6 IEOR 4404: Homework 6. Consider the FIFO GI/GI/ queue as a model for a printer which prints one job at a time according to the distribution G(x) = P (S x) = e x, x 0 ( service time distribution ), and

More information

Randomness at the root of things 2: Poisson sequences

Randomness at the root of things 2: Poisson sequences SPECIAL FEATURE: FUZZY PHYSICS www.iop.org/journals/physed Randomness at the root of things 2: Poisson sequences Jon Ogborn 1, Simon Collins 2 and Mick Brown 3 1 Institute of Education, University of London,

More information

Lecture 10: Semi-Markov Type Processes

Lecture 10: Semi-Markov Type Processes Lecture 1: Semi-Markov Type Processes 1. Semi-Markov processes (SMP) 1.1 Definition of SMP 1.2 Transition probabilities for SMP 1.3 Hitting times and semi-markov renewal equations 2. Processes with semi-markov

More information

B. Maddah INDE 504 Discrete-Event Simulation. Output Analysis (1)

B. Maddah INDE 504 Discrete-Event Simulation. Output Analysis (1) B. Maddah INDE 504 Discrete-Event Simulation Output Analysis (1) Introduction The basic, most serious disadvantage of simulation is that we don t get exact answers. Two different runs of the same model

More information

Queueing Systems: Lecture 3. Amedeo R. Odoni October 18, Announcements

Queueing Systems: Lecture 3. Amedeo R. Odoni October 18, Announcements Queueing Systems: Lecture 3 Amedeo R. Odoni October 18, 006 Announcements PS #3 due tomorrow by 3 PM Office hours Odoni: Wed, 10/18, :30-4:30; next week: Tue, 10/4 Quiz #1: October 5, open book, in class;

More information

Tyler Hofmeister. University of Calgary Mathematical and Computational Finance Laboratory

Tyler Hofmeister. University of Calgary Mathematical and Computational Finance Laboratory JUMP PROCESSES GENERALIZING STOCHASTIC INTEGRALS WITH JUMPS Tyler Hofmeister University of Calgary Mathematical and Computational Finance Laboratory Overview 1. General Method 2. Poisson Processes 3. Diffusion

More information

Lecture 1: Brief Review on Stochastic Processes

Lecture 1: Brief Review on Stochastic Processes Lecture 1: Brief Review on Stochastic Processes A stochastic process is a collection of random variables {X t (s) : t T, s S}, where T is some index set and S is the common sample space of the random variables.

More information

Figure 10.1: Recording when the event E occurs

Figure 10.1: Recording when the event E occurs 10 Poisson Processes Let T R be an interval. A family of random variables {X(t) ; t T} is called a continuous time stochastic process. We often consider T = [0, 1] and T = [0, ). As X(t) is a random variable

More information

Slides 12: Output Analysis for a Single Model

Slides 12: Output Analysis for a Single Model Slides 12: Output Analysis for a Single Model Objective: Estimate system performance via simulation. If θ is the system performance, the precision of the estimator ˆθ can be measured by: The standard error

More information

6 Solving Queueing Models

6 Solving Queueing Models 6 Solving Queueing Models 6.1 Introduction In this note we look at the solution of systems of queues, starting with simple isolated queues. The benefits of using predefined, easily classified queues will

More information

reversed chain is ergodic and has the same equilibrium probabilities (check that π j =

reversed chain is ergodic and has the same equilibrium probabilities (check that π j = Lecture 10 Networks of queues In this lecture we shall finally get around to consider what happens when queues are part of networks (which, after all, is the topic of the course). Firstly we shall need

More information

Logistical and Transportation Planning Methods 1.203J/6.281J/13.665J/15.073J/16.76J/ESD.216J

Logistical and Transportation Planning Methods 1.203J/6.281J/13.665J/15.073J/16.76J/ESD.216J Logistical and Transportation Planning Methods 1.203J/6.281J/13.665J/15.073J/16.76J/ESD.216J Massachusetts Institute of Technology Cambridge, Massachusetts Quiz #1 October 26, 2005 OPEN BOOK TWO HOURS

More information

Continuous Time Processes

Continuous Time Processes page 102 Chapter 7 Continuous Time Processes 7.1 Introduction In a continuous time stochastic process (with discrete state space), a change of state can occur at any time instant. The associated point

More information

E[X n ]= dn dt n M X(t). ). What is the mgf? Solution. Found this the other day in the Kernel matching exercise: 1 M X (t) =

E[X n ]= dn dt n M X(t). ). What is the mgf? Solution. Found this the other day in the Kernel matching exercise: 1 M X (t) = Chapter 7 Generating functions Definition 7.. Let X be a random variable. The moment generating function is given by M X (t) =E[e tx ], provided that the expectation exists for t in some neighborhood of

More information

4452 Mathematical Modeling Lecture 16: Markov Processes

4452 Mathematical Modeling Lecture 16: Markov Processes Math Modeling Lecture 16: Markov Processes Page 1 4452 Mathematical Modeling Lecture 16: Markov Processes Introduction A stochastic model is one in which random effects are incorporated into the model.

More information

Examples of Countable State Markov Chains Thursday, October 16, :12 PM

Examples of Countable State Markov Chains Thursday, October 16, :12 PM stochnotes101608 Page 1 Examples of Countable State Markov Chains Thursday, October 16, 2008 12:12 PM Homework 2 solutions will be posted later today. A couple of quick examples. Queueing model (without

More information

Computer simulation of radioactive decay

Computer simulation of radioactive decay Computer simulation of radioactive decay y now you should have worked your way through the introduction to Maple, as well as the introduction to data analysis using Excel Now we will explore radioactive

More information

Modelling data networks stochastic processes and Markov chains

Modelling data networks stochastic processes and Markov chains Modelling data networks stochastic processes and Markov chains a 1, 3 1, 2 2, 2 b 0, 3 2, 3 u 1, 3 α 1, 6 c 0, 3 v 2, 2 β 1, 1 Richard G. Clegg (richard@richardclegg.org) November 2016 Available online

More information

BRANCHING PROCESSES AND THEIR APPLICATIONS: Lecture 15: Crump-Mode-Jagers processes and queueing systems with processor sharing

BRANCHING PROCESSES AND THEIR APPLICATIONS: Lecture 15: Crump-Mode-Jagers processes and queueing systems with processor sharing BRANCHING PROCESSES AND THEIR APPLICATIONS: Lecture 5: Crump-Mode-Jagers processes and queueing systems with processor sharing June 7, 5 Crump-Mode-Jagers process counted by random characteristics We give

More information

Relationship between probability set function and random variable - 2 -

Relationship between probability set function and random variable - 2 - 2.0 Random Variables A rat is selected at random from a cage and its sex is determined. The set of possible outcomes is female and male. Thus outcome space is S = {female, male} = {F, M}. If we let X be

More information

Probability Distributions

Probability Distributions The ASTRO509-3 dark energy puzzle Probability Distributions I have had my results for a long time: but I do not yet know how I am to arrive at them. Johann Carl Friedrich Gauss 1777-1855 ASTR509 Jasper

More information

The University of British Columbia Computer Science 405 Practice Midterm Solutions

The University of British Columbia Computer Science 405 Practice Midterm Solutions The University of British Columbia Computer Science 405 Practice Midterm Solutions Instructor: Kees van den Doel Time: 45 mins Total marks: 100 The solutions provided here are much more verbose than what

More information

Chapter 2. Poisson Processes

Chapter 2. Poisson Processes Chapter 2. Poisson Processes Prof. Ai-Chun Pang Graduate Institute of Networking and Multimedia, epartment of Computer Science and Information Engineering, National Taiwan University, Taiwan utline Introduction

More information

Monotonicity and Aging Properties of Random Sums

Monotonicity and Aging Properties of Random Sums Monotonicity and Aging Properties of Random Sums Jun Cai and Gordon E. Willmot Department of Statistics and Actuarial Science University of Waterloo Waterloo, Ontario Canada N2L 3G1 E-mail: jcai@uwaterloo.ca,

More information

Classical Queueing Models.

Classical Queueing Models. Sergey Zeltyn January 2005 STAT 99. Service Engineering. The Wharton School. University of Pennsylvania. Based on: Classical Queueing Models. Mandelbaum A. Service Engineering course, Technion. http://iew3.technion.ac.il/serveng2005w

More information

N.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a

N.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a WHEN IS A MAP POISSON N.G.Bean, D.A.Green and P.G.Taylor Department of Applied Mathematics University of Adelaide Adelaide 55 Abstract In a recent paper, Olivier and Walrand (994) claimed that the departure

More information

Chap. 5 Ion Chambers the electroscope

Chap. 5 Ion Chambers the electroscope Chap. 5 Ion Chambers the electroscope Electroscope: an early device used to study static electricity continues to be used for personal dosimeters. Put a (known) charge on the central electrode, leaves

More information

Homework 4 due on Thursday, December 15 at 5 PM (hard deadline).

Homework 4 due on Thursday, December 15 at 5 PM (hard deadline). Large-Time Behavior for Continuous-Time Markov Chains Friday, December 02, 2011 10:58 AM Homework 4 due on Thursday, December 15 at 5 PM (hard deadline). How are formulas for large-time behavior of discrete-time

More information