Introduction to Continuous-Time Markov Chains and Queueing Theory
|
|
- Jason Strickland
- 5 years ago
- Views:
Transcription
1 Introducton to Contnuous-Tme Markov Chans and Queueng Theory
2 From DTMC to CTMC p p 1 p k-1 k p k-1,k p k-1,k k+1 p 1 p 21 p k,k-1 p k,k-1 DTMC 1. Transtons at dscrete tme steps n=,1,2, 2. Past doesn t matter (Markov property) P(X n+1 X n,x n-1, X 1 ) = P(X n+1 X n ) 3. P(X n+1 = j X n = ) = p j (statonarty) CTMC 1. Transtons between states can happen any tme 2. Past stll doesn t matter 3. Transton stll ndependent of tme t 2
3 CTMC: A Generc Defnton A CTMC s contnuous tme stochastc process {X(t), t }, s.t. for all s,t, and any,j,x(u) P{X(t+s) = j X(s) =,X(u) = x(u), u s} = P{X(t+s) = j X(s) = } (Markov property) = P{X(t) = j X() = } (statonarty) τ : tme untl CTMC leaves state, f currently n Above def. mples: P{τ > t+s τ > s} = P{τ > t} Q: What does ths mply? A: τ s exponentally dstrbuted! 3
4 CTMC: Vewpont 1 exp(v ) p j p k j k p l l Step 1: When at state, wat an exponentally dstrbuted amount of tme denote rate out of: v Step 2: When the process leaves, t wll enter j wth probablty p j 4
5 CTMC: Vewpont 2 (more common) 1 1 exp( 1 ) 2 2 exp( 2 ) When at state : move to state j wth rate j (ndependently) Q: Tme to leave state? 3 exp( 3 ) frst move to any state frst phone rngs A: Exponental wth rate (v = n = Σ j j ) Q: Probablty to go to state k, after leavng? j A: pj = j j 3 Vew 2 => Vew 1 5
6 A Sngle Server Example Posson () e.g. 3 jobs/sec servce: exp(μ) e.g. 5 jobs/sec μ 1 2 μ μ Let π j = lm t P j (t) : lmt probablty of beng n state j Q: How do we determne π j? how do we solve the chan? A: Assume an equvalent DTMC half-rgorous argument 6
7 CTMC DTMC wth tme unt δ CTMC DTMC (tme step δ ) δ+o(δ) δ+o(δ) μ μ μ μδ+o(δ) μδ+o(δ) Dvde tme nto very small ntervals δ Prob. of an arrval n the next nterval δ : δ + o(δ) Prob. of a departure n the next nterval δ : μδ + o(δ) P{ +1} = δ (1-μδ) = δ + o(δ) P{ -1} = μδ (1- δ) = μδ + o(δ) (1 arrval + departure) ( arrval + 1 departure) P{ } = 1- δ -μδ +o(δ) (no event wth almost prob 1) we can gnore self-loops n the balance equatons 7
8 Solvng the Balance Equatons for a CTMC Methodology Step 1) Wrte balance equatons Step 2) Take lmt as δ δ+o(δ) δ+o(δ) 1 2 μδ+o(δ) μδ+o(δ) For state rate out = rate n ( δ + ο(δ) ) = π ( μδ ο(δ) ) π 1 + ο(δ) ο(δ) π + = π1 μ + δ δ ο(δ) ο(δ) lm π + = lm π1 μ + δ δ δ δ π = π1μ π1 = π μ For state 1 rate out = rate n ( δ + ο(δ) + μδ + ο(δ) ) = π ( δ + ο(δ) ) + π ( μδ ο(δ) ) π1 2 + ο(δ) + μ + = π δ ο(δ) + + π δ π1 2 π μ (π1 = π ) μ 1( + μ) = π + π2μ π μ + 2 π ( + μ) = π + π2μ π2 = μ ο(δ) δ 8
9 Solvng a CTMC Our frst Queueng Result! Lesson from prevous example: can smply solve the balance equatons, rate n = rate out See book (MHB, CH.13) for generalzaton Can also try local balance equatons Need to check for rreducblty (for π to exst) - What about perodcty?? Back to our queue) Posson () servce: exp(μ) Defne ρ = \μ (utlzaton) n n π (we derved earler) n = π = ρ π μ n π =1 (normalze to get π ) π = ρ ( 1 ρ) n= n Our frst contnuous tme queueng result!! n 9
10 Introducton to Queueng: M/M/1 Posson () servce: exp(μ) The example so far was an M/M/1 system M stands for memoryless --- both arrvals and departures 1 for sngle server π n : number of customers n system (n servce or queue) Q: What s the probablty that the server s empty? A: π =1-ρ Q: What s the expected number of customers? A: E[N] = = d = (1 = (1 = (1 d n n-1 n πn n ρ ρ) ρ ρ) n ρ ρ ρ) ρ n= n= n= ρ n= d 1 (1 ρ) dρ ρ 1 1 ρ (1 ρ) (1 ρ) ρ = 2 E[N] = ρ (1 ρ) n 1
11 M/M/1 contnued Q1: What happens when ρ 1? (.e. system very busy) ρ 1 ρ A: E[N] = E[N] (queue goes to nfnty!) ρ 1 Q2: What happens to the Markov Chan when ρ 1? A: All states become transent π = (for all ) Null-recurrent for ρ = 1 But ths means we cannot apply balance equatons (no balance!) Could we have guessed t from the MC?? (homework!) Q3: We know E[N]; What s the expected delay E[T]? A: Lttle s Law wll tell us that E[T] = E[N]/ 11
12 Introducton to Queueng Theory 12
13 Queueng Systems: Kendall s Notaton A queung system s descrbed by A/D/n/B/S A: the arrval process M: for Memoryless Posson arrvals D: Determnstc arrvals at fxed ntervals G: generc dstrbuton D: servce process M: Memoryless duraton of servce s exponentally dstrbuted D: Determnstc each servce last the same fxed amount of t G: generc dstrbuton (e.g. unform, pareto, gamma, etc.) n: number of servers B: sze of queue/buffer If queue s full addtonal arrvals are rejected No B n notaton nfnte queue (e.g. M/M/1, M/G/1, G/G/4) S: Schedulng polcy FCFS (default assumed), preemptve, random, etc. 13
14 Queue Stablty Posson () servce: exp(μ) For the system to be stable: < μ Q: What happens f > μ? A: Queue sze goes to nfnty (and so does delay!) Q: Can you gve the ntuton? A: Consder an nterval [,t] (large t) Number n system = (arrvals n [,t]) (departures n [,t]) Number n system = t μt = (- μ)t t -> queue sze -> 14
15 Throughput of a Queueng System Throughput X: jobs/mn leavng the system Q: Whch of the two systems has a hgher throughput? A: The throughput s the same for both: X = = 1/6 Consder a busy perod of the system Def: from tme an arrval fnds system empty, untl t emptes agan Assume A arrvals durng a busy perod Q: How many departures durng that busy perod? A: Exactly A! All arrved jobs should complete for the system to empty Open (stable) system: Throughput X = Input Rate 15
16 Lttle s Law (or the most famous Queueng Result) M/M/1: Posson () servce: exp(μ) E[N] : number of customers n the system (queue + server) E[T]: tme a customer spends n the system (queue+server) Lttle s Law: E[N] = E[T] M/M/1: E[T] = E[N] = ρ 1 ρ 1 = μ 1 (some) Intuton behnd Lttle s Law Customer X arrves at the end of a queue on average stays E[T] Q: how many customers have arrved whle X was n the system? A: E[T] => on average a departure leaves E[N] = E[T] customers n the system 16
17 Proof of Lttle s Law DEF: A s the area nsde boxes A(t): num of arrvals by t D(t): num of departures by t 1. Sum tmes horzontally D(t) = 1 T A A(t) = 1 T 2. Sum tmes vertcally: A t = N(s)ds N(t 2 )=3 N(t 1 )=2 area A t 1 t 2 D(t) = 1 T t N(s)ds A(t) = 1 T D(t) t A(t) T N(s)ds = 1 = 1 D(t) D(t) t t A(t) T D(t) = 1 t A(t) t T t t N(s)ds t TX N T A(t) = 1 t T ergodcty E[N] = E[T] 17
18 Generalty of Lttle s Law Q: Dd we assume anythng about the number of servers? A: No! Q: Dd we assume that schedulng s frst-come frst-serve (FCFS)? A: No! In fact, n the prevous example 3 fnshes before 2! Lttle s Law apples to ANY system and ANY schedulng Many servers, many queues, queueng network, schedulng polcy 18
19 Lttle s Law: Addtonal Results Q: What about E[T Q ]? number of jobs n queue not server(s) A: E[T Q ] = E[N Q ] (smlar proof) Q: What about ρ (number of customers n servce)? A: E[S] = ρ ρ = /μ Q: What s ρ? A: System utlzaton -> fracton of tme server(s) s busy (tme average) A: Ergodcty Prob{server s busy at a random tme} (ensemble average) 19
20 M/M/k/k loss system Consder a call center wth k total lnes E.g. an actual call center, or swtch wth k crcuts, or base staton wth k channels If all servers/lnes busy call/job s rejected (Key Queston): What s the probablty of blockng? 2
21 (contnuous-tme) Markov Chan for M/M/k/k Q: How many states do we need? A: k states Q:What s the rate from to +1? A: Q:What s the rate from to -1? A: kμ 21
22 Local balance equatons for M/M/k/k Q: Is the chan tme-reversble (to apply local balance)?.e. s rate from 1 2 = rate from 2 1? A: Yes, t s so, we can apply local balance - π = μ = π1μ => π1 π = π22μ => π2 = π - π μ - π -1 = π μ => π = μ 2! 1! π π = 1 => Erlang B P π block = = π = μ k k = 1 1! μ k 1 = μ! k 1 k! 22
23 What about general servce (M/G/k/k)? Q: Job sze/duraton s not exponental? A: Turns out that the state probabltes π s as n M/M/k/k The block probablty s the same and gven by Erlang B P block = π k = μ k k 1 =! μ 1 k! Ths s an mportant nsenstvty result Result s nsenstve to servce dstrbuton (only depends on mean μ) Insenstvty results often arse when there s no queueng 23
24 M/M/k Dspatch to frst avalable server queue f all busy Exponental servce wth rate μ Posson () A very mportant model for server farms Amazon, Google, CNN, pretty much all major web stes Cloud computng 24
25 CTMC for M/M/k Q: How many states? A: Infnte states Q: What s the rate from +1 A: Q: What s the rate from -1 ( k) A: μ Q: What s the rate from -1 ( > k) A: kμ 25
26 Local Balance Equatons for M/M/k 26
27 M/M/k: Utlzaton and Queueng Q: What s the expected number of busy servers? A: /μ - Defnton: ρ = /kμ (utlzaton of a sngle server) Q: What s the probablty (P Q ) an arrvng job must queue? A: P Q = P{arrval fnds all servers busy} = P{arrval sees k jobs n system} = =k = Erlang C: P μ Q k π 1 k! π (from PASTA property) = k kμ k = ρ k k k k! π = k ρ k k k! k k = ρ π = k ( kρ) k 1( kρ) ( kρ) k 1 = π, where π = + = k!(1-ρ)! k!(1 ρ) ρ 27
28 M/M/k Queueng vs. M/M/k/k Blockng Q: For whch system (M/M/k and M/M/k/k) s the probablty that all k server are busy hgher? A: For the M/M/k Q: Why? A: In M/M/k jobs can arrve when all k servers are busy these do not dsappear but queue up more work for later In M/M/k/k these jobs are smply rejected Can confrm by comparng Erlang B and C (work the math as HW) ρ E[N] = PQ + kρ 1 ρ E[N] 1 E[T] = = PQ + kμ 1 μ 28
29 (Back to) Comparng Channel Allocatons or server organzatons or supermarket lnes Q: Whch s better n terms of E[T], FDM or M/M/1 (statstcal multplexng) A: M/M/1 E[T FDM ] = k/(kμ-) but E[T M/M/1 ] = 1/(kμ-) 29
30 (Back to) Comparng Channel Allocatons (cont d) or server organzatons or supermarket lnes Q: What about E[T M/M/1 ] and E[T M/M/k ]? A: E[T E[T M/M/k M/M/1 ] ] = P M/M/k Q + k(1 ρ) ρ ρ 1 E[T E[T E[T E[T M/M/k M/M/1 M/M/k M/M/1 ] k ] ] 1 ] 3
31
32
Applied Stochastic Processes
STAT455/855 Fall 23 Appled Stochastc Processes Fnal Exam, Bref Solutons 1. (15 marks) (a) (7 marks) The dstrbuton of Y s gven by ( ) ( ) y 2 1 5 P (Y y) for y 2, 3,... The above follows because each of
More information6. Stochastic processes (2)
6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process
More information6. Stochastic processes (2)
Contents Markov processes Brth-death processes Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 Markov process Consder a contnuous-tme and dscrete-state stochastc process X(t) wth state space
More informationAnalysis of Discrete Time Queues (Section 4.6)
Analyss of Dscrete Tme Queues (Secton 4.6) Copyrght 2002, Sanjay K. Bose Tme axs dvded nto slots slot slot boundares Arrvals can only occur at slot boundares Servce to a job can only start at a slot boundary
More informationContinuous Time Markov Chains
Contnuous Tme Markov Chans Brth and Death Processes,Transton Probablty Functon, Kolmogorov Equatons, Lmtng Probabltes, Unformzaton Chapter 6 1 Markovan Processes State Space Parameter Space (Tme) Dscrete
More informationContinuous Time Markov Chain
Contnuous Tme Markov Chan Hu Jn Department of Electroncs and Communcaton Engneerng Hanyang Unversty ERICA Campus Contents Contnuous tme Markov Chan (CTMC) Propertes of sojourn tme Relatons Transton probablty
More informationMarkov chains. Definition of a CTMC: [2, page 381] is a continuous time, discrete value random process such that for an infinitesimal
Markov chans M. Veeraraghavan; March 17, 2004 [Tp: Study the MC, QT, and Lttle s law lectures together: CTMC (MC lecture), M/M/1 queue (QT lecture), Lttle s law lecture (when dervng the mean response tme
More informationQueueing Networks II Network Performance
Queueng Networks II Network Performance Davd Tpper Assocate Professor Graduate Telecommuncatons and Networkng Program Unversty of Pttsburgh Sldes 6 Networks of Queues Many communcaton systems must be modeled
More informationEquilibrium Analysis of the M/G/1 Queue
Eulbrum nalyss of the M/G/ Queue Copyrght, Sanay K. ose. Mean nalyss usng Resdual Lfe rguments Secton 3.. nalyss usng an Imbedded Marov Chan pproach Secton 3. 3. Method of Supplementary Varables done later!
More informationECE697AA Lecture 17. Birth-Death Processes
Tlman Wolf Department of Electrcal and Computer Engneerng /4/8 ECE697AA ecture 7 Queung Systems II ECE697AA /4/8 Uass Amherst Tlman Wolf Brth-Death Processes Solvng general arov chan can be dffcult Smpler,
More informationTCOM 501: Networking Theory & Fundamentals. Lecture 7 February 25, 2003 Prof. Yannis A. Korilis
TCOM 501: Networkng Theory & Fundamentals Lecture 7 February 25, 2003 Prof. Yanns A. Korls 1 7-2 Topcs Open Jackson Networks Network Flows State-Dependent Servce Rates Networks of Transmsson Lnes Klenrock
More informationReview: Discrete Event Random Processes. Hongwei Zhang
Revew: Dscrete Event Random Processes Hongwe Zhang http://www.cs.wayne.edu/~hzhang Outlne Markov chans and some renewal theory Markov chan Renewal processes, renewal reward processes, Markov renewal processes
More informationSuggested solutions for the exam in SF2863 Systems Engineering. June 12,
Suggested solutons for the exam n SF2863 Systems Engneerng. June 12, 2012 14.00 19.00 Examner: Per Enqvst, phone: 790 62 98 1. We can thnk of the farm as a Jackson network. The strawberry feld s modelled
More informationApplication of Queuing Theory to Waiting Time of Out-Patients in Hospitals.
Applcaton of Queung Theory to Watng Tme of Out-Patents n Hosptals. R.A. Adeleke *, O.D. Ogunwale, and O.Y. Hald. Department of Mathematcal Scences, Unversty of Ado-Ekt, Ado-Ekt, Ekt State, Ngera. E-mal:
More informationNetwork of Markovian Queues. Lecture
etwork of Markovan Queues etwork of Markovan Queues ETW09 20 etwork queue ed, G E ETW09 20 λ If the frst queue was not empty Then the tme tll the next arrval to the second queue wll be equal to the servce
More informationCS-433: Simulation and Modeling Modeling and Probability Review
CS-433: Smulaton and Modelng Modelng and Probablty Revew Exercse 1. (Probablty of Smple Events) Exercse 1.1 The owner of a camera shop receves a shpment of fve cameras from a camera manufacturer. Unknown
More informationConvergence of random processes
DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large
More informationCS 798: Homework Assignment 2 (Probability)
0 Sample space Assgned: September 30, 2009 In the IEEE 802 protocol, the congeston wndow (CW) parameter s used as follows: ntally, a termnal wats for a random tme perod (called backoff) chosen n the range
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationThe optimal delay of the second test is therefore approximately 210 hours earlier than =2.
THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple
More information1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations
Physcs 171/271 -Davd Klenfeld - Fall 2005 (revsed Wnter 2011) 1 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys
More informationModule 2. Random Processes. Version 2 ECE IIT, Kharagpur
Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be
More informationLecture 4: November 17, Part 1 Single Buffer Management
Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input
More informationAdaptive Dynamical Polling in Wireless Networks
BULGARIA ACADEMY OF SCIECES CYBERETICS AD IFORMATIO TECHOLOGIES Volume 8, o Sofa 28 Adaptve Dynamcal Pollng n Wreless etworks Vladmr Vshnevsky, Olga Semenova Insttute for Informaton Transmsson Problems
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More informationπ e ax2 dx = x 2 e ax2 dx or x 3 e ax2 dx = 1 x 4 e ax2 dx = 3 π 8a 5/2 (a) We are considering the Maxwell velocity distribution function: 2πτ/m
Homework Solutons Problem In solvng ths problem, we wll need to calculate some moments of the Gaussan dstrbuton. The brute-force method s to ntegrate by parts but there s a nce trck. The followng ntegrals
More information9 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations
Physcs 171/271 - Chapter 9R -Davd Klenfeld - Fall 2005 9 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys a set
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationQueuing system theory
Elements of queung system: Queung system theory Every queung system conssts of three elements: An arrval process: s characterzed by the dstrbuton of tme between the arrval of successve customers, the mean
More informationData analysis and stochastic modeling
Data analysis and stochastic modeling Lecture 7 An introduction to queueing theory Guillaume Gravier guillaume.gravier@irisa.fr with a lot of help from Paul Jensen s course http://www.me.utexas.edu/ jensen/ormm/instruction/powerpoint/or_models_09/14_queuing.ppt
More informationComplex Numbers, Signals, and Circuits
Complex Numbers, Sgnals, and Crcuts 3 August, 009 Complex Numbers: a Revew Suppose we have a complex number z = x jy. To convert to polar form, we need to know the magntude of z and the phase of z. z =
More informationOrder Full Rate, Leadtime Variability, and Advance Demand Information in an Assemble- To-Order System
Order Full Rate, Leadtme Varablty, and Advance Demand Informaton n an Assemble- To-Order System by Lu, Song, and Yao (2002) Presented by Png Xu Ths summary presentaton s based on: Lu, Yngdong, and Jng-Sheng
More informationPhysics 5153 Classical Mechanics. Principle of Virtual Work-1
P. Guterrez 1 Introducton Physcs 5153 Classcal Mechancs Prncple of Vrtual Work The frst varatonal prncple we encounter n mechancs s the prncple of vrtual work. It establshes the equlbrum condton of a mechancal
More informationGoogle PageRank with Stochastic Matrix
Google PageRank wth Stochastc Matrx Md. Sharq, Puranjt Sanyal, Samk Mtra (M.Sc. Applcatons of Mathematcs) Dscrete Tme Markov Chan Let S be a countable set (usually S s a subset of Z or Z d or R or R d
More informationAnswers Problem Set 2 Chem 314A Williamsen Spring 2000
Answers Problem Set Chem 314A Wllamsen Sprng 000 1) Gve me the followng crtcal values from the statstcal tables. a) z-statstc,-sded test, 99.7% confdence lmt ±3 b) t-statstc (Case I), 1-sded test, 95%
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More informationLecture 7: Boltzmann distribution & Thermodynamics of mixing
Prof. Tbbtt Lecture 7 etworks & Gels Lecture 7: Boltzmann dstrbuton & Thermodynamcs of mxng 1 Suggested readng Prof. Mark W. Tbbtt ETH Zürch 13 März 018 Molecular Drvng Forces Dll and Bromberg: Chapters
More informationRandomness and Computation
Randomness and Computaton or, Randomzed Algorthms Mary Cryan School of Informatcs Unversty of Ednburgh RC 208/9) Lecture 0 slde Balls n Bns m balls, n bns, and balls thrown unformly at random nto bns usually
More informationECE559VV Project Report
ECE559VV Project Report (Supplementary Notes Loc Xuan Bu I. MAX SUM-RATE SCHEDULING: THE UPLINK CASE We have seen (n the presentaton that, for downlnk (broadcast channels, the strategy maxmzng the sum-rate
More informationWeek3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity
Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle
More informationEnsemble Methods: Boosting
Ensemble Methods: Boostng Ncholas Ruozz Unversty of Texas at Dallas Based on the sldes of Vbhav Gogate and Rob Schapre Last Tme Varance reducton va baggng Generate new tranng data sets by samplng wth replacement
More informationProblem Set 9 - Solutions Due: April 27, 2005
Problem Set - Solutons Due: Aprl 27, 2005. (a) Frst note that spam messages, nvtatons and other e-mal are all ndependent Posson processes, at rates pλ, qλ, and ( p q)λ. The event of the tme T at whch you
More informationt } = Number of calls in progress at time t. Engsett Model (Erlang-B)
Engsett Model (Erlang-B) A B Desrpton: Bloed-alls lost model Consder a entral exhange wth users (susrers) sharng truns (truns). When >, long ours. Ths s the ase of prnpal nterest. Assume that the truns
More informationChapter 7 Channel Capacity and Coding
Chapter 7 Channel Capacty and Codng Contents 7. Channel models and channel capacty 7.. Channel models Bnary symmetrc channel Dscrete memoryless channels Dscrete-nput, contnuous-output channel Waveform
More informationLast Time. Priority-based scheduling. Schedulable utilization Rate monotonic rule: Keep utilization below 69% Static priorities Dynamic priorities
Last Tme Prorty-based schedulng Statc prortes Dynamc prortes Schedulable utlzaton Rate monotonc rule: Keep utlzaton below 69% Today Response tme analyss Blockng terms Prorty nverson And solutons Release
More informationEconomics 101. Lecture 4 - Equilibrium and Efficiency
Economcs 0 Lecture 4 - Equlbrum and Effcency Intro As dscussed n the prevous lecture, we wll now move from an envronment where we looed at consumers mang decsons n solaton to analyzng economes full of
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationHidden Markov Models & The Multivariate Gaussian (10/26/04)
CS281A/Stat241A: Statstcal Learnng Theory Hdden Markov Models & The Multvarate Gaussan (10/26/04) Lecturer: Mchael I. Jordan Scrbes: Jonathan W. Hu 1 Hdden Markov Models As a bref revew, hdden Markov models
More informationOn the relationships among queue lengths at arrival, departure, and random epochs in the discrete-time queue with D-BMAP arrivals
On the relatonshps among queue lengths at arrval departure and random epochs n the dscrete-tme queue wth D-BMAP arrvals Nam K. Km Seo H. Chang Kung C. Chae * Department of Industral Engneerng Korea Advanced
More informationDistributions /06. G.Serazzi 05/06 Dimensionamento degli Impianti Informatici distrib - 1
Dstrbutons 8/03/06 /06 G.Serazz 05/06 Dmensonamento degl Impant Informatc dstrb - outlne densty, dstrbuton, moments unform dstrbuton Posson process, eponental dstrbuton Pareto functon densty and dstrbuton
More informationLimited Dependent Variables
Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages
More informationBirth Death Processes
Brth Death rocesses 79 Brth Death rocesses ohamed, 3.... - K+ + States of the rocess may reresent a count of someth ( number of acet n a queue, The oulaton of a cty, the number of customers n store) +
More informationProbability and Random Variable Primer
B. Maddah ENMG 622 Smulaton 2/22/ Probablty and Random Varable Prmer Sample space and Events Suppose that an eperment wth an uncertan outcome s performed (e.g., rollng a de). Whle the outcome of the eperment
More informationSection 8.3 Polar Form of Complex Numbers
80 Chapter 8 Secton 8 Polar Form of Complex Numbers From prevous classes, you may have encountered magnary numbers the square roots of negatve numbers and, more generally, complex numbers whch are the
More information20. Mon, Oct. 13 What we have done so far corresponds roughly to Chapters 2 & 3 of Lee. Now we turn to Chapter 4. The first idea is connectedness.
20. Mon, Oct. 13 What we have done so far corresponds roughly to Chapters 2 & 3 of Lee. Now we turn to Chapter 4. The frst dea s connectedness. Essentally, we want to say that a space cannot be decomposed
More informationChapter 7 Channel Capacity and Coding
Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models
More informationMeenu Gupta, Man Singh & Deepak Gupta
IJS, Vol., o. 3-4, (July-December 0, pp. 489-497 Serals Publcatons ISS: 097-754X THE STEADY-STATE SOLUTIOS OF ULTIPLE PARALLEL CHAELS I SERIES AD O-SERIAL ULTIPLE PARALLEL CHAELS BOTH WITH BALKIG & REEGIG
More information2.3 Nilpotent endomorphisms
s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms
More informationStrong Markov property: Same assertion holds for stopping times τ.
Brownan moton Let X ={X t : t R + } be a real-valued stochastc process: a famlty of real random varables all defned on the same probablty space. Defne F t = nformaton avalable by observng the process up
More informationk t+1 + c t A t k t, t=0
Macro II (UC3M, MA/PhD Econ) Professor: Matthas Kredler Fnal Exam 6 May 208 You have 50 mnutes to complete the exam There are 80 ponts n total The exam has 4 pages If somethng n the queston s unclear,
More informationA be a probability space. A random vector
Statstcs 1: Probablty Theory II 8 1 JOINT AND MARGINAL DISTRIBUTIONS In Probablty Theory I we formulate the concept of a (real) random varable and descrbe the probablstc behavor of ths random varable by
More informationUsing T.O.M to Estimate Parameter of distributions that have not Single Exponential Family
IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran
More informationRapporto di Ricerca CS Simonetta Balsamo, Andrea Marin. On representing multiclass M/M/k queue by Generalized Stochastic Petri Net
UNIVERSITÀ CA FOSCARI DI VENEZIA Dpartmento d Informatca Techncal Report Seres n Computer Scence Rapporto d Rcerca CS-2007- Febbrao 2007 Smonetta Balsamo, Andrea Marn On representng multclass M/M/k queue
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationCS : Algorithms and Uncertainty Lecture 17 Date: October 26, 2016
CS 29-128: Algorthms and Uncertanty Lecture 17 Date: October 26, 2016 Instructor: Nkhl Bansal Scrbe: Mchael Denns 1 Introducton In ths lecture we wll be lookng nto the secretary problem, and an nterestng
More informationHere is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)
Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationPhysics 114 Exam 2 Fall 2014 Solutions. Name:
Physcs 114 Exam Fall 014 Name: For gradng purposes (do not wrte here): Queston 1. 1... 3. 3. Problem Answer each of the followng questons. Ponts for each queston are ndcated n red. Unless otherwse ndcated,
More informationUniversity of Washington Department of Chemistry Chemistry 453 Winter Quarter 2015
Lecture 2. 1/07/15-1/09/15 Unversty of Washngton Department of Chemstry Chemstry 453 Wnter Quarter 2015 We are not talkng about truth. We are talkng about somethng that seems lke truth. The truth we want
More informationHomework Assignment 3 Due in class, Thursday October 15
Homework Assgnment 3 Due n class, Thursday October 15 SDS 383C Statstcal Modelng I 1 Rdge regresson and Lasso 1. Get the Prostrate cancer data from http://statweb.stanford.edu/~tbs/elemstatlearn/ datasets/prostate.data.
More informationRandom Walks on Digraphs
Random Walks on Dgraphs J. J. P. Veerman October 23, 27 Introducton Let V = {, n} be a vertex set and S a non-negatve row-stochastc matrx (.e. rows sum to ). V and S defne a dgraph G = G(V, S) and a drected
More informationAssignment 5. Simulation for Logistics. Monti, N.E. Yunita, T.
Assgnment 5 Smulaton for Logstcs Mont, N.E. Yunta, T. November 26, 2007 1. Smulaton Desgn The frst objectve of ths assgnment s to derve a 90% two-sded Confdence Interval (CI) for the average watng tme
More informationTuring Machines (intro)
CHAPTER 3 The Church-Turng Thess Contents Turng Machnes defntons, examples, Turng-recognzable and Turng-decdable languages Varants of Turng Machne Multtape Turng machnes, non-determnstc Turng Machnes,
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationSupplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso
Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed
More informationFE REVIEW OPERATIONAL AMPLIFIERS (OP-AMPS)( ) 8/25/2010
FE REVEW OPERATONAL AMPLFERS (OP-AMPS)( ) 1 The Op-amp 2 An op-amp has two nputs and one output. Note the op-amp below. The termnal labeled l wth the (-) sgn s the nvertng nput and the nput labeled wth
More informationLecture 3: Shannon s Theorem
CSE 533: Error-Correctng Codes (Autumn 006 Lecture 3: Shannon s Theorem October 9, 006 Lecturer: Venkatesan Guruswam Scrbe: Wdad Machmouch 1 Communcaton Model The communcaton model we are usng conssts
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationHomework 9 Solutions. 1. (Exercises from the book, 6 th edition, 6.6, 1-3.) Determine the number of distinct orderings of the letters given:
Homework 9 Solutons PROBLEM ONE 1 (Exercses from the book, th edton,, 1-) Determne the number of dstnct orderngs of the letters gven: (a) GUIDE Soluton: 5! (b) SCHOOL Soluton:! (c) SALESPERSONS Soluton:
More information8.592J: Solutions for Assignment 7 Spring 2005
8.59J: Solutons for Assgnment 7 Sprng 5 Problem 1 (a) A flament of length l can be created by addton of a monomer to one of length l 1 (at rate a) or removal of a monomer from a flament of length l + 1
More informationCOMPLETE BUFFER SHARING IN ATM NETWORKS UNDER BURSTY ARRIVALS
COMPLETE BUFFER SHARING WITH PUSHOUT THRESHOLDS IN ATM NETWORKS UNDER BURSTY ARRIVALS Ozgur Aras and Tugrul Dayar Abstract. Broadband Integrated Servces Dgtal Networks (B{ISDNs) are to support multple
More informationCOMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS
More informationProbability Theory. The nth coefficient of the Taylor series of f(k), expanded around k = 0, gives the nth moment of x as ( ik) n n!
8333: Statstcal Mechancs I Problem Set # 3 Solutons Fall 3 Characterstc Functons: Probablty Theory The characterstc functon s defned by fk ep k = ep kpd The nth coeffcent of the Taylor seres of fk epanded
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationMath 261 Exercise sheet 2
Math 261 Exercse sheet 2 http://staff.aub.edu.lb/~nm116/teachng/2017/math261/ndex.html Verson: September 25, 2017 Answers are due for Monday 25 September, 11AM. The use of calculators s allowed. Exercse
More informationDeparture Process from a M/M/m/ Queue
Dearture rocess fro a M/M// Queue Q - (-) Q Q3 Q4 (-) Knowledge of the nature of the dearture rocess fro a queue would be useful as we can then use t to analyze sle cases of queueng networs as shown. The
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationA note on almost sure behavior of randomly weighted sums of φ-mixing random variables with φ-mixing weights
ACTA ET COMMENTATIONES UNIVERSITATIS TARTUENSIS DE MATHEMATICA Volume 7, Number 2, December 203 Avalable onlne at http://acutm.math.ut.ee A note on almost sure behavor of randomly weghted sums of φ-mxng
More informationEE215 FUNDAMENTALS OF ELECTRICAL ENGINEERING
EE215 FUNDAMENTALS OF ELECTRICAL ENGINEERING TaChang Chen Unersty of Washngton, Bothell Sprng 2010 EE215 1 WEEK 8 FIRST ORDER CIRCUIT RESPONSE May 21 st, 2010 EE215 2 1 QUESTIONS TO ANSWER Frst order crcuts
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More informationScheduling in polling systems
Schedulng n pollng systems Adam Werman, Erk M.M. Wnands, and Onno J. Boxma Abstract: We present a smple mean value analyss MVA framework for analyzng the effect of schedulng wthn queues n classcal asymmetrc
More informationTHE ROYAL STATISTICAL SOCIETY 2006 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 6 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutons to assst canddates preparng for the eamnatons n future years and for
More informationa b a In case b 0, a being divisible by b is the same as to say that
Secton 6.2 Dvsblty among the ntegers An nteger a ε s dvsble by b ε f there s an nteger c ε such that a = bc. Note that s dvsble by any nteger b, snce = b. On the other hand, a s dvsble by only f a = :
More informationMATH 829: Introduction to Data Mining and Analysis The EM algorithm (part 2)
1/16 MATH 829: Introducton to Data Mnng and Analyss The EM algorthm (part 2) Domnque Gullot Departments of Mathematcal Scences Unversty of Delaware Aprl 20, 2016 Recall 2/16 We are gven ndependent observatons
More informationNotes prepared by Prof Mrs) M.J. Gholba Class M.Sc Part(I) Information Technology
Inverse transformatons Generaton of random observatons from gven dstrbutons Assume that random numbers,,, are readly avalable, where each tself s a random varable whch s unformly dstrbuted over the range(,).
More informationC/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1
C/CS/Phy9 Problem Set 3 Solutons Out: Oct, 8 Suppose you have two qubts n some arbtrary entangled state ψ You apply the teleportaton protocol to each of the qubts separately What s the resultng state obtaned
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More information