PROBABILITY DISTRIBUTIONS
|
|
- Marshall Pitts
- 6 years ago
- Views:
Transcription
1 Review of PROBABILITY DISTRIBUTIONS Hideaki Shimazaki, Ph.D. Poisson process 1
2 Probability distribution Probability that a (continuous) random variable X is in (x,x+dx). ( ) P x < X < x + dx Probability density function (PDF). P( x < X < x + dx) f ( x) = lim dx +0 dx P( x < X < x + dx) f ( x)dx Cumulative distribution function (CDF) = Life time distribution. x F ( x) = P( X x) = f ( s)ds Survival function = Complementary CDF. ( ) = P( X > x) = f s F x x ( )ds =1 F ( x) PDF X gamma distrib. CDF Hideaki Shimazaki, Ph.D. Poisson process 2
3 The fundamental theorem of calculus The relation between probability distribution and probability density function. ( ) = f s F x x ( )ds d dx F x ( ) = d dx " #$ x f ( % s)ds &' = f x ( ) Hideaki Shimazaki, Ph.D. Poisson process 3
4 Probability distribution: Example Exponential distribution Probability density function (PDF). Cumulative distribution function (CDF). f ( x) = λe λx F ( x) = P( X x) =1 e λx Survival function. 1.0 F ( x) = P( X > x) =1 F ( x) = e λx Expectation E! " X # $ = λ 1 Variance var! " X # $ = λ 2 Hideaki Shimazaki, Ph.D. Poisson process 4
5 Samples from a distribution 0.8 PDF If a random variable X follows a cdf FX, then the r.v. U given by U = F X X ( X ) = f X ( s)ds follows an uniform distribution in [0,1]. U X gamma distrib CDF f X F X ( x) ( x) X Hideaki Shimazaki, Ph.D. Poisson process 5
6 Homework 1-1 Problem Confirm that U = F X ( X ) follows an uniform distribution in [0,1]. x when X is a random variable from F X ( x) = f X ( s)ds 0 Hint Suppose a random variable (r.v.) X given by a pdf Consider a r.v. Y that is transformed from X using a monotonic function g. Y = g X The distribution of Y is given as f Y f X ( ) ( y) = f X ( x) dx dy = f X ( x) ( x ) g! ( x) 1 x Consider a particular relation given by CDF, g ( x) = F X ( x) = f X s Then we obtain f Y ( y) = f X ( x) g! ( x) 1 = f X ( x) f X ( x) 1 =1 ( )ds Hideaki Shimazaki, Ph.D. Poisson process 6
7 Samples from a distribution Inverse function method 1 CDF Let U be an uniform r.v.. X X that satisfies U = f X ( s)ds The r.v. X = F 1 ( U ) follows the density f X follows the CDF given by F. ( x) Exponential distribution: U = F X f X X = F X 1 U ( x) = λe λx X ( X ) = λe λs ds =1 e λ X A r.v. that follows an exponential distribution with rate λ is generated using an uniform r.v. X as ( ) = λ 1 log( U ) Memo: The distribution that can be inverted analytically is limited, e.g., Exp., Weibull, Pareto, etc. For other distributions, one can numerically compute CDF to obtain X. Hideaki Shimazaki, Ph.D. Poisson process 7
8 Introduction to POISSON POINT PROCESS Hideaki Shimazaki, Ph.D. Poisson process 8
9 Memoryless process A point process is memoryless if intervals X satisfy ( ) = P( X > s) P X > s + t X > t Question. Suppose that you bought a refrigerator t years ago. It still works well. How long will it continue to work from now? 0 t s t + s X Event Answer. We wish to know the probability that the refrigerator survives another s years given that it survived t years. This is given as P( X > s + t X > t). From the memoryless property, it is equivalent to P( X > s). Thus, the fact that the refrigerator survived t years did not provide any information to predict a failure of the refrigerator in future. Hideaki Shimazaki, Ph.D. Poisson process 9
10 Exponential distribution Q. What distribution possesses the memoryless property? Ans. The exponential distribution: f ( x) = λe λx The survival function can be written in a conditional form as Using the memoryless property, we obtain ( ) = P( X > s) P( X > t) P X > s + t The exponential distribution satisfies the memoryless property. If ( ) = e λx P X > x Density is given as ( ) = P( X > s + t X > t) P( X > t) P X > s + t, then P X > s ( ) P( X > t) = e λs e λt f ( x) = d dx P ( X > x ) = λe λx ( ) = e λ (s+t ) = P X > s + t
11 Poisson point process If intervals of events are samples from the exponential distribution, and the intervals are independent each other, then the process is memoryless. This process is called a (homogeneous) Poisson point process. Hideaki Shimazaki, Ph.D. Poisson process 11
12 Simulating a Poisson process Question. How can we simulate a Poisson point process? Ans. Use the inverse function method to generate an inter-spike interval (ISIs) that follows an exponential distribution ISI X = λ 1 logu Hideaki Shimazaki, Ph.D. Poisson process 12
13 The Poisson distribution Let s consider a distribution of the number of spikes that occurred in T[s]. N T : the number of spikes that happens in T [s] N T -th spike T A count distribution of a Poisson point process is given by a Poisson distribution. Ê Ê ( ( ) = λt ) n P N T = n n! e λt Ê Ï Ï Ï Ï 0.10 Ï Ï Ï Ê Ï 0.05 Ê Ï Ï Ï Ï Ï Ï Ï Ï Ï Ê Ê Ï Ê Ê Ê Ê Ê Ê Ê Ê Ê Ê Ê Ï Ê ÏÊ ÏÊ ÏÊ ÏÊ ÏÊ ÏÊ ÏÊ ÏÊ ÏÊ ÏÊ ÏÊ ÏÊ Hideaki Shimazaki, Ph.D. Poisson process 13
14 Homework 1-2 Problem Derive the Poisson distribution for the first few spike counts, N T = 0,1,2. Hint N T = 0 X 1 T If there is no spike in T, then the first spike occurred after T. This is given by survival function of an exponential distribution. P( N T = 0) = P( X 1 > T ) = F ( T ) N T =1 X 2 Let the first spike occurred at s_1, the first ISI follows an exponential density, the second ISI should be greater than T-s_1. s 1 T T ( ) = f ( s 1 ) F T s 1 P N T =1 0 ( )ds 1 N T = 2 X 3 Similarly if you have two spikes in T, s 1 s 2 T T T ( ) = f ( s 1 ) f ( s 2 s 1 ) F T s 2 P N T = 2 0 s 1 ( )ds 1 ds 2 Hideaki Shimazaki, Ph.D. Poisson process 14
15 The Erlang distribution Let s consider a distribution of a waiting time τ until spikes occurred n times n-th spike τ Waiting time of multiple spikes from a Poisson process is given by an Erlang distribution. 0.4 ( ) = λ n τ n 1 P τ < X < τ + dτ ( n 1)! e λτ dτ Hideaki Shimazaki, Ph.D. Poisson process 15
16 Spike count and ISI The relation between a Poisson and Erlang distribution n-1 n N τ spikes τ S n If S n > τ, the number of spikes in is at most n-1. P( N τ < n) = P( S n > τ ) Rhs is a survival function of an Erlang distribution. ( ) = λ n t n 1 e λt dt P S n > τ = τ n 1 k=0 ( λτ ) k k! Hideaki Shimazaki, Ph.D. Poisson process 16 e λτ ( ) n P( N τ = n) = P( N τ < n +1) P( N τ < n) = λτ n! e λτ
17 Instantaneous spike rate Alternative definition of a Poisson point process Divide T into small N bins of a small width Δ (T=NΔ). Spike t Δ t + Δ P( a spike in [t,t + Δ) ) = λδ + o( Δ) P ( >1 spikes in [t,t + Δ) ) = o( Δ) Instantaneous spike rate P( no spikes in [t,t + Δ) ) =1 λδ + o( Δ) o( Δ) is a function that approaches to zero faster than Δ : ( ) o Δ lim Δ +0 Δ = 0 Hideaki Shimazaki, Ph.D. Poisson process 17
18 Relation to the Poisson distribution The probability of a spike/no spike is an approximation of the Poisson distribution for a small time bin. The spike count in a small bin is approximated as In particular, ( ( ) = λδ ) n P N Δ = n P N Δ = 0 # n! ( ) n e λδ = λδ n! ( ) =1% 1 λδ + 1 ( 2 λδ ) 2 + P N Δ =1 $ # ( ) = λδ% 1 λδ + 1 ( 2 λδ ) 2 + $ P( N Δ = 2) = ( λδ) 2 % 1 λδ λδ # $ # % 1 λδ + 1 $ 2 λδ ( ) 2 + & ( =1 λδ + o Δ ' & ( = λδ + o( Δ) ' & ( = o( Δ) ' ( ) 2 + ( ) & ( ' Hideaki Shimazaki, Ph.D. Poisson process 18
19 Exponential / Poisson distribution revisited The exponential distribution from an instantaneous spike rate. The probability that no spikes happened in N-1 bins and a spike happened in the last bin (geometric distribution). (x=nδ) P( x < X < x + Δ) = ( 1 λδ) N 1 λδ + o( Δ) ISI distribution: f ( x) = lim ( ) P x < X < x + Δ Δ 0 Δ = λe λx The Poisson distribution from an instantaneous spike rate. The probability that n spikes happened in N bins (T=NΔ). P( N T = n) =! # " N n ( ( ) N n ( λδ) n λt ) n $ & 1 λδ % n! e λt as Δ 0 Hideaki Shimazaki, Ph.D. Poisson process 19
20 Exponential distribution revisited We can derive the exponential distribution from an instantaneous spike rate, λ [spike/sec] Divide T into small N bins of a width Δ. Δ T = NΔ N bins Spike Probability a spike in a bin: λδ >2 spikes in a bin: o( Δ) no spikes in a bin: 1 λδ + o( Δ) The probability that no spikes happened in N-1 bins and a spike happened in the last bin. P( x < T < x + Δ) = ( 1 λδ) N 1 λδ + o( Δ) ISI distribution: P( x < T < x + Δ) f ( x) = lim Δ 0 Δ = λe λx Hideaki Shimazaki, Ph.D. Poisson process 20
21 Poisson distribution revisted We can derive the Poisson distribution from an instantaneous spike rate, λ [spike/sec] Divide T into small N bins of a width Δ. N bins Δ Spike T = NΔ Probability a spike in a bin: λδ >2 spikes in a bin: o( Δ) no spikes in a bin: 1 λδ + o( Δ) The probability that n spikes happened in T [s]. P( N T = n) =! # " N n ( ( ) N n ( λδ) n λt ) n $ & 1 λδ % n! e λt as Δ 0 Hideaki Shimazaki, Ph.D. Poisson process 21
22 Homework 1-3 Problem The probability that no spikes happened in N-1 bins and a spike happened in the last bin is given as P( x < X < x + Δ) = ( 1 λδ) N 1 λδ + o( Δ) = λδ ( 1 λδ) N + o( Δ) 1 λδ Show that the ISI distribution becomes an exponential distribution. Hint Approximate the terms by the Taylor expansions. 1 1 x =1+ x + x2 + x 3 λδ 1 λδ Hence we obtain = λδ{ 1+ λδ + ( λδ) 2 + } = λδ + o( Δ) ( ) = x 1 2 x2 1 3 x3 log 1 x P( x < X < x + Δ) = λδexp[ λx] + o( Δ), and f ( x) = lim ( 1 λδ) N = exp#$ N log( 1 λδ) % & # ' = exp-n ( λδ 1 $ ) 2 λδ / = e λx λ xδ ( ) 2 Hideaki Shimazaki, Ph.D. Poisson process 22 Δ 0 P( x < X < x + Δ) Δ *% +.,& = λe λx
23 Problem Homework 1-4 Probability that n spikes occur in N bins (T [s]) is given as! N $ P( N T = n) = # &( λδ) n ( 1 λδ) N n " n % Show that the probability becomes the Poisson distribution for large N and small Δ with a relation given by a constant T=NΔ. Hint Using an approximation given by the Taylor expansions (See previous slides). n N! # λδ & P( N T = n) = % ( ( 1 λδ) N N! ( ( N n)!n! $ 1 λδ ' ( N n)!n! λδ ) n exp[ λδn] Use the relation, T=NΔ, to obtain P( N T = n) = Use the Stirling s formula and prove that N! 1 ( ( N n)!n n n! λt ) n exp[ λt ] ln N! ~ N ln N N N! ln ( N n)!n = " 1 n % $ n # N & 'ln " 1 n % $ # N ' & Hideaki Shimazaki, Ph.D. Poisson process 23 N n =1 lne n n 0
24 Likelihood function Likelihood function t 1 t 2 t n 0 T p( t 1,t 2,,t n N T = n) = λ n exp[ λt ] Proof p( t 1,t 2,,t n N T = n)δ n n = f ( t 1 )Δ f ( t i t i 1 )Δ i=2 n P( t n+1 > T t n ) = λ exp( λt 1 )Δ λ exp&' λ t i t i 1 [ ] = λ n Δexp λt i=2 Here the ISI distribution is ( ) ( ) Δ exp&' λ ( T t n )( ) f ( x) = λ exp[ λx] Hideaki Shimazaki, Ph.D. Poisson process 24
25 INHOMOGENEOUS POISSON PROCESS Hideaki Shimazaki, Ph.D. Poisson process 25
26 Inhomogeneous Poisson process Instantaneous rate λ ( t) Point process t t +Δ P( a spike in [t,t + Δ) ) = λ ( t)δ + o( Δ) Time-dependent rate Hideaki Shimazaki, Ph.D. Poisson process 26
27 Inhomogeneous Poisson process Instantaneous rate λ ( t) Point process t i 1 t i f ( t t i 1 ) = λ t # ( )exp t λ ( u & $% )du t i 1 '( for t > t i 1 Note that the above formula extends the exponential ISI of homogeneous Poisson process. Hideaki Shimazaki, Ph.D. Poisson process 27
28 Homework 1-5 Problem Derive the ISI density of the inhomogeneous Poisson process. Hint Let the last spike occurred at time 0. The probability of a spike occurrence in [t, t+δ) is given as ( ) = 1 λ kδ P t < X < t + Δ N 1 k=1 #$ ( )Δ% & #$ λ ( NΔ)Δ% & + o( Δ) = λ ( NΔ N )Δ #$ 1 λ ( kδ)δ% & + o( Δ) 1 λ ( NΔ)Δ k=1 Using the following approximation, N #$ 1 λ ( kδ)δ % # N % # N % & = exp) log{ 1 λ ( kδ)δ} * = exp) { λ ( kδ)δ + o( Δ) }* k=1 $ k=1 & $ k=1 & λ ( NΔ)Δ 1 λ ( NΔ)Δ = λ ( NΔ )Δ + o( Δ) P( t < X < t + Δ) f ( t) = lim = λ t % t Δ 0 ( )exp λ ( u ( The ISI density is given as )du 0 Δ &' )* Hideaki Shimazaki, Ph.D. Poisson process 28
29 Likelihood function Likelihood function λ ( t) ( ) = λ ( t i ) p t 1,t 2,,t n N T = n 0 T t 1 t 2 n exp % T λ ( u ( &' )du 0 )* i=1 t n Proof p( t 1,t 2,,t n N T = n)δ n = f ( t 1 )Δ f ( t i t i 1 )Δ n n i=2 = λ ( t i )Δexp ' T λ ( u * () )du 0 +, i=1 P( t n+1 > T t n ) Here the ISI distribution is given as f ( t i t i 1 ) = λ t i # t i ( )exp λ ( u & $% )du t i 1 '( Hideaki Shimazaki, Ph.D. Poisson process 29
30 What we learned Memoryless property of a process. Exponential distribution = Poisson process. Poisson count distribution, Waiting time distribution (Erlang). Definition of a Poisson process using instantaneous firing rate. Exponential and a Poisson count distribution revisited. Inhomogeneous Poisson process: ISI distribution and likelihood Hideaki Shimazaki, Ph.D. Poisson process 30
31 Tomorrow, we will learn 1 2 Renewal process: Conditional intensity function and ISI density. non-poisson process (Point process written by the conditional intensity function) 3 Time-rescaling theorem 4 5 How to simulate a point process via the time-rescaling theorem. How to assess a point process model via the time-rescaling theorem. (Q-Q plot and K-S test) Hideaki Shimazaki, Ph.D. Poisson process 31
32 Follow-up from the lecture feedback Stimulus signal x( t) Tomorrow s topic. Instantaneous spike-rate λ ( t) Today s topic. Point process t t +Δ P( a spike in [t,t + Δ) ) = λ ( t)δ + o( Δ) Hideaki Shimazaki, Ph.D. Poisson process 32
33 Likelihood function Density function An observed sample Likelihood function f ( x) = λe λx X L( λ) = f ( X) = λe λx Multiple observation X 1, X 2,, X n Likelihood function ( ) = p( X i λ) L λ n i=1 Maximum likelihood estimation (MLE) λ MLE = argmax λ n i=1 ( ) p X i λ Hideaki Shimazaki, Ph.D. Poisson process 33
34 Likelihood of a Poisson process Likelihood function of a homogeneous Poisson process ( ) = p( t 1,t 2 t 1,,t n t n 1 N T = n) p t 1,t 2,,t n N T = n λ f ( t i t i 1 ) = λe λ ( t i t i 1 ) Inter-spike Intervals (ISIs) n = f ( t i t i 1 ;λ) F T t n ;λ i=1 [ ] = λ n exp λt ( ) Likelihood function of a inhomogeneous Poisson process p( t 1,t 2,,t n N T = n λ 0:T ) = p( t 1,t 2 t 1,,t n t n 1 N T = n) f ( t i t i 1 ) = λ t i # t i ( )exp λ ( u & $% )du t i 1 '( n ( ) = f t i t i 1 ;λ ti :t i 1 F T t i ;λ tn :T i=1 n = λ ( t i ) exp & T λ ( u ) '( )du 0 *+ i=1 ( ) Hideaki Shimazaki, Ph.D. Poisson process 34
Exponential Distribution and Poisson Process
Exponential Distribution and Poisson Process Stochastic Processes - Lecture Notes Fatih Cavdur to accompany Introduction to Probability Models by Sheldon M. Ross Fall 215 Outline Introduction Exponential
More informationPoisson Processes. Particles arriving over time at a particle detector. Several ways to describe most common model.
Poisson Processes Particles arriving over time at a particle detector. Several ways to describe most common model. Approach 1: a) numbers of particles arriving in an interval has Poisson distribution,
More informationHW7 Solutions. f(x) = 0 otherwise. 0 otherwise. The density function looks like this: = 20 if x [10, 90) if x [90, 100]
HW7 Solutions. 5 pts.) James Bond James Bond, my favorite hero, has again jumped off a plane. The plane is traveling from from base A to base B, distance km apart. Now suppose the plane takes off from
More informationThe exponential distribution and the Poisson process
The exponential distribution and the Poisson process 1-1 Exponential Distribution: Basic Facts PDF f(t) = { λe λt, t 0 0, t < 0 CDF Pr{T t) = 0 t λe λu du = 1 e λt (t 0) Mean E[T] = 1 λ Variance Var[T]
More informationNorthwestern University Department of Electrical Engineering and Computer Science
Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability
More informationChapter Learning Objectives. Probability Distributions and Probability Density Functions. Continuous Random Variables
Chapter 4: Continuous Random Variables and Probability s 4-1 Continuous Random Variables 4-2 Probability s and Probability Density Functions 4-3 Cumulative Functions 4-4 Mean and Variance of a Continuous
More informationECE 313 Probability with Engineering Applications Fall 2000
Exponential random variables Exponential random variables arise in studies of waiting times, service times, etc X is called an exponential random variable with parameter λ if its pdf is given by f(u) =
More informationSystem Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models
System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 20, 2012 Introduction Introduction The world of the model-builder
More informationRandom variables. DS GA 1002 Probability and Statistics for Data Science.
Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities
More informationContinuous Probability Distributions. Uniform Distribution
Continuous Probability Distributions Uniform Distribution Important Terms & Concepts Learned Probability Mass Function (PMF) Cumulative Distribution Function (CDF) Complementary Cumulative Distribution
More informationChapter 4 Continuous Random Variables and Probability Distributions
Chapter 4 Continuous Random Variables and Probability Distributions Part 3: The Exponential Distribution and the Poisson process Section 4.8 The Exponential Distribution 1 / 21 Exponential Distribution
More informationChapter 3 sections. SKIP: 3.10 Markov Chains. SKIP: pages Chapter 3 - continued
Chapter 3 sections Chapter 3 - continued 3.1 Random Variables and Discrete Distributions 3.2 Continuous Distributions 3.3 The Cumulative Distribution Function 3.4 Bivariate Distributions 3.5 Marginal Distributions
More informationIE 303 Discrete-Event Simulation
IE 303 Discrete-Event Simulation 1 L E C T U R E 5 : P R O B A B I L I T Y R E V I E W Review of the Last Lecture Random Variables Probability Density (Mass) Functions Cumulative Density Function Discrete
More informationChing-Han Hsu, BMES, National Tsing Hua University c 2015 by Ching-Han Hsu, Ph.D., BMIR Lab. = a + b 2. b a. x a b a = 12
Lecture 5 Continuous Random Variables BMIR Lecture Series in Probability and Statistics Ching-Han Hsu, BMES, National Tsing Hua University c 215 by Ching-Han Hsu, Ph.D., BMIR Lab 5.1 1 Uniform Distribution
More informationPoisson Processes for Neuroscientists
Poisson Processes for Neuroscientists Thibaud Taillefumier This note is an introduction to the key properties of Poisson processes, which are extensively used to simulate spike trains. For being mathematical
More information3 Continuous Random Variables
Jinguo Lian Math437 Notes January 15, 016 3 Continuous Random Variables Remember that discrete random variables can take only a countable number of possible values. On the other hand, a continuous random
More informationArrivals and waiting times
Chapter 20 Arrivals and waiting times The arrival times of events in a Poisson process will be continuous random variables. In particular, the time between two successive events, say event n 1 and event
More informationChapter 3 sections. SKIP: 3.10 Markov Chains. SKIP: pages Chapter 3 - continued
Chapter 3 sections 3.1 Random Variables and Discrete Distributions 3.2 Continuous Distributions 3.3 The Cumulative Distribution Function 3.4 Bivariate Distributions 3.5 Marginal Distributions 3.6 Conditional
More informationMoments. Raw moment: February 25, 2014 Normalized / Standardized moment:
Moments Lecture 10: Central Limit Theorem and CDFs Sta230 / Mth 230 Colin Rundel Raw moment: Central moment: µ n = EX n ) µ n = E[X µ) 2 ] February 25, 2014 Normalized / Standardized moment: µ n σ n Sta230
More informationContinuous Random Variables
Continuous Random Variables Recall: For discrete random variables, only a finite or countably infinite number of possible values with positive probability. Often, there is interest in random variables
More informationClosed book and notes. 60 minutes. Cover page and four pages of exam. No calculators.
IE 230 Seat # Closed book and notes. 60 minutes. Cover page and four pages of exam. No calculators. Score Exam #3a, Spring 2002 Schmeiser Closed book and notes. 60 minutes. 1. True or false. (for each,
More informationBMIR Lecture Series on Probability and Statistics Fall, 2015 Uniform Distribution
Lecture #5 BMIR Lecture Series on Probability and Statistics Fall, 2015 Department of Biomedical Engineering and Environmental Sciences National Tsing Hua University s 5.1 Definition ( ) A continuous random
More informationManual for SOA Exam MLC.
Chapter 10. Poisson processes. Section 10.5. Nonhomogenous Poisson processes Extract from: Arcones Fall 2009 Edition, available at http://www.actexmadriver.com/ 1/14 Nonhomogenous Poisson processes Definition
More informationEE126: Probability and Random Processes
EE126: Probability and Random Processes Lecture 18: Poisson Process Abhay Parekh UC Berkeley March 17, 2011 1 1 Review 2 Poisson Process 2 Bernoulli Process An arrival process comprised of a sequence of
More informationContinuous Distributions
A normal distribution and other density functions involving exponential forms play the most important role in probability and statistics. They are related in a certain way, as summarized in a diagram later
More informationTwo hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.
Two hours MATH38181 To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer any FOUR
More informationLet X be a continuous random variable, < X < f(x) is the so called probability density function (pdf) if
University of California, Los Angeles Department of Statistics Statistics 1A Instructor: Nicolas Christou Continuous probability distributions Let X be a continuous random variable, < X < f(x) is the so
More informationChapter 4. Continuous Random Variables
Chapter 4. Continuous Random Variables Review Continuous random variable: A random variable that can take any value on an interval of R. Distribution: A density function f : R R + such that 1. non-negative,
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationBMIR Lecture Series on Probability and Statistics Fall 2015 Discrete RVs
Lecture #7 BMIR Lecture Series on Probability and Statistics Fall 2015 Department of Biomedical Engineering and Environmental Sciences National Tsing Hua University 7.1 Function of Single Variable Theorem
More information2 Continuous Random Variables and their Distributions
Name: Discussion-5 1 Introduction - Continuous random variables have a range in the form of Interval on the real number line. Union of non-overlapping intervals on real line. - We also know that for any
More informationChapter 4: CONTINUOUS RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS
Chapter 4: CONTINUOUS RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Part 4: Gamma Distribution Weibull Distribution Lognormal Distribution Sections 4-9 through 4-11 Another exponential distribution example
More informationLecture 4a: Continuous-Time Markov Chain Models
Lecture 4a: Continuous-Time Markov Chain Models Continuous-time Markov chains are stochastic processes whose time is continuous, t [0, ), but the random variables are discrete. Prominent examples of continuous-time
More informationSTAT 380 Markov Chains
STAT 380 Markov Chains Richard Lockhart Simon Fraser University Spring 2016 Richard Lockhart (Simon Fraser University) STAT 380 Markov Chains Spring 2016 1 / 38 1/41 PoissonProcesses.pdf (#2) Poisson Processes
More informationContinuous Random Variables and Continuous Distributions
Continuous Random Variables and Continuous Distributions Continuous Random Variables and Continuous Distributions Expectation & Variance of Continuous Random Variables ( 5.2) The Uniform Random Variable
More informationIEOR 4703: Homework 2 Solutions
IEOR 4703: Homework 2 Solutions Exercises for which no programming is required Let U be uniformly distributed on the interval (0, 1); P (U x) = x, x (0, 1). We assume that your computer can sequentially
More informationChapter 2. Poisson Processes. Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan
Chapter 2. Poisson Processes Prof. Shun-Ren Yang Department of Computer Science, National Tsing Hua University, Taiwan Outline Introduction to Poisson Processes Definition of arrival process Definition
More informationSTAT 509 Section 3.4: Continuous Distributions. Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s.
STAT 509 Section 3.4: Continuous Distributions Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s. A continuous random variable is one for which the outcome
More information1 Random Variable: Topics
Note: Handouts DO NOT replace the book. In most cases, they only provide a guideline on topics and an intuitive feel. 1 Random Variable: Topics Chap 2, 2.1-2.4 and Chap 3, 3.1-3.3 What is a random variable?
More informationChapter 4: Continuous Probability Distributions
Chapter 4: Continuous Probability Distributions Seungchul Baek Department of Statistics, University of South Carolina STAT 509: Statistics for Engineers 1 / 57 Continuous Random Variable A continuous random
More informationQualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama
Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama Instructions This exam has 7 pages in total, numbered 1 to 7. Make sure your exam has all the pages. This exam will be 2 hours
More informationSlides 8: Statistical Models in Simulation
Slides 8: Statistical Models in Simulation Purpose and Overview The world the model-builder sees is probabilistic rather than deterministic: Some statistical model might well describe the variations. An
More informationBasics of Stochastic Modeling: Part II
Basics of Stochastic Modeling: Part II Continuous Random Variables 1 Sandip Chakraborty Department of Computer Science and Engineering, INDIAN INSTITUTE OF TECHNOLOGY KHARAGPUR August 10, 2016 1 Reference
More informationDescribing Spike-Trains
Describing Spike-Trains Maneesh Sahani Gatsby Computational Neuroscience Unit University College London Term 1, Autumn 2012 Neural Coding The brain manipulates information by combining and generating action
More informationEE/CpE 345. Modeling and Simulation. Fall Class 5 September 30, 2002
EE/CpE 345 Modeling and Simulation Class 5 September 30, 2002 Statistical Models in Simulation Real World phenomena of interest Sample phenomena select distribution Probabilistic, not deterministic Model
More informationPAS04 - Important discrete and continuous distributions
PAS04 - Important discrete and continuous distributions Jan Březina Technical University of Liberec 30. října 2014 Bernoulli trials Experiment with two possible outcomes: yes/no questions throwing coin
More informationApplied Statistics and Probability for Engineers. Sixth Edition. Chapter 4 Continuous Random Variables and Probability Distributions.
Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger Chapter 4 Continuous Random Variables and Probability Distributions 4 Continuous CHAPTER OUTLINE Random
More informationChapter 4 Continuous Random Variables and Probability Distributions
Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger Chapter 4 Continuous Random Variables and Probability Distributions 4 Continuous CHAPTER OUTLINE 4-1
More informationSTAT509: Continuous Random Variable
University of South Carolina September 23, 2014 Continuous Random Variable A continuous random variable is a random variable with an interval (either finite or infinite) of real numbers for its range.
More informationThings to remember when learning probability distributions:
SPECIAL DISTRIBUTIONS Some distributions are special because they are useful They include: Poisson, exponential, Normal (Gaussian), Gamma, geometric, negative binomial, Binomial and hypergeometric distributions
More informationThese notes will supplement the textbook not replace what is there. defined for α >0
Gamma Distribution These notes will supplement the textbook not replace what is there. Gamma Function ( ) = x 0 e dx 1 x defined for >0 Properties of the Gamma Function 1. For any >1 () = ( 1)( 1) Proof
More informationBirth-Death Processes
Birth-Death Processes Birth-Death Processes: Transient Solution Poisson Process: State Distribution Poisson Process: Inter-arrival Times Dr Conor McArdle EE414 - Birth-Death Processes 1/17 Birth-Death
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 8 10/1/2008 CONTINUOUS RANDOM VARIABLES Contents 1. Continuous random variables 2. Examples 3. Expected values 4. Joint distributions
More information3. Poisson Processes (12/09/12, see Adult and Baby Ross)
3. Poisson Processes (12/09/12, see Adult and Baby Ross) Exponential Distribution Poisson Processes Poisson and Exponential Relationship Generalizations 1 Exponential Distribution Definition: The continuous
More informationReliability Engineering I
Happiness is taking the reliability final exam. Reliability Engineering I ENM/MSC 565 Review for the Final Exam Vital Statistics What R&M concepts covered in the course When Monday April 29 from 4:30 6:00
More informationProbability Distributions Columns (a) through (d)
Discrete Probability Distributions Columns (a) through (d) Probability Mass Distribution Description Notes Notation or Density Function --------------------(PMF or PDF)-------------------- (a) (b) (c)
More informationStat410 Probability and Statistics II (F16)
Stat4 Probability and Statistics II (F6 Exponential, Poisson and Gamma Suppose on average every /λ hours, a Stochastic train arrives at the Random station. Further we assume the waiting time between two
More informationSupratim Ray
Supratim Ray sray@cns.iisc.ernet.in Biophysics of Action Potentials Passive Properties neuron as an electrical circuit Passive Signaling cable theory Active properties generation of action potential Techniques
More informationPart I Stochastic variables and Markov chains
Part I Stochastic variables and Markov chains Random variables describe the behaviour of a phenomenon independent of any specific sample space Distribution function (cdf, cumulative distribution function)
More informationCheck Your Understanding of the Lecture Material Finger Exercises with Solutions
Check Your Understanding of the Lecture Material Finger Exercises with Solutions Instructor: David Dobor March 6, 2017 While the solutions to these questions are available, you are strongly encouraged
More informationSystem Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models
System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 29, 2014 Introduction Introduction The world of the model-builder
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 17: Continuous random variables: conditional PDF Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin
More informationMAS1302 Computational Probability and Statistics
MAS1302 Computational Probability and Statistics April 23, 2008 3. Simulating continuous random behaviour 3.1 The Continuous Uniform U(0,1) Distribution We have already used this random variable a great
More informationDS-GA 1002 Lecture notes 2 Fall Random variables
DS-GA 12 Lecture notes 2 Fall 216 1 Introduction Random variables Random variables are a fundamental tool in probabilistic modeling. They allow us to model numerical quantities that are uncertain: the
More informationPoissonprocessandderivationofBellmanequations
APPENDIX B PoissonprocessandderivationofBellmanequations 1 Poisson process Let us first define the exponential distribution Definition B1 A continuous random variable X is said to have an exponential distribution
More informationChapter 4: Continuous Random Variable
Chapter 4: Continuous Random Variable Shiwen Shen University of South Carolina 2017 Summer 1 / 57 Continuous Random Variable A continuous random variable is a random variable with an interval (either finite
More informationStat 512 Homework key 2
Stat 51 Homework key October 4, 015 REGULAR PROBLEMS 1 Suppose continuous random variable X belongs to the family of all distributions having a linear probability density function (pdf) over the interval
More informationSection 7.5: Nonstationary Poisson Processes
Section 7.5: Nonstationary Poisson Processes Discrete-Event Simulation: A First Course c 2006 Pearson Ed., Inc. 0-13-142917-5 Discrete-Event Simulation: A First Course Section 7.5: Nonstationary Poisson
More informationThe Binomial distribution. Probability theory 2. Example. The Binomial distribution
Probability theory Tron Anders Moger September th 7 The Binomial distribution Bernoulli distribution: One experiment X i with two possible outcomes, probability of success P. If the experiment is repeated
More informationChapter 3 Common Families of Distributions
Lecture 9 on BST 631: Statistical Theory I Kui Zhang, 9/3/8 and 9/5/8 Review for the previous lecture Definition: Several commonly used discrete distributions, including discrete uniform, hypergeometric,
More informationMATH 2413 TEST ON CHAPTER 4 ANSWER ALL QUESTIONS. TIME 1.5 HRS.
MATH 1 TEST ON CHAPTER ANSWER ALL QUESTIONS. TIME 1. HRS. M1c Multiple Choice Identify the choice that best completes the statement or answers the question. 1. Use the summation formulas to rewrite the
More informationExperimental Design and Statistics - AGA47A
Experimental Design and Statistics - AGA47A Czech University of Life Sciences in Prague Department of Genetics and Breeding Fall/Winter 2014/2015 Matúš Maciak (@ A 211) Office Hours: M 14:00 15:30 W 15:30
More informationReview for the previous lecture
Lecture 1 and 13 on BST 631: Statistical Theory I Kui Zhang, 09/8/006 Review for the previous lecture Definition: Several discrete distributions, including discrete uniform, hypergeometric, Bernoulli,
More informationExpected Values, Exponential and Gamma Distributions
Expected Values, Exponential and Gamma Distributions Sections 5.2 & 5.4 Cathy Poliak, Ph.D. cathy@math.uh.edu Office in Fleming 11c Department of Mathematics University of Houston Lecture 13-3339 Cathy
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationSpecial distributions
Special distributions August 22, 2017 STAT 101 Class 4 Slide 1 Outline of Topics 1 Motivation 2 Bernoulli and binomial 3 Poisson 4 Uniform 5 Exponential 6 Normal STAT 101 Class 4 Slide 2 What distributions
More informationContinuous-time Markov Chains
Continuous-time Markov Chains Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ October 23, 2017
More informationS n = x + X 1 + X X n.
0 Lecture 0 0. Gambler Ruin Problem Let X be a payoff if a coin toss game such that P(X = ) = P(X = ) = /2. Suppose you start with x dollars and play the game n times. Let X,X 2,...,X n be payoffs in each
More information2905 Queueing Theory and Simulation PART IV: SIMULATION
2905 Queueing Theory and Simulation PART IV: SIMULATION 22 Random Numbers A fundamental step in a simulation study is the generation of random numbers, where a random number represents the value of a random
More informationSome Generalizations of Poisson Processes
Journal of Statistical Theory and Applications Volume 11, Number 3, 212, pp. 225-235 ISSN 1538-7887 Some Generalizations of Poisson Processes Seetha Lekshmi, V. Dept.of Statistics, Nirmala College Muvattupuzha,
More information2 Functions of random variables
2 Functions of random variables A basic statistical model for sample data is a collection of random variables X 1,..., X n. The data are summarised in terms of certain sample statistics, calculated as
More informationGuidelines for Solving Probability Problems
Guidelines for Solving Probability Problems CS 1538: Introduction to Simulation 1 Steps for Problem Solving Suggested steps for approaching a problem: 1. Identify the distribution What distribution does
More informationSTAT 430/510 Probability Lecture 12: Central Limit Theorem and Exponential Distribution
STAT 430/510 Probability Lecture 12: Central Limit Theorem and Exponential Distribution Pengyuan (Penelope) Wang June 15, 2011 Review Discussed Uniform Distribution and Normal Distribution Normal Approximation
More informationExponential & Gamma Distributions
Exponential & Gamma Distributions Engineering Statistics Section 4.4 Josh Engwer TTU 7 March 26 Josh Engwer (TTU) Exponential & Gamma Distributions 7 March 26 / 2 PART I PART I: EXPONENTIAL DISTRIBUTION
More information1 Acceptance-Rejection Method
Copyright c 2016 by Karl Sigman 1 Acceptance-Rejection Method As we already know, finding an explicit formula for F 1 (y), y [0, 1], for the cdf of a rv X we wish to generate, F (x) = P (X x), x R, is
More informationReview 1: STAT Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics. August 25, 2015
Review : STAT 36 Mark Carpenter, Ph.D. Professor of Statistics Department of Mathematics and Statistics August 25, 25 Support of a Random Variable The support of a random variable, which is usually denoted
More informationf X (x) = λe λx, , x 0, k 0, λ > 0 Γ (k) f X (u)f X (z u)du
11 COLLECTED PROBLEMS Do the following problems for coursework 1. Problems 11.4 and 11.5 constitute one exercise leading you through the basic ruin arguments. 2. Problems 11.1 through to 11.13 but excluding
More informationChapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory
Chapter 1 Statistical Reasoning Why statistics? Uncertainty of nature (weather, earth movement, etc. ) Uncertainty in observation/sampling/measurement Variability of human operation/error imperfection
More informationProbability Models. 4. What is the definition of the expectation of a discrete random variable?
1 Probability Models The list of questions below is provided in order to help you to prepare for the test and exam. It reflects only the theoretical part of the course. You should expect the questions
More informationStatistical distributions: Synopsis
Statistical distributions: Synopsis Basics of Distributions Special Distributions: Binomial, Exponential, Poisson, Gamma, Chi-Square, F, Extreme-value etc Uniform Distribution Empirical Distributions Quantile
More informationVariations. ECE 6540, Lecture 10 Maximum Likelihood Estimation
Variations ECE 6540, Lecture 10 Last Time BLUE (Best Linear Unbiased Estimator) Formulation Advantages Disadvantages 2 The BLUE A simplification Assume the estimator is a linear system For a single parameter
More informationThe integral test and estimates of sums
The integral test Suppose f is a continuous, positive, decreasing function on [, ) and let a n = f (n). Then the series n= a n is convergent if and only if the improper integral f (x)dx is convergent.
More information1 Solution to Problem 2.1
Solution to Problem 2. I incorrectly worked this exercise instead of 2.2, so I decided to include the solution anyway. a) We have X Y /3, which is a - function. It maps the interval, ) where X lives) onto
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationRandom variable X is a mapping that maps each outcome s in the sample space to a unique real number x, x. X s. Real Line
Random Variable Random variable is a mapping that maps each outcome s in the sample space to a unique real number,. s s : outcome Sample Space Real Line Eamples Toss a coin. Define the random variable
More informationThree hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.
Three hours To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer QUESTION 1, QUESTION
More informationPROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS
PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please
More informationBrief Review of Probability
Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More information