RS Chapter 2 Random Variables 9/28/2017. Chapter 2. Random Variables
|
|
- Aubrie Byrd
- 5 years ago
- Views:
Transcription
1 RS Chapter Random Variables 9/8/017 Chapter Random Variables Random Variables A random variable is a convenient way to epress the elements of Ω as numbers rather than abstract elements of sets. Definition: Let A X ; A Y be nonempty families of subsets of X and Y, respectively. A function f: X Y is (A X ;A Y )-measurable if f -1 A A X for all A A Y. Definition: Random Variable A random variable X is a measurable function from the probability space (Ω, Σ,P) into the probability space (χ, A X, P X ), where χ in R is the range of X (which is a subset of the real line) A X is a Borel field of X, and P X is the probability measure on χ induced by X. Specifically, X: Ω χ. 1
2 RS Chapter Random Variables 9/8/017 Random Variables - Remarks Remarks: - A random variable X is a function. - It is a numerical quantity whose value is determined by a random eperiment. - It takes single elements in Ω and maps them to single points in R. - P is the probability measure over the sample space and P X is the probability measure over the range of the random variable. - The induced measure P X is just a way of relating measure on the real line --the range of X-- back to the original probability measure over the abstract events in the σ-algebra of the sample space. Random Variables - Interpretation Interpretation The induced measure P X allows us to relate a measure on the real line --the range of X-- back to the original probability measure over the abstract events in the σ-algebra of the sample space: P X [A] = P [X -1 (A)] =P[{ω Ω: X(ω) A}. That is, we take the probability weights associated with events and assign them to real numbers. Recall that when we deal with probabilities on some random variable X, we are really dealing with the P X measure. We measure the "size" of the set (using P as our measure) of ω's such that the random variable X returns values in A.
3 RS Chapter Random Variables 9/8/017 Random Variables - Interpretation Interpretation P is the probability measure over the sample space and P X is the probability measure over the range of the random variable. Thus, we write P[A] (where A is a subset of the range of X) but we mean P X [A], which is equivalent to P[{ω Ω: X(ω) A}]. Notational shortcut: We use P[A] instead of P X [A] (This notation can be misleading if there's confusion about whether A is in the sample space or in the range of X.) Random Variables Eample 1 Eample: Back to the previous eample where two coins are tossed. We defined the sample space (Ω) as all possible outcomes and the sigma algebra of all possible subsets of the sample space. A simple probability measure (P) was applied to the events in the sigma algebra. Let the random variable X be "number of heads." Recall that X takes Ω into χ and induces P X from P. In this eample, χ = {0; 1; } and A = {Φ; {0}; {1}; {}; {0;1}; {0;}; {1;}; {0;1;}}. The induced probability measure P X from the measure defined above would look like: 3
4 RS Chapter Random Variables 9/8/017 Random Variables Eample 1 Eample: Back to the previous eample where two coins are tossed. Prob. of 0 heads = P X [0] = P[{TT}] = 1/4 Prob. of 1 heads = P X [1] = P[{HT; TH}] = 1/ Prob. of heads = P X [] = P[{HH}] = ¼ Prob. of 0 or 1 heads = P X [{0; 1}] = P[{TT; TH; HT}] = 3/4 Prob. of 0 or heads = P X [{0; }] = P[{TT; HH}] = 1/ Prob. of 1 or heads = P X [{1; }] = P[{TH; HT; HH}] = 3/4 Prob. of 1,, or 3 heads = P X [{0; 1; }] = P[{HH; TH; HT; TT}] = 1 Prob. of "nothing" = P X [Φ] = P[Φ] = 0 The empty set is simply needed to complete the σ-algebra. Its interpretation is not important since P[Φ] = 0 for any reasonable P. Random Variables Eample Eample: Probability Space One standard probability space is the Borel field over the unit interval of the real line under the Lebesgue measure λ. That is ([0; 1]; B; λ). The Borel field over the unit interval gives us a set of all possible intervals taken from [0,1]. The Lebesgue measure measures the size of any given interval. For any interval [a; b] in [0,1] with b a, λ[[a,b]] = b - a. This probability space is well known: uniform distribution, the probability of any interval of values is the size of the interval. 4
5 RS Chapter Random Variables 9/8/017 Random Variables Eample 3 1. Two dice are rolled and X is the sum of the two upward faces.. A coin is tossed n = 3 times and X is the number of times that a head occurs. 3. A point is selected at random from a square whose sides are of length 1. X is the distance of the point from the lower left hand corner. X point 4. Xis the number of times the price of IBM increases during a time interval, say a day. 5. Today, the DJ Inde is 9,504.17, X is the value of the inde in thirty days. Random Variables: Summary Ω is the sample space - the set of possible outcomes from an eperiment. - An event A is a set containing outcomes from the sample space. Σ is a σ -algebra of subsets of the sample space. Think of Σ as the collection of all possible events involving outcomes chosen from. P is a probability measure over Σ. P assigns a number between [0,1] to each event in Σ. We have functions (random variables) that allow us to look at real numbers instead of abstract events in Σ. 5
6 RS Chapter Random Variables 9/8/017 Random Variables: Summary For each random variable X, there eists a new probability measure P X : P X [A] where A R simply relates back to P[{ω Ω: X(ω) A}. We calculate P X [A], but we are really interested in the probability P[{ω Ω: X(ω) A}, where A simply represents {ω Ω: X(ω) A} through the inverse transformation X -1. Random Variables: Probability Function & CDF Definition - The probability function, p(), of a RV, X. For any random variable, X, and any real number,, we define p P X P X where {X = } = the set of all outcomes (event) with X =. Definition The cumulative distribution function (CDF), F(), of a RV, X. For any random variable, X, and any real number,, we define F P X P X where {X } = the set of all outcomes (event) with X. 6
7 RS Chapter Random Variables 9/8/017 Probability Function & CDF: Eample I Two dice are rolled and X is the sum of the two upward faces. Sample space S = { :(1,1), 3:(1,;,1), 4:(1,3; 3,1;,), 5:(1,4;,3; 3,; 4,1), 6, 7, 8, 9, 10, 11, 1}. Graph: Probability function: p() Probability Function & CDF: Eample I Probability function: 1 p PX P 1,1 36 p3 PX 3 P 1,,, p4 PX 4 P 1,3,,, 3, p5, p6, p7, p8, p p10, p11, p and p 0 for all other Note: X for all other 7
8 RS Chapter Random Variables 9/8/017 Probability Function & CDF: Eample I Graph: CDF F F() is a step function Probability Function & CDF: Eample II A point is selected at random from a square whose sides are of length 1. X is the distance of the point from the lower le{t hand corner. X point An event, E, is any subset of the square, S. P[E] = (area of E)/(Area of S) = area of E E S 8
9 RS Chapter Random Variables 9/8/017 Probability Function & CDF: Eample II The probability function is given by: set of all points a dist p PX P 0 from lower left corner S Thus p() = 0 for all values of. The probability function for this eample is not very informative. The Cumulative distribution function is given by: set of all points within a F PX P dist from lower left corner S
10 RS Chapter Random Variables 9/8/ F PX Area A 1 1 S A Computation of Area A 1 A tan A tan tan 1 10
11 RS Chapter Random Variables 9/8/ F PX 1 1 tan F Random Variables: PDF for a Continuous RV Definition: Suppose that X is a random variable. Let f() denote a function defined for - < < with the following properties: 1. f() 0. f d1. 3. P a X b f d. b a Then f() is called the probability density function of X.. The random variable X is called continuous. 11
12 RS Chapter Random Variables 9/8/017 Random Variables: PDF for a Continuous RV f d1. b. P a X b f d a Random Variables: CDF for a Continuous RV. F P X f t dt F 1
13 RS Chapter Random Variables 9/8/017 CDF and PDF for a Continuous RV: Relation Thus if X is a continuous random variable with probability density function, f(), the cumulative distribution function of X is given by:. F P X f t dt Also because of the FTC (fundamental theorem of calculus): df F f d CDF and PDF for a Continuous RV: Relation Eample: Deriving a pdf from a CDF A point is selected at random from a square whose sides are of length 1. X is the distance of the point from the lower left hand corner. point X F PX tan
14 RS Chapter Random Variables 9/8/017 CDF and PDF for a Continuous RV: Relation Now 0 0 or f F 0 1 d 1 1 tan 1 1 d 4 CDF and PDF for a Continuous RV: Relation Also d d 1 tan d 1 1 tan 1 tan 1 d 1 3 tan 1 1 d 1 tan d 1 14
15 RS Chapter Random Variables 9/8/017 CDF and PDF for a Continuous RV: Relation Now d du 1 1 tan u 1 u d d tan and d d d d 1 tan 1 1 tan tan 1 CDF and PDF for a Continuous RV: Relation Finally 0 0 or f F 01 1 tan
16 RS Chapter Random Variables 9/8/017 CDF and PDF for a Continuous RV: Relation Graph of f() Discrete Random Variables A random variable X is called discrete if p p i1 i 1 All the probability is accounted for by values,, such that p() > 0. For a discrete random variable X the probability distribution is described by the probability function p(), which has the following properties: 1. 0 p 1 pi. p 1 3. i1 P a b p ab 16
17 RS Chapter Random Variables 9/8/017 Discrete Random Variables: Graph p() Pa b p ab a b Discrete Random Variables: Details Recall p() = P[X = ] = the probability function of X. This can be defined for any random variable X. For a continuous random variable p() = 0 for all values of X. Let S X ={ p() > 0}. This set is countable -i. e., it can be put into a 1-1 correspondence with the integers. S X ={ p() > 0}= { 1,, 3, 4, } Thus, we can write p p i1 i 17
18 RS Chapter Random Variables 9/8/017 Discrete Random Variables: Details Proof: (that the set S X ={ p() > 0} is countable -i. e., it can be put into a 1-1 correspondence with the integers.) S X = S 1 S S 3 S 3 where 1 1 Si p i 1 i That is, 1 S1 p 1 Note: ns1 1 1 S p Note: ns S3 p Note: ns Thus the number of elements of S n S i 1 (is finite) i i Discrete Random Variables: Details Thus the elements of S X = S 1 S S 3 S 3 can be arranged { 1,, 3, 4, } by choosing the first elements to be the elements of S 1, the net elements to be the elements of S, the net elements to be the elements of S 3, the net elements to be the elements of S 4, etc This allows us to write for p p i1 i 18
19 RS Chapter Random Variables 9/8/017 Discrete & Continuous Random Variables A Probability distribution is similar to a distribution of mass. A Discrete distribution is similar to a point distribution of mass. => Positive amounts of mass are put at discrete points. p( 1 ) p( ) p( 3 ) p( 4 ) Discrete & Continuous Random Variables A Continuous distribution is similar to a continuous distribution of mass. The total mass of 1 is spread over a continuum. The mass assigned to any point is zero but has a non-zero density f() 19
20 RS Chapter Random Variables 9/8/017 Distribution function F(): Properties This is defined for any random variable, X: F() = P[X ] Properties 1. F(- ) = 0 and F( ) = 1. Since {X - }= and {X } =S => F(- ) = 0 and F( ) = 1.. F() is non-decreasing (i. e., if 1 < then F( 1 ) F( ) ) If 1 < then {X } = {X 1 } { 1 < X } Thus P[X ] = P[X 1 ] + P[ 1 < X ] or F( ) = F( 1 ) + P[ 1 < X ] Since P[ 1 < X ] 0 then F( ) F( 1 ). Distribution function F(): Properties 3. F(b) F(a) = P[a < X b]. If a < b then using the argument above F(b) = F(a) + P[a < X b] => F(b) F(a) = P[a < X b]. 4. p() = P[X = ] =F() F(-) F lim F u Here u 5. If p() = 0 for all (i.e., X is continuous) then F() is continuous. A function F is continuous if lim lim F F u F F u u u One can show that p() = 0 implies F F F 0
21 RS Chapter Random Variables 9/8/017 Distribution function F(): Discrete RV F P X p u u F() is a non-decreasing step function with F F 0 and 1 p F F jump in F at. F() p() Distribution function F(): Continuous RV F P X f u du F() is a non-decreasing continuous function with F F 0 and 1. f F F() f() slope
22 RS Chapter Random Variables 9/8/017 Some Important Discrete Distributions The Binomial distribution Jacob Bernoulli ( )
23 RS Chapter Random Variables 9/8/017 Bernouille Distribution Suppose that we have a Bernoulli trial (an eperiment) that has results: 1. Success (S). Failure (F) Suppose that p is the probability of success (S) and q = 1 p is the probability of failure (F). Then, the probability distribution with probability function q p PX p is called the Bernoulli distribution. 0 1 Now assume that the Bernoulli trial is repeated independently n times. Let X be the number of successes ocurring in the n trials. (The possible values of X are {0, 1,,, n}) The Binomial Distribution Suppose we have n = 5 the outcomes together with the values of X and the probabilities of each outcome are given in the table below: FFFFF 0 q 5 SFFSF p q 3 SSSFF 3 p 3 q FSFSS 3 p 3 q SFFFF 1 pq 4 SFFFS p q 3 SSFSF 3 p 3 q FFSSS 3 p 3 q FSFFF 1 pq 4 FSSFF p q 3 SSFFS 3 p 3 q SSSSF 4 p 4 q FFSFF 1 pq 4 FSFSF p q 3 SFSSF 3 p 3 q SSSFS 4 p 4 q FFFSF 1 pq 4 FSFFS p q 3 SFSFS 3 p 3 q SSFSS 4 p 4 q FFFFS 1 pq 4 FFSSF p q 3 SFFSS 3 p 3 q SFSSS 4 p 4 q SSFFF p q 3 FFSFS p q 3 FSSSF 3 p 3 q FSSSS 4 p 4 q SFSFF p q 3 FFFSS p q 3 FSSFS 3 p 3 q SSSSS 5 p 5 3
24 RS Chapter Random Variables 9/8/017 The Binomial Distribution For n = 5 the following table gives the different possible values of X,, and p() = P[X = ] p() = P[X = ] q 5 5pq 4 10p 3 q 10p q 3 5p 4 q p 5 For general n, the outcome of the sequence of n Bernoulli trials is a sequence of S s and F s of length n: SSFSFFSFFF FSSSFFSFSFFS The value of X for such a sequence is k = the number of S s in the sequence. The probability of such a sequence is p k q n k ( a p for each S and a q for each F) There are n k such sequences containing eactly k S s The Binomial Distribution n k is the number of ways of selecting the k positions for the S s (the remaining n k positions are for the F s). Thus, n k nk pk PX k p q k 0,1,,3,, n1, n k These are the terms in the epansion of (p + q) n using the Binomial Theorem n n n n 0 1 n For this reason the probability function n 0 n 1 n1 n n 0 pq p q p q p q p q n n p PX p q 0,1,,, n is called the probability function for the Binomial distribution 4
25 RS Chapter Random Variables 9/8/017 The Binomial Distribution Summary We observe a Bernoulli trial (S,F) n times. Let X denote the number of successes in the n trials. Then, X has a binomial distribution: n n p PX p q 0,1,,, n where 1. p = the probability of success (S), and. q = 1 p = the probability of failure (F) The Binomial Distribution Eample If a firm announces profits and they are surprising, the chance of a stock price increase is 85%. Assume there are n=0 (independent) announcements. Let X denote the number of increases in the stock price following surprising announcements in the n = 0 trials. Then, X has a binomial distribution, with p = 0.85 and n = 0. Thus n n p PX p q 0,1,,, n ,1,,, 0 5
26 RS Chapter Random Variables 9/8/ p ( ) p ( ) p ( ) p ( ) p() The Poisson distribution Siméon Denis Poisson ( ) 6
27 RS Chapter Random Variables 9/8/017 The Poisson distribution Suppose events are occurring randomly and uniformly in time. The events occur with a known average. Let X be the number of events occurring (arrivals) in a fied period of time (time-interval of given length). Typical eample: X = number of crime cases coming before a criminal court per year (original Poisson s application in 1838.) Then, X will have a Poisson distribution with parameter. 0,1,,3, 4, p e! The parameter λ represents the epected number of occurrences in a fied period of time. The parameter λ is a positive real number. The Poisson distribution Eample: On average, a trade occurs every 15 seconds. Suppose trades are independent. We are interested in the probability of observing 10 trades in a minute (X=10). A Poisson distribution can be used with λ=4 (4 trades per minute). Poisson probability function 7
28 RS Chapter Random Variables 9/8/017 Properties: 1. p e 1! Thus e e 1!! 3! 4! 3 4 e e 1 e!! 3! 4! e using e u 1 u u u u! 3! 4! n n. If pbin p, n p 1 p is the probability function for the Binomial distribution with parameters n and p. Let n and p 0 such that np = a constant (=λ, say) then lim pbin p, n ppoisson e n, p0! Proof: p p, n p 1 p Bin Suppose np or p n n n n n! pbin p, n pbin, n 1! n! n n n n! 1 1! n n! n n nn n ! n nn n n ! n n n n n n 8
29 RS Chapter Random Variables 9/8/017 Now lim p Bin, n n 1 1 lim ! n n n n n n lim 1! n n n u u Using the classic limit lim 1 e n n lim pbin, n lim 1 e p n! n n! n Poisson Note: In many applications, when n is large and p is very small --and the epectation np is not big. Then, the binomial distribution may be approimated by the easier Poisson distribution. This is called the law of rare events, since each of the n individual Bernoulli events rarely occurs. n The Poisson distribution: Graphical Illustration Suppose a time interval is divided into n equal parts and that one event may or may not occur in each subinterval. n subintervals - Event occurs - Event does not occur time interval X = # of events is Bin(n,p) As n, events can occur over the continuous time interval. X = # of events is Poisson() 9
30 RS Chapter Random Variables 9/8/017 The Poisson distribution: Comments The Poisson distribution arises in connection with Poisson processes - a stochastic process in which events occur continuously and independently of one another. It occurs most easily for time-events; such as the number of calls passing through a call center per minute, or the number of visitors passing through a turnstile per hour. However, it can apply to any process in which the mean can be shown to be constant. It is used in finance (number of jumps in an asset price in a given interval); market microstructure (number of trades per unit of time in a stock market); sports economics (number of goals in sports involving two competing teams); insurance (number of a given disaster -volcano eruptions/hurricanes/floods- per year); etc. Poisson Distribution - Eample: Hurricanes The number of Hurricanes over a period of a year in the Caribbean is known to have a Poisson distribution with = 13.1 Determine the probability function of X. Compute the probability that X is at most 8. Compute the probability that X is at least 10. Given that at least 10 hurricanes occur, what is the probability that X is at most 15? Solution: p e 0,1,,3,4,! e 0,1,,3, 4,! 30
31 RS Chapter Random Variables 9/8/017 Poisson Distribution - Eample: Hurricanes Table of p() p ( ) p ( ) Poisson Distribution - Eample: Hurricanes at most 8 8 p p p P P X at least P P X P X 1 p 0 p 1 p P at most 15 at least 10 P X 15 X 10 P X 15 X 10 P 10 X 15 P X 10 PX 10 p10 p11 p
Probability Theory The Binomial and Poisson Distributions. Sections 5.2 and 5.3
Probability Theory The Binomial and Poisson Distributions Sections 5.2 and 5.3 Models for count data The binomial distributions provide a theoretical model for count data having a fixed maximum Examples:
More informationDEFINITION: IF AN OUTCOME OF A RANDOM EXPERIMENT IS CONVERTED TO A SINGLE (RANDOM) NUMBER (E.G. THE TOTAL
CHAPTER 5: RANDOM VARIABLES, BINOMIAL AND POISSON DISTRIBUTIONS DEFINITION: IF AN OUTCOME OF A RANDOM EXPERIMENT IS CONVERTED TO A SINGLE (RANDOM) NUMBER (E.G. THE TOTAL NUMBER OF DOTS WHEN ROLLING TWO
More informationChapter 3 Single Random Variables and Probability Distributions (Part 1)
Chapter 3 Single Random Variables and Probability Distributions (Part 1) Contents What is a Random Variable? Probability Distribution Functions Cumulative Distribution Function Probability Density Function
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationIntroduction to Probability and Statistics Slides 3 Chapter 3
Introduction to Probability and Statistics Slides 3 Chapter 3 Ammar M. Sarhan, asarhan@mathstat.dal.ca Department of Mathematics and Statistics, Dalhousie University Fall Semester 2008 Dr. Ammar M. Sarhan
More informationChapter 2: The Random Variable
Chapter : The Random Variable The outcome of a random eperiment need not be a number, for eample tossing a coin or selecting a color ball from a bo. However we are usually interested not in the outcome
More informationRandom variable X is a mapping that maps each outcome s in the sample space to a unique real number x, < x <. ( ) X s. Real Line
Random Variable Random variable is a mapping that maps each outcome s in the sample space to a unique real number, <
More informationLecture Notes 2 Random Variables. Discrete Random Variables: Probability mass function (pmf)
Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution
More informationRandom variable X is a mapping that maps each outcome s in the sample space to a unique real number x, x. X s. Real Line
Random Variable Random variable is a mapping that maps each outcome s in the sample space to a unique real number,. s s : outcome Sample Space Real Line Eamples Toss a coin. Define the random variable
More informationRandom Variable. Discrete Random Variable. Continuous Random Variable. Discrete Random Variable. Discrete Probability Distribution
Random Variable Theoretical Probability Distribution Random Variable Discrete Probability Distributions A variable that assumes a numerical description for the outcome of a random eperiment (by chance).
More informationLecture Notes 2 Random Variables. Random Variable
Lecture Notes 2 Random Variables Definition Discrete Random Variables: Probability mass function (pmf) Continuous Random Variables: Probability density function (pdf) Mean and Variance Cumulative Distribution
More information1: PROBABILITY REVIEW
1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following
More informationLecture 3. Discrete Random Variables
Math 408 - Mathematical Statistics Lecture 3. Discrete Random Variables January 23, 2013 Konstantin Zuev (USC) Math 408, Lecture 3 January 23, 2013 1 / 14 Agenda Random Variable: Motivation and Definition
More informationNotes 1 : Measure-theoretic foundations I
Notes 1 : Measure-theoretic foundations I Math 733-734: Theory of Probability Lecturer: Sebastien Roch References: [Wil91, Section 1.0-1.8, 2.1-2.3, 3.1-3.11], [Fel68, Sections 7.2, 8.1, 9.6], [Dur10,
More informationIntroduction to Probability Theory for Graduate Economics Fall 2008
Introduction to Probability Theory for Graduate Economics Fall 008 Yiğit Sağlam October 10, 008 CHAPTER - RANDOM VARIABLES AND EXPECTATION 1 1 Random Variables A random variable (RV) is a real-valued function
More informationChapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory
Chapter 1 Statistical Reasoning Why statistics? Uncertainty of nature (weather, earth movement, etc. ) Uncertainty in observation/sampling/measurement Variability of human operation/error imperfection
More informationStatistics and Econometrics I
Statistics and Econometrics I Random Variables Shiu-Sheng Chen Department of Economics National Taiwan University October 5, 2016 Shiu-Sheng Chen (NTU Econ) Statistics and Econometrics I October 5, 2016
More informationChapter 2 Random Variables
Stochastic Processes Chapter 2 Random Variables Prof. Jernan Juang Dept. of Engineering Science National Cheng Kung University Prof. Chun-Hung Liu Dept. of Electrical and Computer Eng. National Chiao Tung
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More informationSTAT2201. Analysis of Engineering & Scientific Data. Unit 3
STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random
More informationRandom Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More informationSystem Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models
System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models Fatih Cavdur fatihcavdur@uludag.edu.tr March 29, 2014 Introduction Introduction The world of the model-builder
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationProbability Review. Gonzalo Mateos
Probability Review Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ September 11, 2018 Introduction
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationLecture 11: Random Variables
EE5110: Probability Foundations for Electrical Engineers July-November 2015 Lecture 11: Random Variables Lecturer: Dr. Krishna Jagannathan Scribe: Sudharsan, Gopal, Arjun B, Debayani The study of random
More informationSociology 6Z03 Topic 10: Probability (Part I)
Sociology 6Z03 Topic 10: Probability (Part I) John Fox McMaster University Fall 2014 John Fox (McMaster University) Soc 6Z03: Probability I Fall 2014 1 / 29 Outline: Probability (Part I) Introduction Probability
More informationRS Chapter 1 Random Variables 6/5/2017. Chapter 1. Probability Theory: Introduction
Chapter 1 Probability Theory: Introduction Basic Probability General In a probability space (Ω, Σ, P), the set Ω is the set of all possible outcomes of a probability experiment. Mathematically, Ω is just
More informationChapter 2: Random Variables
ECE54: Stochastic Signals and Systems Fall 28 Lecture 2 - September 3, 28 Dr. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter 2: Random Variables Example. Tossing a fair coin twice:
More informationBrief Review of Probability
Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions
More informationBayes Rule for probability
Bayes Rule for probability P A B P A P B A PAP B A P AP B A An generalization of Bayes Rule Let A, A 2,, A k denote a set of events such that S A A2 Ak and Ai Aj for all i and j. Then P A i B P Ai P B
More informationChapter 1 Probability Theory
Review for the previous lecture Eample: how to calculate probabilities of events (especially for sampling with replacement) and the conditional probability Definition: conditional probability, statistically
More informationRandom Variables Example:
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More informationChapter 3, 4 Random Variables ENCS Probability and Stochastic Processes. Concordia University
Chapter 3, 4 Random Variables ENCS6161 - Probability and Stochastic Processes Concordia University ENCS6161 p.1/47 The Notion of a Random Variable A random variable X is a function that assigns a real
More informationII. Probability. II.A General Definitions
II. Probability II.A General Definitions The laws of thermodynamics are based on observations of macroscopic bodies, and encapsulate their thermal properties. On the other hand, matter is composed of atoms
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationECE Lecture 4. Overview Simulation & MATLAB
ECE 450 - Lecture 4 Overview Simulation & MATLAB Random Variables: Concept and Definition Cumulative Distribution Functions (CDF s) Eamples & Properties Probability Distribution Functions (pdf s) 1 Random
More informationFundamental Tools - Probability Theory II
Fundamental Tools - Probability Theory II MSc Financial Mathematics The University of Warwick September 29, 2015 MSc Financial Mathematics Fundamental Tools - Probability Theory II 1 / 22 Measurable random
More informationRelationship between probability set function and random variable - 2 -
2.0 Random Variables A rat is selected at random from a cage and its sex is determined. The set of possible outcomes is female and male. Thus outcome space is S = {female, male} = {F, M}. If we let X be
More informationChapter 1. Sets and probability. 1.3 Probability space
Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space Random processes - Chapter 1. Sets and probability 2 Probability
More informationThe random variable 1
The random variable 1 Contents 1. Definition 2. Distribution and density function 3. Specific random variables 4. Functions of one random variable 5. Mean and variance 2 The random variable A random variable
More informationELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Random Variable Discrete Random
More informationRandom variables. DS GA 1002 Probability and Statistics for Data Science.
Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationRecap of Basic Probability Theory
02407 Stochastic Processes Recap of Basic Probability Theory Uffe Høgsbro Thygesen Informatics and Mathematical Modelling Technical University of Denmark 2800 Kgs. Lyngby Denmark Email: uht@imm.dtu.dk
More informationLecture 6: The Pigeonhole Principle and Probability Spaces
Lecture 6: The Pigeonhole Principle and Probability Spaces Anup Rao January 17, 2018 We discuss the pigeonhole principle and probability spaces. Pigeonhole Principle The pigeonhole principle is an extremely
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationName: Firas Rassoul-Agha
Midterm 1 - Math 5010 - Spring 016 Name: Firas Rassoul-Agha Solve the following 4 problems. You have to clearly explain your solution. The answer carries no points. Only the work does. CALCULATORS ARE
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationRecap of Basic Probability Theory
02407 Stochastic Processes? Recap of Basic Probability Theory Uffe Høgsbro Thygesen Informatics and Mathematical Modelling Technical University of Denmark 2800 Kgs. Lyngby Denmark Email: uht@imm.dtu.dk
More informationRVs and their probability distributions
RVs and their probability distributions RVs and their probability distributions In these notes, I will use the following notation: The probability distribution (function) on a sample space will be denoted
More informationMATH MW Elementary Probability Course Notes Part I: Models and Counting
MATH 2030 3.00MW Elementary Probability Course Notes Part I: Models and Counting Tom Salisbury salt@yorku.ca York University Winter 2010 Introduction [Jan 5] Probability: the mathematics used for Statistics
More informationEE/CpE 345. Modeling and Simulation. Fall Class 5 September 30, 2002
EE/CpE 345 Modeling and Simulation Class 5 September 30, 2002 Statistical Models in Simulation Real World phenomena of interest Sample phenomena select distribution Probabilistic, not deterministic Model
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationChapter 2. Discrete Distributions
Chapter. Discrete Distributions Objectives ˆ Basic Concepts & Epectations ˆ Binomial, Poisson, Geometric, Negative Binomial, and Hypergeometric Distributions ˆ Introduction to the Maimum Likelihood Estimation
More information18.175: Lecture 2 Extension theorems, random variables, distributions
18.175: Lecture 2 Extension theorems, random variables, distributions Scott Sheffield MIT Outline Extension theorems Characterizing measures on R d Random variables Outline Extension theorems Characterizing
More informationSpecial Discrete RV s. Then X = the number of successes is a binomial RV. X ~ Bin(n,p).
Sect 3.4: Binomial RV Special Discrete RV s 1. Assumptions and definition i. Experiment consists of n repeated trials ii. iii. iv. There are only two possible outcomes on each trial: success (S) or failure
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationPOISSON RANDOM VARIABLES
POISSON RANDOM VARIABLES Suppose a random phenomenon occurs with a mean rate of occurrences or happenings per unit of time or length or area or volume, etc. Note: >. Eamples: 1. Cars passing through an
More informationLecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019
Lecture 10: Probability distributions DANIEL WELLER TUESDAY, FEBRUARY 19, 2019 Agenda What is probability? (again) Describing probabilities (distributions) Understanding probabilities (expectation) Partial
More information9. DISCRETE PROBABILITY DISTRIBUTIONS
9. DISCRETE PROBABILITY DISTRIBUTIONS Random Variable: A quantity that takes on different values depending on chance. Eg: Next quarter s sales of Coca Cola. The proportion of Super Bowl viewers surveyed
More informationReview of Probability. CS1538: Introduction to Simulations
Review of Probability CS1538: Introduction to Simulations Probability and Statistics in Simulation Why do we need probability and statistics in simulation? Needed to validate the simulation model Needed
More informationBinomial and Poisson Probability Distributions
Binomial and Poisson Probability Distributions Esra Akdeniz March 3, 2016 Bernoulli Random Variable Any random variable whose only possible values are 0 or 1 is called a Bernoulli random variable. What
More information7 Random samples and sampling distributions
7 Random samples and sampling distributions 7.1 Introduction - random samples We will use the term experiment in a very general way to refer to some process, procedure or natural phenomena that produces
More informationDistribusi Binomial, Poisson, dan Hipergeometrik
Distribusi Binomial, Poisson, dan Hipergeometrik CHAPTER TOPICS The Probability of a Discrete Random Variable Covariance and Its Applications in Finance Binomial Distribution Poisson Distribution Hypergeometric
More informationMODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES
MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 7-11 Topics 2.1 RANDOM VARIABLE 2.2 INDUCED PROBABILITY MEASURE 2.3 DISTRIBUTION FUNCTION AND ITS PROPERTIES 2.4 TYPES OF RANDOM VARIABLES: DISCRETE,
More informationChapter 4 : Discrete Random Variables
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2015 Néhémy Lim Chapter 4 : Discrete Random Variables 1 Random variables Objectives of this section. To learn the formal definition of a random variable.
More informationLecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable
Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed
More informationMATH/STAT 395. Introduction to Probability Models. Jan 7, 2013
MATH/STAT 395 Introduction to Probability Models Jan 7, 2013 1.0 Random Variables Definition: A random variable X is a measurable function from the sample space Ω to the real line R. X : Ω R Ω is the set
More informationRandom Variables and Probability Distributions
CHAPTER Random Variables and Probability Distributions Random Variables Suppose that to each point of a sample space we assign a number. We then have a function defined on the sample space. This function
More information1. If X has density. cx 3 e x ), 0 x < 0, otherwise. Find the value of c that makes f a probability density. f(x) =
1. If X has density f(x) = { cx 3 e x ), 0 x < 0, otherwise. Find the value of c that makes f a probability density. 2. Let X have density f(x) = { xe x, 0 < x < 0, otherwise. (a) Find P (X > 2). (b) Find
More informationLecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationB.N.Bandodkar College of Science, Thane. Subject : Computer Simulation and Modeling.
B.N.Bandodkar College of Science, Thane Subject : Computer Simulation and Modeling. Simulation is a powerful technique for solving a wide variety of problems. To simulate is to copy the behaviors of a
More information(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)
3 Probability Distributions (Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3) Probability Distribution Functions Probability distribution function (pdf): Function for mapping random variables to real numbers. Discrete
More informationBandits, Experts, and Games
Bandits, Experts, and Games CMSC 858G Fall 2016 University of Maryland Intro to Probability* Alex Slivkins Microsoft Research NYC * Many of the slides adopted from Ron Jin and Mohammad Hajiaghayi Outline
More informationDiscrete Probability Distribution
Shapes of binomial distributions Discrete Probability Distribution Week 11 For this activity you will use a web applet. Go to http://socr.stat.ucla.edu/htmls/socr_eperiments.html and choose Binomial coin
More informationChapter 7: Theoretical Probability Distributions Variable - Measured/Categorized characteristic
BSTT523: Pagano & Gavreau, Chapter 7 1 Chapter 7: Theoretical Probability Distributions Variable - Measured/Categorized characteristic Random Variable (R.V.) X Assumes values (x) by chance Discrete R.V.
More informationBinomial random variable
Binomial random variable Toss a coin with prob p of Heads n times X: # Heads in n tosses X is a Binomial random variable with parameter n,p. X is Bin(n, p) An X that counts the number of successes in many
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER / Probability
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER 2 2017/2018 DR. ANTHONY BROWN 5.1. Introduction to Probability. 5. Probability You are probably familiar with the elementary
More informationX 1 ((, a]) = {ω Ω : X(ω) a} F, which leads us to the following definition:
nna Janicka Probability Calculus 08/09 Lecture 4. Real-valued Random Variables We already know how to describe the results of a random experiment in terms of a formal mathematical construction, i.e. the
More informationJUSTIN HARTMANN. F n Σ.
BROWNIAN MOTION JUSTIN HARTMANN Abstract. This paper begins to explore a rigorous introduction to probability theory using ideas from algebra, measure theory, and other areas. We start with a basic explanation
More information2.1 Elementary probability; random sampling
Chapter 2 Probability Theory Chapter 2 outlines the probability theory necessary to understand this text. It is meant as a refresher for students who need review and as a reference for concepts and theorems
More information(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)
3 Probability Distributions (Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3) Probability Distribution Functions Probability distribution function (pdf): Function for mapping random variables to real numbers. Discrete
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationWeek 2. Review of Probability, Random Variables and Univariate Distributions
Week 2 Review of Probability, Random Variables and Univariate Distributions Probability Probability Probability Motivation What use is Probability Theory? Probability models Basis for statistical inference
More informationSession 2: Probability distributionsand density functions p. 1
Session 2: Probability distributions and density functions Susan Thomas http://www.igidr.ac.in/ susant susant@mayin.org IGIDR Bombay Session 2: Probability distributionsand density functions p. 1 Recap
More informationProbability Distributions
The ASTRO509-3 dark energy puzzle Probability Distributions I have had my results for a long time: but I do not yet know how I am to arrive at them. Johann Carl Friedrich Gauss 1777-1855 ASTR509 Jasper
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationClass 26: review for final exam 18.05, Spring 2014
Probability Class 26: review for final eam 8.05, Spring 204 Counting Sets Inclusion-eclusion principle Rule of product (multiplication rule) Permutation and combinations Basics Outcome, sample space, event
More informationStochastic Processes. Review of Elementary Probability Lecture I. Hamid R. Rabiee Ali Jalali
Stochastic Processes Review o Elementary Probability bili Lecture I Hamid R. Rabiee Ali Jalali Outline History/Philosophy Random Variables Density/Distribution Functions Joint/Conditional Distributions
More informationLecture 6 Random Variable. Compose of procedure & observation. From observation, we get outcomes
ENM 07 Lecture 6 Random Variable Random Variable Eperiment (hysical Model) Compose of procedure & observation From observation we get outcomes From all outcomes we get a (mathematical) probability model
More informationDiscrete and continuous
Discrete and continuous A curve, or a function, or a range of values of a variable, is discrete if it has gaps in it - it jumps from one value to another. In practice in S2 discrete variables are variables
More informationPOISSON PROCESSES 1. THE LAW OF SMALL NUMBERS
POISSON PROCESSES 1. THE LAW OF SMALL NUMBERS 1.1. The Rutherford-Chadwick-Ellis Experiment. About 90 years ago Ernest Rutherford and his collaborators at the Cavendish Laboratory in Cambridge conducted
More informationBernoulli and Binomial
Bernoulli and Binomial Will Monroe July 1, 217 image: Antoine Taveneaux with materials by Mehran Sahami and Chris Piech Announcements: Problem Set 2 Due this Wednesday, 7/12, at 12:3pm (before class).
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationBasic Probability. Introduction
Basic Probability Introduction The world is an uncertain place. Making predictions about something as seemingly mundane as tomorrow s weather, for example, is actually quite a difficult task. Even with
More informationRandom Variable And Probability Distribution. Is defined as a real valued function defined on the sample space S. We denote it as X, Y, Z,
Random Variable And Probability Distribution Introduction Random Variable ( r.v. ) Is defined as a real valued function defined on the sample space S. We denote it as X, Y, Z, T, and denote the assumed
More informationLecture 3: Random variables, distributions, and transformations
Lecture 3: Random variables, distributions, and transformations Definition 1.4.1. A random variable X is a function from S into a subset of R such that for any Borel set B R {X B} = {ω S : X(ω) B} is an
More informationMath 183 Statistical Methods
Math 183 Statistical Methods Eddie Aamari S.E.W. Assistant Professor eaamari@ucsd.edu math.ucsd.edu/~eaamari/ AP&M 5880A Today: Chapter 3 (continued) Negative Binomial Model Poisson Model Practice these
More information