(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)

Similar documents
(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)

Probability Distributions for Continuous Variables. Probability Distributions for Continuous Variables

Random Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping

Continuous Probability Spaces

Random variables. DS GA 1002 Probability and Statistics for Data Science.

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

Random Variables Example:

Random variable X is a mapping that maps each outcome s in the sample space to a unique real number x, x. X s. Real Line

Continuous-Valued Probability Review

Lecture 3. Discrete Random Variables

STAT2201. Analysis of Engineering & Scientific Data. Unit 3

System Simulation Part II: Mathematical and Statistical Models Chapter 5: Statistical Models

Random Variable. Discrete Random Variable. Continuous Random Variable. Discrete Random Variable. Discrete Probability Distribution

Random variable X is a mapping that maps each outcome s in the sample space to a unique real number x, < x <. ( ) X s. Real Line

Conditional Probability

Relationship between probability set function and random variable - 2 -

Conditional Probability

Chapter Learning Objectives. Probability Distributions and Probability Density Functions. Continuous Random Variables

Chapter 3. Chapter 3 sections

Chapter 3 Discrete Random Variables

Binomial and Poisson Probability Distributions

b. ( ) ( ) ( ) ( ) ( ) 5. Independence: Two events (A & B) are independent if one of the conditions listed below is satisfied; ( ) ( ) ( )

Continuous Distributions

3 Modeling Process Quality

Lecture 8 : The Geometric Distribution

Introduction to Probability and Statistics Slides 3 Chapter 3

Outline PMF, CDF and PDF Mean, Variance and Percentiles Some Common Distributions. Week 5 Random Variables and Their Distributions

Example A. Define X = number of heads in ten tosses of a coin. What are the values that X may assume?

Part 3: Parametric Models

Probability Density Functions and the Normal Distribution. Quantitative Understanding in Biology, 1.2

Discrete Random Variables

Name: Firas Rassoul-Agha

Discrete random variables and probability distributions

Fault-Tolerant Computer System Design ECE 60872/CS 590. Topic 2: Discrete Distributions

Probability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008

Common Discrete Distributions

Statistics for Economists. Lectures 3 & 4

Things to remember when learning probability distributions:

Probability and Probability Distributions. Dr. Mohammed Alahmed

Slides 8: Statistical Models in Simulation

Probability Distributions Columns (a) through (d)

Lecture 2. Distributions and Random Variables

EE/CpE 345. Modeling and Simulation. Fall Class 5 September 30, 2002

To find the median, find the 40 th quartile and the 70 th quartile (which are easily found at y=1 and y=2, respectively). Then we interpolate:

Math/Stat 352 Lecture 8

Chapter 4 Continuous Random Variables and Probability Distributions

Definition: A random variable X is a real valued function that maps a sample space S into the space of real numbers R. X : S R

Applied Statistics I

CS 237: Probability in Computing

Lecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019

Discrete Random Variables (cont.) Discrete Distributions the Geometric pmf

Discrete Probability Distributions

Chapter 2: Discrete Distributions. 2.1 Random Variables of the Discrete Type

Continuous random variables

MATH : EXAM 2 INFO/LOGISTICS/ADVICE

Chapter 4: Continuous Probability Distributions

Computer Science, Informatik 4 Communication and Distributed Systems. Simulation. Discrete-Event System Simulation. Dr.

Chapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.

Lecture 2: Repetition of probability theory and statistics

RVs and their probability distributions

Basics on Probability. Jingrui He 09/11/2007

CMPSCI 240: Reasoning Under Uncertainty

Chapter 1 Statistical Reasoning Why statistics? Section 1.1 Basics of Probability Theory

Probability. Machine Learning and Pattern Recognition. Chris Williams. School of Informatics, University of Edinburgh. August 2014

Discrete probability distributions

Brief Review of Probability

ELEG 3143 Probability & Stochastic Process Ch. 1 Probability

Statistics and Econometrics I

STAT509: Continuous Random Variable

DS-GA 1002 Lecture notes 2 Fall Random variables

Example. What is the sample space for flipping a fair coin? Rolling a 6-sided die? Find the event E where E = {x x has exactly one head}

Chapter 3. Discrete Random Variables and Their Probability Distributions

CS 361: Probability & Statistics

Chapter 4: Continuous Random Variable

The random variable 1

Counting principles, including permutations and combinations.

Northwestern University Department of Electrical Engineering and Computer Science

57:022 Principles of Design II Final Exam Solutions - Spring 1997

Review of Probability. CS1538: Introduction to Simulations

Mathematical Statistics 1 Math A 6330

Probability, Random Processes and Inference

Continuous Random Variables and Probability Distributions

Probabilistic Systems Analysis Spring 2018 Lecture 6. Random Variables: Probability Mass Function and Expectation

Chapter 5. Statistical Models in Simulations 5.1. Prof. Dr. Mesut Güneş Ch. 5 Statistical Models in Simulations

15 Discrete Distributions

Part IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015

STAT 430/510 Probability Lecture 12: Central Limit Theorem and Exponential Distribution

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES

Special distributions

Probability Midterm Exam 2:15-3:30 pm Thursday, 21 October 1999

n px p x (1 p) n x. p x n(n 1)... (n x + 1) x!

Part (A): Review of Probability [Statistics I revision]

INF FALL NATURAL LANGUAGE PROCESSING. Jan Tore Lønning

Random variables, Expectation, Mean and Variance. Slides are adapted from STAT414 course at PennState

Notes Week 2 Chapter 3 Probability WEEK 2 page 1

IE 303 Discrete-Event Simulation

Advanced Herd Management Probabilities and distributions

Distributions of Functions of Random Variables. 5.1 Functions of One Random Variable

Probability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.

Transcription:

3 Probability Distributions (Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)

Probability Distribution Functions Probability distribution function (pdf): Function for mapping random variables to real numbers. Discrete random variable: Values constitute a finite or countably infinite set. Continuous random variable: Set of possible values is the set of real numbers R, one interval, or a disjoint union of intervals on the real line. 2

Random Variables Notation! 1. Random variables - usually denoted by uppercase letters near the end of our alphabet (e.g. X, Y). 2. Particular value - now use lowercase letters, such as x, which correspond to the r.v. X. 3

Properties of PDFs For f(x) to be a legitimate pdf, it must satisfy the following two conditions: 1. f(x) ³ 0 for all x. &''()( +! " = $ = 1 2. for discrete distributions., $ -$ = 1 for continuous distributions. &''()( + 4

Discrete Random Variables 5

PDFs for Discrete RVs The pdf of a discrete r.v. X describes how the total probability is distributed among all the possible range values of the r.v. X: f(x) = p(x=x), for each value x in the range of X 6

Example A lab has 6 computers. Let X denote the number of these computers that are in use during lunch hour -- {0, 1, 2 6}. Suppose that the probability distribution of X is as given in the following table: 7

Example From here, we can find many things: 1. Probability that at most 2 computers are in use 2. Probability that at least half of the computers are in use 3. Probability that there are 3 or 4 computers free 8

Bernoulli Distribution Bernoulli random variable: Any random variable whose only possible values are 0 or 1. This is a discrete random variable why? This distribution is specified with a single parameter: P(X = x) = π x (1- π) (1-x) ;; x = 0, 1 9

Bernoulli Distribution Bernoulli random variable: Any random variable whose only possible values are 0 or 1. This is a discrete random variable why? This distribution is specified with a single parameter: P(X = x) = π x (1- π) (1-x) ;; x = 0, 1 Examples? 10

Geometric Distribution A patient is waiting for a suitable matching kidney donor for a transplant. The probability that a randomly selected donor is a suitable match is 0.1. What is the probability the first donor tested is the first matching donor? Second? Third? 11

Geometric Distribution Continuing in this way, a general formula for the pmf emerges:! " = $ = (1 () * (;,,,,,,$ = 0,1,2,., The parameter π can assume any value between 0 and 1. Depending on what parameter π is, we get different members of the geometric distribution. NOTATION: We write X ~ G(π) to indicate that X is a geometric rv with success probability π. 12

Binomial Distribution The Binomial r.v. counts the total number of successes out of n trials, where X is the number of successes. Each trial must be independent of the previous experiment. The probability of success must be the same for each trial. 13

Binomial Distribution Example: A dice is tossed four times. A success is defined as rolling a 1 or a 6. The probability of success is 1/3. What is P(X = 2)? What is P(X = 3)? 14

Binomial Distribution Example: A dice is tossed four times. A success is defined as rolling a 1 or a 6. The probability of success is 1/3. What is P(X = 2)? What is P(X = 3)? Let s use the probabilities we calculated above to derive the binomial pdf. 15

Binomial Distribution Example: A dice is tossed four times. A success is defined as rolling a 1 or a 6. The probability of success is 1/3. What is P(X = 2)? What is P(X = 3)? Let s use the probabilities we calculated above to derive the binomial pdf. NOTATION: We write X ~ Bin(n, π) to indicate that X is a binomial rv based on n Bernoulli trials with success probability π. 16

The Negative Binomial Distribution Consider the dice example for the binomial distribution. Now we instead want to find the probability that we roll 3 failures (i.e. a 2, 3, 4, or 5) before the 2 nd success. How is this related to the binomial distribution? 17

The Negative Binomial Distribution Consider the dice example for the binomial distribution. What is the probability that exactly 3 successes occur before 2 failures occur? NOTATION: We write X ~ NB(r, π) to indicate that X is a negative binomial r.v., with x failures occurring before r successes, where the probability of success is equal to π. 18

The Poisson Probability Distribution A Poisson r.v. describes the total number of events that happen in a certain time period. Examples: - # of vehicles arriving at a parking lot in one week - # of gamma rays hitting a satellite per hour - # of cookies sold at a bake sale in 1 hour 19

The Poisson Probability Distribution A Poisson r.v. describes the total number of events that happen in a certain time period. A discrete random variable X is said to have a Poisson distribution with parameter λ (λ > 0) if the pdf of X is! " = $ = % &' ( )* ; %%%%%%%$ = 0, 1, 2,. $! NOTATION: We write X ~ P(λ) to indicate that X is a Poisson r.v. with parameter λ. 20

Example Let X denote the number of mosquitoes captured in a trap during a given time period. Suppose that X has a Poisson distribution with λ = 4.5. What is the probability that the trap contains 5 mosquitoes? 21

Example problem (classwork) A factory makes parts for a medical device company. 6% of those parts are defective. For each one of the problems below: (i) Define an appropriate random variable for the experiment. (ii) Give the values that the random variable can take on. (iii) Find the probability that the random variable equals 2. (iv) State any assumptions you need to make. 1. Out of 10 parts, the number that are defective. 2. Finding a number of non-defective parts before finding 4 defective parts. 3. The number of parts you inspect until you get the first defective one. 4. The average number of defective parts per day is 10. 22

Cumulative Distribution Functions Definition: The cumulative distribution function (cdf) is denoted with F(x). For a discrete r.v. X with pdf f(x) = P(X = x), F(x) is defined for every real number x by! " = $% &$ " = $ %(& = )) +:+$-. For any number x, the cdf F(x) is the probability that the observed value of X will be at most x. 23

Example Suppose we are given the following pmf: Then, calculate: F(0), F(1), F(2) What about F(1.5)? F(20.5)? Is P(X < 1) = P(X <= 1)? 24

Continuous Random Variables 25

Continuous Random Variables A random variable X is continuous if possible values comprise either a single interval on the number line or a union of disjoint intervals. Example: If in the study of the ecology of a lake, X, the r.v. may be depth measurements at randomly chosen locations. 26

Cumulative Distribution Functions Definition: The cumulative distribution function (cdf) is denoted with F(x). For a discrete r.v. X with pdf f(x), F(x) is defined for every real number x by!" # = " % & '& (:("*+ 27

Cumulative Distribution Functions Definition: The cumulative distribution function (cdf) is denoted with F(x). For a discrete r.v. X with pdf f(x), F(x) is defined for every real number x by!" # = " % & '& (:("*+ This is illustrated below, where F(x) increases smoothly as x increases. A pdf and associated cdf 28

PDFs for Continuous RVs The probability that X takes on a value in the interval [a, b] is the area above this interval and under the graph of the density function: P(a X b) = the area under the density curve between a and b 29

Example Consider the reference line connecting the valve stem on a tire to the center point. Let X be the angle measured clockwise to the location of an imperfection. The pdf for X is 30

Example cont d The pdf is shown graphically below: The pdf and probability from example on previous slide. 31

Example cont d Clearly f(x) ³ 0. How can we show that the area of this pdf is equal to 1? How do we calculate P(90 <= X <= 180)? What is the probability that the angle of occurrence is within 90 of the reference line? (The reference line is at 0 degrees.) 32

Uniform Distribution The previous problem was an example of the uniform distribution. Definition: A continuous rv X is said to have a uniform distribution on the interval [a, b] if the pdf of X is! "; $, & = ( 1,((((($( "( & & $ 33

Uniform Distribution The previous problem was an example of the uniform distribution. Definition: A continuous rv X is said to have a uniform distribution on the interval [a, b] if the pdf of X is! "; $, & = ( 1,((((($( "( & & $ NOTATION: We write X ~ U(a, b) to indicate that X is a uniform rv with a lower bound equal to a and an upper bound equal to b. 34

Exponential Distribution The family of exponential distributions provides probability models that are very widely used in engineering and science disciplines to describe time-to-event data. Examples? 35

Exponential Distribution The family of exponential distributions provides probability models that are very widely used in engineering and science disciplines to describe time-to-event data. Definition: X is said to have an exponential distribution with the rate parameter l (l > 0) if the pdf of X is 36

Exponential Distribution The family of exponential distributions provides probability models that are very widely used in engineering and science disciplines to describe time-to-event data. Definition: X is said to have an exponential distribution with the rate parameter l (l > 0) if the pdf of X is NOTATION: We write X ~ Exp(l ) to indicate that X is an Exponential r.v. with parameter l. 37

Exponential Distribution The family of exponential distributions provides probability models that are very widely used in engineering and science disciplines to describe time-to-event data. A partial reason for the popularity of such applications is the memoryless property of the Exponential distribution. 38

The Exponential Distributions Suppose a light bulb s lifetime is exponentially distributed with parameter l. What is the probability that the lifetime of the light bulb lasts less than t hours? What is the probability that the lifetime of the light bulb lasts more than t hours? 39

The Exponential Distributions Suppose a light bulb s lifetime is exponentially distributed with parameter l. Now say you turn the light bulb on and then leave. You come back after t 0 hours to find it still on. What is the probability that the light bulb will last for at least additional t hours? In symbols, we are looking for P(X ³ t + t 0 X ³ t 0 ). How would we calculate this? 40

The Weibull Distribution The Weibull distribution is used similarly to the exponential distribution to model times to an event, but with an extra parameter included for flexibility. 41

The Weibull Distribution The Weibull distribution is used similarly to the exponential distribution to model times to an event, but with an extra parameter included for flexibility. Definition A random variable X is said to have a Weibull distribution with parameters a and b (a > 0, b > 0) if the pdf of X is! "; $%, ' = $%' )* " *)+, )(. / )1,$$$$$$$$$$$$"$ 0 42

The Weibull Distribution The Weibull distribution is used similarly to the exponential distribution to model times to an event, but with an extra parameter included for flexibility. Definition A random variable X is said to have a Weibull distribution with parameters a and b (a > 0, b > 0) if the pdf of X is! "; $%, ' = $%' )* " *)+, )(. / )1,$$$$$$$$$$$$"$ 0 What is this distribution if alpha = 1? 43

The Weibull Distribution Both a and b can be varied to obtain a number of differentlooking density curves, as illustrated below. Weibull density curves 44

The Beta Distribution So far, all families of continuous distributions (except for the uniform distribution) had positive density over an infinite interval. The beta distribution provides positive density only for X in an interval from 0 to 1. The beta distribution is commonly used to model variation in the proportion or percentage of a quantity occurring in different samples. 45

The Beta Distribution Definition A random variable X is said to have a beta distribution with parameters a, b (both positive), if the pdf of X is:! "; $%, ' = $ Γ(% + ') Γ(%)Γ(') $"-./ (1 ") 2./ ; $0$ "$ 1 46

Example The distribution of the amount of gravel (in tons) sold by a particular construction supply company in a given week is a continuous rv X with pdf What is the cdf of sales for any x? How do you use this to find the probability that X is less than.25? What about the probability that X is greater than.75? What about P(.25 < X <.75)? 47

Percentiles of a Distribution Definition The median of a continuous distribution is the 50th percentile of the distribution. How can we express this in terms of F(x)? 48

Example X is a r.v. such that:! " = $ 1 2 " + 1,$$$$$$$$$ 1 < " < 1 Calculate F(x). What is the 0.375 th percentile of this distribution? What is the median of this distribution? 49

Example You flip and unfair coin four times, where the probability of flipping a head is 60%. What is the median number of heads for this distribution? 50