Probability Distributions for Discrete RV

Similar documents
Applied Statistics I

Conditional Probability

Discrete random variables and probability distributions

Mathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2

Lecture 3: Random variables, distributions, and transformations

Discrete Probability Distribution

Outline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks

Events A and B are said to be independent if the occurrence of A does not affect the probability of B.

The Bernoulli distribution has only two outcomes, Y, success or failure, with values one or zero. The probability of success is p.

MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES

What is Probability? Probability. Sample Spaces and Events. Simple Event

What is a random variable

Lecture 6 Random Variable. Compose of procedure & observation. From observation, we get outcomes

Deep Learning for Computer Vision

Bayes Rule for probability

SDS 321: Introduction to Probability and Statistics

More on Distribution Function

2. Conditional Probability

STAT/MA 416 Answers Homework 4 September 27, 2007 Solutions by Mark Daniel Ward PROBLEMS

27 Binary Arithmetic: An Application to Programming

Notation: X = random variable; x = particular value; P(X = x) denotes probability that X equals the value x.

Conditional Probability

Expected Value 7/7/2006


Quantitative Methods for Decision Making

(i) Given that a student is female, what is the probability of having a GPA of at least 3.0?

Probability (10A) Young Won Lim 6/12/17

Lecture 1 : The Mathematical Theory of Probability

Probability. VCE Maths Methods - Unit 2 - Probability

Lecture Lecture 5

Chapter 3: Random Variables 1

Outline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks

Probability Pearson Education, Inc. Slide

Joint Distribution of Two or More Random Variables

V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE

PERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY

Part (A): Review of Probability [Statistics I revision]

Probability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)

Chapter 1 Probability Theory

Statistics Statistical Process Control & Control Charting

IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS LECTURE 3-RANDOM VARIABLES

Random Variables. Statistics 110. Summer Copyright c 2006 by Mark E. Irwin

p. 4-1 Random Variables

Introduction Probability. Math 141. Introduction to Probability and Statistics. Albyn Jones

Introduction to Probability and Statistics Slides 3 Chapter 3

6.2 Introduction to Probability. The Deal. Possible outcomes: STAT1010 Intro to probability. Definitions. Terms: What are the chances of?

Why should you care?? Intellectual curiosity. Gambling. Mathematically the same as the ESP decision problem we discussed in Week 4.

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

Steve Smith Tuition: Maths Notes

Probability theory. References:

Homework 4 Solution, due July 23

CLASS 6 July 16, 2015 STT

Chapter 4: Probability and Probability Distributions

Expected Value. Lecture A Tiefenbruck MWF 9-9:50am Center 212 Lecture B Jones MWF 2-2:50pm Center 214 Lecture C Tiefenbruck MWF 11-11:50am Center 212

STAT 430/510 Probability

Discrete Random Variable

Probability and Statisitcs

First Digit Tally Marks Final Count

Lecture 2. Constructing Probability Spaces

9/6/2016. Section 5.1 Probability. Equally Likely Model. The Division Rule: P(A)=#(A)/#(S) Some Popular Randomizers.

STAT 430/510 Probability Lecture 7: Random Variable and Expectation

CS206 Review Sheet 3 October 24, 2018

Probability, Random Processes and Inference

n How to represent uncertainty in knowledge? n Which action to choose under uncertainty? q Assume the car does not have a flat tire

Chapter 3: Random Variables 1

Definition A random variable X is said to have a Weibull distribution with parameters α and β (α > 0, β > 0) if the pdf of X is

ELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities

Chapter 2: The Random Variable

2. In a clinical trial of certain new treatment, we may be interested in the proportion of patients cured.

10 th CBSE (SESSION : ) SUBJECT : MATHS SUMMATIVE ASSESSMENT-II SOLUTION _SET-1_CODE NO. 30/1

Thus, P(F or L) = P(F) + P(L) - P(F & L) = = 0.553

Uncertainty. Russell & Norvig Chapter 13.

Sec$on Summary. Assigning Probabilities Probabilities of Complements and Unions of Events Conditional Probability

PROBABILITY CHAPTER LEARNING OBJECTIVES UNIT OVERVIEW

CS 361: Probability & Statistics

Stochastic processes Lecture 1: Multiple Random Variables Ch. 5

Probability: Terminology and Examples Class 2, Jeremy Orloff and Jonathan Bloom

Discrete Probability Distributions

Chapter 4: Probability and Probability Distributions

Probabilistic models

STA 2023 EXAM-2 Practice Problems From Chapters 4, 5, & Partly 6. With SOLUTIONS

324 Stat Lecture Notes (1) Probability

STAT509: Discrete Random Variable

Lecture 3 - Axioms of Probability

LECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD

CISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability. Outline. Terminology and background. Arthur G.

DISCRETE RANDOM VARIABLES: PMF s & CDF s [DEVORE 3.2]

Stochastic processes and Data mining

4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space

4th IIA-Penn State Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur

Conditional Probability and Bayes Theorem (2.4) Independence (2.5)

3.5. First step analysis

STA 2023 EXAM-2 Practice Problems. Ven Mudunuru. From Chapters 4, 5, & Partly 6. With SOLUTIONS

Discrete Random Variables (1) Solutions

Example A. Define X = number of heads in ten tosses of a coin. What are the values that X may assume?

NLP: Probability. 1 Basics. Dan Garrette December 27, E : event space (sample space)

Formal Modeling in Cognitive Science Lecture 19: Application of Bayes Theorem; Discrete Random Variables; Distributions. Background.

Formal Modeling in Cognitive Science

Chapter 3 Questions. Question 3.1. Based on the nature of values that each random variable can take, we can have the following classifications:

Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability

Transcription:

An example: Assume we toss a coin 3 times and record the outcomes. Let X i be a random variable defined by { 1, if the i th outcome is Head; X i = 0, if the i th outcome is Tail; Let X be the random variable such that X = X 1 + X 2 + X 3, then X represents the total number of Heads we could get from the experiment. If the probability for getting a Head for each toss is 0.7, then the probabilities for all the outcomes are tabulated as following: s HHH HHT HTH HTT THH THT TTH TTT x 3 2 2 1 2 1 1 0 p(x) 0.343 0.147 0.147 0.063 0.147 0.063 0.063 0.027 Liang Zhang (UofU) Applied Statistics I June 17, 2008 1 / 17

Example continued: s HHH HHT HTH HTT THH THT TTH TTT x 3 2 2 1 2 1 1 0 p(x) 0.343 0.147 0.147 0.063 0.147 0.063 0.063 0.027 We can re-tabulate it only for the x values: x 0 1 2 3 p(x) 0.027 0.189 0.441 0.343 Now we can answer various questions. The probability that there are at most 2 Heads is P(X 2) = P(x = 0 or 1 or 2) = p(0) + p(1) + p(2) = 0.657 The probability that the number of Heads are is strictly between 1 and 3 is P(1 < X < 3) = P(X = 2) = p(2) = 0.441 Liang Zhang (UofU) Applied Statistics I June 17, 2008 2 / 17

Definition The probability distribution or probability mass function (pmf) of a discrete rv is defined for every number x by p(x) = P(X = x) = P(all s S : X (s) = x). In words, for every possible value x of the random variable, the pmf specifies the probability of observing that value when the experiment is performed. (The conditions p(x) 0 and all possible x p(x) = 1 are required for any pmf.) Liang Zhang (UofU) Applied Statistics I June 17, 2008 3 / 17

Example 3.8 Six lots of components are ready to be shipped by a certain supplier. The number of defective components in each lot is as follows: Lot 1 2 3 4 5 6 Number of defectives 0 2 0 1 2 0 One of these lots is to be randomly selected for shipment to a particular customer. Let X be the number of defectives in the selected lot. The three possible X values are 0, 1 and 2. The pmf for X is p(0) = P(X = 0) = P(lot 1 or 3 or 6 is selected) = 3 6 = 0.500 p(1) = P(X = 1) = P(lot 4 is selected) = 1 6 = 0.167 p(2) = P(X = 2) = P(lot 2 or 5 is selected) = 2 6 = 0.333 Liang Zhang (UofU) Applied Statistics I June 17, 2008 4 / 17

Example 3.10: Consider a group of five potential blood donors a, b, c, d, and e of whom only a and b have type O+ blood. Five blood smaples, one from each individual, will be typed in random order until an O+ individual is identified. Let the rv Y = the number of typings necessary to identify an O+ individual. Then what is the pmf of Y? Liang Zhang (UofU) Applied Statistics I June 17, 2008 5 / 17

Example: Consider whether the next customer coming to a certain gas station buys gasoline or diesel. Let { 1, if the customer purchases gasoline X = 0, if the customer purchases diesel If 30% of all customers in one month purchase diesel, then the pmf for X is p(0) = P(X = 0) = P(nextcustomerbuysdiesel) = 0.3 p(1) = P(X = 1) = P(nextcustomerbuysgasoline) = 0.7 p(x) = P(X = x) = 0 for x 0 or 1 Liang Zhang (UofU) Applied Statistics I June 17, 2008 6 / 17

Example: Consider whether the next customer coming to a certain gas station buys gasoline or diesel. Let { 1, if the customer purchases gasoline X = 0, if the customer purchases diesel If 100α% of all customers in one month purchase diesel, then the pmf for X is p(0) = P(X = 0) = P(nextcustomerbuysdiesel) = α p(1) = P(X = 1) = P(nextcustomerbuysgasoline) = 1 α p(x) = P(X = x) = 0 for x 0 or 1 here α is between 0 and 1. Liang Zhang (UofU) Applied Statistics I June 17, 2008 7 / 17

Definition Suppose p(x) depends on a quantity that can be assigned any one of a number of possible values, with each different value determining a different probability distribution. Such a quantity is called a parameter of the distribution. The collection of all probability distributions for different values of the parameter is called a family of probability distribution. For the previous example, the quantity α is a parameter. Each different value of α between 0 and 1 determines a different member of a family of distributions; two such members are 0.3 if x = 0 p(x) = 0.7 if x = 1 0 otherwise 0.25 if x = 0 p(x) = 0.75 if x = 1 0 otherwise Liang Zhang (UofU) Applied Statistics I June 17, 2008 8 / 17

Example: Assume we are drawing cards from a 100 well-shuffled cards with replacement. We keep drawing until we get a. Let p = P({ }), i.e. there are 100 p s. Assume the successive drawings are independent and define X = the number of drawings. Then p(1) = P(X = 1) = P({ }) = p p(2) = P(X = 2) = P({ }) = (1 p) p p(3) = P(X = 3) = P({ }) = (1 p) (1 p) p... A general formula would be { (1 p) x 1 p x = 1, 2, 3,... p(x) = 0 otherwise Liang Zhang (UofU) Applied Statistics I June 17, 2008 9 / 17

Example: Assume we are drawing cards from a 100 well-shuffled cards with replacement. We keep drawing until we get a. Let p = P({ }), i.e. there are 100 p s. Assume the successive drawings are independent and define X = the number of drawings. If we know that there are 20 s, i.e. p = 0.2, then what is the probability for us to draw at most 3 times? More than 2 times? P(X 3) = p(1) + p(2) + p(3) = 0.2 + 0.2 0.8 + 0.2 (0.8) 2 = 0.488 P(X > 2) = p(3)+p(4)+p(5)+ = 1 p(1) p(2) = 1 0.2 0.2 0.8 = 0.64 Liang Zhang (UofU) Applied Statistics I June 17, 2008 10 / 17

Definition The cumulative distribution function (cdf) F (x) of a discrete rv X with pmf p(x) is defined for every number x by F (x) = P(X x) = y:y x p(y) For any number x, F(x) is the probability that the observed value of X will be at most x. F (x) = P(X x) = P(X is less than or equal to x) p(x) = P(X = x) = P(X is exactly equal to x) Liang Zhang (UofU) Applied Statistics I June 17, 2008 11 / 17

Example 3.10 (continued): 0 if y < 1 0.4 if 1 y < 2 F (y) = 0.7 if 2 y < 3 0.9 if 3 y < 4 1 if y 2 Liang Zhang (UofU) Applied Statistics I June 17, 2008 12 / 17

Example: Assume we are drawing cards from a 100 well-shuffled cards with replacement. We keep drawing until we get a. Let α = P({ }), i.e. there are 100 α s. Assume the successive drawings are independent and define X = the number of drawings. The pmf would be { (1 α) x 1 α x = 1, 2, 3,... p(x) = 0 otherwise Then for any positive interger x, we have F (x) = y x p(y) = = x x 1 (1 α) (y 1) α = α (1 α) y y=1 { 1 (1 α) x x 1 0 x < 1 y=0 Liang Zhang (UofU) Applied Statistics I June 17, 2008 13 / 17

Example: Assume we are drawing cards from a 100 well-shuffled cards with replacement. We keep drawing until we get a. Let α = P({ }), i.e. there are 100 α s. Assume the successive drawings are independent and define X = the number of drawings. The pmf would be Liang Zhang (UofU) Applied Statistics I June 17, 2008 14 / 17

pmf = cdf: It is also possible cdf = pmf: F (x) = P(X x) = y:y x p(x) = F (x) F (x ) p(y) where x represents the largest possible X value that is strictly less than x. Liang Zhang (UofU) Applied Statistics I June 17, 2008 15 / 17

Proposition For any two numbers a and b with a b, P(a X b) = F (b) F (a ) where a represents the largest possible X value that is strictly less than a. In particular, if the only possible values are integers and if a and b are integers, then P(a X b) = P(X = a or a + 1 or... or b) = F (b) F (a 1) Taking a = b yields P(X = a) = F (a) F (a 1) in this case. Liang Zhang (UofU) Applied Statistics I June 17, 2008 16 / 17

Example (Problem 23): A consumer organization that evaluates new automobiles customarily reports the number of major defects in each car examined. Let X denote the number of major defects in a randomly selected car of a certain type. The cdf of X is as follows: 0 x < 0 0.06 0 x < 1 0.19 1 x < 2 0.39 2 x < 3 F (x) = 0.67 3 x < 4 0.92 4 x < 5 0.97 5 x < 6 1 x 6 Calculate the following probabilities directly from the cdf: (a)p(2), (b)p(x > 3) and (c)p(2 X < 5). Liang Zhang (UofU) Applied Statistics I June 17, 2008 17 / 17