What is the probability of getting a heads when flipping a coin
|
|
- Ursula Doreen Haynes
- 5 years ago
- Views:
Transcription
1 Chapter 2 Probability Probability theory is a branch of mathematics dealing with chance phenomena. The origins of the subject date back to the Italian mathematician Cardano about 1550, and French mathematicians Pascal and Fermat in The modern mathematical foundation for probability theory was laid down by Russian mathematician A. N. Kolmogorov ( ). Cardano ( ) was a passionate gambler. Around 1550, Cardano wrote a little book on Dice Game, in which he develops a theory of odds and probabilities. The two major results of the book are: The probability that one of two exclusive events occurs equals the sum of their probabilities The probability that two independent events occurs simultaneously equals the product of their probabilities The book appears more as a diary than as a book. The book was never published, actually Cardano kept it secret. since he was the sole person in the world having a notion of odds and the capacity of computing them, it gave him a significant advantage over his opponents, and a good reason to keep his findings secret. The book was first discovered more than hundred years after his death. But at that time the theory of probabilities had been rediscovered by Fermat ( ) and Pascal ( ). In this chapter, we will concentrate on ideas from probability that we need to go more deeply into statistics. Examples: How can gambling which depends on the unpredictable fall of dice and cards be a profitable business for a casino? If you buy a lottery ticket every day for many years, how much will each ticket win on the average? Give a test for the AIDS virus to the employees of a small company. What is the chance of at least one positive test even if all the employees are free of the virus? What is the probability of drawing an ace from an ordinary deck of 52 playing cards? What is the probability of getting a heads when flipping a coin 2.1 Sample Space and Events A statistic takes various values in each individual sample but there is nevertheless a regular distribution in a large number of repetitions. This is called a random phenomenon. Toss a coin 100 times, what is the proportion of heads? Figure 4.1, p.291 A random phenomenon has outcomes that we cannot predict but that have a regular distribution in repetitions 1-1
2 Basic concepts: Experiment refers to any process of observation or measurement that (i) can be repeated, theoretically, an infinite number of times; (ii) has a well-defined set of possible outcomes. Sample space denote by Ω or S: The set of all possible outcomes of an experiment Event: a subset of the sample space Example 1.1 Roll a pair of coins, one red and one blue, what is the sample space? S = {(H, H), (H, T), (T, H), (T, T)} Example 1.2 Describe the event B that the total number of points rolled with the pair of dice is 7 B = {(1, 6), (2, 5), (3, 4), (4, 3), (5, 2), (6, 1)} Let A and B be any two events defined over the sample space Ω (a) The intersection of A and B, denoted by A B, (A and B), is the event whose outcomes belong to both A and B (both A and B occur) (b) The union of A and B, denoted by A B, (A or B), is the event whose outcomes belong to either A or B (either A or B occurs) 1-2
3 Example 1.3 Ω = {1, 2,..., 6}. (a) A = {2, 3, 4}, B = {2, 4, 6}. Then (b) A = {1, 3, 5}, B = {2, 4, 6}. Then A B = {2, 4}, A B = {2, 3, 4, 6} A B = {1, 2, 3, 4, 5, 6}, A B = A and B are said to be mutually exclusive (disjoint) if they have no outcomes in common, that is, A B =, null set, emptyset The complement of A, denoted by A c or A, is the event consisting of all the outcomes in Ω other than those contained in A ( A does not occur) Remark: A and A c are disjoint, A A c = Ω De Morgan Law: (A B) c = A c B c (A B) c = A c B c 1-3
4 2.2 Counting Sample Points The Basic Principle of Counting If an operation consist of a sequence of k separate steps of which the first can be performed in n 1 ways, followed by the second n 2 ways, and so on until the kth can be performed in n k ways, then the operation consisting of k steps can be performed by n 1 n 2 n k ways. Example 1.4 Select 3 digits from 0, 1, 2, 3, 4, 5, and 6. (a) How many three-digit numbers can be formed? (b) How many of these are odd numbers? (c) How many are greater than 330? (a) The digit in the hundreds position can t be 0. The answer is = 180 (b) The digit in the units position is odd and the digit in the hundreds position is not zero. (c) = 75 Case I: The digit in the hundreds position is greater than = 90 Case II: The digit in the hundreds position is equal to 3, and the digit in the tens position is bigger than =
5 Example 1.5 In how many different ways can one answer all the questions of a true-false test consisting of 20 questions? 2 20 = 1, 048, Permutations A permutation is an arrangement of all or part of a set of objects. The number of permutations of n distinct objects is n! Example boys and 4 girls are to be seated in a row of chairs numbered 1 through 8. (a) How many total arrangements are possible? (b) If one boy and one girl want to sit together, how many arrangements are possible? (a) 8! = (b) 2! 7! = The number of permutations of the four letters a, b, c, d is 24, but what is the number of permutations if we take only two of the four letters or, as it is usually put, if we take the four letters two at a time? The number of permutations of n distinct objects taken r at a time is: np r = n! (n r)! Example 1.7 How many different letter arrangements can be formed using the letters PROB- ABILITY? 1-5
6 11!/(2!2!)=.. The number of distinct permutations of n objects, of which n 1 are of one kind, n 2 are of a second kind, n k are of a kth kind, and n 1 + n n k = n is n! n 1! n 2! n k! The number of permutations of n distinct objects arranged in a circle is (n 1)! 1-6
7 2.2.3 Combinations In many problems we are interested in the number of ways of selecting r objects from n without regard to order. These selections are called combinations. The number of combinations of n distinct objects taken r at a time is ( ) n n! = r r! (n r)! 0! = 1, ( ( n 1) = n, n 2) = n(n 1)/2 ( ) n The values are often called binomial coefficients r Example 1.8 From a group of 5 women and 7 men, how many different committees consisting of 2 women and 3 men can be formed? What if 2 of the men are feuding and refuse to serve on the committee together? The number of ways of selecting 2 women from 5 is ( ) 5 = 5! 2 2! 3! = 10. The number of ways selecting 3 men from 7 is ( ) 7 = 7! 3 3! 4! = 35. It follows from the basic principle that there are = 350 possible committees consisting of 2 women and 3 men. If 2 of the men refuse to serve on the committee together, then there are ( )( ) possible groups of 3 men not containing either of the 2 feuding men, and ( )( )
8 groups of 3 men containing exactly 1 of the feuding men. Hence, there are ( )( ) ( )( ) = ( ) 5 groups of 3 men not containing both of the feuding men. Since there are = 10 ways to 2 choose the 2 women, it follows that, in this case, there are = 300 possible committees. The number of ways of partitioning a set of n distinct objects into r distinct groups with n 1 elements in the first group, n 2 elements in the second, and so forth, is ( ) n n! = n 1, n 2,..., n r n 1! n 2! n r! where n 1 + n n r = n. 1-8
9 2.3 Probability Measure A Probability Measure on Ω is a function P from subsets of Ω to [0, 1] that satisfies the following axioms: (1) P (Ω) = 1 (2) For any event A, P (A) 0 (3) If A and B disjoint, then P (A B) = P (A) + P (B) More general, if A 1, A 2,..., A k are disjoint, then P (A 1 A 2 A k ) = P (A 1 ) + P (A 2 ) + + P (A k ) Probability (chance) of an event is the proportion of times the event occurs in a very long series of repetitions. Properties of Probability Measure Complement rule: P (A c ) = 1 P (A) P ( ) = 0 If A B, then P (A) P (B) For any two events A and B, P (A B) = P (A) + P (B) P (A B) 1-9
10 2.4 Assigning Probabilities Empirical Probability/ Relative Frequency If an experiment is repeated n times and an event A is observed f times, then its empirical probability of event A to happen is P (A) = f/n Subjective Probability - the probability assigned to an event based on subjective judgment, experience, information or belief Theoretical probability Assigning Probabilities: Finite number of outcomes Suppose that a sample space consists of a finite number of outcomes. Assign a probability to each individual outcome. These probabilities must be numbers between 0 and 1 and must have sum 1. Probability of an event is the sum of the probabilities of outcomes making up the event Example 1.1 All human blood can be typed as one of O, A, B, or AB. Here are the probabilities that the person you choose will have blood type O, A, or B Blood type O A B AB Probability ? What is the probability that the person chosen has either type O or type AB? P (T ypeab) = 1 ( ) = 0.06, P (T ypeo or T ypeab) = =
11 Example 1.9 An experiment has four possible outcomes, A, B, C, D, which are mutually exclusive. Explain why the following assignments of probabilities are not permissible. (a) P (A) =.12, P (B) =.63, P (C) =.45, P (D) =.2 (b) P (A) =.12, P (B) =.63, P (C) =.1, P (D) =.1 (c) P (A) =.12, P (B) =.63, P (C) =.1, P (D) = Assigning probabilities: equally likely outcomes If an experiment has k possible outcomes, all equally likely, then each individual outcome has probability 1 k P (A) = count of outcomes in A k Example 1.2 Toss a fair die. Let A be the event that an even number appears and B the event that number 3 or 5 occurs. Find P (A) and P (B). P (A) = 3/6 = 1/2, P (B) = 2/6 Example 1.3 Flip a fair coin 4 times. What is the probability that at least one heads occurs? P (at least one heads) = 1 (1/2) 4 = 15/16 Example 1.4 Powerball: select 5 numbers from 1 49, select 1 number from What is the chance you win the prize? 1-11
12 P (win) = ( )( 42 ) = , 179, 128 Some statisticians say you have a better chance of dying in a plane crash, being struck by a killer lightning bolt or suffering a fatal fall from your bed. Example 1.5 (Birthday problem). If n people are present in a room, what is the probability that at least two of them celebrate their birthday on the same day of the year? How large need n be so that this probability is greater than 1/2? As each person can celebrate his or her birthday on any one of 365 days, there is total of (365) n possible outcomes. Let A be the event that at least two of them celebrate their birthday on the same day. Then P (A) = 1 P (A ), where A is the event that no two of them celebrate their birthday on the same day. Noting that the number of points in A is (365 n + 1), we have P (A ) = = (365 n + 1) (365) n 365! (365) n (365 n)! and It is rather surprising that n P (A) n 1 365! P (A) = 1 (365) n (365 n)! = 1 (1 i 365 ) P (A) i=1 > 1/2 for n = for n = 50 > for n =
13 2.5 Conditional Probability In one of the earliest studies (1936) establishing a link between smoking and lung cancer, two British doctors reported that of 135 men afflicted with lung cancer, 122 or 90% were heavy smokers. In nontechnical language, the inference is clear. If you have lung cancer, it is much more likely the case than not that you are a heavy smoker. Is the converse true? If you are a heavy smoker, does it necessarily follow that your chances of developing lung cancer are much higher than for a non-smoker? Example 1.6 Smoking and Lung Cancer Smoking Lung cancer Yes No Total Yes No Total (a) If a person is smoking, what is the chance the person has a lung cancer? (b) If a person is not smoking, what is the chance the person has a lung cancer? P (Cancer Smoking) = 122/2122 = , P (cancer nosmoking) = 13/5013 = Example 1.10 Toss a die, it is known an even number occurs, what is the probability it is a 2? Definition 1.1 If A and B are any two events in a sample space Ω and P (A) > 0, the conditional probability of B given A is P (B A) = P (A B) P (A) Solve Examples?? and??. Example 1.11 Mr. Smith has two children. It is known that he has at least one boy, what is the probability that he has two boys? 1-13
14 Let A be the event that he has at least one boy, B be the event that he has 2 boys. P (B A) = P (A B) P (A) = P (A) P (B) = 1/4 3/4 = 1 3 Properties of the conditional probability P (B A) 0 P (Ω A) = 1 If B 1, B 2,... are disjoint, then P (B A) = 1 P (B c A) P ( B i A) = P (B i A) Think A as a new sample space, the conditional probability is a probability measure defined on the new reduced sample space. Example 1.12 Three cards are randomly selected, without replacement, from an ordinary deck of 52 playing cards. Compute the conditional probability that the third card selected is a spade, given that the first and second cards are spades. Solution 1: Let A 3 be the event that the first card selected is a spade, and A 1,2 the event that the second and third cards are spades. Given A 1,2, imaging that we put aside the two spades, there are only 50 outcomes in the reduced sample space, and there are 11 spades left. Therefore, the probability of A 3, given A 1,2, equals 11/50. 1 Solution 2: P (A 3 A 1,2 ) = P (A 1,2A 3 P (A 1,2 ) = = /
15 Example 1.7 The probability that a regularly scheduled flight departs on time is P (D) = 0.83; the probability that it arrives on time is P (A) = 0.82; and the probability that it departs and arrives on time is P (D A) = Find the probability that a plane (a) arrives on time given that it departed on time, (b) departed on time given that it has arrived on time. (a) P (A D) = 0.78/0.83 = 0.94, (b) P (D A) = 0.78/0.82 = 0.95 The Multiplication Rule: P (AB) = P (A)P (B A) = P (B)P (A B) P (A 1 A 2 A n ) provided P (A 1 A n 1 ) > 0. = P (A 1 )P (A 2 A 1 )P (A 3 A 1 A 2 ) P (A n A 1 A n 1 ) Example 1.8 Select 5 cards randomly from a poker deck of 52 cards. What is the probability of (a) a full house (i.e., three cards of one denomination and two of another)? (b) pair? (c) a straight (i.e., having consecutive denominations but not all in the same suit)? (a) (b) ( 13 )( 4 )( 12 )( ( 52 )( 5 12 ( 13 1 )( 4 2 ) ) = ) )( )( 1)( 1 ( 52 ) = (c) 10 ( 4 5 1) 40 ) = (
16 Example 1.13 An urn initially contains 5 white and 7 black balls. Each time a ball is selected, its color is noted and it is replaced in the urn along with 2 other balls of the same color. Compute the probability that (a) the first 2 balls selected are black and the next 2 white; (b) of the first 4 balls selected, exactly 2 are black. Let W i be the event that the i th ball selected is white, and B i the event that the i th ball selected is black. (a) By the multiplication rule, P (B 1 B 2 W 3 W 4 ) = P (B 1 )P (B 2 B 1 )P (W 3 B 1 B 2 )P (W 4 B 1 B 2 W 3 ) = 7 12 (b) The desired probability is = P (B 1 B 2 W 3 W 4 ) + P (B 1 W 2 B 3 W 4 ) + P (B 1 W 2 W 3 B 4 ) + P (W 1 B 2 B 3 W 4 ) + P (W 1 B 2 W 3 B 4 ) + P (W 1 W 2 B 3 B 4 ) = Example 1.14 A man has n keys on a key ring, only one of which can open the door to his apartment. He chooses a key at random and tries it. If it fails to open the door, he will discard it and choose at random one of the remaining n 1 keys, and so on. What is the probability that he opens the door with the k th key he tries? 1 n 1-16
17 Law of total probability Let B 1, B 2,..., B k be a partition of the sample space Ω, i.e., B 1, B 2,..., B k are mutually exclusive events such that k i=1b i = Ω. Then for any event A P (A) = k P (B i )P (A B i ) i=1 Bayes formula Let B 1, B 2,..., B k be a partition of the sample space Ω. Then for any event A P (B r A) = P (B r)p (A B r ) P (A) = P (B r)p (A B r ) k P (B i )P (A B i ) i=1 Remark: For any two events A and B, P (A) = P (B)P (A B) + P (B c )P (A B c ) and P (B A) = P (B)P (A B) P (B)P (A B) + P (B c )P (A B c ) Remarks. 1. The law of the total probability is useful in computing the probability of a composite event, that is, an event A which depends on a series of causes B 1, B 2,. The formula tells us how to compute P (A) when the probabilities of the causes B 1, B 2, and the conditional probabilities of the event A given the cause B i are known. 2. Bayes rule has been interpreted as a formula for inverse probabilities : If B 1, B 2, is a series of causes and A is a possible effect, then P (A B i ) is the probability of A when it is known that B i is the cause, whereas P (B r A) is the probability that B r is the cause when it is known that A is the effect. 1-17
18 Example 1.15 A cancer diagnostic test is 99% accurate if the person has the disease, it is 98% accurate if the person does not have the disease. If 0.2% of the population have the disease. (a) What is the probability that the test result is positive? (b) What is the probability that a tested person has cancer, given that his test result is positive? Let A the test result is positive, B the person has the disease (a) P (A) = P (B)P (A B) + P (B )P (A B ) = = (b) P (B A) = P (B)P (A B) P (A) = = Example 1.16 During a power blackout, 100 persons are arrested on suspicion of looting. Each is given a polygraph test. From past experience it is known that the polygraph is 90% reliable when administrated to a guilty suspect and 98% reliable when given to someone who is innocent. Suppose that of the 100 persons taken into custody, only 12 were actually involved in any wrongdoing. What is the probability that a given suspect is innocent given that the polygraph says he is guilty? Let A be the event that the polygraph says the person is guilty, B the person is innocent. P (A) = P (B)P (A B) + P (B )P (A B ) = =.1256 P (B)P (A B) P (B A) = = = = P (A) Example 1.9 Have you cheated on a test in the past year? 38 students are randomly selected for the survey. Each student is given a fair coin and asked to flip the coin and answer yes to the question if the coin was heads and answer truthfully to the question if the flip of the coin was tails, but the student doesn t show the outcome of the coin flip. Let P (yes) be the probability of yes response and P (cheat) the probability that a student has cheated on a test. Find the relation of P (yes) and P (cheat). Suppose that 24 students among the 38 gave a yes response, what is the estimation of P (cheat)? 1-18
19 P (yes) = P (Heads)P (Y es Heads) + P (tails)p (yes tails) = 1/2 + 1/2P (cheat), P (cheat) = 2P (yes) 1 (cheat) = 2(24/38) 1 = 10/38 =
20 2.6 Independent Events Example 1.17 Select 2 balls from an urn containing 6 white and 5 black balls. What is the conditional probability that the second ball is black given that the first ball is black? Without replacement, P (B 2 B 1 ) = 4/10, P (B 2 ) = 5/11 With replacement, P (B 2 B 1 ) = 5/11, P (B 2 ) = 5/11 Generally speaking, P (B A) is not equal to P (B). In other words, knowing that A has occurred generally changes the chances of B s occurrence. However, the above example shows that there are some special cases where P (B A) does in fact equal P (B). Definition 1.2 A and B are said to be independent if P (A B) = P (A)P (B) Two events A and B that are not independent are said to be dependent. Remarks: If A and B are independent, then P (B A) = P (B), P (A B) = P (A) Suppose P (A) > 0, P (B) > 0. If A and B are independent, then A and B can not be mutually exclusive. If A and B are mutually exclusive, then A and B can not be independent. The sample space Ω as well as the empty set is independent of any event. If A and B are independent, then so are A and B c, A c and B c. Definition 1.3 The events A 1, A 2,..., A n are called mutually independent (or simply independent) if for all combinations 1 i < j < k < n the multiplication rules P (A i A j ) = P (A i )P (A j ) (1) P (A i A j A k ) = P (A i )P (A j )P (A k ). P (A 1 A 2 A n ) = P (A 1 )P (A 2 ) P (A n ) hold. 1-20
21 There are total 2 n n 1 equations! A very useful property: Suppose A 1, A 2,..., A n are independent, and T is a subset of {1, 2,..., n}. If B is an event formed from {A i, i T }, and C is an event formed from {A i, i T }, then B and C are independent. Definition 1.4 Suppose that an experiment consists of performing a sequence of subexperiments. The subexperiments are said to be independent if the outcomes of any group of the subexperiments have no effect on the probabilities of the outcomes of the other subexperiments. If each subexperiment has the same subsample space and the same probability function on its events, then the subexperiments are called trials. If the subexperiments are independent, then outcomes of different subexperiments are independent. Example 1.18 Toss a coin 4 times. Assume P (Heads) = 2/3. Find the probabilities of getting (a) No heads, (b) one heads, (c) 2 heads, (d) 3 heads, (e) 4 heads, (a) (1/3) 4 (b) 4(2/3)(1/3) 3 (c) ( ) 4 2 (2/3) 2 (1/3) 2 (d) ( ) 4 3 (2/3) 3 (1/3) 1 (e) (2/3)
22 Example 1.19 Perform an infinite sequence of independent trials. In each trial, P (success) = p, P (failure) = 1 p, 0 < p < 1 What is the probability that exactly k successes occur in the first n trials? Let X = # of successes in the first n trials, A i = {success on the i th trial}, i 1 P (X = k) =? Note that P (a sequence contains k successes and n k failures) = p k (1 p) n k ( ) n and that there are such sequences (containing k successes and n k failures). We have k ( ) n P (X = k) = p k (1 p) n k k Example 1.20 The first recorded probabilistic problem (Luca Pacioli, 1494) Two men A and B are playing balla. Both have set 10 gold coins at stake, and the one who first wins 6 games gets the 20 gold coins at stake. However, at a point where A has won 5 games and B has won 3 games, the play is interrupted. Suppose that the two men are equally skillful, how should they divide the stake? Answers: Luca Pacioli (1494) 5 : 3 Niccolo Tartaglia (1556) 2 : 1 G.F. Peverone (1558) 6 : 1 Blaise Pascal (1654) 7 : 1 Which of these answers is correct? P (B wins) = (1/2) 3 = 1/8. P (A wins) = 7/8 1-22
Probabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationTopic 3: Introduction to Probability
Topic 3: Introduction to Probability 1 Contents 1. Introduction 2. Simple Definitions 3. Types of Probability 4. Theorems of Probability 5. Probabilities under conditions of statistically independent events
More informationProbability. Chapter 1 Probability. A Simple Example. Sample Space and Probability. Sample Space and Event. Sample Space (Two Dice) Probability
Probability Chapter 1 Probability 1.1 asic Concepts researcher claims that 10% of a large population have disease H. random sample of 100 people is taken from this population and examined. If 20 people
More information4. Probability of an event A for equally likely outcomes:
University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:
More informationProbability Experiments, Trials, Outcomes, Sample Spaces Example 1 Example 2
Probability Probability is the study of uncertain events or outcomes. Games of chance that involve rolling dice or dealing cards are one obvious area of application. However, probability models underlie
More informationBasic Statistics and Probability Chapter 3: Probability
Basic Statistics and Probability Chapter 3: Probability Events, Sample Spaces and Probability Unions and Intersections Complementary Events Additive Rule. Mutually Exclusive Events Conditional Probability
More information1 Probability Theory. 1.1 Introduction
1 Probability Theory Probability theory is used as a tool in statistics. It helps to evaluate the reliability of our conclusions about the population when we have only information about a sample. Probability
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationPROBABILITY.
PROBABILITY PROBABILITY(Basic Terminology) Random Experiment: If in each trial of an experiment conducted under identical conditions, the outcome is not unique, but may be any one of the possible outcomes,
More informationChapter 8 Sequences, Series, and Probability
Chapter 8 Sequences, Series, and Probability Overview 8.1 Sequences and Series 8.2 Arithmetic Sequences and Partial Sums 8.3 Geometric Sequences and Partial Sums 8.5 The Binomial Theorem 8.6 Counting Principles
More informationSenior Math Circles November 19, 2008 Probability II
University of Waterloo Faculty of Mathematics Centre for Education in Mathematics and Computing Senior Math Circles November 9, 2008 Probability II Probability Counting There are many situations where
More informationProbability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)
Chapter 14 From Randomness to Probability How to measure a likelihood of an event? How likely is it to answer correctly one out of two true-false questions on a quiz? Is it more, less, or equally likely
More informationP (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,
More information1 Combinatorial Analysis
ECE316 Notes-Winter 217: A. K. Khandani 1 1 Combinatorial Analysis 1.1 Introduction This chapter deals with finding effective methods for counting the number of ways that things can occur. In fact, many
More informationORF 245 Fundamentals of Statistics Chapter 5 Probability
ORF 245 Fundamentals of Statistics Chapter 5 Probability Robert Vanderbei Oct 2015 Slides last edited on October 14, 2015 http://www.princeton.edu/ rvdb Sample Spaces (aka Populations) and Events When
More informationCISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability. Outline. Terminology and background. Arthur G.
CISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability Arthur G. Werschulz Fordham University Department of Computer and Information Sciences Copyright Arthur G. Werschulz, 2017.
More informationGod doesn t play dice. - Albert Einstein
ECE 450 Lecture 1 God doesn t play dice. - Albert Einstein As far as the laws of mathematics refer to reality, they are not certain; as far as they are certain, they do not refer to reality. Lecture Overview
More information1 The Basic Counting Principles
1 The Basic Counting Principles The Multiplication Rule If an operation consists of k steps and the first step can be performed in n 1 ways, the second step can be performed in n ways [regardless of how
More informationChance, too, which seems to rush along with slack reins, is bridled and governed by law (Boethius, ).
Chapter 2 Probability Chance, too, which seems to rush along with slack reins, is bridled and governed by law (Boethius, 480-524). Blaise Pascal (1623-1662) Pierre de Fermat (1601-1665) Abraham de Moivre
More informationMath 140 Introductory Statistics
5. Models of Random Behavior Math 40 Introductory Statistics Professor Silvia Fernández Chapter 5 Based on the book Statistics in Action by A. Watkins, R. Scheaffer, and G. Cobb. Outcome: Result or answer
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More informationBinomial Probability. Permutations and Combinations. Review. History Note. Discuss Quizzes/Answer Questions. 9.0 Lesson Plan
9.0 Lesson Plan Discuss Quizzes/Answer Questions History Note Review Permutations and Combinations Binomial Probability 1 9.1 History Note Pascal and Fermat laid out the basic rules of probability in a
More informationMath 140 Introductory Statistics
Math 140 Introductory Statistics Professor Silvia Fernández Lecture 8 Based on the book Statistics in Action by A. Watkins, R. Scheaffer, and G. Cobb. 5.1 Models of Random Behavior Outcome: Result or answer
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationChapter Summary. 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance
Chapter 7 Chapter Summary 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance Section 7.1 Introduction Probability theory dates back to 1526 when the Italian
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More information2.6 Tools for Counting sample points
2.6 Tools for Counting sample points When the number of simple events in S is too large, manual enumeration of every sample point in S is tedious or even impossible. (Example) If S contains N equiprobable
More information1. When applied to an affected person, the test comes up positive in 90% of cases, and negative in 10% (these are called false negatives ).
CS 70 Discrete Mathematics for CS Spring 2006 Vazirani Lecture 8 Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According to clinical trials,
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationMAT2377. Ali Karimnezhad. Version September 9, Ali Karimnezhad
MAT2377 Ali Karimnezhad Version September 9, 2015 Ali Karimnezhad Comments These slides cover material from Chapter 1. In class, I may use a blackboard. I recommend reading these slides before you come
More informationMATH MW Elementary Probability Course Notes Part I: Models and Counting
MATH 2030 3.00MW Elementary Probability Course Notes Part I: Models and Counting Tom Salisbury salt@yorku.ca York University Winter 2010 Introduction [Jan 5] Probability: the mathematics used for Statistics
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter One Jesse Crawford Department of Mathematics Tarleton State University (Tarleton State University) Chapter One Notes 1 / 71 Outline 1 A Sketch of Probability and
More informationChapter 5 : Probability. Exercise Sheet. SHilal. 1 P a g e
1 P a g e experiment ( observing / measuring ) outcomes = results sample space = set of all outcomes events = subset of outcomes If we collect all outcomes we are forming a sample space If we collect some
More informationLectures Conditional Probability and Independence
Lectures 5 11 Conditional Probability and Independence Purpose: Calculate probabilities under restrictions, conditions or partial information on the random experiment. Break down complex probabilistic
More informationSTT When trying to evaluate the likelihood of random events we are using following wording.
Introduction to Chapter 2. Probability. When trying to evaluate the likelihood of random events we are using following wording. Provide your own corresponding examples. Subjective probability. An individual
More informationLecture notes for probability. Math 124
Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result
More informationProbability (Devore Chapter Two)
Probability (Devore Chapter Two) 1016-345-01: Probability and Statistics for Engineers Fall 2012 Contents 0 Administrata 2 0.1 Outline....................................... 3 1 Axiomatic Probability 3
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More information3.2 Probability Rules
3.2 Probability Rules The idea of probability rests on the fact that chance behavior is predictable in the long run. In the last section, we used simulation to imitate chance behavior. Do we always need
More informationChapter 6. Probability
Chapter 6 robability Suppose two six-sided die is rolled and they both land on sixes. Or a coin is flipped and it lands on heads. Or record the color of the next 20 cars to pass an intersection. These
More informationChapter 6: Probability The Study of Randomness
Chapter 6: Probability The Study of Randomness 6.1 The Idea of Probability 6.2 Probability Models 6.3 General Probability Rules 1 Simple Question: If tossing a coin, what is the probability of the coin
More informationChapter 1 Axioms of Probability. Wen-Guey Tzeng Computer Science Department National Chiao University
Chapter 1 Axioms of Probability Wen-Guey Tzeng Computer Science Department National Chiao University What is probability? A branch of mathematics that deals with calculating the likelihood of a given event
More information= 2 5 Note how we need to be somewhat careful with how we define the total number of outcomes in b) and d). We will return to this later.
PROBABILITY MATH CIRCLE (ADVANCED /27/203 The likelyhood of something (usually called an event happening is called the probability. Probability (informal: We can calculate probability using a ratio: want
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Probability assigns a likelihood to results of experiments that have not yet been conducted. Suppose that the experiment has
More informationHW2 Solutions, for MATH441, STAT461, STAT561, due September 9th
HW2 Solutions, for MATH44, STAT46, STAT56, due September 9th. You flip a coin until you get tails. Describe the sample space. How many points are in the sample space? The sample space consists of sequences
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationLecture 8: Probability
Lecture 8: Probability The idea of probability is well-known The flipping of a balanced coin can produce one of two outcomes: T (tail) and H (head) and the symmetry between the two outcomes means, of course,
More informationF71SM STATISTICAL METHODS
F71SM STATISTICAL METHODS RJG SUMMARY NOTES 2 PROBABILITY 2.1 Introduction A random experiment is an experiment which is repeatable under identical conditions, and for which, at each repetition, the outcome
More informationTOPIC 12 PROBABILITY SCHEMATIC DIAGRAM
TOPIC 12 PROBABILITY SCHEMATIC DIAGRAM Topic Concepts Degree of Importance References NCERT Book Vol. II Probability (i) Conditional Probability *** Article 1.2 and 1.2.1 Solved Examples 1 to 6 Q. Nos
More informationSTAT 201 Chapter 5. Probability
STAT 201 Chapter 5 Probability 1 2 Introduction to Probability Probability The way we quantify uncertainty. Subjective Probability A probability derived from an individual's personal judgment about whether
More informationHW MATH425/525 Lecture Notes 1
HW MATH425/525 Lecture Notes 1 Definition 4.1 If an experiment can be repeated under the same condition, its outcome cannot be predicted with certainty, and the collection of its every possible outcome
More informationIntermediate Math Circles November 8, 2017 Probability II
Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B
More informationToday we ll discuss ways to learn how to think about events that are influenced by chance.
Overview Today we ll discuss ways to learn how to think about events that are influenced by chance. Basic probability: cards, coins and dice Definitions and rules: mutually exclusive events and independent
More informationReview Basic Probability Concept
Economic Risk and Decision Analysis for Oil and Gas Industry CE81.9008 School of Engineering and Technology Asian Institute of Technology January Semester Presented by Dr. Thitisak Boonpramote Department
More informationLecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events
Lecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events Discrete Structures II (Summer 2018) Rutgers University Instructor: Abhishek
More informationProblems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman.
Math 224 Fall 2017 Homework 1 Drew Armstrong Problems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman. Section 1.1, Exercises 4,5,6,7,9,12. Solutions to Book Problems.
More informationConditional Probability (cont'd)
Conditional Probability (cont'd) April 26, 2006 Conditional Probability (cont'd) Midterm Problems In a ten-question true-false exam, nd the probability that a student get a grade of 70 percent or better
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More informationDiscrete Probability
Discrete Probability Mark Muldoon School of Mathematics, University of Manchester M05: Mathematical Methods, January 30, 2007 Discrete Probability - p. 1/38 Overview Mutually exclusive Independent More
More informationProbability and Probability Distributions. Dr. Mohammed Alahmed
Probability and Probability Distributions 1 Probability and Probability Distributions Usually we want to do more with data than just describing them! We might want to test certain specific inferences about
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationExample. What is the sample space for flipping a fair coin? Rolling a 6-sided die? Find the event E where E = {x x has exactly one head}
Chapter 7 Notes 1 (c) Epstein, 2013 CHAPTER 7: PROBABILITY 7.1: Experiments, Sample Spaces and Events Chapter 7 Notes 2 (c) Epstein, 2013 What is the sample space for flipping a fair coin three times?
More informationAnnouncements. Topics: To Do:
Announcements Topics: In the Probability and Statistics module: - Sections 1 + 2: Introduction to Stochastic Models - Section 3: Basics of Probability Theory - Section 4: Conditional Probability; Law of
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationConditional Probability
Chapter 3 Conditional Probability 3.1 Definition of conditional probability In spite of our misgivings, let us persist with the frequency definition of probability. Consider an experiment conducted N times
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationNotes. Combinatorics. Combinatorics II. Notes. Notes. Slides by Christopher M. Bourke Instructor: Berthe Y. Choueiry. Spring 2006
Combinatorics Slides by Christopher M. Bourke Instructor: Berthe Y. Choueiry Spring 2006 Computer Science & Engineering 235 Introduction to Discrete Mathematics Sections 4.1-4.6 & 6.5-6.6 of Rosen cse235@cse.unl.edu
More informationMATH 556: PROBABILITY PRIMER
MATH 6: PROBABILITY PRIMER 1 DEFINITIONS, TERMINOLOGY, NOTATION 1.1 EVENTS AND THE SAMPLE SPACE Definition 1.1 An experiment is a one-off or repeatable process or procedure for which (a there is a well-defined
More informationLecture 2: Probability. Readings: Sections Statistical Inference: drawing conclusions about the population based on a sample
Lecture 2: Probability Readings: Sections 5.1-5.3 1 Introduction Statistical Inference: drawing conclusions about the population based on a sample Parameter: a number that describes the population a fixed
More information1 Preliminaries Sample Space and Events Interpretation of Probability... 13
Summer 2017 UAkron Dept. of Stats [3470 : 461/561] Applied Statistics Ch 2: Probability Contents 1 Preliminaries 3 1.1 Sample Space and Events...........................................................
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Example: Two dice are tossed. What is the probability that the sum is 8? This is an easy exercise: we have a sample space
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationClass 26: review for final exam 18.05, Spring 2014
Probability Class 26: review for final eam 8.05, Spring 204 Counting Sets Inclusion-eclusion principle Rule of product (multiplication rule) Permutation and combinations Basics Outcome, sample space, event
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationChapter 1 Axioms of Probability. Wen-Guey Tzeng Computer Science Department National Chiao University
Chapter 1 Axioms of Probability Wen-Guey Tzeng Computer Science Department National Chiao University Introduction Luca Paccioli(1445-1514), Studies of chances of events Niccolo Tartaglia(1499-1557) Girolamo
More information5.3 Conditional Probability and Independence
28 CHAPTER 5. PROBABILITY 5. Conditional Probability and Independence 5.. Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted
More information2.4. Conditional Probability
2.4. Conditional Probability Objectives. Definition of conditional probability and multiplication rule Total probability Bayes Theorem Example 2.4.1. (#46 p.80 textbook) Suppose an individual is randomly
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More informationEnM Probability and Random Processes
Historical Note: EnM 503 - Probability and Random Processes Probability has its roots in games of chance, which have been played since prehistoric time. Games and equipment have been found in Egyptian
More informationDiscrete Probability. Chemistry & Physics. Medicine
Discrete Probability The existence of gambling for many centuries is evidence of long-running interest in probability. But a good understanding of probability transcends mere gambling. The mathematics
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationConditional Probability (cont...) 10/06/2005
Conditional Probability (cont...) 10/06/2005 Independent Events Two events E and F are independent if both E and F have positive probability and if P (E F ) = P (E), and P (F E) = P (F ). 1 Theorem. If
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationProbability, For the Enthusiastic Beginner (Exercises, Version 1, September 2016) David Morin,
Chapter 8 Exercises Probability, For the Enthusiastic Beginner (Exercises, Version 1, September 2016) David Morin, morin@physics.harvard.edu 8.1 Chapter 1 Section 1.2: Permutations 1. Assigning seats *
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationIntroduction to Probability, Fall 2009
Introduction to Probability, Fall 2009 Math 30530 Review questions for exam 1 solutions 1. Let A, B and C be events. Some of the following statements are always true, and some are not. For those that are
More informationProbability Exercises. Problem 1.
Probability Exercises. Ma 162 Spring 2010 Ma 162 Spring 2010 April 21, 2010 Problem 1. ˆ Conditional Probability: It is known that a student who does his online homework on a regular basis has a chance
More informationExam III Review Math-132 (Sections 7.1, 7.2, 7.3, 7.4, 7.5, 7.6, 8.1, 8.2, 8.3)
1 Exam III Review Math-132 (Sections 7.1, 7.2, 7.3, 7.4, 7.5, 7.6, 8.1, 8.2, 8.3) On this exam, questions may come from any of the following topic areas: - Union and intersection of sets - Complement of
More informationIf S = {O 1, O 2,, O n }, where O i is the i th elementary outcome, and p i is the probability of the i th elementary outcome, then
1.1 Probabilities Def n: A random experiment is a process that, when performed, results in one and only one of many observations (or outcomes). The sample space S is the set of all elementary outcomes
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More information4. Suppose that we roll two die and let X be equal to the maximum of the two rolls. Find P (X {1, 3, 5}) and draw the PMF for X.
Math 10B with Professor Stankova Worksheet, Midterm #2; Wednesday, 3/21/2018 GSI name: Roy Zhao 1 Problems 1.1 Bayes Theorem 1. Suppose a test is 99% accurate and 1% of people have a disease. What is the
More information