1. Sample Space and Probability Part I. Purdue University School of Electrical and Computer Engineering ECE 302, Spring 2012 Prof.
|
|
- Ralph Gibson
- 5 years ago
- Views:
Transcription
1 1. Sample Space and Probability Part I Purdue University School of Electrical and Computer Engineering ECE 302, Spring 2012 Prof.
2 ProbabilisCc Model Sample space Ω = the set of all possible outcomes of an experiment E.g., {+$1, - $1} for a one- month stock movement in the opcon example; {$102, $100, $98} for the stock value aoer two months; {Obama, McCain, neither} for a voter s preference, etc. Probability law which assigns to a set A of possible outcomes (also called an event) a number P(A), called the probability of A.
3 Sets: basic terms and notacon, 1 A countably infinite (or countable) set is a set with infinitely many elements which can be enumerated in a list, e.g., the set of all integers { 0, 1,1, 2,2, } An example of an uncountable set is the set of all real numbers between 0 and 1, denoted [0,1]
4 Sets: basic terms and notacon, 2 The set of all x that have a certain property P is denoted by { x x satisfies P}, e.g., the interval [0,1] can alternatively be written as { x 0 x 1}.
5 Set operacons: complement
6 Set operacons: union More generally, S n = S 1 S 2 = x x S n for some n n =1 { }
7 Set operacons: interseccon More generally, S n = S 1 S 2 = x x S n for all n n =1 { }
8 Disjoint sets
9 ParCCon
10 CollecCvely exhauscve sets
11 Example: three coin tosses H HHH H T HHT H T H T HTH HTT T H H T THH THT T H TTH T TTT Sample space Ω = { HHH,HHT,HTH,HTT,THH,THT,TTH,TTT} Event "heads on the first and second toss" is the set { HHH,HHT}
12 Example: three coin tosses
13 Example: three coin tosses
14 Example: three coin tosses
15 Example: three coin tosses
16 Example: three coin tosses
17 Example: three coin tosses
18 Example: presidencal eleccon % for Obama 100% 100% % for McCain
19 Example: presidencal eleccon % for Obama 100% 100% % for McCain Note: Even though the sample space is discrete in reality (the quantum is 1 voter out of 130M, or %), it is more conveniently modeled as continuous.
20 Example: presidencal eleccon % for Obama 100% 100% % for McCain Is this sample space enough for answering these questions: (1) Will Obama win the popular vote? (2) Will Obama win the election?
21 Example: presidencal eleccon % for Obama 100% 100% % for McCain Is this sample space enough for answering these questions: (1) Will Obama win the popular vote? (2) Will Obama win the election? (1) No: need to include 3 rd -party candidates (2) No: need both 3 rd -party candidates and electoral (not popular) vote
22 Example: presidencal eleccon % for Obama 100% 100% % for McCain
23 Example: presidencal eleccon % for Obama 100% 100% % for McCain
24 Sample space Ω ProbabilisCc Model Probability law: assigns to an event A a number P(A) sacsfying the following probability axioms: 1. P(A) 0 2. If A B =, then P(A B) = P(A) + P(B) If A 1, A 2, are disjoint, then P 3. P(Ω) =1 n =1 A n = P(A n ) n =1
25 RelaConship between probability and relacve frequency of occurrence
26 Example: three coin tosses Suppose all outcomes are equally likely P(Ω) =1 by axiom 3 P P ({ HHH} ) + P( { HHT} ) + + P( { TTT} ) = P(Ω) by axiom 2 ({ HHH} ) = P( { HHT} ) = = P( { TTT} ) =1/8 ({ HTT,TTH,TTT} ) = 3/8 by axiom 2 P(S 4 ) = P("two tails in a row") = P Discrete uniform probability law : if Ω consists of N equally likely outcomes, then, for any event A, P(A) = number of elements in A N
27 Example: presidencal eleccon % for Obama 100% 100% % for McCain
28 Example: presidencal eleccon % for Obama 100% 100% % for McCain
29 Example: some properces of probability laws
30 Example: some properces of probability laws
31 Example: some properces of probability laws
32 Example: some properces of probability laws
33 Example: some properces of probability laws
34 Example: some properces of probability laws (a) If A B then P(A) P(B) Proof : Let C = A c B Then B = A C and C A = (since C A c ). Therefore, Axiom 2 Axiom 1 applied to P(C ) P(B) = P(A C) = P(A) + P(C) P(A)
35 Example Linda is 31 years old, single, outspoken and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice, and also participated in anti-nuclear demonstrations.
36 Example Linda is 31 years old, single, outspoken and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice, and also participated in anti-nuclear demonstrations. Let A = Linda is a bank teller Let B = Linda is a bank teller and is active in the feminist movement Which event is more likely?
37 Example Linda is 31 years old, single, outspoken and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice, and also participated in anti-nuclear demonstrations. Let A = Linda is a bank teller Let B = Linda is a bank teller and is active in the feminist movement Which event is more likely? Since B A, we have P(B) P(A)
38 Example Linda is 31 years old, single, outspoken and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice, and also participated in anti-nuclear demonstrations. Let A = Linda is a bank teller Let B = Linda is a bank teller and is active in the feminist movement Which event is more likely? Since B A, we have P(B) P(A) A. Tversky and D. Kahneman. Extensional Versus Intuitive Reasoning: The Conjunction Fallacy in Probability Judgment. Psychological Review, 90(4): , October 1983.
39 Example: some properces of probability laws
40 Example: some properces of probability laws
41 Example: some properces of probability laws
42 Example: some properces of probability laws
43 Example: some properces of probability laws
44 Example: some properces of probability laws
45 Example: some properces of probability laws (c) P(A B) P(A) + P(B) Proof : Use property (b) : P(A B) = P(A) + P(B) P(A B) 0, by Axiom 1 P(A) + P(B)
46 Example: some properces of probability laws (d) P(A B C) = P(A) + P(A c B) + P(A c B c C) Proof : Since A, A c B, A c B c C form a partition for A B C, the statement follows from Axiom 2.
47 CondiConal Probability NotaCon: P(A B) Probability of event A, given that event B occurred DefiniCon: assuming P(B) 0, CondiConal probabilices specify a probability law on the new universe B (exercise)
48 Example: Problem of Points Eight equally likely outcomes for three fair coin flips Best two out of three fair coin flips Helen bets on H, Tom bets on T (a) What s the probability that Helen wins 1 st round? (b) What s the probability that Helen wins overall? (c) The game is interrupted aoer Helen wins 1 st round. What s the condiconal probability that she would have won overall?
49 Example: Problem of Points Eight equally likely outcomes for three fair coin flips Best two out of three fair coin flips Helen bets on H, Tom bets on T (a) What s the probability that Helen wins 1 st round? (b) What s the probability that Helen wins overall? (c) The game is interrupted aoer Helen wins 1 st round. What s the condiconal probability that she would have won overall? SoluCon (a) ½ - - follows directly from the fact that the coin is fair. (b) ½ - - follows from the fact that all eight outcomes are equally likely.
50 Problem of Points, SoluCon H HHH H wins 1 st round H T HHT H wins overall H T H T HTH HTT T H H T THH THT T H TTH P(H wins 1 st round) = 1/2 P(H wins 1 st round and H wins overall) = 3/8 T TTT P(H wins overall H wins 1 st round) = P(H wins 1 st round and H wins overall)/ P(H wins 1 st round) = (3/8)/(1/2) = 3/4
51 AlternaCvely, View the blue set as the new sample space. Three out of four equally likely outcomes result in H s overall win. Therefore, P(H wins overall H wins 1 st round) = 3/4. HHH HHT HTH HTT H wins 1 st round H wins overall
52 Example: Intrusion DetecCon Event A: intrusion Event B: alarm Suppose that, from past experiences and measurements, we know that P(A) = 0.02; false alarm probability P(B A c ) = 0.05; and missed detection probability P(B c A) = Find P(B), P(A B), P(B c and A), and P(B and A c ).
53 Example: Intrusion DetecCon Event A: intrusion Event B: alarm Suppose that, from past experiences and measurements, we know that P(A) = 0.02; false alarm probability P(B A c ) = 0.05; and missed detection probability P(B c A) = Find P(B), P(A B), P(B c and A), and P(B and A c ). A B c A B A B A c A c B c A c
54 Example: Intrusion DetecCon Event A: intrusion Event B: alarm Suppose that, from past experiences and measurements, we know that P(A) = 0.02; false alarm probability P(B A c ) = 0.05; and missed detection probability P(B c A) = Find P(B), P(A B), P(B c and A), and P(B and A c ). P(A) = 0.02 A P(B c A)=0.01 B c A B A B A c A c B c A c P(B c A) = P(A)P(B c A) = =
55 Example: Intrusion DetecCon Event A: intrusion Event B: alarm Suppose that, from past experiences and measurements, we know that P(A) = 0.02; false alarm probability P(B A c ) = 0.05; and missed detection probability P(B c A) = Find P(B), P(A B), P(B c and A), and P(B and A c ). A B c A P(A c ) = 0.98 A c P(B A c )=0.05 B A B A c B c A c P(B A c ) = P(A c )P(B A c ) = = 0.049
56 Example: Intrusion DetecCon Event A: intrusion Event B: alarm Suppose that, from past experiences and measurements, we know that P(A) = 0.02; false alarm probability P(B A c ) = 0.05; and missed detection probability P(B c A) = Find P(B), P(A B), P(B c and A), and P(B and A c ). A B c A B A B A c Event B A c B c A c P(B) = P(B A) + P(B A c )
57 Example: Intrusion DetecCon Event A: intrusion Event B: alarm Suppose that, from past experiences and measurements, we know that P(A) = 0.02; false alarm probability P(B A c ) = 0.05; and missed detection probability P(B c A) = Find P(B), P(A B), P(B c and A), and P(B and A c ). P(A) = 0.02 A B c A Event B P(B A)=0.99 B A B A c A c B c A c P(B A) = P(A)P(B A) = = P(B A c ) = P(B) = P(B A) + P(B A c )
58 Example: Intrusion DetecCon Event A: intrusion Event B: alarm Suppose that, from past experiences and measurements, we know that P(A) = 0.02; false alarm probability P(B A c ) = 0.05; and missed detection probability P(B c A) = Find P(B), P(A B), P(B c and A), and P(B and A c ). P(A) = 0.02 A B c A Event B P(B A)=0.99 B A B A c A c B c A c P(B A) = P(A)P(B A) = = P(B A c ) = P(B) = P(B A) + P(B A c ) = =
59 Example: Intrusion DetecCon Event A: intrusion Event B: alarm Suppose that, from past experiences and measurements, we know that P(A) = 0.02; false alarm probability P(B A c ) = 0.05; and missed detection probability P(B c A) = Find P(B), P(A B), P(B c and A), and P(B and A c ). P(B A) = P(B) = P(A B) = P(A B)/P(B) =0.0198/
60 Example: Intrusion DetecCon Event A: intrusion Event B: alarm Suppose that, from past experiences and measurements, we know that P(A) = 0.02; false alarm probability P(B A c ) = 0.05; and missed detection probability P(B c A) = Find P(B), P(A B), P(B c and A), and P(B and A c ). P(A) = 0.02 A P(B c A)=0.01 P(B A)=0.99 B c A B A Event B P(B A c )=0.05 B A c P(A c ) = 0.98 A c P(B c A c )=0.95 B c A c P(B c A) = P(A)P(B c A) = = P(B A) = P(A)P(B A) = = P(B A c ) = P(A c )P(B A c ) = = P(B) = P(B A) + P(B A c ) = = P(A B) = P(A B)/P(B) =0.0198/
61 Example 1.18: False- PosiCve Puzzle A crime commiked on an island, populacon 5000 A priori, all are equally likely to have commiked it Based on a forensic test, a suspect is arrested Apart from the test, no other evidence Accuracy of the test is 99.9%, i.e., P(test is posicve suspect is guilty) = and P(test is negacve suspect is innocent) = You are on the jury. Do you have reasonable doubt?
62 False- PosiCve Puzzle: SoluCon Proceed similar to the intruder example P(+) = P(+ and guilty) + P(+ and innocent)
63 False- PosiCve Puzzle: SoluCon Proceed similar to the intruder example P(+) = P(+ and guilty) + P(+ and innocent) = P(+ guilty) P(guilty) + P(+ innocent) P(innocent)
64 False- PosiCve Puzzle: SoluCon Proceed similar to the intruder example P(+) = P(+ and guilty) + P(+ and innocent) = P(+ guilty) P(guilty) + P(+ innocent) P(innocent) =
65 False- PosiCve Puzzle: SoluCon Proceed similar to the intruder example P(+) = P(+ and guilty) + P(+ and innocent) = P(+ guilty) P(guilty) + P(+ innocent) P(innocent) = =
66 False- PosiCve Puzzle: SoluCon Proceed similar to the intruder example P(+) = P(+ and guilty) + P(+ and innocent) = P(+ guilty) P(guilty) + P(+ innocent) P(innocent) = = P(guilty +) = P(+ and guilty) / P(+) = / !!!
67 False- PosiCve Puzzle: SoluCon Proceed similar to the intruder example P(+) = P(+ and guilty) + P(+ and innocent) = P(+ guilty) P(guilty) + P(+ innocent) P(innocent) = = P(guilty +) = P(+ and guilty) / P(+) = / !!! The seemingly reliable test is not very reliable at all!
68 False- PosiCve Puzzle: Some IntuiCon Suppose this is repeated on 1000 islands Suppose we test all 5,000,000 people on 1000 islands
69 False- PosiCve Puzzle: Some IntuiCon Suppose this is repeated on 1000 islands Suppose we test all 5,000,000 people on 1000 islands On average, we expect roughly the following test results: ~1 tests - 5,000,000 people 1000 guilty 4,999,000 innocent ~999 test +
70 False- PosiCve Puzzle: Some IntuiCon Suppose this is repeated on 1000 islands Suppose we test all 5,000,000 people on 1000 islands On average, we expect roughly the following test results: ~1 tests - 5,000,000 people 1000 guilty 4,999,000 innocent ~999 test + ~4999 test + ~4,994,001 test -
71 False- PosiCve Puzzle: Some IntuiCon Suppose this is repeated on 1000 islands Suppose we test all 5,000,000 people on 1000 islands On average, we expect roughly the following test results: ~1 tests - 5,000,000 people 1000 guilty 4,999,000 innocent ~999 test + ~4999 test + ~4,994,001 test - ~999 criminals out of ~5998 who tested + i.e., roughly 1/6
72 False- PosiCve Puzzle: Some IntuiCon Suppose this is repeated on 1000 islands Suppose we test all 5,000,000 people on 1000 islands On average, we expect roughly the following test results: ~1 tests - 5,000,000 people 1000 guilty 4,999,000 innocent ~999 test + ~4999 test + ~4,994,001 test - ~999 criminals out of ~5998 who tested + i.e., roughly 1/6 I.e., there are so few criminals that the bulk of people who test posicve are innocent!
73 So
74 So PLEASE
75 So PLEASE never confuse P(A B) with P(B A)!
76 Example: P(A B) vs P(B A) Let A = On US ElecCon Day November 6, 2012, there is a hurricane in Florida and Louisiana, tornadoes in Midwest, a tsunami in New York, and an earthquake in California.
77 Example: P(A B) vs P(B A) Let A = On US ElecCon Day November 6, 2012, there is a hurricane in Florida and Louisiana, tornadoes in Midwest, a tsunami in New York, and an earthquake in California. Let B = On US ElecCon Day in November 6, 2012, the voter turnout is lower than it was on ElecCon Day November 4, 2008.
78 Example: P(A B) vs P(B A) Let A = On US ElecCon Day November 6, 2012, there is a hurricane in Florida and Louisiana, tornadoes in Midwest, a tsunami in New York, and an earthquake in California. Let B = On US ElecCon Day in November 6, 2012, the voter turnout is lower than it was on ElecCon Day November 4, P(B A) is huge. If A happens, a lot of people will be too preoccupied to vote.
79 Example: P(A B) vs P(B A) Let A = On US ElecCon Day November 6, 2012, there is a hurricane in Florida and Louisiana, tornadoes in Midwest, a tsunami in New York, and an earthquake in California. Let B = On US ElecCon Day in November 6, 2012, the voter turnout is lower than it was on ElecCon Day November 4, P(B A) is huge. If A happens, a lot of people will be too preoccupied to vote. P(A B) is Cny. Lower- than turnout could happen for many reasons besides natural distasters.
80 Total Probability Theorem A 1 B A 2 A 3
81 Total Probability Theorem A 1 B A 2 A 3 One way of compucng P(B): P(B) = P(B A 1 ) + P(B A 2 ) + P(B A 3 ) = P(B A 1 )P(A 1 ) + P(B A 2 )P(A 2 ) + P(B A 3 )P(A 3 )
82 Total Probability Theorem A 1 B A 2 A 3 One way of compucng P(B): P(B) = P(B A 1 ) + P(B A 2 ) + P(B A 3 ) = P(B A 1 )P(A 1 ) + P(B A 2 )P(A 2 ) + P(B A 3 )P(A 3 ) More generally, P(B) = Σ i P(B A i )P(A i ) if A i s are mutually exclusive and B is a subset of the union of A i s
83 Bayes Rule Prior model: probabilices P(A i )
84 Bayes Rule Prior model: probabilices P(A i ) Measurement model: P(B A i ) condiconal probability to observe data B given that the truth is A i
85 Bayes Rule Prior model: probabilices P(A i ) Measurement model: P(B A i ) condiconal probability to observe data B given that the truth is A i Want to compute posterior probabilides P(A i B) CondiConal probability that the truth is A i given that we observed data B
86 Bayes Rule Prior model: probabilices P(A i ) Measurement model: P(B A i ) condiconal probability to observe data B given that the truth is A i Want to compute posterior probabilides P(A i B) CondiConal probability that the truth is A i given that we observed data B P(A i B) = P(A i B) P(B) = P(B A i )P(A i ) P(B)
87 Denominator in Bayes Rule via Total Probability Theorem If B A j then we can use the total probability theorem j to compute P(B) :
88 Denominator in Bayes Rule via Total Probability Theorem If B A j then we can use the total probability theorem j to compute P(B) : P(A i B) = P(B A i )P(A i ) P(B) = P(B A i )P(A i ) P(B A j )P(A j ) j
89 MulCplicaCon Rule P n i=1 A i = P(A 1 )P(A 2 A 1 )P(A 3 A 1 A 2 ) P A n n 1 A i i=1 provided all the conditioning events have nonzero probability,
90 Example 1.10 Three cards are drawn from a deck of 52 cards, without replacement. At each step, each one of the remaining cards is equally likely to be picked. What s the probability that none of the three cards is a heart? Let A i ={i- th card is not a heart}, i=1,2,3
91 Example Three cards are drawn from a deck of 52 cards, without replacement. At each step, each one of the remaining cards is equally likely to be picked. What s the probability that none of the three cards is a heart? Let A i ={i- th card is not a heart}, i=1,2,3 P(A 1 ) = A 1 P(A 1 c ) = A 1 c
92 Example Three cards are drawn from a deck of 52 cards, without replacement. At each step, each one of the remaining cards is equally likely to be picked. What s the probability that none of the three cards is a heart? Let A i ={i- th card is not a heart}, i=1,2,3 P(A 1 ) = P(A 1 c ) = A 1 A 1 c P(A 2 A 1 ) = A 1 A 2 A 1 A 2 c
93 Example Three cards are drawn from a deck of 52 cards, without replacement. At each step, each one of the remaining cards is equally likely to be picked. What s the probability that none of the three cards is a heart? Let A i ={i- th card is not a heart}, i=1,2,3 P(A 3 A 1 A 2 ) = A 1 A 2 A 3 P(A 2 A 1 ) = A 1 A 2 P(A 1 ) = A A 1 A 2 A 3 c A 1 A 2 c P(A 1 c ) = A 1 c
94 Example Three cards are drawn from a deck of 52 cards, without replacement. At each step, each one of the remaining cards is equally likely to be picked. What s the probability that none of the three cards is a heart? Let A i ={i- th card is not a heart}, i=1,2,3 P(A 3 A 1 A 2 ) = A 1 A 2 A 3 P(A 2 A 1 ) = A 1 A 2 P(A 1 ) = A A 1 A 2 A 3 c A 1 A 2 c P(A 1 c ) = A 1 c P(A 1 A 2 A 3 ) = P(A 1 )P(A 2 A 1 )P(A 3 A 1 A 2 ) =
95 Example: Prisoner s Dilemma (p. 58) Three prisoners: A, B, and C. One will be executed next day, two released. Prisoner A asks the guard to tell him the name of one of the other two who will be released. Guard says that B will be released. (Assume that the guard is telling the truth.) A argues: before my chances to be executed were 1/3, now they are 1/2 since I know it s either me or C. What s wrong with his reasoning?
96 Prisoner s Dilemma: A few remarks The prisoners only know that one of them will be executed, but do not know which one. Thus, from their point of view, a reasonable model is a discrete uniform probability law that assigns each of them probability 1/3 to be executed. The guard knows which one of them will be executed. Since A already knows that either B or C will be released, it does not seem like the guard s response should influence A s chances in any way. In fact, under a reasonable assumpcon, A s probability to be executed is scll 1/3 (from A s point of view), as shown in the next few slides.
97 Prisoner s Dilemma: Problem Statement and AddiConal Modeling We know P(A to be executed) = 1/3. P(A to be executed Guard s response is B) =?
98 Prisoner s Dilemma: Problem Statement and AddiConal Modeling We know P(A to be executed) = 1/3. P(A to be executed Guard s response is B) =? But we do not yet have enough informacon to compute this condiconal probability. We need P(Guard s response is B A to be executed).
99 Prisoner s Dilemma: Problem Statement and AddiConal Modeling We know P(A to be executed) = 1/3. P(A to be executed Guard s response is B) =? But we do not yet have enough informacon to compute this condiconal probability. We need P(Guard s response is B A to be executed). It s reasonable for A to assume that if he is to be executed, the guard has a chance to respond B or C : P(Guard s response is B A to be executed) = 1/2.
100 Prisoner s Dilemma: SoluCon Let E i ={prisoner i will be executed} for i=a,b,c Let G j ={guard names prisoner j} for j=b,c
101 Prisoner s Dilemma: SoluCon Let E i ={prisoner i will be executed} for i=a,b,c Let G j ={guard names prisoner j} for j=b,c 1/3 1/3 1/3 E A E B E C
102 Prisoner s Dilemma: SoluCon Let E i ={prisoner i will be executed} for i=a,b,c Let G j ={guard names prisoner j} for j=b,c 1/2 E A G B 1/3 E A 1/2 E A G C 1/3 E B 1/3 E C
103 Prisoner s Dilemma: SoluCon Let E i ={prisoner i will be executed} for i=a,b,c Let G j ={guard names prisoner j} for j=b,c 1/2 E A G B 1/3 1/3 1/3 E A E B 1/2 0 1 E A G C E B G B E B G C E C
104 Prisoner s Dilemma: SoluCon Let E i ={prisoner i will be executed} for i=a,b,c Let G j ={guard names prisoner j} for j=b,c 1/2 E A G B 1/3 1/3 1/3 E A E B E C 1/ E A G C E B G B E B G C E C G B E C G C
105 Prisoner s Dilemma: SoluCon Let E i ={prisoner i will be executed} for i=a,b,c Let G j ={guard names prisoner j} for j=b,c 1/2 E A G B 1/6 1/3 1/3 1/3 E A E B E C 1/ E A G C E B G B E B G C E C G B E C G C 1/6 0 1/3 1/3 0
106 Prisoner s Dilemma: SoluCon Let E i ={prisoner i will be executed} for i=a,b,c Let G j ={guard names prisoner j} for j=b,c G B 1/2 E A G B 1/6 1/3 1/3 1/3 E A E B E C 1/ E A G C E B G B E B G C E C G B E C G C 1/6 0 1/3 1/3 0
107 Prisoner s Dilemma: SoluCon Let E i ={prisoner i will be executed} for i=a,b,c Let G j ={guard names prisoner j} for j=b,c G B 1/2 E A G B 1/6 1/3 1/3 1/3 E A E B E C 1/ E A G C E B G B E B G C E C G B E C G C 1/6 0 1/3 1/3 0 P(E A G B ) = P(E A G B )/P(G B )
108 Prisoner s Dilemma: SoluCon Let E i ={prisoner i will be executed} for i=a,b,c Let G j ={guard names prisoner j} for j=b,c G B 1/2 E A G B 1/6 1/3 1/3 1/3 E A E B E C 1/ E A G C E B G B E B G C E C G B E C G C 1/6 0 1/3 1/3 0 P(E A G B ) = P(E A G B )/P(G B ) = (1/6)/(1/ /3) = 1/3
109 Prisoner s Dilemma Problem 13 in FiFy Challenging Problems in Probability with SoluDons by F. Mosteller, Dover, 1965.
110 The Monty Hall Puzzle (Ex. 1.12) Prize behind one of three doors. Contestant picks a door. Host (who knows where the prize is) opens one of the remaining two doors which does not have the prize. Contestant is offered an opportunity to stay with his door, or to switch to another door. Stay or switch?
111 The Monty Hall Puzzle: SoluCon If stay, P(win) = 1/3
112 The Monty Hall Puzzle: SoluCon If stay, P(win) = 1/3 If switch, the only way to lose is if inically pointed to the door with prize: P(lose) = 1/3 and so P(win) = 2/3
113 The Monty Hall Puzzle: SoluCon If stay, P(win) = 1/3 If switch, the only way to lose is if inically pointed to the door with prize: P(lose) = 1/3 and so P(win) = 2/3 Conclusion: must switch! Switching is advantageous because the host s accon tells you something. If you inically picked a door with no prize, he is forced to open the other door with no prize.
114 The Monty Hall Puzzle: Discussion Crucial parts of the problem statement: the host knows where the prize is he must open the door with no prize
115 The Monty Hall Puzzle: Discussion Crucial parts of the problem statement: the host knows where the prize is he must open the door with no prize Thus, if you have chosen a door with no prize, you are forcing him to open the only other door with no prize and thus show you where the prize is.
116 The Monty Hall Puzzle: Another SoluCon Use the total probability theorem to evaluate the probabilices of winning under the two strategies.
117 The Monty Hall Puzzle: Another SoluCon Use the total probability theorem to evaluate the probabilices of winning under the two strategies. Let W = win and N = originally point to a door with no prize.
118 The Monty Hall Puzzle: Another SoluCon Use the total probability theorem to evaluate the probabilices of winning under the two strategies. Let W = win and N = originally point to a door with no prize. P(N) = 2/3; P(N c ) = 1/3.
119 The Monty Hall Puzzle: Another SoluCon Use the total probability theorem to evaluate the probabilices of winning under the two strategies. Let W = win and N = originally point to a door with no prize. P(N) = 2/3; P(N c ) = 1/3. If you do not switch, P(W N) = 0 and P(W N c ) = 1.
120 The Monty Hall Puzzle: Another SoluCon Use the total probability theorem to evaluate the probabilices of winning under the two strategies. Let W = win and N = originally point to a door with no prize. P(N) = 2/3; P(N c ) = 1/3. If you do not switch, P(W N) = 0 and P(W N c ) = 1. So, if you do not switch, P(W) = P(W N)P(N) + P(W N c )P(N c ) = 1/3.
121 The Monty Hall Puzzle: Another SoluCon Use the total probability theorem to evaluate the probabilices of winning under the two strategies. Let W = win and N = originally point to a door with no prize. P(N) = 2/3; P(N c ) = 1/3. If you do not switch, P(W N) = 0 and P(W N c ) = 1. So, if you do not switch, P(W) = P(W N)P(N) + P(W N c )P(N c ) = 1/3. If you switch, P(W N) = 1 because if you originally choose a door with no prize the host is forced to open the only other door with no prize.
122 The Monty Hall Puzzle: Another SoluCon Use the total probability theorem to evaluate the probabilices of winning under the two strategies. Let W = win and N = originally point to a door with no prize. P(N) = 2/3; P(N c ) = 1/3. If you do not switch, P(W N) = 0 and P(W N c ) = 1. So, if you do not switch, P(W) = P(W N)P(N) + P(W N c )P(N c ) = 1/3. If you switch, P(W N) = 1 because if you originally choose a door with no prize the host is forced to open the only other door with no prize. If you switch, P(W N c ) = 0 because if you originally choose the door with the prize, you will switch out of it and lose.
123 The Monty Hall Puzzle: Another SoluCon Use the total probability theorem to evaluate the probabilices of winning under the two strategies. Let W = win and N = originally point to a door with no prize. P(N) = 2/3; P(N c ) = 1/3. If you do not switch, P(W N) = 0 and P(W N c ) = 1. So, if you do not switch, P(W) = P(W N)P(N) + P(W N c )P(N c ) = 1/3. If you switch, P(W N) = 1 because if you originally choose a door with no prize the host is forced to open the only other door with no prize. If you switch, P(W N c ) = 0 because if you originally choose the door with the prize, you will switch out of it and lose. So, if you switch, P(W) = P(W N)P(N) + P(W N c )P(N c ) = 2/3.
124 Two- Envelopes Puzzle (p. 58) You are handed two envelopes, each containing an posicve integer number of dollars, unknown to you. The two amounts are different. You select at random one envelope and look inside. You can either scck with this envelope or take the other envelope. Your objeccve is to get the larger amount. Does it maker what you do?
125 Two- Envelopes Puzzle Surprisingly, the answer is yes. There exist strategies with a strictly beker than chance of picking the envelope with the larger amount.
126 Two- Envelopes Puzzle: Strategy Make independent flips of a fair coin uncl heads come up for the first Cme. Let X = 1/2 + number of tosses to get first H. If the amount in your envelope > X, stay If the amount in your envelope < X, switch
127 Two- Envelopes Puzzle: Analysis Strategy: If the amount in your envelope > X, stay If the amount in your envelope < X, switch where X = 1/2 + # tosses of a fair coin to get first H Let s show that this strategy has a larger than 1/2 probability to get the larger amount.
128 Two- Envelopes Puzzle: Analysis Strategy: If the amount in your envelope > X, stay If the amount in your envelope < X, switch where X = 1/2 + # tosses of a fair coin to get first H Let s show that this strategy has a larger than 1/2 probability to get the larger amount. Denote the two amounts d and D, d < D
129 Two- Envelopes Puzzle: Analysis Strategy: If the amount in your envelope > X, stay If the amount in your envelope < X, switch where X = 1/2 + # tosses of a fair coin to get first H Let s show that this strategy has a larger than 1/2 probability to get the larger amount. Denote the two amounts d and D, d < D Case 1: X < d always stay win with probability ½
130 Two- Envelopes Puzzle: Analysis Strategy: If the amount in your envelope > X, stay If the amount in your envelope < X, switch where X = 1/2 + # tosses of a fair coin to get first H Let s show that this strategy has a larger than 1/2 probability to get the larger amount. Denote the two amounts d and D, d < D Case 1: X < d always stay win with probability 1/2 Case 2: X > D always switch win with probability ½
131 Two- Envelopes Puzzle: Analysis Strategy: If the amount in your envelope > X, stay If the amount in your envelope < X, switch where X = 1/2 + # tosses of a fair coin to get first H Let s show that this strategy has a larger than 1/2 probability to get the larger amount. Denote the two amounts d and D, d < D Case 1: X < d always stay win with probability 1/2 Case 2: X > D always switch win with probability 1/2 Case 3: d < X < D stay if pick D, switch if pick d win!
132 Two- Envelopes Puzzle: Analysis Strategy: If the amount in your envelope > X, stay If the amount in your envelope < X, switch where X = 1/2 + # tosses of a fair coin to get first H Let s show that this strategy has a larger than 1/2 probability to get the larger amount. Denote the two amounts d and D, d < D Case 1: X < d always stay win with probability 1/2 Case 2: X > D always switch win with probability 1/2 Case 3: d < X < D stay if pick D, switch if pick d win! Since P(Case 3) > 0 for any two amounts d and D, we have that the probability to get the larger amount is bigger than 1/2.
133 Two- Envelopes Puzzle: P(win) > 1/2 Case 1: X < d always stay win with probability 1/2 Case 2: X > D always switch win with probability 1/2 Case 3: d < X < D stay if pick D, switch if pick d win! Using the total probability theorem, we have: P(win) = P(win X<d) P(X<d) + P(win X>D) P(X>D) + P(win d<x<d) P(d<X<D)
134 Two- Envelopes Puzzle: P(win) > 1/2 Case 1: X < d always stay win with probability 1/2 Case 2: X > D always switch win with probability 1/2 Case 3: d < X < D stay if pick D, switch if pick d win! Using the total probability theorem, we have: P(win) = P(win X<d) P(X<d) + P(win X>D) P(X>D) + P(win d<x<d) P(d<X<D) = 1/2 P(X<d) + 1/2 P(X>D) + P(d<X<D)
135 Two- Envelopes Puzzle: P(win) > 1/2 Case 1: X < d always stay win with probability 1/2 Case 2: X > D always switch win with probability 1/2 Case 3: d < X < D stay if pick D, switch if pick d win! Using the total probability theorem, we have: P(win) = P(win X<d) P(X<d) + P(win X>D) P(X>D) + P(win d<x<d) P(d<X<D) = 1/2 P(X<d) + 1/2 P(X>D) + P(d<X<D) = 1/2 P(X<d) + 1/2 P(X>D) + 1/2 P(d<X<D) + 1/2 P(d<X<D)
136 Two- Envelopes Puzzle: P(win) > 1/2 Case 1: X < d always stay win with probability 1/2 Case 2: X > D always switch win with probability 1/2 Case 3: d < X < D stay if pick D, switch if pick d win! Using the total probability theorem, we have: P(win) = P(win X<d) P(X<d) + P(win X>D) P(X>D) + P(win d<x<d) P(d<X<D) = 1/2 P(X<d) + 1/2 P(X>D) + P(d<X<D) = 1/2 P(X<d) + 1/2 P(X>D) + 1/2 P(d<X<D) + 1/2 P(d<X<D) = 1/2 (P(X<d) + P(X>D) + P(d<X<D)) + 1/2 P(d<X<D)
137 Two- Envelopes Puzzle: P(win) > 1/2 Case 1: X < d always stay win with probability 1/2 Case 2: X > D always switch win with probability 1/2 Case 3: d < X < D stay if pick D, switch if pick d win! Using the total probability theorem, we have: P(win) = P(win X<d) P(X<d) + P(win X>D) P(X>D) + P(win d<x<d) P(d<X<D) = 1/2 P(X<d) + 1/2 P(X>D) + P(d<X<D) = 1/2 P(X<d) + 1/2 P(X>D) + 1/2 P(d<X<D) + 1/2 P(d<X<D) = 1/2 (P(X<d) + P(X>D) + P(d<X<D)) + 1/2 P(d<X<D) = 1/2 + 1/2 P(d<X<D) > 1/2
138 Two- Envelopes Puzzle: Comments Note that X can be any random variable having non- zero values at 3/2, 5/2, 7/2 (or, in fact, at any point(s) on ]1,2[, at any point(s) on ]2,3[, etc.)
139 Two- Envelopes Puzzle: Comments Note that X can be any random variable having non- zero values at 3/2, 5/2, 7/2 (or, in fact, at any point(s) on ]1,2[, at any point(s) on ]2,3[, etc.) According to the strategy, you will always switch if the amount in your inical envelope is $1.
140 Two- Envelopes Puzzle: Comments Note that X can be any random variable having non- zero values at 3/2, 5/2, 7/2 (or, in fact, at any point(s) on ]1,2[, at any point(s) on ]2,3[, etc.) According to the strategy, you will always switch if the amount in your inical envelope is $1. If it is known that the largest possible number of dollars in both envelopes is some integer L, then the strategy will scll result in a larger than 50% probability of success. However, it can be improved because having X > L is wasteful in this case. To adapt the strategy to this case, make X not take any values above L 1/2. For example, X can be taken to be discrete uniform over {3/2, 5/2,, L 1/2}.
Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationFirst Digit Tally Marks Final Count
Benford Test () Imagine that you are a forensic accountant, presented with the two data sets on this sheet of paper (front and back). Which of the two sets should be investigated further? Why? () () ()
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationP (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationEvents A and B are said to be independent if the occurrence of A does not affect the probability of B.
Independent Events Events A and B are said to be independent if the occurrence of A does not affect the probability of B. Probability experiment of flipping a coin and rolling a dice. Sample Space: {(H,
More informationConditional Probability P( )
Conditional Probability P( ) 1 conditional probability where P(F) > 0 Conditional probability of E given F: probability that E occurs given that F has occurred. Conditioning on F Written as P(E F) Means
More information18.600: Lecture 4 Axioms of probability and inclusion-exclusion
18.600: Lecture 4 Axioms of probability and inclusion-exclusion Scott Sheffield MIT Outline Axioms of probability Consequences of axioms Inclusion exclusion Outline Axioms of probability Consequences of
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationLecture 2. Conditional Probability
Math 408 - Mathematical Statistics Lecture 2. Conditional Probability January 18, 2013 Konstantin Zuev (USC) Math 408, Lecture 2 January 18, 2013 1 / 9 Agenda Motivation and Definition Properties of Conditional
More informationQuantitative Methods for Decision Making
January 14, 2012 Lecture 3 Probability Theory Definition Mutually exclusive events: Two events A and B are mutually exclusive if A B = φ Definition Special Addition Rule: Let A and B be two mutually exclusive
More informationECE 302: Chapter 02 Probability Model
ECE 302: Chapter 02 Probability Model Fall 2018 Prof Stanley Chan School of Electrical and Computer Engineering Purdue University 1 / 35 1. Probability Model 2 / 35 What is Probability? It is a number.
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationIntroduction and basic definitions
Chapter 1 Introduction and basic definitions 1.1 Sample space, events, elementary probability Exercise 1.1 Prove that P( ) = 0. Solution of Exercise 1.1 : Events S (where S is the sample space) and are
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationECE 450 Lecture 2. Recall: Pr(A B) = Pr(A) + Pr(B) Pr(A B) in general = Pr(A) + Pr(B) if A and B are m.e. Lecture Overview
ECE 450 Lecture 2 Recall: Pr(A B) = Pr(A) + Pr(B) Pr(A B) in general = Pr(A) + Pr(B) if A and B are m.e. Lecture Overview Conditional Probability, Pr(A B) Total Probability Bayes Theorem Independent Events
More informationNotes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 15 Notes. Class URL:
Notes slides from before lecture CSE 21, Winter 2017, Section A00 Lecture 15 Notes Class URL: http://vlsicad.ucsd.edu/courses/cse21-w17/ Notes slides from before lecture Notes March 6 (1) This week: Days
More informationMathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2
( : Focus on free Education) Exercise 16.2 Question 1: A die is rolled. Let E be the event die shows 4 and F be the event die shows even number. Are E and F mutually exclusive? Answer 1: When a die is
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationLecture 1 : The Mathematical Theory of Probability
Lecture 1 : The Mathematical Theory of Probability 0/ 30 1. Introduction Today we will do 2.1 and 2.2. We will skip Chapter 1. We all have an intuitive notion of probability. Let s see. What is the probability
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationLecture 3 - Axioms of Probability
Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What
More informationProbability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)
Chapter 14 From Randomness to Probability How to measure a likelihood of an event? How likely is it to answer correctly one out of two true-false questions on a quiz? Is it more, less, or equally likely
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationVina Nguyen HSSP July 6, 2008
Vina Nguyen HSSP July 6, 2008 1 Late registration Claroline class server 2 What are the two types of probability? 3 What are the two types of probability? What is a set? 4 What are the two types of probability?
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More information2. Conditional Probability
ENGG 2430 / ESTR 2004: Probability and Statistics Spring 2019 2. Conditional Probability Andrej Bogdanov Coins game Toss 3 coins. You win if at least two come out heads. S = { HHH, HHT, HTH, HTT, THH,
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationIntroduction Probability. Math 141. Introduction to Probability and Statistics. Albyn Jones
Math 141 to and Statistics Albyn Jones Mathematics Department Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 September 3, 2014 Motivation How likely is an eruption at Mount Rainier in
More informationProbability Distributions. Conditional Probability.
Probability Distributions. Conditional Probability. CSE21 Winter 2017, Day 21 (B00), Day 14 (A00) March 6, 2017 http://vlsicad.ucsd.edu/courses/cse21-w17 Probability Rosen p. 446, 453 Sample space, S:
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Example: Two dice are tossed. What is the probability that the sum is 8? This is an easy exercise: we have a sample space
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationBasic Statistics for SGPE Students Part II: Probability theory 1
Basic Statistics for SGPE Students Part II: Probability theory 1 Mark Mitchell mark.mitchell@ed.ac.uk Nicolai Vitt n.vitt@ed.ac.uk University of Edinburgh September 2016 1 Thanks to Achim Ahrens, Anna
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationLower bound for sorting/probability Distributions
Lower bound for sorting/probability Distributions CSE21 Winter 2017, Day 20 (B00), Day 14 (A00) March 3, 2017 http://vlsicad.ucsd.edu/courses/cse21-w17 Another application of counting lower bounds Sorting
More information4th IIA-Penn State Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur
4th IIA-Penn State Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur Laws of Probability, Bayes theorem, and the Central Limit Theorem Rahul Roy Indian Statistical Institute, Delhi. Adapted
More information(i) Given that a student is female, what is the probability of having a GPA of at least 3.0?
MATH 382 Conditional Probability Dr. Neal, WKU We now shall consider probabilities of events that are restricted within a subset that is smaller than the entire sample space Ω. For example, let Ω be the
More informationLecture 3. January 7, () Lecture 3 January 7, / 35
Lecture 3 January 7, 2013 () Lecture 3 January 7, 2013 1 / 35 Outline This week s lecture: Fast review of last week s lecture: Conditional probability. Partition, Partition theorem. Bayes theorem and its
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationConditional Probability, Independence, Bayes Theorem Spring January 1, / 23
Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2014 January 1, 2017 1 / 23 Sample Space Confusions 1. Sample space = set of all possible outcomes of an experiment. 2. The size of the
More informationElementary Discrete Probability
Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,
More informationWhat is a random variable
OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Random Variables Fall 20 Yrd. Doç. Dr. Didem Kivanc Tureli didemk@ieee.org didem.kivanc@okan.edu.tr
More information3rd IIA-Penn State Astrostatistics School July, 2010 Vainu Bappu Observatory, Kavalur
3rd IIA-Penn State Astrostatistics School 19 27 July, 2010 Vainu Bappu Observatory, Kavalur Laws of Probability, Bayes theorem, and the Central Limit Theorem Bhamidi V Rao Indian Statistical Institute,
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Probability assigns a likelihood to results of experiments that have not yet been conducted. Suppose that the experiment has
More informationMA : Introductory Probability
MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:
More informationConditional Probability
Conditional Probability Conditional Probability The Law of Total Probability Let A 1, A 2,..., A k be mutually exclusive and exhaustive events. Then for any other event B, P(B) = P(B A 1 ) P(A 1 ) + P(B
More informationHomework 4 Solution, due July 23
Homework 4 Solution, due July 23 Random Variables Problem 1. Let X be the random number on a die: from 1 to. (i) What is the distribution of X? (ii) Calculate EX. (iii) Calculate EX 2. (iv) Calculate Var
More informationCS4705. Probability Review and Naïve Bayes. Slides from Dragomir Radev
CS4705 Probability Review and Naïve Bayes Slides from Dragomir Radev Classification using a Generative Approach Previously on NLP discriminative models P C D here is a line with all the social media posts
More informationHW1 Solutions. October 5, (20 pts.) Random variables, sample space and events Consider the random experiment of ipping a coin 4 times.
HW1 Solutions October 5, 2016 1. (20 pts.) Random variables, sample space and events Consider the random experiment of ipping a coin 4 times. 1. (2 pts.) Dene the appropriate random variables. Answer:
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationExpected Value 7/7/2006
Expected Value 7/7/2006 Definition Let X be a numerically-valued discrete random variable with sample space Ω and distribution function m(x). The expected value E(X) is defined by E(X) = x Ω x m(x), provided
More informationEE126: Probability and Random Processes
EE126: Probability and Random Processes Lecture 1: Probability Models Abhay Parekh UC Berkeley January 18, 2011 1 Logistics 2 Introduction 3 Model 4 Examples What is this course about? Most real-world
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationConditional Probability, Independence, Bayes Theorem Spring January 1, / 28
Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2014 January 1, 2017 1 / 28 Sample Space Confusions 1. Sample space = set of all possible outcomes of an experiment. 2. The size of the
More informationUncertainty. Russell & Norvig Chapter 13.
Uncertainty Russell & Norvig Chapter 13 http://toonut.com/wp-content/uploads/2011/12/69wp.jpg Uncertainty Let A t be the action of leaving for the airport t minutes before your flight Will A t get you
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationBayes Rule for probability
Bayes Rule for probability P A B P A P B A PAP B A P AP B A An generalization of Bayes Rule Let A, A 2,, A k denote a set of events such that S A A2 Ak and Ai Aj for all i and j. Then P A i B P Ai P B
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationAllais Paradox. The set of prizes is X = {$0, $1, 000, 000, $5, 000, 000}.
1 Allais Paradox The set of prizes is X = {$0, $1, 000, 000, $5, 000, 000}. Which probability do you prefer: p 1 = (0.00, 1.00, 0.00) or p 2 = (0.01, 0.89, 0.10)? Which probability do you prefer: p 3 =
More informationConditional Probability, Independence, Bayes Theorem Spring 2018
Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2018 Slides are Posted Don t forget that after class we post the slides including solutions to all the questions. February 13, 2018 2 /
More informationTopic 2 Multiple events, conditioning, and independence, I. 2.1 Two or more events on the same sample space
CSE 103: Probability and statistics Fall 2010 Topic 2 Multiple events, conditioning, and independence, I 2.1 Two or more events on the same sample space Frequently we end up dealing with multiple events
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More informationDiscrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10
EECS 70 Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 Introduction to Basic Discrete Probability In the last note we considered the probabilistic experiment where we flipped
More informationProbability Distributions. Conditional Probability
Probability Distributions. Conditional Probability Russell Impagliazzo and Miles Jones Thanks to Janine Tiefenbruck http://cseweb.ucsd.edu/classes/sp16/cse21-bd/ May 16, 2016 In probability, we want to
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationNotes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 16 Notes. Class URL:
Notes slides from before lecture CSE 21, Winter 2017, Section A00 Lecture 16 Notes Class URL: http://vlsicad.ucsd.edu/courses/cse21-w17/ Notes slides from before lecture Notes March 8 (1) This week: Days
More informationLecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationn How to represent uncertainty in knowledge? n Which action to choose under uncertainty? q Assume the car does not have a flat tire
Uncertainty Uncertainty Russell & Norvig Chapter 13 Let A t be the action of leaving for the airport t minutes before your flight Will A t get you there on time? A purely logical approach either 1. risks
More informationChapter 3 Conditional Probability and Independence. Wen-Guey Tzeng Computer Science Department National Chiao Tung University
Chapter 3 Conditional Probability and Independence Wen-Guey Tzeng Computer Science Department National Chiao Tung University Conditional probability P(A B) = the probability of event A given the occurrence
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationBasic Probability Theory (I)
1 Basic Probability Theory (I) Adrian Brasoveanu [partly based on slides by Sharon Goldwater & Frank Keller and materials by John K. Kruschke] April 22, 2014 2 1 Sample Spaces and Events Sample Spaces
More informationCSE 21 Math for Algorithms and Systems Analysis. Lecture 11 Bayes Rule and Random Variables
CSE 21 Math for Algorithms and Systems Analysis Lecture 11 Bayes Rule and Random Variables Outline Review of CondiConal Probability Bayes Rule Random Variables DefiniCon of CondiConal Probability U P (A
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities Dr. Jing Yang jingyang@uark.edu OUTLINE 2 Applications
More informationORF 245 Fundamentals of Statistics Chapter 5 Probability
ORF 245 Fundamentals of Statistics Chapter 5 Probability Robert Vanderbei Oct 2015 Slides last edited on October 14, 2015 http://www.princeton.edu/ rvdb Sample Spaces (aka Populations) and Events When
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 4: Sequential experiments Andrew McGregor University of Massachusetts Last Compiled: February 2, 2017 Outline 1 Recap 2 Sequential Experiments 3 Total Probability
More informationChapter 7 Wednesday, May 26th
Chapter 7 Wednesday, May 26 th Random event A random event is an event that the outcome is unpredictable. Example: There are 45 students in this class. What is the probability that if I select one student,
More informationPERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY
Friends, we continue the discussion with fundamentals of discrete probability in the second session of third chapter of our course in Discrete Mathematics. The conditional probability and Baye s theorem
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationFormalizing Probability. Choosing the Sample Space. Probability Measures
Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take
More informationProbability Pearson Education, Inc. Slide
Probability The study of probability is concerned with random phenomena. Even though we cannot be certain whether a given result will occur, we often can obtain a good measure of its likelihood, or probability.
More informationConditional Probability and Bayes Theorem (2.4) Independence (2.5)
Conditional Probability and Bayes Theorem (2.4) Independence (2.5) Prof. Tesler Math 186 Winter 2019 Prof. Tesler Conditional Probability and Bayes Theorem Math 186 / Winter 2019 1 / 38 Scenario: Flip
More informationConsider an experiment that may have different outcomes. We are interested to know what is the probability of a particular set of outcomes.
CMSC 310 Artificial Intelligence Probabilistic Reasoning and Bayesian Belief Networks Probabilities, Random Variables, Probability Distribution, Conditional Probability, Joint Distributions, Bayes Theorem
More informationProbability. VCE Maths Methods - Unit 2 - Probability
Probability Probability Tree diagrams La ice diagrams Venn diagrams Karnough maps Probability tables Union & intersection rules Conditional probability Markov chains 1 Probability Probability is the mathematics
More informationIntroduction to Probability 2017/18 Supplementary Problems
Introduction to Probability 2017/18 Supplementary Problems Problem 1: Let A and B denote two events with P(A B) 0. Show that P(A) 0 and P(B) 0. A A B implies P(A) P(A B) 0, hence P(A) 0. Similarly B A
More informationCHAPTER - 16 PROBABILITY Random Experiment : If an experiment has more than one possible out come and it is not possible to predict the outcome in advance then experiment is called random experiment. Sample
More informationV. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE
V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE A game of chance featured at an amusement park is played as follows: You pay $ to play. A penny a nickel are flipped. You win $ if either
More informationSome Basic Concepts of Probability and Information Theory: Pt. 1
Some Basic Concepts of Probability and Information Theory: Pt. 1 PHYS 476Q - Southern Illinois University January 18, 2018 PHYS 476Q - Southern Illinois University Some Basic Concepts of Probability and
More informationHomework 1. Spring 2019 (Due Tuesday January 22)
ECE 302: Probabilistic Methods in Electrical and Computer Engineering Spring 2019 Instructor: Prof. A. R. Reibman Homework 1 Spring 2019 (Due Tuesday January 22) Homework is due on Tuesday January 22 at
More informationGeneral Info. Grading
Syllabus & Policies General Info Lecture 1: Introduction, Set Theory, and Boolean Algebra Classroom: Perkins 2-072 Time: Mon - Fri, 2:00-3:15 pm Wed, 3:30-4:30 pm Sta 111 Colin Rundel May 13, 2014 Professor:
More informationLecture 4 An Introduction to Stochastic Processes
Lecture 4 An Introduction to Stochastic Processes Prof. Massimo Guidolin Prep Course in Quantitative Methods for Finance August-September 2017 Plan of the lecture Motivation and definitions Filtrations
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationPart (A): Review of Probability [Statistics I revision]
Part (A): Review of Probability [Statistics I revision] 1 Definition of Probability 1.1 Experiment An experiment is any procedure whose outcome is uncertain ffl toss a coin ffl throw a die ffl buy a lottery
More information