Chapter 7 Probability Basics

Size: px
Start display at page:

Download "Chapter 7 Probability Basics"

Transcription

1 Making Hard Decisions Chapter 7 Probability Basics Slide 1 of 62

2 Introduction A A,, 1 An Let be an event with possible outcomes: 1 A = Flipping a coin A = {Heads} A 2 = Ω {Tails} The total event (or sample space) of event is the collection of all possible outcomes of Ω= {Heads, Tails} A A Formally: Ω= A A A A = A 1 2 n 1 n i = 1 i n Slide 2 of 62

3 Probability Calculus Probability rules may be derived using VENN DIAGRAMS 1. Probabilities must be between 0 and 1 for all possible outcomes in the sample space : Ω A 1 Ω 0 Pr( A i ) 1, for all outcomes Ai that are in Ratio of the area of the oval and the area of the total rectangle can be interpreted as the probability of the event Ω Slide 3 of 62

4 Probability Calculus 2. Probabilities must add up if both events cannot occur at the same time: A 1 A 2 Ω A 1 A2 = φ Pr( A1 A2 ) = Pr( A1 ) + Pr( A2 ) Slide 4 of 62

5 Probability Calculus A A 3. If,, 1 n are all the possible outcomes and not two of these can occur at the same time, their Total Probability must sum up to 1: A1 A2 A 3 A,, 1 An Ω are said to be collectively exhaustive and mutually exclusive Slide 5 of 62

6 Probability Calculus 4. The probability of the complement of equals 1 minus the probability of A 1 A 1 A1 A1 Pr( A1 ) = 1 Pr( A1 ) Ω Slide 6 of 62

7 Probability Calculus 5. If two events can occur at the same time the probability of either of them happening or both equals the sum of their individual probability minus the probability of them both happening at the same time. A1 A2 Ω Pr( A1 A2 ) = Pr( A1 ) + Pr( A2 ) Pr( A1 A2 ) Slide 7 of 62

8 Probability Calculus 6. Conditional probability: Dow Jones Up { Ω New Total Event based on the condition that we know that the Dow Jones went up Stock Price Up Slide 8 of 62

9 Probability Calculus: Conditional Probability Pr( Stock Dow ) = Pr( Stock Dow Pr( Dow ) ) Intuition: If I know that the market as a whole will go up, the chances of the stock of an individual company going up will increase. Pr( A B) = Pr( A B) Pr( B) Informally: Conditioning on an event coincides with reducing the total event to the conditioning event Slide 9 of 62

10 Probability Calculus: Conditional Probability Example: The probability of drawing an ace of spades in a deck of 52 cards equals 1/52. However, if I tell you that I have an ace in my hands, the probability of it being the ace of spades equals ¼. Pr( Ace Space) 1/ 52 Pr( Spades Ace) = = = Pr( Ace) 4 / Note also that: Pr( B A) = Pr( A B) Pr( A) Slide 10 of 62

11 Probability Calculus 7. Multiplicative Rule: Calculating the probability of two events happening at the same time. Pr( Ai B) = Pr( B A) Pr( A) = Pr( A B) Pr( B) 8. Independence between two events: Informally, two events are independent if information about one does not provide you any information about the other and vice versa. Consider: A A,, 1 An B B,, 1 Bm Event with possible outcomes Event with possible outcomes Slide 11 of 62

12 Probability Calculus: Independence A Example: is the event of flipping a coin and is the event of throwing a dice. If you know the outcome of flipping the coin you do not learn anything about the outcome of throwing the dice (regardless of the outcome of flipping the coin). Hence, these two events are independent. Formal definition of independence between event and event : B B A Pr( Ai Bj) = Pr( Ai) A For all possible combinations and i Bj Slide 12 of 62

13 Probability Calculus: Independence Equivalent definitions of independence between event and event : 1. B Pr( Bj Ai) = Pr( Bj) A For all possible combinations and i 2. Pr( A B ) = Pr( A) Pr( B ) i j i j A For all possible combinations and i Bj Bj A Independence/dependence in influence diagrams: No arrow between two chance nodes implies independence between the uncertain events An arrow from a chance event A to a chance event B does not mean that "A causes B". It indicates that information about A helps in determining the likelihood of outcomes of B. Slide 13 of 62

14 Probability Calculus: Conditional Independence Example: The performance of a person on any IQ test is uncertain and may range anywhere from 0% to 100%. However, if you to know that the person in question is highly intelligent it is expected his\her score will be high, e.g. ranging anywhere from 90% to 100%. On the other hand, the person s IQ does not explain this remaining uncertainty, and it may be considered measurement error affected by other conditions. For example, having a good night sleep during the previous night. On any two IQ tests, these measurement errors may be reasonably modeled as independent, if we know the IQ of the person. Slide 14 of 62

15 Probability Calculus: Conditional Independence A A,, 1 An B B,, 1 Bm C C,, 1 Cp Event with possible outcomes Event with possible outcomes Event with possible outcomes A B C Formal definition: Event and event are conditionally independent given event if and only if Pr( A B, C ) = Pr( A C ) i j k i k A, B For all possible combinations and i j Ck Informally: If I already know C, any information or knowledge about B does not tell me anything more about A Slide 15 of 62

16 Probability Calculus: Conditional Independence Equivalent definitions: Event and event are conditionally independent given event if and only if A C B 1. Pr( B A, C ) = Pr( B C ) j i k j k A, B For all possible combinations and i j Ck 2. Pr( A B C ) = Pr( A C ) Pr( B C ) i j k i k j k A, B For all possible combinations and i j C k Slide 16 of 62

17 Probability Calculus: Conditional Independence Equivalent definitions: Event and event are conditionally independent given event if and only if A C B 1. Pr( B A, C ) = Pr( B C ) j i k j k A, B For all possible combinations and i j Ck 2. Pr( A B C ) = Pr( A C ) Pr( B C ) i j k i k j k A, B For all possible combinations and i j C k Slide 17 of 62

18 Probability Calculus: Conditional Independence Conditional independence in influence diagrams: C C A B A B Slide 18 of 62

19 Probability Calculus: Law of Total Probability Let B,, B 1 3 be mutually exclusive, collectively exhaustive: B 1 A B 3 B 2 Pr( A) = Pr( A B) + Pr( A B ) + Pr( A B ) Pr( A) = Pr( A B) Pr( B) + Pr( A B ) Pr( B ) + Pr( A B ) Pr( B ) Slide 19 of 62

20 Probability Calculus: Law of Total Probability Example: X = System fails SYSTEM: X, X = failure, X = No Failure A = Component A fails, B = Component B fails, C = Component C fails A B C Assume that components A, B and C operate independently. Slide 20 of 62

21 Probability Calculus: Law of Total Probability Task: Write the probability of failure Pr(X) as a function of the component failure probabilities Pr(A), Pr(B) and Pr(C). 1.Pr( X ) = Pr( X A) Pr( A) + Pr( X A) Pr( A) = = 1 Pr( A) + Pr( X A)Pr( A) 2.Pr( X A) = Pr( X B, A) Pr( B A) + Pr( X BA, ) Pr( B A) = Pr( X BA, ) Pr( B) + 0 Pr( B) = Pr( X BA, ) Pr( B) 3.Pr( X ) = Pr( A) + Pr( X B, A) Pr( B) Pr( A) Substitute result 2 into 3 Slide 21 of 62

22 Probability Calculus: Law of Total Probability Intermediate conclusion: Hence we need to further develop Pr( X B, A) 4.Pr( X BA, ) = Pr( X CBA,, )Pr( C BA, ) + Pr( X CBA,, ) Pr( C BA, ) = 1 Pr( C) + 0 Pr( C) = Pr( C) Substitute result 4 into 3 5.Pr( X ) = Pr( A) + Pr( C) Pr( B) Pr( A) 6.Pr( A) = 1 Pr( A) Substitute result 6 into 5 7.Pr( X) = Pr( A) + Pr( C) Pr( B) Pr( C) Pr( B) Pr( A) Slide 22 of 62

23 Probability Calculus: Law of Total Probability Example: Oil Wildcatter Problem Dry (?) Max Profit -100K Drill at Site 1 Low (?) High (?) 150K 500K Drill at Site 2 Dry (0.2) -200K Low (0.8) 50K Payoff at site 1 is uncertain. Dominating factor in eventual payoff at Site 1 is the presence of a dome or not. Slide 23 of 62

24 Probability Calculus: Law of Total Probability DOME Pr(Dome) Pr(No Dome) Outcome Pr(Outcome Dome) Outcome Pr(Outcome No Dome) Dry Dry Low Low High High Slide 24 of 62

25 Probability Calculus: Law of Total Probability Pr( Dry) = Pr( Dry Dome)Pr( Dome) + Pr( Dry No Dome)Pr( No Dome) = *0.400 = Pr( Low) = Pr( Low Dome)Pr( Dome) + Pr( Low No Dome)Pr( No Dome) = *0.400 = Pr( High) = Pr( High Dome)Pr( Dome) + Pr( High No Dome)Pr( No Dome) = *0.400 = Slide 25 of 62

26 Probability Calculus: Law of Total Probability Dome (0.600) Dry (0.600) Low (0.250) High (0.150) Dry (0.850) -100K 150K 500K -100K No Dome (0.400) Low (0.125) 150K LAW OF TOTAL PROBABILITY High (0.025) 500K Dry ( = 0.70) -100K Low ( = 0.20) 150K High ( = 0.10) 500K Informally: when we apply LOTP we are collapsing a probability tree Slide 26 of 62

27 Probability Calculus: Bayes Theorem Let B,, B 1 3 be mutually exclusive, collectively exhaustive: B 1 A B 3 B 2 1. From the multiplicative rule it follows that: Pr( A B ) = Pr( B A) Pr( A) = Pr( A B ) Pr( B ) j j j j Slide 27 of 62

28 Probability Calculus: Bayes Theorem 2. Dividing the LHS and RHS of 1. by Pr(A) yields: Pr( B A) = j Pr( A B ) Pr( B ) j Pr( A) 3. We may rewrite Pr(A) using the Law of Total Probability, yielding Pr( A) = Pr( A B) Pr( B) + Pr( A B ) Pr( B ) + Pr( A B ) Pr( B ) j 4. Substituting the result of 3. into 2. gives perhaps the most well known theorem in probability theory: Bayes Theorem. Slide 28 of 62

29 Probability Calculus: Bayes Theorem Pr( B A) j = Pr( A B ) Pr( B ) j Pr( A B ) Pr( B ) + Pr( A B ) Pr( B ) + Pr( A B ) Pr( B ) j Thomas Bayes (1702 to 1761): Bayes theory of probability was published in His conclusions were accepted by Laplace in 1781, rediscovered by Condorcet, and remained unchallenged until Boole questioned them. Since then Bayes' techniques have been subject to controversy. Source: Slide 29 of 62

30 Probability Calculus: Bayes Theorem Oil Wildcatter Problem Example Continued: We drilled at site 1 and the well is a high producer. Given this new information what are the chances that a dome exists? (Perhaps that information is important when attracting additional investors.) 1. From the rule for conditional probability it follows that: Pr( Dome High ) = 2. From the LOTP it follows that: Pr( High Dome)Pr( Dome) Pr( High) Pr( High) = Pr( High Dome) Pr( Dome) + Pr( High NoDome) Pr( NoDome) Slide 30 of 62

31 Probability Calculus: Bayes Theorem Oil Wildcatter Problem Example Continued: 3. Substitution of 2 in 1 yields: Pr( Dome High ) = Pr( High Dome)Pr( Dome) = Pr( High Dome)Pr( Dome) + Pr( High No Dome)Pr( No Dome) 0.150* * * = Pr(Dome) The Prior Probability Pr(Dome Data) The Posterior Probability Data = The well is a high produces Slide 31 of 62

32 Probability Calculus: Bayes Theorem Oil Wildcatter Problem Example Continued: Dome (0.600) Dry (0.600) Low (0.250) -100K 150K Notice that Pr(Dry),Pr(Low) and Pr(High) have been inserted in the tree.these were calculated using LOTP. No Dome (0.400) High (0.150) Dry (0.850) Low (0.125) High (0.025) -100K 150K 500K Notice that Pr(Dome High) has been inserted as well This one was calculated using Bayes Theorem. BAYES THEOREM Dry (0.7) Low (0.2) Dome (?) No Dome (?) Dome (?) -100K -100K 150K We need to fill out the Remainder of the question Marks. High (0.10) No Dome (?) Dome (0.90) No Dome (?) 150K 500K 500K Slide 32 of 62

33 Probability Calculus: Bayes Theorem Oil Wildcatter Problem Example Continued: When we reverse the order of the chance nodes in a decision tree we need to apply Bayes Theorem Pr(Dome) Pr(No Dome) X Pr(X Dome) Pr(X No Dome) Pr(X Dome) Pr(X No Dome) Pr(X) Pr(Dome X) Pr(No Dome X) Check Dry Low High Check Next, we allocate the probabilities from the table at their appropriate locations in the tree Slide 33 of 62

34 Probability Calculus: Bayes Theorem Oil Wildcatter Problem Example Continued: AFTER BAYES THEOREM Dome (0.514) -100K Dry (0.7) No Dome (0.486) -100K Low (0.2) Dome (0.750) 150K No Dome (0.250) 150K High (0.10) Dome (0.900) No Dome (0.100) 500K 500K Slide 34 of 62

35 Probability Calculus: Bayes Theorem The Game Show Example: Suppose we have a game show host and you. There are three doors and one of them contains a prize. The game show host knows the door containing the prize but of course does not convey this information to you. He asks you to pick a door. You picked Door 1 and are walking up to door 1 to open it when the game show host screams: STOP!. You stop and the game show host shows Door 3 which appears to be empty. Next, the game show asks: "DO YOU WANT TO SWITCH TO DOOR 2?" WHAT SHOULD YOU DO? Slide 35 of 62

36 Probability Calculus: Bayes Theorem The Game Show Example: Assumption 1: The game show host will never show the door with the prize. Assumption 2: The game show will never show the door that you picked. Define: D i ={Prize is behind door i }, i=1,,3 H i ={Host shows Door i containing no prize after you selected Door 1}, i=1,,3 1. It seems reasonable to set prior probabilities: Pr( D i ) = 1 3 Slide 36 of 62

37 Probability Calculus: Bayes Theorem 2. Apply LOTP to calculate Pr(H 3 ): 3 Pr( H3) = Pr( H3 Di) Pr( Di) = = * + 1* + 0* = Calculate Pr(D 1 H 3 ): 1 1 * Pr( H 3 D1 ) Pr( D1 ) Pr( D H ) = = Pr( H ) Apply the complement rule: 1 Pr( D H 3 ) = 1 Pr( D1 H 3 ) = 1 3 i= 1 1 = 2 = So YES, you should SWITCH since you would increase your chances of winning! Slide 37 of 62

38 Probability Calculus: Uncertain Quantities Example: When a student attempts to log on to a computer time-sharing system, either all ports are busy (B) in which case the student will fail to obtain access, or else there is at least one port free (F), in which case the student will be successful in accessing the system. Total Event: Ω= { B, F} Definition: For a given total event Ω, a random variable (rv) is any rule that associates a number with each Ω outcome in. In mathematical language, a random variable is a function whose domain is the total event and whose range is the real numbers. Slide 38 of 62

39 Probability Calculus: Uncertain Quantities B F Ω X( B ) = 0 X( F) = X( B) = 1 Example: Consider the experiment in which batteries are examined until a good (G) is obtained. Let B denote a bad Battery. Total Event: Ω= { G, BG, BBG, BBBG,...} Slide 39 of 62

40 Probability Calculus: Uncertain Quantities Define a rv X as follows: X = The number of batteries examined before the experiment terminates. Then: X ( G) = 1, X ( BG) = 2, X ( BBG) = 3, etc The argument of the random variable function is typically omitted. Hence, one writes Pr( X = 2) = Pr( Second Battery Works) Note that the above statement only has meaning with the above definition of the random variable. It is good practice to always include the definition of a random variable in words. Slide 40 of 62

41 Probability Calculus: Uncertain Quantities The nature of random variables can be discrete and continuous. Definition: A discrete random variable is an rv whose possible values either constitute a finite set or else can be listed in an infinite sequence in which there is a first element, a second element, and so on. (Think of the previous batter example). A random variable is continuous if its set of possible values consists of an entire interval on the number line. (For example, the failure time of a component). Slide 41 of 62

42 Discrete Probability Distributions The nature of random variables can be discrete and continuous. Definition: A discrete random variable is an rv whose possible values either constitute a finite set or else can be listed in an infinite sequence in which there is a first element, a second element, and so on. (Think of the previous batter example). A random variable is continuous if its set of possible values consists of an entire interval on the number line. (For example, the failure time of a component). Slide 42 of 62

43 Discrete Probability Distributions Example: Y = Number of Raisins in an Oatmeal Cookie Assume possible outcomes: Y=1,,5 Definition: The probability mass function (PMF) of Y is the collection of probabilities such that Pr(Y=i)=p i Y Pr(Y=i) Note that: Pr( Y = 1) + Pr( Y = 2) + Pr( Y = 3) + Pr( Y = 4) + Pr( Y = 5) = 5 i= 1 Pr( Y = i) = 1 Slide 43 of 62

44 Discrete Probability Distributions Graphical Depictions of PMF s p i 0.2 p i y y A Histogram An Line Graph Definition: The cumulative distribution function (CDF) of Y at y is the sum of the probabilities such that Y y: F ( y) = Pr( Y y) = Pr( Y = i) ii : y Slide 44 of 62

45 Discrete Probability Distributions Graphical Depictions of CDF: F(y) In Decision Analysis a CDF is referred to as a CUMMULATIVE RISK PROFILE and a PMF is referred to as a RISK PROFILE 0.15 y Slide 45 of 62

46 Probability Calculus: Expected Value We know the random variable Y has many possible outcomes. However, if you were forced to give a BEST GUESS for Y, what number would you give? (Managers, CEO s, Senators etc. typically like POINT ESTIMATES, unfortunately). Why not use the expected value of Y? n n E [ Y] y Pr( Y y ) y p = = = n i i i i i= 1 i= 1 Interpretation: If you were able to observe many outcomes of Y, the calculated average of all the outcomes would be close to E[Y]. If Z = g(y): = = = E[ Z] g( y ) Pr( Y y ) g( y ) p i i i i i= 1 i= 1 n Slide 46 of 62

47 Probability Calculus: Expected Value If Z=aY+b, a,b constants, Y a rv: E[ Z] = ae[ Y] + b If Z=aX+bY, a,b const., X,Y a rv: E[ Z] = ae[ X] + be[ Y] Oatmeal Cookie Example: Raisin (0.10) 2 Raisins (0.15) 3 Raisins (0.30) 4 Raisins (0.35) 5 Raisins (0.10) #Raisins # Raisins*Pr(Y = # Raisins) 1 1*0.10= *0.15= *0.30= *0.35= *0.10= On average an oatmeal cookie has 3.2 Raisins Slide 47 of 62

48 Variance and Standard Deviation We know the random variable Y has many possible outcomes. If you were forced to give a BEST GUESS for the uncertainty in Y, what number would you give? Some people prefer to give the range of the outcomes of Y, i.e. the MAX VALUE of Y minus the MIN VALUE of Y. However, this completely ignores that some values of Y may be more likely than others. SUGGESTION: Calculate the BEST GUESS for the DISTANCE from the MEAN. The standard deviation can be thought of such a guess. The standard deviation of Y is the square root of the variance of Y. Slide 48 of 62

49 Variance and Standard Deviation Variance: Var Y E Y E Y 2 ( ) = σy = [ [ ] ] ( 2 2 ) = E[ Y 2 Y E[ Y] + E [ Y] ] = E Y E Y E Y + E Y 2 2 [ ] 2 [ ] [ ] [ ] = E Y E Y 2 2 [ ] [ ] Standard Deviation: ( ) 2 σ Y = σy = E Y E Y [ ] [ ] Slide 49 of 62

50 Variance and Standard Deviation If Z=aY+b, a,b constants, Y a rv: Var Z 2 ( ) = a Var( Y ) If Z=aX+bY, a,b const., X,Y indepent rv s: Var Z a Var X b Var Y 2 2 ( ) = ( ) + ( ) Example: A $35.75 (0.24) (0.47) Max Profit $20 $35 Note that: (0.29) $50 E[ A] = E[ B] B $35.75 (0.25) (0.35) (0.40) -$9 $0 $95 Pr(Profit 0 A) = 0; Pr(Profit 0 B) = 0.6 Slide 50 of 62

51 Variance and Standard Deviation Alternative A Prob Profit Profit^2 Prob*Profit Prob*(Profit^2) Variance St. Dev E[ Y ] = = E 2 [ Y ] = E[ Y 2 ] = E[ Y 2 ] E 2 [ Y ] σ Y Alternative B Prob Profit Profit^2 Prob*Profit Prob*(Profit^2) Variance St. Dev Slide 51 of 62

52 Expected Value, Variance and Standard Deviation 10K Dry (0.7) Max Profit -100K Drill at Site 1 Low (0.2) 150K Example: Oil Wildcatter Problem Continued Drill at Site 2 0K High (0.1) Dry (0.2) Low (0.8) 500K -200K 50K Drill at Site 1 Prob Profit Profit^2 Prob*Profit Prob*(Profit^2) Variance St. Dev = E[Y ] = E 2 [ Y ] 2 = E[ Y ] = E[ Y 2 ] E 2 [ Y ] σ Y Slide 52 of 62

53 Expected Value, Variance and Standard Deviation 10K Dry (0.7) Max Profit -100K Drill at Site 1 Low (0.2) 150K Example: Oil Wildcatter Problem Continued Drill at Site 2 0K High (0.1) Dry (0.2) Low (0.8) 500K -200K 50K Drill at Site 2 Prob Profit Profit^2 Prob*Profit Prob*(Profit^2) Variance St. Dev = E[Y ] = E 2 [ Y ] 2 = E[ Y ] = E[ Y 2 ] E 2 [ Y ] σ Y Slide 53 of 62

54 Expected Value, Variance and Standard Deviation Max Profit EMV=10K Drill at Site 1 Dome (0.6) EMV=52.50K Dry (0.60) Low (0.25) High (0.15) -100K 150K 500K Prob Profit Prob*Profit EMV= 10K EMV=0K Drill at Site 2 No Dome (0.4) Prob Profit Prob*Profit EMV=-53.75K Dry (0.2) Low (0.8) Dry (0.850) Low (0.125) High (0.025) -100K 150K 500K -200K 50K Prob Profit Prob*Profit Prob Profit Prob*Profit Expected Values can be calculated by folding back the tree Slide 54 of 62

55 Continuous Probability Distributions Let: X = The failure time of a component Definition: Let X be a continuous rv. Then a probability density function (pdf) of X is a function f(x) such that for any two numbers a and b with a < b: b Pr( X [ ab, ]) f( xdx ) f(x) = a For f(x) to be a legitamate pdf we must have: f( x) x, for all possible values x a b x f( x) dx = 1 Slide 55 of 62

56 Continuous Probability Distributions Cumulative distribution function: f(u) F( x) = Pr( X x) = f( u) du x The p-th quantile x p : x u f(x) F( x ) = Pr( X x ) = p p p F(x) 1 p x p x x p x Slide 56 of 62

57 Continuous Probability Distributions Let: X = The failure time of a component f(x) Pr( a X b) a b x f(x) F( x) = Pr( X a) f(x) F( x) = Pr( X b) a x b Conclusion: Pr( a X b) = Pr( X b) Pr( X a) = F( b) F( a) x Slide 57 of 62

58 Continuous Probability Distributions Examples theoretical density functions: ( x µ ) Normal: f ( x) = exp( ), x R 2 σ 2π 2 σ Exponential: f ( x) = λ exp( λ x), x > 0 Beta: More in Chapter 9 Expected Value: Variance: Γ ( α + β) f x x x x Γ( α) Γ( β) α 1 β 1 ( ) = (1 ), [0,1] E[ X] = xf( x) dx 2 Var( X ) ( x E[ X ]) f ( x) dx = Formulas carry over from the discrete to the continuous case Slide 58 of 62

59 Dominance Revisited DETERMINISTIC DOMINANCE Assume random Variable X Uniformly Distributed on [A,B] Assume random Variable Y Uniformly Distributed on [C,D] PDF X Y 0 CDF 1 0 A B C D X Y A B C D Slide 59 of 62

60 Dominance Revisited STOCHASTIC DOMINANCE Assume random Variable X Uniformly Distributed on [A,B] Assume random Variable Y Uniformly Distributed on [C,D] PDF X Y Note: Pr(Y<z) < Pr(X< z) for all z 0 CDF 1 A X C B Y D 0 A C B D Slide 60 of 62

61 Dominance Revisited CHOOSE ALTERNATIVE WITH BEST EMV Assume random Variable X Uniformly Distributed on [A,B] Assume random Variable Y Uniformly Distributed on [C,D] E(X) E(Y) X PDF Y 0 CDF 1 0 C A C A X Y B B D D Slide 61 of 62

62 Making Decisions under Uncertainty Deterministic Dominance Present Stochastic Dominance Present Chances of an unlucky outcome increase Making Decisions based on EMV Slide 62 of 62

II. RISK ANALYSIS: Modelling Risk and Uncertainty

II. RISK ANALYSIS: Modelling Risk and Uncertainty Part II: RISK ANALYSIS: Modelling Risk and Uncertainty 1 II. RISK ANALYSIS: Modelling Risk and Uncertainty 1. Basic Probability Review Chapter 7, Clemen 2. Expert Judgment Chapter 8, Clemen 3. Theoretical

More information

Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com

Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com 1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix

More information

Basics on Probability. Jingrui He 09/11/2007

Basics on Probability. Jingrui He 09/11/2007 Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability

More information

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 EECS 70 Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 Introduction to Basic Discrete Probability In the last note we considered the probabilistic experiment where we flipped

More information

Review of Basic Probability Theory

Review of Basic Probability Theory Review of Basic Probability Theory James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 35 Review of Basic Probability Theory

More information

Making Hard Decision. Probability Basics. ENCE 627 Decision Analysis for Engineering

Making Hard Decision. Probability Basics. ENCE 627 Decision Analysis for Engineering CHAPTER Duxbury Thomson Learning Making Hard Decision Probability asics Third Edition A. J. Clark School of Engineering Department of Civil and Environmental Engineering 7b FALL 003 y Dr. Ibrahim. Assakkaf

More information

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten

More information

A Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.

A Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,

More information

Probability. Lecture Notes. Adolfo J. Rumbos

Probability. Lecture Notes. Adolfo J. Rumbos Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................

More information

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables

ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Random Variable Discrete Random

More information

Deep Learning for Computer Vision

Deep Learning for Computer Vision Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair

More information

P (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).

P (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B). Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,

More information

Formalizing Probability. Choosing the Sample Space. Probability Measures

Formalizing Probability. Choosing the Sample Space. Probability Measures Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take

More information

Single Maths B: Introduction to Probability

Single Maths B: Introduction to Probability Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction

More information

Recitation 2: Probability

Recitation 2: Probability Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions

More information

Review of probability. Nuno Vasconcelos UCSD

Review of probability. Nuno Vasconcelos UCSD Review of probability Nuno Vasconcelos UCSD robability probability is the language to deal with processes that are non-deterministic examples: if I flip a coin 00 times how many can I expect to see heads?

More information

6.262: Discrete Stochastic Processes 2/2/11. Lecture 1: Introduction and Probability review

6.262: Discrete Stochastic Processes 2/2/11. Lecture 1: Introduction and Probability review 6.262: Discrete Stochastic Processes 2/2/11 Lecture 1: Introduction and Probability review Outline: Probability in the real world Probability as a branch of mathematics Discrete stochastic processes Processes

More information

Probabilities and Expectations

Probabilities and Expectations Probabilities and Expectations Ashique Rupam Mahmood September 9, 2015 Probabilities tell us about the likelihood of an event in numbers. If an event is certain to occur, such as sunrise, probability of

More information

Brief Review of Probability

Brief Review of Probability Brief Review of Probability Nuno Vasconcelos (Ken Kreutz-Delgado) ECE Department, UCSD Probability Probability theory is a mathematical language to deal with processes or experiments that are non-deterministic

More information

Probability the chance that an uncertain event will occur (always between 0 and 1)

Probability the chance that an uncertain event will occur (always between 0 and 1) Quantitative Methods 2013 1 Probability as a Numerical Measure of the Likelihood of Occurrence Probability the chance that an uncertain event will occur (always between 0 and 1) Increasing Likelihood of

More information

Chapter 1. Probability, Random Variables and Expectations. 1.1 Axiomatic Probability

Chapter 1. Probability, Random Variables and Expectations. 1.1 Axiomatic Probability Chapter 1 Probability, Random Variables and Expectations Note: The primary reference for these notes is Mittelhammer (1999. Other treatments of probability theory include Gallant (1997, Casella & Berger

More information

Business Statistics. Lecture 3: Random Variables and the Normal Distribution

Business Statistics. Lecture 3: Random Variables and the Normal Distribution Business Statistics Lecture 3: Random Variables and the Normal Distribution 1 Goals for this Lecture A little bit of probability Random variables The normal distribution 2 Probability vs. Statistics Probability:

More information

Lecture 1: Basics of Probability

Lecture 1: Basics of Probability Lecture 1: Basics of Probability (Luise-Vitetta, Chapter 8) Why probability in data science? Data acquisition is noisy Sampling/quantization external factors: If you record your voice saying machine learning

More information

Discrete Random Variables

Discrete Random Variables Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan Introduction The markets can be thought of as a complex interaction of a large number of random processes,

More information

1. When applied to an affected person, the test comes up positive in 90% of cases, and negative in 10% (these are called false negatives ).

1. When applied to an affected person, the test comes up positive in 90% of cases, and negative in 10% (these are called false negatives ). CS 70 Discrete Mathematics for CS Spring 2006 Vazirani Lecture 8 Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According to clinical trials,

More information

4. Suppose that we roll two die and let X be equal to the maximum of the two rolls. Find P (X {1, 3, 5}) and draw the PMF for X.

4. Suppose that we roll two die and let X be equal to the maximum of the two rolls. Find P (X {1, 3, 5}) and draw the PMF for X. Math 10B with Professor Stankova Worksheet, Midterm #2; Wednesday, 3/21/2018 GSI name: Roy Zhao 1 Problems 1.1 Bayes Theorem 1. Suppose a test is 99% accurate and 1% of people have a disease. What is the

More information

MATH MW Elementary Probability Course Notes Part I: Models and Counting

MATH MW Elementary Probability Course Notes Part I: Models and Counting MATH 2030 3.00MW Elementary Probability Course Notes Part I: Models and Counting Tom Salisbury salt@yorku.ca York University Winter 2010 Introduction [Jan 5] Probability: the mathematics used for Statistics

More information

Lecture 2: Repetition of probability theory and statistics

Lecture 2: Repetition of probability theory and statistics Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:

More information

Midterm Exam 1 (Solutions)

Midterm Exam 1 (Solutions) EECS 6 Probability and Random Processes University of California, Berkeley: Spring 07 Kannan Ramchandran February 3, 07 Midterm Exam (Solutions) Last name First name SID Name of student on your left: Name

More information

Econ 113. Lecture Module 2

Econ 113. Lecture Module 2 Econ 113 Lecture Module 2 Contents 1. Experiments and definitions 2. Events and probabilities 3. Assigning probabilities 4. Probability of complements 5. Conditional probability 6. Statistical independence

More information

STAT2201. Analysis of Engineering & Scientific Data. Unit 3

STAT2201. Analysis of Engineering & Scientific Data. Unit 3 STAT2201 Analysis of Engineering & Scientific Data Unit 3 Slava Vaisman The University of Queensland School of Mathematics and Physics What we learned in Unit 2 (1) We defined a sample space of a random

More information

Review Basic Probability Concept

Review Basic Probability Concept Economic Risk and Decision Analysis for Oil and Gas Industry CE81.9008 School of Engineering and Technology Asian Institute of Technology January Semester Presented by Dr. Thitisak Boonpramote Department

More information

Probability and Probability Distributions. Dr. Mohammed Alahmed

Probability and Probability Distributions. Dr. Mohammed Alahmed Probability and Probability Distributions 1 Probability and Probability Distributions Usually we want to do more with data than just describing them! We might want to test certain specific inferences about

More information

Course: ESO-209 Home Work: 1 Instructor: Debasis Kundu

Course: ESO-209 Home Work: 1 Instructor: Debasis Kundu Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear

More information

Elementary Discrete Probability

Elementary Discrete Probability Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,

More information

Lecture 3 Probability Basics

Lecture 3 Probability Basics Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability

More information

Probability Year 9. Terminology

Probability Year 9. Terminology Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some

More information

Bandits, Experts, and Games

Bandits, Experts, and Games Bandits, Experts, and Games CMSC 858G Fall 2016 University of Maryland Intro to Probability* Alex Slivkins Microsoft Research NYC * Many of the slides adopted from Ron Jin and Mohammad Hajiaghayi Outline

More information

Expectations and Variance

Expectations and Variance 4. Model parameters and their estimates 4.1 Expected Value and Conditional Expected Value 4. The Variance 4.3 Population vs Sample Quantities 4.4 Mean and Variance of a Linear Combination 4.5 The Covariance

More information

Chapter 2 Random Variables

Chapter 2 Random Variables Stochastic Processes Chapter 2 Random Variables Prof. Jernan Juang Dept. of Engineering Science National Cheng Kung University Prof. Chun-Hung Liu Dept. of Electrical and Computer Eng. National Chiao Tung

More information

ELEG 3143 Probability & Stochastic Process Ch. 1 Probability

ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random

More information

Probability Year 10. Terminology

Probability Year 10. Terminology Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some

More information

Quiz 1. Name: Instructions: Closed book, notes, and no electronic devices.

Quiz 1. Name: Instructions: Closed book, notes, and no electronic devices. Quiz 1. Name: Instructions: Closed book, notes, and no electronic devices. 1.(10) What is usually true about a parameter of a model? A. It is a known number B. It is determined by the data C. It is an

More information

With Question/Answer Animations. Chapter 7

With Question/Answer Animations. Chapter 7 With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements

More information

Math 151. Rumbos Spring Solutions to Review Problems for Exam 1

Math 151. Rumbos Spring Solutions to Review Problems for Exam 1 Math 5. Rumbos Spring 04 Solutions to Review Problems for Exam. There are 5 red chips and 3 blue chips in a bowl. The red chips are numbered,, 3, 4, 5 respectively, and the blue chips are numbered,, 3

More information

Review of Probability. CS1538: Introduction to Simulations

Review of Probability. CS1538: Introduction to Simulations Review of Probability CS1538: Introduction to Simulations Probability and Statistics in Simulation Why do we need probability and statistics in simulation? Needed to validate the simulation model Needed

More information

Each trial has only two possible outcomes success and failure. The possible outcomes are exactly the same for each trial.

Each trial has only two possible outcomes success and failure. The possible outcomes are exactly the same for each trial. Section 8.6: Bernoulli Experiments and Binomial Distribution We have already learned how to solve problems such as if a person randomly guesses the answers to 10 multiple choice questions, what is the

More information

Probability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces.

Probability Theory. Introduction to Probability Theory. Principles of Counting Examples. Principles of Counting. Probability spaces. Probability Theory To start out the course, we need to know something about statistics and probability Introduction to Probability Theory L645 Advanced NLP Autumn 2009 This is only an introduction; for

More information

UC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Solutions 5 Spring 2006

UC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Solutions 5 Spring 2006 Review problems UC Berkeley Department of Electrical Engineering and Computer Science EE 6: Probablity and Random Processes Solutions 5 Spring 006 Problem 5. On any given day your golf score is any integer

More information

Discrete Random Variables

Discrete Random Variables Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan 2014 Introduction The markets can be thought of as a complex interaction of a large number of random

More information

Exam 1 Review With Solutions Instructor: Brian Powers

Exam 1 Review With Solutions Instructor: Brian Powers Exam Review With Solutions Instructor: Brian Powers STAT 8, Spr5 Chapter. In how many ways can 5 different trees be planted in a row? 5P 5 = 5! =. ( How many subsets of S = {,,,..., } contain elements?

More information

STAT Chapter 3: Probability

STAT Chapter 3: Probability Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):

More information

M378K In-Class Assignment #1

M378K In-Class Assignment #1 The following problems are a review of M6K. M7K In-Class Assignment # Problem.. Complete the definition of mutual exclusivity of events below: Events A, B Ω are said to be mutually exclusive if A B =.

More information

To find the median, find the 40 th quartile and the 70 th quartile (which are easily found at y=1 and y=2, respectively). Then we interpolate:

To find the median, find the 40 th quartile and the 70 th quartile (which are easily found at y=1 and y=2, respectively). Then we interpolate: Joel Anderson ST 37-002 Lecture Summary for 2/5/20 Homework 0 First, the definition of a probability mass function p(x) and a cumulative distribution function F(x) is reviewed: Graphically, the drawings

More information

MS-A0504 First course in probability and statistics

MS-A0504 First course in probability and statistics MS-A0504 First course in probability and statistics Heikki Seppälä Department of Mathematics and System Analysis School of Science Aalto University Spring 2016 Probability is a field of mathematics, which

More information

Analysis of Engineering and Scientific Data. Semester

Analysis of Engineering and Scientific Data. Semester Analysis of Engineering and Scientific Data Semester 1 2019 Sabrina Streipert s.streipert@uq.edu.au Example: Draw a random number from the interval of real numbers [1, 3]. Let X represent the number. Each

More information

Math489/889 Stochastic Processes and Advanced Mathematical Finance Solutions for Homework 7

Math489/889 Stochastic Processes and Advanced Mathematical Finance Solutions for Homework 7 Math489/889 Stochastic Processes and Advanced Mathematical Finance Solutions for Homework 7 Steve Dunbar Due Mon, November 2, 2009. Time to review all of the information we have about coin-tossing fortunes

More information

Class 26: review for final exam 18.05, Spring 2014

Class 26: review for final exam 18.05, Spring 2014 Probability Class 26: review for final eam 8.05, Spring 204 Counting Sets Inclusion-eclusion principle Rule of product (multiplication rule) Permutation and combinations Basics Outcome, sample space, event

More information

the time it takes until a radioactive substance undergoes a decay

the time it takes until a radioactive substance undergoes a decay 1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete

More information

Lecture 3: Probability

Lecture 3: Probability Lecture 3: Probability 28th of October 2015 Lecture 3: Probability 28th of October 2015 1 / 36 Summary of previous lecture Define chance experiment, sample space and event Introduce the concept of the

More information

S n = x + X 1 + X X n.

S n = x + X 1 + X X n. 0 Lecture 0 0. Gambler Ruin Problem Let X be a payoff if a coin toss game such that P(X = ) = P(X = ) = /2. Suppose you start with x dollars and play the game n times. Let X,X 2,...,X n be payoffs in each

More information

Great Theoretical Ideas in Computer Science

Great Theoretical Ideas in Computer Science 15-251 Great Theoretical Ideas in Computer Science Probability Theory: Counting in Terms of Proportions Lecture 10 (September 27, 2007) Some Puzzles Teams A and B are equally good In any one game, each

More information

Probabilistic models

Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation

More information

Probability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008

Probability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008 Probability theory for Networks (Part 1) CS 249B: Science of Networks Week 02: Monday, 02/04/08 Daniel Bilar Wellesley College Spring 2008 1 Review We saw some basic metrics that helped us characterize

More information

Introduction to probability

Introduction to probability Introduction to probability 4.1 The Basics of Probability Probability The chance that a particular event will occur The probability value will be in the range 0 to 1 Experiment A process that produces

More information

Joint Probability Distributions and Random Samples (Devore Chapter Five)

Joint Probability Distributions and Random Samples (Devore Chapter Five) Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01: Probability and Statistics for Engineers Spring 2013 Contents 1 Joint Probability Distributions 2 1.1 Two Discrete

More information

Probability. VCE Maths Methods - Unit 2 - Probability

Probability. VCE Maths Methods - Unit 2 - Probability Probability Probability Tree diagrams La ice diagrams Venn diagrams Karnough maps Probability tables Union & intersection rules Conditional probability Markov chains 1 Probability Probability is the mathematics

More information

Introduction to Stochastic Processes

Introduction to Stochastic Processes Stat251/551 (Spring 2017) Stochastic Processes Lecture: 1 Introduction to Stochastic Processes Lecturer: Sahand Negahban Scribe: Sahand Negahban 1 Organization Issues We will use canvas as the course webpage.

More information

Machine Learning

Machine Learning Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 13, 2011 Today: The Big Picture Overfitting Review: probability Readings: Decision trees, overfiting

More information

Some Basic Concepts of Probability and Information Theory: Pt. 1

Some Basic Concepts of Probability and Information Theory: Pt. 1 Some Basic Concepts of Probability and Information Theory: Pt. 1 PHYS 476Q - Southern Illinois University January 18, 2018 PHYS 476Q - Southern Illinois University Some Basic Concepts of Probability and

More information

Expected Value II. 1 The Expected Number of Events that Happen

Expected Value II. 1 The Expected Number of Events that Happen 6.042/18.062J Mathematics for Computer Science December 5, 2006 Tom Leighton and Ronitt Rubinfeld Lecture Notes Expected Value II 1 The Expected Number of Events that Happen Last week we concluded by showing

More information

L2: Review of probability and statistics

L2: Review of probability and statistics Probability L2: Review of probability and statistics Definition of probability Axioms and properties Conditional probability Bayes theorem Random variables Definition of a random variable Cumulative distribution

More information

Probability and distributions. Francesco Corona

Probability and distributions. Francesco Corona Probability Probability and distributions Francesco Corona Department of Computer Science Federal University of Ceará, Fortaleza Probability Many kinds of studies can be characterised as (repeated) experiments

More information

I - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability

I - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)

More information

Random variables. DS GA 1002 Probability and Statistics for Data Science.

Random variables. DS GA 1002 Probability and Statistics for Data Science. Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities

More information

SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416)

SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) SUMMARY OF PROBABILITY CONCEPTS SO FAR (SUPPLEMENT FOR MA416) D. ARAPURA This is a summary of the essential material covered so far. The final will be cumulative. I ve also included some review problems

More information

Lecture 2: Review of Probability

Lecture 2: Review of Probability Lecture 2: Review of Probability Zheng Tian Contents 1 Random Variables and Probability Distributions 2 1.1 Defining probabilities and random variables..................... 2 1.2 Probability distributions................................

More information

CS 361: Probability & Statistics

CS 361: Probability & Statistics February 12, 2018 CS 361: Probability & Statistics Random Variables Monty hall problem Recall the setup, there are 3 doors, behind two of them are indistinguishable goats, behind one is a car. You pick

More information

Lecture 6. Probability events. Definition 1. The sample space, S, of a. probability experiment is the collection of all

Lecture 6. Probability events. Definition 1. The sample space, S, of a. probability experiment is the collection of all Lecture 6 1 Lecture 6 Probability events Definition 1. The sample space, S, of a probability experiment is the collection of all possible outcomes of an experiment. One such outcome is called a simple

More information

Motivation. Stat Camp for the MBA Program. Probability. Experiments and Outcomes. Daniel Solow 5/10/2017

Motivation. Stat Camp for the MBA Program. Probability. Experiments and Outcomes. Daniel Solow 5/10/2017 Stat Camp for the MBA Program Daniel Solow Lecture 2 Probability Motivation You often need to make decisions under uncertainty, that is, facing an unknown future. Examples: How many computers should I

More information

ACE 562 Fall Lecture 2: Probability, Random Variables and Distributions. by Professor Scott H. Irwin

ACE 562 Fall Lecture 2: Probability, Random Variables and Distributions. by Professor Scott H. Irwin ACE 562 Fall 2005 Lecture 2: Probability, Random Variables and Distributions Required Readings: by Professor Scott H. Irwin Griffiths, Hill and Judge. Some Basic Ideas: Statistical Concepts for Economists,

More information

IEOR 3106: Introduction to Operations Research: Stochastic Models. Professor Whitt. SOLUTIONS to Homework Assignment 2

IEOR 3106: Introduction to Operations Research: Stochastic Models. Professor Whitt. SOLUTIONS to Homework Assignment 2 IEOR 316: Introduction to Operations Research: Stochastic Models Professor Whitt SOLUTIONS to Homework Assignment 2 More Probability Review: In the Ross textbook, Introduction to Probability Models, read

More information

This does not cover everything on the final. Look at the posted practice problems for other topics.

This does not cover everything on the final. Look at the posted practice problems for other topics. Class 7: Review Problems for Final Exam 8.5 Spring 7 This does not cover everything on the final. Look at the posted practice problems for other topics. To save time in class: set up, but do not carry

More information

STAT 414: Introduction to Probability Theory

STAT 414: Introduction to Probability Theory STAT 414: Introduction to Probability Theory Spring 2016; Homework Assignments Latest updated on April 29, 2016 HW1 (Due on Jan. 21) Chapter 1 Problems 1, 8, 9, 10, 11, 18, 19, 26, 28, 30 Theoretical Exercises

More information

STA Module 4 Probability Concepts. Rev.F08 1

STA Module 4 Probability Concepts. Rev.F08 1 STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret

More information

Machine Learning. Bayes Basics. Marc Toussaint U Stuttgart. Bayes, probabilities, Bayes theorem & examples

Machine Learning. Bayes Basics. Marc Toussaint U Stuttgart. Bayes, probabilities, Bayes theorem & examples Machine Learning Bayes Basics Bayes, probabilities, Bayes theorem & examples Marc Toussaint U Stuttgart So far: Basic regression & classification methods: Features + Loss + Regularization & CV All kinds

More information

Example A. Define X = number of heads in ten tosses of a coin. What are the values that X may assume?

Example A. Define X = number of heads in ten tosses of a coin. What are the values that X may assume? Stat 400, section.1-.2 Random Variables & Probability Distributions notes by Tim Pilachowski For a given situation, or experiment, observations are made and data is recorded. A sample space S must contain

More information

Introduction to Probability Theory, Algebra, and Set Theory

Introduction to Probability Theory, Algebra, and Set Theory Summer School on Mathematical Philosophy for Female Students Introduction to Probability Theory, Algebra, and Set Theory Catrin Campbell-Moore and Sebastian Lutz July 28, 2014 Question 1. Draw Venn diagrams

More information

UNIT 5 ~ Probability: What Are the Chances? 1

UNIT 5 ~ Probability: What Are the Chances? 1 UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions

Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions 1999 Prentice-Hall, Inc. Chap. 4-1 Chapter Topics Basic Probability Concepts: Sample

More information

SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions

SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions SYSM 6303: Quantitative Introduction to Risk and Uncertainty in Business Lecture 4: Fitting Data to Distributions M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu

More information

Computing Probability

Computing Probability Computing Probability James H. Steiger October 22, 2003 1 Goals for this Module In this module, we will 1. Develop a general rule for computing probability, and a special case rule applicable when elementary

More information

2011 Pearson Education, Inc

2011 Pearson Education, Inc Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive

More information

Notes Week 2 Chapter 3 Probability WEEK 2 page 1

Notes Week 2 Chapter 3 Probability WEEK 2 page 1 Notes Week 2 Chapter 3 Probability WEEK 2 page 1 The sample space of an experiment, sometimes denoted S or in probability theory, is the set that consists of all possible elementary outcomes of that experiment

More information

Notes on probability : Exercise problems, sections (1-7)

Notes on probability : Exercise problems, sections (1-7) Notes on probability : Exercise problems, sections (1-7) 1 Random variables 1.1 A coin is tossed until for the first time the same result appears twice in succession. To every possible outcome requiring

More information

6.041/6.431 Spring 2009 Quiz 1 Wednesday, March 11, 7:30-9:30 PM. SOLUTIONS

6.041/6.431 Spring 2009 Quiz 1 Wednesday, March 11, 7:30-9:30 PM. SOLUTIONS 6.0/6.3 Spring 009 Quiz Wednesday, March, 7:30-9:30 PM. SOLUTIONS Name: Recitation Instructor: Question Part Score Out of 0 all 0 a 5 b c 5 d 5 e 5 f 5 3 a b c d 5 e 5 f 5 g 5 h 5 Total 00 Write your solutions

More information

Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016

Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying

More information

Uncertainty. Michael Peters December 27, 2013

Uncertainty. Michael Peters December 27, 2013 Uncertainty Michael Peters December 27, 20 Lotteries In many problems in economics, people are forced to make decisions without knowing exactly what the consequences will be. For example, when you buy

More information

Lecture 2. Conditional Probability

Lecture 2. Conditional Probability Math 408 - Mathematical Statistics Lecture 2. Conditional Probability January 18, 2013 Konstantin Zuev (USC) Math 408, Lecture 2 January 18, 2013 1 / 9 Agenda Motivation and Definition Properties of Conditional

More information

Conditional Probability

Conditional Probability Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.

More information