Law of Total Probability and Bayes Rule
|
|
- Katrina Short
- 6 years ago
- Views:
Transcription
1 MATH 382 Law of Total Probability and Bayes Rule Dr Neal, WKU Law of Total Probability: Suppose events A 1, A 2,, A n form a partition of Ω That is, the events are mutually disjoint and their union is all of Ω Then for any other event B, we have P(B) P(A 1 ) P(B A 1 ) + P(A 2 ) P( B A 2 ) + +P(A n ) P( B A n ) A 3 A n A 2 A 1 A 1 A 2 A n Ω, all mutually disjoint n Proof Because the A i are all disjoint, the sets {B A i } i 1 are all disjoint Moreover, n n these sets union to B because B B Ω B A i (B A i ) So by the additivity i 1 i 1 of P and the Multiplication Principle, we have n P(B) P ( B A i ) n P( n B A i ) P( A i ) P(B A i ) i 1 i 1 P(A 1 ) P(B A 1 ) + P(A 2 ) P( B A 2 ) + +P(A n ) P( B A n ) i 1 Ω Bayes Rule (Reverse Conditionals): Given that event B has occurred, the probability of a partition event A j is given by P(A j B) P( A j B) P( B) P( A j ) P(B A j ) P( A 1 ) P(B A 1 ) + + P(A n ) P( B A n ) Example 1 Among Kentucky registered voters, 30% are Republican, 50% are Democrat, and 20% are Other The percentages that support the President among these groups are respectively 010, 080, and 060 (a) What percentage of KY registered voters support the President? (b) If one supports the President, then what is the probability that one is a Democrat? (c) If does not support the President, then what is the probability that one is a Republican?
2 Solution (a) Here the partition is A 1 R, A 2 D, and A 3 O Let S denote those that support the president Then, by the law of Total Probability, we have P(S) P( R) P(S R) + P(D) P(S D) + P(O) P(S O) So 55% currently support the President (b) Applying Bayes Rule, we obtain P(D S) P( D)P(S D) P(S) (c) Using the fact that P(S c R) 1 P(S R) 090 along with Bayes Rule, we obtain P(R S c ) P(R)P(Sc R) P(S c ) Example 2 Suppose 10% of major league ball players use enhancers such as steroids or Andro If one uses, then a test will say YES 99% of the time If one doesn't use, then a test will say NO 98% of the time (a) Find the probability that a randomly chosen major leaguer will test positive (b) If one tests positive, what are the probabilities that they do/don't use enhancers (c) If one tests negative, what are the probabilities that they do/don't use enhancers Solution Let Ω be the sample space of major league ball players, and let E be those that use an Enhancer Then Ω E E c is a partition Now let Y denote a Positive Test Then we are given P(E) 010, P(E c ) 090, P(Y E) 099, P(N E c ) 098 From the given information, we also have P(N E) 001 and P(Y E c ) 002 (which is the probability of a false positive (a) We then have P(Y ) P( E) P(Y E ) + P(E c ) P(Y E c ) (b) By Bayes Rule, we have P(E Y) P(E )P(Y E ) P(Y) and P(E c Y) 1 P( E Y) (or P(E c Y) / 0117 )
3 (c) P(E N) P(E N ) P( N) P(E)P( N E ) P(Y c ) P(E c N ) P(Ec ) P( N E c ) P( N) (or use 1 P( E N )) So what happens if somebody tests positive? The sample is independently tested again by other labs If you are clean, the chance of testing positive three times in a row is (almost impossible, but not quite) Also note, about 11 in 10,000 negative tests are wrong But that's why athletes are tested over and over throughout the season A user will eventually be caught The next result is a variation of the multiplication principle: Theorem P(A B C) P( A C) P( B A C) Proof Applying the definition of conditional probability, we obtain: P(A C) P(B A C) P( A C) P(C) P(( A B) C)) P(C) P( A B C) P( B ( A C)) P( A C) Example 3 Draw two cards from a deck without replacement (a) What is the probability that the second is a King? (b) Given that there was a King on the 2nd, what is the probability that there was a King on the 1st? (c) What is the probability that the first is a face card and the second is a King? Solution (a) The result depends on the 1st draw A partition of the 1st draw is K 1 King on 1st, K 1 c No King on 1st Let K2 King on Second Then, P(K 2 ) P(K 1 ) P(K 2 K 1 ) + P(K 1 c ) P(K2 K 1 c ) (3 + 48)
4 (b) By Bayes Rule, we have P(K 1 K 2 ) P(K 1)P(K 2 K 1 ) P(K 2 ) (1 / 13) (3 / 51) (1 / 13) 3 51 (c) Let F 1 face on 1st Then we want P(F 1 K 2 ) But this value still depends on K 1 So we have P(F 1 K 2 ) P( K 1 ) P(F 1 K 2 K 1 ) + P( K 1 c ) P(F 1 K 2 K 1 c ) P( K 1 ) P(F 1 K 1 ) P(K 2 F 1 K 1 ) + P(K 1 c ) P( F1 K 1 c ) P( K2 F 1 K 1 c ) This result also can be computed by P(K 1 ) P( K 2 K 1 ) + P( F 1 K 1 c ) P( K2 F 1 K 1 c )
5 Exercises 1 Bowl A has 3 red chips and 5 blue chips Bowl B has 5 red chips and 4 blue chips A chip is chosen at random from Bowl A and placed in Bowl B Then a chip is chosen at random from Bowl B (a) Compute the probability that the second chip chosen is Red (b) Given that the second chip chosen was red, what is the probability that the first chosen chip was red? (c) Given that the second chip chosen was blue, what is the probability that the first chosen chip was blue? 2 Bowl A has five $5 bills, four $10 bills, and three $20 bills Bowl B has five $10 bills, four $20 bills, and three $50 bills Bowl C has five $20 bills, four $50 bills, and three $100 bills Roll two dice If you roll a sum of 2, 3, 4, or 5, then you pick a bill at random from A If you roll a sum of 6, 7, or 8, then you pick a bill at random from B If you roll a sum of 9, 10, 11, or 12, then you pick a bill at random from C (a) What is the probability that you pick a $20 bill? (b) If you pick a $20 bill, then what is the probability that you rolled a 6, 7, or 8? (c) If you don't pick a $20 bill, then what is the probability that you did not roll a 2, 3, 4, or 5? (d) If you pick a $5 bill, then what is the probability that you rolled a 2, 3, 4, or 5? (e) If you don't pick a $100 bill, then what is the probability that you rolled a 9, 10, 11, or 12? 3 Draw two cards from a deck without replacement (a) What is the probability that the second is a Face Card (J, Q, K)? (b) Given that there was a Face Card on the 2nd, what is the probability that there was a Face Card on the 1st? (c) What is the probability that the first is a High Card (10, J, Q, K A) and the second is a Face Card?
6 Addendum: Application to Confidential Random Sampling Let D be those students that use drugs How do we approximate P(D)? We can take a random survey and simply look at the sample proportion But suppose we are doing one-on-one interviews and we ask that question We might not get truthful answers Is there some way around this problem? Is there some way to ask the question so that the subject will feel more comfortable responding truthfully? Create 100 flash cards, where 60 have the statement I use drugs (C 1 ) and 40 have the statement I do not use drugs (C 2 ) Show the cards to the subject so that he or she can see that they are assorted and the backs are not marked Then have the subject pick a card at random without revealing the question to the surveyor The subject simply says True or False, and the surveyor does not even know which statement was read Now compute the sample proportion p of those that say True Then, P(T ) P(C 1 ) P(T C 1 ) + P(C 2 ) P(T C 2 ) 06 P(D C 1 ) P(D c C 2 ) 06 P(D) P(D c ) indep due to randomness 06 P(D) (1 P(D)) 02 P(D) Hence, p P(T ) 02 P(D) ; so P(D) p For example, suppose 10% actually use drugs Survey 1000 in this manner The results should be close to the following: C 1 C 2 D D c The number of True responses should be around So p should be close to 420/ Then we approximate P(D) by
7 Simpson s Paradox Following is an example that demonstrates how a lurking variable seemingly can cause a paradox when comparing the conditional percentages involving this variable with conditional percentages that do not involve the variable Example 10 Below are data on all recent patients undergoing surgery at two hospitals The data include the condition of the patient before the surgery Good Condition Poor Condition Hospital A Hospital B Hospital A Hospital B Died 6 8 Died 57 8 Survived Survived Total Total (a) Compare the percents to show that Hospital A has a higher survival rate for both groups of patients (b) But which hospital has the higher survival rate? In Hospital A: P(S G) In Hospital B: P(S G) and P(S P) and P(S P) So it seems that Hospital A has a higher survival rate for patients who were admitted in good condition and for patients who were admitted in poor condition But altogether, the survival rates are In Hospital A: P(S) In Hospital B: P(S) So Hospital B has the higher survival rate! Explain a b > e f and c d > g h but a + c b + d < e + g f + h (The huge number of patients admitted in poor condition to Hospital A heavily weights their overall average and brings it down) Example 11 Simpson s Paradox can be understood more easily from the following baseball statistics: Player 1: Hits 2 out of 4 (batting 500), then 1 out of 3 (333) 3/ Player 2: Hits 199/400 (batting < 500), then 0 for 2 (000) 199/
2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationEvent A: at least one tail observed A:
Chapter 3 Probability 3.1 Events, sample space, and probability Basic definitions: An is an act of observation that leads to a single outcome that cannot be predicted with certainty. A (or simple event)
More information(i) Given that a student is female, what is the probability of having a GPA of at least 3.0?
MATH 382 Conditional Probability Dr. Neal, WKU We now shall consider probabilities of events that are restricted within a subset that is smaller than the entire sample space Ω. For example, let Ω be the
More informationMA : Introductory Probability
MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:
More informationSTAT 516: Basic Probability and its Applications
Lecture 3: Conditional Probability and Independence Prof. Michael September 29, 2015 Motivating Example Experiment ξ consists of rolling a fair die twice; A = { the first roll is 6 } amd B = { the sum
More informationConditional Probability. CS231 Dianna Xu
Conditional Probability CS231 Dianna Xu 1 Boy or Girl? A couple has two children, one of them is a girl. What is the probability that the other one is also a girl? Assuming 50/50 chances of conceiving
More informationCompound Events. The event E = E c (the complement of E) is the event consisting of those outcomes which are not in E.
Compound Events Because we are using the framework of set theory to analyze probability, we can use unions, intersections and complements to break complex events into compositions of events for which it
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More informationIntroduction to Probability 2017/18 Supplementary Problems
Introduction to Probability 2017/18 Supplementary Problems Problem 1: Let A and B denote two events with P(A B) 0. Show that P(A) 0 and P(B) 0. A A B implies P(A) P(A B) 0, hence P(A) 0. Similarly B A
More information(6, 1), (5, 2), (4, 3), (3, 4), (2, 5), (1, 6)
Section 7.3: Compound Events Because we are using the framework of set theory to analyze probability, we can use unions, intersections and complements to break complex events into compositions of events
More informationProbability 5-4 The Multiplication Rules and Conditional Probability
Outline Lecture 8 5-1 Introduction 5-2 Sample Spaces and 5-3 The Addition Rules for 5-4 The Multiplication Rules and Conditional 5-11 Introduction 5-11 Introduction as a general concept can be defined
More informationSTP 226 ELEMENTARY STATISTICS
STP 226 ELEMENTARY STATISTICS CHAPTER 5 Probability Theory - science of uncertainty 5.1 Probability Basics Equal-Likelihood Model Suppose an experiment has N possible outcomes, all equally likely. Then
More informationMath Exam 1 Review. NOTE: For reviews of the other sections on Exam 1, refer to the first page of WIR #1 and #2.
Math 166 Fall 2008 c Heather Ramsey Page 1 Math 166 - Exam 1 Review NOTE: For reviews of the other sections on Exam 1, refer to the first page of WIR #1 and #2. Section 1.5 - Rules for Probability Elementary
More informationChapter 3 : Conditional Probability and Independence
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2016 Néhémy Lim Chapter 3 : Conditional Probability and Independence 1 Conditional Probabilities How should we modify the probability of an event when
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More information2. Conditional Probability
ENGG 2430 / ESTR 2004: Probability and Statistics Spring 2019 2. Conditional Probability Andrej Bogdanov Coins game Toss 3 coins. You win if at least two come out heads. S = { HHH, HHT, HTH, HTT, THH,
More informationConditional probability
CHAPTER 4 Conditional probability 4.1. Introduction Suppose there are 200 men, of which 100 are smokers, and 100 women, of which 20 are smokers. What is the probability that a person chosen at random will
More informationLecture 4. Selected material from: Ch. 6 Probability
Lecture 4 Selected material from: Ch. 6 Probability Example: Music preferences F M Suppose you want to know what types of CD s males and females are more likely to buy. The CD s are classified as Classical,
More informationName: Exam 2 Solutions. March 13, 2017
Department of Mathematics University of Notre Dame Math 00 Finite Math Spring 07 Name: Instructors: Conant/Galvin Exam Solutions March, 07 This exam is in two parts on pages and contains problems worth
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationNotes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 16 Notes. Class URL:
Notes slides from before lecture CSE 21, Winter 2017, Section A00 Lecture 16 Notes Class URL: http://vlsicad.ucsd.edu/courses/cse21-w17/ Notes slides from before lecture Notes March 8 (1) This week: Days
More informationMATH 3C: MIDTERM 1 REVIEW. 1. Counting
MATH 3C: MIDTERM REVIEW JOE HUGHES. Counting. Imagine that a sports betting pool is run in the following way: there are 20 teams, 2 weeks, and each week you pick a team to win. However, you can t pick
More informationAP Statistics Ch 6 Probability: The Study of Randomness
Ch 6.1 The Idea of Probability Chance behavior is unpredictable in the short run but has a regular and predictable pattern in the long run. We call a phenomenon random if individual outcomes are uncertain
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationSTOR Lecture 4. Axioms of Probability - II
STOR 435.001 Lecture 4 Axioms of Probability - II Jan Hannig UNC Chapel Hill 1 / 23 How can we introduce and think of probabilities of events? Natural to think: repeat the experiment n times under same
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationIntro to Probability Day 4 (Compound events & their probabilities)
Intro to Probability Day 4 (Compound events & their probabilities) Compound Events Let A, and B be two event. Then we can define 3 new events as follows: 1) A or B (also A B ) is the list of all outcomes
More informationMutually Exclusive Events
172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes
More information4. Suppose that we roll two die and let X be equal to the maximum of the two rolls. Find P (X {1, 3, 5}) and draw the PMF for X.
Math 10B with Professor Stankova Worksheet, Midterm #2; Wednesday, 3/21/2018 GSI name: Roy Zhao 1 Problems 1.1 Bayes Theorem 1. Suppose a test is 99% accurate and 1% of people have a disease. What is the
More informationMath 243 Section 3.1 Introduction to Probability Lab
Math 243 Section 3.1 Introduction to Probability Lab Overview Why Study Probability? Outcomes, Events, Sample Space, Trials Probabilities and Complements (not) Theoretical vs. Empirical Probability The
More informationPERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY
Friends, we continue the discussion with fundamentals of discrete probability in the second session of third chapter of our course in Discrete Mathematics. The conditional probability and Baye s theorem
More informationIndependence 1 2 P(H) = 1 4. On the other hand = P(F ) =
Independence Previously we considered the following experiment: A card is drawn at random from a standard deck of cards. Let H be the event that a heart is drawn, let R be the event that a red card is
More informationProbability the chance that an uncertain event will occur (always between 0 and 1)
Quantitative Methods 2013 1 Probability as a Numerical Measure of the Likelihood of Occurrence Probability the chance that an uncertain event will occur (always between 0 and 1) Increasing Likelihood of
More informationProbability- describes the pattern of chance outcomes
Chapter 6 Probability the study of randomness Probability- describes the pattern of chance outcomes Chance behavior is unpredictable in the short run, but has a regular and predictable pattern in the long
More information(a) Fill in the missing probabilities in the table. (b) Calculate P(F G). (c) Calculate P(E c ). (d) Is this a uniform sample space?
Math 166 Exam 1 Review Sections L.1-L.2, 1.1-1.7 Note: This review is more heavily weighted on the new material this week: Sections 1.5-1.7. For more practice problems on previous material, take a look
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationDiscrete Mathematics and Probability Theory Fall 2011 Rao Midterm 2 Solutions
CS 70 Discrete Mathematics and Probability Theory Fall 20 Rao Midterm 2 Solutions True/False. [24 pts] Circle one of the provided answers please! No negative points will be assigned for incorrect answers.
More informationChapter 5, 6 and 7: Review Questions: STAT/MATH Consider the experiment of rolling a fair die twice. Find the indicated probabilities.
Chapter5 Chapter 5, 6 and 7: Review Questions: STAT/MATH3379 1. Consider the experiment of rolling a fair die twice. Find the indicated probabilities. (a) One of the dice is a 4. (b) Sum of the dice equals
More informationExample. What is the sample space for flipping a fair coin? Rolling a 6-sided die? Find the event E where E = {x x has exactly one head}
Chapter 7 Notes 1 (c) Epstein, 2013 CHAPTER 7: PROBABILITY 7.1: Experiments, Sample Spaces and Events Chapter 7 Notes 2 (c) Epstein, 2013 What is the sample space for flipping a fair coin three times?
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationStat 225 Week 2, 8/27/12-8/31/12, Notes: Independence and Bayes Rule
Stat 225 Week 2, 8/27/12-8/31/12, Notes: Independence and Bayes Rule The Fall 2012 Stat 225 T.A.s September 7, 2012 1 Monday, 8/27/12, Notes on Independence In general, a conditional probability will change
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More information2.4. Conditional Probability
2.4. Conditional Probability Objectives. Definition of conditional probability and multiplication rule Total probability Bayes Theorem Example 2.4.1. (#46 p.80 textbook) Suppose an individual is randomly
More informationFormalizing Probability. Choosing the Sample Space. Probability Measures
Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take
More informationProbability Year 9. Terminology
Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationProbability. Introduction to Biostatistics
Introduction to Biostatistics Probability Second Semester 2014/2015 Text Book: Basic Concepts and Methodology for the Health Sciences By Wayne W. Daniel, 10 th edition Dr. Sireen Alkhaldi, BDS, MPH, DrPH
More information2.6 Tools for Counting sample points
2.6 Tools for Counting sample points When the number of simple events in S is too large, manual enumeration of every sample point in S is tedious or even impossible. (Example) If S contains N equiprobable
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More information= A. Example 2. Let U = {1, 2, 3, 4, 5, 6, 7, 8, 9, 10}, A = {4, 6, 7, 9, 10}, and B = {2, 6, 8, 9}. Draw the sets on a Venn diagram.
MATH 109 Sets A mathematical set is a well-defined collection of objects A for which we can determine precisely whether or not any object belongs to A. Objects in a set are formally called elements of
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationProbability Year 10. Terminology
Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationChapter 6: Probability The Study of Randomness
Chapter 6: Probability The Study of Randomness 6.1 The Idea of Probability 6.2 Probability Models 6.3 General Probability Rules 1 Simple Question: If tossing a coin, what is the probability of the coin
More informationMath Treibergs. Solutions to Fourth Homework February 13, 2009
Math 5010 1. Treibergs Solutions to Fourth Homework February 13, 2009 76[12] Two roads join Ayton to Beaton, and two further roads join Beaton to the City. Ayton is directly connected to the City by railway.
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter One Jesse Crawford Department of Mathematics Tarleton State University (Tarleton State University) Chapter One Notes 1 / 71 Outline 1 A Sketch of Probability and
More informationConditional Probability and Independence
Conditional Probability and Independence September 3, 2009 1 Restricting the Sample Space - Conditional Probability How do we modify the probability of an event in light of the fact that something is known?
More informationIntermediate Math Circles November 8, 2017 Probability II
Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B
More informationOutline Conditional Probability The Law of Total Probability and Bayes Theorem Independent Events. Week 4 Classical Probability, Part II
Week 4 Classical Probability, Part II Week 4 Objectives This week we continue covering topics from classical probability. The notion of conditional probability is presented first. Important results/tools
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationCogs 14B: Introduction to Statistical Analysis
Cogs 14B: Introduction to Statistical Analysis Statistical Tools: Description vs. Prediction/Inference Description Averages Variability Correlation Prediction (Inference) Regression Confidence intervals/
More informationChapter 5 : Probability. Exercise Sheet. SHilal. 1 P a g e
1 P a g e experiment ( observing / measuring ) outcomes = results sample space = set of all outcomes events = subset of outcomes If we collect all outcomes we are forming a sample space If we collect some
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 4: Sequential experiments Andrew McGregor University of Massachusetts Last Compiled: February 2, 2017 Outline 1 Recap 2 Sequential Experiments 3 Total Probability
More informationChapter. Probability
Chapter 3 Probability Section 3.1 Basic Concepts of Probability Section 3.1 Objectives Identify the sample space of a probability experiment Identify simple events Use the Fundamental Counting Principle
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationIntroduction and basic definitions
Chapter 1 Introduction and basic definitions 1.1 Sample space, events, elementary probability Exercise 1.1 Prove that P( ) = 0. Solution of Exercise 1.1 : Events S (where S is the sample space) and are
More informationDiscrete Probability. Chemistry & Physics. Medicine
Discrete Probability The existence of gambling for many centuries is evidence of long-running interest in probability. But a good understanding of probability transcends mere gambling. The mathematics
More informationMath C067 Independence and Repeated Trials.
Math C067 Independence and Repeated Trials. Richard Beigel February 7, 006 Socks. Bill s sock drawer contains 10 red socks, 0 green socks, and 30 blue socks. If Bill removes two socks from his drawer at
More informationCh 2: Probability. Contents. Fall 2017 UAkron Dept. of Stats [3470 : 451/551] Theoretical Statistics I
Fall 2017 UAkron Dept. of Stats [3470 : 451/551] Theoretical Statistics I Ch 2: Probability Contents 1 Preliminaries 3 1.1 Interpretation of Probability (2.2)......................................................
More informationLectures Conditional Probability and Independence
Lectures 5 11 Conditional Probability and Independence Purpose: Calculate probabilities under restrictions, conditions or partial information on the random experiment. Break down complex probabilistic
More information3.2 Probability Rules
3.2 Probability Rules The idea of probability rests on the fact that chance behavior is predictable in the long run. In the last section, we used simulation to imitate chance behavior. Do we always need
More informationLecture 4 Bayes Theorem
1 / 24 Lecture 4 Bayes Theorem September 09, 2010 2 / 24 Lesson Plan 1. Bayes Theorem 2. Simpson s Paradox 3. More worked problems 3 / 24 Why Study Probability? A probability model describes the random
More informationLecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationThe enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}
Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment
More informationRandom processes. Lecture 17: Probability, Part 1. Probability. Law of large numbers
Random processes Lecture 17: Probability, Part 1 Statistics 10 Colin Rundel March 26, 2012 A random process is a situation in which we know what outcomes could happen, but we don t know which particular
More informationMath 140 Introductory Statistics
5. Models of Random Behavior Math 40 Introductory Statistics Professor Silvia Fernández Chapter 5 Based on the book Statistics in Action by A. Watkins, R. Scheaffer, and G. Cobb. Outcome: Result or answer
More informationCDA6530: Performance Models of Computers and Networks. Chapter 1: Review of Practical Probability
CDA6530: Performance Models of Computers and Networks Chapter 1: Review of Practical Probability Probability Definition Sample Space (S) which is a collection of objects (all possible scenarios or values).
More informationExam III Review Math-132 (Sections 7.1, 7.2, 7.3, 7.4, 7.5, 7.6, 8.1, 8.2, 8.3)
1 Exam III Review Math-132 (Sections 7.1, 7.2, 7.3, 7.4, 7.5, 7.6, 8.1, 8.2, 8.3) On this exam, questions may come from any of the following topic areas: - Union and intersection of sets - Complement of
More informationMath 140 Introductory Statistics
Math 140 Introductory Statistics Professor Silvia Fernández Lecture 8 Based on the book Statistics in Action by A. Watkins, R. Scheaffer, and G. Cobb. 5.1 Models of Random Behavior Outcome: Result or answer
More informationHW Solution 3 Due: Sep 11
ECS 35: Probability and Random Processes 204/ HW Solution 3 Due: Sep Lecturer: Prapun Suksompong, PhD Instructions (a) ONE part of a question will be graded (5 pt) Of course, you do not know which part
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationDiscrete Probability. Mark Huiskes, LIACS Probability and Statistics, Mark Huiskes, LIACS, Lecture 2
Discrete Probability Mark Huiskes, LIACS mark.huiskes@liacs.nl Probability: Basic Definitions In probability theory we consider experiments whose outcome depends on chance or are uncertain. How do we model
More informationElisha Mae Kostka 243 Assignment Mock Test 1 due 02/11/2015 at 09:01am PST
Elisha Mae Kostka 243 Assignment Mock Test 1 due 02/11/2015 at 09:01am PST 1. (1 pt) Luis Gonzalez began his career as a major league baseball player in 1990. You are given a sample of the number of homeruns
More informationExam 1 - Math Solutions
Exam 1 - Math 3200 - Solutions Spring 2013 1. Without actually expanding, find the coefficient of x y 2 z 3 in the expansion of (2x y z) 6. (A) 120 (B) 60 (C) 30 (D) 20 (E) 10 (F) 10 (G) 20 (H) 30 (I)
More informationSTAT 516 Answers Homework 2 January 23, 2008 Solutions by Mark Daniel Ward PROBLEMS. = {(a 1, a 2,...) : a i < 6 for all i}
STAT 56 Answers Homework 2 January 23, 2008 Solutions by Mark Daniel Ward PROBLEMS 2. We note that E n consists of rolls that end in 6, namely, experiments of the form (a, a 2,...,a n, 6 for n and a i
More informationVina Nguyen HSSP July 6, 2008
Vina Nguyen HSSP July 6, 2008 1 Late registration Claroline class server 2 What are the two types of probability? 3 What are the two types of probability? What is a set? 4 What are the two types of probability?
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationPLEASE MARK YOUR ANSWERS WITH AN X, not a circle! 1. (a) (b) (c) (d) (e) 2. (a) (b) (c) (d) (e) (a) (b) (c) (d) (e) 4. (a) (b) (c) (d) (e)...
Math 020, Exam II October, 206 The Honor Code is in effect for this examination. All work is to be your own. You may use a calculator. The exam lasts for hour 5 minutes. Be sure that your name is on every
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationChapter 3 Conditional Probability and Independence. Wen-Guey Tzeng Computer Science Department National Chiao Tung University
Chapter 3 Conditional Probability and Independence Wen-Guey Tzeng Computer Science Department National Chiao Tung University Conditional probability P(A B) = the probability of event A given the occurrence
More information4. Probability of an event A for equally likely outcomes:
University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationSTAT 201 Chapter 5. Probability
STAT 201 Chapter 5 Probability 1 2 Introduction to Probability Probability The way we quantify uncertainty. Subjective Probability A probability derived from an individual's personal judgment about whether
More informationSTAT 285 Fall Assignment 1 Solutions
STAT 285 Fall 2014 Assignment 1 Solutions 1. An environmental agency sets a standard of 200 ppb for the concentration of cadmium in a lake. The concentration of cadmium in one lake is measured 17 times.
More information4. Conditional Probability P( ) CSE 312 Autumn 2012 W.L. Ruzzo
4. Conditional Probability P( ) CSE 312 Autumn 2012 W.L. Ruzzo 1 conditional probability Conditional probability of E given F: probability that E occurs given that F has occurred. Conditioning on F S Written
More informationProbability (special topic)
Chapter 2 Probability (special topic) Probability forms a foundation for statistics. You may already be familiar with many aspects of probability, however, formalization of the concepts is new for most.
More informationCINQA Workshop Probability Math 105 Silvia Heubach Department of Mathematics, CSULA Thursday, September 6, 2012
CINQA Workshop Probability Math 105 Silvia Heubach Department of Mathematics, CSULA Thursday, September 6, 2012 Silvia Heubach/CINQA 2012 Workshop Objectives To familiarize biology faculty with one of
More information6.042/18.062J Mathematics for Computer Science December 14, 2004 Tom Leighton and Eric Lehman. Final Exam
6.04/18.06J Mathematics for Computer Science December 14, 004 Tom Leighton and Eric Lehman Final Exam YOUR NAME: : You may use two 8.5 11 sheets with notes in your own handwriting on both sides, but no
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More informationMath 10 - Compilation of Sample Exam Questions + Answers
Math 10 - Compilation of Sample Exam Questions + Sample Exam Question 1 We have a population of size N. Let p be the independent probability of a person in the population developing a disease. Answer the
More information