Lecture 3. January 7, () Lecture 3 January 7, / 35
|
|
- Blaze Nelson
- 5 years ago
- Views:
Transcription
1 Lecture 3 January 7, 2013 () Lecture 3 January 7, / 35
2 Outline This week s lecture: Fast review of last week s lecture: Conditional probability. Partition, Partition theorem. Bayes theorem and its applications. Independence. () Lecture 3 January 7, / 35
3 Contents 1 Fast review of last week s lecture 2 Bayes theorem 3 Independence () Lecture 3 January 7, / 35
4 Conditional Probability Definition (Conditional Probability) Let A and B be events from a given event space F with B satisfying P (B) > 0. The conditional probability of A, given that B occurs, is a probability measure denoted by P (A B) and is defined by, P (A B) = P (A B). P (B) If P (B) = 0 then P (A B) is not defined. () Lecture 3 January 7, / 35
5 Example Roll a die. What is the probability that... 1 the score is at most 3, given that the score is prime? Solution: By the definition of conditional probability, we have B = {2, 3, 5} and A = {1, 2, 3}. With the knowledge of conditional probability, we can write the probability in the second problem as P (A B), and P (A B) = P (A B) P (B) = 2/6 3/6 = 2 3. () Lecture 3 January 7, / 35
6 Partition Definition (Partition, Definition 2.2.1) A collection of events, B 1, B 2,..., B k is called a partition of the sample space Ω if 1 B i B j =, for all i and j such that i j; 2 B 1 B 2 B k = Ω. Example: A single die flip: Ω = {1, 2, 3, 4, 5, 6}. It is clear that B 1 = {1}, B 2 = {2, 3}, B 3 = {4, 5, 6}, is a partition of Ω. Example(Example 2.2.2): A and A c form a partition of Ω for any event A. () Lecture 3 January 7, / 35
7 Partition Theorem (or Total Probability Theorem): general case Theorem (Partition Theorem (general case)) More generally, for any partition, B 1, B 2, B 3,..., B k of the sample space Ω with P (B j ) > 0 for all 1 j k, we have k P (A) = P (A B n )P (B n ). n=1 () Lecture 3 January 7, / 35
8 Some important comments about the conditional probability 1 One can often compute the conditional probability without figure out the sample space first. Of course, we can do it in this way, but it will make the problem horribly complicate. 2 The idea of partition theorem is to split computing the probability of a problem into several small problems. For each small problem, one can get further information to compute the probability of this small problems, and then add these probability together. () Lecture 3 January 7, / 35
9 An example Example (Example 2.2.6): We are given two black boxes with each containing a collection of coloured balls. The first box contains 2 red and 3 blue balls and the second contains 4 red and 1 blue balls. 1 First A ball is chosen at random from the first box and placed in the second. 2 Then a ball is chosen at random from the second box. Question: What is the probability that this second ball is blue? () Lecture 3 January 7, / 35
10 Solution Obviously, the choice of the second ball is influenced by the result of the first step. Solution: Take A = {Ball 2 is blue} and B = {Ball 1 is blue}. Sifting the information we are given we deduce that P (A B) = 1/3, P (B) = 3/5, P (A B c ) = 1/6 and P (B c ) = 2/5. Using the Partition Theorem, the required probability is P (A) = P (A B)P (B) + P (A B c )P (B c ) = = () Lecture 3 January 7, / 35
11 Contents 1 Fast review of last week s lecture 2 Bayes theorem 3 Independence () Lecture 3 January 7, / 35
12 A question? We are given two boxes with each containing a collection of coloured balls. The first box contains 2 red and 3 blue balls and the second contains 4 red and 1 blue balls. A ball is chosen at random from the first box and placed in the second. Then a ball is chosen at random from the second box. Question: Suppose this second ball was blue. What is the probability that the first ball was also blue? Keep this question in mind, let us consider the Bayes Theorem. () Lecture 3 January 7, / 35
13 Bayes Theorem (A special case)] The next theorem is called Bayes Theorem, it is very important and has a lot of applications in statistics, especially for testing. Theorem (Bayes Theorem (A special case)) For any events A and B with P (A) > 0 and P (B) > 0, P (B A) = P (A B)P (B) P (A) = P (A B)P (B) P (A B)P (B) + P (A B c )P (B c ). () Lecture 3 January 7, / 35
14 Bayes Theorem (general case) Theorem (Bayes Theorem (general case)) Let A be an event with P (A) > 0. Let B 1, B 2,..., B n form a partition of Ω such that P (B i ) > 0 for all 1 i n. Then, for each j = 1, 2,..., n, P (B j A) = P (A B j)p (B j ) P (A) = P (A B j )P (B j ) n i=1 P (A B i)p (B i ). () Lecture 3 January 7, / 35
15 Proof of Bayes Theorem (general case) Proof. It follows from definition of conditional probability that P (B j A) = P (B j A) P (A) = P (A B j)p (B j ). (1) P (A) Recall the partition theorem (total probability theorem), we get P (A) = n P (A B i )P (B i ). i=1 Hence, P (B j A) = P (B j A) P (A) = P (A B j)p (B j ) P (A) = P (A B j )P (B j ) n i=1 P (A B i)p (B i ). (2) () Lecture 3 January 7, / 35
16 The question We are given two boxes with each containing a collection of coloured balls. The first box contains 2 red and 3 blue balls and the second contains 4 red and 1 blue balls. A ball is chosen at random from the first box and placed in the second. Then a ball is chosen at random from the second box. Question: Suppose this second ball was blue. What is the probability that the first ball was also blue? () Lecture 3 January 7, / 35
17 The question Solution: Let A = {Ball 2 is blue} and B = {Ball 1 is blue}. Sifting the information we are given we deduce the priors P (A B) = 1/3, P (B) = 3/5, P (A B c ) = 1/6 and P (B c ) = 2/5. Using Bayes Theorem, the required probability is therefore P (B A) = 1 P (A B)P (B) P (A B)P (B) + P (A B c )P (B c ) = = 3 4. () Lecture 3 January 7, / 35
18 A famous question (The Monty Hall Problem) Monty Hall is the host of a game show. There are three doors. Behind one is a car, and behind the other two are goats. It is the contestant s goal to win the car by choosing the door with the car behind it. Monty knows which door has the car and invites the contestant to choose a door. Once chosen, Monty chooses one of the other doors that has a goat behind it. The car is still behind a closed door. The contestant is now given the opportunity to switch choice to the other closed door. To maximise his chances of winning the car, should the contestant: 1 switch? 2 stay with his original choice? 3 or does it not matter? () Lecture 3 January 7, / 35
19 Solution to the Monty Hall Problem Solution: Define the events, A = {contestant picks the correct door first time and X = {Monty opens a door with a goat}. P (X) = P (X A) = P (X A c ) = 1, so by Bayes Theorem P (A X) = Then P (A) = 1/3 and P (X A)P (A) P (X A)P (A) + P (X A c )P (A c ) = 1 3. So P (A X) = P (A) and the contestant should switch doors to increase his probability of winning to 2/3. () Lecture 3 January 7, / 35
20 An example from In a certain age group 1% of women have breast cancer. A mammogram correctly confirms the disease in 80% of women tested but incorrectly gives a positive result in 9.6% of cases. What is the probability that a woman who receives a positive result actually has breast cancer? (Source: () Lecture 3 January 7, / 35
21 Solution Let X be the event that a woman gets a positive test result and A be the event that she has breast cancer. We want P (A X) and we use Bayes Theorem. The priors are: P (A) = 1/100, P (X A) = 4/5 and P (X A c ) = 12/125. Hence, P (A X) = P (X A)P (A) P (X A)P (A) + P (X A c )P (A c ) = %. So less than eight in every hundred women with a positive test actually have breast cancer. () Lecture 3 January 7, / 35
22 Contents 1 Fast review of last week s lecture 2 Bayes theorem 3 Independence () Lecture 3 January 7, / 35
23 Some discussion We see that in the famous Monty Hall s problem that Monty s choice helps contestant to have a better chance to win the car. Today we shall study that the conditional probability between two events is unaffected by the second, i.e., the two events are independent. Independence is one of the several most important conceptions in probability theory. Example: Choose a day at random. Does knowing B alter P (A) in the case below? A = {it is Saturday}, B = {it is morning}. Solution: Obviously not: P (A) = P (A B) = 1/7. () Lecture 3 January 7, / 35
24 Independence For two events, A and B with P (B) > 0 and P (A) > 0, when P (A) = P (A B), we have P (A B) = P (A B)P (B) = P (A)P (B). () Lecture 3 January 7, / 35
25 Independence Definition (Independence) Two events, A and B with P (B) > 0 and P (A) > 0, are said to be independent when P (A B) = P (A)P (B). Here we use the definition with a form different from that in long lecture note by Jacques Furter, but they are equivalent (see the next slide). () Lecture 3 January 7, / 35
26 Independence(equivalent definition) The equivalent definition of independence is Definition (Independence) Two events, A and B with P (B) > 0 and P (A) > 0, are said to be independent when P (A B) = P (A). Proof. 1. If P (A B) = P (A), then P (A B) = P (A B)P (B) = P (A)P (B). 2. If P (A B) = P (A)P (B), because P (A B) = P (A B)P (B), we have P (A B)P (B) = P (A)P (B). Hence, P (A B) = P (A). () Lecture 3 January 7, / 35
27 Independence Definition (independence of A, B, C) Three events, A, B and C, are said to be (collectively) independent when, P (A B C) = P (A)P (B)P (C) and each pair (A, B), (B, C), (C, A) are also (pairwise) independent. Similar definitions exist for four or more events. Also, A and B are said to be conditionally independent, given C, when P (A B C) = P (A C) P (B C). () Lecture 3 January 7, / 35
28 Independence and Dependence It is sometimes obvious that events are independent. For example, if we toss a coin twice, the events A = {first toss is heads} and B = {second toss is tails are clearly independent if the coin is fair. But, what about these: A = {a burglary occurs in January}, B = {the government loses the May election}? Probability of B is most probably influenced by the event A. () Lecture 3 January 7, / 35
29 Example(rolling a die) We roll a die two times. Let A be the event where the first throw score is between 1 and 3, B the event where the second throw score is between 4 and 6 and C the event where both scores are either between 1 and 3 or between 4 and 6. Show that A, B and C are pairwise independent, but A, B and C are (collectively) not independent. () Lecture 3 January 7, / 35
30 Solution Solution: The set of outcomes for the throw of a die is S = {1,..., 6}. The sample space is Ω = S S. Let x i N, i = 1, 2, be the score on the i th throw. The event A is given by {1, 2, 3} S, B is S {4, 5, 6} and C by {1, 2, 3} 2 {4, 5, 6} 2 where X 2 denotes the cartesian product of the set X. We see that Ω = 36, A = B = C = 18, hence P (A) = P (B) = P (C) = 1 2. Then we can show that the three events A, B and C are pairwise independent: () Lecture 3 January 7, / 35
31 Solution (continued) 1 To check for independence of A and B, we calculate P (A B) = P ({1, 2, 3} {4, 5, 6}) = 1 4. Hence P (A B) = P (A)P (B). 2 To check for independence of A and C, we calculate P (A C) = P ({1, 2, 3} 2 ) = 1 4. Hence P (A C) = P (A)P (C). 3 To check for independence of B and C, we calculate P (B C) = P ({4, 5, 6} 2 ) = 1 4. Hence P (B C) = P (B)P (C). () Lecture 3 January 7, / 35
32 Solution (continued) A B C =. Therefore, but Therefore, P (A B C) = 0, P (A)P (B)P (C) = 1 8. P (A B C) P (A)P (B)P (C). () Lecture 3 January 7, / 35
33 Another example When we throw a dye, the sample space is Ω = {1,..., 6}. The events A = {a} and B = {b} are not independent when a b. Indeed, they are exclusive in that case, and so P (A B) = 0, which is clearly different from P (A) or P (B). () Lecture 3 January 7, / 35
34 Another example (continued) On the other hand, if we throw a dye twice in succession, getting a score a the first time and b the second are indeed independent events. The sample space is the set of couples Ω 2 = Ω 2. Now, the event corresponding to the first score of a is A 2 = {a} Ω, for the score b the event is B 2 = Ω {b}. Those events are independent because A 2 B 2 = {(a, b)} = 1, A 2 = B 2 = 6 and Ω 2 = 36. Hence, P (A B) = P (A 2 B 2 ) P (B 2 ) = 1/36 1/6 = 1/6 = P (A 2). () Lecture 3 January 7, / 35
35 Thanks for attention! () Lecture 3 January 7, / 35
ORF 245 Fundamentals of Statistics Chapter 5 Probability
ORF 245 Fundamentals of Statistics Chapter 5 Probability Robert Vanderbei Oct 2015 Slides last edited on October 14, 2015 http://www.princeton.edu/ rvdb Sample Spaces (aka Populations) and Events When
More information2.4 Conditional Probability
2.4 Conditional Probability The probabilities assigned to various events depend on what is known about the experimental situation when the assignment is made. Example: Suppose a pair of dice is tossed.
More informationP (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,
More informationORF 245 Fundamentals of Statistics Chapter 1 Probability
ORF 245 Fundamentals of Statistics Chapter 1 Probability Robert Vanderbei Sept 2014 Slides last edited on September 19, 2014 http://www.princeton.edu/ rvdb Course Info Prereqs: Textbook: Three semesters
More informationCS 361: Probability & Statistics
February 12, 2018 CS 361: Probability & Statistics Random Variables Monty hall problem Recall the setup, there are 3 doors, behind two of them are indistinguishable goats, behind one is a car. You pick
More informationIntermediate Math Circles November 15, 2017 Probability III
Intermediate Math Circles November 5, 07 Probability III Example : You have bins in which there are coloured balls. The balls are identical except for their colours. The contents of the containers are:
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationGreat Theoretical Ideas in Computer Science
15-251 Great Theoretical Ideas in Computer Science Probability Theory: Counting in Terms of Proportions Lecture 10 (September 27, 2007) Some Puzzles Teams A and B are equally good In any one game, each
More informationElementary Discrete Probability
Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,
More informationIntroduction to Probability Theory, Algebra, and Set Theory
Summer School on Mathematical Philosophy for Female Students Introduction to Probability Theory, Algebra, and Set Theory Catrin Campbell-Moore and Sebastian Lutz July 28, 2014 Question 1. Draw Venn diagrams
More informationLecture 2. Conditional Probability
Math 408 - Mathematical Statistics Lecture 2. Conditional Probability January 18, 2013 Konstantin Zuev (USC) Math 408, Lecture 2 January 18, 2013 1 / 9 Agenda Motivation and Definition Properties of Conditional
More informationSome Basic Concepts of Probability and Information Theory: Pt. 1
Some Basic Concepts of Probability and Information Theory: Pt. 1 PHYS 476Q - Southern Illinois University January 18, 2018 PHYS 476Q - Southern Illinois University Some Basic Concepts of Probability and
More informationFirst Digit Tally Marks Final Count
Benford Test () Imagine that you are a forensic accountant, presented with the two data sets on this sheet of paper (front and back). Which of the two sets should be investigated further? Why? () () ()
More informationProbability: Part 1 Naima Hammoud
Probability: Part 1 Naima ammoud Feb 7, 2017 Motivation ossing a coin Rolling a die Outcomes: eads or ails Outcomes: 1, 2, 3, 4, 5 or 6 Defining Probability If I toss a coin, there is a 50% chance I will
More informationEE126: Probability and Random Processes
EE126: Probability and Random Processes Lecture 1: Probability Models Abhay Parekh UC Berkeley January 18, 2011 1 Logistics 2 Introduction 3 Model 4 Examples What is this course about? Most real-world
More informationDynamic Programming Lecture #4
Dynamic Programming Lecture #4 Outline: Probability Review Probability space Conditional probability Total probability Bayes rule Independent events Conditional independence Mutual independence Probability
More informationLecture 1: Basics of Probability
Lecture 1: Basics of Probability (Luise-Vitetta, Chapter 8) Why probability in data science? Data acquisition is noisy Sampling/quantization external factors: If you record your voice saying machine learning
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More informationConditional probability
CHAPTER 4 Conditional probability 4.1. Introduction Suppose there are 200 men, of which 100 are smokers, and 100 women, of which 20 are smokers. What is the probability that a person chosen at random will
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationConditional Probability and Independence
Conditional Probability and Independence September 3, 2009 1 Restricting the Sample Space - Conditional Probability How do we modify the probability of an event in light of the fact that something is known?
More informationLecture 3: Probability
Lecture 3: Probability 28th of October 2015 Lecture 3: Probability 28th of October 2015 1 / 36 Summary of previous lecture Define chance experiment, sample space and event Introduce the concept of the
More informationTutorial 3: Random Processes
August 18 Semester 2018-II Tutorial 3: Random Processes Lecturer: Utpal Mukherji/ Parimal Parag Prepared by: Prathamesh Mayekar Note: LaTeX template courtesy of UC Berkeley EECS dept. 3.1 Conditional Probability
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationMath/Stat 394 Homework 5
Math/Stat 394 Homework 5 1. If we select two black balls then X 4. This happens with probability ( 4 2). If we select two white balls then X 2. This happens with ( 14 probability (8 2). If we select two
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationP (E) = P (A 1 )P (A 2 )... P (A n ).
Lecture 9: Conditional probability II: breaking complex events into smaller events, methods to solve probability problems, Bayes rule, law of total probability, Bayes theorem Discrete Structures II (Summer
More informationConditional Probability, Independence, Bayes Theorem Spring January 1, / 23
Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2014 January 1, 2017 1 / 23 Sample Space Confusions 1. Sample space = set of all possible outcomes of an experiment. 2. The size of the
More informationDiscrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10
EECS 70 Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 Introduction to Basic Discrete Probability In the last note we considered the probabilistic experiment where we flipped
More informationLecture 9: Conditional Probability and Independence
EE5110: Probability Foundations July-November 2015 Lecture 9: Conditional Probability and Independence Lecturer: Dr. Krishna Jagannathan Scribe: Vishakh Hegde 9.1 Conditional Probability Definition 9.1
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationLecture Stat 302 Introduction to Probability - Slides 5
Lecture Stat 302 Introduction to Probability - Slides 5 AD Jan. 2010 AD () Jan. 2010 1 / 20 Conditional Probabilities Conditional Probability. Consider an experiment with sample space S. Let E and F be
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationDiscrete Random Variables
Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan 2014 Introduction The markets can be thought of as a complex interaction of a large number of random
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationMATHEMATICS 191, FALL 2004 MATHEMATICAL PROBABILITY Outline #3 (Conditional Probability)
Last modified: October 5, 2004 References: PRP, sections 1.4, 1.5 and 1.7 EP, Chapter 2 MATHEMATICS, FALL 2004 MATHEMATICAL PROBABILITY Outline #3 (Conditional Probability) 1. Define conditional probability
More information4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio
4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Wrong is right. Thelonious Monk 4.1 Three Definitions of
More informationConditional Probability, Independence, Bayes Theorem Spring January 1, / 28
Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2014 January 1, 2017 1 / 28 Sample Space Confusions 1. Sample space = set of all possible outcomes of an experiment. 2. The size of the
More informationLecture 6 - Random Variables and Parameterized Sample Spaces
Lecture 6 - Random Variables and Parameterized Sample Spaces 6.042 - February 25, 2003 We ve used probablity to model a variety of experiments, games, and tests. Throughout, we have tried to compute probabilities
More informationGrades 7 & 8, Math Circles 24/25/26 October, Probability
Faculty of Mathematics Waterloo, Ontario NL 3G1 Centre for Education in Mathematics and Computing Grades 7 & 8, Math Circles 4/5/6 October, 017 Probability Introduction Probability is a measure of how
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More informationConditional Probability, Independence, Bayes Theorem Spring 2018
Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2018 Slides are Posted Don t forget that after class we post the slides including solutions to all the questions. February 13, 2018 2 /
More informationChapter 1 Principles of Probability
Chapter Principles of Probability Combining independent probabilities You have applied to three medical schools: University of California at San Francisco (UCSF), Duluth School of Mines (DSM), and Harvard
More informationHW1 Solutions. October 5, (20 pts.) Random variables, sample space and events Consider the random experiment of ipping a coin 4 times.
HW1 Solutions October 5, 2016 1. (20 pts.) Random variables, sample space and events Consider the random experiment of ipping a coin 4 times. 1. (2 pts.) Dene the appropriate random variables. Answer:
More information2.6 Tools for Counting sample points
2.6 Tools for Counting sample points When the number of simple events in S is too large, manual enumeration of every sample point in S is tedious or even impossible. (Example) If S contains N equiprobable
More informationProbability Basics Review
CS70: Jean Walrand: Lecture 16 Events, Conditional Probability, Independence, Bayes Rule Probability Basics Review Setup: Set notation review A B A [ B A \ B 1 Probability Basics Review 2 Events 3 Conditional
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationCS70: Jean Walrand: Lecture 16.
CS70: Jean Walrand: Lecture 16. Events, Conditional Probability, Independence, Bayes Rule 1. Probability Basics Review 2. Events 3. Conditional Probability 4. Independence of Events 5. Bayes Rule Probability
More informationLecture 1 Introduction to Probability and Set Theory Text: A Course in Probability by Weiss
Lecture 1 to and Set Theory Text: A Course in by Weiss 1.2 2.3 STAT 225 to Models January 13, 2014 to and Whitney Huang Purdue University 1.1 Agenda to and 1 2 3 1.2 Motivation Uncertainty/Randomness in
More informationFormalizing Probability. Choosing the Sample Space. Probability Measures
Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take
More informationCS1800 Probability 3: Bayes Rule. Professor Kevin Gold
CS1800 Probability 3: Bayes Rule Professor Kevin Gold Brief Review of Probability - Counting Outcomes and Axioms Recall from before that we can calculate probabilities by counting success outcomes and
More informationMAT2377. Ali Karimnezhad. Version September 9, Ali Karimnezhad
MAT2377 Ali Karimnezhad Version September 9, 2015 Ali Karimnezhad Comments These slides cover material from Chapter 1. In class, I may use a blackboard. I recommend reading these slides before you come
More informationPresentation on Theo e ry r y o f P r P o r bab a il i i l t i y
Presentation on Theory of Probability Meaning of Probability: Chance of occurrence of any event In practical life we come across situation where the result are uncertain Theory of probability was originated
More informationDiscrete Probability
MAT 258 Discrete Mathematics Discrete Probability Kenneth H. Rosen and Kamala Krithivasan Discrete Mathematics 7E Global Edition Chapter 7 Reproduced without explicit consent Fall 2016 Week 11 Probability
More informationStat 225 Week 2, 8/27/12-8/31/12, Notes: Independence and Bayes Rule
Stat 225 Week 2, 8/27/12-8/31/12, Notes: Independence and Bayes Rule The Fall 2012 Stat 225 T.A.s September 7, 2012 1 Monday, 8/27/12, Notes on Independence In general, a conditional probability will change
More informationLecture 1: Review of Probability
EAS31136/B9036: Statistics in Earth & Atmospheric Sciences Lecture 1: Review of Probability Instructor: Prof. Johnny Luo www.sci.ccny.cuny.edu/~luo Dates Topic Reading (Based on the 2 nd Edition of Wilks
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationConditional Probability
32 Chapter 4 Conditional Probability 4. Discrete Conditional Probability Conditional Probability In this section we ask and answer the following question. Suppose we assign a distribution function to a
More informationDiscrete Random Variables. Discrete Random Variables
Random Variables In many situations, we are interested in numbers associated with the outcomes of a random experiment. For example: Testing cars from a production line, we are interested in variables such
More informationCS 246 Review of Proof Techniques and Probability 01/14/19
Note: This document has been adapted from a similar review session for CS224W (Autumn 2018). It was originally compiled by Jessica Su, with minor edits by Jayadev Bhaskaran. 1 Proof techniques Here we
More informationIntroduction to Probability 2017/18 Supplementary Problems
Introduction to Probability 2017/18 Supplementary Problems Problem 1: Let A and B denote two events with P(A B) 0. Show that P(A) 0 and P(B) 0. A A B implies P(A) P(A B) 0, hence P(A) 0. Similarly B A
More informationStatistical Methods for the Social Sciences, Autumn 2012
Statistical Methods for the Social Sciences, Autumn 2012 Review Session 3: Probability. Exercises Ch.4. More on Stata TA: Anastasia Aladysheva anastasia.aladysheva@graduateinstitute.ch Office hours: Mon
More informationSTATISTICAL INDEPENDENCE AND AN INVITATION TO THE Art OF CONDITIONING
STATISTICAL INDEPENDENCE AND AN INVITATION TO THE Art OF CONDITIONING Tutorial 2 STAT1301 Fall 2010 28SEP2010, MB103@HKU By Joseph Dong Look, imagine a remote village where there has been a long drought.
More informationJoint, Conditional, & Marginal Probabilities
Joint, Conditional, & Marginal Probabilities The three axioms for probability don t discuss how to create probabilities for combined events such as P [A B] or for the likelihood of an event A given that
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationV. Probability. by David M. Lane and Dan Osherson
V. Probability by David M. Lane and Dan Osherson Prerequisites none F.Introduction G.Basic Concepts I.Gamblers Fallacy Simulation K.Binomial Distribution L.Binomial Demonstration M.Base Rates Probability
More informationMutually Exclusive Events
172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes
More information18.05 Problem Set 5, Spring 2014 Solutions
8.0 Problem Set, Spring 04 Solutions Problem. (0 pts.) (a) We know that y i ax i b = ε i N(0,σ ). y i = ε i + ax i + b N(ax i + b, σ ). That is, Therefore f(y i a, b, x i,σ)= e (y i ax i b) σ π σ. (b)
More informationMath 1313 Experiments, Events and Sample Spaces
Math 1313 Experiments, Events and Sample Spaces At the end of this recording, you should be able to define and use the basic terminology used in defining experiments. Terminology The next main topic in
More informationConditional Probability P( )
Conditional Probability P( ) 1 conditional probability where P(F) > 0 Conditional probability of E given F: probability that E occurs given that F has occurred. Conditioning on F Written as P(E F) Means
More informationProbability Pr(A) 0, for any event A. 2. Pr(S) = 1, for the sample space S. 3. If A and B are mutually exclusive, Pr(A or B) = Pr(A) + Pr(B).
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this
More information1. When applied to an affected person, the test comes up positive in 90% of cases, and negative in 10% (these are called false negatives ).
CS 70 Discrete Mathematics for CS Spring 2006 Vazirani Lecture 8 Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According to clinical trials,
More informationChapter 7 Wednesday, May 26th
Chapter 7 Wednesday, May 26 th Random event A random event is an event that the outcome is unpredictable. Example: There are 45 students in this class. What is the probability that if I select one student,
More informationDiscrete Random Variables
Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan Introduction The markets can be thought of as a complex interaction of a large number of random processes,
More informationConditional Probability (cont...) 10/06/2005
Conditional Probability (cont...) 10/06/2005 Independent Events Two events E and F are independent if both E and F have positive probability and if P (E F ) = P (E), and P (F E) = P (F ). 1 Theorem. If
More informationProbability, Statistics, and Bayes Theorem Session 3
Probability, Statistics, and Bayes Theorem Session 3 1 Introduction Now that we know what Bayes Theorem is, we want to explore some of the ways that it can be used in real-life situations. Often the results
More informationNotes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 15 Notes. Class URL:
Notes slides from before lecture CSE 21, Winter 2017, Section A00 Lecture 15 Notes Class URL: http://vlsicad.ucsd.edu/courses/cse21-w17/ Notes slides from before lecture Notes March 6 (1) This week: Days
More informationLecture 9b: Events, Conditional Probability, Independence, Bayes' Rule Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 9b: Events, Conditional Probability, Independence, Bayes' Rule Lecturer: Lale Özkahya Resources: Kenneth
More informationConditional Probability and Bayes
Conditional Probability and Bayes Chapter 2 Lecture 5 Yiren Ding Shanghai Qibao Dwight High School March 9, 2016 Yiren Ding Conditional Probability and Bayes 1 / 13 Outline 1 Independent Events Definition
More informationExamples of frequentist probability include games of chance, sample surveys, and randomized experiments. We will focus on frequentist probability sinc
FPPA-Chapters 13,14 and parts of 16,17, and 18 STATISTICS 50 Richard A. Berk Spring, 1997 May 30, 1997 1 Thinking about Chance People talk about \chance" and \probability" all the time. There are many
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationSTAT 111 Recitation 1
STAT 111 Recitation 1 Linjun Zhang January 20, 2017 What s in the recitation This class, and the exam of this class, is a mix of statistical concepts and calculations. We are going to do a little bit of
More informationExam 1 Solutions. Problem Points Score Total 145
Exam Solutions Read each question carefully and answer all to the best of your ability. Show work to receive as much credit as possible. At the end of the exam, please sign the box below. Problem Points
More informationDiscrete Probability. Mark Huiskes, LIACS Probability and Statistics, Mark Huiskes, LIACS, Lecture 2
Discrete Probability Mark Huiskes, LIACS mark.huiskes@liacs.nl Probability: Basic Definitions In probability theory we consider experiments whose outcome depends on chance or are uncertain. How do we model
More informationECE 302: Chapter 02 Probability Model
ECE 302: Chapter 02 Probability Model Fall 2018 Prof Stanley Chan School of Electrical and Computer Engineering Purdue University 1 / 35 1. Probability Model 2 / 35 What is Probability? It is a number.
More information6.042/18.062J Mathematics for Computer Science November 28, 2006 Tom Leighton and Ronitt Rubinfeld. Random Variables
6.042/18.062J Mathematics for Computer Science November 28, 2006 Tom Leighton and Ronitt Rubinfeld Lecture Notes Random Variables We ve used probablity to model a variety of experiments, games, and tests.
More information6.041/6.431 Spring 2009 Quiz 1 Wednesday, March 11, 7:30-9:30 PM. SOLUTIONS
6.0/6.3 Spring 009 Quiz Wednesday, March, 7:30-9:30 PM. SOLUTIONS Name: Recitation Instructor: Question Part Score Out of 0 all 0 a 5 b c 5 d 5 e 5 f 5 3 a b c d 5 e 5 f 5 g 5 h 5 Total 00 Write your solutions
More informationStatistika pro informatiku
Statistika pro informatiku prof. RNDr. Roman Kotecký DrSc., Dr. Rudolf Blažek, PhD Katedra teoretické informatiky FIT České vysoké učení technické v Praze MI-SPI, ZS 2011/12, Přednáška 2 Evropský sociální
More informationBayes Rule for probability
Bayes Rule for probability P A B P A P B A PAP B A P AP B A An generalization of Bayes Rule Let A, A 2,, A k denote a set of events such that S A A2 Ak and Ai Aj for all i and j. Then P A i B P Ai P B
More informationIndependent Events. The multiplication rule for independent events says that if A and B are independent, P (A and B) = P (A) P (B).
Independent Events Two events are said to be independent if the outcome of one of them does not influence the other. For example, in sporting events, the outcomes of different games are usually considered
More informationDiscrete Mathematics
Discrete Mathematics Workshop Organized by: ACM Unit, ISI Tutorial-1 Date: 05.07.2017 (Q1) Given seven points in a triangle of unit area, prove that three of them form a triangle of area not exceeding
More informationIntermediate Math Circles November 8, 2017 Probability II
Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationCS626 Data Analysis and Simulation
CS626 Data Analysis and Simulation Instructor: Peter Kemper R 104A, phone 221-3462, email:kemper@cs.wm.edu Today: Probability Primer Quick Reference: Sheldon Ross: Introduction to Probability Models 9th
More information