P (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
|
|
- Debra Lindsey
- 5 years ago
- Views:
Transcription
1 Lectures Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information, how does the probability space (Ω, F, P ) change to reflect this information? This is the notion of conditional probability Intuitively, we should consider for any event B F, given that A occurs, the probability that B occurs is the probability of that part of B which is in A divided by the probability of A This leads to the definition: Definition of conditional probability Let (Ω, F, P ) be a probability space and let A F such that 0 Then the conditional probability of an event B F given A is defined by Note that (A, G, Q) defines a new probability space, with G = {A B : B F} and Q(B) = P (B A) To see this, it is not hard to check that G is again a σ-field, and to see that Q satisfies the axioms of probability, we observe that Q(A) = P (A A)/ = 1 (Axiom 1 is satisfied), Q(B) 0 for every B G (Axiom 2 is satisfied) To check Axiom 3, suppose we have disjoint events B, C G Then Q(B C) = P (B C A) = P ((B C) A) = P (B A) + P (C A) = P (B A) + P (C A) = Q(A) + Q(B) The same argument extends to countably many disjoint events B 1, B 2, G Having verified that Q(B) = P (B A) is actually a probability measure, we do some computational examples 1
2 First Example A fair six-sided die is tossed once and the outcome is recorded Given that the outcome is an odd number, what is the probability that the outcome is 5? Let A be the event that the outcome is odd, and let B be the event that the outcome is 5 Then we are asking for P (B A) According to the definition, Now = 1/2, and = P (B) = P ({5}) = 1/6 Therefore as expected 1/6 1/2 = 1 3 Second Example A fair six-sided die is tossed twice and both outcomes are recorded Given that at least one of the numbers is a 6, what is the probability that the total on the dice is at least 10? Let A be the event that at least one of the numbers is a 6, and let B be the event that the total is at least 10 Then we are asking for P (B A) Now = 1, where A is the event that neither of the dice shows 6 The probability of that event, by the multiplication principle is A 36 = = We conclude = 11/36 Next, we compute This is the event that at least one of the dice shows a 6 and the total on the dice is at least 10 We can list the outcomes in A B: A B = {(6, 4), (6, 5), (6, 6), (5, 6), (4, 6)} and therefore So finally, = A B 36 = 5 36 = 5/36 11/36 = Law of total probability The third axiom of probability gives a law called the law of total probability, which is useful in computing conditional probabilities It essentially says that if a given event B can be written as B = (B A 1 ) (B A 2 ) 2
3 where A 1, A 2, are events, then we can compute P (B) in terms of the probabilities P (B A i ) and P (A i ) This allows us to break down probability computations into simple pieces Law of total probability Let B, A 1, A 2, be events in a probability space and suppose B = (B A 1 ) (B A 2 ) Then P (B) = P (B A i )P (A i ) i=1 Proof By Axiom 3 of probability, P (B) = P (B A i ) i=1 By definition of conditional probability, P (B A i ) = P (B A i) P (A i ) and so P (B A i ) = P (B A i )P (A i ) Putting this into the sum, P (B) = P (B A i )P (A i ) i=1 This verifies the law of total probability First Example A red urn and a blue urn each contain black and white balls The red urn contains as many white balls as black balls, whereas the blue urn contains three times as many white balls as black balls A player randomly and uniformly picks one of the urns, and then randomly and uniformly picks a ball from that urn Determine the probability that the ball picked is black Let A r be the event that we pick the red urn, and let A b be the event that we pick the blue urn Then P (A r ) = P (A b ) = 1/2 Let B be the event that the ball picked is black To determine P (B), note that B = (A r B) (A b B) and therefore P (B) = P (A r B) + P (A b B) 3
4 by Axiom 3 of probability We would expect P (A r B) = = 1 4 since there is half a chance of picking the red urn, and then half a chance that we pick a white ball from the red urn Similarly, P (A b B) = = 1 3 To make these statements precise, we use the law of total probability: P (B) = P (B A r )P (A r ) + P (B A b )P (A b ) = = 7 12 The reader should find the problem with the following argument: P (A r B) = 1/2 since A r B is the event that a black ball is picked from the red urn, and half the balls in the red urn are black; this ignores that A r is an event and P (A r ) < 1 For this reason we apply P (A r B) = P (B A r )P (A r ) Second Example Continuing from the last example, suppose that we know that the ball picked is black What is the probability that the ball was picked from the blue urn? Using the notation of the last example, this is P (A b B) By definition of conditional probability, P (A b B) = P (A b B) P (B) = 1/3 7/12 = 4 7 Third Example Two decks of cards lie on a table One of the decks is a standard deck, but the other is not, since every card in it is the ace of spades A dealer randomly and uniformly picks one of the two decks, and asks you to pick a card from it The card you pick is the ace of spades Determine the probability that the deck offered to you is the non-standard deck This problem is basically the same as the last one: let B be the event that the ace of spades is picked, and let A s and A n be the events that the chosen deck is standard and non-standard respectively Then we want P (A n B) We know that P (A n B) = P (A n B) P (B) Let us compute P (B) using the law of total probability: P (B) = P (B A n )P (A n ) + P (B A s )P (A s ) 4
5 Then P (A s ) = P (A n ) = 1/2 and P (B A n ) = 1 and P (B A s ) = 1/52 Therefore P (B) = = We also have P (A n B) = P (B A n )P (A n ) = 1/2, so P (A n B) = P (A n B) P (B) = 1/2 53/104 = So there is a 52/53 chance that the deck chosen is non-standard 43 Bayes Rule Bayes rule is an exceedingly important but simple to state tool in probability, and appears in numerous applications Bayes Rule Let A and B be events in a probability space, such that 0 and P (B) 0 Then P (B)P (A B) Proof By definition of conditional probability, Also Solving for, we get P (A B) = P (B) P (A B)P (B) and dividing both sides by gives Bayes Rule The probability P (B) is called the prior probability, and P (B A) is called the posterior probability We imagine that an experiment is performed, from which we want to obtain some information about B The prior probability P (B) is the probability that B occurs, without any further information The posterior probability is the probability that B occurs, given the information obtained from the experiment, which is the event A In practice, to compute, we may use the law of total probability = P (A B)P (B) + P (A B)P (B) 5
6 First Example A patient X at a medical exam reveals a symptom x of Type II diabetes The percentage of all people in the United States with Type II diabetes is 10 percent (the prior probability is 10/100) The percentage of Type II diabetics which are asymptomatic in a medical exam is 01 percent and the percentage of Type II diabetics which have symptoms is 80 percent Determine the probability that patient X has Type II diabetes (the posterior probability) We set up the problem in the framework of conditional probability Let B be the event that a patient has Type II diabetes Let A be the event that a patient has symptom x at a medical exam Then we have from Bayes Rule that the posterior probability is P (A B)P (B)/ Now P (B A) is the probability we want: it is the probability that given that symptom x is detected, the patient has Type II diabetes The prior probability is P (B) = 10/100, and we have P (A B) = 80/100, and P (A B) = 1/1000, since these quantities are given Therefore Then = P (A B)P (B) + P (A B)P (B) = (80/100) (10/100) (809/10000) = = = So the patient has roughly a 989 percent chance of having Type II diabetes Second Example A student S is suspected of cheating on an exam, due to evidence E of cheating being present Suppose that in the case of a cheating student, evidence E is present with 60 percent probability, and that in the case of a student that does not cheat, evidence E is present with a 001 percent probability Suppose also that the proportion of students that cheat is 1 percent Determine the probability that S cheated Let B be the event S cheated, and let A be the event that evidence E is present We seek P (A B)P (B) This time we do not know, the probability that evidence E is present However, by the law of total probability, = P (A B)P (B) + P (A B)P (B) We know P (A B) = 06 and P (A B) = 00001, and P (B) = 001, since these are given Therefore P (A B)P (B) = = 0983 So there is roughly a 98 percent chance the student S cheated 6
7 44 Monty-Hall Problem The Monty-Hall problem is a good illustration of conditional probability A game show consists of three closed doors, behind one of which there is a prize A game show host, who knows which door hides the prize, asks a contestant to pick one of the three doors, and then randomly opens a different door with no prize behind it it Then the host asks: would you like to open the door you originally picked (call this stay strategy), or would you like to pick the other closed door (ie switch strategy)? The first remark is that it does not matter which door you first selected, so we might as well assume you picked door number 1 The question is: do you stick with door number 1 or do you switch to another door? It seems intuitive that it is equally likely that the prize is behind the door 1 and the door that the game show host did not pick However, this is not the case, since by revealing that there is nothing behind door 2, the game show host increases the likelihood that there is something behind door 3 Thus it seems plausible that to maximize the probability of revealing the prize, you should switch doors The key is to make this rigorous in terms of probability Let A i be the event that the prize lies behind door i Let B i be the event that the game show host picks door i Let B be the event that switching doors leads to a win Then we have P (A i ) = 1/3 for i = 1, 2, 3 and also B = (B 3 A 2 ) (B 2 A 3 ) By the law of total probability, P (B) = P (B 3 A 2 )P (A 2 ) + P (B 2 A 3 )P (A 3 ) = 2 3 since P (B 3 A 2 ) = P (B 2 A 3 ) = 1 Let C be the event that keeping the door (staying) wins Then C = (B 2 A 1 ) (B 3 A 1 ) and by the law of total probability, P (C) = P (B 2 A 1 )P (A 1 ) + P (B 3 A 1 )P (A 1 ) = 1 3 since P (B 2 A 1 ) = 1/2 = P (B 3 A 1 ) Therefore a win is twice as likely if you switch doors than if you stay 7
8 45 Independence Two events in a probability space are independent if the occurrence of either of them does not affect the probability of the occurrence of the other In mathematical terms, this means events A and B are independent if P (A B) = By definition of conditional probability, this is the same as = P (B) More generally, we can define independence of a set of events Definition of independence Let (Ω, F, P ) be a probability space and let A 1, A 2,, A n be events in F Then A 1, A 2,, A n are independent if for any non-empty set I {1, 2,, n}, ( ) P A i = P (A i ) i I i I The definition says that if events are independent, the the probability of their intersection is just the product of all their probabilities So for instance, = P (B), and P (A B C) = P (B)P (C) We have been implicitly using the notion of independence When we say two fair die are tossed independently, we now have the formal definition of what that means: if A is any set of outcomes on the first die and B is any set of outcomes on the second, then = P (B) In words, the outcome of the first die does not affect the outcome of the second First Example An event A cannot be independent of itself, unless = 0 or = 1 To see this, if A is independent of A, then P (A A) = = 2 by definition But P (A A) =, so we get = 2 which is only possible if = 0 or = 1 Similarly, one can show that if A and B are disjoint and independent, then or P (B) is 0, and one can also show that 8
9 if A and B are independent, then so are A and B, using inclusion-exclusion and the complement rule Second Example A coin is tossed independently n times Suppose the probability of heads on each toss is p What is the probability that no heads occur? Let A i be the event of tails on the ith toss Then we want P (A 1 A 2 A n ) By independendence, this is P (A 1 )P (A 2 ) P (A n ) Now by the complement rule, P (A i ) = 1 p, so P (no heads) = (1 p) n We will come back to this example when we compute the probability of exactly k heads in n coin tosses; this is the famous binomial distribution Third Example A dart is thrown uniformly and randomly at a circular simplified dartboard consisting of eight sectors with equal area, labelled clockwise 1, 2, 3, 4 Let A be the event that the dart lands in sectors 1, 2, let B be the event that the dart lands in sectors 2, 3, and let C be the event that the dart lands in sectors 1, 3 Are the events A, B, C independent? To check independence, we have to check P (B) =, P (B)P (C) = P (B C), P (C) = P (A C) and P (B)P (C) = P (A B C) Now = P (B) = P (C) = 1/2, since they each have 2 sectors, and since each pairwise intersection A B, B C, A C covers 1 sector, = P (B C) = P (A C) = 1/4 So any two of the events A, B, C are independent However, they are not independent together, since A B C = and so P (A B C) = 0 P (B)P (C) = 1 8 The last example illustrates that to check independence of a set of events, independence of all combinations of at least two of those sets must also be checked 9
Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationElementary Discrete Probability
Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,
More informationDiscrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10
EECS 70 Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 Introduction to Basic Discrete Probability In the last note we considered the probabilistic experiment where we flipped
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationFirst Digit Tally Marks Final Count
Benford Test () Imagine that you are a forensic accountant, presented with the two data sets on this sheet of paper (front and back). Which of the two sets should be investigated further? Why? () () ()
More informationLecture 3. January 7, () Lecture 3 January 7, / 35
Lecture 3 January 7, 2013 () Lecture 3 January 7, 2013 1 / 35 Outline This week s lecture: Fast review of last week s lecture: Conditional probability. Partition, Partition theorem. Bayes theorem and its
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More information1. When applied to an affected person, the test comes up positive in 90% of cases, and negative in 10% (these are called false negatives ).
CS 70 Discrete Mathematics for CS Spring 2006 Vazirani Lecture 8 Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According to clinical trials,
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More information2.4 Conditional Probability
2.4 Conditional Probability The probabilities assigned to various events depend on what is known about the experimental situation when the assignment is made. Example: Suppose a pair of dice is tossed.
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationGreat Theoretical Ideas in Computer Science
15-251 Great Theoretical Ideas in Computer Science Probability Theory: Counting in Terms of Proportions Lecture 10 (September 27, 2007) Some Puzzles Teams A and B are equally good In any one game, each
More informationDiscrete Random Variables
Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan 2014 Introduction The markets can be thought of as a complex interaction of a large number of random
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More informationChapter 3 : Conditional Probability and Independence
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2016 Néhémy Lim Chapter 3 : Conditional Probability and Independence 1 Conditional Probabilities How should we modify the probability of an event when
More informationSome Basic Concepts of Probability and Information Theory: Pt. 1
Some Basic Concepts of Probability and Information Theory: Pt. 1 PHYS 476Q - Southern Illinois University January 18, 2018 PHYS 476Q - Southern Illinois University Some Basic Concepts of Probability and
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationChance, too, which seems to rush along with slack reins, is bridled and governed by law (Boethius, ).
Chapter 2 Probability Chance, too, which seems to rush along with slack reins, is bridled and governed by law (Boethius, 480-524). Blaise Pascal (1623-1662) Pierre de Fermat (1601-1665) Abraham de Moivre
More informationSTAT Chapter 3: Probability
Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationORF 245 Fundamentals of Statistics Chapter 5 Probability
ORF 245 Fundamentals of Statistics Chapter 5 Probability Robert Vanderbei Oct 2015 Slides last edited on October 14, 2015 http://www.princeton.edu/ rvdb Sample Spaces (aka Populations) and Events When
More informationFormalizing Probability. Choosing the Sample Space. Probability Measures
Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take
More informationHW1 Solutions. October 5, (20 pts.) Random variables, sample space and events Consider the random experiment of ipping a coin 4 times.
HW1 Solutions October 5, 2016 1. (20 pts.) Random variables, sample space and events Consider the random experiment of ipping a coin 4 times. 1. (2 pts.) Dene the appropriate random variables. Answer:
More informationLectures Conditional Probability and Independence
Lectures 5 11 Conditional Probability and Independence Purpose: Calculate probabilities under restrictions, conditions or partial information on the random experiment. Break down complex probabilistic
More informationEE126: Probability and Random Processes
EE126: Probability and Random Processes Lecture 1: Probability Models Abhay Parekh UC Berkeley January 18, 2011 1 Logistics 2 Introduction 3 Model 4 Examples What is this course about? Most real-world
More informationLecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events
Lecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events Discrete Structures II (Summer 2018) Rutgers University Instructor: Abhishek
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationLecture 04: Conditional Probability. Lisa Yan July 2, 2018
Lecture 04: Conditional Probability Lisa Yan July 2, 2018 Announcements Problem Set #1 due on Friday Gradescope submission portal up Use Piazza No class or OH on Wednesday July 4 th 2 Summary from last
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationLecture 1: Basics of Probability
Lecture 1: Basics of Probability (Luise-Vitetta, Chapter 8) Why probability in data science? Data acquisition is noisy Sampling/quantization external factors: If you record your voice saying machine learning
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationDiscrete Random Variables
Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan Introduction The markets can be thought of as a complex interaction of a large number of random processes,
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationChapter 1 Principles of Probability
Chapter Principles of Probability Combining independent probabilities You have applied to three medical schools: University of California at San Francisco (UCSF), Duluth School of Mines (DSM), and Harvard
More informationDynamic Programming Lecture #4
Dynamic Programming Lecture #4 Outline: Probability Review Probability space Conditional probability Total probability Bayes rule Independent events Conditional independence Mutual independence Probability
More informationLecture 2. Conditional Probability
Math 408 - Mathematical Statistics Lecture 2. Conditional Probability January 18, 2013 Konstantin Zuev (USC) Math 408, Lecture 2 January 18, 2013 1 / 9 Agenda Motivation and Definition Properties of Conditional
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationProbability: Part 1 Naima Hammoud
Probability: Part 1 Naima ammoud Feb 7, 2017 Motivation ossing a coin Rolling a die Outcomes: eads or ails Outcomes: 1, 2, 3, 4, 5 or 6 Defining Probability If I toss a coin, there is a 50% chance I will
More informationDiscrete Probability
MAT 258 Discrete Mathematics Discrete Probability Kenneth H. Rosen and Kamala Krithivasan Discrete Mathematics 7E Global Edition Chapter 7 Reproduced without explicit consent Fall 2016 Week 11 Probability
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationIntermediate Math Circles November 8, 2017 Probability II
Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More informationProbability Experiments, Trials, Outcomes, Sample Spaces Example 1 Example 2
Probability Probability is the study of uncertain events or outcomes. Games of chance that involve rolling dice or dealing cards are one obvious area of application. However, probability models underlie
More informationProblem # Number of points 1 /20 2 /20 3 /20 4 /20 5 /20 6 /20 7 /20 8 /20 Total /150
Name Student ID # Instructor: SOLUTION Sergey Kirshner STAT 516 Fall 09 Practice Midterm #1 January 31, 2010 You are not allowed to use books or notes. Non-programmable non-graphic calculators are permitted.
More informationSTAT 414: Introduction to Probability Theory
STAT 414: Introduction to Probability Theory Spring 2016; Homework Assignments Latest updated on April 29, 2016 HW1 (Due on Jan. 21) Chapter 1 Problems 1, 8, 9, 10, 11, 18, 19, 26, 28, 30 Theoretical Exercises
More informationCS 361: Probability & Statistics
February 12, 2018 CS 361: Probability & Statistics Random Variables Monty hall problem Recall the setup, there are 3 doors, behind two of them are indistinguishable goats, behind one is a car. You pick
More informationIntermediate Math Circles November 15, 2017 Probability III
Intermediate Math Circles November 5, 07 Probability III Example : You have bins in which there are coloured balls. The balls are identical except for their colours. The contents of the containers are:
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationConditional Probability P( )
Conditional Probability P( ) 1 conditional probability where P(F) > 0 Conditional probability of E given F: probability that E occurs given that F has occurred. Conditioning on F Written as P(E F) Means
More informationP (E) = P (A 1 )P (A 2 )... P (A n ).
Lecture 9: Conditional probability II: breaking complex events into smaller events, methods to solve probability problems, Bayes rule, law of total probability, Bayes theorem Discrete Structures II (Summer
More informationHW2 Solutions, for MATH441, STAT461, STAT561, due September 9th
HW2 Solutions, for MATH44, STAT46, STAT56, due September 9th. You flip a coin until you get tails. Describe the sample space. How many points are in the sample space? The sample space consists of sequences
More informationMATH 3C: MIDTERM 1 REVIEW. 1. Counting
MATH 3C: MIDTERM REVIEW JOE HUGHES. Counting. Imagine that a sports betting pool is run in the following way: there are 20 teams, 2 weeks, and each week you pick a team to win. However, you can t pick
More information1 The Basic Counting Principles
1 The Basic Counting Principles The Multiplication Rule If an operation consists of k steps and the first step can be performed in n 1 ways, the second step can be performed in n ways [regardless of how
More informationLecture notes for probability. Math 124
Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More informationCourse: ESO-209 Home Work: 1 Instructor: Debasis Kundu
Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear
More informationIntroduction to Probability Theory, Algebra, and Set Theory
Summer School on Mathematical Philosophy for Female Students Introduction to Probability Theory, Algebra, and Set Theory Catrin Campbell-Moore and Sebastian Lutz July 28, 2014 Question 1. Draw Venn diagrams
More informationProbability Year 10. Terminology
Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationLecture 1 Introduction to Probability and Set Theory Text: A Course in Probability by Weiss
Lecture 1 to and Set Theory Text: A Course in by Weiss 1.2 2.3 STAT 225 to Models January 13, 2014 to and Whitney Huang Purdue University 1.1 Agenda to and 1 2 3 1.2 Motivation Uncertainty/Randomness in
More informationCOS 424: Interacting with Data. Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008
COS 424: Interacting with Data Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008 1 Probability Review 1.1 Random Variables A random variable can be used to model any probabilistic outcome.
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationProbability Rules. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics
Probability Rules MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2018 Introduction Probability is a measure of the likelihood of the occurrence of a certain behavior
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationThe enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}
Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment
More informationMAT2377. Ali Karimnezhad. Version September 9, Ali Karimnezhad
MAT2377 Ali Karimnezhad Version September 9, 2015 Ali Karimnezhad Comments These slides cover material from Chapter 1. In class, I may use a blackboard. I recommend reading these slides before you come
More informationLecture 9: Conditional Probability and Independence
EE5110: Probability Foundations July-November 2015 Lecture 9: Conditional Probability and Independence Lecturer: Dr. Krishna Jagannathan Scribe: Vishakh Hegde 9.1 Conditional Probability Definition 9.1
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter One Jesse Crawford Department of Mathematics Tarleton State University (Tarleton State University) Chapter One Notes 1 / 71 Outline 1 A Sketch of Probability and
More informationSTAT 418: Probability and Stochastic Processes
STAT 418: Probability and Stochastic Processes Spring 2016; Homework Assignments Latest updated on April 29, 2016 HW1 (Due on Jan. 21) Chapter 1 Problems 1, 8, 9, 10, 11, 18, 19, 26, 28, 30 Theoretical
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationWhat is the probability of getting a heads when flipping a coin
Chapter 2 Probability Probability theory is a branch of mathematics dealing with chance phenomena. The origins of the subject date back to the Italian mathematician Cardano about 1550, and French mathematicians
More information1 True/False. Math 10B with Professor Stankova Worksheet, Discussion #9; Thursday, 2/15/2018 GSI name: Roy Zhao
Math 10B with Professor Stankova Worksheet, Discussion #9; Thursday, 2/15/2018 GSI name: Roy Zhao 1 True/False 1. True False When we solve a problem one way, it is not useful to try to solve it in a second
More information4. Probability of an event A for equally likely outcomes:
University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:
More informationIntroduction to Probability Theory
Introduction to Probability Theory Overview The concept of probability is commonly used in everyday life, and can be expressed in many ways. For example, there is a 50:50 chance of a head when a fair coin
More informationLecture 3: Probability
Lecture 3: Probability 28th of October 2015 Lecture 3: Probability 28th of October 2015 1 / 36 Summary of previous lecture Define chance experiment, sample space and event Introduce the concept of the
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More information4. Conditional Probability
1 of 13 7/15/2009 9:25 PM Virtual Laboratories > 2. Probability Spaces > 1 2 3 4 5 6 7 4. Conditional Probability Definitions and Interpretations The Basic Definition As usual, we start with a random experiment
More informationConditional Probability, Independence, Bayes Theorem Spring January 1, / 23
Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2014 January 1, 2017 1 / 23 Sample Space Confusions 1. Sample space = set of all possible outcomes of an experiment. 2. The size of the
More information12 1 = = 1
Basic Probability: Problem Set One Summer 07.3. We have A B B P (A B) P (B) 3. We also have from the inclusion-exclusion principle that since P (A B). P (A B) P (A) + P (B) P (A B) 3 P (A B) 3 For examples
More informationConditional probability
CHAPTER 4 Conditional probability 4.1. Introduction Suppose there are 200 men, of which 100 are smokers, and 100 women, of which 20 are smokers. What is the probability that a person chosen at random will
More informationStat 225 Week 1, 8/20/12-8/24/12, Notes: Set Theory
Stat 225 Week 1, 8/20/12-8/24/12, Notes: Set Theory The Fall 2012 Stat 225 T.A.s September 7, 2012 The material in this handout is intended to cover general set theory topics. Information includes (but
More informationChapter 7: Section 7-1 Probability Theory and Counting Principles
Chapter 7: Section 7-1 Probability Theory and Counting Principles D. S. Malik Creighton University, Omaha, NE D. S. Malik Creighton University, Omaha, NE Chapter () 7: Section 7-1 Probability Theory and
More informationDetermining Probabilities. Product Rule for Ordered Pairs/k-Tuples:
Determining Probabilities Product Rule for Ordered Pairs/k-Tuples: Determining Probabilities Product Rule for Ordered Pairs/k-Tuples: Proposition If the first element of object of an ordered pair can be
More informationSenior Math Circles November 19, 2008 Probability II
University of Waterloo Faculty of Mathematics Centre for Education in Mathematics and Computing Senior Math Circles November 9, 2008 Probability II Probability Counting There are many situations where
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationMATH MW Elementary Probability Course Notes Part I: Models and Counting
MATH 2030 3.00MW Elementary Probability Course Notes Part I: Models and Counting Tom Salisbury salt@yorku.ca York University Winter 2010 Introduction [Jan 5] Probability: the mathematics used for Statistics
More informationStatistics 1 - Lecture Notes Chapter 1
Statistics 1 - Lecture Notes Chapter 1 Caio Ibsen Graduate School of Economics - Getulio Vargas Foundation April 28, 2009 We want to establish a formal mathematic theory to work with results of experiments
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationn How to represent uncertainty in knowledge? n Which action to choose under uncertainty? q Assume the car does not have a flat tire
Uncertainty Uncertainty Russell & Norvig Chapter 13 Let A t be the action of leaving for the airport t minutes before your flight Will A t get you there on time? A purely logical approach either 1. risks
More informationConsider an experiment that may have different outcomes. We are interested to know what is the probability of a particular set of outcomes.
CMSC 310 Artificial Intelligence Probabilistic Reasoning and Bayesian Belief Networks Probabilities, Random Variables, Probability Distribution, Conditional Probability, Joint Distributions, Bayes Theorem
More informationIf S = {O 1, O 2,, O n }, where O i is the i th elementary outcome, and p i is the probability of the i th elementary outcome, then
1.1 Probabilities Def n: A random experiment is a process that, when performed, results in one and only one of many observations (or outcomes). The sample space S is the set of all elementary outcomes
More information14 - PROBABILITY Page 1 ( Answers at the end of all questions )
- PROBABILITY Page ( ) Three houses are available in a locality. Three persons apply for the houses. Each applies for one house without consulting others. The probability that all the three apply for the
More informationEvent A: at least one tail observed A:
Chapter 3 Probability 3.1 Events, sample space, and probability Basic definitions: An is an act of observation that leads to a single outcome that cannot be predicted with certainty. A (or simple event)
More information4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio
4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Wrong is right. Thelonious Monk 4.1 Three Definitions of
More information