Chapter 3 : Conditional Probability and Independence
|
|
- Barnaby Arnold
- 5 years ago
- Views:
Transcription
1 STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2016 Néhémy Lim Chapter 3 : Conditional Probability and Independence 1 Conditional Probabilities How should we modify the probability of an event when some supplementary information concerning the result of an experiment is available? The concept of conditional probability allows to answer this question. Example 1. A professional tennis player has the following yearly records : 45 victories (W) - 17 losses (L). Before playing a match, one would then bet that he would win with probability 45/( ) Actually, we may suspect that the surface he is playing on might have some effect on his performance. To get better insight on this assumption, we have the following data on the player s records : W L Grass 7 3 Hard 27 9 Clay 11 5 Intuitively, if we know that the player is going to play a match on clay, we feel that the probability of winning should be updated to 11/(11+5) = This intuition turns out to be true and is confirmed by the definition of conditional probability. Definition 1.1 (Conditional probability). Let (Ω, A, P) be a probability space and F A an event such that > 0, we define the conditional probability that an event E A occurs given or knowing that F has occurred, and denote it by P(E F ), as follows : P(E F ) = P(E F ) (1) Proposition 1.1. Let (Ω, A, P) be a probability space and F A an event such that > 0. Function mapping P F : A R defined by P F (E) = P(E F ) is a probability measure on (Ω, A). Proof. We need to check that P F measure : satisfies the three axioms of a probability 1
2 1. For any event E A, is P F (E) 0? By definition, P F (E) = P(E F )/. Since P(E F ) 0 and > 0. So P F (E) Is P F (Ω) = 1? By definition, P F (Ω) = P(Ω F )/ = / = Let (E i ) be a countably infinite sequence of events that are mutually exclusive (i.e. E i E j = if i j), do we have P F ( E i) = P F (E i )? ( ) P F E i ( ) = P E i F by definition = P ( E i F ) = P ( (E i F )) distributivity of over = P(E i F ) since P is a probability measure and events E i are mutually exclusive events = P F (E i ) Remark : In case the sample space Ω is finite with uniform probability, that is all outcomes are equally likely to occur then, conditional on the event that the outcome lies in a subset F Ω, it may be convenient to compute conditional probabilities of the form P(E F ) by using F as the reduced sample space. Proposition 1.2. Let Ω be a finite sample space and consider the associated probability space (Ω, P(Ω), P) with uniform probability measure P. Let F A be an event such that > 0, the conditional probability of event E A given F can be computed as : P(E F ) = E F (2) F Example 2. You draw a card from a standard deck of 52 cards. If the card you draw is an ace, what is the probability that this is the ace of spades? Let A be the event that the card is an ace and S be the event that the card is a spade. Using the above proposition, the desired probability is thus : P(S A) = S A A = 1 4 2
3 Proposition 1.3 (Multiplication rule). Let E 1,..., E n be a sequence of n N, n 1 events. Then we have, ( n ) ( ) n 1 P E i = P(E 1 )P(E 2 E 1 )P(E 3 E 1 E 2 )... P E n E i (3) In particular, for n = 2, we have : P(E 1 E 2 ) = P(E 1 )P(E 2 E 1 ) Proof. To prove the multiplication rule, just apply the definition of conditional probability to its right-hand side. Example 3. Three cards are dealt successively at random and without replacement from a standard deck of 52 playing cards. What is the probability of receiving, in order, a king, a queen, and a jack? Let K 1, Q 2 and J 3 be the events of being dealt a king in the first draw, a queen in the second draw and a jack in the third draw, respectively. We want to find P(K 1 Q 2 J 3 ). According to the multiplication rule, we have : P(K 1 Q 2 J 3 ) = P(K 1 )P(Q 2 K 1 )P(J 3 K 1 Q 2 ) = For any two events E and F such that P(E) > 0 and > 0, we have that P(E F ) = P(E F ) so P(E F ) = P(E F ). Similarly, we have that P(F E) = P(E F ) P(E). By replacing P(E F ) by P(E F ) in the last expression, we obtain the so-called first Bayes s formula that is stated as follows : Property 1.1 (First Bayes s formula). Let E and F be two events such that P(E) > 0 and > 0. We have that P(F E) = P(E F ) P(E) (4) Example 4. According to a study, 0.5% of the population exhibit symptoms of video game addiction. The study highlights that the proportion of addicts is 2% among teenagers. We also know that there are 15% of teenagers in the population. What is the probability that a randomly selected addict is a teenager? Let us denote A the event that a person is an addict and T the event that the person is a teenager. Then the desired probability is : P(T A) = P(A T )P(T ) P(A) = = 0.6 In Chapter 2, one of the main results is called the law of total probability. This result can be rewritten using conditional probabilities instead of probabilities of intersection thanks to the multiplication rule. 3
4 Property 1.2 (Law of total probability). Let E A be an event and F 1,..., F n be n N, n 1 events that form a partition of the sample space Ω (i.e. n F i = Ω and F i F j = for i j), we have that n P(E) = P (E F i ) P(F i ) (5) The law of total probability entails the following result known as the second Bayes s formula : Property 1.3 (Second Bayes s formula). Let E A be an event and F 1,..., F n be nn, n 1 events that form a partition of the sample space Ω (i.e. n F i = Ω and F i F j = for i j). For a given i = 1... n, we have that P(F i E) = P(E F i )P(F i ) n j=1 P(E F j)p(f j ) (6) Example 5. A company called Fruit designs smartphones called e-phones. The items are produced on three factories. The three factories account for 20%, 30%, and 50% of the output, respectively. The fraction of defective e-phones produced is this: for the first factory, 5%; for the second factory, 3%; for the third factory, 1%. If an e-phone is chosen at random from the total output and is found to be defective, what is the probability that it was produced by the third factory? Let F i be the event that a given item is produced on the ith factory, for i = 1, 2, 3 and let us denote D the event that the item is defective. We are given that P(F 1 ) = 0.2, P(F 2 ) = 0.3 and P(F 3 ) = 0.5. In addition, P(D F 1 ) = 0.05, P(D F 2 ) = 0.03 and P(D F 3 ) = We want to find P(F 3 D). The second Bayes s formula is applied as follows: P(F 3 D) = P(D F 3 )P(F 3 ) P(D F 1 )P(F 1 ) + P(D F 2 )P(F 2 ) + P(D F 3 )P(F 3 ) = Independent Events Definition 2.1 (Independence). Let (Ω, A, P) be a probability space and E, F A two events such that P(E) > 0 and > 0, events E and F are said to be independent if one of the following equivalent identities holds : (a) P(E F ) = P(E) 4
5 (b) P(E F ) = P(E) (c) P(F E) = Example 6. A card is selected at random from an ordinary deck of 52 playing cards. If A is the event that the selected card is an ace and S is the event that it is a spade, then A and S are independent. Indeed, P(A) = 4 52 = 1 13, P(S) = = and P(A S) = 52 = P(A)P(S) Property 2.1. If events E and F are independent, then so are : E and F c E c and F E c and F c Proof. Let E and F be two independent events and let us prove that E and F c are independent, that is P(E F c ) = P(E)P(F c ). We have : P(E F c ) = P(E) P(E F ) (Law of total probability) = P(E) P(E) (since E and F are independent) = P(E)(1 ) = P(E)P(F c ) The proofs for the rest of the property are left as an exercise. Example 7. You roll one die followed by another die. Let A be the event that the sum of the die is 9. Let B be the event that the first die lands on an even number. Let C be the event that the second die lands on an odd number. Show that A and B are independent A and C are independent B and C are independent P(A B C) P(A)P(B)P(C) In a situation like this we say that A, B and C are pairwise independent but not mutually independent. Definition 2.2 (Independence of n events). Let E 1,..., E n be a sequence of n N, n 1 events, we say that events (E i )...n are pairwise independent if E i and E j are independent, that is P(E i E j ) = P(E i )P(E j ) for all i j. We say that events (E i )...n are mutually independent or independent if for all subsets I {1,..., n} ( ) P E i = P (E i ) (7) i I i I 5
6 For instance, for n = 3, if E 1, E 2 and E 3 are mutually independent, this means P(E 1 E 2 ) = P(E 1 )P(E 2 ) P(E 1 E 3 ) = P(E 1 )P(E 3 ) P(E 2 E 3 ) = P(E 2 )P(E 3 ) P(E 1 E 2 E 3 ) = P(E 1 )P(E 2 )P(E 3 ) Example 8. A person has two coins. The first coin comes up heads with probability 1/4 and tails with probability 3/4. The second coin comes up heads with probability 3/4 and tails with probability 1/4. One of the two coins is selected and then flipped twice. Each coin has the same initial probability of being selected. 1. Show that the event that the first flip is heads is not independent of the event that the second flip is heads. 2. Let F be the event that the first coin is selected. Let H 1 be the event that the first flip is heads and let H 2 be the event that the second flip is heads. Show that P(H 1 H 2 F ) = P(H 1 F )P(H 2 F ) Definition 2.3. Let E, F and G be three events such that P(G) > 0. We say that E and F are conditionally independent given G (or that conditioned on G the events E and F are independent) if P(E F G) = P(E G)P(F G) (8) It is easy to check that if E and F are conditionally independent given G then so are E and F c. It is also easy to extend this to three or more events being conditionally independent given G. 6
Probability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationSTAT 516: Basic Probability and its Applications
Lecture 3: Conditional Probability and Independence Prof. Michael September 29, 2015 Motivating Example Experiment ξ consists of rolling a fair die twice; A = { the first roll is 6 } amd B = { the sum
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationOutline Conditional Probability The Law of Total Probability and Bayes Theorem Independent Events. Week 4 Classical Probability, Part II
Week 4 Classical Probability, Part II Week 4 Objectives This week we continue covering topics from classical probability. The notion of conditional probability is presented first. Important results/tools
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationP (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More informationDiscrete Random Variables (1) Solutions
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 06 Néhémy Lim Discrete Random Variables ( Solutions Problem. The probability mass function p X of some discrete real-valued random variable X is given
More informationChapter 7: Section 7-1 Probability Theory and Counting Principles
Chapter 7: Section 7-1 Probability Theory and Counting Principles D. S. Malik Creighton University, Omaha, NE D. S. Malik Creighton University, Omaha, NE Chapter () 7: Section 7-1 Probability Theory and
More informationMATH 556: PROBABILITY PRIMER
MATH 6: PROBABILITY PRIMER 1 DEFINITIONS, TERMINOLOGY, NOTATION 1.1 EVENTS AND THE SAMPLE SPACE Definition 1.1 An experiment is a one-off or repeatable process or procedure for which (a there is a well-defined
More informationProbability 1 (MATH 11300) lecture slides
Probability 1 (MATH 11300) lecture slides Márton Balázs School of Mathematics University of Bristol Autumn, 2015 December 16, 2015 To know... http://www.maths.bris.ac.uk/ mb13434/prob1/ m.balazs@bristol.ac.uk
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationSTAT 516 Answers Homework 2 January 23, 2008 Solutions by Mark Daniel Ward PROBLEMS. = {(a 1, a 2,...) : a i < 6 for all i}
STAT 56 Answers Homework 2 January 23, 2008 Solutions by Mark Daniel Ward PROBLEMS 2. We note that E n consists of rolls that end in 6, namely, experiments of the form (a, a 2,...,a n, 6 for n and a i
More informationIf S = {O 1, O 2,, O n }, where O i is the i th elementary outcome, and p i is the probability of the i th elementary outcome, then
1.1 Probabilities Def n: A random experiment is a process that, when performed, results in one and only one of many observations (or outcomes). The sample space S is the set of all elementary outcomes
More informationMutually Exclusive Events
172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes
More informationCompound Events. The event E = E c (the complement of E) is the event consisting of those outcomes which are not in E.
Compound Events Because we are using the framework of set theory to analyze probability, we can use unions, intersections and complements to break complex events into compositions of events for which it
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationDiscrete Probability. Mark Huiskes, LIACS Probability and Statistics, Mark Huiskes, LIACS, Lecture 2
Discrete Probability Mark Huiskes, LIACS mark.huiskes@liacs.nl Probability: Basic Definitions In probability theory we consider experiments whose outcome depends on chance or are uncertain. How do we model
More informationChapter 4 : Discrete Random Variables
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2015 Néhémy Lim Chapter 4 : Discrete Random Variables 1 Random variables Objectives of this section. To learn the formal definition of a random variable.
More information(6, 1), (5, 2), (4, 3), (3, 4), (2, 5), (1, 6)
Section 7.3: Compound Events Because we are using the framework of set theory to analyze probability, we can use unions, intersections and complements to break complex events into compositions of events
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationECE 302: Chapter 02 Probability Model
ECE 302: Chapter 02 Probability Model Fall 2018 Prof Stanley Chan School of Electrical and Computer Engineering Purdue University 1 / 35 1. Probability Model 2 / 35 What is Probability? It is a number.
More informationConditional Probability. CS231 Dianna Xu
Conditional Probability CS231 Dianna Xu 1 Boy or Girl? A couple has two children, one of them is a girl. What is the probability that the other one is also a girl? Assuming 50/50 chances of conceiving
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More informationDetermining Probabilities. Product Rule for Ordered Pairs/k-Tuples:
Determining Probabilities Product Rule for Ordered Pairs/k-Tuples: Determining Probabilities Product Rule for Ordered Pairs/k-Tuples: Proposition If the first element of object of an ordered pair can be
More information(i) Given that a student is female, what is the probability of having a GPA of at least 3.0?
MATH 382 Conditional Probability Dr. Neal, WKU We now shall consider probabilities of events that are restricted within a subset that is smaller than the entire sample space Ω. For example, let Ω be the
More informationChapter 2.5 Random Variables and Probability The Modern View (cont.)
Chapter 2.5 Random Variables and Probability The Modern View (cont.) I. Statistical Independence A crucially important idea in probability and statistics is the concept of statistical independence. Suppose
More informationElementary Discrete Probability
Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More information1. Discrete Distributions
Virtual Laboratories > 2. Distributions > 1 2 3 4 5 6 7 8 1. Discrete Distributions Basic Theory As usual, we start with a random experiment with probability measure P on an underlying sample space Ω.
More informationExample. What is the sample space for flipping a fair coin? Rolling a 6-sided die? Find the event E where E = {x x has exactly one head}
Chapter 7 Notes 1 (c) Epstein, 2013 CHAPTER 7: PROBABILITY 7.1: Experiments, Sample Spaces and Events Chapter 7 Notes 2 (c) Epstein, 2013 What is the sample space for flipping a fair coin three times?
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationProbability Theory Review
Cogsci 118A: Natural Computation I Lecture 2 (01/07/10) Lecturer: Angela Yu Probability Theory Review Scribe: Joseph Schilz Lecture Summary 1. Set theory: terms and operators In this section, we provide
More informationIndependence. P(A) = P(B) = 3 6 = 1 2, and P(C) = 4 6 = 2 3.
Example: A fair die is tossed and we want to guess the outcome. The outcomes will be 1, 2, 3, 4, 5, 6 with equal probability 1 6 each. If we are interested in getting the following results: A = {1, 3,
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter One Jesse Crawford Department of Mathematics Tarleton State University (Tarleton State University) Chapter One Notes 1 / 71 Outline 1 A Sketch of Probability and
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More information2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More informationProbability the chance that an uncertain event will occur (always between 0 and 1)
Quantitative Methods 2013 1 Probability as a Numerical Measure of the Likelihood of Occurrence Probability the chance that an uncertain event will occur (always between 0 and 1) Increasing Likelihood of
More informationSTA 2023 EXAM-2 Practice Problems. Ven Mudunuru. From Chapters 4, 5, & Partly 6. With SOLUTIONS
STA 2023 EXAM-2 Practice Problems From Chapters 4, 5, & Partly 6 With SOLUTIONS Mudunuru, Venkateswara Rao STA 2023 Spring 2016 1 1. A committee of 5 persons is to be formed from 6 men and 4 women. What
More informationPLEASE MARK YOUR ANSWERS WITH AN X, not a circle! 1. (a) (b) (c) (d) (e) 2. (a) (b) (c) (d) (e) (a) (b) (c) (d) (e) 4. (a) (b) (c) (d) (e)...
Math 020, Exam II October, 206 The Honor Code is in effect for this examination. All work is to be your own. You may use a calculator. The exam lasts for hour 5 minutes. Be sure that your name is on every
More informationHW MATH425/525 Lecture Notes 1
HW MATH425/525 Lecture Notes 1 Definition 4.1 If an experiment can be repeated under the same condition, its outcome cannot be predicted with certainty, and the collection of its every possible outcome
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationIntermediate Math Circles November 8, 2017 Probability II
Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationMATH MW Elementary Probability Course Notes Part I: Models and Counting
MATH 2030 3.00MW Elementary Probability Course Notes Part I: Models and Counting Tom Salisbury salt@yorku.ca York University Winter 2010 Introduction [Jan 5] Probability: the mathematics used for Statistics
More informationLecture 1 Introduction to Probability and Set Theory Text: A Course in Probability by Weiss
Lecture 1 to and Set Theory Text: A Course in by Weiss 1.2 2.3 STAT 225 to Models January 13, 2014 to and Whitney Huang Purdue University 1.1 Agenda to and 1 2 3 1.2 Motivation Uncertainty/Randomness in
More information4. Conditional Probability P( ) CSE 312 Autumn 2012 W.L. Ruzzo
4. Conditional Probability P( ) CSE 312 Autumn 2012 W.L. Ruzzo 1 conditional probability Conditional probability of E given F: probability that E occurs given that F has occurred. Conditioning on F S Written
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Probability assigns a likelihood to results of experiments that have not yet been conducted. Suppose that the experiment has
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationChapter Summary. 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance
Chapter 7 Chapter Summary 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance Section 7.1 Introduction Probability theory dates back to 1526 when the Italian
More informationDiscrete Probability
Discrete Probability Counting Permutations Combinations r- Combinations r- Combinations with repetition Allowed Pascal s Formula Binomial Theorem Conditional Probability Baye s Formula Independent Events
More informationConditional Probability and Independence
Conditional Probability and Independence September 3, 2009 1 Restricting the Sample Space - Conditional Probability How do we modify the probability of an event in light of the fact that something is known?
More informationMath Exam 1 Review. NOTE: For reviews of the other sections on Exam 1, refer to the first page of WIR #1 and #2.
Math 166 Fall 2008 c Heather Ramsey Page 1 Math 166 - Exam 1 Review NOTE: For reviews of the other sections on Exam 1, refer to the first page of WIR #1 and #2. Section 1.5 - Rules for Probability Elementary
More informationLecture 4. Selected material from: Ch. 6 Probability
Lecture 4 Selected material from: Ch. 6 Probability Example: Music preferences F M Suppose you want to know what types of CD s males and females are more likely to buy. The CD s are classified as Classical,
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationSTOR Lecture 4. Axioms of Probability - II
STOR 435.001 Lecture 4 Axioms of Probability - II Jan Hannig UNC Chapel Hill 1 / 23 How can we introduce and think of probabilities of events? Natural to think: repeat the experiment n times under same
More informationIntro to Probability Day 4 (Compound events & their probabilities)
Intro to Probability Day 4 (Compound events & their probabilities) Compound Events Let A, and B be two event. Then we can define 3 new events as follows: 1) A or B (also A B ) is the list of all outcomes
More informationDynamic Programming Lecture #4
Dynamic Programming Lecture #4 Outline: Probability Review Probability space Conditional probability Total probability Bayes rule Independent events Conditional independence Mutual independence Probability
More informationPlease do NOT write in this box. Multiple Choice Total
Name: Instructor: ANSWERS Bullwinkle Math 1010, Exam I. October 14, 014 The Honor Code is in effect for this examination. All work is to be your own. Please turn off all cellphones and electronic devices.
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationAxioms of Probability. Set Theory. M. Bremer. Math Spring 2018
Math 163 - pring 2018 Axioms of Probability Definition: The set of all possible outcomes of an experiment is called the sample space. The possible outcomes themselves are called elementary events. Any
More informationEcon 113. Lecture Module 2
Econ 113 Lecture Module 2 Contents 1. Experiments and definitions 2. Events and probabilities 3. Assigning probabilities 4. Probability of complements 5. Conditional probability 6. Statistical independence
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Example: Two dice are tossed. What is the probability that the sum is 8? This is an easy exercise: we have a sample space
More informationAxiomatic Foundations of Probability. Definition: Probability Function
Chapter 1 sections We will SKIP a number of sections Set theory SKIP Real number uncountability Definition of probability Finite sample spaces Counting methods Combinatorial methods SKIP tennis tournament
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationSTA 2023 EXAM-2 Practice Problems From Chapters 4, 5, & Partly 6. With SOLUTIONS
STA 2023 EXAM-2 Practice Problems From Chapters 4, 5, & Partly 6 With SOLUTIONS Mudunuru Venkateswara Rao, Ph.D. STA 2023 Fall 2016 Venkat Mu ALL THE CONTENT IN THESE SOLUTIONS PRESENTED IN BLUE AND BLACK
More informationIntroduction to probability
Introduction to probability 4.1 The Basics of Probability Probability The chance that a particular event will occur The probability value will be in the range 0 to 1 Experiment A process that produces
More informationIntroduction and basic definitions
Chapter 1 Introduction and basic definitions 1.1 Sample space, events, elementary probability Exercise 1.1 Prove that P( ) = 0. Solution of Exercise 1.1 : Events S (where S is the sample space) and are
More informationMATH 3C: MIDTERM 1 REVIEW. 1. Counting
MATH 3C: MIDTERM REVIEW JOE HUGHES. Counting. Imagine that a sports betting pool is run in the following way: there are 20 teams, 2 weeks, and each week you pick a team to win. However, you can t pick
More informationProblem #1 #2 #3 #4 Extra Total Points /3 /13 /7 /10 /4 /33
STAT/MATH 394 A - Autumn Quarter 206 - Midterm - October 2, 206 Name: Student ID Number: Problem # #2 #3 #4 Extra Total Points /3 /3 /7 /0 /4 /33 Read directions carefully and show all your work. Particularly,
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More information18.600: Lecture 7 Bayes formula and independence
18.600: Lecture 7 Bayes formula and independence Scott Sheffield MIT Outline Bayes formula Independence Outline Bayes formula Independence Recall definition: conditional probability Definition: P(E F )
More informationLectures Conditional Probability and Independence
Lectures 5 11 Conditional Probability and Independence Purpose: Calculate probabilities under restrictions, conditions or partial information on the random experiment. Break down complex probabilistic
More informationIntroduction to Probability
Introduction to Probability Content Experiments, Counting Rules, and Assigning Probabilities Events and Their Probability Some Basic Relationships of Probability Conditional Probability Bayes Theorem 2
More informationThe enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}
Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment
More informationBASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES
BASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES COMMON TERMS RELATED TO PROBABILITY Probability is the measure of the likelihood that an event will occur Probability values are
More informationStatistical Methods for the Social Sciences, Autumn 2012
Statistical Methods for the Social Sciences, Autumn 2012 Review Session 3: Probability. Exercises Ch.4. More on Stata TA: Anastasia Aladysheva anastasia.aladysheva@graduateinstitute.ch Office hours: Mon
More informationIntro to Probability Day 3 (Compound events & their probabilities)
Intro to Probability Day 3 (Compound events & their probabilities) Compound Events Let A, and B be two event. Then we can define 3 new events as follows: 1) A or B (also A B ) is the list of all outcomes
More informationLecture 3 - Axioms of Probability
Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What
More information18.600: Lecture 7 Bayes formula and independence
18.600 Lecture 7 18.600: Lecture 7 Bayes formula and independence Scott Sheffield MIT 18.600 Lecture 7 Outline Bayes formula Independence 18.600 Lecture 7 Outline Bayes formula Independence Recall definition:
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More information