ECE 450 Lecture 2. Recall: Pr(A B) = Pr(A) + Pr(B) Pr(A B) in general = Pr(A) + Pr(B) if A and B are m.e. Lecture Overview
|
|
- Allen Fowler
- 5 years ago
- Views:
Transcription
1 ECE 450 Lecture 2 Recall: Pr(A B) = Pr(A) + Pr(B) Pr(A B) in general = Pr(A) + Pr(B) if A and B are m.e. Lecture Overview Conditional Probability, Pr(A B) Total Probability Bayes Theorem Independent Events Compound Experiments Binomial Distribution ECE 450 D. van Alphen 1
2 Conditional Probability Defn: The conditional probability of event A, given that event B has occurred is Pr( A B) P(B) Note (by symmetry of the definition): Pr( B A) Pr(A B), Pr(B) Pr(A B) Pr(A) P(A) From (1) & (2), we have two new ways of writing Pr(A B): Pr(A B) = Pr(A) Pr(B A) = Pr(B) Pr(A B) 0 0 (1) (2) ECE 450 D. van Alphen 2
3 Verification Example (Is the definition reasonable?) Experiment: Toss a single die, and find Pr(2 even) Pr( 2 even) Pr(2 even) Pr(even) Pr(2) Pr(even) / 3 Another way to look at it - Let B be the event of getting an even number: B is called the restricted S B B 1 sample space; 2 is now one of 3 equally likely outcomes. 3 6 ECE 450 D. van Alphen 3
4 Experiment: Toss 2 coins Another Example Sample Space: S = {HH, HT, TH, TT} Find the conditional probability of obtaining two heads when flipping two coins, given that at least one head was obtained; i.e., find Pr(2 heads at least 1 head) Def: A: event of obtaining 2 heads = {HH} Then B: event of obtaining at least one head = {HH, HT, TH} Pr( A Pr(A B) B) Pr(B) Pr(A) Pr(B) / 3 ECE 450 D. van Alphen 4
5 Side Note & Definition Note: Conditional probabilities are themselves probabilities; thus, they satisfy all the axioms for probabilities : 1. Pr(A B) 0 2. Pr(B B) = 1 3. Pr(A C B) = Pr(A B) + Pr(C B) if A and C are m.e. Another definition: consider a collection of subsets, {A i }, (i = 1,, n ), of S. The collection is S A 1 A 2 a partition of S if:... A n A i A j = f, i j U A i = S, i = 1,, n ECE 450 D. van Alphen 5
6 Total Probability Theorem Let {A i } be a partition of S, and let B be a subset of S: S A 1 A 2 A 3 B... A n Strategy: To find Pr(B), break apart B, into mutually exclusive pieces Then Pr(B) = Pr[ (A 1 B) (A 2 B)... (A n B) ] m.e = Pr(A 1 B) + Pr(A 2 B) + + Pr(A n B) (see box, bottom of p.2) Pr(B) = Pr(B A 1 )Pr(A 1 ) + Pr(B A 2 )Pr(A 2 ) + + Pr(B A n )Pr(A n ) ECE 450 D. van Alphen 6
7 Example Using Total Probability Transistor types X, Y and Z make up 45%, 25%, and 30% of the total number of transistors in a box, respectively. Let B be the event that a transistor fails before 1000 hrs. Given the reliability information: Pr(B X) =.15 Pr(B Y) =.4 Pr(B Z) =.25 Find the probability that a randomly chosen transistor from the box fails before 1000 hours. Pr(B) = + + = + + =.243 ECE 450 D. van Alphen 7
8 Bayes Rule Recall from p. 2 (again, the box near the bottom) Pr(A B) = Pr(A B) Pr(B) = Pr(B A) Pr(A) Focus here; solve for Pr(A B) Pr(B A)Pr(A) Pr( A B), Pr(B) 0 Pr(B) (Bayes Rule) Pr( A j B) n Pr( B j1 A Pr( B j A )Pr( A j j ) )Pr( A j ) By ECE 450 D. van Alphen 8
9 Bayes Rule: Note & Example Note: Use Bayes Rule when asked to find some Pr(A B), but it would be easier to find Pr(B A). ( Backwards conditional probability ) Example: Say an observed transistor (from the previous example) fails before 1000 hrs. Find the probability that it was a Type Z transistor. Let B: event that transistor fails before 1000 hrs. We want: Pr(Z B), non-trivial We know Pr(B Z) =.25 (the easier problem; given on p. 7) Using Bayes Rule, next page: ECE 450 D. van Alphen 9
10 Bayes Rule Example, continued Pr( Z B) Pr(B Z)Pr(Z) Pr(B) Answer from p. 7 example In-Class Practice Two cards are drawn without replacement from a 52-card deck. Find the probability that the 2 nd is a queen, given that the 1 st is a queen. Find the probability that both the 1 st and 2 nd are queens. Unordered answers: 1/221, 3/51 ECE 450 D. van Alphen 10
11 Bayes Rule In-Class Example A medical test for a particular type of cancer has the following properties: It correctly detects the cancer (when present) with probability 95%; It incorrectly detects the cancer (when there is no cancer present) with probability 20%. Suppose that this particular type of cancer is present in only 1% of people of your age/sex/ethnicity. Find the probability that you actually have this cancer, given that your test is positive (i.e., cancer was detected). Let c: event that you have cancer. Let d: event that cancer is detected. ECE 450 D. van Alphen 11
12 Pr(d c) =.95; Pr( ) =.05 (complements) Pr(d c ) =.2; Pr(d c ) = ; Pr(c) =.01 (a priori) Find Pr(c d) ECE 450 D. van Alphen 12
13 (Statistically) Independent Events Defn: 2 events A and B are statistically independent ( ) if and only if Pr(A B) = Pr(A) (knowing B has occurred tells me nothing about whether or not A has occurred) Equivalently: and Pr(B A) = P(B) Pr(A B) = Pr(A) Pr(B) (caution: only true for independent events) ECE 450 D. van Alphen 13
14 Example Using Independence Definition Experiment: Toss 2 dice. Define the events A: sum = 7 Question: Are A, B, B: 1 face = 6 Pr(A B) Pr Pr{(6,1) (1,6)} 2 / 36 2 Pr( B) Pr{(6,1) (6,2) (6,6)} 11/ Pr(A) = 6/36 = 1/6 A, B not A, B dependent ECE 450 D. van Alphen 14
15 Facts/Thoughts About Independence Fact 1: Complementary events are dependent events. Fact 2: Unions, intersections & complements of independent events are independent. Consider the 2012 election (Obama/Biden vs. Romney/Ryan): Event A: Obama wins as Pres. Event B: Romney wins as Pres. Event C: Biden wins as VP. Event D: Ryan wins as VP. Is there any pair of events from this set that is an independent pair? Let A: it rains today; B: it rains tomorrow. Are A and B independent? ECE 450 D. van Alphen 15
16 Example Using Independence Say the switches in the circuit below are closed ( -ly of each other) at any time with probability 0.1. Find the probability of a closed path from point A to point B. A B Labeling for the Solution: A bottom top right ECE 450 D. van Alphen 16 B Note: for a closed path to exist, the right switch must be closed; and, either the bottom switch must be closed or both of the top switches must be closed.
17 Example, continued Pr(closed path) = Pr[ right and ( top or bottom )] (both switches) = Pr(right) Pr(top or bottom), by Fact 2, p. 14 = (0.1) [Pr(top) + Pr(bottom) Pr(both top & bottom)] by Corollary 4 (both switches: (.1)(.1) ) A =.1 [(.01) +.1 (.01)(.1)] =.0109 top right B Note: Don t round off! bottom ECE 450 D. van Alphen 17
18 Compound Experiments Consider experiments: E a, E b with sample spaces: S a, S b Say S a = {a 1,, a n } and S b = {b 1,, b m }. Define S a x S b (the Cartesian Cross Product) as the set of ordered pairs with the 1 st element from S a and the second element from S b Do experiments E a & E b (jointly), and get pairs of outcomes from S a x S b The joint performance of E a & E b is said to be a compound experiment. ECE 450 D. van Alphen 18
19 Cross Product Examples & Bernoulli Trials Example 1: Toss a coin 2 times, with S 1 = S 2 = {H, T}. S = S 1 x S 2 = {,,, } Example 2: Toss a coin 3 times, with S 1 = S 2 = S 3 = {H, T}. S = S 1 x S 2 x S 3 = { (HHH), (HHT), (HTH), (HTT), (THH), (THT), (TTH), (TTT) } Definition: A Bernoulli Trial is an experiment with only 2 possible outcomes, sometimes called success and failure. Success 1 yes, Failure 0 no ECE 450 D. van Alphen 19
20 Binomial Experiments Definition: A Binomial Experiment is an experiment consisting of n independent Bernoulli Trials. Let A k denote the event of getting k successes (and thus n-k failures) in n trials. Let p be the probability of success on each trial. Let q = 1 p be the probability of failure on each trial. Example: Consider a 5-trial binomial experiment, and say we are interested in the probability of having 2 successes (first), followed by 3 failures. Pr{1, 1, 0, 0, 0} = = (O.K. to multiply since the events are ) ECE 450 D. van Alphen 20
21 Binomial Experiments, continued Refined example: Say we want to know the probability of getting 2 successes, in 5 independent trials (order doesn t matter): 5 2 Pr{A 2 } = p 2 q 3 (since there are 5 C 2 ways to decide where to put the 2 successes in the string of 5 outcomes) In general, the probability of getting k successes in n (independent) Bernoulli tials is n k p n (k) = Pr{A k } = p k q n k (Binomial Experiments) ECE 450 D. van Alphen 21
22 Binomial Experiment Examples missiles are fired at a tank; each missile has a (0.2) probability of hitting the tank, independently of the other missiles. Find the probability that exactly 3 missiles hit the tank. p 10 (3) = Pr{ A 3 } = ( ) 3 ( ) A certain football player can catch 2/3 of the passes thrown to him. He needs to catch at least 3 more passes for his team to win the game. Find the probability that his team wins if the quarterback throws to him 5 more times. Pr{win} = Pr{at least 3 catches} = Pr{exactly 3 catches or exactly 4 catches or exactly 5 catches} ECE 450 D. van Alphen 22
23 Binomial Experiment Examples, continued = Pr{A 3 A 4 A 5 } = Pr{A 3 } + Pr{A 4 } + Pr{A 5 } = + + = ** Note: we can add these probabilities, because the events catch exactly 1 pass, catch exactly 2 passes, and catch exactly 3 passes are: events. ECE 450 D. van Alphen 23
24 Binomial Experiment Examples 3. Using a normal deck of cards, say we cut the deck 5 times; find the probability of getting an ace on at least 3 cuts. Pr{at least 3 aces} = Pr{exactly 3 aces or exactly 4 aces or exactly 5 aces) = Pr{A 3 } + Pr{A 4 } + Pr{A 5 } = = (Bernoulli Trials) m.e. ECE 450 D. van Alphen 24
25 Danger!! 1. Pr(A B) = Pr(A) + Pr(B) Pr(A B) = Pr(A) + Pr(B) if A, B m.e. 2. Pr(A B) = Pr(A) Pr(B A) = Pr(A) Pr(B) if A, B independent ECE 450 D. van Alphen 25
26 Review Pr(A B) = (defn) = (Bayes Rule) Total Probability: If {A i } is a partition of sample space S, then Pr(B) = If A and B are independent, then Pr(A B) = and Pr(A B) = (Binomial Experiments): The probability of getting k successes in n independent Bernoulli trials is: ECE 450 D. van Alphen 26
Probability. VCE Maths Methods - Unit 2 - Probability
Probability Probability Tree diagrams La ice diagrams Venn diagrams Karnough maps Probability tables Union & intersection rules Conditional probability Markov chains 1 Probability Probability is the mathematics
More informationMathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2
( : Focus on free Education) Exercise 16.2 Question 1: A die is rolled. Let E be the event die shows 4 and F be the event die shows even number. Are E and F mutually exclusive? Answer 1: When a die is
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationLecture 1 : The Mathematical Theory of Probability
Lecture 1 : The Mathematical Theory of Probability 0/ 30 1. Introduction Today we will do 2.1 and 2.2. We will skip Chapter 1. We all have an intuitive notion of probability. Let s see. What is the probability
More informationCHAPTER - 16 PROBABILITY Random Experiment : If an experiment has more than one possible out come and it is not possible to predict the outcome in advance then experiment is called random experiment. Sample
More informationMathematical Foundations of Computer Science Lecture Outline October 18, 2018
Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationProbability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)
Chapter 14 From Randomness to Probability How to measure a likelihood of an event? How likely is it to answer correctly one out of two true-false questions on a quiz? Is it more, less, or equally likely
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Example: Two dice are tossed. What is the probability that the sum is 8? This is an easy exercise: we have a sample space
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Probability assigns a likelihood to results of experiments that have not yet been conducted. Suppose that the experiment has
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationECE 302: Chapter 02 Probability Model
ECE 302: Chapter 02 Probability Model Fall 2018 Prof Stanley Chan School of Electrical and Computer Engineering Purdue University 1 / 35 1. Probability Model 2 / 35 What is Probability? It is a number.
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationLecture 3 - Axioms of Probability
Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What
More informationCISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability. Outline. Terminology and background. Arthur G.
CISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability Arthur G. Werschulz Fordham University Department of Computer and Information Sciences Copyright Arthur G. Werschulz, 2017.
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More information324 Stat Lecture Notes (1) Probability
324 Stat Lecture Notes 1 robability Chapter 2 of the book pg 35-71 1 Definitions: Sample Space: Is the set of all possible outcomes of a statistical experiment, which is denoted by the symbol S Notes:
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationMODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES
MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES 7-11 Topics 2.1 RANDOM VARIABLE 2.2 INDUCED PROBABILITY MEASURE 2.3 DISTRIBUTION FUNCTION AND ITS PROPERTIES 2.4 TYPES OF RANDOM VARIABLES: DISCRETE,
More informationFirst Digit Tally Marks Final Count
Benford Test () Imagine that you are a forensic accountant, presented with the two data sets on this sheet of paper (front and back). Which of the two sets should be investigated further? Why? () () ()
More informationEvents A and B are said to be independent if the occurrence of A does not affect the probability of B.
Independent Events Events A and B are said to be independent if the occurrence of A does not affect the probability of B. Probability experiment of flipping a coin and rolling a dice. Sample Space: {(H,
More informationSTAT Chapter 3: Probability
Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):
More informationDiscrete Random Variable
Discrete Random Variable Outcome of a random experiment need not to be a number. We are generally interested in some measurement or numerical attribute of the outcome, rather than the outcome itself. n
More informationChapter 13, Probability from Applied Finite Mathematics by Rupinder Sekhon was developed by OpenStax College, licensed by Rice University, and is
Chapter 13, Probability from Applied Finite Mathematics by Rupinder Sekhon was developed by OpenStax College, licensed by Rice University, and is available on the Connexions website. It is used under a
More informationConditional Probability and Bayes Theorem (2.4) Independence (2.5)
Conditional Probability and Bayes Theorem (2.4) Independence (2.5) Prof. Tesler Math 186 Winter 2019 Prof. Tesler Conditional Probability and Bayes Theorem Math 186 / Winter 2019 1 / 38 Scenario: Flip
More information27 Binary Arithmetic: An Application to Programming
27 Binary Arithmetic: An Application to Programming In the previous section we looked at the binomial distribution. The binomial distribution is essentially the mathematics of repeatedly flipping a coin
More informationNotes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 16 Notes. Class URL:
Notes slides from before lecture CSE 21, Winter 2017, Section A00 Lecture 16 Notes Class URL: http://vlsicad.ucsd.edu/courses/cse21-w17/ Notes slides from before lecture Notes March 8 (1) This week: Days
More informationLecture 1: Basics of Probability
Lecture 1: Basics of Probability (Luise-Vitetta, Chapter 8) Why probability in data science? Data acquisition is noisy Sampling/quantization external factors: If you record your voice saying machine learning
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationPart (A): Review of Probability [Statistics I revision]
Part (A): Review of Probability [Statistics I revision] 1 Definition of Probability 1.1 Experiment An experiment is any procedure whose outcome is uncertain ffl toss a coin ffl throw a die ffl buy a lottery
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationConditional Probability P( )
Conditional Probability P( ) 1 conditional probability where P(F) > 0 Conditional probability of E given F: probability that E occurs given that F has occurred. Conditioning on F Written as P(E F) Means
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationEcon 113. Lecture Module 2
Econ 113 Lecture Module 2 Contents 1. Experiments and definitions 2. Events and probabilities 3. Assigning probabilities 4. Probability of complements 5. Conditional probability 6. Statistical independence
More information9/6/2016. Section 5.1 Probability. Equally Likely Model. The Division Rule: P(A)=#(A)/#(S) Some Popular Randomizers.
Chapter 5: Probability and Discrete Probability Distribution Learn. Probability Binomial Distribution Poisson Distribution Some Popular Randomizers Rolling dice Spinning a wheel Flipping a coin Drawing
More informationProbability Pr(A) 0, for any event A. 2. Pr(S) = 1, for the sample space S. 3. If A and B are mutually exclusive, Pr(A or B) = Pr(A) + Pr(B).
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More information2. Conditional Probability
ENGG 2430 / ESTR 2004: Probability and Statistics Spring 2019 2. Conditional Probability Andrej Bogdanov Coins game Toss 3 coins. You win if at least two come out heads. S = { HHH, HHT, HTH, HTT, THH,
More informationP (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,
More informationProbability (10A) Young Won Lim 6/12/17
Probability (10A) Copyright (c) 2017 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later
More informationProblems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman.
Math 224 Fall 2017 Homework 1 Drew Armstrong Problems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman. Section 1.1, Exercises 4,5,6,7,9,12. Solutions to Book Problems.
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationLecture Notes. Here are some handy facts about the probability of various combinations of sets:
Massachusetts Institute of Technology Lecture 20 6.042J/18.062J: Mathematics for Computer Science April 20, 2000 Professors David Karger and Nancy Lynch Lecture Notes 1 Set Theory and Probability 1.1 Basic
More informationOutline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks
Outline 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks Likelihood A common and fruitful approach to statistics is to assume
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationWhat is a random variable
OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Random Variables Fall 20 Yrd. Doç. Dr. Didem Kivanc Tureli didemk@ieee.org didem.kivanc@okan.edu.tr
More informationIntroduction Probability. Math 141. Introduction to Probability and Statistics. Albyn Jones
Math 141 to and Statistics Albyn Jones Mathematics Department Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 September 3, 2014 Motivation How likely is an eruption at Mount Rainier in
More information1. When applied to an affected person, the test comes up positive in 90% of cases, and negative in 10% (these are called false negatives ).
CS 70 Discrete Mathematics for CS Spring 2006 Vazirani Lecture 8 Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According to clinical trials,
More informationLecture notes for probability. Math 124
Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result
More informationECE 450 Lecture 3. Overview: Randomly Selected Experiments & Hypothesis Testing. Digital Communications Examples. Many General Probability Examples
ECE 450 Lecture 3 Overview: Randomly Selected Experiments & Hypothesis Testing Digital Communications Examples Many General Probability Examples D. van Alphen Review & Practice: Conditional Probability
More informationRandom Signals and Systems. Chapter 1. Jitendra K Tugnait. Department of Electrical & Computer Engineering. James B Davis Professor.
Random Signals and Systems Chapter 1 Jitendra K Tugnait James B Davis Professor Department of Electrical & Computer Engineering Auburn University 2 3 Descriptions of Probability Relative frequency approach»
More informationCS626 Data Analysis and Simulation
CS626 Data Analysis and Simulation Instructor: Peter Kemper R 104A, phone 221-3462, email:kemper@cs.wm.edu Today: Probability Primer Quick Reference: Sheldon Ross: Introduction to Probability Models 9th
More informationGreat Theoretical Ideas in Computer Science
15-251 Great Theoretical Ideas in Computer Science Probability Theory: Counting in Terms of Proportions Lecture 10 (September 27, 2007) Some Puzzles Teams A and B are equally good In any one game, each
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationIntroduction and basic definitions
Chapter 1 Introduction and basic definitions 1.1 Sample space, events, elementary probability Exercise 1.1 Prove that P( ) = 0. Solution of Exercise 1.1 : Events S (where S is the sample space) and are
More informationMutually Exclusive Events
172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationGod doesn t play dice. - Albert Einstein
ECE 450 Lecture 1 God doesn t play dice. - Albert Einstein As far as the laws of mathematics refer to reality, they are not certain; as far as they are certain, they do not refer to reality. Lecture Overview
More informationDiscrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10
EECS 70 Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 Introduction to Basic Discrete Probability In the last note we considered the probabilistic experiment where we flipped
More informationLecture 2. Constructing Probability Spaces
Lecture 2. Constructing Probability Spaces This lecture describes some procedures for constructing probability spaces. We will work exclusively with discrete spaces usually finite ones. Later, we will
More informationPERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY
Friends, we continue the discussion with fundamentals of discrete probability in the second session of third chapter of our course in Discrete Mathematics. The conditional probability and Baye s theorem
More informationConditional Probability (cont...) 10/06/2005
Conditional Probability (cont...) 10/06/2005 Independent Events Two events E and F are independent if both E and F have positive probability and if P (E F ) = P (E), and P (F E) = P (F ). 1 Theorem. If
More informationPROBABILITY CHAPTER LEARNING OBJECTIVES UNIT OVERVIEW
CHAPTER 16 PROBABILITY LEARNING OBJECTIVES Concept of probability is used in accounting and finance to understand the likelihood of occurrence or non-occurrence of a variable. It helps in developing financial
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 2: Random Experiments. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 2: Random Experiments Prof. Vince Calhoun Reading This class: Section 2.1-2.2 Next class: Section 2.3-2.4 Homework: Assignment 1: From the
More information4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio
4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Wrong is right. Thelonious Monk 4.1 Three Definitions of
More information6.2 Introduction to Probability. The Deal. Possible outcomes: STAT1010 Intro to probability. Definitions. Terms: What are the chances of?
6.2 Introduction to Probability Terms: What are the chances of?! Personal probability (subjective) " Based on feeling or opinion. " Gut reaction.! Empirical probability (evidence based) " Based on experience
More informationSample Space: Specify all possible outcomes from an experiment. Event: Specify a particular outcome or combination of outcomes.
Chapter 2 Introduction to Probability 2.1 Probability Model Probability concerns about the chance of observing certain outcome resulting from an experiment. However, since chance is an abstraction of something
More informationEvent A: at least one tail observed A:
Chapter 3 Probability 3.1 Events, sample space, and probability Basic definitions: An is an act of observation that leads to a single outcome that cannot be predicted with certainty. A (or simple event)
More informationToday we ll discuss ways to learn how to think about events that are influenced by chance.
Overview Today we ll discuss ways to learn how to think about events that are influenced by chance. Basic probability: cards, coins and dice Definitions and rules: mutually exclusive events and independent
More informationNotes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 15 Notes. Class URL:
Notes slides from before lecture CSE 21, Winter 2017, Section A00 Lecture 15 Notes Class URL: http://vlsicad.ucsd.edu/courses/cse21-w17/ Notes slides from before lecture Notes March 6 (1) This week: Days
More informationDiscrete Probability
Discrete Probability Counting Permutations Combinations r- Combinations r- Combinations with repetition Allowed Pascal s Formula Binomial Theorem Conditional Probability Baye s Formula Independent Events
More informationV. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE
V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE A game of chance featured at an amusement park is played as follows: You pay $ to play. A penny a nickel are flipped. You win $ if either
More informationIntroduction to Probability
Introduction to Probability Gambling at its core 16th century Cardano: Books on Games of Chance First systematic treatment of probability 17th century Chevalier de Mere posed a problem to his friend Pascal.
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationFormalizing Probability. Choosing the Sample Space. Probability Measures
Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take
More informationExpected Value 7/7/2006
Expected Value 7/7/2006 Definition Let X be a numerically-valued discrete random variable with sample space Ω and distribution function m(x). The expected value E(X) is defined by E(X) = x Ω x m(x), provided
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More informationConditional Probability, Independence and Bayes Theorem Class 3, Jeremy Orloff and Jonathan Bloom
Conditional Probability, Independence and Bayes Theorem Class 3, 18.05 Jeremy Orloff and Jonathan Bloom 1 Learning Goals 1. Know the definitions of conditional probability and independence of events. 2.
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More informationProbability: Terminology and Examples Class 2, Jeremy Orloff and Jonathan Bloom
1 Learning Goals Probability: Terminology and Examples Class 2, 18.05 Jeremy Orloff and Jonathan Bloom 1. Know the definitions of sample space, event and probability function. 2. Be able to organize a
More informationNotes 1 Autumn Sample space, events. S is the number of elements in the set S.)
MAS 108 Probability I Notes 1 Autumn 2005 Sample space, events The general setting is: We perform an experiment which can have a number of different outcomes. The sample space is the set of all possible
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities Dr. Jing Yang jingyang@uark.edu OUTLINE 2 Applications
More informationElementary Discrete Probability
Elementary Discrete Probability MATH 472 Financial Mathematics J Robert Buchanan 2018 Objectives In this lesson we will learn: the terminology of elementary probability, elementary rules of probability,
More informationBusiness Statistics MBA Pokhara University
Business Statistics MBA Pokhara University Chapter 3 Basic Probability Concept and Application Bijay Lal Pradhan, Ph.D. Review I. What s in last lecture? Descriptive Statistics Numerical Measures. Chapter
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationTopic 2 Probability. Basic probability Conditional probability and independence Bayes rule Basic reliability
Topic 2 Probability Basic probability Conditional probability and independence Bayes rule Basic reliability Random process: a process whose outcome can not be predicted with certainty Examples: rolling
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationIndependence. P(A) = P(B) = 3 6 = 1 2, and P(C) = 4 6 = 2 3.
Example: A fair die is tossed and we want to guess the outcome. The outcomes will be 1, 2, 3, 4, 5, 6 with equal probability 1 6 each. If we are interested in getting the following results: A = {1, 3,
More informationDiscrete Random Variables
Discrete Random Variables An Undergraduate Introduction to Financial Mathematics J. Robert Buchanan 2014 Introduction The markets can be thought of as a complex interaction of a large number of random
More informationConditional Probability
Conditional Probability Conditional Probability The Law of Total Probability Let A 1, A 2,..., A k be mutually exclusive and exhaustive events. Then for any other event B, P(B) = P(B A 1 ) P(A 1 ) + P(B
More information