Probability: Part 1 Naima Hammoud

Size: px
Start display at page:

Download "Probability: Part 1 Naima Hammoud"

Transcription

1 Probability: Part 1 Naima ammoud Feb 7, 2017

2 Motivation ossing a coin Rolling a die Outcomes: eads or ails Outcomes: 1, 2, 3, 4, 5 or 6

3 Defining Probability If I toss a coin, there is a 50% chance I will get eads. If I roll a die, there is a 1 in 6 chance I will get a 3. If I look at the weather app, it says there is a 90% chance of rain.

4 Defining Probability If I toss a coin, there is a 50% chance I will get eads. If I roll a die, there is a 1 in 6 chance I will get a 3. If I look at the weather app, it says there is a 90% chance of rain. A probability is a measure of the chance that an event is going to happen

5 Properties of Probability It is a positive number between 0 and 1 A probability of 0 means that there is 0% chance that an event will happen, i.e. we are sure the event will not happen A probability of 1 means that we are 100% sure an event will happen Multiplying the probability by 100 gives a percentage he probability of an event happening is denoted by: P(event) = a number between 0 and 1

6 Definitions Sample Space: the collection of events that contains every possible outcome. Example: the sample space in a coin toss is {eads, ails} the sample space in rolling a die is {1, 2, 3, 4, 5, 6}

7 Definitions Sample Space: the collection of events that contains every possible outcome. Example: the sample space in a coin toss is {eads, ails} the sample space in rolling a die is {1, 2, 3, 4, 5, 6} Event: a specific outcome of the sample space. Example: observing eads when tossing a coin observing a 4 when rolling a die

8 Probability Examples If I flip a fair coin, then I can define the following events: : the event that eads is observed : the event that ails is observed P() = 0.5 and P() = 0.5 If I roll a die, I can define the following event: A: the event of rolling a number larger than 3 P(A) = P(rolling 4 or 5 or 6) = 3/6 = 1/2

9 More Definitions Probabilities always sum up to 1 When rolling a die, the sample space is {1, 2, 3, 4, 5, 6} If A: the event that 5 or 6 occur, then P(A)=1/3 he complement of A is denoted by A c, where A c : event that 1, 2, 3 or 4 occur P(A c ) = 2/3 because P(A)+ P(A c ) = 1

10 More Definitions Independent events Example: if I toss a coin, each toss is independent of the one that preceded it. If I get 10 heads in a row, the probability to observe a head on the 11 th toss is still 0.5 (or 50%) Disjoint events When two or more events have nothing in common. Example: rolling a six-sided die A: I roll a die and observe a 3 B: I roll a die and observe a 1 or a 6

11 More Definitions Independent events Example: if I toss a coin, each toss is independent of the one that preceded it. If I get 10 heads in a row, the probability to observe a head on the 11 th toss is still 0.5 (or 50%) Disjoint events When two or more events have nothing in common. Example: rolling a six-sided die A: I roll a die and observe a 3 A and B are disjoint B: I roll a die and observe a 1 or a 6

12 Examples 1. ossing two heads in a row 2. ossing three tails in a row 3. ossing a head, a tail, followed by another tail 4. Rolling a 5 then rolling a 6 5. Rolling a 5 or a 6 6. Rolling a 1, 2, or 3 on the first roll, then 4, 5, or 6 on the second roll

13 Examples 1. ossing two heads in a row 2. ossing three tails in a row 3. ossing a head, a tail, followed by another tail 4. Rolling a 5 then rolling a 6 5. Rolling a 5 or a 6 6. Rolling a 1, 2, or 3 on the first roll, then 4, 5, or 6 on the second roll Rule of thumb: OR + disjoint = add AND + independent = multiply

14 ossing wo Coins able representation Outcomes: {,,, }

15 ossing wo Coins able representation ree representation () () () () Outcomes: {,,, }

16 ossing wo Coins able representation ree representation () () () () Outcomes: {,,, } P ()=

17 ossing wo Coins able representation ree representation () () () () Outcomes: {,,, } P ()=

18 ossing wo Coins able representation ree representation () () () () Outcomes: {,,, } P ()=

19 ossing wo Coins able representation ree representation () () () () Outcomes: {,,, } P ()=0.25

20 ossing wo Coins otal of 4 outcomes Each outcome has a 1 in 4 or 0.25 (or 25%) chance of happening What is the probability of obtaining at least one head?

21 ossing wo Coins otal of 4 outcomes Each outcome has a 1 in 4 or 0.25 (or 25%) chance of happening What is the probability of obtaining at least one head?

22 ossing wo Coins otal of 4 outcomes Each outcome has a 1 in 4 or 0.25 (or 25%) chance of happening What is the probability of obtaining at least one head? P (at least one head) = P ( or or )

23 ossing wo Coins otal of 4 outcomes Each outcome has a 1 in 4 or 0.25 (or 25%) chance of happening What is the probability of obtaining at least one head? P (at least one head) = P ()+P ()+P ()

24 ossing wo Coins otal of 4 outcomes Each outcome has a 1 in 4 or 0.25 (or 25%) chance of happening What is the probability of obtaining at least one head? P (at least one head) = P ()+P ()+P () 1/4 1/4 1/4

25 ossing wo Coins otal of 4 outcomes Each outcome has a 1 in 4 or 0.25 (or 25%) chance of happening What is the probability of obtaining at least one head? P (at least one head) = P ()+P ()+P () =3/4 Is there a difference between flipping two coins or flipping the same coin twice?

26 ossing hree Coins 1

27 ossing hree Coins 1 2

28 ossing hree Coins 1 2 3

29 ossing hree Coins Sample Space: {,,,,,,, }

30 ossing Multiple Coins 1 coin: 2 outcomes

31 ossing Multiple Coins 1 coin: 2 outcomes 2 coins: 4 outcomes

32 ossing Multiple Coins 1 coin: 2 outcomes 2 coins: 4 outcomes 3 coins: 8 outcomes

33 ossing Multiple Coins 1 coin: 2 outcomes 2 coins: 4 outcomes 3 coins: 8 outcomes 4 coins?

34 ossing Multiple Coins With each coin toss there are WO possibilities: eads and ails 1 coin: 2 outcomes 2 coins: 4 outcomes 3 coins: 8 outcomes 4 coins?

35 ossing Multiple Coins With each coin toss there are WO possibilities: eads and ails 1 coin: 2 outcomes 2 coins: 4 outcomes coins: 8 outcomes coins? 2 4 = 16 outcomes

36 Rolling wo Dice With each roll of a die there are SIX possibilities: 1, 2, 3, 4, 5, 6 1 roll: 6 outcomes 2 rolls: 6 2 = 36 outcomes A tree representation will look quite messy A better representation is with a table

37 Rolling wo Dice ,1 6,2 6,3 6,4 6,5 6,6 5,1 5,2 5,3 5,4 5,5 5,6 4,1 4,2 4,3 4,4 4,5 4,6 3,1 3,2 3,3 3,4 3,5 3,6 2,1 2,2 2,3 2,4 2,5 2,6 1,1 1,2 1,3 1,4 1,5 1,

38 Rolling wo Dice ,1 6,2 6,3 6,4 6,5 6,6 5,1 5,2 5,3 5,4 5,5 5,6 4,1 4,2 4,3 4,4 4,5 4,6 3,1 3,2 3,3 3,4 3,5 3,6 2,1 2,2 2,3 2,4 2,5 2,6 1,1 1,2 1,3 1,4 1,5 1, outcomes P(each outcome) = 1/36 P(sum = 2) =? P(sum = 4) =? P(sum = 7) =? P(obtaining at least one 2) =? Careful about double counting

39 Rolling wo Dice ,1 6,2 6,3 6,4 6,5 6,6 5,1 5,2 5,3 5,4 5,5 5,6 4,1 4,2 4,3 4,4 4,5 4,6 3,1 3,2 3,3 3,4 3,5 3,6 2,1 2,2 2,3 2,4 2,5 2,6 1,1 1,2 1,3 1,4 1,5 1, outcomes P(each outcome) = 1/36 P(sum = 2) =? P(sum = 4) =? P(sum = 7) =? P(obtaining at least one 2) =? Careful about double counting What is the probability that I get a 3 on the second roll, knowing that I got a 5 on the first?

40 Introducing Conditional Probability ,1 6,2 6,3 6,4 6,5 6,6 5,1 5,2 5,3 5,4 5,5 5,6 4,1 4,2 4,3 4,4 4,5 4,6 3,1 3,2 3,3 3,4 3,5 3,6 2,1 2,2 2,3 2,4 2,5 2,6 1,1 1,2 1,3 1,4 1,5 1, outcomes P(each outcome) = 1/36 P(sum = 2) =? P(sum = 4) =? P(sum = 7) =? P(obtaining at least one 2) =? Careful about double counting What is the probability that I get a 3 on the second roll, knowing that I got a 5 on the first?

41 Introducing Conditional Probability ,1 6,2 6,3 6,4 6,5 6,6 5,1 5,2 5,3 5,4 5,5 5,6 4,1 4,2 4,3 4,4 4,5 4,6 3,1 3,2 3,3 3,4 3,5 3,6 2,1 2,2 2,3 2,4 2,5 2,6 1,1 1,2 1,3 1,4 1,5 1, outcomes P(each outcome) = 1/36 P(sum = 2) =? P(sum = 4) =? P(sum = 7) =? P(obtaining at least one 2) =? Careful about double counting What is the probability that I get a 3 on the second roll, knowing that I got a 5 on the first?

42 Introducing Conditional Probability ,1 6,2 6,3 6,4 6,5 6,6 5,1 5,2 5,3 5,4 5,5 5,6 4,1 4,2 4,3 4,4 4,5 4,6 3,1 3,2 3,3 3,4 3,5 3,6 2,1 2,2 2,3 2,4 2,5 2,6 1,1 1,2 1,3 1,4 1,5 1, outcomes P(each outcome) = 1/36 P(sum = 2) =? P(sum = 4) =? P(sum = 7) =? P(obtaining at least one 2) =? Careful about double counting What is the probability that I get a 3 on the second roll, knowing that I got a 5 on the first? 1/6

43 Conditional Probability Monty all

44 Conditional Probability Formal Definition Probability of event B happening given that event A has already occurred P (event B given event A) = P (B A) P (B A) = P (A and B) P (B)

45 Conditional Probability Formal Definition Probability of event B happening given that event A has already occurred P (event B given event A) = P (B A) P (B A) = P (A and B) P (B) P (A and B) = P (B A)P (B) =P (B and A)

46 Conditional Probability Formal Definition Probability of event B happening given that event A has already occurred P (event B given event A) = P (B A) P (B A) = P (A and B) P (B) P (A and B) = P (B A)P (B) =P (B and A) P (A B)P (A)

47 Conditional Probability Bayes heorem Probability of event B happening given that event A has already occurred P (event B given event A) = P (B A) P (B A) = P (A and B) P (B) = P (A B)P (A) P (B) Bayes heorem

48 Conditional Probability Monty all Solution C1 = car behind door 1 D1 = host opens door 1 C2 = car behind door 2 D2 = host opens door 2 C3 = car behind door 3 D3 = host opens door 3 P(C1) = P(C2) = P(C3) = 1/3 I choose door 1, so now I know the host has to open either door 2 or door 3 with equal probability, but the host knows where the car is, so: P(D2 C1) = 0.5, P(D2 C2) = 0, P(D2 C3) =1 P(D3 C1) = 0.5, P(D3 C2) = 1, P(D3 C3) = 0

49 Conditional Probability Monty all Solution P(C1) = P(C2) = P(C3) = 1/3 I choose door 1 P(D2 C1) = 0.5, P(D2 C2) = 0, P(D2 C3) =1 P(D3 C1) = 0.5, P(D3 C2) = 1, P(D3 C3) = 0 ost opens D3 and it has a goat Compare P(C1 D3) and P(C2 D3)

50 Conditional Probability Monty all Solution P(C1) = P(C2) = P(C3) = 1/3 I choose door 1 P(D2 C1) = 0.5, P(D2 C2) = 0, P(D2 C3) =1 P(D3 C1) = 0.5, P(D3 C2) = 1, P(D3 C3) = 0 ost opens D3 and it has a goat Compare P(C1 D3) and P(C2 D3) P (C1 D3) = P (D3 C1)P (C1) P (D3) P (C2 D3) = P (D3 C2)P (C2) P (D3)

51 Conditional Probability Monty all Solution P(C1) = P(C2) = P(C3) = 1/3 I choose door 1 P(D2 C1) = 0.5, P(D2 C2) = 0, P(D2 C3) =1 P(D3 C1) = 0.5, P(D3 C2) = 1, P(D3 C3) = 0 ost opens D3 and it has a goat Compare P(C1 D3) and P(C2 D3) P (C1 D3) = P (D3 C1)P (C1) P (D3) P (C2 D3) = P (D3 C2)P (C2) P (D3) 1/3 2/3

52 Conditional Probability Monty all Solution SWIC O DOOR 2 P (C1 D3) = P (D3 C1)P (C1) P (D3) P (C2 D3) = 1/3 2/3 P (D3 C2)P (C2) P (D3)

53 Conditional Probability Radar Example Suppose that the probability you see a plane when you look up to the sky is 5%, and let s say that we have a radar which registers a plane with 99% accuracy. here is also a 10% chance for the radar to sound a false alarm. A = event that we see a plane (A c is the event that we don t see a plane) B = event that the radar registers something (B c means radar didn't register) 0.05 A B B c here is a plane and radar registered it here is a plane, but radar did not register it 0.95 A c B B c False alarm here is no plane and radar did not register anything

54 Conditional Probability Radar Example A = event that we see a plane (A c is the event that we don t see a plane) B = event that the radar registers something (B c means radar didn't register) 0.05 A B B c 0.95 A c B B c What is the probability that the radar registers something?

55 Conditional Probability Radar Example A = event that we see a plane (A c is the event that we don t see a plane) B = event that the radar registers something (B c means radar didn't register) 0.05 A B B c 0.95 A c B B c What is the probability that the radar registers something? here is a plane and the radar registers it

56 Conditional Probability Radar Example A = event that we see a plane (A c is the event that we don t see a plane) B = event that the radar registers something (B c means radar didn't register) 0.05 A B B c 0.95 A c B B c What is the probability that the radar registers something? here is a plane and the radar registers it here is no plane but the radar makes a false alarm

57 Conditional Probability Radar Example A = event that we see a plane (A c is the event that we don t see a plane) B = event that the radar registers something (B c means radar didn't register) 0.05 A B B c = A c B B c = What is the probability that the radar registers something? here is a plane and the radar registers it here is no plane but the radar makes a false alarm

58 Conditional Probability Radar Example A = event that we see a plane (A c is the event that we don t see a plane) B = event that the radar registers something (B c means radar didn't register) 0.05 A B B c = A c B B c = What is the probability that the radar registers something? P (B) =P (A and B)+P (A c and B) = = here is a 14.45% chance that the radar registers something!

59 Conditional Probability Radar Example A = event that we see a plane (A c is the event that we don t see a plane) B = event that the radar registers something (B c means radar didn't register) 0.05 A B B c = A c B B c = What is the probability that there is a plane given that the radar registered something? P (A B) = P (A and B) P (B) = =0.34

60 Conditional Probability Radar Example A = event that we see a plane (A c is the event that we don t see a plane) B = event that the radar registers something (B c means radar didn't register) 0.05 A B B c = A c B B c = What is the probability that there is a plane given that the radar registered something? If the radar registers P (A and B) P (A B) = something, there s only = P (B) =0.34 a 34% chance that there s actually a plane!

Lecture 1. ABC of Probability

Lecture 1. ABC of Probability Math 408 - Mathematical Statistics Lecture 1. ABC of Probability January 16, 2013 Konstantin Zuev (USC) Math 408, Lecture 1 January 16, 2013 1 / 9 Agenda Sample Spaces Realizations, Events Axioms of Probability

More information

The probability of an event is viewed as a numerical measure of the chance that the event will occur.

The probability of an event is viewed as a numerical measure of the chance that the event will occur. Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that

More information

CS 361: Probability & Statistics

CS 361: Probability & Statistics February 12, 2018 CS 361: Probability & Statistics Random Variables Monty hall problem Recall the setup, there are 3 doors, behind two of them are indistinguishable goats, behind one is a car. You pick

More information

P (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).

P (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B). Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,

More information

MAT Mathematics in Today's World

MAT Mathematics in Today's World MAT 1000 Mathematics in Today's World Last Time We discussed the four rules that govern probabilities: 1. Probabilities are numbers between 0 and 1 2. The probability an event does not occur is 1 minus

More information

ORF 245 Fundamentals of Statistics Chapter 5 Probability

ORF 245 Fundamentals of Statistics Chapter 5 Probability ORF 245 Fundamentals of Statistics Chapter 5 Probability Robert Vanderbei Oct 2015 Slides last edited on October 14, 2015 http://www.princeton.edu/ rvdb Sample Spaces (aka Populations) and Events When

More information

Lecture 3. January 7, () Lecture 3 January 7, / 35

Lecture 3. January 7, () Lecture 3 January 7, / 35 Lecture 3 January 7, 2013 () Lecture 3 January 7, 2013 1 / 35 Outline This week s lecture: Fast review of last week s lecture: Conditional probability. Partition, Partition theorem. Bayes theorem and its

More information

Chapter 7 Wednesday, May 26th

Chapter 7 Wednesday, May 26th Chapter 7 Wednesday, May 26 th Random event A random event is an event that the outcome is unpredictable. Example: There are 45 students in this class. What is the probability that if I select one student,

More information

Math 140 Introductory Statistics

Math 140 Introductory Statistics Math 140 Introductory Statistics 5.1 Models of random behavior Outcome: Result or answer obtained from a chance process. Event: Collection of outcomes. Probability: Number between 0 and 1 (0% and 100%).

More information

Probability Year 9. Terminology

Probability Year 9. Terminology Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some

More information

Chapter 6: Probability The Study of Randomness

Chapter 6: Probability The Study of Randomness Chapter 6: Probability The Study of Randomness 6.1 The Idea of Probability 6.2 Probability Models 6.3 General Probability Rules 1 Simple Question: If tossing a coin, what is the probability of the coin

More information

the time it takes until a radioactive substance undergoes a decay

the time it takes until a radioactive substance undergoes a decay 1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete

More information

6.2 Introduction to Probability. The Deal. Possible outcomes: STAT1010 Intro to probability. Definitions. Terms: What are the chances of?

6.2 Introduction to Probability. The Deal. Possible outcomes: STAT1010 Intro to probability. Definitions. Terms: What are the chances of? 6.2 Introduction to Probability Terms: What are the chances of?! Personal probability (subjective) " Based on feeling or opinion. " Gut reaction.! Empirical probability (evidence based) " Based on experience

More information

Probability Year 10. Terminology

Probability Year 10. Terminology Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some

More information

Probability- describes the pattern of chance outcomes

Probability- describes the pattern of chance outcomes Chapter 6 Probability the study of randomness Probability- describes the pattern of chance outcomes Chance behavior is unpredictable in the short run, but has a regular and predictable pattern in the long

More information

Chapter 14. From Randomness to Probability. Copyright 2012, 2008, 2005 Pearson Education, Inc.

Chapter 14. From Randomness to Probability. Copyright 2012, 2008, 2005 Pearson Education, Inc. Chapter 14 From Randomness to Probability Copyright 2012, 2008, 2005 Pearson Education, Inc. Dealing with Random Phenomena A random phenomenon is a situation in which we know what outcomes could happen,

More information

Lecture 3 Probability Basics

Lecture 3 Probability Basics Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability

More information

4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio

4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio 4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Wrong is right. Thelonious Monk 4.1 Three Definitions of

More information

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten

More information

Probability Rules. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics

Probability Rules. MATH 130, Elements of Statistics I. J. Robert Buchanan. Fall Department of Mathematics Probability Rules MATH 130, Elements of Statistics I J. Robert Buchanan Department of Mathematics Fall 2018 Introduction Probability is a measure of the likelihood of the occurrence of a certain behavior

More information

Dept. of Linguistics, Indiana University Fall 2015

Dept. of Linguistics, Indiana University Fall 2015 L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would

More information

Math 3338: Probability (Fall 2006)

Math 3338: Probability (Fall 2006) Math 3338: Probability (Fall 2006) Jiwen He Section Number: 10853 http://math.uh.edu/ jiwenhe/math3338fall06.html Probability p.1/8 2.2 Axioms, Interpretations, and Properties of Probability Probability

More information

Great Theoretical Ideas in Computer Science

Great Theoretical Ideas in Computer Science 15-251 Great Theoretical Ideas in Computer Science Probability Theory: Counting in Terms of Proportions Lecture 10 (September 27, 2007) Some Puzzles Teams A and B are equally good In any one game, each

More information

STA Module 4 Probability Concepts. Rev.F08 1

STA Module 4 Probability Concepts. Rev.F08 1 STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret

More information

UNIT 5 ~ Probability: What Are the Chances? 1

UNIT 5 ~ Probability: What Are the Chances? 1 UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested

More information

Grades 7 & 8, Math Circles 24/25/26 October, Probability

Grades 7 & 8, Math Circles 24/25/26 October, Probability Faculty of Mathematics Waterloo, Ontario NL 3G1 Centre for Education in Mathematics and Computing Grades 7 & 8, Math Circles 4/5/6 October, 017 Probability Introduction Probability is a measure of how

More information

Conditional Probability

Conditional Probability Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.

More information

P (A) = P (B) = P (C) = P (D) =

P (A) = P (B) = P (C) = P (D) = STAT 145 CHAPTER 12 - PROBABILITY - STUDENT VERSION The probability of a random event, is the proportion of times the event will occur in a large number of repititions. For example, when flipping a coin,

More information

Statistical Methods for the Social Sciences, Autumn 2012

Statistical Methods for the Social Sciences, Autumn 2012 Statistical Methods for the Social Sciences, Autumn 2012 Review Session 3: Probability. Exercises Ch.4. More on Stata TA: Anastasia Aladysheva anastasia.aladysheva@graduateinstitute.ch Office hours: Mon

More information

Statistics 251: Statistical Methods

Statistics 251: Statistical Methods Statistics 251: Statistical Methods Probability Module 3 2018 file:///volumes/users/r/renaes/documents/classes/lectures/251301/renae/markdown/master%20versions/module3.html#1 1/33 Terminology probability:

More information

Vina Nguyen HSSP July 6, 2008

Vina Nguyen HSSP July 6, 2008 Vina Nguyen HSSP July 6, 2008 1 Late registration Claroline class server 2 What are the two types of probability? 3 What are the two types of probability? What is a set? 4 What are the two types of probability?

More information

MA : Introductory Probability

MA : Introductory Probability MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:

More information

Introduction to probability

Introduction to probability Introduction to probability 4.1 The Basics of Probability Probability The chance that a particular event will occur The probability value will be in the range 0 to 1 Experiment A process that produces

More information

Lecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events

Lecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events Lecture 8: Conditional probability I: definition, independence, the tree method, sampling, chain rule for independent events Discrete Structures II (Summer 2018) Rutgers University Instructor: Abhishek

More information

Lecture Lecture 5

Lecture Lecture 5 Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled

More information

Lecture 1: Basics of Probability

Lecture 1: Basics of Probability Lecture 1: Basics of Probability (Luise-Vitetta, Chapter 8) Why probability in data science? Data acquisition is noisy Sampling/quantization external factors: If you record your voice saying machine learning

More information

Statistics 1 - Lecture Notes Chapter 1

Statistics 1 - Lecture Notes Chapter 1 Statistics 1 - Lecture Notes Chapter 1 Caio Ibsen Graduate School of Economics - Getulio Vargas Foundation April 28, 2009 We want to establish a formal mathematic theory to work with results of experiments

More information

Midterm #1 - Solutions

Midterm #1 - Solutions Midterm # - olutions Math/tat 94 Quizzes. Let A be the event Andrea and Bill are both in class. The complementary event is (choose one): A c = Neither Andrea nor Bill are in class A c = Bill is not in

More information

Lecture 1: Probability Fundamentals

Lecture 1: Probability Fundamentals Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability

More information

Mathematical Foundations of Computer Science Lecture Outline October 9, 2018

Mathematical Foundations of Computer Science Lecture Outline October 9, 2018 Mathematical Foundations of Computer Science Lecture Outline October 9, 2018 Eample. in 4? When three dice are rolled what is the probability that one of the dice results Let F i, i {1, 2, 3} be the event

More information

Conditional Probability, Independence, Bayes Theorem Spring January 1, / 28

Conditional Probability, Independence, Bayes Theorem Spring January 1, / 28 Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2014 January 1, 2017 1 / 28 Sample Space Confusions 1. Sample space = set of all possible outcomes of an experiment. 2. The size of the

More information

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 EECS 70 Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 Introduction to Basic Discrete Probability In the last note we considered the probabilistic experiment where we flipped

More information

Properties of Probability

Properties of Probability Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.

More information

5.5 PROBABILITY AS A THEORETICAL CONCEPT

5.5 PROBABILITY AS A THEORETICAL CONCEPT 5.5 PROAILIY AS A EOREICAL CONCEP So far, we have solved probability problems by estimating the required probability after conducting some sort of experiment and collecting data. ut probability may be

More information

Intermediate Math Circles November 8, 2017 Probability II

Intermediate Math Circles November 8, 2017 Probability II Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B

More information

Math 243 Section 3.1 Introduction to Probability Lab

Math 243 Section 3.1 Introduction to Probability Lab Math 243 Section 3.1 Introduction to Probability Lab Overview Why Study Probability? Outcomes, Events, Sample Space, Trials Probabilities and Complements (not) Theoretical vs. Empirical Probability The

More information

Sum and Product Rules

Sum and Product Rules Sum and Product Rules Exercise. Consider tossing a coin five times. What is the probability of getting the same result on the first two tosses or the last two tosses? Solution. Let E be the event that

More information

Conditional Probability, Independence, Bayes Theorem Spring 2018

Conditional Probability, Independence, Bayes Theorem Spring 2018 Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2018 Slides are Posted Don t forget that after class we post the slides including solutions to all the questions. February 13, 2018 2 /

More information

Chapter 2: Probability Part 1

Chapter 2: Probability Part 1 Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.

More information

Mutually Exclusive Events

Mutually Exclusive Events 172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes

More information

Formalizing Probability. Choosing the Sample Space. Probability Measures

Formalizing Probability. Choosing the Sample Space. Probability Measures Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take

More information

Ch 14 Randomness and Probability

Ch 14 Randomness and Probability Ch 14 Randomness and Probability We ll begin a new part: randomness and probability. This part contain 4 chapters: 14-17. Why we need to learn this part? Probability is not a portion of statistics. Instead

More information

Econ 325: Introduction to Empirical Economics

Econ 325: Introduction to Empirical Economics Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain

More information

COS 424: Interacting with Data. Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008

COS 424: Interacting with Data. Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008 COS 424: Interacting with Data Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008 1 Probability Review 1.1 Random Variables A random variable can be used to model any probabilistic outcome.

More information

Section 13.3 Probability

Section 13.3 Probability 288 Section 13.3 Probability Probability is a measure of how likely an event will occur. When the weather forecaster says that there will be a 50% chance of rain this afternoon, the probability that it

More information

Conditional Probability, Independence, Bayes Theorem Spring January 1, / 23

Conditional Probability, Independence, Bayes Theorem Spring January 1, / 23 Conditional Probability, Independence, Bayes Theorem 18.05 Spring 2014 January 1, 2017 1 / 23 Sample Space Confusions 1. Sample space = set of all possible outcomes of an experiment. 2. The size of the

More information

I - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability

I - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)

More information

Bayes Formula. MATH 107: Finite Mathematics University of Louisville. March 26, 2014

Bayes Formula. MATH 107: Finite Mathematics University of Louisville. March 26, 2014 Bayes Formula MATH 07: Finite Mathematics University of Louisville March 26, 204 Test Accuracy Conditional reversal 2 / 5 A motivating question A rare disease occurs in out of every 0,000 people. A test

More information

4. Probability of an event A for equally likely outcomes:

4. Probability of an event A for equally likely outcomes: University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:

More information

3.2 Probability Rules

3.2 Probability Rules 3.2 Probability Rules The idea of probability rests on the fact that chance behavior is predictable in the long run. In the last section, we used simulation to imitate chance behavior. Do we always need

More information

Discrete Mathematics and Probability Theory Fall 2010 Tse/Wagner MT 2 Soln

Discrete Mathematics and Probability Theory Fall 2010 Tse/Wagner MT 2 Soln CS 70 Discrete Mathematics and Probability heory Fall 00 se/wagner M Soln Problem. [Rolling Dice] (5 points) You roll a fair die three times. Consider the following events: A first roll is a 3 B second

More information

ECE353: Probability and Random Processes. Lecture 3 - Independence and Sequential Experiments

ECE353: Probability and Random Processes. Lecture 3 - Independence and Sequential Experiments ECE353: Probability and Random Processes Lecture 3 - Independence and Sequential Experiments Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu

More information

Monty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch

Monty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,

More information

Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability

Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic

More information

Today we ll discuss ways to learn how to think about events that are influenced by chance.

Today we ll discuss ways to learn how to think about events that are influenced by chance. Overview Today we ll discuss ways to learn how to think about events that are influenced by chance. Basic probability: cards, coins and dice Definitions and rules: mutually exclusive events and independent

More information

Topic 5 Basics of Probability

Topic 5 Basics of Probability Topic 5 Basics of Probability Equally Likely Outcomes and the Axioms of Probability 1 / 13 Outline Equally Likely Outcomes Axioms of Probability Consequences of the Axioms 2 / 13 Introduction A probability

More information

Mathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2

Mathematics. (  : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2 ( : Focus on free Education) Exercise 16.2 Question 1: A die is rolled. Let E be the event die shows 4 and F be the event die shows even number. Are E and F mutually exclusive? Answer 1: When a die is

More information

CS 361: Probability & Statistics

CS 361: Probability & Statistics September 12, 2017 CS 361: Probability & Statistics Correlation Summary of what we proved We wanted a way of predicting y from x We chose to think in standard coordinates and to use a linear predictor

More information

University of California, Berkeley, Statistics 134: Concepts of Probability. Michael Lugo, Spring Exam 1

University of California, Berkeley, Statistics 134: Concepts of Probability. Michael Lugo, Spring Exam 1 University of California, Berkeley, Statistics 134: Concepts of Probability Michael Lugo, Spring 2011 Exam 1 February 16, 2011, 11:10 am - 12:00 noon Name: Solutions Student ID: This exam consists of seven

More information

Why should you care?? Intellectual curiosity. Gambling. Mathematically the same as the ESP decision problem we discussed in Week 4.

Why should you care?? Intellectual curiosity. Gambling. Mathematically the same as the ESP decision problem we discussed in Week 4. I. Probability basics (Sections 4.1 and 4.2) Flip a fair (probability of HEADS is 1/2) coin ten times. What is the probability of getting exactly 5 HEADS? What is the probability of getting exactly 10

More information

Topic 4 Probability. Terminology. Sample Space and Event

Topic 4 Probability. Terminology. Sample Space and Event Topic 4 Probability The Sample Space is the collection of all possible outcomes Experimental outcome An outcome from a sample space with one characteristic Event May involve two or more outcomes simultaneously

More information

Introduction to Probability

Introduction to Probability Introduction to Probability Gambling at its core 16th century Cardano: Books on Games of Chance First systematic treatment of probability 17th century Chevalier de Mere posed a problem to his friend Pascal.

More information

STAT 201 Chapter 5. Probability

STAT 201 Chapter 5. Probability STAT 201 Chapter 5 Probability 1 2 Introduction to Probability Probability The way we quantify uncertainty. Subjective Probability A probability derived from an individual's personal judgment about whether

More information

Lecture 1 Introduction to Probability and Set Theory Text: A Course in Probability by Weiss

Lecture 1 Introduction to Probability and Set Theory Text: A Course in Probability by Weiss Lecture 1 to and Set Theory Text: A Course in by Weiss 1.2 2.3 STAT 225 to Models January 13, 2014 to and Whitney Huang Purdue University 1.1 Agenda to and 1 2 3 1.2 Motivation Uncertainty/Randomness in

More information

AMS7: WEEK 2. CLASS 2

AMS7: WEEK 2. CLASS 2 AMS7: WEEK 2. CLASS 2 Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Friday April 10, 2015 Probability: Introduction Probability:

More information

Dynamic Programming Lecture #4

Dynamic Programming Lecture #4 Dynamic Programming Lecture #4 Outline: Probability Review Probability space Conditional probability Total probability Bayes rule Independent events Conditional independence Mutual independence Probability

More information

Lecture notes for probability. Math 124

Lecture notes for probability. Math 124 Lecture notes for probability Math 124 What is probability? Probabilities are ratios, expressed as fractions, decimals, or percents, determined by considering results or outcomes of experiments whose result

More information

Mathematical Foundations of Computer Science Lecture Outline October 18, 2018

Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 Mathematical Foundations of Computer Science Lecture Outline October 18, 2018 The Total Probability Theorem. Consider events E and F. Consider a sample point ω E. Observe that ω belongs to either F or

More information

With Question/Answer Animations. Chapter 7

With Question/Answer Animations. Chapter 7 With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements

More information

A brief review of basics of probabilities

A brief review of basics of probabilities brief review of basics of probabilities Milos Hauskrecht milos@pitt.edu 5329 Sennott Square robability theory Studies and describes random processes and their outcomes Random processes may result in multiple

More information

First Digit Tally Marks Final Count

First Digit Tally Marks Final Count Benford Test () Imagine that you are a forensic accountant, presented with the two data sets on this sheet of paper (front and back). Which of the two sets should be investigated further? Why? () () ()

More information

Conditional probability

Conditional probability CHAPTER 4 Conditional probability 4.1. Introduction Suppose there are 200 men, of which 100 are smokers, and 100 women, of which 20 are smokers. What is the probability that a person chosen at random will

More information

Probability: Terminology and Examples Class 2, Jeremy Orloff and Jonathan Bloom

Probability: Terminology and Examples Class 2, Jeremy Orloff and Jonathan Bloom 1 Learning Goals Probability: Terminology and Examples Class 2, 18.05 Jeremy Orloff and Jonathan Bloom 1. Know the definitions of sample space, event and probability function. 2. Be able to organize a

More information

1 The Basic Counting Principles

1 The Basic Counting Principles 1 The Basic Counting Principles The Multiplication Rule If an operation consists of k steps and the first step can be performed in n 1 ways, the second step can be performed in n ways [regardless of how

More information

2011 Pearson Education, Inc

2011 Pearson Education, Inc Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive

More information

Probability Theory and Applications

Probability Theory and Applications Probability Theory and Applications Videos of the topics covered in this manual are available at the following links: Lesson 4 Probability I http://faculty.citadel.edu/silver/ba205/online course/lesson

More information

Statistics for Engineers

Statistics for Engineers Statistics for Engineers Antony Lewis http://cosmologist.info/teaching/stat/ Starter question Have you previously done any statistics? 1. Yes 2. No 54% 46% 1 2 BOOKS Chatfield C, 1989. Statistics for

More information

ORF 245 Fundamentals of Statistics Chapter 1 Probability

ORF 245 Fundamentals of Statistics Chapter 1 Probability ORF 245 Fundamentals of Statistics Chapter 1 Probability Robert Vanderbei Sept 2014 Slides last edited on September 19, 2014 http://www.princeton.edu/ rvdb Course Info Prereqs: Textbook: Three semesters

More information

Probability Theory. Probability and Statistics for Data Science CSE594 - Spring 2016

Probability Theory. Probability and Statistics for Data Science CSE594 - Spring 2016 Probability Theory Probability and Statistics for Data Science CSE594 - Spring 2016 What is Probability? 2 What is Probability? Examples outcome of flipping a coin (seminal example) amount of snowfall

More information

Fundamentals of Probability CE 311S

Fundamentals of Probability CE 311S Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in

More information

Probability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)

Probability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary) Chapter 14 From Randomness to Probability How to measure a likelihood of an event? How likely is it to answer correctly one out of two true-false questions on a quiz? Is it more, less, or equally likely

More information

Intermediate Math Circles November 15, 2017 Probability III

Intermediate Math Circles November 15, 2017 Probability III Intermediate Math Circles November 5, 07 Probability III Example : You have bins in which there are coloured balls. The balls are identical except for their colours. The contents of the containers are:

More information

The set of all outcomes or sample points is called the SAMPLE SPACE of the experiment.

The set of all outcomes or sample points is called the SAMPLE SPACE of the experiment. Chapter 7 Probability 7.1 xperiments, Sample Spaces and vents Start with some definitions we will need in our study of probability. An XPRIMN is an activity with an observable result. ossing coins, rolling

More information

Week 2. Section Texas A& M University. Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019

Week 2. Section Texas A& M University. Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019 Week 2 Section 1.2-1.4 Texas A& M University Department of Mathematics Texas A& M University, College Station 22 January-24 January 2019 Oğuz Gezmiş (TAMU) Topics in Contemporary Mathematics II Week2 1

More information

Probabilistic models

Probabilistic models Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became

More information

CS 246 Review of Proof Techniques and Probability 01/14/19

CS 246 Review of Proof Techniques and Probability 01/14/19 Note: This document has been adapted from a similar review session for CS224W (Autumn 2018). It was originally compiled by Jessica Su, with minor edits by Jayadev Bhaskaran. 1 Proof techniques Here we

More information

Introduction to Probability Theory, Algebra, and Set Theory

Introduction to Probability Theory, Algebra, and Set Theory Summer School on Mathematical Philosophy for Female Students Introduction to Probability Theory, Algebra, and Set Theory Catrin Campbell-Moore and Sebastian Lutz July 28, 2014 Question 1. Draw Venn diagrams

More information

Some Basic Concepts of Probability and Information Theory: Pt. 1

Some Basic Concepts of Probability and Information Theory: Pt. 1 Some Basic Concepts of Probability and Information Theory: Pt. 1 PHYS 476Q - Southern Illinois University January 18, 2018 PHYS 476Q - Southern Illinois University Some Basic Concepts of Probability and

More information

SDS 321: Introduction to Probability and Statistics

SDS 321: Introduction to Probability and Statistics SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching

More information

Chapter 1: Introduction to Probability Theory

Chapter 1: Introduction to Probability Theory ECE5: Stochastic Signals and Systems Fall 8 Lecture - September 6, 8 Prof. Salim El Rouayheb Scribe: Peiwen Tian, Lu Liu, Ghadir Ayache Chapter : Introduction to Probability Theory Axioms of Probability

More information