Relative Risks (RR) and Odds Ratios (OR) 20

Size: px
Start display at page:

Download "Relative Risks (RR) and Odds Ratios (OR) 20"

Transcription

1 BSTT523: Pagano & Gavreau, Chapter 6 1 Chapter 6: Probability slide: Definitions (6.1 in P&G) 2 Experiments; trials; probabilities Event operations 4 Intersection; Union; Complement Venn diagrams Conditional probability 7 Marginal probability 8 Bayes Theorem 9 Independent Events 9 Example: Employment status and hearing impairment 10 Example: Age at onset of bipolar disorder 11 Diagnostic tests (6.4 in P&G) 14 Sensitivity; Specificity; Predictive Value Examples: Cervical cancer in women 17 Tuberculosis and X-ray screen 18 Self-Reported BMI & Obesity 19 Relative Risks (RR) and Odds Ratios (OR) 20

2 BSTT523: Pagano & Gavreau, Chapter 6 2 Definitions Classical definitions: Experiment: the process of obtaining an observed result of some phenomenon Probability of A: N : Number of all possible results/outcomes A : Event with characteristic of interest m : Number of occurrences of A P(A) = m N Example 1: Randomly draw 1 card from a well shuffled deck of 52 cards N = 52; A = card is a heart ; m = 13 P(A) = = 0.25 Example 2: Roll a fair six-sided die N = 6; A = get a 5 ; m = 1 P(A) = 1 6

3 BSTT523: Pagano & Gavreau, Chapter 6 3 Frequentist definitions: Trial: Performance of 1 experiment n : Number of independent trials E : Event with characteristic of interest m : Number of occurrences of E Probability of E: P(E) = relative frequency of E = m n Example: Flip a fair coin (heads H or tails T) 5 times. Observe H, T, T, T, H A = H; n = 5; m = 2 P(H) = 2 5 = 0.4

4 BSTT523: Pagano & Gavreau, Chapter 6 4 Event Operations: Intersection / AND Operator: A B Both A and B Joint probability: P(A B) Mutually exclusive events: Let ϕ denote a Null Event, i.e., P(ϕ)=0. Events A and B are mutually exclusive if A B = ϕ and P(A B)=0. Union / OR Operator: A B Either A or B or both Additive rule of probability: If A and B are mutually exclusive (P(A B)=0), then P(A B) = P(A) + P(B) If A and B are not mutually exclusive, then P(A B) = P(A) + P(B) - P(A B)

5 BSTT523: Pagano & Gavreau, Chapter 6 5 Venn Diagram for two overlapping events A and B: not A or B A,not B A & B B,not A The size of each area represents the magnitude of probability. P(A) P(B) P(A B) P(A B) A naïve (and incorrect) way to calculate P(A B) is P(A) + P(B); this method would count the overlapping area of P(A B) twice.

6 BSTT523: Pagano & Gavreau, Chapter 6 6 Complement: A c or A NOT A P(A A) = 0 P(A A) = 1 P(A) + P(A) = 1 P(A) = 1 - P(A)

7 BSTT523: Pagano & Gavreau, Chapter 6 7 Conditional Probability P(A given prior occurrence of B) = P(A conditional on B) Question: Does prior occurrence/condition B change P(A)? Definition of conditional probability: Conditional Probability P(A given prior occurrence of B) = P(A conditional on B) Question: Does prior occurrence/condition B change P(A)? Definition of conditional probability: P(A B) = P(A B) P(B) Multiplicative rule of probability: For any events A and B with P(A)>0 and P(B)>0, P(A B) = P(B)P(A B) = P(A)P(B A)

8 BSTT523: Pagano & Gavreau, Chapter 6 8 Marginal Probability Events A1,, Am are mutually exclusive and exhaustive (M.E.E.) if P(Ai Aj)=0 for all i j (mutually exclusive) P(A1)+ P(A2) P(Am)=1 (exhaustive) Jointly occurring sets of events A and B A has m categories; events A1,, Am are M.E.E. B has n categories; events B1,, Bn are M.E.E. The marginal probability of Ai is P(A i ) = n j=1 P(B j ) P (A i B j ) The marginal probability of Bj is P(B j ) = m i=1 P(A i ) P(B j A i ) Law of Total Probability (P&G p.133)

9 BSTT523: Pagano & Gavreau, Chapter 6 9 Bayes Theorem If events A1,, Am are mutually exclusive and exhaustive, then P(A i B) = P(A i)p(b A i ) m P(A j )P(B A j ) j=1 Independent Events Events A and B are independent if P(A B) = P(A)P(B) Note: if P(A) > 0, P(B) > 0, and A and B are independent, then P(A B) = P(A) and P(B A) = P(B) Question: If two events are mutually exclusive, are they independent?

10 BSTT523: Pagano & Gavreau, Chapter 6 10 Example: Employment Status and Hearing Impairment (P&G p.132-3): B = Has a hearing impairment A1 = Currently employed A2 = Currently unemployed A3 = Not in the labor force P(A 1 ) =.6063, P(A 2 ) =.0457, P(A 3 ) =.3480 P(B A 1 ) =.0056, P(B A 2 ) =.0036, P(B A 3 ) =.0065 Apply the Law of Total Probability: P(B) = P(A 1 )P(B A 1 ) + P(A 2 )P(B A 2 ) + P(A 3 )P(B A 3 ) = =.0059 Apply Bayes Theorem: P(A 1 B) = P(A 1 )P(B A 1 ) P(A 1 )P(B A 1 )+P(A 2 )P(B A 2 )+P(A 3 )P(B A 3 ) = =.583

11 BSTT523: Pagano & Gavreau, Chapter 6 11 Example: Age at onset of bipolar disorder and family history A random sample of subjects with bipolar disease Age at Onset: Family History: Early (E) (<=18 yrs) Later (E ) (>18 yrs) Total: Negative (A) Bipolar (B) Unipolar (C) Unipolar & Bipolar (D) Total Q1. E = Early onset of bipolar disorder. P(E) =? Solution: P(E) = = (marginal probability) Q2. If you select one subject at random, what is the probability they had early onset and no family history? Solution: P(E A) = = (joint probability) Q3. Which is an example of two mutually exclusive events? i) No family history (A) and early onset (E) ii) No family history (A) and family history of bipolar (B) Solution: i) P(A E) > 0 No. ii) P(A B) = 0 Yes.

12 BSTT523: Pagano & Gavreau, Chapter 6 12 Q4. Select one subject at random. What is the probability of early onset or no family history (or both)? Solution: E and A are not M.E., so use formula P(E A) = P(E) + P(A) P(E A). P(E) = =.1981 P(A) = =.4434 P(E A) = =.0881 P(E A) = P(E) + P(A) P(E A) = =.5534 Q5. For a randomly select subject, what is the probability of no family history or family history of bipolar only? Solution: events A and B are mutually exclusive. P(A B) = P(A) + P(B) = =.3774

13 BSTT523: Pagano & Gavreau, Chapter 6 13 Q6. What is the probability of some kind of family history (bipolar or unipolar or both)? Solution: P(B C D) = P(A) = 1 P(A) = =.8091 Q7. Randomly select a subject who had early onset. What is the probability that they have no family history? Or, what is the probability of no family history given early onset? (Note: we are no longer interested in the whole n=318; we are only interested in the subset with early onset. Solution: P(A E) = =.1986 or, P(A E) = P(A E) P(E) = =.1987 Note: another way to derive P(E A) is P(E A) = P(A E)P(E) = (. 1987). 4434) =.0881

14 BSTT523: Pagano & Gavreau, Chapter 6 14 Q8. Are early onset (E) and no family history (A) independent? Solution: they are independent if P(E A) = P(E)P(A). P(E) = =.1981 P(A) = =.4434 P(E A) = =.0881 P(E)P(A) = (. 1981)(. 4434) =.0878 Not exactly! Illustration of the Law of Total Probability: What is the marginal probability of early onset (E)? Average across M.E.E. events A, B, C, D. P(E) = P(E A) + P(E B) + P(E C) + P(E D) = =.4434

15 BSTT523: Pagano & Gavreau, Chapter 6 15 Diagnostic Tests Disease Status Test Result Present (D) Absent (D) Total Positive (T + ) a b a + b Negative (T ) c d c + d Total a + c b + d a + b + c + d False Positive event: False Negative event: Sensitivity: P(T + D) = T + D T D a a+c probability of a positive test result, given that disease is present Specificity: P(T D) = d b+d probability of a negative test result, given that the disease is absent Predictive Value Positive: P(D T + ) = a a+b probability that disease is present, given a positive test result Predictive Value Negative: P(D T ) = d c+d probability that disease is absent, given a negative test result

16 BSTT523: Pagano & Gavreau, Chapter 6 16 Application of Bayes Theorem: Predictive Value Positive P(D T + ) = P(T + D)P(D) P(T + D)P(D)+P(T + D)P(D) Let S e = Sensitivity = P(T + D) S p = Specificity = P(T D) = 1-P(T + D) p = Prevalence of disease = P(D) P(D T + ) = (S e )(p) (S e )(p)+(1 S p )(1 p) Predictive Value Negative P(D T ) = P(T D)P(D) P(T D)P(D)+P(T D)P(D) = (S p )(1 p) (S p )(1 p)+(1 S e )(p)

17 BSTT523: Pagano & Gavreau, Chapter 6 17 Example: Cervical Cancer in Women (P&G p ) D T cervical cancer pap smear test for cervical cancer False negative rate = 16.25% False positive rate = 18.64% Cervical cancer prevalence = 8.3 per 100,000 Q. What is the Predictive Value? P(T D) =.1625 S e = P(T + D) = =.8375 P(T + D) =.1864 S p = P(T + D) = =.8136 p = ,000 = P(D T + ) = (S e )(p) (S e )(p)+(1 S p )(1 p) = (.8375)( ) (.8375)( )+(.1864)( ) = P(D T ) = (S p )(1 p) (S p )(1 p)+(1 S e )(p) = (.8136)( ) (.8136)( )+(.1625)( ) =

18 BSTT523: Pagano & Gavreau, Chapter 6 18 Example: Tuberculosis and X-ray screen (P&G p.138-9) Study sample of N=1,820 X-ray test results; 30 tuberculosis cases Tuberculosis X-ray result No (D) Yes (D) Total Negative (T ) Positive (T + ) Total Note: Tuberculosis prevalence is known to be 9.3 per 100,000. The proportion of cases in this sample, =.0165, should not be used for p; instead use p = S e = P(T + D) = =.7333 S p = P(T D) = =.9715 P(D T + ) = (S e )(p) (S e )(p)+(1 S p )(1 p) = (.7333)( ) (.7333)( )+(.0285)( ) = P(D T ) = (S p )(1 p) (S p )(1 p)+(1 S e )(p) = (.9715)( ) (.9715)( )+(.2667)( ) =

19 BSTT523: Pagano & Gavreau, Chapter 6 19 Example: Data is from a community-based epidemiologic survey. According to selfreported According to measured BMI: BMI: Not Obese Obese TOTAL Not Obese Obese TOTAL Prevalence of obesity = 1091/7455 = S e = P(T + D) = =.74, S p = P(T D) = =.99 P(D T + ) = =.93, P(D T ) = =.96

20 BSTT523: Pagano & Gavreau, Chapter 6 20 Relative Risks and Odds Ratios We want to compare proportions with disease D between Group 1 and Group 2. p 1 = P(D Group 1) = Risk of disease in Group 1 p 2 = P(D Group 2) = Risk of disease in Group 2 Odds1 = p 1 1 p 1, Odds2 = p 2 1 p 2 Measures of disparity in risk between groups: Risk Difference = p 2 p 1 Relative Risk (RR) = Odds Ratio (OR) = p 2 p 1 ( p 2 1 p2 ) ( p 1 1 p1 ) Low prevalence the OR is a close approximation to the RR. More later! - tests comparing two proportions (this class) - logistic regression is based on the OR (categorical data class)

I - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability

I - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)

More information

Probability. Introduction to Biostatistics

Probability. Introduction to Biostatistics Introduction to Biostatistics Probability Second Semester 2014/2015 Text Book: Basic Concepts and Methodology for the Health Sciences By Wayne W. Daniel, 10 th edition Dr. Sireen Alkhaldi, BDS, MPH, DrPH

More information

Mutually Exclusive Events

Mutually Exclusive Events 172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes

More information

Properties of Probability

Properties of Probability Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.

More information

Econ 325: Introduction to Empirical Economics

Econ 325: Introduction to Empirical Economics Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain

More information

4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio

4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio 4 Lecture 4 Notes: Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Wrong is right. Thelonious Monk 4.1 Three Definitions of

More information

Probability & Random Variables

Probability & Random Variables & Random Variables Probability Probability theory is the branch of math that deals with random events, processes, and variables What does randomness mean to you? How would you define probability in your

More information

Probability the chance that an uncertain event will occur (always between 0 and 1)

Probability the chance that an uncertain event will occur (always between 0 and 1) Quantitative Methods 2013 1 Probability as a Numerical Measure of the Likelihood of Occurrence Probability the chance that an uncertain event will occur (always between 0 and 1) Increasing Likelihood of

More information

LECTURE 1. 1 Introduction. 1.1 Sample spaces and events

LECTURE 1. 1 Introduction. 1.1 Sample spaces and events LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events

More information

Compound Events. The event E = E c (the complement of E) is the event consisting of those outcomes which are not in E.

Compound Events. The event E = E c (the complement of E) is the event consisting of those outcomes which are not in E. Compound Events Because we are using the framework of set theory to analyze probability, we can use unions, intersections and complements to break complex events into compositions of events for which it

More information

The enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}

The enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail} Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment

More information

Topic 2 Probability. Basic probability Conditional probability and independence Bayes rule Basic reliability

Topic 2 Probability. Basic probability Conditional probability and independence Bayes rule Basic reliability Topic 2 Probability Basic probability Conditional probability and independence Bayes rule Basic reliability Random process: a process whose outcome can not be predicted with certainty Examples: rolling

More information

Introduction to probability

Introduction to probability Introduction to probability 4.1 The Basics of Probability Probability The chance that a particular event will occur The probability value will be in the range 0 to 1 Experiment A process that produces

More information

Probability- describes the pattern of chance outcomes

Probability- describes the pattern of chance outcomes Chapter 6 Probability the study of randomness Probability- describes the pattern of chance outcomes Chance behavior is unpredictable in the short run, but has a regular and predictable pattern in the long

More information

Origins of Probability Theory

Origins of Probability Theory 1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.

More information

AMS7: WEEK 2. CLASS 2

AMS7: WEEK 2. CLASS 2 AMS7: WEEK 2. CLASS 2 Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Friday April 10, 2015 Probability: Introduction Probability:

More information

Axioms of Probability

Axioms of Probability Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions

Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions 1999 Prentice-Hall, Inc. Chap. 4-1 Chapter Topics Basic Probability Concepts: Sample

More information

Basic Statistics and Probability Chapter 3: Probability

Basic Statistics and Probability Chapter 3: Probability Basic Statistics and Probability Chapter 3: Probability Events, Sample Spaces and Probability Unions and Intersections Complementary Events Additive Rule. Mutually Exclusive Events Conditional Probability

More information

Basic Concepts of Probability

Basic Concepts of Probability Probability Probability theory is the branch of math that deals with random events Probability is used to describe how likely a particular outcome is in a random event the probability of obtaining heads

More information

ELEG 3143 Probability & Stochastic Process Ch. 1 Probability

ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random

More information

Chapter 2.5 Random Variables and Probability The Modern View (cont.)

Chapter 2.5 Random Variables and Probability The Modern View (cont.) Chapter 2.5 Random Variables and Probability The Modern View (cont.) I. Statistical Independence A crucially important idea in probability and statistics is the concept of statistical independence. Suppose

More information

The probability of an event is viewed as a numerical measure of the chance that the event will occur.

The probability of an event is viewed as a numerical measure of the chance that the event will occur. Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that

More information

Lecture Lecture 5

Lecture Lecture 5 Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled

More information

Announcements. Topics: To Do:

Announcements. Topics: To Do: Announcements Topics: In the Probability and Statistics module: - Sections 1 + 2: Introduction to Stochastic Models - Section 3: Basics of Probability Theory - Section 4: Conditional Probability; Law of

More information

Conditional Probability. CS231 Dianna Xu

Conditional Probability. CS231 Dianna Xu Conditional Probability CS231 Dianna Xu 1 Boy or Girl? A couple has two children, one of them is a girl. What is the probability that the other one is also a girl? Assuming 50/50 chances of conceiving

More information

(6, 1), (5, 2), (4, 3), (3, 4), (2, 5), (1, 6)

(6, 1), (5, 2), (4, 3), (3, 4), (2, 5), (1, 6) Section 7.3: Compound Events Because we are using the framework of set theory to analyze probability, we can use unions, intersections and complements to break complex events into compositions of events

More information

Statistics for Managers Using Microsoft Excel (3 rd Edition)

Statistics for Managers Using Microsoft Excel (3 rd Edition) Statistics for Managers Using Microsoft Excel (3 rd Edition) Chapter 4 Basic Probability and Discrete Probability Distributions 2002 Prentice-Hall, Inc. Chap 4-1 Chapter Topics Basic probability concepts

More information

STAT Chapter 3: Probability

STAT Chapter 3: Probability Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):

More information

Chapter 4 - Introduction to Probability

Chapter 4 - Introduction to Probability Chapter 4 - Introduction to Probability Probability is a numerical measure of the likelihood that an event will occur. Probability values are always assigned on a scale from 0 to 1. A probability near

More information

Review Basic Probability Concept

Review Basic Probability Concept Economic Risk and Decision Analysis for Oil and Gas Industry CE81.9008 School of Engineering and Technology Asian Institute of Technology January Semester Presented by Dr. Thitisak Boonpramote Department

More information

Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability

Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic

More information

Introduction to Probability

Introduction to Probability Introduction to Probability Content Experiments, Counting Rules, and Assigning Probabilities Events and Their Probability Some Basic Relationships of Probability Conditional Probability Bayes Theorem 2

More information

Probability Theory and Applications

Probability Theory and Applications Probability Theory and Applications Videos of the topics covered in this manual are available at the following links: Lesson 4 Probability I http://faculty.citadel.edu/silver/ba205/online course/lesson

More information

Chapter 3 : Conditional Probability and Independence

Chapter 3 : Conditional Probability and Independence STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2016 Néhémy Lim Chapter 3 : Conditional Probability and Independence 1 Conditional Probabilities How should we modify the probability of an event when

More information

Intermediate Math Circles November 8, 2017 Probability II

Intermediate Math Circles November 8, 2017 Probability II Intersection of Events and Independence Consider two groups of pairs of events Intermediate Math Circles November 8, 017 Probability II Group 1 (Dependent Events) A = {a sales associate has training} B

More information

Venn Diagrams; Probability Laws. Notes. Set Operations and Relations. Venn Diagram 2.1. Venn Diagrams; Probability Laws. Notes

Venn Diagrams; Probability Laws. Notes. Set Operations and Relations. Venn Diagram 2.1. Venn Diagrams; Probability Laws. Notes Lecture 2 s; Text: A Course in Probability by Weiss 2.4 STAT 225 Introduction to Probability Models January 8, 2014 s; Whitney Huang Purdue University 2.1 Agenda s; 1 2 2.2 Intersection: the intersection

More information

Fundamentals of Probability CE 311S

Fundamentals of Probability CE 311S Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in

More information

STA 291 Lecture 8. Probability. Probability Rules. Joint and Marginal Probability. STA Lecture 8 1

STA 291 Lecture 8. Probability. Probability Rules. Joint and Marginal Probability. STA Lecture 8 1 STA 291 Lecture 8 Probability Probability Rules Joint and Marginal Probability STA 291 - Lecture 8 1 Union and Intersection Let A and B denote two events. The union of two events: A B The intersection

More information

2011 Pearson Education, Inc

2011 Pearson Education, Inc Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive

More information

Outline Conditional Probability The Law of Total Probability and Bayes Theorem Independent Events. Week 4 Classical Probability, Part II

Outline Conditional Probability The Law of Total Probability and Bayes Theorem Independent Events. Week 4 Classical Probability, Part II Week 4 Classical Probability, Part II Week 4 Objectives This week we continue covering topics from classical probability. The notion of conditional probability is presented first. Important results/tools

More information

Basic Concepts of Probability

Basic Concepts of Probability Probability Probability theory is the branch of math that deals with unpredictable or random events Probability is used to describe how likely a particular outcome is in a random event the probability

More information

Chapter Learning Objectives. Random Experiments Dfiii Definition: Dfiii Definition:

Chapter Learning Objectives. Random Experiments Dfiii Definition: Dfiii Definition: Chapter 2: Probability 2-1 Sample Spaces & Events 2-1.1 Random Experiments 2-1.2 Sample Spaces 2-1.3 Events 2-1 1.4 Counting Techniques 2-2 Interpretations & Axioms of Probability 2-3 Addition Rules 2-4

More information

UNIT 5 ~ Probability: What Are the Chances? 1

UNIT 5 ~ Probability: What Are the Chances? 1 UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested

More information

Probability Theory Review

Probability Theory Review Cogsci 118A: Natural Computation I Lecture 2 (01/07/10) Lecturer: Angela Yu Probability Theory Review Scribe: Joseph Schilz Lecture Summary 1. Set theory: terms and operators In this section, we provide

More information

4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space

4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood

More information

CMPSCI 240: Reasoning about Uncertainty

CMPSCI 240: Reasoning about Uncertainty CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models

More information

Determining Probabilities. Product Rule for Ordered Pairs/k-Tuples:

Determining Probabilities. Product Rule for Ordered Pairs/k-Tuples: Determining Probabilities Product Rule for Ordered Pairs/k-Tuples: Determining Probabilities Product Rule for Ordered Pairs/k-Tuples: Proposition If the first element of object of an ordered pair can be

More information

Chapter 6: Probability The Study of Randomness

Chapter 6: Probability The Study of Randomness Chapter 6: Probability The Study of Randomness 6.1 The Idea of Probability 6.2 Probability Models 6.3 General Probability Rules 1 Simple Question: If tossing a coin, what is the probability of the coin

More information

Probability Theory for Machine Learning. Chris Cremer September 2015

Probability Theory for Machine Learning. Chris Cremer September 2015 Probability Theory for Machine Learning Chris Cremer September 2015 Outline Motivation Probability Definitions and Rules Probability Distributions MLE for Gaussian Parameter Estimation MLE and Least Squares

More information

STAT:5100 (22S:193) Statistical Inference I

STAT:5100 (22S:193) Statistical Inference I STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized

More information

(a) Fill in the missing probabilities in the table. (b) Calculate P(F G). (c) Calculate P(E c ). (d) Is this a uniform sample space?

(a) Fill in the missing probabilities in the table. (b) Calculate P(F G). (c) Calculate P(E c ). (d) Is this a uniform sample space? Math 166 Exam 1 Review Sections L.1-L.2, 1.1-1.7 Note: This review is more heavily weighted on the new material this week: Sections 1.5-1.7. For more practice problems on previous material, take a look

More information

Ch 14 Randomness and Probability

Ch 14 Randomness and Probability Ch 14 Randomness and Probability We ll begin a new part: randomness and probability. This part contain 4 chapters: 14-17. Why we need to learn this part? Probability is not a portion of statistics. Instead

More information

CINQA Workshop Probability Math 105 Silvia Heubach Department of Mathematics, CSULA Thursday, September 6, 2012

CINQA Workshop Probability Math 105 Silvia Heubach Department of Mathematics, CSULA Thursday, September 6, 2012 CINQA Workshop Probability Math 105 Silvia Heubach Department of Mathematics, CSULA Thursday, September 6, 2012 Silvia Heubach/CINQA 2012 Workshop Objectives To familiarize biology faculty with one of

More information

Lecture 1: Probability Fundamentals

Lecture 1: Probability Fundamentals Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability

More information

HW MATH425/525 Lecture Notes 1

HW MATH425/525 Lecture Notes 1 HW MATH425/525 Lecture Notes 1 Definition 4.1 If an experiment can be repeated under the same condition, its outcome cannot be predicted with certainty, and the collection of its every possible outcome

More information

4. Probability of an event A for equally likely outcomes:

4. Probability of an event A for equally likely outcomes: University of California, Los Angeles Department of Statistics Statistics 110A Instructor: Nicolas Christou Probability Probability: A measure of the chance that something will occur. 1. Random experiment:

More information

Statistics for Business and Economics

Statistics for Business and Economics Statistics for Business and Economics Basic Probability Learning Objectives In this lecture(s), you learn: Basic probability concepts Conditional probability To use Bayes Theorem to revise probabilities

More information

1 Probability Theory. 1.1 Introduction

1 Probability Theory. 1.1 Introduction 1 Probability Theory Probability theory is used as a tool in statistics. It helps to evaluate the reliability of our conclusions about the population when we have only information about a sample. Probability

More information

Probability. Chapter 1 Probability. A Simple Example. Sample Space and Probability. Sample Space and Event. Sample Space (Two Dice) Probability

Probability. Chapter 1 Probability. A Simple Example. Sample Space and Probability. Sample Space and Event. Sample Space (Two Dice) Probability Probability Chapter 1 Probability 1.1 asic Concepts researcher claims that 10% of a large population have disease H. random sample of 100 people is taken from this population and examined. If 20 people

More information

Math 1313 Experiments, Events and Sample Spaces

Math 1313 Experiments, Events and Sample Spaces Math 1313 Experiments, Events and Sample Spaces At the end of this recording, you should be able to define and use the basic terminology used in defining experiments. Terminology The next main topic in

More information

Year 10 Mathematics Probability Practice Test 1

Year 10 Mathematics Probability Practice Test 1 Year 10 Mathematics Probability Practice Test 1 1 A letter is chosen randomly from the word TELEVISION. a How many letters are there in the word TELEVISION? b Find the probability that the letter is: i

More information

2. AXIOMATIC PROBABILITY

2. AXIOMATIC PROBABILITY IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop

More information

Chapter 7 Wednesday, May 26th

Chapter 7 Wednesday, May 26th Chapter 7 Wednesday, May 26 th Random event A random event is an event that the outcome is unpredictable. Example: There are 45 students in this class. What is the probability that if I select one student,

More information

CS4705. Probability Review and Naïve Bayes. Slides from Dragomir Radev

CS4705. Probability Review and Naïve Bayes. Slides from Dragomir Radev CS4705 Probability Review and Naïve Bayes Slides from Dragomir Radev Classification using a Generative Approach Previously on NLP discriminative models P C D here is a line with all the social media posts

More information

Lecture 2: Probability and Distributions

Lecture 2: Probability and Distributions Lecture 2: Probability and Distributions Ani Manichaikul amanicha@jhsph.edu 17 April 2007 1 / 65 Probability: Why do we care? Probability helps us by: Allowing us to translate scientific questions info

More information

7.1 What is it and why should we care?

7.1 What is it and why should we care? Chapter 7 Probability In this section, we go over some simple concepts from probability theory. We integrate these with ideas from formal language theory in the next chapter. 7.1 What is it and why should

More information

Today we ll discuss ways to learn how to think about events that are influenced by chance.

Today we ll discuss ways to learn how to think about events that are influenced by chance. Overview Today we ll discuss ways to learn how to think about events that are influenced by chance. Basic probability: cards, coins and dice Definitions and rules: mutually exclusive events and independent

More information

TOPIC 12 PROBABILITY SCHEMATIC DIAGRAM

TOPIC 12 PROBABILITY SCHEMATIC DIAGRAM TOPIC 12 PROBABILITY SCHEMATIC DIAGRAM Topic Concepts Degree of Importance References NCERT Book Vol. II Probability (i) Conditional Probability *** Article 1.2 and 1.2.1 Solved Examples 1 to 6 Q. Nos

More information

Week 2: Probability: Counting, Sets, and Bayes

Week 2: Probability: Counting, Sets, and Bayes Statistical Methods APPM 4570/5570, STAT 4000/5000 21 Probability Introduction to EDA Week 2: Probability: Counting, Sets, and Bayes Random variable Random variable is a measurable quantity whose outcome

More information

MA : Introductory Probability

MA : Introductory Probability MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:

More information

Math Exam 1 Review. NOTE: For reviews of the other sections on Exam 1, refer to the first page of WIR #1 and #2.

Math Exam 1 Review. NOTE: For reviews of the other sections on Exam 1, refer to the first page of WIR #1 and #2. Math 166 Fall 2008 c Heather Ramsey Page 1 Math 166 - Exam 1 Review NOTE: For reviews of the other sections on Exam 1, refer to the first page of WIR #1 and #2. Section 1.5 - Rules for Probability Elementary

More information

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten

More information

Chapter 2. Probability

Chapter 2. Probability 2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing

More information

Probability: Why do we care? Lecture 2: Probability and Distributions. Classical Definition. What is Probability?

Probability: Why do we care? Lecture 2: Probability and Distributions. Classical Definition. What is Probability? Probability: Why do we care? Lecture 2: Probability and Distributions Sandy Eckel seckel@jhsph.edu 22 April 2008 Probability helps us by: Allowing us to translate scientific questions into mathematical

More information

A brief review of basics of probabilities

A brief review of basics of probabilities brief review of basics of probabilities Milos Hauskrecht milos@pitt.edu 5329 Sennott Square robability theory Studies and describes random processes and their outcomes Random processes may result in multiple

More information

2. Counting and Probability

2. Counting and Probability 2. Counting and Probability 2.1.1 Factorials 2.1.2 Combinatorics 2.2.1 Probability Theory 2.2.2 Probability Examples 2.1.1 Factorials Combinatorics Combinatorics is the mathematics of counting. It can

More information

Dept. of Linguistics, Indiana University Fall 2015

Dept. of Linguistics, Indiana University Fall 2015 L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would

More information

3.2 Probability Rules

3.2 Probability Rules 3.2 Probability Rules The idea of probability rests on the fact that chance behavior is predictable in the long run. In the last section, we used simulation to imitate chance behavior. Do we always need

More information

What is Probability? Probability. Sample Spaces and Events. Simple Event

What is Probability? Probability. Sample Spaces and Events. Simple Event What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5

More information

Basic Statistics for SGPE Students Part II: Probability theory 1

Basic Statistics for SGPE Students Part II: Probability theory 1 Basic Statistics for SGPE Students Part II: Probability theory 1 Mark Mitchell mark.mitchell@ed.ac.uk Nicolai Vitt n.vitt@ed.ac.uk University of Edinburgh September 2016 1 Thanks to Achim Ahrens, Anna

More information

CSC Discrete Math I, Spring Discrete Probability

CSC Discrete Math I, Spring Discrete Probability CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields

More information

Probability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)

Probability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary) Chapter 14 From Randomness to Probability How to measure a likelihood of an event? How likely is it to answer correctly one out of two true-false questions on a quiz? Is it more, less, or equally likely

More information

ENGI 4421 Introduction to Probability; Sets & Venn Diagrams Page α 2 θ 1 u 3. wear coat. θ 2 = warm u 2 = sweaty! θ 1 = cold u 3 = brrr!

ENGI 4421 Introduction to Probability; Sets & Venn Diagrams Page α 2 θ 1 u 3. wear coat. θ 2 = warm u 2 = sweaty! θ 1 = cold u 3 = brrr! ENGI 4421 Introduction to Probability; Sets & Venn Diagrams Page 2-01 Probability Decision trees u 1 u 2 α 2 θ 1 u 3 θ 2 u 4 Example 2.01 θ 1 = cold u 1 = snug! α 1 wear coat θ 2 = warm u 2 = sweaty! θ

More information

CIVL Why are we studying probability and statistics? Learning Objectives. Basic Laws and Axioms of Probability

CIVL Why are we studying probability and statistics? Learning Objectives. Basic Laws and Axioms of Probability CIVL 3103 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected

More information

PERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY

PERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY Friends, we continue the discussion with fundamentals of discrete probability in the second session of third chapter of our course in Discrete Mathematics. The conditional probability and Baye s theorem

More information

Discrete Probability

Discrete Probability Discrete Probability Mark Muldoon School of Mathematics, University of Manchester M05: Mathematical Methods, January 30, 2007 Discrete Probability - p. 1/38 Overview Mutually exclusive Independent More

More information

Chapter 1 (Basic Probability)

Chapter 1 (Basic Probability) Chapter 1 (Basic Probability) What is probability? Consider the following experiments: 1. Count the number of arrival requests to a web server in a day. 2. Determine the execution time of a program. 3.

More information

18.600: Lecture 3 What is probability?

18.600: Lecture 3 What is probability? 18.600: Lecture 3 What is probability? Scott Sheffield MIT Outline Formalizing probability Sample space DeMorgan s laws Axioms of probability Outline Formalizing probability Sample space DeMorgan s laws

More information

If S = {O 1, O 2,, O n }, where O i is the i th elementary outcome, and p i is the probability of the i th elementary outcome, then

If S = {O 1, O 2,, O n }, where O i is the i th elementary outcome, and p i is the probability of the i th elementary outcome, then 1.1 Probabilities Def n: A random experiment is a process that, when performed, results in one and only one of many observations (or outcomes). The sample space S is the set of all elementary outcomes

More information

Presentation on Theo e ry r y o f P r P o r bab a il i i l t i y

Presentation on Theo e ry r y o f P r P o r bab a il i i l t i y Presentation on Theory of Probability Meaning of Probability: Chance of occurrence of any event In practical life we come across situation where the result are uncertain Theory of probability was originated

More information

Introduction and basic definitions

Introduction and basic definitions Chapter 1 Introduction and basic definitions 1.1 Sample space, events, elementary probability Exercise 1.1 Prove that P( ) = 0. Solution of Exercise 1.1 : Events S (where S is the sample space) and are

More information

Probability (Devore Chapter Two)

Probability (Devore Chapter Two) Probability (Devore Chapter Two) 1016-345-01: Probability and Statistics for Engineers Fall 2012 Contents 0 Administrata 2 0.1 Outline....................................... 3 1 Axiomatic Probability 3

More information

Topic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1

Topic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a

More information

Random Signals and Systems. Chapter 1. Jitendra K Tugnait. Department of Electrical & Computer Engineering. James B Davis Professor.

Random Signals and Systems. Chapter 1. Jitendra K Tugnait. Department of Electrical & Computer Engineering. James B Davis Professor. Random Signals and Systems Chapter 1 Jitendra K Tugnait James B Davis Professor Department of Electrical & Computer Engineering Auburn University 2 3 Descriptions of Probability Relative frequency approach»

More information

Lecture 2: Probability. Readings: Sections Statistical Inference: drawing conclusions about the population based on a sample

Lecture 2: Probability. Readings: Sections Statistical Inference: drawing conclusions about the population based on a sample Lecture 2: Probability Readings: Sections 5.1-5.3 1 Introduction Statistical Inference: drawing conclusions about the population based on a sample Parameter: a number that describes the population a fixed

More information

Review of Statistics

Review of Statistics Review of Statistics Topics Descriptive Statistics Mean, Variance Probability Union event, joint event Random Variables Discrete and Continuous Distributions, Moments Two Random Variables Covariance and

More information

Independence. P(A) = P(B) = 3 6 = 1 2, and P(C) = 4 6 = 2 3.

Independence. P(A) = P(B) = 3 6 = 1 2, and P(C) = 4 6 = 2 3. Example: A fair die is tossed and we want to guess the outcome. The outcomes will be 1, 2, 3, 4, 5, 6 with equal probability 1 6 each. If we are interested in getting the following results: A = {1, 3,

More information

2.4. Conditional Probability

2.4. Conditional Probability 2.4. Conditional Probability Objectives. Definition of conditional probability and multiplication rule Total probability Bayes Theorem Example 2.4.1. (#46 p.80 textbook) Suppose an individual is randomly

More information

STAT 430/510 Probability

STAT 430/510 Probability STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain

More information