Rules of Probability

Similar documents
Conditional Probability

Mathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2

Statistics and Quantitative Analysis U4320. Segment 3: Probability Prof. Sharyn O Halloran

Expected Value and Variance

An Experiment/Some Intuition (Fall 2006): Lecture 18 The EM Algorithm heads coin 1 tails coin 2 Overview Maximum Likelihood Estimation

MODULE 2 RANDOM VARIABLE AND ITS DISTRIBUTION LECTURES DISTRIBUTION FUNCTION AND ITS PROPERTIES


2. Conditional Probability

Discussion 11 Summary 11/20/2018

Probability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)

Stochastic Structural Dynamics

Expected Value 7/7/2006

Events A and B are said to be independent if the occurrence of A does not affect the probability of B.

CS-433: Simulation and Modeling Modeling and Probability Review

What is Probability? Probability. Sample Spaces and Events. Simple Event

Chapter 1. Probability

Lecture 3: Probability Distributions

SDS 321: Introduction to Probability and Statistics

Why should you care?? Intellectual curiosity. Gambling. Mathematically the same as the ESP decision problem we discussed in Week 4.

CSC Discrete Math I, Spring Discrete Probability

324 Stat Lecture Notes (1) Probability

A random variable is a function which associates a real number to each element of the sample space

Probability. VCE Maths Methods - Unit 2 - Probability

(i) Given that a student is female, what is the probability of having a GPA of at least 3.0?

Lecture 3 - Axioms of Probability

Quantitative Methods for Decision Making

6.2 Introduction to Probability. The Deal. Possible outcomes: STAT1010 Intro to probability. Definitions. Terms: What are the chances of?

Statistics Statistical Process Control & Control Charting

not to be republishe NCERT PROBABILITY Chapter 16.1 Introduction

Lecture 6 Random Variable. Compose of procedure & observation. From observation, we get outcomes

Probability Pearson Education, Inc. Slide

Conditional Probability

STAT 430/510 Probability

Homework 4 Solution, due July 23

Engineering Risk Benefit Analysis

What is a random variable

PROBABILITY CHAPTER LEARNING OBJECTIVES UNIT OVERVIEW

LECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD

Mean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102

Math 426: Probability MWF 1pm, Gasson 310 Homework 4 Selected Solutions

Chapter 4: Probability and Probability Distributions

Bayes Rule for probability

1. Fundamentals 1.1 Probability Theory Sample Space and Probability Random Variables Limit Theories

Probabilistic models

Probability and Random Variable Primer

Introduction to Random Variables

Outline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks

arxiv: v1 [math.co] 1 Mar 2014

First Digit Tally Marks Final Count

Probability Distributions for Discrete RV

HMMT February 2016 February 20, 2016

} Often, when learning, we deal with uncertainty:

ELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities

Applied Statistics I

Population element: 1 2 N. 1.1 Sampling with Replacement: Hansen-Hurwitz Estimator(HH)

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

11. Probability Sample Spaces and Probability

Probability (10A) Young Won Lim 6/12/17

V. RANDOM VARIABLES, PROBABILITY DISTRIBUTIONS, EXPECTED VALUE

Exercises of Chapter 2

Probability Pr(A) 0, for any event A. 2. Pr(S) = 1, for the sample space S. 3. If A and B are mutually exclusive, Pr(A or B) = Pr(A) + Pr(B).

Formal Modeling in Cognitive Science

Formal Modeling in Cognitive Science Lecture 19: Application of Bayes Theorem; Discrete Random Variables; Distributions. Background.

Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability

Random Variables. Statistics 110. Summer Copyright c 2006 by Mark E. Irwin

Key Concepts. Key Concepts. Event Relations. Event Relations

27 Binary Arithmetic: An Application to Programming

Notation: X = random variable; x = particular value; P(X = x) denotes probability that X equals the value x.

p. 4-1 Random Variables

ECE 450 Lecture 2. Recall: Pr(A B) = Pr(A) + Pr(B) Pr(A B) in general = Pr(A) + Pr(B) if A and B are m.e. Lecture Overview

Smarandache-Zero Divisors in Group Rings

Introduction Probability. Math 141. Introduction to Probability and Statistics. Albyn Jones

Topics in Probability Theory and Stochastic Processes Steven R. Dunbar. Classes of States and Stationary Distributions

9/6/2016. Section 5.1 Probability. Equally Likely Model. The Division Rule: P(A)=#(A)/#(S) Some Popular Randomizers.

Deep Learning for Computer Vision

CS206 Review Sheet 3 October 24, 2018

Beyond Zudilin s Conjectured q-analog of Schmidt s problem

PhysicsAndMathsTutor.com

Statistical methods in recognition. Why is classification a problem?

3rd IIA-Penn State Astrostatistics School July, 2010 Vainu Bappu Observatory, Kavalur

Chapter 4: Probability and Probability Distributions

4th IIA-Penn State Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur

CISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability. Outline. Terminology and background. Arthur G.

Discrete Probability

Lecture 2. Constructing Probability Spaces

The Bernoulli distribution has only two outcomes, Y, success or failure, with values one or zero. The probability of success is p.

Lecture 3: Random variables, distributions, and transformations

Lecture 1 : The Mathematical Theory of Probability

Thus, P(F or L) = P(F) + P(L) - P(F & L) = = 0.553

Machine learning: Density estimation

Chapter 13, Probability from Applied Finite Mathematics by Rupinder Sekhon was developed by OpenStax College, licensed by Rice University, and is

Probability: Terminology and Examples Class 2, Jeremy Orloff and Jonathan Bloom

More on Distribution Function

Multiple Choice. Choose the one that best completes the statement or answers the question.

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1

4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space

PERMUTATIONS, COMBINATIONS AND DISCRETE PROBABILITY

CS4705. Probability Review and Naïve Bayes. Slides from Dragomir Radev

Random Partitions of Samples

Chapter 2 PROBABILITY SAMPLE SPACE

Transcription:

( ) ( ) = for all Corollary: Rules of robablty The probablty of the unon of any two events and B s roof: ( Φ) = 0. F. ( B) = ( ) + ( B) ( B) If B then, ( ) ( B). roof: week 2

week 2 2 Incluson / Excluson formula: For any fnte collecton of events For any fnte collecton of events roof: By nducton n,...,, 2 ( ) ( ) ( ) ( ) ( ) > > > = = + = j n n k j k j j n n 2 U n,...,, 2 ( ) = = n n U

Example In a lottery there are 0 tckets numbered, 2, 3,, 0. Two numbers are drown for przes. You hold tckets and 2. What s the probablty that you wn at least one prze? week 2 3

Condtonal robablty Idea have performed a chance experment but don t know the outcome (ω), but have some partal nformaton (event ) about ω. Queston: gven ths partal nformaton what s the probablty that the outcome s n some event B? Example: Toss a con 3 tmes. We are nterested n event B that there are 2 or more heads. The sample space has 8 equally lkely outcomes. Ω = { HHH, HHT, HTH, THH, HTT, THT, TTH, TTT} The probablty of the event B s Suppose we know that the frst con came up H. Let be the event the frst outcome s H. Then { HHH, HHT, HTH, HTT} and B = HHH, HHT, The condtonal probablty of B gven s 3 3 8 ( B) = = 4 4 8 = { HTH} ( ) week 2 4

Gven a probablty space (Ω, F, ) and events, B F wth () > 0 The condtonal probablty of B gven the nformaton that has occurred s ( ) ( B) B = Example: ( ) We toss a de. What s the probablty of observng the number 6 gven that the outcome s even? Does ths gve rse to a vald probablty measure? Theorem If F and () > 0 then (Ω, F, Q) s a probablty space where Q : s defned by Q(B) = (B ). roof: F R week 2 5

The fact that condtonal probablty s a vald probablty measure allows the followng: ( ) ( ) B = B,, B F, () >0 ( B B ) = ( B ) + ( B ) ( B B ) 2 2 2 for any, B, B 2 F, () >0. week 2 6

Multplcaton rule For any two events and B, For any 3 events, B and C, ( B) = ( B ) ( ) ( B C) = ( ) ( B ) ( C B) In general, n I = = n ( ) ( ) ( ) 2 3 2 n I = Example: n urn ntally contans 0 balls, 3 blue and 7 whte. We draw a ball and note ts colure; then we replace t and add one more of the same colure. We repeat ths process 3 tmes. What s the probablty that the frst 2 balls drawn are blue and the thrd one s whte? Soluton: week 2 7

Law of total probablty Defnton: For a probablty space (Ω, F, ), a partton of Ω s a countable collecton { B } of events such that B F, B B = Φ and B = Ω. Theorem: If { B, B,... 2 } s a partton of Ω such that B > 0 then roof: ( ) ( B ) ( ) j U for any. = B F ( ) week 2 8

( ) Examples. Calculaton of for the Urn example. B 2 2. In a certan populaton 5% of the females and 8% of the males are left-handed; 48% of the populaton are males. What proporton of the populaton s lefthanded? Suppose person from the populaton s chosen at random; what s the probablty that ths person s left-handed? week 2 9

Bayes Rule Example: test for a dsease correctly dagnoses a dseased person as havng the dsease wth probablty 0.85. The test ncorrectly dagnoses someone wthout the dsease as havng the dsease wth probablty 0. If % of the people n a populaton have the dsease, what s the probablty that a person from ths populaton who tests postve for the dsease actually has t? (a) 0.0085 (b) 0.079 (c) 0.075 (d) 0.500 (e) 0.9000 week 2 0

Independence Example: Roll a 6-sded de twce. Defne the followng events : 3 or less on frst roll B : Sum s odd. If occurrence of one event does not affect the probablty that the other occurs than, B are ndependent. week 2

Defnton Events and B are ndependent f Note: Independence dsjont. Two dsjont events are ndependent f and only f the probablty of one of them s zero. Generalzed to more than 2 events: collecton of events, 2 s (mutually) ndependent f for any subcollecton ( B) ( ) ( B) = {,... }, 2 {,... } m n ( ) = ( ) ( ) ( ) 2 m 2 m Note: parwze ndependence does not guarantee mutual ndependence. week 2 2

Defnton Events and B are ndependent f Note: Independence dsjont. Two dsjont events are ndependent f and only f the probablty of one of them s zero. Generalzed to more than 2 events: collecton of events, 2 s (mutually) ndependent f for any subcollecton ( B) ( ) ( B) = {,... }, 2 {,... } m n ( ) = ( ) ( ) ( ) 2 m 2 m Note: parwze ndependence does not guarantee mutual ndependence. week 2 3

Example Roll a de twce. Defne the followng events; : st de odd B: 2nd de odd C: sum s odd. week 2 4

Example week 2 5

week 2 6