STAT:5100 (22S:193) Statistical Inference I
|
|
- Estella Montgomery
- 5 years ago
- Views:
Transcription
1 STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
2 Recap Matching problem Generalized birthday problem Inclusion-exclusion formula Countably infinite sample spaces Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
3 Countably Infinite Sample Spaces Countably Infinite Sample Spaces Example (continued) Suppose two players, A and B, take turns rolling a die. The first player who rolls a six wins the game. Player A rolls first. We can use as a sample space S = {1, 2, 3,... } Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
4 Countably Infinite Sample Spaces Example (continued) What is the probability that A wins? A wins if the game ends on an odd roll: 1, 3, 5,.... Let F n be the event that the game ends on roll n. The F n are pairwise disjoint. It is tempting to write ( ) P(A wins) = P F 2k 1 = P(F 2k 1 ) = = = k=1 k=1 k=1 k=1 p 2k k=1 ( ) (2k 1) 1 5 = 6 k=1 ( ) k 1 25 = 1 ( ( ) 2k ) /36 = 6 11 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
5 Countably Infinite Sample Spaces Example (continued) This is in fact the right answer. But there is a flaw in the argument. For infinite sample spaces our definition of probability does not guarantee that ( ) P F 2k 1 = P(F 2k 1 ) k=1 k=1 for pairwise disjoint F n. This identity does hold in situations like ours where p k = 1. k=1 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
6 Countable Additivity Theorem Let P be a probability on a countably infinite sample space S = {s 1, s 2,... }, let p k = P({s k }), and suppose that p k = 1. k=1 Then for any pairwise disjoint events A i S ( ) P A i = i=1 P(A i ). i=1 This property is known as countable additivity. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
7 Countable Additivity Theorem Let P be a countably additive probability, let A 1 A 2 A 3... be a decreasing sequence of events, and let Then A = A i. i=1 lim P(A i) = P(A). i This is called the continuity property of countably additive probability. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
8 Countable Additivity Knowing that a probability is countably additive can make many calculations easier. All probabilities on finite sample spaces are countably additive. Are there probabilities that are not countably additive? Yes; one example is a uniform probability distribution on the integers. For all practical purposes all probabilities used in practice are countably additive. As a result, the standard approach is to require countable additivity as part of the definition or a probability. The definition we have used so far is then called finitely additive probability. There is a school of probability and statistics based entirely on the use of finitely additive probabilities. Bruno de Finetti was a major proponent of the finitely additive approach. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
9 Countably Additive Probability Countably Additive Probability Definition A probability, or probability function, is a real-valued function defined on all subsets of a sample space S such that (i) P(A) 0 for all A S (ii) P(S) = 1 (iii) If A 1, A 2, S are pairwise disjoint, then ( ) P A i = P(A i ). i=1 i=1 Notes This definition does not add the countable additivity axiom; it replaces the finite additivity axiom with the countably additive version. We need to check that finite additivity still holds. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
10 Countably Additive Probability Theorem Suppose A, B S are disjoint and P is a (countably additive) probability on S. Then P(A B) = P(A) + P(B). Proof. Let C 1 = A, C 2 = B, and C i = for i = 3, 4,.... Then the C i are mutually exclusive, and A B = C i. So by the countable additivity axiom and the fact that P( ) = 0, ( ) P(A B) = P C i = P(C i ) i=1 i=1 i=1 = P(A) + P(B) = P(A) + P(B). Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
11 Countably Additive Probability There is a gap in the proof: Our earlier proof that P( ) = 0 used finite additivity! To fill the hole we need to prove P( ) = 0 using only the three axioms for countably additive probability. Here is one way: Let A 1 = S and let A i = for i = 2, 3,.... Then the A i are pairwise disjoint, and ( ) P(S) = P A i = P(A i ) = P(S) + P( ). i=1 This is only possible if P( ) = 0. i=1 i=2 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
12 Countably Additive Probability We have already seen that a countably additive probability satisfies a certain continuity property. A finitely additive probability that has a continuity property is countably additive: Theorem Suppose P is a finitely additive probability on a sample space S and that for any events A 1 A 2... with i=1 A i = lim P(A i) = 0. i Then P is a countably additive probability on S. So, in this sense, a countably additive probability is a finitely additive probability that is also continuous. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
13 Countably Additive Probability Proof. Outline: Using finite additivity, write ( ) ( P A i = P A 1 A 2 A n ) A i i=1 i=n+1 ( ) = P(A 1 ) + P(A 2 ) + + P(A n ) + P A i. i=n+1 Then argue that continuity implies ( ) P A i 0. i=n+1 as n. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
14 Building Probability Models Building Probability Models The main tool we have so far for building probability models is equally likely outcomes. A lot can be done with this framework. Much of classical probability is bases on equally likely outcomes. Box models used in some introductory text books are another example. But more flexible tools are needed for more complex situations. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
15 Building Probability Models Example About 50% of decided Iowa voters say they will vote Democratic, 50% Republican. About 10% of all people are left handed. If we select a decided voter at random, what is the chance the person will be a left-handed Democratic voter? It seems reasonable to assume about 10% of Iowa decided voters are left handed; about 10% of decided Republican voters are left handed; about 10% of decided Democratic voters are left handed. So the probability should be about = The classifications of party and handedness seem unrelated, or independent. What if instead of handedness the second classification was Male/Female? Urban/Rural? Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
16 Independence Independence Definition Two events A and B are independent if P(A B) = P(A)P(B). Notes In model building we often assume (at least approximate) independence. This allows complex probabilities to be derived from simple ones. Like any assumption, you have to think it through carefully before relying on it. It is rarely exactly true but often close enough to be useful. In some cases independence is derived. If A and B are disjoint and have positive probability then they are not independent; they are dependent. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
17 Independence Example A remote sensing device can be equipped with one or two power supplies. With a single power supply the device fails if the power supply fails. With two power supplies the device will only fail once both power supplies have failed. Suppose the chance of one power supply failing in a particular time frame is 10%. If we assume independent failures, then the chance that both fail is = 0.01 or 1%. Is the independence assumption reasonable? Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
18 Independence Example A fair die is rolled. Let A be the event that an even number is rolled. Let B be the event that the number rolled is at most 2. Then P(A) = 3 6 = 1 2 P(B) = 2 6 = 1 3 P(A B) = 1 6 = = P(A)P(B). So A and B are independent, even though they relate to the same roll of a die. This is an example of derived independence. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
19 Independence If A and B are independent, then P(A B c ) = P(A) P(A B) So A and B c are also independent. = P(A) P(A)P(B) = P(A)(1 P(B)) = P(A)P(B c ) Similarly, A c and B are independent, and A c and B c are independent. In words: knowing whether A has or has not occurred tells us nothing about whether B has or has not occurred. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
20 Independence Definition Events A 1, A 2,..., A n are mutually independent if P(A 1 A 2 A n ) = P(A 1 )P(A 2 ) P(A n ) and every sub-collection of n 1 of the A i is mutually independent. Notes Three events A, B, and C are mutually independent if P(A B) = P(A)P(B) P(A C) = P(A)P(C) P(B C) = P(B)P(C) P(A B C) = P(A)P(B)P(C) It is possible to have the first three but not the fourth; it is possible to have the fourth but not the first three. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
21 Independence Example (Remote sensing power supplies, continued) Suppose we can use n power supplies in our remote sensing device. The device will only fail once all power supplies have failed. Suppose the chance of a particular power supply failing is again 10%. Suppose failures of these devices are mutually independent. Then the chance of all power supplies failing is (0.1) n. By making n large we can make the chance of failure as small as we like. Is the independence assumption likely to be reasonable for very large n? Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
22 Independence Examples A fair coin is tossed independently n times. All 2 n outcomes are equally likely. A fair die is rolled independently n times. All 6 n outcomes are equally likely. A biased coin with probability p of heads is tossed n times. The probability of a particular outcome with k heads and n k tails is p k (1 p) n k. The probability of k heads is ( ) n p k (1 p) n k. k This is an important basic model for binary data. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
23 Friday, September 11, 2015 Recap Countably additive probability Independence Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
24 Friday, September 11, 2015 Example Reliability block diagrams are sometimes used to analyze reliability of complex systems. 1 2 A B 3 4 Failure modes are usually assumed independent. Let F = {whole system fails} F i = {Component i fails} p i = P(F i ). Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
25 Friday, September 11, 2015 Example (continued) We can often break larger systems into smaller sub-systems. The system of components 1 and 2 is a series system: A 1 2 B The sub-system fails if either 1 or 2 fails The sub-system failure event is F 12 = F 1 F 2. So the sub-system failure probability is P(F 12 ) = P(F 1 F 2 ) = P(F 1 ) + P(F 2 ) P(F 1 F 2 ) = p 1 + p 2 p 1 p 2 Similarly for the second sub-system P(F 34 ) = p 3 + p 4 p 3 p 4. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
26 Friday, September 11, 2015 Example (continued) The whole system is a parallel system of these two sub-systems. 1,2 A B The whole system only fails if both sub-systems fail, F = F 12 F 34. 3,4 So the failure probability for the whole system is P(F ) = P(F 12 F 34 ) = P(F 12 )P(F 34 ) = (p 1 +p 2 p 1 p 2 )(p 3 +p 4 p 3 p 4 ) The process of generating system failure probabilities from reliability block diagrams can be automated. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
27 Friday, September 11, 2015 Updating Probabilities: Conditional Probability Updating Probabilities: Conditional Probability Example Suppose I roll a die. The probability of an even roll is 1/2. Suppose I tell you the roll is 3. Does this change the probability that the roll is even? Using relative frequencies, we can look at cases where the roll is 3: new P(even) #(even and 3) = #(roll 3) P(even and 3) P( 3) prop(even and 3) prop( 3) = 1/6 1/2 = 1/3 You adjust your probability to a new sample space that only allows rolls 3. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
28 Friday, September 11, 2015 Updating Probabilities: Conditional Probability Definition For events A and B with P(B) > 0, the conditional probability of A given that B has occurred is P(A B) = P(A B) P(B) Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
29 Friday, September 11, 2015 Updating Probabilities: Conditional Probability Notes If A and B are independent then P(A B) = P(A). Sometimes we compute conditional probabilities. Other times we use them to build up more complicated probabilites: using the multiplication formula: using the Law of Total Probability: P(A B) = P(A B)P(B) P(A) = P(A B) + P(A B c ) = P(A B)P(B) + P(A B c )P(B c ) Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
30 Friday, September 11, 2015 Updating Probabilities: Conditional Probability Example About half of potential Iowa voters are male and half female About 40% of female potential voters would vote Republican About 60% of male potential voters would vote republican If a voter is selected at random then P(F ) = 0.5 P(M) = 0.5 P(R F ) = 0.4 P(R M) = 0.6 The probability of selecting a Republican potential voter is P(R F ) = P(R F )P(F ) = = 0.2 P(R M) = P(R M)P(M) = = 0.3 P(R) = P(R F ) + P(R M) = = 0.5 Mosaic plots can be used to illustrate jount probabilities of two or more classifications. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
31 Friday, September 11, 2015 Updating Probabilities: Conditional Probability Example 10% of a population has a disease. A test has the properties P(+ D) = 0.96 P( D c ) = 0.95 sensitivity specificity If a person is chosen at random and tested, then the probability of a positive result is P(+) = P(+ D) + P(+ D c ) = P(+ D)P(D) + P(+ D c )P(D c ) = P(+ D)P(D) + (1 P( D c ))P(D c ) = (1 0.95) 0.9 = = Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
32 Friday, September 11, 2015 Bayes Theorem Bayes Theorem It is often useful to reverse the calculation: Given that a randomly chosen person has a positive result, what is P(D), the probability that the person has the disease? P(D +) = P(D +) P(+) = = This calculation is very easy to do from scratch just rewrite the probability you want in terms of the inputs you have. But this calculation is very important, so it has a formal theorem attached to it. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
33 Friday, September 11, 2015 Bayes Theorem Theorem (Bayes Theorem) Let the events B 1, B 2,... partition S, i.e. the B i are pairwise disjoint, and they are collectively exhaustive: B i = S). Then for any event A P(B i A) = P(A B i) P(A) = P(A B i)p(b i ) j P(A B j)p(b j ) Notes Bayes theorem is the foundation to the Bayesian approach to drawing conclusions from data. The denominator follows from the law of total probability. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
34 Friday, September 11, 2015 Conditioning Examples Example Another reliability block diagram: 1 2 A B One possible approach is to condition on whether component 5 has failed or not. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
35 Friday, September 11, 2015 Conditioning Examples Example (continued) If component 5 has failed, then the system is like the one we analyzed previously; so P(F F 5 ) = (p 1 + p 2 p 1 p 2 )(p 3 + p 4 p 3 p 4 ). If component 5 has not failed, then the system is a series of two parallel systems, so P(F F c 5 ) = p 1 p 3 + p 2 p 4 p 1 p 3 p 2 p 4 The system failure probability is then P(F ) = P(F F 5 )p 5 + P(F F c 5 )(1 p 5 ) Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
36 Friday, September 11, 2015 Conditioning Examples Example The counting multiplication rule can often be replaced by a conditioning argument. In one approach to the matching problem we needed to compute P(A i1 A ik ), with A i the event that person i receives their own hat. P(A i1 ) = 1 n. P(A i1 A i2 ) = P(A i1 )P(A i2 A i1 ) = 1 n 1 n 1 = 1 n(n 1). P(A i1 A i2 A i3 ) = P(A i1 A i2 )P(A i3 A i1 A i2 ) = 1 n(n 1) 1 n 2 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
37 Friday, September 11, 2015 Conditioning Examples Example In analyzing processes based on a sequence of independent trials it is often useful to condition on the result of the first trial. Suppose a die is rolled until a six occurs. Let E be the event that a six eventually occurs. Let A be the event that the first roll is a six. Then P(E) = P(E A)P(A) + P(E A c )P(A c ) = P(E A) P(E Ac ) 5 6. Now P(E A) = 1. If A does not occur, then the process starts over independently, and P(E A c ) = P(E). So P(E) satisfies P(E) = P(E)5 6. So P(E) = 1. Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall
2. AXIOMATIC PROBABILITY
IA Probability Lent Term 2. AXIOMATIC PROBABILITY 2. The axioms The formulation for classical probability in which all outcomes or points in the sample space are equally likely is too restrictive to develop
More informationLecture 2: Probability, conditional probability, and independence
Lecture 2: Probability, conditional probability, and independence Theorem 1.2.6. Let S = {s 1,s 2,...} and F be all subsets of S. Let p 1,p 2,... be nonnegative numbers that sum to 1. The following defines
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationLecture 16. Lectures 1-15 Review
18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Probability assigns a likelihood to results of experiments that have not yet been conducted. Suppose that the experiment has
More informationThe enumeration of all possible outcomes of an experiment is called the sample space, denoted S. E.g.: S={head, tail}
Random Experiment In random experiments, the result is unpredictable, unknown prior to its conduct, and can be one of several choices. Examples: The Experiment of tossing a coin (head, tail) The Experiment
More informationChapter 3 : Conditional Probability and Independence
STAT/MATH 394 A - PROBABILITY I UW Autumn Quarter 2016 Néhémy Lim Chapter 3 : Conditional Probability and Independence 1 Conditional Probabilities How should we modify the probability of an event when
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationConditional Probability and Bayes
Conditional Probability and Bayes Chapter 2 Lecture 5 Yiren Ding Shanghai Qibao Dwight High School March 9, 2016 Yiren Ding Conditional Probability and Bayes 1 / 13 Outline 1 Independent Events Definition
More informationAnnouncements. Topics: To Do:
Announcements Topics: In the Probability and Statistics module: - Sections 1 + 2: Introduction to Stochastic Models - Section 3: Basics of Probability Theory - Section 4: Conditional Probability; Law of
More informationProbability Theory and Applications
Probability Theory and Applications Videos of the topics covered in this manual are available at the following links: Lesson 4 Probability I http://faculty.citadel.edu/silver/ba205/online course/lesson
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More information1 INFO 2950, 2 4 Feb 10
First a few paragraphs of review from previous lectures: A finite probability space is a set S and a function p : S [0, 1] such that p(s) > 0 ( s S) and s S p(s) 1. We refer to S as the sample space, subsets
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Example: Two dice are tossed. What is the probability that the sum is 8? This is an easy exercise: we have a sample space
More informationOutline Conditional Probability The Law of Total Probability and Bayes Theorem Independent Events. Week 4 Classical Probability, Part II
Week 4 Classical Probability, Part II Week 4 Objectives This week we continue covering topics from classical probability. The notion of conditional probability is presented first. Important results/tools
More information1 INFO Sep 05
Events A 1,...A n are said to be mutually independent if for all subsets S {1,..., n}, p( i S A i ) = p(a i ). (For example, flip a coin N times, then the events {A i = i th flip is heads} are mutually
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More informationStatistics for Business and Economics
Statistics for Business and Economics Basic Probability Learning Objectives In this lecture(s), you learn: Basic probability concepts Conditional probability To use Bayes Theorem to revise probabilities
More informationIntroduction and basic definitions
Chapter 1 Introduction and basic definitions 1.1 Sample space, events, elementary probability Exercise 1.1 Prove that P( ) = 0. Solution of Exercise 1.1 : Events S (where S is the sample space) and are
More informationIntroduction to Probability 2017/18 Supplementary Problems
Introduction to Probability 2017/18 Supplementary Problems Problem 1: Let A and B denote two events with P(A B) 0. Show that P(A) 0 and P(B) 0. A A B implies P(A) P(A B) 0, hence P(A) 0. Similarly B A
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Probability
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Probability Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Applications Elementary Set Theory Random
More informationLecture 7. Bayes formula and independence
18.440: Lecture 7 Bayes formula and independence Scott Sheffield MIT 1 Outline Bayes formula Independence 2 Outline Bayes formula Independence 3 Recall definition: conditional probability Definition: P(E
More information18.600: Lecture 7 Bayes formula and independence
18.600 Lecture 7 18.600: Lecture 7 Bayes formula and independence Scott Sheffield MIT 18.600 Lecture 7 Outline Bayes formula Independence 18.600 Lecture 7 Outline Bayes formula Independence Recall definition:
More informationCS626 Data Analysis and Simulation
CS626 Data Analysis and Simulation Instructor: Peter Kemper R 104A, phone 221-3462, email:kemper@cs.wm.edu Today: Probability Primer Quick Reference: Sheldon Ross: Introduction to Probability Models 9th
More information2.6 Tools for Counting sample points
2.6 Tools for Counting sample points When the number of simple events in S is too large, manual enumeration of every sample point in S is tedious or even impossible. (Example) If S contains N equiprobable
More informationMA : Introductory Probability
MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationChapter 14. From Randomness to Probability. Copyright 2012, 2008, 2005 Pearson Education, Inc.
Chapter 14 From Randomness to Probability Copyright 2012, 2008, 2005 Pearson Education, Inc. Dealing with Random Phenomena A random phenomenon is a situation in which we know what outcomes could happen,
More informationAxiomatic Foundations of Probability. Definition: Probability Function
Chapter 1 sections We will SKIP a number of sections Set theory SKIP Real number uncountability Definition of probability Finite sample spaces Counting methods Combinatorial methods SKIP tennis tournament
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More information18.600: Lecture 7 Bayes formula and independence
18.600: Lecture 7 Bayes formula and independence Scott Sheffield MIT Outline Bayes formula Independence Outline Bayes formula Independence Recall definition: conditional probability Definition: P(E F )
More informationMutually Exclusive Events
172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationProbability the chance that an uncertain event will occur (always between 0 and 1)
Quantitative Methods 2013 1 Probability as a Numerical Measure of the Likelihood of Occurrence Probability the chance that an uncertain event will occur (always between 0 and 1) Increasing Likelihood of
More informationChapter 2.5 Random Variables and Probability The Modern View (cont.)
Chapter 2.5 Random Variables and Probability The Modern View (cont.) I. Statistical Independence A crucially important idea in probability and statistics is the concept of statistical independence. Suppose
More informationLecture 3 - Axioms of Probability
Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What
More informationConditional Probability
Conditional Probability When we obtain additional information about a probability experiment, we want to use the additional information to reassess the probabilities of events given the new information.
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationStatistical Theory 1
Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is
More informationCIVL 7012/8012. Basic Laws and Axioms of Probability
CIVL 7012/8012 Basic Laws and Axioms of Probability Why are we studying probability and statistics? How can we quantify risks of decisions based on samples from a population? How should samples be selected
More informationLecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 10: Bayes' Theorem, Expected Value and Variance Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationChapter. Probability
Chapter 3 Probability Section 3.1 Basic Concepts of Probability Section 3.1 Objectives Identify the sample space of a probability experiment Identify simple events Use the Fundamental Counting Principle
More informationLecture 9: Naive Bayes, SVM, Kernels. Saravanan Thirumuruganathan
Lecture 9: Naive Bayes, SVM, Kernels Instructor: Outline 1 Probability basics 2 Probabilistic Interpretation of Classification 3 Bayesian Classifiers, Naive Bayes 4 Support Vector Machines Probability
More informationCompound Events. The event E = E c (the complement of E) is the event consisting of those outcomes which are not in E.
Compound Events Because we are using the framework of set theory to analyze probability, we can use unions, intersections and complements to break complex events into compositions of events for which it
More informationMonty Hall Puzzle. Draw a tree diagram of possible choices (a possibility tree ) One for each strategy switch or no-switch
Monty Hall Puzzle Example: You are asked to select one of the three doors to open. There is a large prize behind one of the doors and if you select that door, you win the prize. After you select a door,
More informationFormalizing Probability. Choosing the Sample Space. Probability Measures
Formalizing Probability Choosing the Sample Space What do we assign probability to? Intuitively, we assign them to possible events (things that might happen, outcomes of an experiment) Formally, we take
More informationChapter 7 Wednesday, May 26th
Chapter 7 Wednesday, May 26 th Random event A random event is an event that the outcome is unpredictable. Example: There are 45 students in this class. What is the probability that if I select one student,
More informationProbability Theory for Machine Learning. Chris Cremer September 2015
Probability Theory for Machine Learning Chris Cremer September 2015 Outline Motivation Probability Definitions and Rules Probability Distributions MLE for Gaussian Parameter Estimation MLE and Least Squares
More informationTopic 2 Probability. Basic probability Conditional probability and independence Bayes rule Basic reliability
Topic 2 Probability Basic probability Conditional probability and independence Bayes rule Basic reliability Random process: a process whose outcome can not be predicted with certainty Examples: rolling
More informationTopic 5 Basics of Probability
Topic 5 Basics of Probability Equally Likely Outcomes and the Axioms of Probability 1 / 13 Outline Equally Likely Outcomes Axioms of Probability Consequences of the Axioms 2 / 13 Introduction A probability
More informationSTAT 516: Basic Probability and its Applications
Lecture 3: Conditional Probability and Independence Prof. Michael September 29, 2015 Motivating Example Experiment ξ consists of rolling a fair die twice; A = { the first roll is 6 } amd B = { the sum
More informationExample. What is the sample space for flipping a fair coin? Rolling a 6-sided die? Find the event E where E = {x x has exactly one head}
Chapter 7 Notes 1 (c) Epstein, 2013 CHAPTER 7: PROBABILITY 7.1: Experiments, Sample Spaces and Events Chapter 7 Notes 2 (c) Epstein, 2013 What is the sample space for flipping a fair coin three times?
More informationExample: Suppose we toss a quarter and observe whether it falls heads or tails, recording the result as 1 for heads and 0 for tails.
Example: Suppose we toss a quarter and observe whether it falls heads or tails, recording the result as 1 for heads and 0 for tails. (In Mathematical language, the result of our toss is a random variable,
More informationProbability- describes the pattern of chance outcomes
Chapter 6 Probability the study of randomness Probability- describes the pattern of chance outcomes Chance behavior is unpredictable in the short run, but has a regular and predictable pattern in the long
More informationDynamic Programming Lecture #4
Dynamic Programming Lecture #4 Outline: Probability Review Probability space Conditional probability Total probability Bayes rule Independent events Conditional independence Mutual independence Probability
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationIndependence 1 2 P(H) = 1 4. On the other hand = P(F ) =
Independence Previously we considered the following experiment: A card is drawn at random from a standard deck of cards. Let H be the event that a heart is drawn, let R be the event that a red card is
More informationProblem #1 #2 #3 #4 Extra Total Points /3 /13 /7 /10 /4 /33
STAT/MATH 394 A - Autumn Quarter 206 - Midterm - October 2, 206 Name: Student ID Number: Problem # #2 #3 #4 Extra Total Points /3 /3 /7 /0 /4 /33 Read directions carefully and show all your work. Particularly,
More informationProbability 5-4 The Multiplication Rules and Conditional Probability
Outline Lecture 8 5-1 Introduction 5-2 Sample Spaces and 5-3 The Addition Rules for 5-4 The Multiplication Rules and Conditional 5-11 Introduction 5-11 Introduction as a general concept can be defined
More informationProbability, Random Processes and Inference
INSTITUTO POLITÉCNICO NACIONAL CENTRO DE INVESTIGACION EN COMPUTACION Laboratorio de Ciberseguridad Probability, Random Processes and Inference Dr. Ponciano Jorge Escamilla Ambrosio pescamilla@cic.ipn.mx
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationLecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationRandomized Algorithms
Randomized Algorithms Prof. Tapio Elomaa tapio.elomaa@tut.fi Course Basics A new 4 credit unit course Part of Theoretical Computer Science courses at the Department of Mathematics There will be 4 hours
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationCogs 14B: Introduction to Statistical Analysis
Cogs 14B: Introduction to Statistical Analysis Statistical Tools: Description vs. Prediction/Inference Description Averages Variability Correlation Prediction (Inference) Regression Confidence intervals/
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationChapter Summary. 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance
Chapter 7 Chapter Summary 7.1 Discrete Probability 7.2 Probability Theory 7.3 Bayes Theorem 7.4 Expected value and Variance Section 7.1 Introduction Probability theory dates back to 1526 when the Italian
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationDetermining Probabilities. Product Rule for Ordered Pairs/k-Tuples:
Determining Probabilities Product Rule for Ordered Pairs/k-Tuples: Determining Probabilities Product Rule for Ordered Pairs/k-Tuples: Proposition If the first element of object of an ordered pair can be
More informationAnnouncements. Lecture 5: Probability. Dangling threads from last week: Mean vs. median. Dangling threads from last week: Sampling bias
Recap Announcements Lecture 5: Statistics 101 Mine Çetinkaya-Rundel September 13, 2011 HW1 due TA hours Thursday - Sunday 4pm - 9pm at Old Chem 211A If you added the class last week please make sure to
More informationBasic notions of probability theory
Basic notions of probability theory Contents o Boolean Logic o Definitions of probability o Probability laws Objectives of This Lecture What do we intend for probability in the context of RAM and risk
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter One Jesse Crawford Department of Mathematics Tarleton State University (Tarleton State University) Chapter One Notes 1 / 71 Outline 1 A Sketch of Probability and
More informationNotes 1 Autumn Sample space, events. S is the number of elements in the set S.)
MAS 108 Probability I Notes 1 Autumn 2005 Sample space, events The general setting is: We perform an experiment which can have a number of different outcomes. The sample space is the set of all possible
More informationLecture 4. Selected material from: Ch. 6 Probability
Lecture 4 Selected material from: Ch. 6 Probability Example: Music preferences F M Suppose you want to know what types of CD s males and females are more likely to buy. The CD s are classified as Classical,
More informationChapter 3: Probability 3.1: Basic Concepts of Probability
Chapter 3: Probability 3.1: Basic Concepts of Probability Objectives Identify the sample space of a probability experiment and a simple event Use the Fundamental Counting Principle Distinguish classical
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More informationBasic Statistics and Probability Chapter 3: Probability
Basic Statistics and Probability Chapter 3: Probability Events, Sample Spaces and Probability Unions and Intersections Complementary Events Additive Rule. Mutually Exclusive Events Conditional Probability
More informationProblems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman.
Math 224 Fall 2017 Homework 1 Drew Armstrong Problems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman. Section 1.1, Exercises 4,5,6,7,9,12. Solutions to Book Problems.
More informationSTOR Lecture 4. Axioms of Probability - II
STOR 435.001 Lecture 4 Axioms of Probability - II Jan Hannig UNC Chapel Hill 1 / 23 How can we introduce and think of probabilities of events? Natural to think: repeat the experiment n times under same
More informationTOPIC 12 PROBABILITY SCHEMATIC DIAGRAM
TOPIC 12 PROBABILITY SCHEMATIC DIAGRAM Topic Concepts Degree of Importance References NCERT Book Vol. II Probability (i) Conditional Probability *** Article 1.2 and 1.2.1 Solved Examples 1 to 6 Q. Nos
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationDenker FALL Probability- Assignment 6
Denker FALL 2010 418 Probability- Assignment 6 Due Date: Thursday, Oct. 7, 2010 Write the final answer to the problems on this assignment attach the worked out solutions! Problem 1: A box contains n +
More information3.2 Probability Rules
3.2 Probability Rules The idea of probability rests on the fact that chance behavior is predictable in the long run. In the last section, we used simulation to imitate chance behavior. Do we always need
More informationLecture 1. ABC of Probability
Math 408 - Mathematical Statistics Lecture 1. ABC of Probability January 16, 2013 Konstantin Zuev (USC) Math 408, Lecture 1 January 16, 2013 1 / 9 Agenda Sample Spaces Realizations, Events Axioms of Probability
More informationF71SM STATISTICAL METHODS
F71SM STATISTICAL METHODS RJG SUMMARY NOTES 2 PROBABILITY 2.1 Introduction A random experiment is an experiment which is repeatable under identical conditions, and for which, at each repetition, the outcome
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationConditional Probability & Independence. Conditional Probabilities
Conditional Probability & Independence Conditional Probabilities Question: How should we modify P(E) if we learn that event F has occurred? Definition: the conditional probability of E given F is P(E F
More informationDiscrete Probability
Discrete Probability Counting Permutations Combinations r- Combinations r- Combinations with repetition Allowed Pascal s Formula Binomial Theorem Conditional Probability Baye s Formula Independent Events
More information