Basic Statistics for SGPE Students Part II: Probability theory 1
|
|
- Rosaline Wilkerson
- 5 years ago
- Views:
Transcription
1 Basic Statistics for SGPE Students Part II: Probability theory 1 Mark Mitchell mark.mitchell@ed.ac.uk Nicolai Vitt n.vitt@ed.ac.uk University of Edinburgh September Thanks to Achim Ahrens, Anna Babloyan and Erkal Ersoy for creating these slides and allowing us to use them.
2 Hypothesis testing and p-values 1 / 35 Outline 1. Descriptive statistics Sample statistics (mean, variance, percentiles) Graphs (box plot, histogram) Data transformations (log transformation, unit of measure) Correlation vs. Causation 2. Probability theory Conditional probabilities and independence Bayes theorem 3. Probability distributions Discrete and continuous probability functions Probability density function & cumulative distribution function Binomial, Poisson and Normal distribution E[X] and V[X] 4. Statistical inference Population vs. sample Law of large numbers Central limit theorem Confidence intervals
3 Probability Example II.1 A fair coin is tossed three times. Sample space and event The (mutually exclusive and exhaustive) list of possible outcomes of an experiment is known as the sample space and is denoted as S. An event E is a single outcome or group of outcomes in the sample space. That is, E is a subset of S. In this example, S = {HHH ; THH ; HTH ; HHT; HTT; THT; TTH ; TTT} where H and T denote head and tail. Suppose we are interested in the event at least two heads. The corresponding subspace is E = {HHH ; THH ; HTH ; HHT}. What is the probability of the event E? 2 / 35
4 Probability Let s take a step back: What is probability? Classical Interpretation (Jacob Bernoulli, Pierre-Simon Laplace) If outcomes are equally likely, they must have the same probability. For example, when a coin is tossed, there are two possible outcomes: head and tail. More general, if there are n equally likely outcomes, then the probability of each outcome is 1/n. Frequency Interpretation The probability that a specific outcome of a process will be obtained is the relative frequency with which that outcome would be obtained if the process were repeated a large number of times under the same conditions. As we make more and more tosses, the proportion of tosses that produce head approaches 0.5. We say that 0.5 is the probability of head. Rel. frequency of heads Trial 1 Trial Number of tosses 3 / 35
5 Probability Let s take a step back: What is probability? Subjective Interpretation (Bayesian approach) The probability that a person assigns to a possible outcome represents his own judgement (based on the person s beliefs and information). Another person, who may have different beliefs or different information, may assign a different probability to the same outcome. Distinction between prior and posterior beliefs. Thinking about randomness [Carl Friedrich] Gauss s conversation turned to chance, the enemy of all knowledge, and the thing he had always wished to overcome. Viewed from up close, one could detect the infinite fineness of the web of causality behind every event. Step back and larger patterns appeared: Freedom and Chance were a question of distance, a point of view. Did he understand? Sort of, said Eugen wearily, looking at his pocket watch. from Measuring the World by Daniel Kehlmann 4 / 35
6 Probability Properties of probability S Rule 1 For any event A, 0 P(A) 1. Furthermore, P(S) = 1. A S Rule 2: Complement rule A c denotes the complement of event A. P(A c ) = 1 P(A) A c A S Rule 3: Multiplication rule Two events A and B are independent of each other if and only if P(AB) = P(A and B) = P(A B) = P(A)P(B). AB c AB A c B 5 / 35
7 Probability Properties of probability Rule 4: Addition rule If two events A and B are mutually exclusive, then P(A or B) = P(A B) = P(A) + P(B). A B S S Rule 5 If event B is a subset of event A, then P(B) < P(A). AB c B 6 / 35
8 Probability What is the probability of E? Example II.1 A fair coin is tossed three times. S = {HHH, THH, HTH, HHT, HTT, THT, TTH, TTT} E = {HHH, THH, HTH, HHT} What is P(E)? First, note that because the coin is fair P(H ) = P(T) = 1 2. Second, since each toss is independent of the previous, we can use Rule 3 (Multiplication Rule), P(HHH ) = P(H )P(H )P(H ) = = 1 8. and following the same reasoning, P(HHT) = P(HHT) =... = 1 /8. Third, using Rule 4 (Addition Rule) P(E) = P(HHH ) + P(THH ) + P(HTH ) + P(HHT) = 4 8 = / 35
9 Probability Generalised addition rule Example II.2 A fair six-sided die is rolled. The sample space is given by S = {1, 2, 3, 4, 5, 6}. Let E 1 be the event obtain 3 or 4 and let E 2 denote the event smaller than 4. Thus, E 1 = {3, 4} and E 2 = {1, 2, 3} It is immediately clear that P(E 1 ) = 2 /6 and P(E 2 ) = 3 /6. But what is the probability that either E 1 or E 2? That is, what is P(E 1 E 2 )? Since E 1 and E 2 are not mutually exclusive, we cannot apply Rule 4 (Addition Rule). But we can generalise Rule 4. 8 / 35
10 Probability Generalised addition rule Rule 4 : (General) Addition rule For any two events A and B P(A or B) = P(A B) = P(A) + P(B) P(AB). Note that if A and B are mutually exclusive, P(AB) = 0. Therefore, Rule 4 is a special case of Rule 4. Applying Rule 4, we get AB c AB A c B S P(E 1 E 2 ) = P(E 1 ) + P(E 2 ) P(E 1 E 2 ) = P(3) + P(4) + P(1) + P(2) + P(3) P(3) }{{}}{{}}{{} P(E 1) P(E 2) P(E 1E 2) = = / 35
11 Conditional probability Example II.3 Suppose that, on any particular day, Anna is either in a good mood (A) or in a bad mood (A c ). Also, on any particular day, the sun is either shining (B) or not (B c ). Anna s mood depends on the weather, such that she is more likely to be in a good mood when the sun is shining. S A The blue area A which represents the probability that Anna is in a good mood is rather small compared to the full rectangle ( 35%). In general, it is more likely that Anna is in a bad mood. 10 / 35
12 Conditional probability Example II.3 Suppose that, on any particular day, Anna is either in a good mood (A) or in a bad mood (A c ). Also, on any particular day, the sun is either shining (B) or not (B c ). Anna s mood depends on the weather, such that she is more likely to be in a good mood when the sun is shining. S AB A c B AB c This graph shows both events, A and B, and their overlap. 11 / 35
13 Conditional probability Example II.3 Suppose that, on any particular day, Anna is either in a good mood (A) or in a bad mood (A c ). Also, on any particular day, the sun is either shining (B) or not (B c ). Anna s mood depends on the weather, such that she is more likely to be in a good mood when the sun is shining. AB A c B Now, suppose the sun is shining. We can discard the remaining sample space and focus on B. The area AB takes up most of the area in the circle. That is, given that B occured, it is more likely that Anna is in a good mood, although in general she is more often in a bad mood. 12 / 35
14 Conditional probability Rule 3 : General Multiplication rule If A and B are any two events and P(B) > 0, then P(AB) = P(A)P(B A) = P(B)P(A B). AB c AB A c B S P(A B) is the conditional probability of the event A given that the event B has occurred. Conditional probability From Rule 3 follows the definition for conditional probability P(A B) = P(AB) P(B). Note that, if A and B are independent, then P(A B) = P(A)P(B) P(B) Thus, Rule 3 is a special case of Rule 3. = P(A). 13 / 35
15 Conditional probability Example II.4 The following table contains counts (in thousands) of persons aged 25 and older, classified by educational attainment and employment status: Education Employed Unemployed Not in labor force Total Did not finish high school 11, ,226 26,633 High school degree 36,857 1,682 22,834 61,373 Some college 34,612 1,275 13,944 49,831 Bachelor s degree or higher 43, ,546 56,620 Total 126,172 4,735 63, ,457 Is employment status independent of educational attainment? Suppose we randomly draw a person from the population. What is the probability that the person is employed? P(employed) = 126, ,457 = Now, suppose we randomly draw another person and are given the information that the person did not finish high school. What is the probability that the person is employed given that the person did not finish high school? P(employed did not finish high school) = 11,521 26,633 = / 35
16 Conditional probability We can display the relationship between education and employment in a probability table. Education Employed Unemployed Not in labor force Total Did not finish high school High school degree Some college Bachelor s degree or higher Total The probabilities in the central enclosed rectangle are joint probabilities. For example, P(no high school unemployed) = P(unemp.)P(no high school unemp.) ( ) ( ) 4, = 194,457 4,735 = P(no high school)p(unemp. no high school) ( ) ( ) 26, = 194,457 26,633 ( ) 886 = = , / 35
17 Conditional probability We can display the relationship between education and employment in a probability table. Education Employed Unemployed Not in labor force Total Did not finish high school High school degree Some college Bachelor s degree or higher Total The probabilities in the right-most and bottom row are called marginal probabilities. For example, ( ) 61,373 P(High school degree) = = , / 35
18 Conditional probability We can display the relationship between education and employment in a probability table. Education Employed Unemployed Not in labor force Total Did not finish high school High school degree Some college Bachelor s degree or higher Total Note that, under independence, P(no high school employed) = P(employed)P(no high school) = = which indicates that educational attainment and employment are not independent. 17 / 35
19 Conditional probability Example II.5 Ms Smith, Ms Brown and Ms Thomson want to spend a day in Edinburgh, but cannot agree on what to do. They decide to vote. Each person can choose between theatre (T) and cinema (C). Ms Smith and Ms Thomson decide independently but Ms Brown is affected by Ms Thomson. The probabilities can be summarised as follows: P(Thomson = T) = 0.2; P(Brown = T Thomson = T) = 0.8; P(Brown = T Thomson = C) = 0.05; P(Smith = T) = 0.8. What is the probability that the majority (i.e. at least two) will vote in favour of theatre? 18 / 35
20 Independence versus disjointness Recall that P(A and B) = P(A)P(B) holds if and only if A and B are independent. Furthermore, P(A and B) = 0 holds if and only if the events A and B are disjoint or mutually exclusive. Therefore, if A and B are nontrivial events (i.e. P(A) and P(B) are nonzero), then they cannot be both independent and mutually exclusive. Remark Independent and disjoint does not mean the same! Disjointness means that A and B cannot occur at the same time. Independence means that the occurrence of A has no influence on the probability that B happens, and vice versa. 19 / 35
21 Bayes theorem Derivation From Rule 3 P(A B) = P(AB) P(B) P(B A) = P(AB) P(A) (1) (2) We can rewrite (2) as P(B A)P(A) = P(AB) and substitute the expression into (1) to get P(A B) = P(B A)P(A). (3) P(B) Furthermore and from (2) Therefore, we can write (3) as P(B) = P(BA) + P(BA c ) P(B) = P(B A)P(A) + P(B A c )P(A c ). P(A B) = P(B A)P(A) P(B A)P(A) + P(B A c )P(A c ). 20 / 35
22 Bayes theorem Bayes theorem For any two events A and B with 0 < P(A) < 1 and 0 < P(B) < 1 P(A B) = P(B A)P(A) P(B A)P(A) + P(B A c )P(A c ) Bayes theorem provides a simple rule for computing the conditional probability of the event A given B from the conditional probability of B given A (and the unconditional probability of A). 21 / 35
23 Bayes theorem Example II.6 Suppose you have three coins in a box. Two of them are fair and the other one is counterfeit and always lands heads. Thus, if you randomly pick one coin, there is a 1/3 chance that the coin is counterfeit; i.e. P(counterfeit) = 1/3. P(counterfeit) is the prior (or unconditional) probability. Now, you toss the randomly picked coin three times and get three heads. We are interested in the (posterior) probability that the coin is counterfeit conditional on observing three heads. That is P(counterfeit HHH) = We know from above that P(HHH counterfeit)p(counterfeit) P(HHH counterfeit)p(counterfeit) + P(HHH fair)p(fair) P(counterfeit) = 1 3 P(fair) = 2 3 P(HHH counterfeit) = 1 P(HHH fair) = 1 8 Thus, P(counterfeit HHH) = = / 35
24 Bayes theorem Example II.7 Suppose a test for an illegal drug correctly identifies drug users 90% of the time and will give a positive reading for non-drug users only 1% percent of the time. 1 person in thousand of the population are drug users. Timmy is tested positive, indicating that he is a drug user. How likely is it that Timmy is actually a drug user? We are looking for P(user pos.) = P(pos. user)p(user) P(pos. user)p(user) + P(pos. non-user)p(non-user). From the text above, we know that P(user) = 0.001, P(non-user) = 0.999, P(pos. user) = 0.9 and P(pos. non-user) = Therefore, P(user pos.) = / 35
25 Bayes theorem Example II.7 Suppose a test for an illegal drug correctly identifies drug users 90% of the time and will give a positive reading for non-drug users only 1% percent of the time. 1 person in thousand of the population are drug users. Timmy is tested positive. indicating that he is a drug user. How likely is it that Timmy is actually a drug user? The prior (unconditional) probability that Timmy is a drug user is P(user) = Based on the information from the test, we update the prior probability of upwards to a posterior probability of This probability is surprisingly low. Despite the positive test result and despite the test being quite reliable, it is more likely that Timmy is not a drug user than that he is a drug user! 24 / 35
26 Bayes theorem Example II.7 Suppose a test for an illegal drug correctly identifies drug users 90% of the time and will give a positive reading for non-drug users only 1% percent of the time. 1 person in thousand of the population are drug users. Timmy is tested positive. indicating that he is a drug user. How likely is it that Timmy is actually a drug user? We can display the relationship between test results and drug consumption in a probability table: Test results Drug user? Positive Negative Non-user User P(user positive) = P(user)P(pos. user) = = P(non-user positive) = P(non-user)P(pos. non-user) = = / 35
27 Monty Hall problem You are in a game show. There are three doors. Behind one door is a car; behind the other two doors are goats. You pick one door (here door 1).????? The game host opens another door which has a goat (here door 2).?? The game host gives you the chance to switch to the other closed door (here door 3). Should you stick to the door or switch? Does it matter?? 26 / 35
28 Monty Hall problem The answer seems obvious: It should not make a difference. There are two doors left. So the probability of winning should be 0.5, independent of how you decide. However, this reasoning is wrong! To see why, let s list all nine different cases and look which strategy is more successful. 27 / 35
29 Monty Hall problem Door 1 Door 2 Door 3 Stick Switch WIN LOSE LOSE WIN LOSE WIN If we switch, we have a 2 /3 chance of winning! Watch video 28 / 35
30 Monty Hall problem Door 1 Door 2 Door 3 Stick Switch LOSE WIN WIN LOSE LOSE WIN If we switch, we have a 2 /3 chance of winning! Watch video 28 / 35
31 Monty Hall problem Door 1 Door 2 Door 3 Stick Switch LOSE WIN LOSE WIN WIN LOSE If we switch, we have a 2 /3 chance of winning! Watch video 28 / 35
32 The Birthday Problem Example II.8 Suppose there is group of k (2 k 365) people. What is the probability that at least two people in a group share the same birthday (i.e. year of birth does not matter)? Ignore February 29 and assume that each of the 365 days of a year is equally likely to be the birthday of any person and that birthdays of the group members are unrelated (no twins). It turns out, it is easier to start with the question what is the probability that no one in the group shares a birthday? Note that P(at least two share a birthday) = 1 P(no one shares a birthday). Let s start with k = 2. Given that the first person has her birthday on any arbitrary day of the year, the probability that the second person does not have the same birthday is / 35
33 The Birthday Problem Example II.8 Suppose there is group of k (2 k 365) people. What is the probability that at least two people in a group share the same birthday (i.e. year of birth does not matter)? Ignore February 29 and assume that each of the 365 days of a year is equally likely to be the birthday of any person and that birthdays of the group members are unrelated (no twins). k = 3. The probability that three persons do not share the same birthday is And, in general, (365 k + 1) 365 k. 30 / 35
34 The Birthday Problem Example II.8 Suppose there is group of k (2 k 365) people. What is the probability that at least two people in a group share the same birthday (i.e. year of birth does not matter)? Ignore February 29 and assume that each of the 365 days of a year is equally likely to be the birthday of any person and that birthdays of the group members are unrelated (no twins). Note that (n k)(n k 1)... 1 n(n 1)... (n k + 1) = n(n 1)... (n k + 1) (n k)(n k 1)... 1 n! = (n k)! where n! = n(n 1)... 1 and 0! = 1. Thus, we can write the above as P(no one shares a birthday) = 365! (365 k)!365 k and the solution is 365! P(at least two share a birthday) = 1 (365 k)!365. k 31 / 35
35 The Birthday Problem Example II.8 Suppose there is group of k (2 k 365) people. What is the probability that at least two people in a group share the same birthday (i.e. year of birth does not matter)? Ignore February 29 and assume that each of the 365 days of a year is equally likely to be the birthday of any person and that birthdays of the group members are unrelated (no twins). The table shows the probability p that at least two people in a group of k people will have the same birthday. k p Watch video 32 / 35
36 Sampling with replacement The birthday problem is an example of sampling with replacement. Sampling with replacement (stylised example) A box contains n balls numbered 1,..., n. First, one ball is selected at random from the box and its number noted. This ball is then put back in the box and another ball is selected. Thus, it is possible that the same ball is selected again. This process is called sampling with replacement. It is assumed that each of the n balls is equally likely to be selected at each stage and that the selections are independent of each other. Suppose we pick k balls. There are in total n k different outcomes. The probability assigned to each outcome is 1 /n k. 33 / 35
37 Sampling without replacement Example II.9 Suppose we have a box of 6 books and we randomly arrange the books on a shelf. What is the probability that, by chance, the books are ordered alphabetically? There are = 6! = 720 distinct ways of arranging 6 books, but only one order is alphapetically correct. Thus, p = 1 /720. More general: Permutations Suppose that k cards are to be selected and removed from a deck of n cards without replacement. Each possible distinct outcome is called a permutation. The total number of permutations is n! P n,k = n(n 1)... (n k + 1) = (n k)! where a! = a(a 1)(a 2)... 1 and 0! = / 35
38 Summary Frequentist approach: The probability of an outcome is the relative frequency with which that outcome would be obtained if the experiment were repeated a large number of times. Independence and disjointness are not the same! If two events A and B are mutually exclusive (or disjoint), then P(AB) = 0. If two events are independent, then the occurrence of A has no influence on the probability that B occurs, and vice versa. Bayes theorem provides a rule for computing the conditional probability of the event A given B from the conditional probability of B given A. It is the building block of Bayesian econometrics. 35 / 35
Events A and B are said to be independent if the occurrence of A does not affect the probability of B.
Independent Events Events A and B are said to be independent if the occurrence of A does not affect the probability of B. Probability experiment of flipping a coin and rolling a dice. Sample Space: {(H,
More informationWhat is Probability? Probability. Sample Spaces and Events. Simple Event
What is Probability? Probability Peter Lo Probability is the numerical measure of likelihood that the event will occur. Simple Event Joint Event Compound Event Lies between 0 & 1 Sum of events is 1 1.5
More informationProbabilistic models
Probabilistic models Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became
More informationCSC Discrete Math I, Spring Discrete Probability
CSC 125 - Discrete Math I, Spring 2017 Discrete Probability Probability of an Event Pierre-Simon Laplace s classical theory of probability: Definition of terms: An experiment is a procedure that yields
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationIntroduction Probability. Math 141. Introduction to Probability and Statistics. Albyn Jones
Math 141 to and Statistics Albyn Jones Mathematics Department Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 September 3, 2014 Motivation How likely is an eruption at Mount Rainier in
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationSTAT 430/510 Probability
STAT 430/510 Probability Hui Nie Lecture 3 May 28th, 2009 Review We have discussed counting techniques in Chapter 1. Introduce the concept of the probability of an event. Compute probabilities in certain
More informationSTAT509: Probability
University of South Carolina August 20, 2014 The Engineering Method and Statistical Thinking The general steps of engineering method are: 1. Develop a clear and concise description of the problem. 2. Identify
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationMathematics. ( : Focus on free Education) (Chapter 16) (Probability) (Class XI) Exercise 16.2
( : Focus on free Education) Exercise 16.2 Question 1: A die is rolled. Let E be the event die shows 4 and F be the event die shows even number. Are E and F mutually exclusive? Answer 1: When a die is
More informationCS 361: Probability & Statistics
September 12, 2017 CS 361: Probability & Statistics Correlation Summary of what we proved We wanted a way of predicting y from x We chose to think in standard coordinates and to use a linear predictor
More informationWith Question/Answer Animations. Chapter 7
With Question/Answer Animations Chapter 7 Chapter Summary Introduction to Discrete Probability Probability Theory Bayes Theorem Section 7.1 Section Summary Finite Probability Probabilities of Complements
More informationLECTURE NOTES by DR. J.S.V.R. KRISHNA PRASAD
.0 Introduction: The theory of probability has its origin in the games of chance related to gambling such as tossing of a coin, throwing of a die, drawing cards from a pack of cards etc. Jerame Cardon,
More informationProbability Theory and Applications
Probability Theory and Applications Videos of the topics covered in this manual are available at the following links: Lesson 4 Probability I http://faculty.citadel.edu/silver/ba205/online course/lesson
More informationProbability deals with modeling of random phenomena (phenomena or experiments whose outcomes may vary)
Chapter 14 From Randomness to Probability How to measure a likelihood of an event? How likely is it to answer correctly one out of two true-false questions on a quiz? Is it more, less, or equally likely
More informationProbability Pearson Education, Inc. Slide
Probability The study of probability is concerned with random phenomena. Even though we cannot be certain whether a given result will occur, we often can obtain a good measure of its likelihood, or probability.
More informationChapter 2 PROBABILITY SAMPLE SPACE
Chapter 2 PROBABILITY Key words: Sample space, sample point, tree diagram, events, complement, union and intersection of an event, mutually exclusive events; Counting techniques: multiplication rule, permutation,
More informationProbabilistic models
Kolmogorov (Andrei Nikolaevich, 1903 1987) put forward an axiomatic system for probability theory. Foundations of the Calculus of Probabilities, published in 1933, immediately became the definitive formulation
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationCS4705. Probability Review and Naïve Bayes. Slides from Dragomir Radev
CS4705 Probability Review and Naïve Bayes Slides from Dragomir Radev Classification using a Generative Approach Previously on NLP discriminative models P C D here is a line with all the social media posts
More informationCISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability. Outline. Terminology and background. Arthur G.
CISC 1100/1400 Structures of Comp. Sci./Discrete Structures Chapter 7 Probability Arthur G. Werschulz Fordham University Department of Computer and Information Sciences Copyright Arthur G. Werschulz, 2017.
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14
CS 70 Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 14 Introduction One of the key properties of coin flips is independence: if you flip a fair coin ten times and get ten
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationProbability the chance that an uncertain event will occur (always between 0 and 1)
Quantitative Methods 2013 1 Probability as a Numerical Measure of the Likelihood of Occurrence Probability the chance that an uncertain event will occur (always between 0 and 1) Increasing Likelihood of
More informationConsider an experiment that may have different outcomes. We are interested to know what is the probability of a particular set of outcomes.
CMSC 310 Artificial Intelligence Probabilistic Reasoning and Bayesian Belief Networks Probabilities, Random Variables, Probability Distribution, Conditional Probability, Joint Distributions, Bayes Theorem
More informationProbability Year 9. Terminology
Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationUncertainty. Russell & Norvig Chapter 13.
Uncertainty Russell & Norvig Chapter 13 http://toonut.com/wp-content/uploads/2011/12/69wp.jpg Uncertainty Let A t be the action of leaving for the airport t minutes before your flight Will A t get you
More informationProbability Pr(A) 0, for any event A. 2. Pr(S) = 1, for the sample space S. 3. If A and B are mutually exclusive, Pr(A or B) = Pr(A) + Pr(B).
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this
More informationFirst Digit Tally Marks Final Count
Benford Test () Imagine that you are a forensic accountant, presented with the two data sets on this sheet of paper (front and back). Which of the two sets should be investigated further? Why? () () ()
More informationCS 361: Probability & Statistics
February 12, 2018 CS 361: Probability & Statistics Random Variables Monty hall problem Recall the setup, there are 3 doors, behind two of them are indistinguishable goats, behind one is a car. You pick
More informationBusiness Statistics MBA Pokhara University
Business Statistics MBA Pokhara University Chapter 3 Basic Probability Concept and Application Bijay Lal Pradhan, Ph.D. Review I. What s in last lecture? Descriptive Statistics Numerical Measures. Chapter
More informationWhat is a random variable
OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Random Variables Fall 20 Yrd. Doç. Dr. Didem Kivanc Tureli didemk@ieee.org didem.kivanc@okan.edu.tr
More informationNotes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 15 Notes. Class URL:
Notes slides from before lecture CSE 21, Winter 2017, Section A00 Lecture 15 Notes Class URL: http://vlsicad.ucsd.edu/courses/cse21-w17/ Notes slides from before lecture Notes March 6 (1) This week: Days
More informationCHAPTER - 16 PROBABILITY Random Experiment : If an experiment has more than one possible out come and it is not possible to predict the outcome in advance then experiment is called random experiment. Sample
More informationProbability Year 10. Terminology
Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More information9/6/2016. Section 5.1 Probability. Equally Likely Model. The Division Rule: P(A)=#(A)/#(S) Some Popular Randomizers.
Chapter 5: Probability and Discrete Probability Distribution Learn. Probability Binomial Distribution Poisson Distribution Some Popular Randomizers Rolling dice Spinning a wheel Flipping a coin Drawing
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Probability assigns a likelihood to results of experiments that have not yet been conducted. Suppose that the experiment has
More informationTA Qinru Shi: Based on poll result, the first Programming Boot Camp will be: this Sunday 5 Feb, 7-8pm Gates 114.
TA Qinru Shi: Based on poll result, the first Programming Boot Camp will be: this Sunday 5 Feb, 7-8pm Gates 114. Prob Set 1: to be posted tomorrow. due in roughly a week Finite probability space S 1) a
More informationProbability. VCE Maths Methods - Unit 2 - Probability
Probability Probability Tree diagrams La ice diagrams Venn diagrams Karnough maps Probability tables Union & intersection rules Conditional probability Markov chains 1 Probability Probability is the mathematics
More information2. Conditional Probability
ENGG 2430 / ESTR 2004: Probability and Statistics Spring 2019 2. Conditional Probability Andrej Bogdanov Coins game Toss 3 coins. You win if at least two come out heads. S = { HHH, HHT, HTH, HTT, THH,
More informationWeek 2: Probability: Counting, Sets, and Bayes
Statistical Methods APPM 4570/5570, STAT 4000/5000 21 Probability Introduction to EDA Week 2: Probability: Counting, Sets, and Bayes Random variable Random variable is a measurable quantity whose outcome
More informationIntroduction to Probability 2017/18 Supplementary Problems
Introduction to Probability 2017/18 Supplementary Problems Problem 1: Let A and B denote two events with P(A B) 0. Show that P(A) 0 and P(B) 0. A A B implies P(A) P(A B) 0, hence P(A) 0. Similarly B A
More informationProbability and Probability Distributions. Dr. Mohammed Alahmed
Probability and Probability Distributions 1 Probability and Probability Distributions Usually we want to do more with data than just describing them! We might want to test certain specific inferences about
More informationLecture 3 - Axioms of Probability
Lecture 3 - Axioms of Probability Sta102 / BME102 January 25, 2016 Colin Rundel Axioms of Probability What does it mean to say that: The probability of flipping a coin and getting heads is 1/2? 3 What
More information324 Stat Lecture Notes (1) Probability
324 Stat Lecture Notes 1 robability Chapter 2 of the book pg 35-71 1 Definitions: Sample Space: Is the set of all possible outcomes of a statistical experiment, which is denoted by the symbol S Notes:
More informationLecture 16. Lectures 1-15 Review
18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability
More informationTopic 3: Introduction to Probability
Topic 3: Introduction to Probability 1 Contents 1. Introduction 2. Simple Definitions 3. Types of Probability 4. Theorems of Probability 5. Probabilities under conditions of statistically independent events
More informationProbability (10A) Young Won Lim 6/12/17
Probability (10A) Copyright (c) 2017 Young W. Lim. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later
More informationP (A B) P ((B C) A) P (B A) = P (B A) + P (C A) P (A) = P (B A) + P (C A) = Q(A) + Q(B).
Lectures 7-8 jacques@ucsdedu 41 Conditional Probability Let (Ω, F, P ) be a probability space Suppose that we have prior information which leads us to conclude that an event A F occurs Based on this information,
More informationMATH1231 Algebra, 2017 Chapter 9: Probability and Statistics
MATH1231 Algebra, 2017 Chapter 9: Probability and Statistics A/Prof. Daniel Chan School of Mathematics and Statistics University of New South Wales danielc@unsw.edu.au Daniel Chan (UNSW) MATH1231 Algebra
More informationChapter 14. From Randomness to Probability. Copyright 2012, 2008, 2005 Pearson Education, Inc.
Chapter 14 From Randomness to Probability Copyright 2012, 2008, 2005 Pearson Education, Inc. Dealing with Random Phenomena A random phenomenon is a situation in which we know what outcomes could happen,
More informationChapter 2. Conditional Probability and Independence. 2.1 Conditional Probability
Chapter 2 Conditional Probability and Independence 2.1 Conditional Probability Example: Two dice are tossed. What is the probability that the sum is 8? This is an easy exercise: we have a sample space
More informationMean, Median and Mode. Lecture 3 - Axioms of Probability. Where do they come from? Graphically. We start with a set of 21 numbers, Sta102 / BME102
Mean, Median and Mode Lecture 3 - Axioms of Probability Sta102 / BME102 Colin Rundel September 1, 2014 We start with a set of 21 numbers, ## [1] -2.2-1.6-1.0-0.5-0.4-0.3-0.2 0.1 0.1 0.2 0.4 ## [12] 0.4
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationDiscrete Random Variable
Discrete Random Variable Outcome of a random experiment need not to be a number. We are generally interested in some measurement or numerical attribute of the outcome, rather than the outcome itself. n
More informationtossing a coin selecting a card from a deck measuring the commuting time on a particular morning
2 Probability Experiment An experiment or random variable is any activity whose outcome is unknown or random upfront: tossing a coin selecting a card from a deck measuring the commuting time on a particular
More informationn How to represent uncertainty in knowledge? n Which action to choose under uncertainty? q Assume the car does not have a flat tire
Uncertainty Uncertainty Russell & Norvig Chapter 13 Let A t be the action of leaving for the airport t minutes before your flight Will A t get you there on time? A purely logical approach either 1. risks
More informationBayes Rule for probability
Bayes Rule for probability P A B P A P B A PAP B A P AP B A An generalization of Bayes Rule Let A, A 2,, A k denote a set of events such that S A A2 Ak and Ai Aj for all i and j. Then P A i B P Ai P B
More informationDiscrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10
EECS 70 Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 10 Introduction to Basic Discrete Probability In the last note we considered the probabilistic experiment where we flipped
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More informationCS206 Review Sheet 3 October 24, 2018
CS206 Review Sheet 3 October 24, 2018 After ourintense focusoncounting, wecontinue withthestudyofsomemoreofthebasic notions from Probability (though counting will remain in our thoughts). An important
More informationLower bound for sorting/probability Distributions
Lower bound for sorting/probability Distributions CSE21 Winter 2017, Day 20 (B00), Day 14 (A00) March 3, 2017 http://vlsicad.ucsd.edu/courses/cse21-w17 Another application of counting lower bounds Sorting
More informationEE 178 Lecture Notes 0 Course Introduction. About EE178. About Probability. Course Goals. Course Topics. Lecture Notes EE 178
EE 178 Lecture Notes 0 Course Introduction About EE178 About Probability Course Goals Course Topics Lecture Notes EE 178: Course Introduction Page 0 1 EE 178 EE 178 provides an introduction to probabilistic
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Lecture 2 Probability Copyright 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 3-1 3.1 Definition Random Experiment a process leading to an uncertain
More informationPart (A): Review of Probability [Statistics I revision]
Part (A): Review of Probability [Statistics I revision] 1 Definition of Probability 1.1 Experiment An experiment is any procedure whose outcome is uncertain ffl toss a coin ffl throw a die ffl buy a lottery
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationChapter 2. Probability
2-1 Chapter 2 Probability 2-2 Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance with certainty. Examples: rolling a die tossing
More informationChapter 7: Section 7-1 Probability Theory and Counting Principles
Chapter 7: Section 7-1 Probability Theory and Counting Principles D. S. Malik Creighton University, Omaha, NE D. S. Malik Creighton University, Omaha, NE Chapter () 7: Section 7-1 Probability Theory and
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationChapter 13, Probability from Applied Finite Mathematics by Rupinder Sekhon was developed by OpenStax College, licensed by Rice University, and is
Chapter 13, Probability from Applied Finite Mathematics by Rupinder Sekhon was developed by OpenStax College, licensed by Rice University, and is available on the Connexions website. It is used under a
More informationChapter 2.5 Random Variables and Probability The Modern View (cont.)
Chapter 2.5 Random Variables and Probability The Modern View (cont.) I. Statistical Independence A crucially important idea in probability and statistics is the concept of statistical independence. Suppose
More informationProbability Distributions. Conditional Probability.
Probability Distributions. Conditional Probability. CSE21 Winter 2017, Day 21 (B00), Day 14 (A00) March 6, 2017 http://vlsicad.ucsd.edu/courses/cse21-w17 Probability Rosen p. 446, 453 Sample space, S:
More informationConditional Probability and Bayes Theorem (2.4) Independence (2.5)
Conditional Probability and Bayes Theorem (2.4) Independence (2.5) Prof. Tesler Math 186 Winter 2019 Prof. Tesler Conditional Probability and Bayes Theorem Math 186 / Winter 2019 1 / 38 Scenario: Flip
More informationPROBABILITY CHAPTER LEARNING OBJECTIVES UNIT OVERVIEW
CHAPTER 16 PROBABILITY LEARNING OBJECTIVES Concept of probability is used in accounting and finance to understand the likelihood of occurrence or non-occurrence of a variable. It helps in developing financial
More informationELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 1 Experiments, Models, and Probabilities Dr. Jing Yang jingyang@uark.edu OUTLINE 2 Applications
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions
Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions 1999 Prentice-Hall, Inc. Chap. 4-1 Chapter Topics Basic Probability Concepts: Sample
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationNotes slides from before lecture. CSE 21, Winter 2017, Section A00. Lecture 16 Notes. Class URL:
Notes slides from before lecture CSE 21, Winter 2017, Section A00 Lecture 16 Notes Class URL: http://vlsicad.ucsd.edu/courses/cse21-w17/ Notes slides from before lecture Notes March 8 (1) This week: Days
More information2.6 Tools for Counting sample points
2.6 Tools for Counting sample points When the number of simple events in S is too large, manual enumeration of every sample point in S is tedious or even impossible. (Example) If S contains N equiprobable
More informationWhy should you care?? Intellectual curiosity. Gambling. Mathematically the same as the ESP decision problem we discussed in Week 4.
I. Probability basics (Sections 4.1 and 4.2) Flip a fair (probability of HEADS is 1/2) coin ten times. What is the probability of getting exactly 5 HEADS? What is the probability of getting exactly 10
More informationConditional Probability
Conditional Probability Conditional Probability The Law of Total Probability Let A 1, A 2,..., A k be mutually exclusive and exhaustive events. Then for any other event B, P(B) = P(B A 1 ) P(A 1 ) + P(B
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER / Probability
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER 2 2017/2018 DR. ANTHONY BROWN 5.1. Introduction to Probability. 5. Probability You are probably familiar with the elementary
More informationLecture 3. January 7, () Lecture 3 January 7, / 35
Lecture 3 January 7, 2013 () Lecture 3 January 7, 2013 1 / 35 Outline This week s lecture: Fast review of last week s lecture: Conditional probability. Partition, Partition theorem. Bayes theorem and its
More informationProbability. Introduction to Biostatistics
Introduction to Biostatistics Probability Second Semester 2014/2015 Text Book: Basic Concepts and Methodology for the Health Sciences By Wayne W. Daniel, 10 th edition Dr. Sireen Alkhaldi, BDS, MPH, DrPH
More informationDiscrete Probability
Discrete Probability Counting Permutations Combinations r- Combinations r- Combinations with repetition Allowed Pascal s Formula Binomial Theorem Conditional Probability Baye s Formula Independent Events
More informationORF 245 Fundamentals of Statistics Chapter 5 Probability
ORF 245 Fundamentals of Statistics Chapter 5 Probability Robert Vanderbei Oct 2015 Slides last edited on October 14, 2015 http://www.princeton.edu/ rvdb Sample Spaces (aka Populations) and Events When
More informationConditional probability
CHAPTER 4 Conditional probability 4.1. Introduction Suppose there are 200 men, of which 100 are smokers, and 100 women, of which 20 are smokers. What is the probability that a person chosen at random will
More informationSTAT Chapter 3: Probability
Basic Definitions STAT 515 --- Chapter 3: Probability Experiment: A process which leads to a single outcome (called a sample point) that cannot be predicted with certainty. Sample Space (of an experiment):
More informationUNIT 5 ~ Probability: What Are the Chances? 1
UNIT 5 ~ Probability: What Are the Chances? 1 6.1: Simulation Simulation: The of chance behavior, based on a that accurately reflects the phenomenon under consideration. (ex 1) Suppose we are interested
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More information2.4 Conditional Probability
2.4 Conditional Probability The probabilities assigned to various events depend on what is known about the experimental situation when the assignment is made. Example: Suppose a pair of dice is tossed.
More informationChance, too, which seems to rush along with slack reins, is bridled and governed by law (Boethius, ).
Chapter 2 Probability Chance, too, which seems to rush along with slack reins, is bridled and governed by law (Boethius, 480-524). Blaise Pascal (1623-1662) Pierre de Fermat (1601-1665) Abraham de Moivre
More information