Sociology 6Z03 Topic 10: Probability (Part I)
|
|
- Blaise Clarke
- 5 years ago
- Views:
Transcription
1 Sociology 6Z03 Topic 10: Probability (Part I) John Fox McMaster University Fall 2014 John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Outline: Probability (Part I) Introduction Probability Basics John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
2 Introduction Probability Theory Probability theory is the area of mathematics that deals with random phenomena. Individual random events are intrinsically unpredictable, but repeated random events are orderly and patterned. It is the purpose of probability theory to describe these patterns literally to bring order to chaos. Much of modern mathematics for example, calculus, algebra, and geometry is of ancient origin, but probability theory did not exist before the European Renaissance (specifically, the 17th century the late Renaissance or early Enlightenment). One use of probability theory is to provide a foundation for statistical inference. Statistical inference is the process of drawing conclusions about characteristics of a population based on a sample drawn at random from the population. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Probability Basics Experiment, Outcomes, Sample Space, Realization In probability theory: an experiment is a repeatable procedure for making an observation; an outcome is a possible observation resulting from an experiment; and the sample space of the experiment is the set of all possible outcomes. Any specific realization of the experiment produces a particular outcome in the sample space. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
3 Probability Basics Finite and Continuous Sample Spaces Sample spaces may be discrete or continuous. If, for example, we flip a coin twice and record on each flip whether the coin shows heads (H) or tails (T ), then the sample space of the experiment is discrete and finite, consisting of the outcomes S = {HH, HT, TH, TT } If, in contrast, we burn a light bulb until it fails, recording the failure time in hours and fractions of an hour, then the sample space of the experiment is continuous and consists of all positive real numbers (not bothering to specify an upper limit for the life of a bulb): S = {x : x > 0}. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Probability Basics Sample Spaces Thought Question Suppose that we flip a coin only once and observe whether the coin comes up H or T. What is the sample space of this experiment? A S = {HH, TT }. B S = {HH, HT, TH, TT }. C S = {H, T }. D S = {HT }. E I don t know. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
4 Probability Basics Events An event is a subset of the sample space of an experiment that is, a set of outcomes. An event is said to occur in a realization of the experiment if one of its constituent outcomes occurs. For example, for S = {HH, HT, TH, TT }, the event E = {HH, HT }, representing a head on the first flip of the coin, occurs if we obtain either the outcome HH or the outcome HT. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Probability Basics Axioms of Probability Probabilities are numbers assigned to events in a manner consistent with the following axioms (rules, as given by Moore): P1: The probability of an event E is a number between 0 and 1: 0 P(E ) 1. P2: The sample space S is exhaustive some outcome must occur: P(S) = 1. P3: Two events A and B are disjoint if they have no outcomes in common; disjoint events cannot occur simultaneously. The probability of occurrence of one or the other of two disjoint events is the sum of their separate probabilities of occurrence: For A and B disjoint, P(A or B) = P(A) + P(B). P4: The probability that an event E does not occur is the complement of its probability of occurrence: P(not E ) = 1 P(E ). John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
5 Probability Basics Interpretation of Probability Probabilities can be interpreted as long-run proportions. For example, to say that the probability of an event is.5 means that the event will occur approximately half the time if the experiment is repeated a very large number of times, with the approximation tending to improve as the number of repetitions of the experiment increases. This interpretation provides a way to estimate probabilities: Repeat the experiment many times and observe the proportion of times that the event occurs. This objective interpretation of probability is the basis of the classical approach to statistical inference. There are subjective or personal approaches to probability as well, where a probability is interpreted as strength of belief that an event will occur or that a proposition is true. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Probability Basics Axioms of Probability, Probability Models The fourth axiom, P4, is not really needed: It can be deduced from the others. (Can you see how?) Consider the event E = {o a, o b,..., o m } where the o i s are outcomes that is elements of the sample space S. Then, by the third axiom, the probability of E is the sum of probabilities of its constituent outcomes, P(E ) = P(o a ) + P(o b ) + + P(o m ). Thus, if we know the probabilities of all of the outcomes in the sample space, we can figure out the probability of any event. A probability model for an experiment consists of the sample space for the experiment and an assignment of probabilities to events in a manner consistent with the axioms. The axioms are not so restrictive as to imply a unique assignment of probabilities to a sample space. There are always infinitely many probability models for an experiment. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
6 Probability Basics Probability Models: Examples Suppose, for example, that all outcomes in the sample space S = {HH, HT, TH, TT } are equally likely, so that P(HH) = P(HT ) = P(TH) = P(TT ) =.25 This corresponds to a fair coin flipped in a fair manner. Then, for E = {HH, HT } ( a head on the first flip ), the probability of E is P(E ) = =.5. Let A = {TH, TT } be the event a tail on the first flip, and B = {HH} the event two heads. The events A and B are disjoint, and the event A or B is {TH, TT, HH}; thus, P(A or B) =.75 = P(A) + P(B) = John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Probability Basics Probability Models: Examples Thought Question Continuing with the preceding example, with S = {HH, HT, TH, TT } and equally likely outcomes, as before let A = {TH, TT } be the event a tail on the first flip. Now let C be the event a tail on the second flip. What outcomes are in C? A C = {TH, TT }. B C = {HT, TT }. C C = {TT }. D C = {HH, TH}. E I don t know. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
7 Probability Basics Probability Models: Examples Thought Question Are the events A = {TH, TT } ( a tail on the first flip ) and C = {HT, TT } ( a tail on the second flip ) disjoint? A Yes. B No. C I don t know. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Probability Basics Probability Models: Examples Equally likely outcomes produce a simple example but any assignment of probabilities to outcomes that sums to 1 is consistent with the axioms. For example, a coin that is weighted to produce 2/3 heads yields the following probabilities for two independent flips: P(HH) = 4/9, P(HT ) = P(TH) = 2/9, P(TT ) = 1/9 John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
8 Probability Basics Probability Models: Examples Thought Question With this assignment of probabilities to outcomes, P(HH) = 4/9, P(HT ) = P(TH) = 2/9, P(TT ) = 1/9 what is the probability of the event E = {HH, HT }? A 6/9 = 2/3. B 4/9. C 2/4 = 1/2. D 8/9. E I don t know. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 A random variable is a rule that assigns a number to each outcome in the sample space of an experiment. For example, the following random variable X counts the number of heads in each outcome of the coin-flipping experiment: outcome value x of X HH 2 HT 1 TH 1 TT 0 It is sometimes useful to distinguish between the random variable X (denoted by an upper-case letter) and a particular value of the random variable x (denoted by a lower-case letter). John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
9 Probability Distributions The probability distribution of a discrete random variable lists all possible values x i of the variable and shows the probability p i of observing each. For example, for the coin-flipping experiment with equally likely outcomes, the probability distribution of the number of heads X is x i p i = P(X = x i ) TT = 0.25 HT, TH = 1.50 HH = 2.25 sum 1.00 Notice that although the outcomes in the original sample space of the experiment are equally likely, the values of the random variable X are not equally likely. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Probability Distributions In general, a discrete, finite random variable has a number of possible values, x 1, x 2,..., x k, with probabilities p 1, p 2,..., p k. Following from the axioms of probability theory, each probability p i is a number between 0 and 1, and the sum of all probabilities is p 1 + p p k = 1. We can find the probability of particular events that refer to the random variable by summing the probabilities for the values that make up the event. For example, the probability of getting at least one head is P(X 1) = P(X = 1) + P(X = 2) = =.75. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
10 Probability Distributions The probability distribution of a discrete random variable can be graphed as follows: Probability, p i Number of Heads, x i John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Probability Distributions Thought Question Continuing with the sample space S = {HH, HT, TH, TT }, define the random variable Y = 1 when both flips are the same (i.e., HH or TT ) and Y = 0 when they are different (i.e., HT or TH). If the four outcomes are equally likely, each with probability 1/4 = 0.25, is the following probability distribution for Y correct? y i p i = P(Y = y i ) sum 1.0 A Yes. B No. C I don t know. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
11 Mean of a Random Variable The mean µ of the random X, also called the expectation or expected value of X, is defined in the following manner: µ = x 1 p 1 + x 2 p x k p k = x i p i It is conventional to use Greek letters like µ to represent numerical summaries of probability distributions. The expected value of X is also written as E (X ). For our example: x i p i x i p i sum 1.00 µ = 1.00 John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Mean of a Random Variable The mean of X gives the average value of the random variable in the following senses: The mean µ is the average of the possible values of X, each weighted by its probability of occurrence. If you think of probabilities as weights arranged along a bar, the mean µ is the point at which the bar balances: µ Number of Heads, x i If we repeat the experiment many times and calculate the value of X for each realization, then the average of these values of X is approximately µ, with the approximation tending to get better as the number of repetitions increases. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
12 Mean of a Random Variable Thought Question Recall the random variable Y = 1 when both flips in the coin-flipping experiment are the same and Y = 0 when they are different. With equally likely outcomes, Y has the probability distribution What is the mean of Y? A 0. B 1. C 0.5. y i p i = P(Y = y i ) sum 1.0 John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Variance and Standard Deviation of a Random Variable The variance σ 2 of X measures how spread out the distribution of X is around its mean µ: σ 2 = (x 1 µ) 2 p 1 + (x 2 µ) 2 p (x k µ) 2 p k = (x i µ) 2 p i The variance of X is also written as V (X ) or Var(X ). The standard deviation σ of X is just the square root of the variance (and restores the units of the variable). Continuing the example (where µ = 1), x p i x i µ (x i µ) 2 p i sum 1.00 σ 2 = 0.50 σ = 0.50 = heads John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
13 Variance and Standard Deviation of a Random Variable Thought Question Recall the random variable Y with probability distribution y i p i = P(Y = y i ) sum 1.0 and mean µ = 0.5. What are the variance and standard deviation of Y? A σ 2 = 1 and σ = 1. B σ 2 = 0.25 and σ = 0.5. C σ 2 = 0.5 and σ = D I don t know. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Mean, Variance and Standard Deviation The formulas for µ, σ 2, and σ are very similar to the formulas for the mean x, variance s 2, and standard deviation s of a variable in a data set: random variable variable in a data set mean µ = x i p i x = 1 n x i = x i 1 n s2 = 1 n 1 (x i x) 2 variance σ 2 = (x i µ) 2 p i standard deviation σ = σ 2 s = s 2 = (x i x) 2 1 n 1 John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
14 Continuous Random variables defined on continuous sample spaces may themselves be continuous. The probability distribution of a continuous random variable X is described by a density curve, p(x). It is meaningless to talk of the probability of observing specific, individual values of a continuous random variable, but areas under the density curve give the probability of observing specific ranges of values of the random variable. John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29 Continuous A continuous random variable, like a discrete random variable, has a mean, variance, and standard deviation. The formulas for the mean and variance of a continuous random variable are very similar to the corresponding formulas for a discrete random variable (substituting integrals for sums): µ = σ 2 = all x all x xp(x)dx (x µ) 2 p(x)dx (If you are unfamiliar with calculus, integrals are the continuous analogs of sums but don t worry about these formulas.) John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
15 Continuous Any density curve gives the distribution of a continuous random variable. A particularly important family of random variables is the family of normal distributions, which is already familiar. Recall that a normal distribution is uniquely specified by its mean µ and standard deviation σ. An example, for the standard normal distribution, Z N(0, 1): p(z) P(0 < Z < 2) = Z 4 John Fox (McMaster University) Soc 6Z03: Probability I Fall / 29
Basic Probability. Introduction
Basic Probability Introduction The world is an uncertain place. Making predictions about something as seemingly mundane as tomorrow s weather, for example, is actually quite a difficult task. Even with
More informationChapter 2: Probability Part 1
Engineering Probability & Statistics (AGE 1150) Chapter 2: Probability Part 1 Dr. O. Phillips Agboola Sample Space (S) Experiment: is some procedure (or process) that we do and it results in an outcome.
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationStatistical Inference
Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory
More informationSection 13.3 Probability
288 Section 13.3 Probability Probability is a measure of how likely an event will occur. When the weather forecaster says that there will be a 50% chance of rain this afternoon, the probability that it
More informationChapter 1 (Basic Probability)
Chapter 1 (Basic Probability) What is probability? Consider the following experiments: 1. Count the number of arrival requests to a web server in a day. 2. Determine the execution time of a program. 3.
More information2011 Pearson Education, Inc
Statistics for Business and Economics Chapter 3 Probability Contents 1. Events, Sample Spaces, and Probability 2. Unions and Intersections 3. Complementary Events 4. The Additive Rule and Mutually Exclusive
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER / Probability
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER 2 2017/2018 DR. ANTHONY BROWN 5.1. Introduction to Probability. 5. Probability You are probably familiar with the elementary
More informationLecture 1 : The Mathematical Theory of Probability
Lecture 1 : The Mathematical Theory of Probability 0/ 30 1. Introduction Today we will do 2.1 and 2.2. We will skip Chapter 1. We all have an intuitive notion of probability. Let s see. What is the probability
More informationUNIT Explain about the partition of a sampling space theorem?
UNIT -1 1. Explain about the partition of a sampling space theorem? PARTITIONS OF A SAMPLE SPACE The events B1, B2. B K represent a partition of the sample space 'S" if (a) So, when the experiment E is
More informationSociology 6Z03 Review II
Sociology 6Z03 Review II John Fox McMaster University Fall 2016 John Fox (McMaster University) Sociology 6Z03 Review II Fall 2016 1 / 35 Outline: Review II Probability Part I Sampling Distributions Probability
More informationAxioms of Probability
Sample Space (denoted by S) The set of all possible outcomes of a random experiment is called the Sample Space of the experiment, and is denoted by S. Example 1.10 If the experiment consists of tossing
More informationBusiness Statistics. Lecture 3: Random Variables and the Normal Distribution
Business Statistics Lecture 3: Random Variables and the Normal Distribution 1 Goals for this Lecture A little bit of probability Random variables The normal distribution 2 Probability vs. Statistics Probability:
More informationCHAPTER - 16 PROBABILITY Random Experiment : If an experiment has more than one possible out come and it is not possible to predict the outcome in advance then experiment is called random experiment. Sample
More informationChapter Learning Objectives. Random Experiments Dfiii Definition: Dfiii Definition:
Chapter 2: Probability 2-1 Sample Spaces & Events 2-1.1 Random Experiments 2-1.2 Sample Spaces 2-1.3 Events 2-1 1.4 Counting Techniques 2-2 Interpretations & Axioms of Probability 2-3 Addition Rules 2-4
More informationn N CHAPTER 1 Atoms Thermodynamics Molecules Statistical Thermodynamics (S.T.)
CHAPTER 1 Atoms Thermodynamics Molecules Statistical Thermodynamics (S.T.) S.T. is the key to understanding driving forces. e.g., determines if a process proceeds spontaneously. Let s start with entropy
More informationSTA111 - Lecture 1 Welcome to STA111! 1 What is the difference between Probability and Statistics?
STA111 - Lecture 1 Welcome to STA111! Some basic information: Instructor: Víctor Peña (email: vp58@duke.edu) Course Website: http://stat.duke.edu/~vp58/sta111. 1 What is the difference between Probability
More informationModule 1. Probability
Module 1 Probability 1. Introduction In our daily life we come across many processes whose nature cannot be predicted in advance. Such processes are referred to as random processes. The only way to derive
More informationSTT When trying to evaluate the likelihood of random events we are using following wording.
Introduction to Chapter 2. Probability. When trying to evaluate the likelihood of random events we are using following wording. Provide your own corresponding examples. Subjective probability. An individual
More informationEssentials of Statistics and Probability
May 22, 2007 Department of Statistics, NC State University dbsharma@ncsu.edu SAMSI Undergrad Workshop Overview Practical Statistical Thinking Introduction Data and Distributions Variables and Distributions
More informationNotes on Mathematics Groups
EPGY Singapore Quantum Mechanics: 2007 Notes on Mathematics Groups A group, G, is defined is a set of elements G and a binary operation on G; one of the elements of G has particularly special properties
More informationLecture 3 Probability Basics
Lecture 3 Probability Basics Thais Paiva STA 111 - Summer 2013 Term II July 3, 2013 Lecture Plan 1 Definitions of probability 2 Rules of probability 3 Conditional probability What is Probability? Probability
More informationNotes 1 Autumn Sample space, events. S is the number of elements in the set S.)
MAS 108 Probability I Notes 1 Autumn 2005 Sample space, events The general setting is: We perform an experiment which can have a number of different outcomes. The sample space is the set of all possible
More informationProbability Theory and Simulation Methods
Feb 28th, 2018 Lecture 10: Random variables Countdown to midterm (March 21st): 28 days Week 1 Chapter 1: Axioms of probability Week 2 Chapter 3: Conditional probability and independence Week 4 Chapters
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More informationChap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of
Chap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of repetitions. (p229) That is, probability is a long-term
More informationChapter 2.5 Random Variables and Probability The Modern View (cont.)
Chapter 2.5 Random Variables and Probability The Modern View (cont.) I. Statistical Independence A crucially important idea in probability and statistics is the concept of statistical independence. Suppose
More informationLecture 1. ABC of Probability
Math 408 - Mathematical Statistics Lecture 1. ABC of Probability January 16, 2013 Konstantin Zuev (USC) Math 408, Lecture 1 January 16, 2013 1 / 9 Agenda Sample Spaces Realizations, Events Axioms of Probability
More informationNotes Week 2 Chapter 3 Probability WEEK 2 page 1
Notes Week 2 Chapter 3 Probability WEEK 2 page 1 The sample space of an experiment, sometimes denoted S or in probability theory, is the set that consists of all possible elementary outcomes of that experiment
More informationNotes 6 Autumn Example (One die: part 1) One fair six-sided die is thrown. X is the number showing.
MAS 08 Probability I Notes Autumn 005 Random variables A probability space is a sample space S together with a probability function P which satisfies Kolmogorov s aioms. The Holy Roman Empire was, in the
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More informationProbability Year 9. Terminology
Probability Year 9 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationOutline. 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks
Outline 1. Define likelihood 2. Interpretations of likelihoods 3. Likelihood plots 4. Maximum likelihood 5. Likelihood ratio benchmarks Likelihood A common and fruitful approach to statistics is to assume
More informationProblems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman.
Math 224 Fall 2017 Homework 1 Drew Armstrong Problems from Probability and Statistical Inference (9th ed.) by Hogg, Tanis and Zimmerman. Section 1.1, Exercises 4,5,6,7,9,12. Solutions to Book Problems.
More informationMutually Exclusive Events
172 CHAPTER 3 PROBABILITY TOPICS c. QS, 7D, 6D, KS Mutually Exclusive Events A and B are mutually exclusive events if they cannot occur at the same time. This means that A and B do not share any outcomes
More informationP A = h n. Probability definitions, axioms and theorems. Classical approach to probability. Examples of classical probability definition
Probability definitions, axioms and theorems CEE 3030 A LECTURE PREPARED BY Classical approach to probability Sample space S is known Let n = number of total outcomes in sample space Let h = number of
More informationI - Probability. What is Probability? the chance of an event occuring. 1classical probability. 2empirical probability. 3subjective probability
What is Probability? the chance of an event occuring eg 1classical probability 2empirical probability 3subjective probability Section 2 - Probability (1) Probability - Terminology random (probability)
More informationData Modeling & Analysis Techniques. Probability & Statistics. Manfred Huber
Data Modeling & Analysis Techniques Probability & Statistics Manfred Huber 2017 1 Probability and Statistics Probability and statistics are often used interchangeably but are different, related fields
More informationLecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya
BBM 205 Discrete Mathematics Hacettepe University http://web.cs.hacettepe.edu.tr/ bbm205 Lecture 4: Probability, Proof Techniques, Method of Induction Lecturer: Lale Özkahya Resources: Kenneth Rosen, Discrete
More informationProbability Year 10. Terminology
Probability Year 10 Terminology Probability measures the chance something happens. Formally, we say it measures how likely is the outcome of an event. We write P(result) as a shorthand. An event is some
More informationLecture 6. Probability events. Definition 1. The sample space, S, of a. probability experiment is the collection of all
Lecture 6 1 Lecture 6 Probability events Definition 1. The sample space, S, of a probability experiment is the collection of all possible outcomes of an experiment. One such outcome is called a simple
More informationMATH Solutions to Probability Exercises
MATH 5 9 MATH 5 9 Problem. Suppose we flip a fair coin once and observe either T for tails or H for heads. Let X denote the random variable that equals when we observe tails and equals when we observe
More informationExecutive Assessment. Executive Assessment Math Review. Section 1.0, Arithmetic, includes the following topics:
Executive Assessment Math Review Although the following provides a review of some of the mathematical concepts of arithmetic and algebra, it is not intended to be a textbook. You should use this chapter
More informationSTAT:5100 (22S:193) Statistical Inference I
STAT:5100 (22S:193) Statistical Inference I Week 3 Luke Tierney University of Iowa Fall 2015 Luke Tierney (U Iowa) STAT:5100 (22S:193) Statistical Inference I Fall 2015 1 Recap Matching problem Generalized
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationProbability theory basics
Probability theory basics Michael Franke Basics of probability theory: axiomatic definition, interpretation, joint distributions, marginalization, conditional probability & Bayes rule. Random variables:
More informationProbability. Lecture Notes. Adolfo J. Rumbos
Probability Lecture Notes Adolfo J. Rumbos October 20, 204 2 Contents Introduction 5. An example from statistical inference................ 5 2 Probability Spaces 9 2. Sample Spaces and σ fields.....................
More informationTopic 3: Introduction to Probability
Topic 3: Introduction to Probability 1 Contents 1. Introduction 2. Simple Definitions 3. Types of Probability 4. Theorems of Probability 5. Probabilities under conditions of statistically independent events
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationCHAPTER 5 Probability: What Are the Chances?
CHAPTER 5 Probability: What Are the Chances? 5.3 Conditional Probability and Independence The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers Conditional
More informationThe probability of an event is viewed as a numerical measure of the chance that the event will occur.
Chapter 5 This chapter introduces probability to quantify randomness. Section 5.1: How Can Probability Quantify Randomness? The probability of an event is viewed as a numerical measure of the chance that
More informationBasic Statistics and Probability Chapter 3: Probability
Basic Statistics and Probability Chapter 3: Probability Events, Sample Spaces and Probability Unions and Intersections Complementary Events Additive Rule. Mutually Exclusive Events Conditional Probability
More informationDiscrete Probability and State Estimation
6.01, Fall Semester, 2007 Lecture 12 Notes 1 MASSACHVSETTS INSTITVTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.01 Introduction to EECS I Fall Semester, 2007 Lecture 12 Notes
More informationIntroduction to Stochastic Processes
Stat251/551 (Spring 2017) Stochastic Processes Lecture: 1 Introduction to Stochastic Processes Lecturer: Sahand Negahban Scribe: Sahand Negahban 1 Organization Issues We will use canvas as the course webpage.
More informationWhat is a random variable
OKAN UNIVERSITY FACULTY OF ENGINEERING AND ARCHITECTURE MATH 256 Probability and Random Processes 04 Random Variables Fall 20 Yrd. Doç. Dr. Didem Kivanc Tureli didemk@ieee.org didem.kivanc@okan.edu.tr
More informationWeek 2: Probability: Counting, Sets, and Bayes
Statistical Methods APPM 4570/5570, STAT 4000/5000 21 Probability Introduction to EDA Week 2: Probability: Counting, Sets, and Bayes Random variable Random variable is a measurable quantity whose outcome
More informationProbability 5-4 The Multiplication Rules and Conditional Probability
Outline Lecture 8 5-1 Introduction 5-2 Sample Spaces and 5-3 The Addition Rules for 5-4 The Multiplication Rules and Conditional 5-11 Introduction 5-11 Introduction as a general concept can be defined
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Introduction to Probability and Statistics Lecture 2: Conditional probability Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin www.cs.cmu.edu/ psarkar/teaching
More informationIf the objects are replaced there are n choices each time yielding n r ways. n C r and in the textbook by g(n, r).
Caveat: Not proof read. Corrections appreciated. Combinatorics In the following, n, n 1, r, etc. will denote non-negative integers. Rule 1 The number of ways of ordering n distinguishable objects (also
More informationProbability and Sample space
Probability and Sample space We call a phenomenon random if individual outcomes are uncertain but there is a regular distribution of outcomes in a large number of repetitions. The probability of any outcome
More informationRecap. The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY INFERENTIAL STATISTICS
Recap. Probability (section 1.1) The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY Population Sample INFERENTIAL STATISTICS Today. Formulation
More informationDiscrete Distributions
Discrete Distributions STA 281 Fall 2011 1 Introduction Previously we defined a random variable to be an experiment with numerical outcomes. Often different random variables are related in that they have
More informationChapter 2 Classical Probability Theories
Chapter 2 Classical Probability Theories In principle, those who are not interested in mathematical foundations of probability theory might jump directly to Part II. One should just know that, besides
More informationLet us think of the situation as having a 50 sided fair die; any one number is equally likely to appear.
Probability_Homework Answers. Let the sample space consist of the integers through. {, 2, 3,, }. Consider the following events from that Sample Space. Event A: {a number is a multiple of 5 5, 0, 5,, }
More informationStatistics 251: Statistical Methods
Statistics 251: Statistical Methods Probability Module 3 2018 file:///volumes/users/r/renaes/documents/classes/lectures/251301/renae/markdown/master%20versions/module3.html#1 1/33 Terminology probability:
More informationIntroduction to Probability and Statistics Slides 3 Chapter 3
Introduction to Probability and Statistics Slides 3 Chapter 3 Ammar M. Sarhan, asarhan@mathstat.dal.ca Department of Mathematics and Statistics, Dalhousie University Fall Semester 2008 Dr. Ammar M. Sarhan
More informationProbability: Why do we care? Lecture 2: Probability and Distributions. Classical Definition. What is Probability?
Probability: Why do we care? Lecture 2: Probability and Distributions Sandy Eckel seckel@jhsph.edu 22 April 2008 Probability helps us by: Allowing us to translate scientific questions into mathematical
More informationProbability (Devore Chapter Two)
Probability (Devore Chapter Two) 1016-345-01: Probability and Statistics for Engineers Fall 2012 Contents 0 Administrata 2 0.1 Outline....................................... 3 1 Axiomatic Probability 3
More informationOrigins of Probability Theory
1 16.584: INTRODUCTION Theory and Tools of Probability required to analyze and design systems subject to uncertain outcomes/unpredictability/randomness. Such systems more generally referred to as Experiments.
More informationthe time it takes until a radioactive substance undergoes a decay
1 Probabilities 1.1 Experiments with randomness Wewillusethetermexperimentinaverygeneralwaytorefertosomeprocess that produces a random outcome. Examples: (Ask class for some first) Here are some discrete
More informationIndependence. P(A) = P(B) = 3 6 = 1 2, and P(C) = 4 6 = 2 3.
Example: A fair die is tossed and we want to guess the outcome. The outcomes will be 1, 2, 3, 4, 5, 6 with equal probability 1 6 each. If we are interested in getting the following results: A = {1, 3,
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions
Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions 1999 Prentice-Hall, Inc. Chap. 4-1 Chapter Topics Basic Probability Concepts: Sample
More informationCS 361: Probability & Statistics
February 26, 2018 CS 361: Probability & Statistics Random variables The discrete uniform distribution If every value of a discrete random variable has the same probability, then its distribution is called
More informationChapter 14. From Randomness to Probability. Copyright 2012, 2008, 2005 Pearson Education, Inc.
Chapter 14 From Randomness to Probability Copyright 2012, 2008, 2005 Pearson Education, Inc. Dealing with Random Phenomena A random phenomenon is a situation in which we know what outcomes could happen,
More information1.1 Review of Probability Theory
1.1 Review of Probability Theory Angela Peace Biomathemtics II MATH 5355 Spring 2017 Lecture notes follow: Allen, Linda JS. An introduction to stochastic processes with applications to biology. CRC Press,
More informationBASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES
BASICS OF PROBABILITY CHAPTER-1 CS6015-LINEAR ALGEBRA AND RANDOM PROCESSES COMMON TERMS RELATED TO PROBABILITY Probability is the measure of the likelihood that an event will occur Probability values are
More informationLecture 2: Probability and Distributions
Lecture 2: Probability and Distributions Ani Manichaikul amanicha@jhsph.edu 17 April 2007 1 / 65 Probability: Why do we care? Probability helps us by: Allowing us to translate scientific questions info
More informationLecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability
Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic
More informationSTAT200 Elementary Statistics for applications
STAT200 Elementary Statistics for applications Lecture # 12 Dr. Ruben Zamar Winter 2011 / 2012 http://www4.agr.gc.ca/aafc-aac/display-afficher.do?id=1256763623482 Randomness Randomness is unpredictable
More informationDept. of Linguistics, Indiana University Fall 2015
L645 Dept. of Linguistics, Indiana University Fall 2015 1 / 34 To start out the course, we need to know something about statistics and This is only an introduction; for a fuller understanding, you would
More informationCOS 424: Interacting with Data. Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008
COS 424: Interacting with Data Lecturer: Dave Blei Lecture #2 Scribe: Ellen Kim February 7, 2008 1 Probability Review 1.1 Random Variables A random variable can be used to model any probabilistic outcome.
More informationTOPIC 12 PROBABILITY SCHEMATIC DIAGRAM
TOPIC 12 PROBABILITY SCHEMATIC DIAGRAM Topic Concepts Degree of Importance References NCERT Book Vol. II Probability (i) Conditional Probability *** Article 1.2 and 1.2.1 Solved Examples 1 to 6 Q. Nos
More informationTOPIC 12: RANDOM VARIABLES AND THEIR DISTRIBUTIONS
TOPIC : RANDOM VARIABLES AND THEIR DISTRIBUTIONS In the last section we compared the length of the longest run in the data for various players to our expectations for the longest run in data generated
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationCME 106: Review Probability theory
: Probability theory Sven Schmit April 3, 2015 1 Overview In the first half of the course, we covered topics from probability theory. The difference between statistics and probability theory is the following:
More informationAnnouncements. Lecture 5: Probability. Dangling threads from last week: Mean vs. median. Dangling threads from last week: Sampling bias
Recap Announcements Lecture 5: Statistics 101 Mine Çetinkaya-Rundel September 13, 2011 HW1 due TA hours Thursday - Sunday 4pm - 9pm at Old Chem 211A If you added the class last week please make sure to
More informationLecture 16. Lectures 1-15 Review
18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability
More informationCMPT 882 Machine Learning
CMPT 882 Machine Learning Lecture Notes Instructor: Dr. Oliver Schulte Scribe: Qidan Cheng and Yan Long Mar. 9, 2004 and Mar. 11, 2004-1 - Basic Definitions and Facts from Statistics 1. The Binomial Distribution
More informationMATH MW Elementary Probability Course Notes Part I: Models and Counting
MATH 2030 3.00MW Elementary Probability Course Notes Part I: Models and Counting Tom Salisbury salt@yorku.ca York University Winter 2010 Introduction [Jan 5] Probability: the mathematics used for Statistics
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More information4/17/2012. NE ( ) # of ways an event can happen NS ( ) # of events in the sample space
I. Vocabulary: A. Outcomes: the things that can happen in a probability experiment B. Sample Space (S): all possible outcomes C. Event (E): one outcome D. Probability of an Event (P(E)): the likelihood
More informationIntroduction to probability
Introduction to probability 4.1 The Basics of Probability Probability The chance that a particular event will occur The probability value will be in the range 0 to 1 Experiment A process that produces
More informationChapter 2 Class Notes
Chapter 2 Class Notes Probability can be thought of in many ways, for example as a relative frequency of a long series of trials (e.g. flips of a coin or die) Another approach is to let an expert (such
More informationLecture 6: The Pigeonhole Principle and Probability Spaces
Lecture 6: The Pigeonhole Principle and Probability Spaces Anup Rao January 17, 2018 We discuss the pigeonhole principle and probability spaces. Pigeonhole Principle The pigeonhole principle is an extremely
More informationSome Basic Concepts of Probability and Information Theory: Pt. 1
Some Basic Concepts of Probability and Information Theory: Pt. 1 PHYS 476Q - Southern Illinois University January 18, 2018 PHYS 476Q - Southern Illinois University Some Basic Concepts of Probability and
More informationProbability COMP 245 STATISTICS. Dr N A Heard. 1 Sample Spaces and Events Sample Spaces Events Combinations of Events...
Probability COMP 245 STATISTICS Dr N A Heard Contents Sample Spaces and Events. Sample Spaces........................................2 Events........................................... 2.3 Combinations
More informationSample Spaces, Random Variables
Sample Spaces, Random Variables Moulinath Banerjee University of Michigan August 3, 22 Probabilities In talking about probabilities, the fundamental object is Ω, the sample space. (elements) in Ω are denoted
More information