Advanced Herd Management Probabilities and distributions
|
|
- Francis Young
- 5 years ago
- Views:
Transcription
1 Advanced Herd Management Probabilities and distributions Anders Ringgaard Kristensen Slide 1
2 Outline Probabilities Conditional probabilities Bayes theorem Distributions Discrete Continuous Distribution functions Sampling from distributions Estimation Hypotheses Confidence intervals Slide 2
3 Probabilities: Basic concepts The probability concept is used in daily language. What do we mean when we say: The probability of the outcome 5 when rolling a dice is 1/6? The probability that cow no. 543 is pregnant is 0.40? The probability that USA will attack North Korea within 5 years is 0.05? Slide 3
4 Interpretations of probabilities At least 3 different interpretations are observed: A frequentist interpretation: The probability expresses how frequent we will observe a given outcome if exactly the same experiment is repeated a large number of times. The value is rather objective. An objective belief interpretation: The probability expresses our belief in a certain (unobservable) state or event. The belief may be based on an underlying frequentist interpretation of similar cases and thus be rather objective. A subjective belief interpretation: The probability expresses our belief in a certain unobservable (or not yet observed) event. Slide 4
5 Experiments An experiment may be anything creating an outcome we can observe. The sample space, S, is the set of all possible outcomes. An event, A, is a subset of S, i.e. A S Two events A 1 and A 2 are called disjoint, if they have no common outcomes, i.e. if A 1 A 2 = Slide 5
6 Example of experiment Rolling a dice: The sample space is S = {1, 2, 3, 4, 5, 6} Examples of events: A 1 = {1} A 2 = {1, 5} A 3 = {4, 5, 6} Since A 1 A 3 =, A 1 and A 3 are disjoint. A 1 and A 2 are not disjoint, because A 1 A 2 = {1} Slide 6
7 A simplified definition Let S be the sample space of an experiment. A probability distribution P on S is a function, so that P(S) = 1. For any event A S, 0 P(A) 1 For any two disjoint events A 1 and A 2, P(A 1 A 2 ) = P(A 1 ) + P(A 2 ) Slide 7
8 Example: Rolling a dice Like before: S = {1, 2, 3, 4, 5, 6} A valid probability function on S is, for A S: P(A) = A /6 where A is the size of A (i.e. the number of elements it contains) P({1}) = P({2}) = P({3}) = P({4}) = P({5}) = P({6}) = 1/6 P({1, 5}) = 2/6 = 1/3 P({1, 2, 3}) = 3/6 = 1/2 Notice, that many other valid probability functions could be defined (even though the one above is the only one that makes sense from a frequentist point of view). Slide 8
9 Independence If two events A and B are independent, then P(A B) = P(A)P(B). Example: Rolling two dices S = {(1, 1), (1, 2),, (1, 6),, (6, 6)} For any A S: P(A) = A /36 A = {(6, 1), (6, 2),, (6, 6)} P(A) = 6/36 = 1/6 B = {(1, 6), (2, 6),, (6, 6)} P(B) = 6/36 = 1/6 A B = {(6, 6)} and P(A B) = (1/6)(1/6) = 1/36 Slide 9
10 Conditional probabilities Let A and B be two events, where P(B) > 0 The conditional probability of A given B is written as P(A B), and it is by definition Slide 10
11 Example: Rolling a dice Again, let S = {1, 2, 3, 4, 5, 6}, and P(A) = A /6. Define B = {1, 2, 3}, and A = {2}. Then A B = {2}, and The logical result: If you know the outcome is 1, 2 or 3, it is reasonable to assume that all 3 values are equally probable. Slide 11
12 Conditional sum rule Let A 1, A 2, A n be pair wise disjoint events so that Let B be an event so that P(B) > 0. Then Slide 12
13 Sum rule: Dice example Define the 3 disjoint events A 1 = {1, 2}, A 2 = {3, 4}, A 3 = {5, 6} Thus A 1 A 2 A 3 = S Define B = {1, 3, 5} (we know that P(B) = ½) P(B A 1 ) = P(B A 1 )/P(A 1 ) = (1/6)/(1/3) = ½ P(B A 2 ) = P(B A 2 )/P(A 2 ) = (1/6)/(1/3) = ½ P(B A 3 ) = P(B A 3 )/P(A 3 ) = (1/6)/(1/3) = ½ Thus Slide 13
14 Bayes theorem Let A 1, A 2, A n be pair wise disjoint events so that Let B be an event so that P(B) > 0. Then Bayes theorem is extremely important in all kinds of reasoning under uncertainty. Updating of belief. Slide 14
15 Updating of belief, I In a dairy herd, the conception rate is known to be Define M as the event mating for a cow. Define Π + as the event pregnant for the same cow, and Π - as the event not pregnant. Thus P(Π + M) = 0.40 is a conditional probability. Given that the cow has been mated, the probability of pregnancy is Correspondingly, P(Π - M) = 0.60 After 3 weeks the farmer observes the cow for heat. The farmer s heat detection rate is Define H + as the event that the farmer detects heat. Thus, P(H + Π - ) = 0.55, and P(H - Π - ) = 0.45 There is a slight risk that the farmer erroneously observes a pregnant cow to be in heat. We assume, that P(H + Π + ) = 0.01 Notice, that all probabilities are figures that makes sense and are estimated on a routine basis (except P(H + Π + ) which is a guess) Slide 15
16 Updating of belief, II Now, let us assume that the farmer observes the cow, and concludes, that it is not in heat. Thus, we have observed the event H - and we would like to know the probability, that the cow is pregnant, i.e. we wish to calculate P(Π + H - ) We apply Bayes theorem: We know all probabilities in the formula, and get In other words, our belief in the event pregnant increases from 0.40 to 0.59 based on a negative heat observation result Slide 16
17 Summary of probabilities Probabilities may be interpreted As frequencies As objective or subjective beliefs in certain events The belief interpretation enables us to represent uncertain knowledge in a concise way. Bayes theorem lets us update our belief (knowledge) as new observations are done. Slide 17
18 Discrete distributions In some cases the probability is defined by a certain function defined over the sample space. In those cases, we say that the outcome is drawn from a standard distribution. There exist standard distributions for many natural phenomena. If the sample space is a countable set, we denote the corresponding distribution as discrete. Slide 18
19 Discrete distributions If X is the random variable representing the outcome, the expected value of a discrete distribution is defined as The variance is defined as We shall look at two important discrete distributions: The binomial distribution The Poisson distribution. Slide 19
20 The binomial distribution I Consider an experiment with binary outcomes: Success (s) or failure (f) Mating of a sow Pregnant (s), not pregnant (f) Tossing a coin Heads (s), tails (f) Testing for a disease Present (s), not present (f) Assume that the probability of success is p and that the experiment is repeated n times. Let X be the total number of successes observed in the n experiments. The sample space of the compound n experiments is S = {0, 1, 2,, n} The random variable X is then said to be binomially distributed with parameters p and n. Slide 20
21 The binomial distribution II The probability function P(X = k) is (by objective frequentist interpretation) given by where is the binomial coefficient which may be calculated or looked up in a table. Slide 21
22 The binomial distribution III The mean (expected value) of a binomial distribution is simply E(X) = np. The variance is Var(X) = np(1-p) The binomial distribution is one of the most frequently used distribution for natural phenomena. Slide 22
23 The binomial distribution IV Three binomial distributions with n = 10 P(k ) 0,35 0,3 0,25 0,2 0,15 0,1 0, k 0,2 0,5 0,8 Three binomial distributions, where n = 10, and p = 0.2, 0.5 and 0.8, respectively. Slide 23
24 The Poisson distribution I If a certain phenomenon occurs a random with a constant intensity (but independently of each others) the total number of occurrences X in a time interval of a given length (or in a space of a given area) is Poisson distributed with parameter λ Examples: Number of (non-infectious) disease cases per month Number of feeding system failures per year Number of labor incidents per year Slide 24
25 The Poisson distribution II The sample space for Y is S = {0, 1, 2, } The probability function P(X = k) is (by objective frequentist interpretation) given by The expected value is E(X) = λ The variance is Var(X) = λ The Poisson distribution may be used as an approximation for a binomial distribution with small p and large n Slide 25
26 The Poisson distribution III Three poisson distributions P(k ) 0,3 0,25 0,2 0,15 0,1 0, k Three Poisson distributions with λ = 2, 6 and 12, respectively. Slide 26
27 Continuous distributions In some cases, the sample space S of a distribution is not countable. If, furthermore, S is an interval on R, the random variable X taking values in S is said to have a continuous distribution. For any x S, we have P(X = x) = 0. Thus, no probability function exists for a continuous distribution. Instead, the distribution is defined by a density function f(x). Slide 27
28 Density functions The density function f has the following properties (for a, b R and a b) Thus, for a continuous distribution, f can only be interpreted as a probability when integrated over an interval. Slide 28
29 Continuous distributions For a continuous distribution, the expected value E(X) is defined as And the variance is (just like the discrete case) We shall here look at 3 important distributions: The uniform distribution The normal distribution The exponential distributions Slide 29
30 The uniform distribution If S = [a; b], and the random variable X has a uniform distribution on S, then the density function is The expected value and the variance are Uniform f(x) 1 0,8 0,6 0,4 0,2 Slide ,5 1 1,5 2 x
31 The normal distribution I If S = R, and the random variable X has a normal distribution on S, then the density function is The expected value and the variance simply turn out to be E(X) = µ, and Var(X) = σ 2 We say that X is N(µ, σ 2 ), or X N(µ, σ 2 ) Slide 31
32 The normal distribution II The normal distribution may be used to represent almost all kinds of random outcome on the continuous scale in the real world. Exceptions are phenomena that are bounded in some sense (e.g. the waiting time to be served in a queue cannot be negative) It can be showed (central limit theorems) that if X 1, X 2,, X n are random variables of (more or less) any kind, then the sum Y n = X 1 + X X n is normally distributed for n sufficiently large. The normal distribution is the cornerstone among statistical distributions. Slide 32
33 Normal distributions III Three normal distributions 0,5 f(x ) 0,4 0,3 0,2 0, x m=0, s=3 m=-5, s=1 m=0, s=1 Three normal distributions with mean m and standard deviation s Slide 33
34 Normal distributions IV The normal distribution with µ = 0, and σ = 1 is called the standard normal distribution. A random variable being standard normally distributed is often denoted as Z The density function of the standard normal distribution is often denoted as φ. It follows that Slide 34
35 Normal distributions V Let X 1 N(µ 1, σ 1 2), X 2 N(µ 2, σ 2 2), and X 1 and X 2 are independent. Define Y 1 = X 1 + X 2 and Y 1 = X 1 X 2. Then Y 1 N(µ 1 + µ 2, σ σ 2 2) Y 2 N(µ 1 µ 2, σ σ 2 2) Let a and b be arbitrary real numbers, and let X N(µ, σ2). Define Y =ax + b. Then, Y N(aµ + b, a 2 σ 2 ) Slide 35
36 Normal distributions VI From the previous slide it follows in particular, that if X N(µ, σ2), then So, if f is the density function of X N(µ, σ2), then Thus, we can calculate the value of any density function for a normal distribution from the density distribution of the Slide standard 36 normal distribution.
37 Exponential distribution I If S = R + = ]0; [, and the random variable X has an exponential distribution on S, then the density function is The expected value and the variance are E(X) = λ -1, and Var(X) = λ -2 We say that X is exponentially distributed with parameter λ. Slide 37
38 Exponential distribution II The exponential distribution is in many ways the complimentary to the Poisson distribution. If something happens at random at constant intensity, the number of events within a fixed time interval is Poisson distributed, and the waiting time between two events is exponentially distributed. Less frequently used in herd management. Slide 38
39 Exponential distribution III Three exponential distributions 1 f(x x ) 0,8 0,6 0,4 0,2 1 0,5 0, x Three exponential distributions with mean 1, 2 and 5, respectively. Slide 39
40 Distribution functions I The distributions presented have all been defined by their probability functions (discrete distributions) and density functions (continuous distributions). We might just as well have used the distribution function F, which is defined in the same way for both classes of distributions: F(x) = P(X x) Slide 40
41 Distribution functions II Even though the definition is the same, the value of the distribution function is calculated in different ways for the two classes of distributions. For discrete distributions For continuous distributions Slide 41
42 Distribution functions III It follows directly, that for a continuous distribution, F (x) = f(x) The distribution function of the standard normal distribution is often denoted as Φ, and naturally Φ (z) = φ(z). No closed form (formula) exists for Φ, it must be looked up in tables. For discrete distributions, the distribution function most often doesn t have a closed form, so it must be looked up in tables. Slide 42
43 Distribution functions IV Any distribution function F has the following two properties: F(x) 0 for x - F(x) 1 for x Slide 43
44 Distribution function, Binomial Three binomial distributions with n = 10 Three binomial distributions with n = 10 0,35 1,2 P (k ) 0,3 0,25 0,2 0,15 0,1 0, ,2 0,5 0,8 P(k ) 1 0,8 0,6 0,4 0, ,2 0,5 0,8 k k Probability functions to the left, distribution functions to the right. Slide 44
45 Distribution function, Poisson Three poisson distributions Probability function P(k ) 0,3 0,25 0,2 0,15 0,1 0, k P(k ) 1,2 1 0,8 0,6 0,4 0,2 0 Slide 45 Three poisson distributions k Distribution function
46 Distribution function, uniform Uniform Uniform f(x) 1 0,8 0,6 0,4 0, ,5 1 1,5 2 x f(x) 1 0,8 0,6 0,4 0, ,5 1 1,5 2 x Density function to the left Distribution function to the right Slide 46
47 Distribution function, normal Three normal distributions Three normal distributions 0,5 1 f(x ) 0,4 0,3 0,2 0,1 m=0, s=3 m=-5, s=1 m=0, s=1 f(x ) 0,8 0,6 0,4 0,2 m=0, s=3 m=-5, s=1 m=0, s= x x Density function to the left Distribution function to the right Slide 47
48 Distribution function, exponential Three exponential distributions Three exponential distributions 1 1 f(x ) 0,8 0,6 0,4 0,2 1 0,5 0,2 f(x ) 0,8 0,6 0,4 0,2 1 0,5 0, x x Density function to the left Distribution function to the right Slide 48
49 Sampling from a distribution Assume that X 1, X 2,, X n are sampled independently from the same distribution having the known expectation µ and the known standard deviation σ Then the mean of the sample has the expected value µ and the standard deviation In particular, if the X i s are N(µ, σ 2 ) then the sample mean is N(µ, σ 2 /n) Slide 49
50 Sampling from a normal distribution Assume that X 1, X 2,, X n are sampled independently from the same normal distribution N(µ, σ 2 ) where µ is unknown and σ is known. For some reason we expect (hope) that µ has a certain value µ 0, and we would therefore like to test the following hypothesis: H 0 : µ = µ 0 How can we do that? Well, we know that the sample mean is N(µ, σ 2 /n) Slide 50
51 Hypothesis testing, normal dist. I A normal distribution with standard deviation 3 A normal distribution with standard deviation 3 0,2 1 0,8 f(x) 0,1 m=0, s=3 f(x) 0,6 0,4 m=0, s=3 0, x x Observations close to the mean are far more likely than distant observations. From the distribution function we can calculate the likelihood that an observation falls within the interval µ ± σ The likelihood that an observation falls within the interval µ ± 2σ Rule of thumb: 2/3 of the observations falls within ±σ and 95% within ±2σ Slide 51
52 Hypothesis testing, normal dist. II We can test our hypothesis H 0 for instance by calculating a confidence interval for the mean. A 95% confidence interval for the sample mean (distributed as N(µ, σ 2 /n)) under H 0 is calculated as If the sample mean is included in the interval, we accept H 0, otherwise we reject. If neither µ nor σ are known, the sample mean becomes student-t distributed (with n-1 degrees of freedom) instead. Then the confidence interval becomes wider as consequence of the uncertainty on σ. For large n the student-t distribution converges towards a standard normal Slide distribution. 52
53 Hypothesis testing, binomial Assume that we have observed the outcome of X successes out of n in a binomial trial. We would like to test the hypothesis: H 0 : p = p 0 Under H 0, the expected number of successes is E 0 (X) = np 0 and the variance is Var 0 = np 0 (1-p 0 ) How likely is it that the observed value of X is drawn from a binomial distribution with parameters p 0 and n? Basically two approaches may be used: Approximate with the normal distribution N(np 0,Var 0 ). This is a reasonable approach if n is big. Remember that n now has a different meaning! We have only one observation from the distribution Use the distribution function of the binomial distribution Slide 53 directly. Only valid approach for small n.
54 Other distributions Used as hyper distributions for parameters of other distributions in order to represent uncertainty: The Gamma distribution (hyper distribution for the mean and variance of a poisson) The Beta distribution (hyper distribution for the p parameter of a binomial distribution) Will be discussed briefly under advanced topics. Distributions for statistical tests: The χ 2 distribution. The student-t distribution The F distribution Those distributions will not be discussed very much in this course. Many other distributions are described in literature Slide 54
55 What distribution can I use to represent: Litter size in sheep? Litter size in sows? Number of cows/sows conceiving after first service. Time to first estrus? Milk yield of dairy cows? Daily gain of slaughter pigs? Slide 55
Advanced topics from statistics
Advanced topics from statistics Anders Ringgaard Kristensen Advanced Herd Management Slide 1 Outline Covariance and correlation Random vectors and multivariate distributions The multinomial distribution
More informationDepartment of Large Animal Sciences. Outline. Slide 2. Department of Large Animal Sciences. Slide 4. Department of Large Animal Sciences
Outline Advanced topics from statistics Anders Ringgaard Kristensen Covariance and correlation Random vectors and multivariate distributions The multinomial distribution The multivariate normal distribution
More informationProbability and Probability Distributions. Dr. Mohammed Alahmed
Probability and Probability Distributions 1 Probability and Probability Distributions Usually we want to do more with data than just describing them! We might want to test certain specific inferences about
More informationCounting principles, including permutations and combinations.
1 Counting principles, including permutations and combinations. The binomial theorem: expansion of a + b n, n ε N. THE PRODUCT RULE If there are m different ways of performing an operation and for each
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More informationCSE 312 Final Review: Section AA
CSE 312 TAs December 8, 2011 General Information General Information Comprehensive Midterm General Information Comprehensive Midterm Heavily weighted toward material after the midterm Pre-Midterm Material
More informationGEOMETRIC -discrete A discrete random variable R counts number of times needed before an event occurs
STATISTICS 4 Summary Notes. Geometric and Exponential Distributions GEOMETRIC -discrete A discrete random variable R counts number of times needed before an event occurs P(X = x) = ( p) x p x =,, 3,...
More informationEstimating the accuracy of a hypothesis Setting. Assume a binary classification setting
Estimating the accuracy of a hypothesis Setting Assume a binary classification setting Assume input/output pairs (x, y) are sampled from an unknown probability distribution D = p(x, y) Train a binary classifier
More informationLecture 16. Lectures 1-15 Review
18.440: Lecture 16 Lectures 1-15 Review Scott Sheffield MIT 1 Outline Counting tricks and basic principles of probability Discrete random variables 2 Outline Counting tricks and basic principles of probability
More information3rd IIA-Penn State Astrostatistics School July, 2010 Vainu Bappu Observatory, Kavalur
3rd IIA-Penn State Astrostatistics School 19 27 July, 2010 Vainu Bappu Observatory, Kavalur Laws of Probability, Bayes theorem, and the Central Limit Theorem Bhamidi V Rao Indian Statistical Institute,
More informationConfidence Intervals for Normal Data Spring 2014
Confidence Intervals for Normal Data 18.05 Spring 2014 Agenda Today Review of critical values and quantiles. Computing z, t, χ 2 confidence intervals for normal data. Conceptual view of confidence intervals.
More information18.05 Practice Final Exam
No calculators. 18.05 Practice Final Exam Number of problems 16 concept questions, 16 problems. Simplifying expressions Unless asked to explicitly, you don t need to simplify complicated expressions. For
More informationAn introduction to biostatistics: part 1
An introduction to biostatistics: part 1 Cavan Reilly September 6, 2017 Table of contents Introduction to data analysis Uncertainty Probability Conditional probability Random variables Discrete random
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More information18.05 Final Exam. Good luck! Name. No calculators. Number of problems 16 concept questions, 16 problems, 21 pages
Name No calculators. 18.05 Final Exam Number of problems 16 concept questions, 16 problems, 21 pages Extra paper If you need more space we will provide some blank paper. Indicate clearly that your solution
More information4th IIA-Penn State Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur
4th IIA-Penn State Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur Laws of Probability, Bayes theorem, and the Central Limit Theorem Rahul Roy Indian Statistical Institute, Delhi. Adapted
More information(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)
3 Probability Distributions (Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3) Probability Distribution Functions Probability distribution function (pdf): Function for mapping random variables to real numbers. Discrete
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More information7 Random samples and sampling distributions
7 Random samples and sampling distributions 7.1 Introduction - random samples We will use the term experiment in a very general way to refer to some process, procedure or natural phenomena that produces
More informationSingle Maths B: Introduction to Probability
Single Maths B: Introduction to Probability Overview Lecturer Email Office Homework Webpage Dr Jonathan Cumming j.a.cumming@durham.ac.uk CM233 None! http://maths.dur.ac.uk/stats/people/jac/singleb/ 1 Introduction
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationLecture 4: Random Variables and Distributions
Lecture 4: Random Variables and Distributions Goals Random Variables Overview of discrete and continuous distributions important in genetics/genomics Working with distributions in R Random Variables A
More informationExample 1. The sample space of an experiment where we flip a pair of coins is denoted by:
Chapter 8 Probability 8. Preliminaries Definition (Sample Space). A Sample Space, Ω, is the set of all possible outcomes of an experiment. Such a sample space is considered discrete if Ω has finite cardinality.
More informationAMS7: WEEK 2. CLASS 2
AMS7: WEEK 2. CLASS 2 Introduction to Probability. Probability Rules. Independence and Conditional Probability. Bayes Theorem. Risk and Odds Ratio Friday April 10, 2015 Probability: Introduction Probability:
More information15 Discrete Distributions
Lecture Note 6 Special Distributions (Discrete and Continuous) MIT 4.30 Spring 006 Herman Bennett 5 Discrete Distributions We have already seen the binomial distribution and the uniform distribution. 5.
More information1 INFO Sep 05
Events A 1,...A n are said to be mutually independent if for all subsets S {1,..., n}, p( i S A i ) = p(a i ). (For example, flip a coin N times, then the events {A i = i th flip is heads} are mutually
More informationTopic 2: Probability & Distributions. Road Map Probability & Distributions. ECO220Y5Y: Quantitative Methods in Economics. Dr.
Topic 2: Probability & Distributions ECO220Y5Y: Quantitative Methods in Economics Dr. Nick Zammit University of Toronto Department of Economics Room KN3272 n.zammit utoronto.ca November 21, 2017 Dr. Nick
More informationProbability Dr. Manjula Gunarathna 1
Probability Dr. Manjula Gunarathna Probability Dr. Manjula Gunarathna 1 Introduction Probability theory was originated from gambling theory Probability Dr. Manjula Gunarathna 2 History of Probability Galileo
More informationECE 313 Probability with Engineering Applications Fall 2000
Exponential random variables Exponential random variables arise in studies of waiting times, service times, etc X is called an exponential random variable with parameter λ if its pdf is given by f(u) =
More informationThe t-distribution. Patrick Breheny. October 13. z tests The χ 2 -distribution The t-distribution Summary
Patrick Breheny October 13 Patrick Breheny Biostatistical Methods I (BIOS 5710) 1/25 Introduction Introduction What s wrong with z-tests? So far we ve (thoroughly!) discussed how to carry out hypothesis
More informationProbability Theory and Random Variables
Probability Theory and Random Variables One of the most noticeable aspects of many computer science related phenomena is the lack of certainty. When a job is submitted to a batch oriented computer system,
More informationExam 2 Practice Questions, 18.05, Spring 2014
Exam 2 Practice Questions, 18.05, Spring 2014 Note: This is a set of practice problems for exam 2. The actual exam will be much shorter. Within each section we ve arranged the problems roughly in order
More informationPart IA Probability. Definitions. Based on lectures by R. Weber Notes taken by Dexter Chua. Lent 2015
Part IA Probability Definitions Based on lectures by R. Weber Notes taken by Dexter Chua Lent 2015 These notes are not endorsed by the lecturers, and I have modified them (often significantly) after lectures.
More informationSampling Distributions of Statistics Corresponds to Chapter 5 of Tamhane and Dunlop
Sampling Distributions of Statistics Corresponds to Chapter 5 of Tamhane and Dunlop Slides prepared by Elizabeth Newton (MIT), with some slides by Jacqueline Telford (Johns Hopkins University) 1 Sampling
More informationRandom Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More informationProbability theory basics
Probability theory basics Michael Franke Basics of probability theory: axiomatic definition, interpretation, joint distributions, marginalization, conditional probability & Bayes rule. Random variables:
More informationFundamentals. CS 281A: Statistical Learning Theory. Yangqing Jia. August, Based on tutorial slides by Lester Mackey and Ariel Kleiner
Fundamentals CS 281A: Statistical Learning Theory Yangqing Jia Based on tutorial slides by Lester Mackey and Ariel Kleiner August, 2011 Outline 1 Probability 2 Statistics 3 Linear Algebra 4 Optimization
More informationEstimation of reliability parameters from Experimental data (Parte 2) Prof. Enrico Zio
Estimation of reliability parameters from Experimental data (Parte 2) This lecture Life test (t 1,t 2,...,t n ) Estimate θ of f T t θ For example: λ of f T (t)= λe - λt Classical approach (frequentist
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationLecture 10: Probability distributions TUESDAY, FEBRUARY 19, 2019
Lecture 10: Probability distributions DANIEL WELLER TUESDAY, FEBRUARY 19, 2019 Agenda What is probability? (again) Describing probabilities (distributions) Understanding probabilities (expectation) Partial
More informationEvaluating Hypotheses
Evaluating Hypotheses IEEE Expert, October 1996 1 Evaluating Hypotheses Sample error, true error Confidence intervals for observed hypothesis error Estimators Binomial distribution, Normal distribution,
More informationProbability: Why do we care? Lecture 2: Probability and Distributions. Classical Definition. What is Probability?
Probability: Why do we care? Lecture 2: Probability and Distributions Sandy Eckel seckel@jhsph.edu 22 April 2008 Probability helps us by: Allowing us to translate scientific questions into mathematical
More informationSTAT 4385 Topic 01: Introduction & Review
STAT 4385 Topic 01: Introduction & Review Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso xsu@utep.edu Spring, 2016 Outline Welcome What is Regression Analysis? Basics
More information5. Conditional Distributions
1 of 12 7/16/2009 5:36 AM Virtual Laboratories > 3. Distributions > 1 2 3 4 5 6 7 8 5. Conditional Distributions Basic Theory As usual, we start with a random experiment with probability measure P on an
More information(Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3)
3 Probability Distributions (Ch 3.4.1, 3.4.2, 4.1, 4.2, 4.3) Probability Distribution Functions Probability distribution function (pdf): Function for mapping random variables to real numbers. Discrete
More informationLecture 2: Repetition of probability theory and statistics
Algorithms for Uncertainty Quantification SS8, IN2345 Tobias Neckel Scientific Computing in Computer Science TUM Lecture 2: Repetition of probability theory and statistics Concept of Building Block: Prerequisites:
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER / Probability
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 2 MATH00040 SEMESTER 2 2017/2018 DR. ANTHONY BROWN 5.1. Introduction to Probability. 5. Probability You are probably familiar with the elementary
More informationMath 105 Course Outline
Math 105 Course Outline Week 9 Overview This week we give a very brief introduction to random variables and probability theory. Most observable phenomena have at least some element of randomness associated
More informationClass 26: review for final exam 18.05, Spring 2014
Probability Class 26: review for final eam 8.05, Spring 204 Counting Sets Inclusion-eclusion principle Rule of product (multiplication rule) Permutation and combinations Basics Outcome, sample space, event
More informationFourier and Stats / Astro Stats and Measurement : Stats Notes
Fourier and Stats / Astro Stats and Measurement : Stats Notes Andy Lawrence, University of Edinburgh Autumn 2013 1 Probabilities, distributions, and errors Laplace once said Probability theory is nothing
More informationExperimental Design and Statistics - AGA47A
Experimental Design and Statistics - AGA47A Czech University of Life Sciences in Prague Department of Genetics and Breeding Fall/Winter 2014/2015 Matúš Maciak (@ A 211) Office Hours: M 14:00 15:30 W 15:30
More informationProbability and Statistics Concepts
University of Central Florida Computer Science Division COT 5611 - Operating Systems. Spring 014 - dcm Probability and Statistics Concepts Random Variable: a rule that assigns a numerical value to each
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationStatistical Methods in Particle Physics
Statistical Methods in Particle Physics Lecture 3 October 29, 2012 Silvia Masciocchi, GSI Darmstadt s.masciocchi@gsi.de Winter Semester 2012 / 13 Outline Reminder: Probability density function Cumulative
More informationFrequentist Statistics and Hypothesis Testing Spring
Frequentist Statistics and Hypothesis Testing 18.05 Spring 2018 http://xkcd.com/539/ Agenda Introduction to the frequentist way of life. What is a statistic? NHST ingredients; rejection regions Simple
More informationMATH1231 Algebra, 2017 Chapter 9: Probability and Statistics
MATH1231 Algebra, 2017 Chapter 9: Probability and Statistics A/Prof. Daniel Chan School of Mathematics and Statistics University of New South Wales danielc@unsw.edu.au Daniel Chan (UNSW) MATH1231 Algebra
More informationRecitation 2: Probability
Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions
More informationS n = x + X 1 + X X n.
0 Lecture 0 0. Gambler Ruin Problem Let X be a payoff if a coin toss game such that P(X = ) = P(X = ) = /2. Suppose you start with x dollars and play the game n times. Let X,X 2,...,X n be payoffs in each
More informationThe Random Variable for Probabilities Chris Piech CS109, Stanford University
The Random Variable for Probabilities Chris Piech CS109, Stanford University Assignment Grades 10 20 30 40 50 60 70 80 90 100 10 20 30 40 50 60 70 80 90 100 Frequency Frequency 10 20 30 40 50 60 70 80
More informationSpecial distributions
Special distributions August 22, 2017 STAT 101 Class 4 Slide 1 Outline of Topics 1 Motivation 2 Bernoulli and binomial 3 Poisson 4 Uniform 5 Exponential 6 Normal STAT 101 Class 4 Slide 2 What distributions
More informationIntroduction to Bayesian Networks
Introduction to Bayesian Networks Anders Ringgaard Kristensen Slide 1 Outline Causal networks Bayesian Networks Evidence Conditional Independence and d-separation Compilation The moral graph The triangulated
More informationChapter 6 Continuous Probability Distributions
Math 3 Chapter 6 Continuous Probability Distributions The observations generated by different statistical experiments have the same general type of behavior. The followings are the probability distributions
More informationRandom Variables. Saravanan Vijayakumaran Department of Electrical Engineering Indian Institute of Technology Bombay
1 / 13 Random Variables Saravanan Vijayakumaran sarva@ee.iitb.ac.in Department of Electrical Engineering Indian Institute of Technology Bombay August 8, 2013 2 / 13 Random Variable Definition A real-valued
More informationConfidence Intervals for Normal Data Spring 2018
Confidence Intervals for Normal Data 18.05 Spring 2018 Agenda Exam on Monday April 30. Practice questions posted. Friday s class is for review (no studio) Today Review of critical values and quantiles.
More informationProbability Theory for Machine Learning. Chris Cremer September 2015
Probability Theory for Machine Learning Chris Cremer September 2015 Outline Motivation Probability Definitions and Rules Probability Distributions MLE for Gaussian Parameter Estimation MLE and Least Squares
More informationLecture 2: Probability and Distributions
Lecture 2: Probability and Distributions Ani Manichaikul amanicha@jhsph.edu 17 April 2007 1 / 65 Probability: Why do we care? Probability helps us by: Allowing us to translate scientific questions info
More informationTopic -2. Probability. Larson & Farber, Elementary Statistics: Picturing the World, 3e 1
Topic -2 Probability Larson & Farber, Elementary Statistics: Picturing the World, 3e 1 Probability Experiments Experiment : An experiment is an act that can be repeated under given condition. Rolling a
More informationFault-Tolerant Computer System Design ECE 60872/CS 590. Topic 2: Discrete Distributions
Fault-Tolerant Computer System Design ECE 60872/CS 590 Topic 2: Discrete Distributions Saurabh Bagchi ECE/CS Purdue University Outline Basic probability Conditional probability Independence of events Series-parallel
More informationRandom Variable. Discrete Random Variable. Continuous Random Variable. Discrete Random Variable. Discrete Probability Distribution
Random Variable Theoretical Probability Distribution Random Variable Discrete Probability Distributions A variable that assumes a numerical description for the outcome of a random eperiment (by chance).
More informationSTA1000F Summary. Mitch Myburgh MYBMIT001 May 28, Work Unit 1: Introducing Probability
STA1000F Summary Mitch Myburgh MYBMIT001 May 28, 2015 1 Module 1: Probability 1.1 Work Unit 1: Introducing Probability 1.1.1 Definitions 1. Random Experiment: A procedure whose outcome (result) in a particular
More informationIntroduction to Probability and Statistics Slides 3 Chapter 3
Introduction to Probability and Statistics Slides 3 Chapter 3 Ammar M. Sarhan, asarhan@mathstat.dal.ca Department of Mathematics and Statistics, Dalhousie University Fall Semester 2008 Dr. Ammar M. Sarhan
More informationSTA Module 4 Probability Concepts. Rev.F08 1
STA 2023 Module 4 Probability Concepts Rev.F08 1 Learning Objectives Upon completing this module, you should be able to: 1. Compute probabilities for experiments having equally likely outcomes. 2. Interpret
More informationProbability Theory and Simulation Methods
Feb 28th, 2018 Lecture 10: Random variables Countdown to midterm (March 21st): 28 days Week 1 Chapter 1: Axioms of probability Week 2 Chapter 3: Conditional probability and independence Week 4 Chapters
More informationCME 106: Review Probability theory
: Probability theory Sven Schmit April 3, 2015 1 Overview In the first half of the course, we covered topics from probability theory. The difference between statistics and probability theory is the following:
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationCS 630 Basic Probability and Information Theory. Tim Campbell
CS 630 Basic Probability and Information Theory Tim Campbell 21 January 2003 Probability Theory Probability Theory is the study of how best to predict outcomes of events. An experiment (or trial or event)
More informationAnnouncements. Topics: To Do:
Announcements Topics: In the Probability and Statistics module: - Sections 1 + 2: Introduction to Stochastic Models - Section 3: Basics of Probability Theory - Section 4: Conditional Probability; Law of
More informationRecap. The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY INFERENTIAL STATISTICS
Recap. Probability (section 1.1) The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY Population Sample INFERENTIAL STATISTICS Today. Formulation
More informationWeek 12-13: Discrete Probability
Week 12-13: Discrete Probability November 21, 2018 1 Probability Space There are many problems about chances or possibilities, called probability in mathematics. When we roll two dice there are possible
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions
Statistics for Managers Using Microsoft Excel/SPSS Chapter 4 Basic Probability And Discrete Probability Distributions 1999 Prentice-Hall, Inc. Chap. 4-1 Chapter Topics Basic Probability Concepts: Sample
More informationQUANTITATIVE TECHNIQUES
UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION (For B Com. IV Semester & BBA III Semester) COMPLEMENTARY COURSE QUANTITATIVE TECHNIQUES QUESTION BANK 1. The techniques which provide the decision maker
More informationINF FALL NATURAL LANGUAGE PROCESSING. Jan Tore Lønning
1 INF4080 2018 FALL NATURAL LANGUAGE PROCESSING Jan Tore Lønning 2 Probability distributions Lecture 5, 5 September Today 3 Recap: Bayes theorem Discrete random variable Probability distribution Discrete
More informationTopic 2 Probability. Basic probability Conditional probability and independence Bayes rule Basic reliability
Topic 2 Probability Basic probability Conditional probability and independence Bayes rule Basic reliability Random process: a process whose outcome can not be predicted with certainty Examples: rolling
More informationChapter 1: Revie of Calculus and Probability
Chapter 1: Revie of Calculus and Probability Refer to Text Book: Operations Research: Applications and Algorithms By Wayne L. Winston,Ch. 12 Operations Research: An Introduction By Hamdi Taha, Ch. 12 OR441-Dr.Khalid
More informationData Mining Techniques. Lecture 3: Probability
Data Mining Techniques CS 6220 - Section 3 - Fall 2016 Lecture 3: Probability Jan-Willem van de Meent (credit: Zhao, CS 229, Bishop) Project Vote 1. Freeform: Develop your own project proposals 30% of
More informationAlgorithms for Uncertainty Quantification
Algorithms for Uncertainty Quantification Tobias Neckel, Ionuț-Gabriel Farcaș Lehrstuhl Informatik V Summer Semester 2017 Lecture 2: Repetition of probability theory and statistics Example: coin flip Example
More informationMATH 3510: PROBABILITY AND STATS July 1, 2011 FINAL EXAM
MATH 3510: PROBABILITY AND STATS July 1, 2011 FINAL EXAM YOUR NAME: KEY: Answers in blue Show all your work. Answers out of the blue and without any supporting work may receive no credit even if they are
More informationDecision making and problem solving Lecture 1. Review of basic probability Monte Carlo simulation
Decision making and problem solving Lecture 1 Review of basic probability Monte Carlo simulation Why probabilities? Most decisions involve uncertainties Probability theory provides a rigorous framework
More informationChap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of
Chap 4 Probability p227 The probability of any outcome in a random phenomenon is the proportion of times the outcome would occur in a long series of repetitions. (p229) That is, probability is a long-term
More informationProbability- describes the pattern of chance outcomes
Chapter 6 Probability the study of randomness Probability- describes the pattern of chance outcomes Chance behavior is unpredictable in the short run, but has a regular and predictable pattern in the long
More informationSociology 6Z03 Review II
Sociology 6Z03 Review II John Fox McMaster University Fall 2016 John Fox (McMaster University) Sociology 6Z03 Review II Fall 2016 1 / 35 Outline: Review II Probability Part I Sampling Distributions Probability
More informationDiscrete Random Variables
CPSC 53 Systems Modeling and Simulation Discrete Random Variables Dr. Anirban Mahanti Department of Computer Science University of Calgary mahanti@cpsc.ucalgary.ca Random Variables A random variable is
More informationProbability Theory. Probability and Statistics for Data Science CSE594 - Spring 2016
Probability Theory Probability and Statistics for Data Science CSE594 - Spring 2016 What is Probability? 2 What is Probability? Examples outcome of flipping a coin (seminal example) amount of snowfall
More informationOutline. A quiz
Introduction to Bayesian Networks Anders Ringgaard Kristensen Outline Causal networks Bayesian Networks Evidence Conditional Independence and d-separation Compilation The moral graph The triangulated graph
More informationIntroduction to Stochastic Processes
Stat251/551 (Spring 2017) Stochastic Processes Lecture: 1 Introduction to Stochastic Processes Lecturer: Sahand Negahban Scribe: Sahand Negahban 1 Organization Issues We will use canvas as the course webpage.
More information1 Presessional Probability
1 Presessional Probability Probability theory is essential for the development of mathematical models in finance, because of the randomness nature of price fluctuations in the markets. This presessional
More informationBNAD 276 Lecture 5 Discrete Probability Distributions Exercises 1 11
1 / 15 BNAD 276 Lecture 5 Discrete Probability Distributions 1 11 Phuong Ho May 14, 2017 Exercise 1 Suppose we have the probability distribution for the random variable X as follows. X f (x) 20.20 25.15
More informationProbability. Machine Learning and Pattern Recognition. Chris Williams. School of Informatics, University of Edinburgh. August 2014
Probability Machine Learning and Pattern Recognition Chris Williams School of Informatics, University of Edinburgh August 2014 (All of the slides in this course have been adapted from previous versions
More informationStatistical Methods for Astronomy
Statistical Methods for Astronomy Probability (Lecture 1) Statistics (Lecture 2) Why do we need statistics? Useful Statistics Definitions Error Analysis Probability distributions Error Propagation Binomial
More information