Lecture 3. Biostatistics in Veterinary Science. Feb 2, Jung-Jin Lee Drexel University. Biostatistics in Veterinary Science Lecture 3
|
|
- Job Burke
- 5 years ago
- Views:
Transcription
1 Lecture 3 Biostatistics in Veterinary Science Jung-Jin Lee Drexel University Feb 2, 2015
2 Review Let S be the sample space and A, B be events. Then 1 P (S) = 1, P ( ) = 0. 2 If A B, then P (A) P (B). In particular, 0 P (A) 1. 3 P (A B) = P (A) + P (B) P (A B). In particular, if A and B are disjoint, then P (A B) = P (A) + P (B). 4 P (A c ) = 1 P (A).
3 Conditional Probability P (A): the probability that A occurs. Let B be another event. Often whether or not B has already occurred might affect the occurrence of the event A. Example Suppose that we are rolling a fair die, so that the sample space S = {1, 2, 3, 4, 5, 6}. Let A = {1, 2, 4}, then P (A) = 1 2. Roll the die again, and suppose that somehow we know that the outcome is an even number, that is B = {2, 4, 6} has already happenend. Then what is the probability that the outcome was one of A = {1, 2, 4}? Since B has occured, we know that the outcome should be one of 2, 4, 6 and among these three numbers, 2, 4 belong to A. Therefore we conclude that the desired probability is 2 3. Note that 2 3 = A B B = P (A B) P (B).
4 Conditional Probability, continued Definition The probability of an event A occuring when we know that B has already occurred is called the conditional probability of A given B and is denoted by P (A B). In general, Example P (A B) = P (A B). P (B) Let S = {1, 2,..., 10}, A = {1, 2, 3, 4, 5}, and B = {2, 4, 6, 8, 10}. Then P (A) = P (B) = 1 2, P (A B) = 1 P (A B) 5, and P (A B) = P (B) = 1/5 1/2 = 2 5.
5 Independence Definition Let A and B be events. We say that A and B are independent if the occurrence of A does not depend on the occurrence of B. Formally, A and B are independent if P (A) = P (A B) = In other words, A and B are independent if P (A B). P (B) P (A B) = P (A)P (B). Example Let S = {1, 2,..., 10}, A = {1, 2, 3, 4}, and B = {2, 4, 6, 8, 10}. Then P (A B) = 1 5, P (A) = 2 5, and P (B) = 1 2, so P (A B) = P (A)P (B) and we conclude that A and B are independent.
6 Addition and Multiplication Rules Let A and B be events (not necessarily independent). Since P (A B) = P (A B) P (B), it follows that By symmetry, so in general, we get P (A B) = P (B)P (A B). P (A B) = P (B A) = P (A)P (B A), P (A B) = P (B)P (A B) = P (A)P (B A).
7 Addition and Multiplication Rules, continued Let A and B be events. 1 In general, P (A B) = P (A) + P (B) P (A B). In particular, if A and B are disjoint, then P (A B) = P (A) + P (B). 2 In general, P (A B) = P (B)P (A B) = P (A)P (B A). In particular, if A and B are independent, then P (A B) = P (A)P (B).
8 Random Variable Definition A variable which can take different values with given probabilities is called a random variable. It is usually denoted by a capital letter such as X or Y. 1 X is called a discrete random variable if X takes discrete values (e.g. litter size, parity). 2 X is called a continuous random variable if X takes continuous values (e.g. height, weight, temperature).
9 Discrete Random Variable Example Suppose that X can take values 1, 2, 3, and 4 with probabilities 1 12, 1 2, 1 4, and 1 6, respectively. The values of X and the corresponding probabilities can be described using a table: x P (X = x) The function f given by f(x) = P (X = x) (e.g. f(3) = 1 4 in the example above) is called the probability mass function (pmf in short) of X. Note that P (X = x) = 1. x
10 Discrete Random Variable - Bernoulli Distribution Suppose X takes either 1 (with probability p) or 0 (with probability 1 p). We say that X follows Bernoulli distribution with success probability p. x 0 1 P (X = x) 1 p p Bernoulli distribution is useful when the outcome of an experiment is dichotomous (e.g. X = 1 if a subject has a certain disease and X = 0 if a subject has no disease).
11 Discrete Random Variable - Binomial Distribution Suppose that there is an experiment whose outcome is either success (with probability p) or failure (with probability 1 p). Suppose that this experiment is carried out n times and each result is independent of others. Let X be the number of success, then we say that X follows binom(n, p). x n P (X = x) (1 p) n np(1 p) n 1 n(n 1) 2 p 2 (1 p) n 2 p n In general, the pmf is given by P (X = x) = n! x!(n x)! px (1 p) n x, x = 0, 1, 2,..., n. It is important when dealing with proportion (e.g. among n animals, how many animals have a disease, if each animal either has or does not have the disease?)
12 Discrete Random Variable - Binomial Distribution Example Suppose a box has 6 red balls and 4 black balls. A ball is selected from the box 5 times with replacement. Let X denote the total number of red balls selected. What is the probability that 3 X 4? We note that X follows binom(5, 3 5 ), so P (3 X 4) =P (X = 3) + P (X = 4) = 5! 3!2! = ( 3 5 ) 3 ( ) ! 5 4!1! ( 3 5 ) 4 ( ) dbinom(3,size=5,prob=3/5)+dbinom(4,size=5,prob=3/5) ## [1]
13 Discrete Random Variable - Poisson Distribution Let λ > 0. Suppose that X can take values 0, 1, 2, 3,... with the corresponding probabilities described below: x n P (X = x) e λ e λ λ e λ λ 2 2 e λ λ n n! In this case, we say that X follows P oisson(λ). In general, the pmf is given by P (X = x) = e λ λ x x!, x = 0, 1, 2,.... It is important when dealing with the count of the number of events occurring randomly in a time at a constant rate λ (e.g. the number of phone calls received by a call center per day).
14 Continuous Random Variable Continuous random variables take continuous values, so they cannot be described using a table and pmf. Instead, probability density function (pdf in short) is used.
15 Integral Let f be a nonnegative function. Then b the curve y = f(x) between x = a and x = b. a f(x) dx means the area under b a f(x) dx a b x
16 Probability Density Function Let X be a continuous random variable. A function f is called the probability density function of X if for any a and b, the probability P (a X b) can be expressed by P (a X b) = b a f(x) dx. a P (a X b) b x
17 Probability Density Function, continued When X is a continuous random variable, P (X = a) = a a f(x) dx = 0. In particular, f(x) does NOT represent the probability P (X = a). In fact, f(x) could be greater than 1. f(x) dx = 1.
18 Normal Distribution A continuous random variable X is said to follow N(µ, σ 2 ) if its pdf f is given by f(x) = 1 ) (x µ)2 exp ( 2πσ 2σ 2. µ x Note that f is symmetric with respect to x = µ. µ determines the location of the curve y = f(x) and σ determines the shape of the curve (larger σ wider curve).
19 Normal Distribution, continued Example Suppose X follows N(2, 3 2 ). What is P (1 X 5)? Note that the pdf is given by f(x) = 1 ) ( 3 2π exp (x 2) ) 1 ( 1 3 2π exp (x 2)2 dx, the area of the yellow region, represents 18 the desired probability. x
20 Standard Normal Distribution N(0, 1 2 ) (that is, µ = 0 and σ = 1) is called the standard normal distribution. When Z follows N(0, 1 2 ), its pdf is given by P (Z 0) = P (Z 0) = 0 0 f(x) = 1 2π exp 1 2π exp 1 2π exp ( x2 ( x2 2 ) ( x2. 2 ) dx = ) dx = 1 2.
21 Calculuation with Standard Normal Distribution How to compute P (Z z) = example, let s calculate 1 P (Z 2.15) 2 P (Z 1.96) z ) 1 exp ( x2 dx in general. For 2π 2
22 Calculuation with Standard Normal Distribution, continued One can use a standard normal distribution table. P (Z 2.15) = and P (Z 1.96) = =
23 Calculuation with Standard Normal Distribution, continued There are various types of standard normal distribution tables. P (Z 2.15) = 1 P (Z > 2.15) = = and P (Z 1.96) = P (Z > 1.96) =
24 Calculuation with Standard Normal Distribution, continued Another type of standard normal table: Table entry z Standard Normal Probabilities Table entry for z is the area under the standard normal curve to the left of z z P (Z 2.15) = 1 P (Z 2.15) = = and P (Z 1.96) =
25 Calculuation with Standard Normal Distribution, continued Our textbook gives yet another table in pages Another approach: Use R. Note that the R command pnorm(z) gives P (Z z). pnorm(0) ## [1] 0.5 pnorm(2.15) ## [1] pnorm(-1.96) ## [1] 0.025
26 Calculuation with Standard Normal Distribution, continued Problem Suppose that Z follows N(0, 1 2 ). Compute 1 P (Z 1.96) 2 P ( 1.96 Z 2.15) Answer 1 P (Z 1.96) = P (Z 1.96) = P ( 1.96 Z 2.15) = P (Z 2.15) P (Z 1.96) =
27 Standardization of Normal Distribution The previous tables are only for standard normal distribution. How to compute probabilities involving a general normal distribution? Theorem Suppose that X follows N(µ, σ 2 ). Let Z = X µ σ, then Z follows N(0, 1 2 ).
28 Standardization of Normal Distribution, continued Example Suppose that X follows N(2, 3 2 ). What is P (1 X 5)? If we let Z = X 2 3, then Z follows N(0, 12 ) and ( 1 2 P (1 X 5) = P 3 X ) = P ( 13 ) 3 Z 1. So the probability involving a general normal distribution becomes a probability involving standard normal distribution.
29 Standardization of Normal Distribution, continued Example x x pnorm(1)-pnorm(-1/3) ## [1] ## CAN COMPUTE THE PROBABILITY WITHOUT STANDARDIZATION pnorm(5,mean=2,sd=3)-pnorm(1,mean=2,sd=3) ## [1]
30 Critical Value of Normal Distribution Example Suppose that Z follows N(0, 1 2 ). How to find z α such that P (Z z α ) = 0.8? 0.8 One can use qnorm() function in R. Note that z α = qnorm(p) if and only if P (Z z α ) = p. z α x qnorm(0.8) ## [1] pnorm(0.8416) ## [1] 0.8
31 Critical Value of Normal Distribution, continued Problem Suppose that Z follows N(0, 1 2 ). Find z α such that P ( z α Z z α ) = z α 0.95 z α x Answer qnorm( /2) ## [1] 1.96
32 Critical Value of Normal Distribution, continued Problem Suppose that X follows N(2, 3 2 ). Find x 0 such that P (X x 0 ) = x 0 x Answer Using standardization, we get P (Z x0 2 3 ) = 0.8. Solving x = , we get x 0 = = qnorm(0.8,mean=2,sd=3) ## [1] 4.525
33 Normal Approximation Suppose that X follows binom(n, p), so X is a discrete random variable that can take values 0, 1, 2,..., n. Recall that its pmf is given by P (X = x) = n! x!(n x)! px (1 p) n x, x = 0, 1, 2,..., n. By the Central Limit Theorem, if n is large enough, then X behaves like N(np, np(1 p)).
34 Normal Approximation, continued Example Suppose that the probability that a typical cat in a certain town has fleas is 1 3. If there are 100 cats in the town, what is the probability that at most 30 cats have fleas? Let X be the number of cats (among 100) that have fleas, then X follows binom(100, 1 3 ). The desired probability is P (X 30) = P (X = 0) + P (X = 1) + P (X = 2) + + P (X = 30) 30 = P (X = k) = k=0 30 k=0 100! k!(100 k)! ( 1 3 ) k ( ) 100 k 2. 3 sum(dbinom(0:30,size=100,prob=1/3)) ## [1]
35 Normal Approximation, continued Example It is almost impossible to compute 30 k=0 now use normal approximation: binom(100, 1 3 ) N( , ( 100! 1 ) k ( 2 ) 100 k. k!(100 k)! 3 3 We ) = N( 100 3, ) = N( 100 3, ( ) 2 ). pnorm(30,mean=100/3,sd=10*sqrt(2)/3) ## [1] One can further compare: c(sum(dbinom(0:20,size=100,prob=1/3)), sum(dbinom(0:40,size=100,prob=1/3))) ## [1] c(pnorm(20,mean=100/3,sd=10*sqrt(2)/3), pnorm(40,mean=100/3,sd=10*sqrt(2)/3)) ## [1]
36 t-distribution When sample size is small, we need to work with t-distributions. The shape of its pdf depends on its degrees of freedom. pdf of t distributions df=1 df=2 df=3 df= x
37 t-distribution, continued
38 χ 2 -Distribution χ 2 -distribution is used, for example, to test independence in various setting. The shape of its pdf depends on its degrees of freedom. pdf of chi square distributions df=1 df=2 df=3 df= x
39 χ 2 -Distribution, continued
40 F -Distribution F -distribution is used, for example, in ANOVA. The shape of its pdf depends on a pair of degrees of freedom. pdf of F distributions df1=1, df2=1 df1=2, df2=1 df1=5, df2=2 df1=30, df2= x
41 F -Distribution, continued
42 Population and Sample Suppose that we are interested in the average weight of all cats in Philadelphia. Instead of studying the whole population (which is often impossible due to economic and practical considerations), we use a sample. Then our inference on the whole population is based on what we get from the sample. Samples are used for parameter estimation and hypothesis testing. We start with estimation.
43 Sampling Distribution of Normal Population Assume that a population follows N(µ, σ 2 ), where µ and σ 2 are unknown numbers to be estimated. Suppose that we took a sample of size n, say X 1, X 2,..., X n, from the population, then each X i is a random variable. Define the sample mean X by X = X 1 + X X n. n We also define the the sample variance S 2 by S 2 = 1 n 1 n (X i X) 2. It is known that X (respectively, S 2 ) is a good estimator for µ (respectively, σ 2 ). i=1
44 Sampling Distribution of Normal Population, continued Problem Suppose that the following sample of size 25 was obtained from a weight data that follows a normal population: 0.5, 1.2, 4.3, 4.1, 5.4, 4.3, 2.1, 4.0, 0.2, 7.3, 3.2, 6.0, 5.4, 3.2, 2.7, 7.5, 4.3, 3.3, 5.9, 4.2, 1.7, 1.8, 3.8, 1.5, 4.2 Estimate the population mean µ and the population variance σ 2. Answer weight=c(0.5, 1.2, 4.3, 4.1, 5.4, 4.3, 2.1, 4.0, 0.2, 7.3, 3.2, 6.0, 5.4, 3.2, 2.7, 7.5, 4. mean(weight) ## [1] var(weight) ## [1] 3.773
45 Sampling Distribution of Normal Population, continued It follows that ˆµ = and ˆσ 2 = 3.773, so we infer that the normal population follows N(3.684, 3.773) based on our sample above. Of course, these estimates would have been different if we took a different sample. So a natural question follows: How accurate (or stable) is ˆµ = 3.684? The answer relies on the following theorem.
46 Sampling Distribution of Mean Theorem Assume that a population follows N(µ, σ 2 ), where µ is unknown and σ 2 is known. Suppose that we took a sample of size n, say X 1, X 2,..., X n, from ( the population, then X is a random variable that follows ( ) 2 σ N µ, n ). In particular, ( P X 1.96 σ µ X σ ) = n n This is, however, rarely used in practice, because we usually do not know σ. Instead, we use the following theorem.
47 Sampling Distribution of Mean, continued Theorem Assume that a population follows N(µ, σ 2 ), where µ and σ 2 are unknown. Suppose that we took a sample of size n, say X 1, X 2,..., X n, from the population, then X µ S/ is a random variable that follows a n t-distribution with n 1 degrees of freedom. In particular, ( ) S P X t α/2 n µ X S + t α/2 n = 1 α. Here t α/2 is determined so that P (T t α/2 ) = 1 α/2, where T follows a t-distribution with n 1 degrees of freedom. The interval ( X tα/2 S n, X + t α/2 S n ) is called the (1 α) 100 % confidence interval of µ.
48 Sampling Distribution of Mean, continued Example Consider the weight data again. We are interested in finding the 95% confidence interval of µ. So α = 0.05 and t α/2 = Therefore, the 95% confidence interval of µ is given by ( ) , = (2.882, 4.486) n=length(weight) alpha=0.05 t=qt(1-alpha/2,df=n-1) t ## [1] CI95=c(mean(weight)-t*sqrt(var(weight)/n),mean(weight)+t*sqrt(var(weight)/n)) CI95 ## [1]
49 Sampling Distribution of Mean, continued When the sample size n is large enough, the result above remains valid (approximately) even when the population does not necessarily follow a normal distribution (Central Limit Theorem).
7 Random samples and sampling distributions
7 Random samples and sampling distributions 7.1 Introduction - random samples We will use the term experiment in a very general way to refer to some process, procedure or natural phenomena that produces
More informationLecture 6. Probability events. Definition 1. The sample space, S, of a. probability experiment is the collection of all
Lecture 6 1 Lecture 6 Probability events Definition 1. The sample space, S, of a probability experiment is the collection of all possible outcomes of an experiment. One such outcome is called a simple
More informationProbability Theory and Statistics. Peter Jochumzen
Probability Theory and Statistics Peter Jochumzen April 18, 2016 Contents 1 Probability Theory And Statistics 3 1.1 Experiment, Outcome and Event................................ 3 1.2 Probability............................................
More informationRandom Variables. Definition: A random variable (r.v.) X on the probability space (Ω, F, P) is a mapping
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More information1 Probability Distributions
1 Probability Distributions A probability distribution describes how the values of a random variable are distributed. For example, the collection of all possible outcomes of a sequence of coin tossing
More informationDistributions of Functions of Random Variables. 5.1 Functions of One Random Variable
Distributions of Functions of Random Variables 5.1 Functions of One Random Variable 5.2 Transformations of Two Random Variables 5.3 Several Random Variables 5.4 The Moment-Generating Function Technique
More informationQuick Tour of Basic Probability Theory and Linear Algebra
Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra CS224w: Social and Information Network Analysis Fall 2011 Quick Tour of and Linear Algebra Quick Tour of and Linear Algebra Outline Definitions
More informationStatistics for Economists. Lectures 3 & 4
Statistics for Economists Lectures 3 & 4 Asrat Temesgen Stockholm University 1 CHAPTER 2- Discrete Distributions 2.1. Random variables of the Discrete Type Definition 2.1.1: Given a random experiment with
More informationA Probability Primer. A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes.
A Probability Primer A random walk down a probabilistic path leading to some stochastic thoughts on chance events and uncertain outcomes. Are you holding all the cards?? Random Events A random event, E,
More informationThe t-distribution. Patrick Breheny. October 13. z tests The χ 2 -distribution The t-distribution Summary
Patrick Breheny October 13 Patrick Breheny Biostatistical Methods I (BIOS 5710) 1/25 Introduction Introduction What s wrong with z-tests? So far we ve (thoroughly!) discussed how to carry out hypothesis
More informationProbability Distributions Columns (a) through (d)
Discrete Probability Distributions Columns (a) through (d) Probability Mass Distribution Description Notes Notation or Density Function --------------------(PMF or PDF)-------------------- (a) (b) (c)
More informationRandom Variables Example:
Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5 s in the 6 rolls. Let X = number of 5 s. Then X could be 0, 1, 2, 3, 4, 5, 6. X = 0 corresponds to the
More information15 Discrete Distributions
Lecture Note 6 Special Distributions (Discrete and Continuous) MIT 4.30 Spring 006 Herman Bennett 5 Discrete Distributions We have already seen the binomial distribution and the uniform distribution. 5.
More informationNormal Distribution and Central Limit Theorem
Normal Distribution and Central Limit Theorem Josemari Sarasola Statistics for Business Josemari Sarasola Normal Distribution and Central Limit Theorem 1 / 13 The normal distribution is the most applied
More informationChapter 4a Probability Models
Chapter 4a Probability Models 4a.2 Probability models for a variable with a finite number of values 297 4a.1 Introduction Chapters 2 and 3 are concerned with data description (descriptive statistics) where
More informationIntroduction to Statistical Data Analysis Lecture 3: Probability Distributions
Introduction to Statistical Data Analysis Lecture 3: Probability Distributions James V. Lambers Department of Mathematics The University of Southern Mississippi James V. Lambers Statistical Data Analysis
More informationExample 1. Assume that X follows the normal distribution N(2, 2 2 ). Estimate the probabilities: (a) P (X 3); (b) P (X 1); (c) P (1 X 3).
Example 1. Assume that X follows the normal distribution N(2, 2 2 ). Estimate the probabilities: (a) P (X 3); (b) P (X 1); (c) P (1 X 3). First of all, we note that µ = 2 and σ = 2. (a) Since X 3 is equivalent
More informationTopic 2: Probability & Distributions. Road Map Probability & Distributions. ECO220Y5Y: Quantitative Methods in Economics. Dr.
Topic 2: Probability & Distributions ECO220Y5Y: Quantitative Methods in Economics Dr. Nick Zammit University of Toronto Department of Economics Room KN3272 n.zammit utoronto.ca November 21, 2017 Dr. Nick
More informationProbability theory and inference statistics! Dr. Paola Grosso! SNE research group!! (preferred!)!!
Probability theory and inference statistics Dr. Paola Grosso SNE research group p.grosso@uva.nl paola.grosso@os3.nl (preferred) Roadmap Lecture 1: Monday Sep. 22nd Collecting data Presenting data Descriptive
More informationNorthwestern University Department of Electrical Engineering and Computer Science
Northwestern University Department of Electrical Engineering and Computer Science EECS 454: Modeling and Analysis of Communication Networks Spring 2008 Probability Review As discussed in Lecture 1, probability
More informationProbability and Distributions
Probability and Distributions What is a statistical model? A statistical model is a set of assumptions by which the hypothetical population distribution of data is inferred. It is typically postulated
More informationDr. Junchao Xia Center of Biophysics and Computational Biology. Fall /13/2016 1/33
BIO5312 Biostatistics Lecture 03: Discrete and Continuous Probability Distributions Dr. Junchao Xia Center of Biophysics and Computational Biology Fall 2016 9/13/2016 1/33 Introduction In this lecture,
More informationSociology 6Z03 Review II
Sociology 6Z03 Review II John Fox McMaster University Fall 2016 John Fox (McMaster University) Sociology 6Z03 Review II Fall 2016 1 / 35 Outline: Review II Probability Part I Sampling Distributions Probability
More informationAdvanced Herd Management Probabilities and distributions
Advanced Herd Management Probabilities and distributions Anders Ringgaard Kristensen Slide 1 Outline Probabilities Conditional probabilities Bayes theorem Distributions Discrete Continuous Distribution
More informationHomework for 1/13 Due 1/22
Name: ID: Homework for 1/13 Due 1/22 1. [ 5-23] An irregularly shaped object of unknown area A is located in the unit square 0 x 1, 0 y 1. Consider a random point distributed uniformly over the square;
More informationMA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems
MA/ST 810 Mathematical-Statistical Modeling and Analysis of Complex Systems Review of Basic Probability The fundamentals, random variables, probability distributions Probability mass/density functions
More informationChapters 3.2 Discrete distributions
Chapters 3.2 Discrete distributions In this section we study several discrete distributions and their properties. Here are a few, classified by their support S X. There are of course many, many more. For
More information3.4. The Binomial Probability Distribution
3.4. The Binomial Probability Distribution Objectives. Binomial experiment. Binomial random variable. Using binomial tables. Mean and variance of binomial distribution. 3.4.1. Four Conditions that determined
More informationChapter 4 Multiple Random Variables
Review for the previous lecture Theorems and Examples: How to obtain the pmf (pdf) of U = g ( X Y 1 ) and V = g ( X Y) Chapter 4 Multiple Random Variables Chapter 43 Bivariate Transformations Continuous
More informationSpecial Discrete RV s. Then X = the number of successes is a binomial RV. X ~ Bin(n,p).
Sect 3.4: Binomial RV Special Discrete RV s 1. Assumptions and definition i. Experiment consists of n repeated trials ii. iii. iv. There are only two possible outcomes on each trial: success (S) or failure
More informationMath 3215 Intro. Probability & Statistics Summer 14. Homework 5: Due 7/3/14
Math 325 Intro. Probability & Statistics Summer Homework 5: Due 7/3/. Let X and Y be continuous random variables with joint/marginal p.d.f. s f(x, y) 2, x y, f (x) 2( x), x, f 2 (y) 2y, y. Find the conditional
More informationChapter 5. Means and Variances
1 Chapter 5 Means and Variances Our discussion of probability has taken us from a simple classical view of counting successes relative to total outcomes and has brought us to the idea of a probability
More informationReview of Probability Theory
Review of Probability Theory Arian Maleki and Tom Do Stanford University Probability theory is the study of uncertainty Through this class, we will be relying on concepts from probability theory for deriving
More informationStatistics and Econometrics I
Statistics and Econometrics I Random Variables Shiu-Sheng Chen Department of Economics National Taiwan University October 5, 2016 Shiu-Sheng Chen (NTU Econ) Statistics and Econometrics I October 5, 2016
More informationBinomial and Poisson Probability Distributions
Binomial and Poisson Probability Distributions Esra Akdeniz March 3, 2016 Bernoulli Random Variable Any random variable whose only possible values are 0 or 1 is called a Bernoulli random variable. What
More informationChapter 1. Sets and probability. 1.3 Probability space
Random processes - Chapter 1. Sets and probability 1 Random processes Chapter 1. Sets and probability 1.3 Probability space 1.3 Probability space Random processes - Chapter 1. Sets and probability 2 Probability
More informationExercises and Answers to Chapter 1
Exercises and Answers to Chapter The continuous type of random variable X has the following density function: a x, if < x < a, f (x), otherwise. Answer the following questions. () Find a. () Obtain mean
More informationStatistics 3858 : Maximum Likelihood Estimators
Statistics 3858 : Maximum Likelihood Estimators 1 Method of Maximum Likelihood In this method we construct the so called likelihood function, that is L(θ) = L(θ; X 1, X 2,..., X n ) = f n (X 1, X 2,...,
More informationThis does not cover everything on the final. Look at the posted practice problems for other topics.
Class 7: Review Problems for Final Exam 8.5 Spring 7 This does not cover everything on the final. Look at the posted practice problems for other topics. To save time in class: set up, but do not carry
More informationMathematical Statistics 1 Math A 6330
Mathematical Statistics 1 Math A 6330 Chapter 3 Common Families of Distributions Mohamed I. Riffi Department of Mathematics Islamic University of Gaza September 28, 2015 Outline 1 Subjects of Lecture 04
More informationProbability distributions. Probability Distribution Functions. Probability distributions (contd.) Binomial distribution
Probability distributions Probability Distribution Functions G. Jogesh Babu Department of Statistics Penn State University September 27, 2011 http://en.wikipedia.org/wiki/probability_distribution We discuss
More informationCS 361: Probability & Statistics
February 26, 2018 CS 361: Probability & Statistics Random variables The discrete uniform distribution If every value of a discrete random variable has the same probability, then its distribution is called
More informationRandom Variables and Their Distributions
Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital
More informationWhy study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables
ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section
More informationCourse: ESO-209 Home Work: 1 Instructor: Debasis Kundu
Home Work: 1 1. Describe the sample space when a coin is tossed (a) once, (b) three times, (c) n times, (d) an infinite number of times. 2. A coin is tossed until for the first time the same result appear
More informationPhysics 403 Probability Distributions II: More Properties of PDFs and PMFs
Physics 403 Probability Distributions II: More Properties of PDFs and PMFs Segev BenZvi Department of Physics and Astronomy University of Rochester Table of Contents 1 Last Time: Common Probability Distributions
More informationLecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2
Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2 Fall, 2013 Page 1 Random Variable and Probability Distribution Discrete random variable Y : Finite possible values {y
More informationJoint Probability Distributions and Random Samples (Devore Chapter Five)
Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01: Probability and Statistics for Engineers Spring 2013 Contents 1 Joint Probability Distributions 2 1.1 Two Discrete
More informationLecture 01: Introduction
Lecture 01: Introduction Dipankar Bandyopadhyay, Ph.D. BMTRY 711: Analysis of Categorical Data Spring 2011 Division of Biostatistics and Epidemiology Medical University of South Carolina Lecture 01: Introduction
More informationBIO5312 Biostatistics Lecture 6: Statistical hypothesis testings
BIO5312 Biostatistics Lecture 6: Statistical hypothesis testings Yujin Chung October 4th, 2016 Fall 2016 Yujin Chung Lec6: Statistical hypothesis testings Fall 2016 1/30 Previous Two types of statistical
More informationContinuous Probability Spaces
Continuous Probability Spaces Ω is not countable. Outcomes can be any real number or part of an interval of R, e.g. heights, weights and lifetimes. Can not assign probabilities to each outcome and add
More informationChapter 4: An Introduction to Probability and Statistics
Chapter 4: An Introduction to Probability and Statistics 4. Probability The simplest kinds of probabilities to understand are reflected in everyday ideas like these: (i) if you toss a coin, the probability
More informationData, Estimation and Inference
Data, Estimation and Inference Pedro Piniés ppinies@robots.ox.ac.uk Michaelmas 2016 1 2 p(x) ( = ) = δ 0 ( < < + δ ) δ ( ) =1. x x+dx (, ) = ( ) ( ) = ( ) ( ) 3 ( ) ( ) 0 ( ) =1 ( = ) = ( ) ( < < ) = (
More informationDS-GA 1002 Lecture notes 2 Fall Random variables
DS-GA 12 Lecture notes 2 Fall 216 1 Introduction Random variables Random variables are a fundamental tool in probabilistic modeling. They allow us to model numerical quantities that are uncertain: the
More informationAn introduction to biostatistics: part 1
An introduction to biostatistics: part 1 Cavan Reilly September 6, 2017 Table of contents Introduction to data analysis Uncertainty Probability Conditional probability Random variables Discrete random
More informationChapter 6 Expectation and Conditional Expectation. Lectures Definition 6.1. Two random variables defined on a probability space are said to be
Chapter 6 Expectation and Conditional Expectation Lectures 24-30 In this chapter, we introduce expected value or the mean of a random variable. First we define expectation for discrete random variables
More informationBivariate distributions
Bivariate distributions 3 th October 017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Bivariate Distributions of the Discrete Type The Correlation Coefficient
More informationLecture 10: Generalized likelihood ratio test
Stat 200: Introduction to Statistical Inference Autumn 2018/19 Lecture 10: Generalized likelihood ratio test Lecturer: Art B. Owen October 25 Disclaimer: These notes have not been subjected to the usual
More information1 Probability and Random Variables
1 Probability and Random Variables The models that you have seen thus far are deterministic models. For any time t, there is a unique solution X(t). On the other hand, stochastic models will result in
More informationLecture 4: Random Variables and Distributions
Lecture 4: Random Variables and Distributions Goals Random Variables Overview of discrete and continuous distributions important in genetics/genomics Working with distributions in R Random Variables A
More informationSummary of Chapters 7-9
Summary of Chapters 7-9 Chapter 7. Interval Estimation 7.2. Confidence Intervals for Difference of Two Means Let X 1,, X n and Y 1, Y 2,, Y m be two independent random samples of sizes n and m from two
More informationChapter 2. Random Variable. Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance.
Chapter 2 Random Variable CLO2 Define single random variables in terms of their PDF and CDF, and calculate moments such as the mean and variance. 1 1. Introduction In Chapter 1, we introduced the concept
More informationPubH 5450 Biostatistics I Prof. Carlin. Lecture 13
PubH 5450 Biostatistics I Prof. Carlin Lecture 13 Outline Outline Sample Size Counts, Rates and Proportions Part I Sample Size Type I Error and Power Type I error rate: probability of rejecting the null
More informationLab 4. Normal Random Variables
Lab 4. Normal Random Variables Objectives ˆ Normal distribution in R ˆ Related statistics, properties, and simulation The normal, a continuous distribution, is the most important of all the distributions.
More informationMathematical statistics
October 4 th, 2018 Lecture 12: Information Where are we? Week 1 Week 2 Week 4 Week 7 Week 10 Week 14 Probability reviews Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation Chapter
More informationConditional Probability
Conditional Probability Idea have performed a chance experiment but don t know the outcome (ω), but have some partial information (event A) about ω. Question: given this partial information what s the
More informationSTAT 4385 Topic 01: Introduction & Review
STAT 4385 Topic 01: Introduction & Review Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso xsu@utep.edu Spring, 2016 Outline Welcome What is Regression Analysis? Basics
More informationBayesian Statistics Part III: Building Bayes Theorem Part IV: Prior Specification
Bayesian Statistics Part III: Building Bayes Theorem Part IV: Prior Specification Michael Anderson, PhD Hélène Carabin, DVM, PhD Department of Biostatistics and Epidemiology The University of Oklahoma
More informationContinuous Random Variables
1 Continuous Random Variables Example 1 Roll a fair die. Denote by X the random variable taking the value shown by the die, X {1, 2, 3, 4, 5, 6}. Obviously the probability mass function is given by (since
More informationPreliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 2: Probability Theory (Outline) prelimsoas.webs.com Gujarati D. Basic Econometrics, Appendix
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More informationChapter 3 Discrete Random Variables
MICHIGAN STATE UNIVERSITY STT 351 SECTION 2 FALL 2008 LECTURE NOTES Chapter 3 Discrete Random Variables Nao Mimoto Contents 1 Random Variables 2 2 Probability Distributions for Discrete Variables 3 3 Expected
More informationNotes on the Multivariate Normal and Related Topics
Version: July 10, 2013 Notes on the Multivariate Normal and Related Topics Let me refresh your memory about the distinctions between population and sample; parameters and statistics; population distributions
More informationConfidence Intervals, Testing and ANOVA Summary
Confidence Intervals, Testing and ANOVA Summary 1 One Sample Tests 1.1 One Sample z test: Mean (σ known) Let X 1,, X n a r.s. from N(µ, σ) or n > 30. Let The test statistic is H 0 : µ = µ 0. z = x µ 0
More informationWeek 1 Quantitative Analysis of Financial Markets Distributions A
Week 1 Quantitative Analysis of Financial Markets Distributions A Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 October
More informationIntroduction to Normal Distribution
Introduction to Normal Distribution Nathaniel E. Helwig Assistant Professor of Psychology and Statistics University of Minnesota (Twin Cities) Updated 17-Jan-2017 Nathaniel E. Helwig (U of Minnesota) Introduction
More informationz and t tests for the mean of a normal distribution Confidence intervals for the mean Binomial tests
z and t tests for the mean of a normal distribution Confidence intervals for the mean Binomial tests Chapters 3.5.1 3.5.2, 3.3.2 Prof. Tesler Math 283 Fall 2018 Prof. Tesler z and t tests for mean Math
More informationExponential, Gamma and Normal Distribuions
Exponential, Gamma and Normal Distribuions Sections 5.4, 5.5 & 6.5 Cathy Poliak, Ph.D. cathy@math.uh.edu Office in Fleming 11c Department of Mathematics University of Houston Lecture 9-3339 Cathy Poliak,
More informationRandom variables. DS GA 1002 Probability and Statistics for Data Science.
Random variables DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Motivation Random variables model numerical quantities
More informationBrief Review of Probability
Maura Department of Economics and Finance Università Tor Vergata Outline 1 Distribution Functions Quantiles and Modes of a Distribution 2 Example 3 Example 4 Distributions Outline Distribution Functions
More informationBIOSTATISTICS. Lecture 2 Discrete Probability Distributions. dr. Petr Nazarov
Microarray Center BIOSTATISTICS Lecture 2 Discrete Probability Distributions dr. Petr Nazarov 28-02-2014 petr.nazarov@crp-sante.lu Lecture 2. Discrete probability distributions OUTLINE Lecture 2 Random
More informationME3620. Theory of Engineering Experimentation. Spring Chapter IV. Decision Making for a Single Sample. Chapter IV
Theory of Engineering Experimentation Chapter IV. Decision Making for a Single Sample Chapter IV 1 4 1 Statistical Inference The field of statistical inference consists of those methods used to make decisions
More informationELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 2 Discrete Random Variables Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Random Variable Discrete Random
More informationECO220Y Continuous Probability Distributions: Uniform and Triangle Readings: Chapter 9, sections
ECO220Y Continuous Probability Distributions: Uniform and Triangle Readings: Chapter 9, sections 9.8-9.9 Fall 2011 Lecture 8 Part 1 (Fall 2011) Probability Distributions Lecture 8 Part 1 1 / 19 Probability
More informationProbability Distributions.
Probability Distributions http://www.pelagicos.net/classes_biometry_fa18.htm Probability Measuring Discrete Outcomes Plotting probabilities for discrete outcomes: 0.6 0.5 0.4 0.3 0.2 0.1 NOTE: Area within
More information" M A #M B. Standard deviation of the population (Greek lowercase letter sigma) σ 2
Notation and Equations for Final Exam Symbol Definition X The variable we measure in a scientific study n The size of the sample N The size of the population M The mean of the sample µ The mean of the
More informationGiven a experiment with outcomes in sample space: Ω Probability measure applied to subsets of Ω: P[A] 0 P[A B] = P[A] + P[B] P[AB] = P(AB)
1 16.584: Lecture 2 : REVIEW Given a experiment with outcomes in sample space: Ω Probability measure applied to subsets of Ω: P[A] 0 P[A B] = P[A] + P[B] if AB = P[A B] = P[A] + P[B] P[AB] P[A] = 1 P[A
More informationRelationship between probability set function and random variable - 2 -
2.0 Random Variables A rat is selected at random from a cage and its sex is determined. The set of possible outcomes is female and male. Thus outcome space is S = {female, male} = {F, M}. If we let X be
More informationPROBABILITY DISTRIBUTIONS: DISCRETE AND CONTINUOUS
PROBABILITY DISTRIBUTIONS: DISCRETE AND CONTINUOUS Univariate Probability Distributions. Let S be a sample space with a probability measure P defined over it, and let x be a real scalar-valued set function
More informationThe Normal Distribuions
The Normal Distribuions Sections 5.4 & 5.5 Cathy Poliak, Ph.D. cathy@math.uh.edu Office in Fleming 11c Department of Mathematics University of Houston Lecture 15-3339 Cathy Poliak, Ph.D. cathy@math.uh.edu
More informationBMIR Lecture Series on Probability and Statistics Fall, 2015 Uniform Distribution
Lecture #5 BMIR Lecture Series on Probability and Statistics Fall, 2015 Department of Biomedical Engineering and Environmental Sciences National Tsing Hua University s 5.1 Definition ( ) A continuous random
More information1 INFO Sep 05
Events A 1,...A n are said to be mutually independent if for all subsets S {1,..., n}, p( i S A i ) = p(a i ). (For example, flip a coin N times, then the events {A i = i th flip is heads} are mutually
More informationRandom Variable. Discrete Random Variable. Continuous Random Variable. Discrete Random Variable. Discrete Probability Distribution
Random Variable Theoretical Probability Distribution Random Variable Discrete Probability Distributions A variable that assumes a numerical description for the outcome of a random eperiment (by chance).
More informationChapter 3. Julian Chan. June 29, 2012
Chapter 3 Julian Chan June 29, 202 Continuous variables For a continuous random variable X there is an associated density function f(x). It satisifies many of the same properties of discrete random variables
More informationInference for Proportions, Variance and Standard Deviation
Inference for Proportions, Variance and Standard Deviation Sections 7.10 & 7.6 Cathy Poliak, Ph.D. cathy@math.uh.edu Office Fleming 11c Department of Mathematics University of Houston Lecture 12 Cathy
More informationStat Lecture 20. Last class we introduced the covariance and correlation between two jointly distributed random variables.
Stat 260 - Lecture 20 Recap of Last Class Last class we introduced the covariance and correlation between two jointly distributed random variables. Today: We will introduce the idea of a statistic and
More informationMATH 3670 First Midterm February 17, No books or notes. No cellphone or wireless devices. Write clearly and show your work for every answer.
No books or notes. No cellphone or wireless devices. Write clearly and show your work for every answer. Name: Question: 1 2 3 4 Total Points: 30 20 20 40 110 Score: 1. The following numbers x i, i = 1,...,
More informationBasics on Probability. Jingrui He 09/11/2007
Basics on Probability Jingrui He 09/11/2007 Coin Flips You flip a coin Head with probability 0.5 You flip 100 coins How many heads would you expect Coin Flips cont. You flip a coin Head with probability
More informationThis paper is not to be removed from the Examination Halls
~~ST104B ZA d0 This paper is not to be removed from the Examination Halls UNIVERSITY OF LONDON ST104B ZB BSc degrees and Diplomas for Graduates in Economics, Management, Finance and the Social Sciences,
More informationPractice Problems Section Problems
Practice Problems Section 4-4-3 4-4 4-5 4-6 4-7 4-8 4-10 Supplemental Problems 4-1 to 4-9 4-13, 14, 15, 17, 19, 0 4-3, 34, 36, 38 4-47, 49, 5, 54, 55 4-59, 60, 63 4-66, 68, 69, 70, 74 4-79, 81, 84 4-85,
More information