Statistical Inference
|
|
- Meagan Jacobs
- 5 years ago
- Views:
Transcription
1 Statistical Inference Classical and Bayesian Methods Revision Class for Midterm Exam AMS-UCSC Th Feb 9, 2012 Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
2 Topics Topics We will talk about... 1 Estimation Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
3 Topics Topics We will talk about... 1 Estimation 2 Sampling Distributions of Estimators Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
4 Topics Topics We will talk about... 1 Estimation 2 Sampling Distributions of Estimators 3 Confidence Intervals Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
5 Topics Topics We will talk about... 1 Estimation 2 Sampling Distributions of Estimators 3 Confidence Intervals 4 Hypothesis testing Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
6 Topics Topics We will talk about... 1 Estimation 2 Sampling Distributions of Estimators 3 Confidence Intervals 4 Hypothesis testing 5 Problems Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
7 Estimation Maximum Likelihood Estimation Maximum Likelihood Estimation Maximum likelihood estimation This is a method that chooses as the estimate of θ the value that provides the largest value of the likelihood function Likelihood function When the joint p.d.f or the joint p.f f n (x θ) is regarded as a function of θ given the values x 1, x 2,..., x n it is called a likelihood function Maximum likelihood estimator/estimate For each possible value of x, we consider δ(x) Ω the value of θ which maximizes f n (x θ). Let ˆθ = δ(x) the estimator defined that way. The estimator ˆθ is a maximum likelihood estimator of θ. After X = x is observed, the value δ(x) is the maximum likelihood estimate Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
8 Estimation Properties of Maximum Likelihood Estimators MLE Properties Invariance Theorem If ˆθ is the maximum likelihood estimator of θ and if g is a one-to-one function, then g(ˆθ) is a MLE of g(θ) Consistency property Consider a random sample taken from a distribution with parameter θ. Suppose that for every large sample of size n greater that some given minimum, there exists a unique MLE of θ. Then under certain conditions, the sequence of MLE s is a consistent sequence of estimators of θ. This means that the MLE sequence converges in probability to the unknown value of θ as n Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
9 Estimation MLE for Multiparametric models MLE for the mean and variance of a Normal distribution ˆθ = (ˆµ, ˆσ 2 ) = ( X n, 1 n n (X i X n ) 2 ) i=1 Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
10 Estimation Sufficient Statistics Definition and Factorization theorem Sufficient statistics Let X 1, X 2,..., X n be a random sample from a distribution indexed by parameter θ. Let T be a statistics. Suppose that for every θ and every possible value t of T, the conditional distribution of X 1, X 2,..., X n given T = t and θ depends on t but not on θ. This means that the conditional distribution of X 1, X 2,..., X n given T = t and θ is the same for all values of θ. We say hat T is a sufficient statistic for the parameter θ Theorem: Factorization criterion Let X 1, X 2,..., X n form a random variable from either a continuous or a discrete distribution for which the pdf or the pf is f (x θ). The value of θ is unknown and belongs to a parameter space Ω. A statistic T = r(x 1, X 2,..., X n ) is a sufficient statistic if and only if the joint pdf or pf f n (x θ) can be factored as: f n (x θ) = u(x)v[r(x, θ)] for all values of x = (x 1, x 2,..., x n ) R n and θ Ω Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
11 Sampling Distributions of Estimators Sampling distribution of a statistic Definition of a Sampling distribution Sampling distribution Let X = (X 1, X 2,..., X n ) a random sample from a distribution involving parameter θ (unknown). Let T be a function of X and possibly of θ. This means, T = r(x 1, X 2,..., X n, θ). The distribution of T given θ is the sampling distribution of T Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
12 Sampling Distributions of Estimators The Chi-Square Distribution Definition of a Sampling distribution Theorem: Relationship with the Normal Distribution If X N(0, 1) then the variable Y = X 2 has a χ 2 distribution with one degree of freedom. Corollary: If the random variables X 1, X 2,..., X m are iid with standard normal distribution, the sum of squares X X 2 m has a χ 2 distribution with m degrees of freedom. Suppose X 1, X 2,..., X n is a sample from a Normal model with known mean and unknown variance. We found that the MLE of σ 2 is: ˆσ 0 2 = 1 n n i=1 (X i µ) 2. Consider the random variables Z i = (X i µ)/σ. These variables form a sequence of random variables from the standard normal distribution. From the Corollary before it follows that n i=1 Z i 2 has a χ 2 distribution with n degrees of freedom. Please note that n i=1 Z i 2 = n ˆσ 0 2/σ2. Therefore this quantity has a χ 2 distribution with n degrees of freedom. Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
13 Sampling Distributions of Estimators Sample mean and sample variance distributions Sample mean and sample variance distributions Theorem: Suppose X 1, X 2,..., X n is a random sample with a normal distribution with mean µ and variance σ 2. The sample mean X n and the sample variance 1 n n i=1 (X i X n ) 2 are independent variables. The sample mean X n has a normal distribution with mean µ and variance σ 2 /n and the variable n i=1 (X i X n ) 2 /σ 2 has a χ 2 distribution with n 1 degrees of freedom The quantity n i=1 (X i X n ) 2 /σ 2 is equivalent to n ˆσ 2 /σ 2 Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
14 Definition Sampling Distributions of Estimators t Distribution t Distribution Consider two independent random variables Y and Z where Y has a χ 2 distribution with m degrees of freedom and Z has the standard normal distribution. The random variable X = Z is called the t distribution ( Y )1/2 m with m degrees of freedom. Let Z = n 1/2 ( X n µ)/σ and Y = n ˆσ 2 /σ 2. Z and Y are independent random variables. Since Z has a standard normal distribution, and Y has a χ 2 distribution with n 1 degrees of freedom, the quantity Z/(Y /(n 1)) 1/2 has a t distribution with n 1 degrees of freedom. n i=1 (X i X n) 2 If we set σ = ( n 1 ) 1/2 the quantity U = n 1/2 ( X n µ)/σ has a t distribution with n 1 degrees of freedom. Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
15 Confidence Intervals Confidence Intervals for the mean of a Normal Distribution Definition of Confidence Intervals Confidence Interval Let X = (X 1,..., X n ) be a random sample from a distribution that depends of a parameter (or paramater vector) θ. Let g(θ) a real valued function of θ. Let A and B two statistics such that A B and for all values of θ: Pr(A < g(θ) < B) γ. Then the random interval (A, B) is called a coefficient γ confidence interval for g(θ) or a 100γ percent confidence interval for g(θ). Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
16 Confidence Intervals Confidence Intervals for the mean of a Normal Distribution Theorem Confidence interval for the mean of a Normal distribution Theorem Let X = (X 1,..., X n ) be a random sample from a Normal distribution with parameters µ and σ 2.For each γ in (0, 1), the interval with the following end points is an exact coefficient γ confidence interval for µ: A = X n T 1 n 1 ((γ + 1)/2)σ /n 1/2 B = X n + T 1 n 1 ((γ + 1)/2)σ /n 1/2 Note: Before observing the data we can be 95% confident that the interval (A, B) will contain µ. However after observing the data we are not sure whether (a, b) will contain µ. The safest interpretation is to say that (a, b) is simply an observed value of the random interval (A, B). Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
17 Confidence Intervals Confidence Intervals for the mean of a Normal Distribution Confidence Intervals from a Pivotal Quantity Definition Pivotal Quantity Let X = (X 1,..., X n ) be a random sample from a distribution that depends on a parameter (or paramater vector) θ. Let V (X, θ) be a random variable whose distribution is the same for all values of θ. Then V is called a pivotal quantity. Note: In order to use the pivotal quantity to find a confidence interval for g(θ), we need to invert the pivotal. This means, we need a function r(v, x) such that r(v (X, θ), X) = g(θ) Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
18 Hypothesis testing The Null and Alternative Hypotheses Definitions Some definitions Null and Alternative Hypotheses The hypothesis H 0 is the null hypothesis and the hypothesis H 1 is the alternative hypothesis. If after performing the test we decide that θ lies in Ω 1 we are said to reject H 0. If θ lies in Ω 0 we are said not to reject H 0 Suppose we want to test the following hypothesis: H 0 : θ Ω 0 H 1 : θ Ω 1 Simple and Composite Hypotheses If Ω i contains just a single value of θ then H i is a simple hypothesis. If Ω i contains more than one value of θ then H i is a composite hypothesis Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
19 Hypothesis testing The Null and Alternative Hypotheses Hypothesis testing Some definitions (Cont.) One-sided and Two-sided Hypothesis Let θ be a one-dimensional parameter. One sided null hypothesis are of the form: H 0 : θ θ 0 or θ θ 0 ; which corresponds to the one-sided alternative hypothesis being H 1 : θ > θ 0 or θ < θ 0. When the null hypothesis is simple (H 0 : θ = θ 0 ) the alternative hypothesis is usually two-sided (H 1 : θ θ 0 ) Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
20 Hypothesis testing The Null and Alternative Hypotheses Critical Region and Test Statistic Mean of a Normal distribution with known variance (Cont.) In most problems for hypothesis testing the critical region is specified in terms of a statistic T = r(x) Test Statistic Let X a random sample from a distribution that depends on parameter θ. Let T = r(x) be a statistic and R a subset of the real line. Suppose a test procedure such that we reject H 0 if T R. Then we call T a test statistic and R a rejection region Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
21 Hypothesis testing Power function and types of errors Power function Definition Power function Let δ be a test statistic. The function π(θ δ) is the power function of the test δ. If δ is described in terms of a critical region S 1 the power function is defined as π(θ δ) = Pr{X S 1 θ} for θ Ω. If δ is described in terms of a test statistic T and a rejection region R the power function is defined as π(θ δ) = Pr{T R θ} for θ Ω Type I/II errors The rejection of a true null hypotheses is a type I error or an error of the first kind. The decision not to reject a false null hypothesis is a type II error or an error of the second kind Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
22 Hypothesis testing Significance level/size of the test Definition Level of significance/size of a test Which test is the best? We would like to have a test δ with low values of its power function for θ Ω 0 and high values of its power function for θ Ω 1. These two goals can not be reached simultaneously. Normally you select a number 0 < α 0 < 1 such that: π(θ δ) α 0, for all θ Ω 0 The value of α 0 is the level of the test and we say that the test has a level of significance α 0 Size of a test The size of a test is defined as: α(δ) = sup θ Ω0 π(θ δ). A test is a level α 0 test if and only if its size is at most α 0. If the null hypothesis is simple (H 0 : θ = θ 0 ), the size of δ will be α(δ) = π(θ 0 δ) Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
23 Hypothesis testing The p-value Definition Calculating p-values Instead of choosing a value of α 0 in advance, we can report the value of the Z statistic and the smallest level α 0 such that we would reject the null hypothesis at level α 0 with the observed data. This value is the p-value. p-value Is the smallest level α 0 such that we would reject the null hypothesis at level α 0 with the observed data Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
24 Problems Problem 1 Confidence Intervals from a pivotal quantity Problem 1: Suppose X 1, X 2,..., X n is a random sample from the normal distribution with unknown mean and unknown variance. Describe a method to construct a confidence interval for σ 2 with a specified confidence coefficient γ (0 < γ < 1). Solution: We use the fact that the variable n i=1 (X i X n ) 2 /σ 2 has a χ 2 distribution with n 1 degrees of freedom. We can find a pair of values n i=1 (X i X n) 2 c 1, c 2 such that Pr[c 1 < < c σ 2 2 ] = γ. This inequality can be rewritten in the form: Pr[1/c n 2 i=1 (X i X n ) 2 < σ 2 < 1/c n 1 i=1 (X i X n ) 2 ] = γ. The interval with end points: 1/c n 2 i=1 (X i X n ) 2 and 1/c n 1 i=1 (X i X n ) 2 is a CI for σ 2 with confidence coefficient γ. Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
25 Problems Problem 2 Hypothesis testing Problem 2: Suppose X 1, X 2,..., X n is a random sample from the normal distribution with unknown mean µ and unknown variance σ 2. The following hypothesis are to be tested: H 0 : µ 3 H 1 : µ > 3 Suppose the sample size n is 17, and it is found from the observed values that X n = 3.2 and 1 n n i=1 (X i X n ) 2 = Calculate the U statistics and the p-value. Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
26 Problems Problem 2 Problem 2 (Cont.) Solution: The statistic U = n 1/2 ( X n µ)/σ = (n 1) 1/2 ( X n µ)/ˆσ U = ( X n 3) [ˆσ/16] 1/2 = 0.2 (0.09/16) 1/2 = 8 3 = has a t distribution with 16 degrees of freedom. The p value is the corresponding tail area such that Pr(U > 8 3 ) = p = (This value was found using the pt function of R and using the following command: 1 pt( , 16)) Note: The statistic U = n 1/2 ( X n µ)/σ is in terms of σ and in the problem we were given ˆσ 2 = 1 n n i=1 (X i X n ) 2 = σ 2 and ˆσ 2 relate to each other as σ 2 = nˆσ2 n 1 Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
27 Problems Problem 2 Thanks for your attention... Winter Session 1 (Revision Class) AMS-132/206 Th Feb 9, / 23
Statistical Inference
Statistical Inference Classical and Bayesian Methods Class 7 AMS-UCSC Tue 31, 2012 Winter 2012. Session 1 (Class 7) AMS-132/206 Tue 31, 2012 1 / 13 Topics Topics We will talk about... 1 Hypothesis testing
More informationStatistical Inference
Statistical Inference Classical and Bayesian Methods Class 6 AMS-UCSC Thu 26, 2012 Winter 2012. Session 1 (Class 6) AMS-132/206 Thu 26, 2012 1 / 15 Topics Topics We will talk about... 1 Hypothesis testing
More informationStatistical Inference
Statistical Inference Classical and Bayesian Methods Class 5 AMS-UCSC Tue 24, 2012 Winter 2012. Session 1 (Class 5) AMS-132/206 Tue 24, 2012 1 / 11 Topics Topics We will talk about... 1 Confidence Intervals
More informationReview. December 4 th, Review
December 4 th, 2017 Att. Final exam: Course evaluation Friday, 12/14/2018, 10:30am 12:30pm Gore Hall 115 Overview Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 6: Statistics and Sampling Distributions Chapter
More informationDefinition 3.1 A statistical hypothesis is a statement about the unknown values of the parameters of the population distribution.
Hypothesis Testing Definition 3.1 A statistical hypothesis is a statement about the unknown values of the parameters of the population distribution. Suppose the family of population distributions is indexed
More informationTopic 10: Hypothesis Testing
Topic 10: Hypothesis Testing Course 003, 2016 Page 0 The Problem of Hypothesis Testing A statistical hypothesis is an assertion or conjecture about the probability distribution of one or more random variables.
More informationTopic 10: Hypothesis Testing
Topic 10: Hypothesis Testing Course 003, 2017 Page 0 The Problem of Hypothesis Testing A statistical hypothesis is an assertion or conjecture about the probability distribution of one or more random variables.
More informationMISCELLANEOUS TOPICS RELATED TO LIKELIHOOD. Copyright c 2012 (Iowa State University) Statistics / 30
MISCELLANEOUS TOPICS RELATED TO LIKELIHOOD Copyright c 2012 (Iowa State University) Statistics 511 1 / 30 INFORMATION CRITERIA Akaike s Information criterion is given by AIC = 2l(ˆθ) + 2k, where l(ˆθ)
More informationMath 494: Mathematical Statistics
Math 494: Mathematical Statistics Instructor: Jimin Ding jmding@wustl.edu Department of Mathematics Washington University in St. Louis Class materials are available on course website (www.math.wustl.edu/
More informationIntroductory Econometrics
Session 4 - Testing hypotheses Roland Sciences Po July 2011 Motivation After estimation, delivering information involves testing hypotheses Did this drug had any effect on the survival rate? Is this drug
More informationLecture 3. Inference about multivariate normal distribution
Lecture 3. Inference about multivariate normal distribution 3.1 Point and Interval Estimation Let X 1,..., X n be i.i.d. N p (µ, Σ). We are interested in evaluation of the maximum likelihood estimates
More informationTesting Hypothesis. Maura Mezzetti. Department of Economics and Finance Università Tor Vergata
Maura Department of Economics and Finance Università Tor Vergata Hypothesis Testing Outline It is a mistake to confound strangeness with mystery Sherlock Holmes A Study in Scarlet Outline 1 The Power Function
More informationINTERVAL ESTIMATION AND HYPOTHESES TESTING
INTERVAL ESTIMATION AND HYPOTHESES TESTING 1. IDEA An interval rather than a point estimate is often of interest. Confidence intervals are thus important in empirical work. To construct interval estimates,
More informationLECTURE 5 HYPOTHESIS TESTING
October 25, 2016 LECTURE 5 HYPOTHESIS TESTING Basic concepts In this lecture we continue to discuss the normal classical linear regression defined by Assumptions A1-A5. Let θ Θ R d be a parameter of interest.
More informationCentral Limit Theorem ( 5.3)
Central Limit Theorem ( 5.3) Let X 1, X 2,... be a sequence of independent random variables, each having n mean µ and variance σ 2. Then the distribution of the partial sum S n = X i i=1 becomes approximately
More informationSTATS 200: Introduction to Statistical Inference. Lecture 29: Course review
STATS 200: Introduction to Statistical Inference Lecture 29: Course review Course review We started in Lecture 1 with a fundamental assumption: Data is a realization of a random process. The goal throughout
More informationLet us first identify some classes of hypotheses. simple versus simple. H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided
Let us first identify some classes of hypotheses. simple versus simple H 0 : θ = θ 0 versus H 1 : θ = θ 1. (1) one-sided H 0 : θ θ 0 versus H 1 : θ > θ 0. (2) two-sided; null on extremes H 0 : θ θ 1 or
More informationST5215: Advanced Statistical Theory
Department of Statistics & Applied Probability Wednesday, October 5, 2011 Lecture 13: Basic elements and notions in decision theory Basic elements X : a sample from a population P P Decision: an action
More informationChapter 9: Hypothesis Testing Sections
Chapter 9: Hypothesis Testing Sections 9.1 Problems of Testing Hypotheses 9.2 Testing Simple Hypotheses 9.3 Uniformly Most Powerful Tests Skip: 9.4 Two-Sided Alternatives 9.6 Comparing the Means of Two
More informationLecture 9 Two-Sample Test. Fall 2013 Prof. Yao Xie, H. Milton Stewart School of Industrial Systems & Engineering Georgia Tech
Lecture 9 Two-Sample Test Fall 2013 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milton Stewart School of Industrial Systems & Engineering Georgia Tech Computer exam 1 18 Histogram 14 Frequency 9 5 0 75 83.33333333
More informationIntroduction to Statistical Inference
Introduction to Statistical Inference Dr. Fatima Sanchez-Cabo f.sanchezcabo@tugraz.at http://www.genome.tugraz.at Institute for Genomics and Bioinformatics, Graz University of Technology, Austria Introduction
More informationInferences about a Mean Vector
Inferences about a Mean Vector Edps/Soc 584, Psych 594 Carolyn J. Anderson Department of Educational Psychology I L L I N O I S university of illinois at urbana-champaign c Board of Trustees, University
More informationPractice Problems Section Problems
Practice Problems Section 4-4-3 4-4 4-5 4-6 4-7 4-8 4-10 Supplemental Problems 4-1 to 4-9 4-13, 14, 15, 17, 19, 0 4-3, 34, 36, 38 4-47, 49, 5, 54, 55 4-59, 60, 63 4-66, 68, 69, 70, 74 4-79, 81, 84 4-85,
More information2014/2015 Smester II ST5224 Final Exam Solution
014/015 Smester II ST54 Final Exam Solution 1 Suppose that (X 1,, X n ) is a random sample from a distribution with probability density function f(x; θ) = e (x θ) I [θ, ) (x) (i) Show that the family of
More informationF & B Approaches to a simple model
A6523 Signal Modeling, Statistical Inference and Data Mining in Astrophysics Spring 215 http://www.astro.cornell.edu/~cordes/a6523 Lecture 11 Applications: Model comparison Challenges in large-scale surveys
More informationSummary of Chapters 7-9
Summary of Chapters 7-9 Chapter 7. Interval Estimation 7.2. Confidence Intervals for Difference of Two Means Let X 1,, X n and Y 1, Y 2,, Y m be two independent random samples of sizes n and m from two
More informationVisual interpretation with normal approximation
Visual interpretation with normal approximation H 0 is true: H 1 is true: p =0.06 25 33 Reject H 0 α =0.05 (Type I error rate) Fail to reject H 0 β =0.6468 (Type II error rate) 30 Accept H 1 Visual interpretation
More informationSummary: the confidence interval for the mean (σ 2 known) with gaussian assumption
Summary: the confidence interval for the mean (σ known) with gaussian assumption on X Let X be a Gaussian r.v. with mean µ and variance σ. If X 1, X,..., X n is a random sample drawn from X then the confidence
More informationTUTORIAL 8 SOLUTIONS #
TUTORIAL 8 SOLUTIONS #9.11.21 Suppose that a single observation X is taken from a uniform density on [0,θ], and consider testing H 0 : θ = 1 versus H 1 : θ =2. (a) Find a test that has significance level
More informationClassical and Bayesian inference
Classical and Bayesian inference AMS 132 Claudia Wehrhahn (UCSC) Classical and Bayesian inference January 8 1 / 8 Probability and Statistical Models Motivating ideas AMS 131: Suppose that the random variable
More informationPolitical Science 236 Hypothesis Testing: Review and Bootstrapping
Political Science 236 Hypothesis Testing: Review and Bootstrapping Rocío Titiunik Fall 2007 1 Hypothesis Testing Definition 1.1 Hypothesis. A hypothesis is a statement about a population parameter The
More informationPerformance Evaluation and Comparison
Outline Hong Chang Institute of Computing Technology, Chinese Academy of Sciences Machine Learning Methods (Fall 2012) Outline Outline I 1 Introduction 2 Cross Validation and Resampling 3 Interval Estimation
More informationSome General Types of Tests
Some General Types of Tests We may not be able to find a UMP or UMPU test in a given situation. In that case, we may use test of some general class of tests that often have good asymptotic properties.
More informationTopic 19 Extensions on the Likelihood Ratio
Topic 19 Extensions on the Likelihood Ratio Two-Sided Tests 1 / 12 Outline Overview Normal Observations Power Analysis 2 / 12 Overview The likelihood ratio test is a popular choice for composite hypothesis
More informationLecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2
Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2 Fall, 2013 Page 1 Random Variable and Probability Distribution Discrete random variable Y : Finite possible values {y
More informationHypothesis Testing. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA
Hypothesis Testing Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA An Example Mardia et al. (979, p. ) reprint data from Frets (9) giving the length and breadth (in
More informationAMS7: WEEK 7. CLASS 1. More on Hypothesis Testing Monday May 11th, 2015
AMS7: WEEK 7. CLASS 1 More on Hypothesis Testing Monday May 11th, 2015 Testing a Claim about a Standard Deviation or a Variance We want to test claims about or 2 Example: Newborn babies from mothers taking
More informationSTAT 135 Lab 5 Bootstrapping and Hypothesis Testing
STAT 135 Lab 5 Bootstrapping and Hypothesis Testing Rebecca Barter March 2, 2015 The Bootstrap Bootstrap Suppose that we are interested in estimating a parameter θ from some population with members x 1,...,
More informationChapter 8 - Statistical intervals for a single sample
Chapter 8 - Statistical intervals for a single sample 8-1 Introduction In statistics, no quantity estimated from data is known for certain. All estimated quantities have probability distributions of their
More informationMath 494: Mathematical Statistics
Math 494: Mathematical Statistics Instructor: Jimin Ding jmding@wustl.edu Department of Mathematics Washington University in St. Louis Class materials are available on course website (www.math.wustl.edu/
More informationStatistical Data Analysis Stat 3: p-values, parameter estimation
Statistical Data Analysis Stat 3: p-values, parameter estimation London Postgraduate Lectures on Particle Physics; University of London MSci course PH4515 Glen Cowan Physics Department Royal Holloway,
More informationSTAT 461/561- Assignments, Year 2015
STAT 461/561- Assignments, Year 2015 This is the second set of assignment problems. When you hand in any problem, include the problem itself and its number. pdf are welcome. If so, use large fonts and
More informationF79SM STATISTICAL METHODS
F79SM STATISTICAL METHODS SUMMARY NOTES 9 Hypothesis testing 9.1 Introduction As before we have a random sample x of size n of a population r.v. X with pdf/pf f(x;θ). The distribution we assign to X is
More informationHypothesis Test. The opposite of the null hypothesis, called an alternative hypothesis, becomes
Neyman-Pearson paradigm. Suppose that a researcher is interested in whether the new drug works. The process of determining whether the outcome of the experiment points to yes or no is called hypothesis
More informationMathematical Statistics
Mathematical Statistics MAS 713 Chapter 8 Previous lecture: 1 Bayesian Inference 2 Decision theory 3 Bayesian Vs. Frequentist 4 Loss functions 5 Conjugate priors Any questions? Mathematical Statistics
More informationparameter space Θ, depending only on X, such that Note: it is not θ that is random, but the set C(X).
4. Interval estimation The goal for interval estimation is to specify the accurary of an estimate. A 1 α confidence set for a parameter θ is a set C(X) in the parameter space Θ, depending only on X, such
More informationHomework 7: Solutions. P3.1 from Lehmann, Romano, Testing Statistical Hypotheses.
Stat 300A Theory of Statistics Homework 7: Solutions Nikos Ignatiadis Due on November 28, 208 Solutions should be complete and concisely written. Please, use a separate sheet or set of sheets for each
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationQuantitative Introduction ro Risk and Uncertainty in Business Module 5: Hypothesis Testing
Quantitative Introduction ro Risk and Uncertainty in Business Module 5: Hypothesis Testing M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu October
More informationMathematical statistics
October 18 th, 2018 Lecture 16: Midterm review Countdown to mid-term exam: 7 days Week 1 Chapter 1: Probability review Week 2 Week 4 Week 7 Chapter 6: Statistics Chapter 7: Point Estimation Chapter 8:
More information7.2 One-Sample Correlation ( = a) Introduction. Correlation analysis measures the strength and direction of association between
7.2 One-Sample Correlation ( = a) Introduction Correlation analysis measures the strength and direction of association between variables. In this chapter we will test whether the population correlation
More informationMath 152. Rumbos Fall Solutions to Assignment #12
Math 52. umbos Fall 2009 Solutions to Assignment #2. Suppose that you observe n iid Bernoulli(p) random variables, denoted by X, X 2,..., X n. Find the LT rejection region for the test of H o : p p o versus
More informationSpace Telescope Science Institute statistics mini-course. October Inference I: Estimation, Confidence Intervals, and Tests of Hypotheses
Space Telescope Science Institute statistics mini-course October 2011 Inference I: Estimation, Confidence Intervals, and Tests of Hypotheses James L Rosenberger Acknowledgements: Donald Richards, William
More informationChapter 7. Hypothesis Testing
Chapter 7. Hypothesis Testing Joonpyo Kim June 24, 2017 Joonpyo Kim Ch7 June 24, 2017 1 / 63 Basic Concepts of Testing Suppose that our interest centers on a random variable X which has density function
More information1/24/2008. Review of Statistical Inference. C.1 A Sample of Data. C.2 An Econometric Model. C.4 Estimating the Population Variance and Other Moments
/4/008 Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University C. A Sample of Data C. An Econometric Model C.3 Estimating the Mean of a Population C.4 Estimating the Population
More informationCh. 5 Hypothesis Testing
Ch. 5 Hypothesis Testing The current framework of hypothesis testing is largely due to the work of Neyman and Pearson in the late 1920s, early 30s, complementing Fisher s work on estimation. As in estimation,
More informationStatistics 3858 : Maximum Likelihood Estimators
Statistics 3858 : Maximum Likelihood Estimators 1 Method of Maximum Likelihood In this method we construct the so called likelihood function, that is L(θ) = L(θ; X 1, X 2,..., X n ) = f n (X 1, X 2,...,
More informationReview: General Approach to Hypothesis Testing. 1. Define the research question and formulate the appropriate null and alternative hypotheses.
1 Review: Let X 1, X,..., X n denote n independent random variables sampled from some distribution might not be normal!) with mean µ) and standard deviation σ). Then X µ σ n In other words, X is approximately
More information4 Hypothesis testing. 4.1 Types of hypothesis and types of error 4 HYPOTHESIS TESTING 49
4 HYPOTHESIS TESTING 49 4 Hypothesis testing In sections 2 and 3 we considered the problem of estimating a single parameter of interest, θ. In this section we consider the related problem of testing whether
More informationElements of statistics (MATH0487-1)
Elements of statistics (MATH0487-1) Prof. Dr. Dr. K. Van Steen University of Liège, Belgium November 12, 2012 Introduction to Statistics Basic Probability Revisited Sampling Exploratory Data Analysis -
More informationSTAT 4385 Topic 01: Introduction & Review
STAT 4385 Topic 01: Introduction & Review Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso xsu@utep.edu Spring, 2016 Outline Welcome What is Regression Analysis? Basics
More informationCSE 312 Final Review: Section AA
CSE 312 TAs December 8, 2011 General Information General Information Comprehensive Midterm General Information Comprehensive Midterm Heavily weighted toward material after the midterm Pre-Midterm Material
More informationEC2001 Econometrics 1 Dr. Jose Olmo Room D309
EC2001 Econometrics 1 Dr. Jose Olmo Room D309 J.Olmo@City.ac.uk 1 Revision of Statistical Inference 1.1 Sample, observations, population A sample is a number of observations drawn from a population. Population:
More informationsimple if it completely specifies the density of x
3. Hypothesis Testing Pure significance tests Data x = (x 1,..., x n ) from f(x, θ) Hypothesis H 0 : restricts f(x, θ) Are the data consistent with H 0? H 0 is called the null hypothesis simple if it completely
More informationHypothesis testing: theory and methods
Statistical Methods Warsaw School of Economics November 3, 2017 Statistical hypothesis is the name of any conjecture about unknown parameters of a population distribution. The hypothesis should be verifiable
More informationHypothesis Testing. 1 Definitions of test statistics. CB: chapter 8; section 10.3
Hypothesis Testing CB: chapter 8; section 0.3 Hypothesis: statement about an unknown population parameter Examples: The average age of males in Sweden is 7. (statement about population mean) The lowest
More informationAnswer Key for STAT 200B HW No. 8
Answer Key for STAT 200B HW No. 8 May 8, 2007 Problem 3.42 p. 708 The values of Ȳ for x 00, 0, 20, 30 are 5/40, 0, 20/50, and, respectively. From Corollary 3.5 it follows that MLE exists i G is identiable
More informationClassical and Bayesian inference
Classical and Bayesian inference AMS 132 Claudia Wehrhahn (UCSC) Classical and Bayesian inference January 8 1 / 11 The Prior Distribution Definition Suppose that one has a statistical model with parameter
More informationQualifying Exam in Probability and Statistics. https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf
Part : Sample Problems for the Elementary Section of Qualifying Exam in Probability and Statistics https://www.soa.org/files/edu/edu-exam-p-sample-quest.pdf Part 2: Sample Problems for the Advanced Section
More informationSTT 843 Key to Homework 1 Spring 2018
STT 843 Key to Homework Spring 208 Due date: Feb 4, 208 42 (a Because σ = 2, σ 22 = and ρ 2 = 05, we have σ 2 = ρ 2 σ σ22 = 2/2 Then, the mean and covariance of the bivariate normal is µ = ( 0 2 and Σ
More informationT.I.H.E. IT 233 Statistics and Probability: Sem. 1: 2013 ESTIMATION AND HYPOTHESIS TESTING OF TWO POPULATIONS
ESTIMATION AND HYPOTHESIS TESTING OF TWO POPULATIONS In our work on hypothesis testing, we used the value of a sample statistic to challenge an accepted value of a population parameter. We focused only
More informationCH.9 Tests of Hypotheses for a Single Sample
CH.9 Tests of Hypotheses for a Single Sample Hypotheses testing Tests on the mean of a normal distributionvariance known Tests on the mean of a normal distributionvariance unknown Tests on the variance
More informationInstitute of Actuaries of India
Institute of Actuaries of India Subject CT3 Probability & Mathematical Statistics May 2011 Examinations INDICATIVE SOLUTION Introduction The indicative solution has been written by the Examiners with the
More informationhttp://www.math.uah.edu/stat/hypothesis/.xhtml 1 of 5 7/29/2009 3:14 PM Virtual Laboratories > 9. Hy pothesis Testing > 1 2 3 4 5 6 7 1. The Basic Statistical Model As usual, our starting point is a random
More informationSTAT 135 Lab 6 Duality of Hypothesis Testing and Confidence Intervals, GLRT, Pearson χ 2 Tests and Q-Q plots. March 8, 2015
STAT 135 Lab 6 Duality of Hypothesis Testing and Confidence Intervals, GLRT, Pearson χ 2 Tests and Q-Q plots March 8, 2015 The duality between CI and hypothesis testing The duality between CI and hypothesis
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter Seven Jesse Crawford Department of Mathematics Tarleton State University Spring 2011 (Tarleton State University) Chapter Seven Notes Spring 2011 1 / 42 Outline
More informationThe t-distribution. Patrick Breheny. October 13. z tests The χ 2 -distribution The t-distribution Summary
Patrick Breheny October 13 Patrick Breheny Biostatistical Methods I (BIOS 5710) 1/25 Introduction Introduction What s wrong with z-tests? So far we ve (thoroughly!) discussed how to carry out hypothesis
More information2.6.3 Generalized likelihood ratio tests
26 HYPOTHESIS TESTING 113 263 Generalized likelihood ratio tests When a UMP test does not exist, we usually use a generalized likelihood ratio test to verify H 0 : θ Θ against H 1 : θ Θ\Θ It can be used
More informationLecture 10: Generalized likelihood ratio test
Stat 200: Introduction to Statistical Inference Autumn 2018/19 Lecture 10: Generalized likelihood ratio test Lecturer: Art B. Owen October 25 Disclaimer: These notes have not been subjected to the usual
More informationPartitioning the Parameter Space. Topic 18 Composite Hypotheses
Topic 18 Composite Hypotheses Partitioning the Parameter Space 1 / 10 Outline Partitioning the Parameter Space 2 / 10 Partitioning the Parameter Space Simple hypotheses limit us to a decision between one
More informationME3620. Theory of Engineering Experimentation. Spring Chapter IV. Decision Making for a Single Sample. Chapter IV
Theory of Engineering Experimentation Chapter IV. Decision Making for a Single Sample Chapter IV 1 4 1 Statistical Inference The field of statistical inference consists of those methods used to make decisions
More informationStatistical Inference: Estimation and Confidence Intervals Hypothesis Testing
Statistical Inference: Estimation and Confidence Intervals Hypothesis Testing 1 In most statistics problems, we assume that the data have been generated from some unknown probability distribution. We desire
More informationSampling distribution of t. 2. Sampling distribution of t. 3. Example: Gas mileage investigation. II. Inferential Statistics (8) t =
2. The distribution of t values that would be obtained if a value of t were calculated for each sample mean for all possible random of a given size from a population _ t ratio: (X - µ hyp ) t s x The result
More information557: MATHEMATICAL STATISTICS II HYPOTHESIS TESTING: EXAMPLES
557: MATHEMATICAL STATISTICS II HYPOTHESIS TESTING: EXAMPLES Example Suppose that X,..., X n N, ). To test H 0 : 0 H : the most powerful test at level α is based on the statistic λx) f π) X x ) n/ exp
More informationST495: Survival Analysis: Hypothesis testing and confidence intervals
ST495: Survival Analysis: Hypothesis testing and confidence intervals Eric B. Laber Department of Statistics, North Carolina State University April 3, 2014 I remember that one fateful day when Coach took
More informationBIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation
BIO5312 Biostatistics Lecture 13: Maximum Likelihood Estimation Yujin Chung November 29th, 2016 Fall 2016 Yujin Chung Lec13: MLE Fall 2016 1/24 Previous Parametric tests Mean comparisons (normality assumption)
More informationA Very Brief Summary of Statistical Inference, and Examples
A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2008 Prof. Gesine Reinert 1 Data x = x 1, x 2,..., x n, realisations of random variables X 1, X 2,..., X n with distribution (model)
More informationSTAT420 Midterm Exam. University of Illinois Urbana-Champaign October 19 (Friday), :00 4:15p. SOLUTIONS (Yellow)
STAT40 Midterm Exam University of Illinois Urbana-Champaign October 19 (Friday), 018 3:00 4:15p SOLUTIONS (Yellow) Question 1 (15 points) (10 points) 3 (50 points) extra ( points) Total (77 points) Points
More informationChapter 10: Inferences based on two samples
November 16 th, 2017 Overview Week 1 Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 1: Descriptive statistics Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation Chapter 8: Confidence
More informationEstimation Theory. as Θ = (Θ 1,Θ 2,...,Θ m ) T. An estimator
Estimation Theory Estimation theory deals with finding numerical values of interesting parameters from given set of data. We start with formulating a family of models that could describe how the data were
More informationStatistics GIDP Ph.D. Qualifying Exam Theory Jan 11, 2016, 9:00am-1:00pm
Statistics GIDP Ph.D. Qualifying Exam Theory Jan, 06, 9:00am-:00pm Instructions: Provide answers on the supplied pads of paper; write on only one side of each sheet. Complete exactly 5 of the 6 problems.
More informationHybrid Censoring; An Introduction 2
Hybrid Censoring; An Introduction 2 Debasis Kundu Department of Mathematics & Statistics Indian Institute of Technology Kanpur 23-rd November, 2010 2 This is a joint work with N. Balakrishnan Debasis Kundu
More informationFinal Exam. 1. (6 points) True/False. Please read the statements carefully, as no partial credit will be given.
1. (6 points) True/False. Please read the statements carefully, as no partial credit will be given. (a) If X and Y are independent, Corr(X, Y ) = 0. (b) (c) (d) (e) A consistent estimator must be asymptotically
More informationThis does not cover everything on the final. Look at the posted practice problems for other topics.
Class 7: Review Problems for Final Exam 8.5 Spring 7 This does not cover everything on the final. Look at the posted practice problems for other topics. To save time in class: set up, but do not carry
More informationPOLI 443 Applied Political Research
POLI 443 Applied Political Research Session 6: Tests of Hypotheses Contingency Analysis Lecturer: Prof. A. Essuman-Johnson, Dept. of Political Science Contact Information: aessuman-johnson@ug.edu.gh College
More informationEcon 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE
Econ 583 Homework 7 Suggested Solutions: Wald, LM and LR based on GMM and MLE Eric Zivot Winter 013 1 Wald, LR and LM statistics based on generalized method of moments estimation Let 1 be an iid sample
More information8. Hypothesis Testing
FE661 - Statistical Methods for Financial Engineering 8. Hypothesis Testing Jitkomut Songsiri introduction Wald test likelihood-based tests significance test for linear regression 8-1 Introduction elements
More informationTesting Statistical Hypotheses
E.L. Lehmann Joseph P. Romano Testing Statistical Hypotheses Third Edition 4y Springer Preface vii I Small-Sample Theory 1 1 The General Decision Problem 3 1.1 Statistical Inference and Statistical Decisions
More informationRobustness and Distribution Assumptions
Chapter 1 Robustness and Distribution Assumptions 1.1 Introduction In statistics, one often works with model assumptions, i.e., one assumes that data follow a certain model. Then one makes use of methodology
More informationStat 5102 Final Exam May 14, 2015
Stat 5102 Final Exam May 14, 2015 Name Student ID The exam is closed book and closed notes. You may use three 8 1 11 2 sheets of paper with formulas, etc. You may also use the handouts on brand name distributions
More information