Chapter 5: HYPOTHESIS TESTING
|
|
- Juliana Lambert
- 5 years ago
- Views:
Transcription
1 MATH411: Applied Statistics Dr. YU, Chi Wai Chapter 5: HYPOTHESIS TESTING 1 WHAT IS HYPOTHESIS TESTING? As its name indicates, it is about a test of hypothesis. To be more precise, we would first translate our question of interest into a hypothesis about an unknown parameter like μ X or σ X, and then test it. Unlike what we did in Chapter 4 to use a sample of data to get a point-valued or an interval-valued estimate of the unknown parameter, we now would have a hypothesized value of the parameter which is assumed to be true first and then we use data to see if the assumption should be rejected or not be rejected. STATISTICAL HYPOTHESES: H 0 AND H 1 In hypothesis testing, we first need to study the following key terms: The null hypothesis H 0 : It is the hypothesis that is assumed to be true and then tested to be rejected or not to be rejected formally. It always contains = sign. (i.e. =,, ). The alternative hypothesis H 1 : It is the hypothesis that typically represents the underlying research question of the investigator and is the complement of H 0, i.e. it contains the values of parameter we accept if we reject H 0. It never contains = sign, EXCEPT a simple test. In this chapter, both of them are with respect to the parameter μ X or σ X. Test statistic: An estimator used for the parameter in a test. Throughout our course, the test statistics used for testing the hypotheses for μ X and σ X are X and S n 1, respectively. ~ 1 ~
2 MATH411: Applied Statistics Dr. YU, Chi Wai EXAMPLE An agronomist may want to decide on the basis of experiments whether or not a new fertilizer would produce a higher yield of soybeans than an old one whose mean is known to be 10. In this case the agronomist has to test μ X > 10, where μ X is the mean of the random variable of the yield of soybean by the new fertilizer, assuming a normal population. Then, we have H 0 : μ X = 10 against H 1 : μ X > 10. A manufacturer of pharmaceutical products may decide on the basis of samples whether or not 90% of all patients given a new medication will recover from a certain disease. In this case we might say that the manufacturer has to decide whether or not the parameter p of a binomial population equals We have H 0 : μ X = p = 0. 9 against H 1 : μ X TYPE OF HYPOTHESIS TESTING According to the form of the alternative hypothesis, we can have the following Four types of tests: I) SIMPLE TEST H 0: μ X = μ 0 H 1 : μ X = μ 1 II) ONE-SIDED RIGHT TEST H 0: μ X = μ 0 H 1 : μ X > μ 0 III) IV) ONE-SIDED LEFT TEST TWO-SIDED TEST H 0: μ X = μ 0 H 1 : μ X < μ 0 H 0: μ X = μ 0 H 1 : μ X μ 0 ~ ~
3 MATH411: Applied Statistics Dr. YU, Chi Wai In this course, we will NOT study any test with an inequality null hypothesis. Note that the hypotheses should be stated BEFORE looking at the data. Unless we have enough information to do a simple test or a onesided test, in practice we would opt for the default which is a two-sided test. 4 MAIN CONCEPT OF HYPOTHESIS TESTING The Basic Idea of doing hypothesis testing is a CONTRADICTION with the following three steps: Step 1: Determine H 0 and H 1. Step : Under H 0, define a rare event --- the event which happens with a very small probability in one experiment of getting n data. Step 3: Collect data. If data contradicts H 0, then we can say that H 0 is false and reject H 0, while if data do not contradict H 0, then we cannot say that H 0 is true and accept it, but we can say that we do NOT reject H 0. ~ 3 ~
4 MATH411: Applied Statistics Dr. YU, Chi Wai Example: We want to know whether or not a coin is fair. Consider a random experiment of flipping the coin, say 10 times. Step 1: (H 0 ) The coin is fair, i.e. P(H})=P(T}) = 1/, and (H 1 ) The coin is NOT fair. Step : Under H 0, i.e. the coin is assumed to be fair, the probability of getting 10 tails in ONE experiment is (1/) So, we can define the event of getting 10 tails to be the rare event under H 0. Step 3: Perform the experiment to collect data, i.e. we now flip the coin 10 times. If we finally get 10 tails, then the collected data tell us that getting 10 tails is NOT a rare event, i.e. they contradict H 0. Therefore, we would say that we have evidence to suspect the reliability of H 0 and thus reject H 0 ( = accept H 1 ). In hypothesis testing, we only use the data to see if there is enough evidence to reject H 0. If we have enough evidence to reject H 0, we can have great confidence that H 0 is false and H 1 is true. However, if we do not have enough evidence to reject H 0, then it does not mean that we have great confidence in the truth of H 0. In this case, we should say "do not reject H 0 ", instead of "accept H 0 ". ~ 4 ~
5 MATH411: Applied Statistics Dr. YU, Chi Wai 5 TEST ERRORS AND ERROR PROBABILITIES We would use a test statistic (a point-valued estimator) to formulate the so-called a statistical test statement (hereafter, a test statement) of hypothesis H a procedure/statement/condition based upon the observed values of the random variable of our interest that leads to the rejection or non-rejection of the hypothesis H 0. Note that there is no perfect test statement. Each test statement must lead to the following two kinds of errors. Not reject H 0 Reject H 0 If H 0 is true No error TYPE I ERROR If H 0 is false TYPE II ERROR No error TYPE I ERROR: THE ERROR OF REJECTING H 0 WHEN IT IS IN FACT TRUE. TYPE II ERROR: THE ERROR OF NOT REJECTING H 0 WHEN IT IS IN FACT FALSE. Correspondingly, we have α = P(Type I error) = P(reject H 0 if H 0 is true) It is the probability of making a wrong decision to reject H 0. β = P(Type II error) = P(Not reject H 0 if H 0 is false) It is the probability of making a wrong decision not to reject H0. Ideally, we want to formulate a test statement such that these two error probabilities can be minimized. However, in general, we cannot control both error probabilities simultaneously (when the sample size is fixed). The following example illustrates this problem. ~ 5 ~
6 MATH411: Applied Statistics Dr. YU, Chi Wai EXAMPLE Suppose we knew that the light bulbs produced from a standard manufacturing process have life times distributed as normal with a standard deviation σ X = 300 hours. However, we did not know the mean lifetime μ X. For simplicity, assume that we were sure that the mean lifetime should be either 100 or 140. Then we may set up the following simple test: H 0: μ X = 100 H 1 : μ X = 140 Suppose that we draw a sample of 100 light bulbs and measure their lifetimes. The sample mean X is used to estimate the true population mean μ X. Since the hypothesized value in H 1 is larger than the hypothesized value in H 0, intuitively, we can say that a large value of x will lead to the rejection of H 0, or we can set the test statement Reject H 0 if x > c. We would later discuss how to determine the constant c, which is often called a critical value in practice. Now we simply use the above statement to get and α = P(reject H 0 if H 0 is true) = P(X > c if μ X = 100) β = P(Not reject H 0 if H 0 is false) = P(X c if μ X = 140) Note that (Step ) under H 0 (i.e. when μ X = 100), the event X > c} occurs with a very small probability α. Thus, X > c} is a rare event under H 0. So, in ONE experiment of getting n data, we should NOT get x > c IF H 0 is TRUE. (Step 3) In other words, getting x > c in one experiment would contradict H 0, and then we would reject H 0. ~ 6 ~
7 MATH411: Applied Statistics Dr. YU, Chi Wai The following picture illustrates why we cannot minimize these two error probabilities simultaneously. (More details would be discussed in lecture!) Since there is a trade-off between the two types of error: making α smaller will lead to a larger β, and vice versa. So, in designing a test statement, we can only control one of the errors, normally guarantee α in a desired low value, and then find a test statement with β as small as possible. DETERMINATION OF A CRITICAL VALUE Recall that when we design a test of hypothesis, in general we cannot control the two error probabilities at the same time, and what we can do is to control the Type I error probability α in a desired low level, (often use 0.01, 0.05 or 0.1), and then reduce the Type II error probability β as much as we could. How to design a test statement with this restriction of α? With reference to the previous example, we now want to test at α = H 0: μ X = 100 H 1 : μ X = 140 ~ 7 ~
8 MATH411: Applied Statistics Dr. YU, Chi Wai Again, in this example, a large value of the sample mean will lead to the rejection of the null hypothesis H 0. So, we consider Reject H 0 if x > c. Now, we can expect that the critical value c should be determined by the fixed Type I error probability. From now, we would call α a significance level. After some technical steps (discussed in lecture), we have c = and thus the complete test statement: Reject H 0 at a significance level 0.05 if x > Suppose that if the observed value of the sample mean is x = 137, then we could conclude that we DO NOT HAVE ENOUGH EVIDENCE TO REJECT H 0 at a level α = ~ 8 ~
9 MATH411: Applied Statistics Dr. YU, Chi Wai 6 POWER OF A TEST STATEMENT A power of the test statement is defined as 1 β, i.e. the probability of rejecting H 0 if H 0 is false. It is often used to assess the goodness of the test statement. For the comparison of two different test statements, first we need both test statements to have a common α, and then the test statement is said to be better if it has a higher power. Question: How can we increase the power of a given test statement when the value α remains unchanged? Answer: QUESTION Find the power of the test statement Reject H 0 at a significance level 0.05 if x > in the previous example. ~ 9 ~
10 MATH411: Applied Statistics Dr. YU, Chi Wai What would be the test statement and its power if the sample size is changed from 100 to 400? ~ 10 ~
11 MATH411: Applied Statistics Dr. YU, Chi Wai 7 FORMULATION OF A TEST STATEMENT ABOUT μ X (NORMAL CASE) In the following, we ONLY consider the formulation of the test statement for one-sided tests and two-sided test in the case that X follows a Normal distribution, i.e. X N(μ X, σ X ). Recall that when X N(μ X, σ X ), we have the result that X N (μ X, σ X n ). Thus, when σ X is known, we have the following results: 1. One-sided right test: Consider H 0 : μ X = μ 0. H 1 : μ X > μ 0 Intuitively, we reject H 0 if x > c. Consequently, we would Reject H 0 at a significance level α if x > μ 0 + z α σ X n (when σ X is KNOWN). ~ 11 ~
12 MATH411: Applied Statistics Dr. YU, Chi Wai. One-sided left test: Consider H 0 : μ X = μ 0. H 1 : μ X < μ 0 Intuitively, we reject H 0 if x < c. Consequently, we would Reject H 0 at a significance level α if x < μ 0 z α σ X n (when σ X is KNOWN). 3. Two-sided test: Consider H 0 : μ X = μ 0. H 1 : μ X μ 0 Intuitively, we reject H 0 if x < a OR x > b. Consequently, we would Reject H 0 at a significance level α if x μ 0 σ X (when σ X is KNOWN). n > zα ~ 1 ~
13 MATH411: Applied Statistics Dr. YU, Chi Wai Previously in Chapter 4, when σ X is Unknown and we used s n 1 to replace σ X, we had a t distribution to derive the formulas of the random and confidence interval for μ X. Similarly, in the following we would also use the t distribution to get the test statement of the hypothesis about μ X when σ X is Unknown. Recall that If X N(μ X, σ X ), then X μ X S n 1 n t n 1 which means that the random variable on the left follows a t distribution with n 1 degrees of freedom. Thus, when σ X is UNknown, we have the following results: 1. One-sided right test: Consider H 0 : μ X = μ 0. H 1 : μ X > μ 0 Intuitively, we reject H 0 if x > c. Consequently, we would Reject H 0 at a significance level α if x > μ 0 + t n 1,α s n 1 n (when σ X is UNKNOWN). ~ 13 ~
14 MATH411: Applied Statistics Dr. YU, Chi Wai. One-sided left test: Consider H 0 : μ X = μ 0. H 1 : μ X < μ 0 Intuitively, we reject H 0 if x < c. Consequently, we would Reject H 0 at a significance level α if x < μ 0 t n 1,α s n 1 n (when σ X is UNKNOWN). 3. Two-sided test: Consider H 0 : μ X = μ 0. H 1 : μ X μ 0 Intuitively, we reject H 0 if x < a OR x > b. Consequently, we would Reject H 0 at a significance level α if x μ 0 s n 1 (when σ X is UNKNOWN). n > t n 1, α ~ 14 ~
15 MATH411: Applied Statistics Dr. YU, Chi Wai Remark that for the above three tests when σ X is UNknown, we often call the term x μ 0 s n 1 n a t value. In R ( we can use the function t.test to get the t value in the case of UNKNOWN σ X, when all collected data are given. EXAMPLE Frequencies, in hertz (Hz), of 1 elephant calls: 14, 16, 17, 17, 4, 0, 3, 18, 9, 31, 15, 35 Assume that the population of possible elephant call frequencies (X) is a normal distribution, Now a scientist is interested in the expected frequency μ X of X. Do a two-sided test with H 0 : μ X = 10 at a 0.05 level of significance. Note that R only provides us a t value only. When we do a two-sided test, we need to find the absolute value of the t value by ourselves. How to find t n 1, α = t 11, 0.05 in R? ~ 15 ~
16 MATH411: Applied Statistics Dr. YU, Chi Wai QUESTION The average length of time for students to register for classes at a certain college has been 46 minutes. A new registration procedure using modern computing machines is being tried. If a random sample of 1 students had an average registration time of 4 minutes with a standard deviation of 11.9 minutes under the new system. Test the hypothesis that the population mean length of time under the new system is now less than 46. Use a 0.05 level of significance with the assumption that the data are from a normal distribution. ~ 16 ~
17 MATH411: Applied Statistics Dr. YU, Chi Wai 8 FORMULATION OF A TEST STATEMENT ABOUT σ X (NORMAL CASE) S n 1 is the test statistic we would use to formulate the test statement about σ X. Similar to our procedure of using S n 1 to construct a random interval for σ X and then get a confidence interval in Chapter 4, we would use the following theoretical result to get the test statement: If X N(μ X, σ X ), then (n 1)S n 1 σ X χ n 1 which means that the random variable on the left follows a χ distribution with n 1 degrees of freedom. Therefore, we can write down the following general result 1. One-sided right test: Consider H 0 : σ X = σ 0 H 1 : σ X > σ 0. Intuitively, we reject H 0 if s n 1 > c. Consequently, we would Reject H 0 at a significance level α if (n 1)s n 1 σ 0 > χ n 1,α. ~ 17 ~
18 MATH411: Applied Statistics Dr. YU, Chi Wai. One-sided left test: Consider H 0 : σ X = σ 0 H 1 : σ X < σ 0. Intuitively, we reject H 0 if s n 1 < c. Consequently, we would Reject H 0 at a significance level α if (n 1)s n 1 σ 0 < χ n 1,1 α. 3. Two-sided test: Consider H 0 : σ X = σ 0 H 1 : σ X σ 0. Intuitively, we reject H 0 if s n 1 < a OR s n 1 > b. Consequently, we would Reject H 0 at a significance level α if (n 1)s n 1 σ 0 OR (n 1)s n 1 < χ n 1,1 α σ 0 > χ n 1, α. ~ 18 ~
19 MATH411: Applied Statistics Dr. YU, Chi Wai QUESTION A manufacturer of car batteries claims that the life of his batteries is normally distributed with a standard deviation equal to 0.9 year. If a random sample of 10 of these batteries has a standard deviation of 1. years, do you think that σ > 0.9 year? Use a 0.05 level of significance to draw a conclusion. How to find χ n 1,α = χ 9,0.05 in R? ~ 19 ~
20 MATH411: Applied Statistics Dr. YU, Chi Wai 9 TWO-SIDED HYPOTHESIS TESTING VS CONFIDENCE INTERVAL (NORMAL CASE) Recall that when we do a two-sided test for μ X with unknown σ X, i.e. test H 0 : μ X = μ 0 H 1 : μ X μ 0 at a significance level α, we would reject H 0 at a significance level α if x μ 0 s n 1 n > t n 1, α. Or equivalently, we would NOT REJECT H 0 at a significance level α if This is exactly saying that x μ 0 s n 1 n t n 1, α μ 0 x ± t n 1, α s n 1 n. ~ 0 ~
21 MATH411: Applied Statistics Dr. YU, Chi Wai Thus, we have the following approach to use C.I. to draw a conclusion for twosided testing of hypothesis: Given that [a,b] is the 100(1 α)% C.I. for μ X. Thus, to test H 0 : μ X = μ 0 H 1 : μ X μ 0 at a significance level α, it suffices to check if μ 0 is inside OR outside [a, b]. Remark Inside Not reject H0 at the level of significance α Outside Reject H0 at the level of significance α Note that using the confidence interval to do the two-sided test, we have to ensure that the significance level + the confidence level = 1. Similarly, this confidence-interval based approach can also be used for any other two-sided tests, like the two-sided tests of μ X (when σ X is KNOWN) and of σ X. ~ 1 ~
22 MATH411: Applied Statistics Dr. YU, Chi Wai 10 ONE-SIDED HYPOTHESIS TESTING VS CONFIDENCE INTERVAL (NORMAL CASE) Given that [a,b] is the 100(1 α)% C.I. for μ X. If μ 0 < a, then, we can reject H 0 in the one-sided right test H 0 : μ X = μ 0 H 1 : μ X > μ 0 at a significance level α/. Similarly, this confidence-interval based approach can also be used for other onesided right tests, like tests of μ X (when σ X is KNOWN) and of σ X. ~ ~
23 MATH411: Applied Statistics Dr. YU, Chi Wai Given that [a,b] is the 100(1 α)% C.I. for μ X. If μ 0 > b, then, we can reject H 0 in the one-sided left test H 0 : μ X = μ 0 H 1 : μ X < μ 0 at a significance level α/. Similarly, this confidence-interval based approach can also be used for other onesided left tests, like the tests of μ X (when σ X is KNOWN) and of σ X. ~ 3 ~
Statistical Inference. Hypothesis Testing
Statistical Inference Hypothesis Testing Previously, we introduced the point and interval estimation of an unknown parameter(s), say µ and σ 2. However, in practice, the problem confronting the scientist
More informationChapter 7: Hypothesis Testing
Chapter 7: Hypothesis Testing *Mathematical statistics with applications; Elsevier Academic Press, 2009 The elements of a statistical hypothesis 1. The null hypothesis, denoted by H 0, is usually the nullification
More informationIntroductory Econometrics. Review of statistics (Part II: Inference)
Introductory Econometrics Review of statistics (Part II: Inference) Jun Ma School of Economics Renmin University of China October 1, 2018 1/16 Null and alternative hypotheses Usually, we have two competing
More informationBusiness Statistics: Lecture 8: Introduction to Estimation & Hypothesis Testing
Business Statistics: Lecture 8: Introduction to Estimation & Hypothesis Testing Agenda Introduction to Estimation Point estimation Interval estimation Introduction to Hypothesis Testing Concepts en terminology
More informationFirst we look at some terms to be used in this section.
8 Hypothesis Testing 8.1 Introduction MATH1015 Biostatistics Week 8 In Chapter 7, we ve studied the estimation of parameters, point or interval estimates. The construction of CI relies on the sampling
More informationME3620. Theory of Engineering Experimentation. Spring Chapter IV. Decision Making for a Single Sample. Chapter IV
Theory of Engineering Experimentation Chapter IV. Decision Making for a Single Sample Chapter IV 1 4 1 Statistical Inference The field of statistical inference consists of those methods used to make decisions
More informationHypothesis tests
6.1 6.4 Hypothesis tests Prof. Tesler Math 186 February 26, 2014 Prof. Tesler 6.1 6.4 Hypothesis tests Math 186 / February 26, 2014 1 / 41 6.1 6.2 Intro to hypothesis tests and decision rules Hypothesis
More informationQuantitative Methods for Economics, Finance and Management (A86050 F86050)
Quantitative Methods for Economics, Finance and Management (A86050 F86050) Matteo Manera matteo.manera@unimib.it Marzio Galeotti marzio.galeotti@unimi.it 1 This material is taken and adapted from Guy Judge
More informationMathematical Statistics
Mathematical Statistics MAS 713 Chapter 8 Previous lecture: 1 Bayesian Inference 2 Decision theory 3 Bayesian Vs. Frequentist 4 Loss functions 5 Conjugate priors Any questions? Mathematical Statistics
More informationCONTINUOUS RANDOM VARIABLES
the Further Mathematics network www.fmnetwork.org.uk V 07 REVISION SHEET STATISTICS (AQA) CONTINUOUS RANDOM VARIABLES The main ideas are: Properties of Continuous Random Variables Mean, Median and Mode
More informationPHP2510: Principles of Biostatistics & Data Analysis. Lecture X: Hypothesis testing. PHP 2510 Lec 10: Hypothesis testing 1
PHP2510: Principles of Biostatistics & Data Analysis Lecture X: Hypothesis testing PHP 2510 Lec 10: Hypothesis testing 1 In previous lectures we have encountered problems of estimating an unknown population
More informationSTAT Chapter 8: Hypothesis Tests
STAT 515 -- Chapter 8: Hypothesis Tests CIs are possibly the most useful forms of inference because they give a range of reasonable values for a parameter. But sometimes we want to know whether one particular
More informationEC2001 Econometrics 1 Dr. Jose Olmo Room D309
EC2001 Econometrics 1 Dr. Jose Olmo Room D309 J.Olmo@City.ac.uk 1 Revision of Statistical Inference 1.1 Sample, observations, population A sample is a number of observations drawn from a population. Population:
More informationNull Hypothesis Significance Testing p-values, significance level, power, t-tests Spring 2017
Null Hypothesis Significance Testing p-values, significance level, power, t-tests 18.05 Spring 2017 Understand this figure f(x H 0 ) x reject H 0 don t reject H 0 reject H 0 x = test statistic f (x H 0
More informationPhysicsAndMathsTutor.com
1. A manager in a sweet factory believes that the machines are working incorrectly and the proportion p of underweight bags of sweets is more than 5%. He decides to test this by randomly selecting a sample
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Chapter 9 Hypothesis Testing: Single Population Ch. 9-1 9.1 What is a Hypothesis? A hypothesis is a claim (assumption) about a population parameter: population
More informationLecture Testing Hypotheses: The Neyman-Pearson Paradigm
Math 408 - Mathematical Statistics Lecture 29-30. Testing Hypotheses: The Neyman-Pearson Paradigm April 12-15, 2013 Konstantin Zuev (USC) Math 408, Lecture 29-30 April 12-15, 2013 1 / 12 Agenda Example:
More informationThe Purpose of Hypothesis Testing
Section 8 1A:! An Introduction to Hypothesis Testing The Purpose of Hypothesis Testing See s Candy states that a box of it s candy weighs 16 oz. They do not mean that every single box weights exactly 16
More informationPOLI 443 Applied Political Research
POLI 443 Applied Political Research Session 4 Tests of Hypotheses The Normal Curve Lecturer: Prof. A. Essuman-Johnson, Dept. of Political Science Contact Information: aessuman-johnson@ug.edu.gh College
More informationLECTURE 12 CONFIDENCE INTERVAL AND HYPOTHESIS TESTING
LECTURE 1 CONFIDENCE INTERVAL AND HYPOTHESIS TESTING INTERVAL ESTIMATION Point estimation of : The inference is a guess of a single value as the value of. No accuracy associated with it. Interval estimation
More informationMTMS Mathematical Statistics
MTMS.01.099 Mathematical Statistics Lecture 12. Hypothesis testing. Power function. Approximation of Normal distribution and application to Binomial distribution Tõnu Kollo Fall 2016 Hypothesis Testing
More informationexp{ (x i) 2 i=1 n i=1 (x i a) 2 (x i ) 2 = exp{ i=1 n i=1 n 2ax i a 2 i=1
4 Hypothesis testing 4. Simple hypotheses A computer tries to distinguish between two sources of signals. Both sources emit independent signals with normally distributed intensity, the signals of the first
More informationSection 5.4: Hypothesis testing for μ
Section 5.4: Hypothesis testing for μ Possible claims or hypotheses: Ball bearings have μ = 1 cm Medicine decreases blood pressure For testing hypotheses, we set up a null (H 0 ) and alternative (H a )
More informationSampling Distributions: Central Limit Theorem
Review for Exam 2 Sampling Distributions: Central Limit Theorem Conceptually, we can break up the theorem into three parts: 1. The mean (µ M ) of a population of sample means (M) is equal to the mean (µ)
More information280 CHAPTER 9 TESTS OF HYPOTHESES FOR A SINGLE SAMPLE Tests of Statistical Hypotheses
280 CHAPTER 9 TESTS OF HYPOTHESES FOR A SINGLE SAMPLE 9-1.2 Tests of Statistical Hypotheses To illustrate the general concepts, consider the propellant burning rate problem introduced earlier. The null
More informationFor use only in [the name of your school] 2014 S4 Note. S4 Notes (Edexcel)
s (Edexcel) Copyright www.pgmaths.co.uk - For AS, A2 notes and IGCSE / GCSE worksheets 1 Copyright www.pgmaths.co.uk - For AS, A2 notes and IGCSE / GCSE worksheets 2 Copyright www.pgmaths.co.uk - For AS,
More informationHypothesis for Means and Proportions
November 14, 2012 Hypothesis Tests - Basic Ideas Often we are interested not in estimating an unknown parameter but in testing some claim or hypothesis concerning a population. For example we may wish
More informationChapter 24. Comparing Means
Chapter 4 Comparing Means!1 /34 Homework p579, 5, 7, 8, 10, 11, 17, 31, 3! /34 !3 /34 Objective Students test null and alternate hypothesis about two!4 /34 Plot the Data The intuitive display for comparing
More informationECO220Y Review and Introduction to Hypothesis Testing Readings: Chapter 12
ECO220Y Review and Introduction to Hypothesis Testing Readings: Chapter 12 Winter 2012 Lecture 13 (Winter 2011) Estimation Lecture 13 1 / 33 Review of Main Concepts Sampling Distribution of Sample Mean
More informationChapter Three. Hypothesis Testing
3.1 Introduction The final phase of analyzing data is to make a decision concerning a set of choices or options. Should I invest in stocks or bonds? Should a new product be marketed? Are my products being
More information41.2. Tests Concerning a Single Sample. Introduction. Prerequisites. Learning Outcomes
Tests Concerning a Single Sample 41.2 Introduction This Section introduces you to the basic ideas of hypothesis testing in a non-mathematical way by using a problem solving approach to highlight the concepts
More information12.10 (STUDENT CD-ROM TOPIC) CHI-SQUARE GOODNESS- OF-FIT TESTS
CDR4_BERE601_11_SE_C1QXD 1//08 1:0 PM Page 1 110: (Student CD-ROM Topic) Chi-Square Goodness-of-Fit Tests CD1-1 110 (STUDENT CD-ROM TOPIC) CHI-SQUARE GOODNESS- OF-FIT TESTS In this section, χ goodness-of-fit
More informationCENTRAL LIMIT THEOREM (CLT)
CENTRAL LIMIT THEOREM (CLT) A sampling distribution is the probability distribution of the sample statistic that is formed when samples of size n are repeatedly taken from a population. If the sample statistic
More informationOne sided tests. An example of a two sided alternative is what we ve been using for our two sample tests:
One sided tests So far all of our tests have been two sided. While this may be a bit easier to understand, this is often not the best way to do a hypothesis test. One simple thing that we can do to get
More informationHypothesis Testing. ) the hypothesis that suggests no change from previous experience
Hypothesis Testing Definitions Hypothesis a claim about something Null hypothesis ( H 0 ) the hypothesis that suggests no change from previous experience Alternative hypothesis ( H 1 ) the hypothesis that
More informationSection 9.4. Notation. Requirements. Definition. Inferences About Two Means (Matched Pairs) Examples
Objective Section 9.4 Inferences About Two Means (Matched Pairs) Compare of two matched-paired means using two samples from each population. Hypothesis Tests and Confidence Intervals of two dependent means
More informationSTAT 135 Lab 6 Duality of Hypothesis Testing and Confidence Intervals, GLRT, Pearson χ 2 Tests and Q-Q plots. March 8, 2015
STAT 135 Lab 6 Duality of Hypothesis Testing and Confidence Intervals, GLRT, Pearson χ 2 Tests and Q-Q plots March 8, 2015 The duality between CI and hypothesis testing The duality between CI and hypothesis
More information1; (f) H 0 : = 55 db, H 1 : < 55.
Reference: Chapter 8 of J. L. Devore s 8 th Edition By S. Maghsoodloo TESTING a STATISTICAL HYPOTHESIS A statistical hypothesis is an assumption about the frequency function(s) (i.e., pmf or pdf) of one
More informationChapter 7: Hypothesis Testing - Solutions
Chapter 7: Hypothesis Testing - Solutions 7.1 Introduction to Hypothesis Testing The problem with applying the techniques learned in Chapter 5 is that typically, the population mean (µ) and standard deviation
More informationHypothesis Testing: One Sample
Hypothesis Testing: One Sample ELEC 412 PROF. SIRIPONG POTISUK General Procedure Although the exact value of a parameter may be unknown, there is often some idea(s) or hypothesi(e)s about its true value
More informationStatistical Process Control (contd... )
Statistical Process Control (contd... ) ME522: Quality Engineering Vivek Kumar Mehta November 11, 2016 Note: This lecture is prepared with the help of material available online at https://onlinecourses.science.psu.edu/
More information6.4 Type I and Type II Errors
6.4 Type I and Type II Errors Ulrich Hoensch Friday, March 22, 2013 Null and Alternative Hypothesis Neyman-Pearson Approach to Statistical Inference: A statistical test (also known as a hypothesis test)
More informationAMS7: WEEK 7. CLASS 1. More on Hypothesis Testing Monday May 11th, 2015
AMS7: WEEK 7. CLASS 1 More on Hypothesis Testing Monday May 11th, 2015 Testing a Claim about a Standard Deviation or a Variance We want to test claims about or 2 Example: Newborn babies from mothers taking
More information8.1-4 Test of Hypotheses Based on a Single Sample
8.1-4 Test of Hypotheses Based on a Single Sample Example 1 (Example 8.6, p. 312) A manufacturer of sprinkler systems used for fire protection in office buildings claims that the true average system-activation
More informationSummary: the confidence interval for the mean (σ 2 known) with gaussian assumption
Summary: the confidence interval for the mean (σ known) with gaussian assumption on X Let X be a Gaussian r.v. with mean µ and variance σ. If X 1, X,..., X n is a random sample drawn from X then the confidence
More informationINTERVAL ESTIMATION AND HYPOTHESES TESTING
INTERVAL ESTIMATION AND HYPOTHESES TESTING 1. IDEA An interval rather than a point estimate is often of interest. Confidence intervals are thus important in empirical work. To construct interval estimates,
More informationNull Hypothesis Significance Testing p-values, significance level, power, t-tests
Null Hypothesis Significance Testing p-values, significance level, power, t-tests 18.05 Spring 2014 January 1, 2017 1 /22 Understand this figure f(x H 0 ) x reject H 0 don t reject H 0 reject H 0 x = test
More informationIntroduction to Statistical Inference
Introduction to Statistical Inference Dr. Fatima Sanchez-Cabo f.sanchezcabo@tugraz.at http://www.genome.tugraz.at Institute for Genomics and Bioinformatics, Graz University of Technology, Austria Introduction
More informationChapter 8 of Devore , H 1 :
Chapter 8 of Devore TESTING A STATISTICAL HYPOTHESIS Maghsoodloo A statistical hypothesis is an assumption about the frequency function(s) (i.e., PDF or pdf) of one or more random variables. Stated in
More informationz and t tests for the mean of a normal distribution Confidence intervals for the mean Binomial tests
z and t tests for the mean of a normal distribution Confidence intervals for the mean Binomial tests Chapters 3.5.1 3.5.2, 3.3.2 Prof. Tesler Math 283 Fall 2018 Prof. Tesler z and t tests for mean Math
More informationProbability and Statistics
Probability and Statistics Kristel Van Steen, PhD 2 Montefiore Institute - Systems and Modeling GIGA - Bioinformatics ULg kristel.vansteen@ulg.ac.be CHAPTER 4: IT IS ALL ABOUT DATA 4a - 1 CHAPTER 4: IT
More informationTests about a population mean
October 2 nd, 2017 Overview Week 1 Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 1: Descriptive statistics Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation Chapter 8: Confidence
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter Seven Jesse Crawford Department of Mathematics Tarleton State University Spring 2011 (Tarleton State University) Chapter Seven Notes Spring 2011 1 / 42 Outline
More informationMath 101: Elementary Statistics Tests of Hypothesis
Tests of Hypothesis Department of Mathematics and Computer Science University of the Philippines Baguio November 15, 2018 Basic Concepts of Statistical Hypothesis Testing A statistical hypothesis is an
More informationPOLI 443 Applied Political Research
POLI 443 Applied Political Research Session 6: Tests of Hypotheses Contingency Analysis Lecturer: Prof. A. Essuman-Johnson, Dept. of Political Science Contact Information: aessuman-johnson@ug.edu.gh College
More informationIn any hypothesis testing problem, there are two contradictory hypotheses under consideration.
8.1 Hypotheses and Test Procedures: A hypothesis One example of a hypothesis is p =.5, if we are testing if a new formula for a soda is preferred to the old formula (p=.5 assumes that they are preferred
More informationHypothesis Testing. ECE 3530 Spring Antonio Paiva
Hypothesis Testing ECE 3530 Spring 2010 Antonio Paiva What is hypothesis testing? A statistical hypothesis is an assertion or conjecture concerning one or more populations. To prove that a hypothesis is
More informationSection 10.1 (Part 2 of 2) Significance Tests: Power of a Test
1 Section 10.1 (Part 2 of 2) Significance Tests: Power of a Test Learning Objectives After this section, you should be able to DESCRIBE the relationship between the significance level of a test, P(Type
More informationHypothesis Testing and Confidence Intervals (Part 2): Cohen s d, Logic of Testing, and Confidence Intervals
Hypothesis Testing and Confidence Intervals (Part 2): Cohen s d, Logic of Testing, and Confidence Intervals Lecture 9 Justin Kern April 9, 2018 Measuring Effect Size: Cohen s d Simply finding whether a
More information4 Hypothesis testing. 4.1 Types of hypothesis and types of error 4 HYPOTHESIS TESTING 49
4 HYPOTHESIS TESTING 49 4 Hypothesis testing In sections 2 and 3 we considered the problem of estimating a single parameter of interest, θ. In this section we consider the related problem of testing whether
More informationIntroduction to Statistics
MTH4106 Introduction to Statistics Notes 15 Spring 2013 Testing hypotheses about the mean Earlier, we saw how to test hypotheses about a proportion, using properties of the Binomial distribution It is
More information23. MORE HYPOTHESIS TESTING
23. MORE HYPOTHESIS TESTING The Logic Behind Hypothesis Testing For simplicity, consider testing H 0 : µ = µ 0 against the two-sided alternative H A : µ µ 0. Even if H 0 is true (so that the expectation
More informationPreliminary Statistics Lecture 5: Hypothesis Testing (Outline)
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 5: Hypothesis Testing (Outline) Gujarati D. Basic Econometrics, Appendix A.8 Barrow M. Statistics
More informationElementary Statistics Triola, Elementary Statistics 11/e Unit 17 The Basics of Hypotheses Testing
(Section 8-2) Hypotheses testing is not all that different from confidence intervals, so let s do a quick review of the theory behind the latter. If it s our goal to estimate the mean of a population,
More informationPurposes of Data Analysis. Variables and Samples. Parameters and Statistics. Part 1: Probability Distributions
Part 1: Probability Distributions Purposes of Data Analysis True Distributions or Relationships in the Earths System Probability Distribution Normal Distribution Student-t Distribution Chi Square Distribution
More informationEXAM 3 Math 1342 Elementary Statistics 6-7
EXAM 3 Math 1342 Elementary Statistics 6-7 Name Date ********************************************************************************************************************************************** MULTIPLE
More informationHypothesis Tests Solutions COR1-GB.1305 Statistics and Data Analysis
Hypothesis Tests Solutions COR1-GB.1305 Statistics and Data Analysis Introduction 1. An analyst claims to have a reliable model for Twitter s quarterly revenues. His model predicted that the most recent
More informationThe t-distribution. Patrick Breheny. October 13. z tests The χ 2 -distribution The t-distribution Summary
Patrick Breheny October 13 Patrick Breheny Biostatistical Methods I (BIOS 5710) 1/25 Introduction Introduction What s wrong with z-tests? So far we ve (thoroughly!) discussed how to carry out hypothesis
More informationSome Statistics. V. Lindberg. May 16, 2007
Some Statistics V. Lindberg May 16, 2007 1 Go here for full details An excellent reference written by physicists with sample programs available is Data Reduction and Error Analysis for the Physical Sciences,
More informationF79SM STATISTICAL METHODS
F79SM STATISTICAL METHODS SUMMARY NOTES 9 Hypothesis testing 9.1 Introduction As before we have a random sample x of size n of a population r.v. X with pdf/pf f(x;θ). The distribution we assign to X is
More informationCIVL /8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8
CIVL - 7904/8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8 Chi-square Test How to determine the interval from a continuous distribution I = Range 1 + 3.322(logN) I-> Range of the class interval
More informationHypotheses Test Procedures. Is the claim wrong?
Hypotheses Test Procedures MATH 2300 Sections 9.1 and 9.2 Is the claim wrong? An oil company representative claims that the average price for gasoline in Lubbock is $2.30 per gallon. You think the average
More informationLECTURE 5 HYPOTHESIS TESTING
October 25, 2016 LECTURE 5 HYPOTHESIS TESTING Basic concepts In this lecture we continue to discuss the normal classical linear regression defined by Assumptions A1-A5. Let θ Θ R d be a parameter of interest.
More informationThe Components of a Statistical Hypothesis Testing Problem
Statistical Inference: Recall from chapter 5 that statistical inference is the use of a subset of a population (the sample) to draw conclusions about the entire population. In chapter 5 we studied one
More informationPreliminary Statistics. Lecture 5: Hypothesis Testing
Preliminary Statistics Lecture 5: Hypothesis Testing Rory Macqueen (rm43@soas.ac.uk), September 2015 Outline Elements/Terminology of Hypothesis Testing Types of Errors Procedure of Testing Significance
More informationChapter 8 - Statistical intervals for a single sample
Chapter 8 - Statistical intervals for a single sample 8-1 Introduction In statistics, no quantity estimated from data is known for certain. All estimated quantities have probability distributions of their
More informationClass 24. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700
Class 4 Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science Copyright 013 by D.B. Rowe 1 Agenda: Recap Chapter 9. and 9.3 Lecture Chapter 10.1-10.3 Review Exam 6 Problem Solving
More informationTwo sample Test. Paired Data : Δ = 0. Lecture 3: Comparison of Means. d s d where is the sample average of the differences and is the
Gene$cs 300: Sta$s$cal Analysis of Biological Data Lecture 3: Comparison of Means Two sample t test Analysis of variance Type I and Type II errors Power More R commands September 23, 2010 Two sample Test
More informationParameter Estimation, Sampling Distributions & Hypothesis Testing
Parameter Estimation, Sampling Distributions & Hypothesis Testing Parameter Estimation & Hypothesis Testing In doing research, we are usually interested in some feature of a population distribution (which
More informationOne- and Two-Sample Tests of Hypotheses
One- and Two-Sample Tests of Hypotheses 1- Introduction and Definitions Often, the problem confronting the scientist or engineer is producing a conclusion about some scientific system. For example, a medical
More informationBasic Concepts of Inference
Basic Concepts of Inference Corresponds to Chapter 6 of Tamhane and Dunlop Slides prepared by Elizabeth Newton (MIT) with some slides by Jacqueline Telford (Johns Hopkins University) and Roy Welsch (MIT).
More informationInference for Proportions, Variance and Standard Deviation
Inference for Proportions, Variance and Standard Deviation Sections 7.10 & 7.6 Cathy Poliak, Ph.D. cathy@math.uh.edu Office Fleming 11c Department of Mathematics University of Houston Lecture 12 Cathy
More informationStatistics 251: Statistical Methods
Statistics 251: Statistical Methods 1-sample Hypothesis Tests Module 9 2018 Introduction We have learned about estimating parameters by point estimation and interval estimation (specifically confidence
More informationBIO5312 Biostatistics Lecture 6: Statistical hypothesis testings
BIO5312 Biostatistics Lecture 6: Statistical hypothesis testings Yujin Chung October 4th, 2016 Fall 2016 Yujin Chung Lec6: Statistical hypothesis testings Fall 2016 1/30 Previous Two types of statistical
More informationStatistical Hypothesis Testing
Statistical Hypothesis Testing Dr. Phillip YAM 2012/2013 Spring Semester Reference: Chapter 7 of Tests of Statistical Hypotheses by Hogg and Tanis. Section 7.1 Tests about Proportions A statistical hypothesis
More informationLecture 7: Hypothesis Testing and ANOVA
Lecture 7: Hypothesis Testing and ANOVA Goals Overview of key elements of hypothesis testing Review of common one and two sample tests Introduction to ANOVA Hypothesis Testing The intent of hypothesis
More informationLectures 5 & 6: Hypothesis Testing
Lectures 5 & 6: Hypothesis Testing in which you learn to apply the concept of statistical significance to OLS estimates, learn the concept of t values, how to use them in regression work and come across
More informationPhysicsAndMathsTutor.com
1. An effect of a certain disease is that a small number of the red blood cells are deformed. Emily has this disease and the deformed blood cells occur randomly at a rate of 2.5 per ml of her blood. Following
More informationhypothesis a claim about the value of some parameter (like p)
Testing hypotheses hypothesis a claim about the value of some parameter (like p) significance test procedure to assess the strength of evidence provided by a sample of data against the claim of a hypothesized
More informationChapter 9. Hypothesis testing. 9.1 Introduction
Chapter 9 Hypothesis testing 9.1 Introduction Confidence intervals are one of the two most common types of statistical inference. Use them when our goal is to estimate a population parameter. The second
More informationLecture 1: Probability Fundamentals
Lecture 1: Probability Fundamentals IB Paper 7: Probability and Statistics Carl Edward Rasmussen Department of Engineering, University of Cambridge January 22nd, 2008 Rasmussen (CUED) Lecture 1: Probability
More informationStatistics for IT Managers
Statistics for IT Managers 95-796, Fall 2012 Module 2: Hypothesis Testing and Statistical Inference (5 lectures) Reading: Statistics for Business and Economics, Ch. 5-7 Confidence intervals Given the sample
More informationSection 9.5. Testing the Difference Between Two Variances. Bluman, Chapter 9 1
Section 9.5 Testing the Difference Between Two Variances Bluman, Chapter 9 1 This the last day the class meets before spring break starts. Please make sure to be present for the test or make appropriate
More informationCHAPTER 10 HYPOTHESIS TESTING WITH TWO SAMPLES
CHAPTER 10 HYPOTHESIS TESTING WITH TWO SAMPLES In this chapter our hypothesis tests allow us to compare the means (or proportions) of two different populations using a sample from each population For example,
More informationMathematical statistics
November 1 st, 2018 Lecture 18: Tests about a population mean Overview 9.1 Hypotheses and test procedures test procedures errors in hypothesis testing significance level 9.2 Tests about a population mean
More informationInferences for Regression
Inferences for Regression An Example: Body Fat and Waist Size Looking at the relationship between % body fat and waist size (in inches). Here is a scatterplot of our data set: Remembering Regression In
More informationa. See the textbook for examples of proving logical equivalence using truth tables. b. There is a real number x for which f (x) < 0. (x 1) 2 > 0.
For some problems, several sample proofs are given here. Problem 1. a. See the textbook for examples of proving logical equivalence using truth tables. b. There is a real number x for which f (x) < 0.
More informationTwo-Sample Inferential Statistics
The t Test for Two Independent Samples 1 Two-Sample Inferential Statistics In an experiment there are two or more conditions One condition is often called the control condition in which the treatment is
More informationFrequentist Statistics and Hypothesis Testing Spring
Frequentist Statistics and Hypothesis Testing 18.05 Spring 2018 http://xkcd.com/539/ Agenda Introduction to the frequentist way of life. What is a statistic? NHST ingredients; rejection regions Simple
More informationSTAT 515 fa 2016 Lec Statistical inference - hypothesis testing
STAT 515 fa 2016 Lec 20-21 Statistical inference - hypothesis testing Karl B. Gregory Wednesday, Oct 12th Contents 1 Statistical inference 1 1.1 Forms of the null and alternate hypothesis for µ and p....................
More information