Finansiell Statistik, GN, 15 hp, VT2008 Lecture 10-11: Statistical Inference: Hypothesis Testing
|
|
- Tamsyn Boone
- 5 years ago
- Views:
Transcription
1 Finansiell Statistik, GN, 15 hp, VT008 Lecture 10-11: Statistical Inference: Hypothesis Testing Gebrenegus Ghilagaber, PhD, Associate Professor April 1, 008 1
2 1 Statistical Inferences: Introduction Recall: Statistics may be grossly devided into: Descriptive Statistics Data Collection Data Presentation Data Analysis and
3 Inferential Statistics - deals with ways/methods of drawing sound generalizations about a populations based on information contained in a sample. This may be done in two ways: 1. Estimation (complete ignorance) Point Estimation Interval Estimation (Con dence Interval). Hypothesis Testing (partial ignorance)
4 Basic Concepts in Hypothsis Testing A statistical hypothesis is a temporary statement (an assertion) about a population probability distribution or its parameter The aim in hypothesis-testing is to test the extent of truth of this temporary statement using information contained in a sample The primary hypothesis to be tested is called Null-hypotheis and is denoted by H 0. The hypothesis to be kept (maintained) if the Null-hypothesis is to be rejected (Nulli ed) is called the Alternative-hypothesis and is denoted by H 1 or H A. 4
5 The signi cance level of a test, denoted by, is a measure of the probability of rejecting a true hypothesis (see details below). It is also called size of the test or level of the test. A test statistic is a function of the sample upon which the statistical decision will be based. 5
6 .1 One Tailed and Two Tailed Alternatives Two-tailed (two-sided) test: H 0 : = 0 H 1 : 6= 0 One-tailed (one-sided) test: H 0 : = 0 H A : > 0 or H 0 : = 0 H A : < 0 6
7 . Type I Error and the Probability of Type I Error In any hypothesis testing procedure, one of the following can happen: Decision Null hypotheis (H 0 ) is Reject H 0 Do not reject H 0 True Type I error Correct decision False Correct decision Type II error Thus, We commit Type I error when we reject a true hypothesis. The probability of such error is denoted by and is known as the signifcance level (size of a test, or level of a test) 7
8 The probability of Not commiting Type I error - the probability of "accepting" a true hypotheis - is given by 1 and is known as the con dence level. P (Re ject H 0 jh 0 is true) = P(Type I error) = (signi cance level) P (Do not Re ject H 0 jh 0 is true) = 1 (con dence level) 8
9 . Type II Error and the Probability of Type II Error We commit Type II error when we fail to reject a False hypothesis. The probability of such error is denoted by. P (Do not Re ject H 0 jh 0 is False) = P (Re ject H 0 jh 0 is False) = 1 (power of a test) 9
10 .4 Power of a test The probability of Not commiting type II error - rejecting a false hypotheis - is given by 1 and is known as the Power of the Test. In other words, the Power of the Test is its capacity to detect a False hypothesis. Power of a test = P (Re jct H 0 jh 0 is False) = 1 10
11 .5 Some Remarks A statistical hypothesis can never be accepted (unless n = N) - the poorman example and are inversely related - show graphically Thus, we cannot minimize them simultaneously as one of them will increase when we decrease the other. Thus, we often x the type I error and then look for the most powerful tests (tests with smallest possible values of ) for a given value of : Which error is more "serious"? 11
12 .6 Large sample Tests on the mean (one-tailed and twotailed) Case 1: Two-tailed test: H 0 : = 0 H A : 6= 0 Test statistic when sample size (n) is large (when we can make use of CLT) is given by 1
13 Z = X 0 = p n = X 0 s= p n and we reject H 0 if Z > Z or Z Z 1
14 Case : One-tailed test (to the right): H 0 : = 0 H A : > 0 Test statistic when sample size (n) is large (when we can make use of CLT) is given by Z = X 0 = p n = X 0 s= p n and we reject H 0 if Z > Z 14
15 Case : One-tailed test (to the left): H 0 : = 0 H A : < 0 Test statistic when sample size (n) is large (when we can make use of CLT) is given by Z = X 0 = p n = X 0 s= p n and we reject H 0 if Z Z 15
16 .7 Small sample Tests on the mean with unknown standard devation (one-tailed and two-tailed) Case 1: Two-tailed test: H 0 : = 0 H A : 6= 0 Test statistic when sample size (n) is small (when we can t make use of CLT) is given by t = X 0 s= p n 16
17 and we reject H 0 if t > t n 1; or t t n 1; 17
18 Case : One-tailed test (to the right): H 0 : = 0 H A : > 0 Test statistic when sample size (n) is small (when we can t make use of CLT) is given by t = X 0 s= p n and we reject H 0 if t > t (n 1;) 18
19 Case : One-tailed test (to the left): H 0 : = 0 H A : < 0 Test statistic when sample size (n) is small (when we can t make use of CLT) is given by and we reject H 0 if t t (n 1;) t = X 0 s= p n 19
20 .8 Tests of di erences between two means (one-tailed and two-tailed).8.1 Large sample cases The above procedures may be extended to the case of comparing means from two populations. Thus, we have Case 1: Two-tailed test: H 0 : 1 = =) 1 = 0 H A : 1 6= =) 1 6= 0 0
21 Test statistic when sample sizes (n 1 and n ) are large (when we can make use of CLT) is given by where z = = X1 X1 X ( 1 ) 0 SE(X 1 X ) X SE(X 1 X ) q SE(X 1 X ) = V ar(x 1 ) + V ar(x ) s V ar(x1 ) = + V ar(x ) n 1 n if the two samples are independent, or (in the case of paired samples), 1
22 where SE(X 1 X ) = v u t Sp 1 n n! is the pooled variance. S p = (n 1 1) S 1 + (n 1) S n 1 + n In any case, we reject H 0 if Z > Z or Z Z :
23 Case : One-tailed test (to the right): H 0 : 1 = =) 1 = 0 H A : 1 > =) 1 > 0 Test statistic when sample sizes (n 1 and n ) are large (when we can make use of CLT) is given by Z = X1 X SE(X 1 X ) and we reject H 0 if Z > Z
24 Case : One-tailed test (to the left): H 0 : 1 = =) 1 = 0 H A : 1 < =) 1 < 0 Test statistic when sample sizes (n 1 and n ) are large (when we can make use of CLT) is given by Z = and we reject H 0 if Z Z. X1 X SE(X 1 X ) 4
25 .8. Small sample cases The appropriate test statistic when sample sizes (n 1 or n or both) are small (when we can t make use of CLT) is given by t = X1 X SE(X 1 X ) and it is compared with t (n1+n tests for a single mean. ) in the same way as we did for the case in 5
26 .9 Determining the sample size based on Z, Z, 0, and A. Recall, = P (Reject H 0 jh 0 is true) = P (X > kj = 0 ) so that = P X 0 s= p n > k 0 s= p n j = 0 = P (Z > Z )! 6
27 Z = k 0 s= p n s =) k = 0 + Z p n (1) 7
28 Similarly, = P ("Accept H 0 jh 0 is False) = P (X < kj = A ) = P X A s= p n < k A s= p n j = A = P Z < Z! so that Z = k A s= p n s =) k = A Z p n () 8
29 Equating (1) and (), we get, so that 0 + Z s p n = A Z s p n n = S Z + Z ( A 0 ) In other words, the minimum sample size required to test a hypothesis on the population mean is a function of four factors: 1. The variance, S (the larger the variance the larger the value of n). The di erence between the values of under the null and alternative hypotheses, A 0 ; (the larger the di erence the smaller the value of n) 9
30 . The size of type I error, (the smaller the value of the larger the value of n) 4. The size of type II error, (the smaller the value of the larger the value of n) 0
31 .10 Tests on Proportions (one-tailed and two-tailed) The procedures used for tests on population means and di erences between two population means may also be applied to make tests on proportions or di erences between proportions of two populations: H 0 : P = P 0 H A : P 6= P 0 The test statistic is given by z = bp P b 0 SE( P b ) = P P 0 r P 0 (1 P 0 ) n 1
32 or t = bp P b 0 SE( P b ) = P P 0 r P 0 (1 P 0 ) n depending on whether our sample size is large or small.
33 Similar procedure applies in testing H 0 : P 1 = P H A : P 1 6= P The test statistic is given by z = bp 1 b P SE( b P 1 b P ) = b P 1 r bp1 (1 b P1 ) bp n 1 + b P (1 b P ) n
34 in the case of independent samples, or z = bp b 1 P b SE( P b b 1 P ) = P 1 bp r bp (1 P b ) 1 n1 + n 1 in the case of paired samples, where bp = X 1 + X n 1 + n is the proportion of "successes" in the mixed sample. 4
35 .11 Chi-square tests on the variance of normal population Suppose, x 1 ; x ; :::; x n is a random sample from a normal population with unknown variance ; and we want to test H 0 : = 0 We recall that, H A : > 0 (n 1)S s (n 1) Thus, an appropriate test statistic to test the above hypothesis would be: = (n 1)S 0 5
36 and reject H 0 if > (n 1;) 6
37 .1 Tests on the equality of variances of two normal populations Suppose, x 1 ; x ; :::; x n is a random sample from a normal population with unknown variance 1 ; and y 1; y ; :::; y n is a random sample from a normal population with unknown variance : Our goal is to test the hypothesis We recall that, H 0 : 1 = H A : 1 > (n 1 1)S 1 1 s (n 1 1) 7
38 and that (n1 1)S1 1 (n 1)S (n 1)S = (n 1 1) = (n 1) s (n 1) s F (n1 1; n 1) Thus, an appropriate test statistic to test the above hypothesis would be: F = (n1 1)S1 1 (n 1)S and reject H 0 if F > F (n1 1; n 1;) = (n 1 1) = (n 1) = S 1 S Remark: Formulate the hypothesis in such a way that the larger variance appears as a numerator - in order to get a value of F that is at least 1 (and not 8
39 a fraction) ready to be compared with table values. 9
40 Relatioship between con dence interval and hypothesis testing Recall that a two-sided 100(1 mean is given by the interval )% con dence interval for the population! s s X Z p ; X + Z p n n () Similarly, a two-tailed test on is formulated as H 0 : = 0 H 1 : 6= 0 40
41 and we reject H 0 if Z > Z or Z < Z ; where Z = X 0 s= p n : 41
42 In other words, we don t reject H 0 if Z < Z < Z =) Z < X 0 s= p n < Z =) Z s p n < X 0 < Z s p n =) X Z s p n < 0 < X + Z s p n =) X + Z s p n > 0 > X Z s p n =) X Z s p n < 0 < X + Z s p n 4
43 To sum up, in testing H 0 : = 0 H 1 : 6= 0 the null hypothesis will not be rejected if 0 lies within the interval! s s X Z p ; X + Z p n n which is just the Recall that a two-sided 100(1 )% con dence interval for the population mean is given by the interval given in (). Similar argument applies for other parameters such as di erence between means, 1 or population variances P: 4
44 4 Computing and plotting the power of a test Consider testing the hypothesis: H 0 : = 0 H 1 : 6= 0 at = 5%: Then, the Null hypothesis will be rejected if the calculated test statistic, Z cal is greater than 1:96 or less than 1:96; that is if Z cal = X 0 s= p n > 1:96 or Z cal = X 0 s= p n < 1:96 which, in turn, means we reject H 0 if! s X > 0 + 1:96 p or X < 0 n 1:96! s p n 44
45 In other words, we don t reject H 0 if 0 1:96 s p n! < X < 0 + 1:96! s p n Thus, the probability of type II error, ; may be computed as = P (we don0t reject H 0 jh 0 is false) ; and the corresponding power, ; may be obtained as = 1 : Suppose now that 0 = 15 and that a sample of 6 observations gave X = 17 and S = 9: Then, H 0 is false means that 6= 15 which, in turn, means that the true value of can be any value except
46 Consider one possible value, say 16. Then, = P (we don0t reject H 0 jh 0 is false) "! s = P 1:96 p < X < 0 + 1:96 n 0! # s p = 16 n = P 15 1:96 < X < :96 = = P h 14:0 < X < 15:98 = 16 i 14:0 16 = P 4 < X < 15:98 16 = P [ :96 < Z < 0:04] = ( 0:04) ( :96) = 0: :00004 = 0:4840 so the power at = 16 is given by (16) = P (Reject H 0 : = 15j = 16) = 1 = 1 0:48401 = 0:
47 Similarly, at = 17; we have = P h 14:0 < X < 15:98 = 17 i = P 4 14: < X 17 6 < 15:98 17 = P [ 5:96 < Z < :04] = ( :04) ( 5:96) = 0:0068 0:0000 = 0:0068 and the corresponding power is given by (17) = P (Reject H 0 : = 15j = 17) = 1 = 1 0:0068 = 0:
48 At = 15:5; we have so that = P h 14:0 < X < 15:98 = 15:5 i = P 4 14:0 15:5 6 < X 15:5 6 < 15:98 15:5 = P [ :96 < Z < 0:96] = (0:96) ( :96) = 0:8147 0:00158 = 0:899 (15:5) = P (Reject H 0 : = 15j = 15:5) = 1 = 1 0:899 = 0:
49 while at = 15 (when H 0 is true) we have = P h 14:0 < X < 15:98 = 15 i so that = P 4 14: < X 15 6 < 15:98 15 = P [ 1:96 < Z < 1:96] = (1:96) ( 1:96) = 0:9750 0:04998 = 0:95 (15) = P (Reject H 0 : = 15j = 15) = 1 = 1 0:95 = 0:05 Note: This is the value of which is the probability of type I error (probability of rejecting H 0 is true) and that was chosen to be 0:05 at the begining
50 We also get similar values on the left of = 15. For instance, at = 14:5; we have = P h 14:0 < X < 15:98 = 14:5 i so that = P 4 14:0 14:5 6 < X 14:5 6 < 15:98 14:5 = P [ 0:96 < Z < :96] = (:96) ( 0:96) = 0:899 (14:5) = P (Reject H 0 : = 15j = 14:5) = 1 = 1 0:899 = 0:17007 = (15:5)
51 while at at = 1; we have so that = P h 14:0 < X < 15:98 = 1 i = P 4 14:0 1 6 < X 14:5 6 < 15:98 1 = P [:04 < Z < 5:96] = (5:96) (:04) = 0:0068 (1) = P (Reject H 0 : = 15j = 1) = 1 = 1 0:0068 = 0:979 = (17)
52 If we plot these values of power, we get the power curve below: 1 Plot of the power function 0.9 Probability of rejecting the Null hypothesis Values under the alternative hypothesis (H1) 5
Finansiell Statistik, GN, 15 hp, VT2008 Lecture 12::(1) Analysis of Variance (2) Chi-Square Tests for Independence and for Goodness-of- t
Finansiell Statistik, GN, 15 hp, VT2008 Lecture 12::(1) Analysis of Variance (2) Chi-Square Tests for Independence and for Goodness-of- t Gebrenegus Ghilagaber, PhD, Associate Professor 1 1 Introduction
More informationLösningsförslag till skriftlig tentamen i FINANSIELL STATISTIK, grundnivå, 7,5 hp, torsdagen 15 januari 2009.
Statistiska Institutionen Gebrenegus Ghilagaber (docent) Lösningsförslag till skriftlig tentamen i FINANSIELL STATISTIK, grundnivå, 7,5 hp, torsdagen 5 januari 009. Sannolkhetslära De ne the following
More informationFinansiell Statistik, GN, 15 hp, VT2008 Lecture 15: Multiple Linear Regression & Correlation
Finansiell Statistik, GN, 5 hp, VT28 Lecture 5: Multiple Linear Regression & Correlation Gebrenegus Ghilagaber, PhD, ssociate Professor May 5, 28 Introduction In the simple linear regression Y i = + X
More informationIntroductory Econometrics. Review of statistics (Part II: Inference)
Introductory Econometrics Review of statistics (Part II: Inference) Jun Ma School of Economics Renmin University of China October 1, 2018 1/16 Null and alternative hypotheses Usually, we have two competing
More informationFinansiell Statistik, GN, 15 hp, VT2008 Lecture 17-2: Index Numbers
Finansiell Statistik, GN, 15 hp, VT2008 Lecture 17-2: Index Numbers Gebrenegus Ghilagaber, PhD, Associate Professor May 7, 2008 1 1 Introduction Index numbers are summary measures used to compare the general
More informationBusiness Statistics: Lecture 8: Introduction to Estimation & Hypothesis Testing
Business Statistics: Lecture 8: Introduction to Estimation & Hypothesis Testing Agenda Introduction to Estimation Point estimation Interval estimation Introduction to Hypothesis Testing Concepts en terminology
More informationINTERVAL ESTIMATION AND HYPOTHESES TESTING
INTERVAL ESTIMATION AND HYPOTHESES TESTING 1. IDEA An interval rather than a point estimate is often of interest. Confidence intervals are thus important in empirical work. To construct interval estimates,
More informationFinansiell Statistik, GN, 15 hp, VT2008 Lecture 17-1: Regression with dichotomous outcome variable - Logistic Regression
Finansiell Statistik, GN, 15 hp, VT2008 Lecture 17-1: Regression with dichotomous outcome variable - Logistic Regression Gebrenegus Ghilagaber, PhD, Associate Professor May 7, 2008 1 1 Introduction Let
More informationClass 19. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700
Class 19 Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science Copyright 2017 by D.B. Rowe 1 Agenda: Recap Chapter 8.3-8.4 Lecture Chapter 8.5 Go over Exam. Problem Solving
More informationClass 24. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700
Class 4 Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science Copyright 013 by D.B. Rowe 1 Agenda: Recap Chapter 9. and 9.3 Lecture Chapter 10.1-10.3 Review Exam 6 Problem Solving
More information280 CHAPTER 9 TESTS OF HYPOTHESES FOR A SINGLE SAMPLE Tests of Statistical Hypotheses
280 CHAPTER 9 TESTS OF HYPOTHESES FOR A SINGLE SAMPLE 9-1.2 Tests of Statistical Hypotheses To illustrate the general concepts, consider the propellant burning rate problem introduced earlier. The null
More informationVisual interpretation with normal approximation
Visual interpretation with normal approximation H 0 is true: H 1 is true: p =0.06 25 33 Reject H 0 α =0.05 (Type I error rate) Fail to reject H 0 β =0.6468 (Type II error rate) 30 Accept H 1 Visual interpretation
More informationME3620. Theory of Engineering Experimentation. Spring Chapter IV. Decision Making for a Single Sample. Chapter IV
Theory of Engineering Experimentation Chapter IV. Decision Making for a Single Sample Chapter IV 1 4 1 Statistical Inference The field of statistical inference consists of those methods used to make decisions
More informationStatistical Inference. Hypothesis Testing
Statistical Inference Hypothesis Testing Previously, we introduced the point and interval estimation of an unknown parameter(s), say µ and σ 2. However, in practice, the problem confronting the scientist
More informationLECTURE 5 HYPOTHESIS TESTING
October 25, 2016 LECTURE 5 HYPOTHESIS TESTING Basic concepts In this lecture we continue to discuss the normal classical linear regression defined by Assumptions A1-A5. Let θ Θ R d be a parameter of interest.
More informationIntroduction to Statistical Data Analysis III
Introduction to Statistical Data Analysis III JULY 2011 Afsaneh Yazdani Preface Major branches of Statistics: - Descriptive Statistics - Inferential Statistics Preface What is Inferential Statistics? The
More informationChapter 5: HYPOTHESIS TESTING
MATH411: Applied Statistics Dr. YU, Chi Wai Chapter 5: HYPOTHESIS TESTING 1 WHAT IS HYPOTHESIS TESTING? As its name indicates, it is about a test of hypothesis. To be more precise, we would first translate
More informationEconometrics Midterm Examination Answers
Econometrics Midterm Examination Answers March 4, 204. Question (35 points) Answer the following short questions. (i) De ne what is an unbiased estimator. Show that X is an unbiased estimator for E(X i
More informationPreliminary Statistics. Lecture 5: Hypothesis Testing
Preliminary Statistics Lecture 5: Hypothesis Testing Rory Macqueen (rm43@soas.ac.uk), September 2015 Outline Elements/Terminology of Hypothesis Testing Types of Errors Procedure of Testing Significance
More informationSection 10.1 (Part 2 of 2) Significance Tests: Power of a Test
1 Section 10.1 (Part 2 of 2) Significance Tests: Power of a Test Learning Objectives After this section, you should be able to DESCRIBE the relationship between the significance level of a test, P(Type
More informationStatistical Inference. Why Use Statistical Inference. Point Estimates. Point Estimates. Greg C Elvers
Statistical Inference Greg C Elvers 1 Why Use Statistical Inference Whenever we collect data, we want our results to be true for the entire population and not just the sample that we used But our sample
More informationTests about a population mean
October 2 nd, 2017 Overview Week 1 Week 2 Week 4 Week 7 Week 10 Week 12 Chapter 1: Descriptive statistics Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation Chapter 8: Confidence
More informationPreliminary Statistics Lecture 5: Hypothesis Testing (Outline)
1 School of Oriental and African Studies September 2015 Department of Economics Preliminary Statistics Lecture 5: Hypothesis Testing (Outline) Gujarati D. Basic Econometrics, Appendix A.8 Barrow M. Statistics
More informationHYPOTHESIS TESTING. Hypothesis Testing
MBA 605 Business Analytics Don Conant, PhD. HYPOTHESIS TESTING Hypothesis testing involves making inferences about the nature of the population on the basis of observations of a sample drawn from the population.
More informationInferences About Two Proportions
Inferences About Two Proportions Quantitative Methods II Plan for Today Sampling two populations Confidence intervals for differences of two proportions Testing the difference of proportions Examples 1
More informationCHAPTER 8. Test Procedures is a rule, based on sample data, for deciding whether to reject H 0 and contains:
CHAPTER 8 Test of Hypotheses Based on a Single Sample Hypothesis testing is the method that decide which of two contradictory claims about the parameter is correct. Here the parameters of interest are
More informationIntroduction to Statistical Hypothesis Testing
Introduction to Statistical Hypothesis Testing Arun K. Tangirala Power of Hypothesis Tests Arun K. Tangirala, IIT Madras Intro to Statistical Hypothesis Testing 1 Learning objectives I Computing Pr(Type
More informationECO220Y Hypothesis Testing: Type I and Type II Errors and Power Readings: Chapter 12,
ECO220Y Hypothesis Testing: Type I and Type II Errors and Power Readings: Chapter 12, 12.7-12.9 Winter 2012 Lecture 15 (Winter 2011) Estimation Lecture 15 1 / 25 Linking Two Approaches to Hypothesis Testing
More informationAMS7: WEEK 7. CLASS 1. More on Hypothesis Testing Monday May 11th, 2015
AMS7: WEEK 7. CLASS 1 More on Hypothesis Testing Monday May 11th, 2015 Testing a Claim about a Standard Deviation or a Variance We want to test claims about or 2 Example: Newborn babies from mothers taking
More informationParameter Estimation, Sampling Distributions & Hypothesis Testing
Parameter Estimation, Sampling Distributions & Hypothesis Testing Parameter Estimation & Hypothesis Testing In doing research, we are usually interested in some feature of a population distribution (which
More informationSTAT Chapter 8: Hypothesis Tests
STAT 515 -- Chapter 8: Hypothesis Tests CIs are possibly the most useful forms of inference because they give a range of reasonable values for a parameter. But sometimes we want to know whether one particular
More informationAn inferential procedure to use sample data to understand a population Procedures
Hypothesis Test An inferential procedure to use sample data to understand a population Procedures Hypotheses, the alpha value, the critical region (z-scores), statistics, conclusion Two types of errors
More informationT.I.H.E. IT 233 Statistics and Probability: Sem. 1: 2013 ESTIMATION AND HYPOTHESIS TESTING OF TWO POPULATIONS
ESTIMATION AND HYPOTHESIS TESTING OF TWO POPULATIONS In our work on hypothesis testing, we used the value of a sample statistic to challenge an accepted value of a population parameter. We focused only
More informationCHAPTER 7. Hypothesis Testing
CHAPTER 7 Hypothesis Testing A hypothesis is a statement about one or more populations, and usually deal with population parameters, such as means or standard deviations. A research hypothesis is a conjecture
More informationProbability and Statistics
Probability and Statistics Kristel Van Steen, PhD 2 Montefiore Institute - Systems and Modeling GIGA - Bioinformatics ULg kristel.vansteen@ulg.ac.be CHAPTER 4: IT IS ALL ABOUT DATA 4a - 1 CHAPTER 4: IT
More informationNormal (Gaussian) distribution The normal distribution is often relevant because of the Central Limit Theorem (CLT):
Lecture Three Normal theory null distributions Normal (Gaussian) distribution The normal distribution is often relevant because of the Central Limit Theorem (CLT): A random variable which is a sum of many
More informationi) the probability of type I error; ii) the 95% con dence interval; iii) the p value; iv) the probability of type II error; v) the power of a test.
1. Explain what is: i) the probability of type I error; ii) the 95% con dence interval; iii) the p value; iv) the probability of type II error; v) the power of a test. Answer: i) It is the probability
More informationSociology 6Z03 Review II
Sociology 6Z03 Review II John Fox McMaster University Fall 2016 John Fox (McMaster University) Sociology 6Z03 Review II Fall 2016 1 / 35 Outline: Review II Probability Part I Sampling Distributions Probability
More informationMathematical statistics
October 20 th, 2018 Lecture 17: Tests of Hypotheses Overview Week 1 Week 2 Week 4 Week 7 Week 10 Week 14 Probability reviews Chapter 6: Statistics and Sampling Distributions Chapter 7: Point Estimation
More informationHypothesis Testing The basic ingredients of a hypothesis test are
Hypothesis Testing The basic ingredients of a hypothesis test are 1 the null hypothesis, denoted as H o 2 the alternative hypothesis, denoted as H a 3 the test statistic 4 the data 5 the conclusion. The
More informationReview: General Approach to Hypothesis Testing. 1. Define the research question and formulate the appropriate null and alternative hypotheses.
1 Review: Let X 1, X,..., X n denote n independent random variables sampled from some distribution might not be normal!) with mean µ) and standard deviation σ). Then X µ σ n In other words, X is approximately
More informationCOMPARING SEVERAL MEANS: ANOVA
LAST UPDATED: November 15, 2012 COMPARING SEVERAL MEANS: ANOVA Objectives 2 Basic principles of ANOVA Equations underlying one-way ANOVA Doing a one-way ANOVA in R Following up an ANOVA: Planned contrasts/comparisons
More informationWhat is a Hypothesis?
What is a Hypothesis? A hypothesis is a claim (assumption) about a population parameter: population mean Example: The mean monthly cell phone bill in this city is μ = $42 population proportion Example:
More informationBusiness Statistics. Lecture 10: Course Review
Business Statistics Lecture 10: Course Review 1 Descriptive Statistics for Continuous Data Numerical Summaries Location: mean, median Spread or variability: variance, standard deviation, range, percentiles,
More informationCH.9 Tests of Hypotheses for a Single Sample
CH.9 Tests of Hypotheses for a Single Sample Hypotheses testing Tests on the mean of a normal distributionvariance known Tests on the mean of a normal distributionvariance unknown Tests on the variance
More informationMathematical statistics
November 1 st, 2018 Lecture 18: Tests about a population mean Overview 9.1 Hypotheses and test procedures test procedures errors in hypothesis testing significance level 9.2 Tests about a population mean
More informationhypothesis a claim about the value of some parameter (like p)
Testing hypotheses hypothesis a claim about the value of some parameter (like p) significance test procedure to assess the strength of evidence provided by a sample of data against the claim of a hypothesized
More informationBIO5312 Biostatistics Lecture 6: Statistical hypothesis testings
BIO5312 Biostatistics Lecture 6: Statistical hypothesis testings Yujin Chung October 4th, 2016 Fall 2016 Yujin Chung Lec6: Statistical hypothesis testings Fall 2016 1/30 Previous Two types of statistical
More informationChapter 7 Comparison of two independent samples
Chapter 7 Comparison of two independent samples 7.1 Introduction Population 1 µ σ 1 1 N 1 Sample 1 y s 1 1 n 1 Population µ σ N Sample y s n 1, : population means 1, : population standard deviations N
More informationPsychology 282 Lecture #4 Outline Inferences in SLR
Psychology 282 Lecture #4 Outline Inferences in SLR Assumptions To this point we have not had to make any distributional assumptions. Principle of least squares requires no assumptions. Can use correlations
More informationCIVL /8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8
CIVL - 7904/8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8 Chi-square Test How to determine the interval from a continuous distribution I = Range 1 + 3.322(logN) I-> Range of the class interval
More informationSample Size and Power I: Binary Outcomes. James Ware, PhD Harvard School of Public Health Boston, MA
Sample Size and Power I: Binary Outcomes James Ware, PhD Harvard School of Public Health Boston, MA Sample Size and Power Principles: Sample size calculations are an essential part of study design Consider
More informationTwo-Sample Inferential Statistics
The t Test for Two Independent Samples 1 Two-Sample Inferential Statistics In an experiment there are two or more conditions One condition is often called the control condition in which the treatment is
More informationStatistics Primer. ORC Staff: Jayme Palka Peter Boedeker Marcus Fagan Trey Dejong
Statistics Primer ORC Staff: Jayme Palka Peter Boedeker Marcus Fagan Trey Dejong 1 Quick Overview of Statistics 2 Descriptive vs. Inferential Statistics Descriptive Statistics: summarize and describe data
More informationStatistics 251: Statistical Methods
Statistics 251: Statistical Methods 1-sample Hypothesis Tests Module 9 2018 Introduction We have learned about estimating parameters by point estimation and interval estimation (specifically confidence
More informationFirst we look at some terms to be used in this section.
8 Hypothesis Testing 8.1 Introduction MATH1015 Biostatistics Week 8 In Chapter 7, we ve studied the estimation of parameters, point or interval estimates. The construction of CI relies on the sampling
More information1 Statistical inference for a population mean
1 Statistical inference for a population mean 1. Inference for a large sample, known variance Suppose X 1,..., X n represents a large random sample of data from a population with unknown mean µ and known
More informationIntroductory Econometrics
Session 4 - Testing hypotheses Roland Sciences Po July 2011 Motivation After estimation, delivering information involves testing hypotheses Did this drug had any effect on the survival rate? Is this drug
More informationHypothesis Testing and Confidence Intervals (Part 2): Cohen s d, Logic of Testing, and Confidence Intervals
Hypothesis Testing and Confidence Intervals (Part 2): Cohen s d, Logic of Testing, and Confidence Intervals Lecture 9 Justin Kern April 9, 2018 Measuring Effect Size: Cohen s d Simply finding whether a
More informationStatistics - Lecture 05
Statistics - Lecture 05 Nicodème Paul Faculté de médecine, Université de Strasbourg http://statnipa.appspot.com/cours/05/index.html#47 1/47 Descriptive statistics and probability Data description and graphical
More informationStatistical methods for comparing multiple groups. Lecture 7: ANOVA. ANOVA: Definition. ANOVA: Concepts
Statistical methods for comparing multiple groups Lecture 7: ANOVA Sandy Eckel seckel@jhsph.edu 30 April 2008 Continuous data: comparing multiple means Analysis of variance Binary data: comparing multiple
More informationThe problem of base rates
Psychology 205: Research Methods in Psychology William Revelle Department of Psychology Northwestern University Evanston, Illinois USA October, 2015 1 / 14 Outline Inferential statistics 2 / 14 Hypothesis
More informationLecture 7: Hypothesis Testing and ANOVA
Lecture 7: Hypothesis Testing and ANOVA Goals Overview of key elements of hypothesis testing Review of common one and two sample tests Introduction to ANOVA Hypothesis Testing The intent of hypothesis
More informationSection 9.1 (Part 2) (pp ) Type I and Type II Errors
Section 9.1 (Part 2) (pp. 547-551) Type I and Type II Errors Because we are basing our conclusion in a significance test on sample data, there is always a chance that our conclusions will be in error.
More informationQuantitative Analysis and Empirical Methods
Hypothesis testing Sciences Po, Paris, CEE / LIEPP Introduction Hypotheses Procedure of hypothesis testing Two-tailed and one-tailed tests Statistical tests with categorical variables A hypothesis A testable
More informationLectures 5 & 6: Hypothesis Testing
Lectures 5 & 6: Hypothesis Testing in which you learn to apply the concept of statistical significance to OLS estimates, learn the concept of t values, how to use them in regression work and come across
More informationLECTURE 12 CONFIDENCE INTERVAL AND HYPOTHESIS TESTING
LECTURE 1 CONFIDENCE INTERVAL AND HYPOTHESIS TESTING INTERVAL ESTIMATION Point estimation of : The inference is a guess of a single value as the value of. No accuracy associated with it. Interval estimation
More information(right tailed) or minus Z α. (left-tailed). For a two-tailed test the critical Z value is going to be.
More Power Stuff What is the statistical power of a hypothesis test? Statistical power is the probability of rejecting the null conditional on the null being false. In mathematical terms it is ( reject
More informationProbability and Statistics Notes
Probability and Statistics Notes Chapter Seven Jesse Crawford Department of Mathematics Tarleton State University Spring 2011 (Tarleton State University) Chapter Seven Notes Spring 2011 1 / 42 Outline
More information4 Hypothesis testing. 4.1 Types of hypothesis and types of error 4 HYPOTHESIS TESTING 49
4 HYPOTHESIS TESTING 49 4 Hypothesis testing In sections 2 and 3 we considered the problem of estimating a single parameter of interest, θ. In this section we consider the related problem of testing whether
More informationSTAT 135 Lab 8 Hypothesis Testing Review, Mann-Whitney Test by Normal Approximation, and Wilcoxon Signed Rank Test.
STAT 135 Lab 8 Hypothesis Testing Review, Mann-Whitney Test by Normal Approximation, and Wilcoxon Signed Rank Test. Rebecca Barter March 30, 2015 Mann-Whitney Test Mann-Whitney Test Recall that the Mann-Whitney
More informationEconometrics. 4) Statistical inference
30C00200 Econometrics 4) Statistical inference Timo Kuosmanen Professor, Ph.D. http://nomepre.net/index.php/timokuosmanen Today s topics Confidence intervals of parameter estimates Student s t-distribution
More informationReview of Statistics 101
Review of Statistics 101 We review some important themes from the course 1. Introduction Statistics- Set of methods for collecting/analyzing data (the art and science of learning from data). Provides methods
More informationEcon 325: Introduction to Empirical Economics
Econ 325: Introduction to Empirical Economics Chapter 9 Hypothesis Testing: Single Population Ch. 9-1 9.1 What is a Hypothesis? A hypothesis is a claim (assumption) about a population parameter: population
More informationH 2 : otherwise. that is simply the proportion of the sample points below level x. For any fixed point x the law of large numbers gives that
Lecture 28 28.1 Kolmogorov-Smirnov test. Suppose that we have an i.i.d. sample X 1,..., X n with some unknown distribution and we would like to test the hypothesis that is equal to a particular distribution
More informationIntroduction to Statistics
MTH4106 Introduction to Statistics Notes 15 Spring 2013 Testing hypotheses about the mean Earlier, we saw how to test hypotheses about a proportion, using properties of the Binomial distribution It is
More informationHypothesis Testing. ECE 3530 Spring Antonio Paiva
Hypothesis Testing ECE 3530 Spring 2010 Antonio Paiva What is hypothesis testing? A statistical hypothesis is an assertion or conjecture concerning one or more populations. To prove that a hypothesis is
More informationy ˆ i = ˆ " T u i ( i th fitted value or i th fit)
1 2 INFERENCE FOR MULTIPLE LINEAR REGRESSION Recall Terminology: p predictors x 1, x 2,, x p Some might be indicator variables for categorical variables) k-1 non-constant terms u 1, u 2,, u k-1 Each u
More informationPSY 307 Statistics for the Behavioral Sciences. Chapter 20 Tests for Ranked Data, Choosing Statistical Tests
PSY 307 Statistics for the Behavioral Sciences Chapter 20 Tests for Ranked Data, Choosing Statistical Tests What To Do with Non-normal Distributions Tranformations (pg 382): The shape of the distribution
More informationHypothesis Tests and Estimation for Population Variances. Copyright 2014 Pearson Education, Inc.
Hypothesis Tests and Estimation for Population Variances 11-1 Learning Outcomes Outcome 1. Formulate and carry out hypothesis tests for a single population variance. Outcome 2. Develop and interpret confidence
More informationThis is particularly true if you see long tails in your data. What are you testing? That the two distributions are the same!
Two sample tests (part II): What to do if your data are not distributed normally: Option 1: if your sample size is large enough, don't worry - go ahead and use a t-test (the CLT will take care of non-normal
More informationSTAT 515 fa 2016 Lec Statistical inference - hypothesis testing
STAT 515 fa 2016 Lec 20-21 Statistical inference - hypothesis testing Karl B. Gregory Wednesday, Oct 12th Contents 1 Statistical inference 1 1.1 Forms of the null and alternate hypothesis for µ and p....................
More information1 One- and Two-Sample Estimation
1 One- and Two-Sample Estimation Problems 1.1 Introduction In previous chapters, we emphasized sampling properties of the sample mean and variance. The purpose of these presentations is to build a foundation
More information8.1-4 Test of Hypotheses Based on a Single Sample
8.1-4 Test of Hypotheses Based on a Single Sample Example 1 (Example 8.6, p. 312) A manufacturer of sprinkler systems used for fire protection in office buildings claims that the true average system-activation
More informationANOVA TESTING 4STEPS. 1. State the hypothesis. : H 0 : µ 1 =
Introduction to Statistics in Psychology PSY 201 Professor Greg Francis Lecture 35 ANalysis Of VAriance Ignoring (some) variability TESTING 4STEPS 1. State the hypothesis. : H 0 : µ 1 = µ 2 =... = µ K,
More informationStatistical Process Control (contd... )
Statistical Process Control (contd... ) ME522: Quality Engineering Vivek Kumar Mehta November 11, 2016 Note: This lecture is prepared with the help of material available online at https://onlinecourses.science.psu.edu/
More informationProbability Methods in Civil Engineering Prof. Dr. Rajib Maity Department of Civil Engineering Indian Institution of Technology, Kharagpur
Probability Methods in Civil Engineering Prof. Dr. Rajib Maity Department of Civil Engineering Indian Institution of Technology, Kharagpur Lecture No. # 36 Sampling Distribution and Parameter Estimation
More informationQuantitative Methods for Economics, Finance and Management (A86050 F86050)
Quantitative Methods for Economics, Finance and Management (A86050 F86050) Matteo Manera matteo.manera@unimib.it Marzio Galeotti marzio.galeotti@unimi.it 1 This material is taken and adapted from Guy Judge
More informationPOLI 443 Applied Political Research
POLI 443 Applied Political Research Session 4 Tests of Hypotheses The Normal Curve Lecturer: Prof. A. Essuman-Johnson, Dept. of Political Science Contact Information: aessuman-johnson@ug.edu.gh College
More informationChapter 15: Nonparametric Statistics Section 15.1: An Overview of Nonparametric Statistics
Section 15.1: An Overview of Nonparametric Statistics Understand Difference between Parametric and Nonparametric Statistical Procedures Parametric statistical procedures inferential procedures that rely
More informationSampling distribution of t. 2. Sampling distribution of t. 3. Example: Gas mileage investigation. II. Inferential Statistics (8) t =
2. The distribution of t values that would be obtained if a value of t were calculated for each sample mean for all possible random of a given size from a population _ t ratio: (X - µ hyp ) t s x The result
More informationChapter 7: Hypothesis Testing
Chapter 7: Hypothesis Testing *Mathematical statistics with applications; Elsevier Academic Press, 2009 The elements of a statistical hypothesis 1. The null hypothesis, denoted by H 0, is usually the nullification
More informationCBA4 is live in practice mode this week exam mode from Saturday!
Announcements CBA4 is live in practice mode this week exam mode from Saturday! Material covered: Confidence intervals (both cases) 1 sample hypothesis tests (both cases) Hypothesis tests for 2 means as
More informationHypothesis Testing. Hypothesis: conjecture, proposition or statement based on published literature, data, or a theory that may or may not be true
Hypothesis esting Hypothesis: conjecture, proposition or statement based on published literature, data, or a theory that may or may not be true Statistical Hypothesis: conjecture about a population parameter
More information7.2 One-Sample Correlation ( = a) Introduction. Correlation analysis measures the strength and direction of association between
7.2 One-Sample Correlation ( = a) Introduction Correlation analysis measures the strength and direction of association between variables. In this chapter we will test whether the population correlation
More informationWISE Power Tutorial Answer Sheet
ame Date Class WISE Power Tutorial Answer Sheet Power: The B.E.A.. Mnemonic Select true or false for each scenario: (Assuming no other changes) True False 1. As effect size increases, power decreases.
More informationHypotheses Test Procedures. Is the claim wrong?
Hypotheses Test Procedures MATH 2300 Sections 9.1 and 9.2 Is the claim wrong? An oil company representative claims that the average price for gasoline in Lubbock is $2.30 per gallon. You think the average
More informationLECTURE 5. Introduction to Econometrics. Hypothesis testing
LECTURE 5 Introduction to Econometrics Hypothesis testing October 18, 2016 1 / 26 ON TODAY S LECTURE We are going to discuss how hypotheses about coefficients can be tested in regression models We will
More informationPSY 305. Module 3. Page Title. Introduction to Hypothesis Testing Z-tests. Five steps in hypothesis testing
Page Title PSY 305 Module 3 Introduction to Hypothesis Testing Z-tests Five steps in hypothesis testing State the research and null hypothesis Determine characteristics of comparison distribution Five
More informationIntroduction to the Analysis of Variance (ANOVA)
Introduction to the Analysis of Variance (ANOVA) The Analysis of Variance (ANOVA) The analysis of variance (ANOVA) is a statistical technique for testing for differences between the means of multiple (more
More information