One way Analysis of Variance (ANOVA)

Similar documents
(Dependent or paired samples) Step (1): State the null and alternate hypotheses: Case1: One-tailed test (Right)

Analysis of Variance (ANOVA) one way

Chapter 13, Part A Analysis of Variance and Experimental Design

What is a Hypothesis? Hypothesis is a statement about a population parameter developed for the purpose of testing.

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test.

STA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:

1 Inferential Methods for Correlation and Regression Analysis

Common Large/Small Sample Tests 1/55

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions

Comparing your lab results with the others by one-way ANOVA

BIOS 4110: Introduction to Biostatistics. Breheny. Lab #9

Regression, Inference, and Model Building

UNIVERSITY OF TORONTO Faculty of Arts and Science APRIL/MAY 2009 EXAMINATIONS ECO220Y1Y PART 1 OF 2 SOLUTIONS

Multiple Comparisons Examples STAT 314

This chapter focuses on two experimental designs that are crucial to comparative studies: (1) independent samples and (2) matched pair samples.

S Y Y = ΣY 2 n. Using the above expressions, the correlation coefficient is. r = SXX S Y Y

2 1. The r.s., of size n2, from population 2 will be. 2 and 2. 2) The two populations are independent. This implies that all of the n1 n2

Linear Regression Models

Probability & Statistics Chapter 8

Chapter 8 Hypothesis Testing

Properties and Hypothesis Testing

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Basic Probability/Statistical Theory I

Statistics. Chapter 10 Two-Sample Tests. Copyright 2013 Pearson Education, Inc. publishing as Prentice Hall. Chap 10-1

This is an introductory course in Analysis of Variance and Design of Experiments.

Chapter 6 Sampling Distributions

Final Examination Solutions 17/6/2010

7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals

Topic 9: Sampling Distributions of Estimators

STAT 203 Chapter 18 Sampling Distribution Models

Goodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)

SOLUTIONS y n. n 1 = 605, y 1 = 351. y1. p y n. n 2 = 195, y 2 = 41. y p H 0 : p 1 = p 2 vs. H 1 : p 1 p 2.

Important Formulas. Expectation: E (X) = Σ [X P(X)] = n p q σ = n p q. P(X) = n! X1! X 2! X 3! X k! p X. Chapter 6 The Normal Distribution.

MATH/STAT 352: Lecture 15

Computing Confidence Intervals for Sample Data

Comparing Two Populations. Topic 15 - Two Sample Inference I. Comparing Two Means. Comparing Two Pop Means. Background Reading

First, note that the LS residuals are orthogonal to the regressors. X Xb X y = 0 ( normal equations ; (k 1) ) So,

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

HYPOTHESIS TESTS FOR ONE POPULATION MEAN WORKSHEET MTH 1210, FALL 2018

Interval Estimation (Confidence Interval = C.I.): An interval estimate of some population parameter is an interval of the form (, ),

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance

Sample Size Determination (Two or More Samples)

Math Third Midterm Exam November 17, 2010

Power and Type II Error

Digital Signal Processing. Homework 2 Solution. Due Monday 4 October Following the method on page 38, the difference equation

Exam II Covers. STA 291 Lecture 19. Exam II Next Tuesday 5-7pm Memorial Hall (Same place as exam I) Makeup Exam 7:15pm 9:15pm Location CB 234

Topic 9: Sampling Distributions of Estimators

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01

t distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference

Chapter 3 Oneway ANOVA

Chapters 5 and 13: REGRESSION AND CORRELATION. Univariate data: x, Bivariate data (x,y).

Lecture 2: Monte Carlo Simulation

Inferential Statistics. Inference Process. Inferential Statistics and Probability a Holistic Approach. Inference Process.

Table 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab

Exam 2 Instructions not multiple versions

Chapter 1 (Definitions)

Module 1 Fundamentals in statistics

Chapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.

3/3/2014. CDS M Phil Econometrics. Types of Relationships. Types of Relationships. Types of Relationships. Vijayamohanan Pillai N.

[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:

f(x i ; ) L(x; p) = i=1 To estimate the value of that maximizes L or equivalently ln L we will set =0, for i =1, 2,...,m p x i (1 p) 1 x i i=1

Section 9.2. Tests About a Population Proportion 12/17/2014. Carrying Out a Significance Test H A N T. Parameters & Hypothesis

Topic 9: Sampling Distributions of Estimators

Lecture 5: Parametric Hypothesis Testing: Comparing Means. GENOME 560, Spring 2016 Doug Fowler, GS

Definitions of terms and examples. Experimental Design. Sampling versus experiments. For each experimental unit, measures of the variables of

Simple Regression. Acknowledgement. These slides are based on presentations created and copyrighted by Prof. Daniel Menasce (GMU) CS 700

Statistical Fundamentals and Control Charts

Good luck! School of Business and Economics. Business Statistics E_BK1_BS / E_IBA1_BS. Date: 25 May, Time: 12:00. Calculator allowed:

Class 27. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

11 Correlation and Regression

SIMPLE LINEAR REGRESSION AND CORRELATION ANALYSIS

Lecture 5. Materials Covered: Chapter 6 Suggested Exercises: 6.7, 6.9, 6.17, 6.20, 6.21, 6.41, 6.49, 6.52, 6.53, 6.62, 6.63.

5. A formulae page and two tables are provided at the end of Part A of the examination PART A

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.

Algebra of Least Squares

Class 23. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Agenda: Recap. Lecture. Chapter 12. Homework. Chapt 12 #1, 2, 3 SAS Problems 3 & 4 by hand. Marquette University MATH 4740/MSCS 5740

Describing the Relation between Two Variables

Lesson 2. Projects and Hand-ins. Hypothesis testing Chaptre 3. { } x=172.0 = 3.67

Confidence Intervals รศ.ดร. อน นต ผลเพ ม Assoc.Prof. Anan Phonphoem, Ph.D. Intelligent Wireless Network Group (IWING Lab)

Mathacle. PSet Stats, Concepts In Statistics Level Number Name: Date:

Lecture 11 Simple Linear Regression

University of California, Los Angeles Department of Statistics. Hypothesis testing

Understanding Dissimilarity Among Samples

Binary Data in Epidemiology Epidemiologic Measures of Association with Time to Event Data

Data Analysis and Statistical Methods Statistics 651

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Agreement of CI and HT. Lecture 13 - Tests of Proportions. Example - Waiting Times

Big Picture. 5. Data, Estimates, and Models: quantifying the accuracy of estimates.

Correlation. Two variables: Which test? Relationship Between Two Numerical Variables. Two variables: Which test? Contingency table Grouped bar graph

COMPARISONS INVOLVING TWO SAMPLE MEANS. Two-tail tests have these types of hypotheses: H A : 1 2

October 25, 2018 BIM 105 Probability and Statistics for Biomedical Engineers 1

(7 One- and Two-Sample Estimation Problem )

Direction: This test is worth 150 points. You are required to complete this test within 55 minutes.

Math 475, Problem Set #12: Answers

Statistics 511 Additional Materials

Statistics Lecture 27. Final review. Administrative Notes. Outline. Experiments. Sampling and Surveys. Administrative Notes

Chapter 22. Comparing Two Proportions. Copyright 2010 Pearson Education, Inc.

BHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13

Transcription:

Oe way Aalysis of Variae (ANOVA) ANOVA Geeral ANOVA Settig"Slide 43-45) Ivestigator otrols oe or more fators of iterest Eah fator otais two or more levels Levels a be umerial or ategorial ifferet levels produe differet groups Thik of eah group as a sample from a differet populatio Observe effets o the depedet variable, Are the groups the same? Experimetal desig: the pla used to ollet the data Experimetal uits (subjets) are assiged radomly to groups, Subjets are assumed homogeeous Oly oe fator or idepedet variable, with two or more levels. Aalyzed by oe-fator aalysis of variae (ANOVA) Oe-Way Aalysis of Variae Evaluate the differee amog the meas of three or more groups Examples: Number of aidets for 1 st, d, ad 3 rd shift, Expeted mileage for five brads of tires. ANOVA Assumptios "Slide 71" Radomess ad Idepedee Selet radom samples from the groups (or radomly assig the levels) Normality The sample values for eah group are from a ormal populatio Homogeeity of Variae All populatios sampled from have the same variae " Ca be tested with Levee s Test" (Textbook: P374) 1

ata frame: Observatios Groups 1.. C Total 1 X 11 X 1..X i1. X 1 X 1 X..X i.. X...... j X 1j X j.x ij. X j Sum X 1. X. X j.. X. X (Grad Total) Samples 1.. j.. The Total sample Mea X 1 X..X i X X(Grad Mea) : umber of groups or levels j : umber of values i group j X ij : i th observatio from group j X : Total mea (Total of all data values) : The Total of all samples ( = 1 + + + j ) X : Grad mea (mea of all data values) Aalysis of variae is a geeral method for studyig sampled-data relatioships. The method eables the differee betwee two or more sample meas to be aalyzed, ahieved by subdividig the total sum of squares. Basi idea is to partitio total variatio of the data ito two soures: Variatio Withi Groups + Variatio Amog Groups Total Variatio: the aggregate variatio of the idividual data values aross the various fator levels (SST) Amog-Group Variatio: variatio amog the fator sample meas (SSA) Withi-Group Variatio: variatio that exists amog the data values withi a partiular fator level (SSW) (Slide 51-5)

The equatios used to alulate these totals are : (Slide 53-59) SST j j1 i1 (X ij X) 11 X ) ( X1 X ) ( X ) SST ( X X SSA (X j1 j j X) SSA (X1 X) (X 1 X) (X X) SSW j1 j i1 (X ij X j) SSW (X 11 X 1) (X 1 X ) (X X) Obtaiig the Mea Squares (Slide 61) The Mea Squares are obtaied by dividig the various sum of squares by their assoiated degrees of freedom Mea Square Amog (d.f= -1) : SSA MSA 1 Mea Square Withi (d.f = -) : MSW SSW Mea Square Total (d.f = -1) : SST MST 1 (-1): The degrees of freedom for the Amog group (-): The degrees of freedom for the withi group 3

F Test for differees amog more tha two meas. Slide (63-64) Step (1): State the ull ad alterate hypotheses: H 0 : µ 1 = µ = µ 3 =.. =µ H 1 : At least two populatio meas are differet. Step (): Selet the level of sigifiae (α) Step (3): The test statisti: Beause we are omparig meas of more tha two groups, use the F statisti. F STAT = MSA SSA 1 = MSW SSW Step (4): The ritial value: The degrees of freedom for the umerator are the degrees of freedom for the amog group (-1) The degrees of freedom for the deomiator are the degrees of freedom for the withi group (-). F α, 1, (Textbook: Table E.5 P548-553) Step (5) : Formulate the deisio Rule ad make a deisio Rejet H o If F > F α, 1, 4

ANOVA TABLE It is oveiet to summarize the alulatio of the F statisti i (ANOVA Table) (Slide 6) Soure of variatio egrees of Sum of Mea Squares F- Stat "F-Ratio" (S.V) freedom Squares (S.S) (MS) Amog groups -1 SSA MSA =SSA/-1 F STAT = MSA / MSW Withi groups - SSW MSW = SSW/- Total -1 SST 5

Example (Slide 65-68) You wat to see if three differet golf lubs yield differet distaes. You radomly selet five measuremets from trials o a automated drivig mahie for eah lub. At the 0.05 sigifiae level, is there a differee i mea distae? Club 1 Club Club 3 54 34 00 63 18 41 35 197 37 7 06 51 16 04 Total 146 1130 109 Mea 49. 6 05.8 X = 7 C=3 1 = = 3 = 5 =15 SSA = 5 (49. 7) + 5 (6 7) + 5 (05.8 7) = 4716.4 SSW = (54 49.) + (63 49.) + + (04 05.8) = 1119.6 Step (1): State the ull ad alterate hypotheses: H 0 : µ 1 = µ = µ 3 H 1 : At least two populatio meas are differet. Step (): Selet the level of sigifiae (α =0.05) Step (3): The test statisti: F STAT = MSA SSA 1 = MSW SSW = 4716.4 3 1 1119.6 15 3 = 5.75 Step (4): The ritial value: The degrees of freedom for the umerator (-1) = 3-1 = The degrees of freedom for the deomiator (-) = 15-3 =1 F 0.05,,1 = 3.89 Step (5) : Formulate the deisio Rule ad make a deisio F STAT 5.75 > F 0.05,,1 (3.89) Rejet Ho at α =0.05 Colusio: There is evidee that at least oe μ j differs from the rest 6

P-value = (0.0000), α = 0.05 P-value < α Rejet H 0 ANOVA TABLE Soure of Variatio(S.V) SS df MS F-Ratio Betwee Groups 4716.4 358. 5.75 Withi Groups 1119.6 1 93.3 Total 5836.0 14 (Textbook P" 378-381 "Startig from paragraph 3, there is a illustrative example) 7

Additioal examples of related samples Example (1) Advertisemets by Sylph Fitess Ceter laim that ompletig its ourse will result i losig weight. A radom sample of eight reet partiipats showed the followig weights before ad after ompletig the ourse. - At the 0.01sigeifiae level, a we olude the studets lost weight (i pouds?) -Fid the ofidee iterval for μ Note: 1 kg =.0 pouds Solutio: Step (1): State the ull ad alterate hypotheses (where u 1 > u or u 1 -u > 0) H : 0 H : 0 0 No Before After 1 155 154 8 07 3 141 147 4 16 157 5 11 196 6 164 150 7 184 170 8 17 165 1 Step (): Selet the level of sigifiae (α=0.01) Step (3): The ritial value 8

I oe tailed test (Right) t, 1 = t 0.01,7 =.998 Rejet H 0 if t.998 Step (4): The test statisti No Before B After A (X 1 -X ) i i 1 155 154 1 1-8.875=-7.875 6.0 8 07 1 1-8.875=1.15 147.0 3 141 147-6 -6-8.875=-14.87 1.7 4 16 157 5 5-8.875=-3.875 15.0 5 11 196 15 15-8.875=6.15 37.5 6 164 150 14 14-8.875=5.15 6.7 7 184 170 14 14-8.875=5.15 6.7 8 17 165 7 7-8.875=-1.875 3.5 Total 71 538.66 71 8.875 8 S = i 1 = 538.66 7 = 8.77 t S 8.875 8.77 8 8.875 8.77.884 8.875 3.1015.8615 Step (5): Formulate the eisio Rule o ot rejet H o. We aot olude that the studets lost weight The Paired ifferee Cofidee Itervalμ is: S ˆ t / 8.77 8.875 3.499 8 8.87510.8519 1.9769 ˆ 19.769 9

Example () Advertisemets by Sylph Fitess Ceter laim that ompletig its ourse will result i losig weight. A radom sample of eight reet partiipats showed the followig weights before ad after ompletig the ourse. - At the 0.01sigeifiae level, a we olude the studet s weight is sigifiatly ireased? (I pouds) -Fid the ofidee iterval for μ Note: 1 kg =.0 pouds No Before After 1 155 154 8 07 3 141 147 4 16 157 5 11 196 6 164 150 7 184 170 8 17 165 Solutio: Step (1): State the ull ad alterate hypotheses (Where u 1 < u or u 1 u < 0) H 0: 0 H 1: < 0 Step (): Selet the level of sigifiae (α=0.01) Step (3): The ritial value (Oe-tailed test (Left) t, 1 = t 0.01,7 =-.998 10

No Rejet H 0 if t.998 Step (4): The test statisti Before B After A (X -X 1 ) i i 1 155 154-1 -1+8.875=7.875 6.0 8 07-1 -1+8.875=1.15 147.0 3 141 147 6 6+8.875=14.87 1.7 4 16 157-5 -5+8.875=3.875 15.0 5 11 196-15 -15+8.875=-6.15 37.5 6 164 150-14 -14+8.875=-5.15 6.7 7 184 170-14 -14+8.875=-5.15 6.7 8 17 165-7 -7+8.875=1.875 3.5 Total -71 538.66 71 8.875 8 S = i 1 = 538.66 7 = 8.77 t S 8.875 8.77 8 8.875 8.875.8615 8.77 3.1015.884 Step (5): Formulate the eisio Rule o ot rejet H o. We aot olude that the studets lost weight The Paired ifferee Cofidee Itervalμ is: S ˆ t / 8.77 8.875 3.499 8 8.87510.8519 1.9769 ˆ 19.769 11

Example (3) The maagemet of isout Furiture, a hai of disout furiture stores i the Northeast, desiged a ietive pla for salespeople.to evaluate this iovative pla, 6 salespeople were seleted at radom, ad their weekly iome before ad after the pla were reorded. Salespeople Before After 1 $30 340 90 85 3 41 475 4 360 365 5 506 55 6 431 431 Was there a sigifiat irease i the typial salesperso's weekly iome due to the iovative ietive pla? Use the 0.05 sigifiae level. Solutio: Step (1): State the ull ad alterate hypotheses (Where u 1 < u or u 1 u < 0) H 0: 0 H 1: < 0 Step (): Selet the level of sigifiae (α=0.05) Step (3): The ritial value Oe-tailed test (Left) t, 1 = t 0.05,5 =-.0150 Rejet H 0 if t.0150 1

Step (4): The test statisti Salespeople Before After (X1-X) i i 1 $337 340-3 -3+3=0 0 90 85 5 5+3=8 64 3 41 45-4 -4+3=-1 1 4 360 365-5 -5+3=- 4 5 506 513-7 -7+3=-4 16 6 431 435-4 -4+3=-1 1 Total -18 86 18 6 3 S = i 1 = 86 5 = 4.1473 t S 3 4.1473 6 3 3 1.7719 4.1473 1..6931.4495 Step (5): Formulate the eisio Rule o ot rejet The Paired ifferee Cofidee Itervalμ is: S ˆ t / 3.7683 3.5706 6 3.57061.5384 6.9546 ˆ 0.9546 3 3.9546 13

Example (4) The maagemet of isout Furiture, a hai of disout furiture stores i the Northeast, desiged a ietive pla for salespeople.to evaluate this iovative pla, 6 salespeople were seleted at radom, ad their weekly iome before ad after the pla were reorded. Was there a sigifiat derease i the typial salesperso's weekly iome due to the iovative ietive pla? Use the 0.05 sigifiae level. Solutio: Step (1): State the ull ad alterate hypotheses (Where u < u 1 or u u 1 < 0) H 0 : 0 H 1 : > 0 Salespeople Before After 1 $30 340 90 85 3 41 475 4 360 365 5 506 55 6 431 431 Step (): Selet the level of sigifiae (α=0.05) Step (3): The ritial value Oe-tailed test (Left) t, 1 = t 0.05,5 =.0150 Rejet H 0 if t.0150 14

Step (4): The test statisti Salespeople Before After (X-X1) i i 1 $337 340 3 3-3=0 0 90 85-5 -5-3=-8 64 3 41 45 4 4-3=1 1 4 360 365 5 5-3= 4 5 506 513 7 7-3=4 16 6 431 435 4 4-3=1 1 Total 18 86 18 3 6 S = i 1 = 86 5 = 4.1473 t S 3 4.1473 6 3 4.1473.4495 3 1..6931 1.7719 Step (5): Formulate the eisio Rule o ot rejet The Paired ifferee Cofidee Itervalμ is: S ˆ t / 3.7683 3.5706 6 3.57061.5384 0.9546 ˆ 6.9546 3 3.9546 15