Chapter Seven: Multi-Sample Methods 1/52

Size: px
Start display at page:

Download "Chapter Seven: Multi-Sample Methods 1/52"

Transcription

1 Chapter Seven: Multi-Sample Methods 1/52

2 7.1 Introduction 2/52 Introduction The independent samples t test and the independent samples Z test for a difference between proportions are designed to analyze data from research designs that employ two groups of subjects. You will now study methods that can be used to analyze data from two or more groups. We will also consider a few multiple comparison procedures (MCPs).

3 7.2 One-Way ANOVA F Test 3/52 One-Way ANOVA: Hypotheses You will recall that the null hypothesis tested by the independent samples t test is H 0 : µ 1 = µ 2. This can be interpreted as asserting that the treatments afforded two groups of subjects were equal in their effect. The null hypothesis tested by the One-Way ANOVA F test is H 0 : µ 1 = µ 2 = = µ k Which can be interpreted as asserting that treatments afforded a specified number of groups (k) of subjects were equal in their effect.

4 7.2 One-Way ANOVA F Test 4/52 Hypotheses (continued) For a three group design the null hypothesis is H 0 : µ 1 = µ 2 = µ 3 The alternative is any condition that makes the null hypothesis false which for the three group design would be 1 µ 1 = µ 2 µ 3 2 µ 1 µ 2 = µ 3 3 µ 1 = µ 3 µ 2 4 µ 1 µ 2 µ 3

5 7.2 One-Way ANOVA F Test 5/52 Obtained F The test statistic for the One-Way ANOVA F test is a ratio given by F = MS b MS w The numerator is termed the mean square between (MS b ) while the denominator is termed the mean square within (MS w ).

6 7.2 One-Way ANOVA F Test 6/52 The Mean Square Within (MS w ) The mean square within (MS w ) is also a ratio and is defined as MS w = SS w N k Here SS w is the sum of squares within, N is the total number of observations, and k is the number of groups. The quantity N k is termed the denominator degrees of freedom. For example, if there are three groups with five subjects in each, N = 15, k = 3 and the denominator degrees of freedom is 15 3 = 12.

7 7.2 One-Way ANOVA F Test 7/52 The Sum of Squares Within (SS w ) The sum of squares within is the sum of the sums of squares for the individual groups or SS w = SS 1 + SS SS k The sum of squares for a given group can be calculated by SS = (x x) 2 or equivalently SS = x 2 ( x) 2 n

8 7.2 One-Way ANOVA F Test 8/52 The Sum of Squares Within (SS w ) (continued) Thus, SS w can be calculated by [ ] [ SS w = x 2 1 (P x 1 ) 2 ] [ n 1 + x 2 2 (P x 2 ) 2 n x 2 k (P x k ) 2 n k ]

9 7.2 One-Way ANOVA F Test 9/52 Example The (fictitious) data in the accompanying table represents the weights of subjects who have been engaged in three different dieting regimens. Use these data to calculate MS w. Diet Diet Diet One Two Three

10 7.2 One-Way ANOVA F Test 10/52 Solution The sums of squares for the three individual groups are as follows. SS 1 = x 2 1 ( x 1 ) 2 SS 2 = x 2 2 ( x 2 ) 2 SS 3 = x 2 3 ( x 3 ) 2 = (1016)2 n 1 5 = (1055)2 n 2 5 = (922)2 n 3 5 = = =

11 7.2 One-Way ANOVA F Test 11/52 Solution (continued) SS w is then by Equation 7.4 SS w = SS 1 + SS 2 + SS 3 = = Then by Equation 7.3 MS w = SS w N k = = 625

12 7.2 One-Way ANOVA F Test 12/52 The Mean Square Between (MS b ) As with the mean square within, the mean square between is a ratio of a sum of squares to a degrees of freedom. More precisely, MS b = SS b k 1 where SS b is the sum of squares between and k is the number of groups. The quantity k 1 is termed the numerator degrees of freedom. For example, if there are three groups the numerator degrees of freedom is 3 1 = 2.

13 7.2 One-Way ANOVA F Test 13/52 The Sum of Squares Between SS b SS b = ( n1 i=1 x ) 2 ( n2 i1 i=1 + x ) 2 ( nk i2 i=1 + + x ) 2 ik ( All x..) 2 n 1 n 2 n k N The terms before the minus sign indicate that the observations in each group are to be summed with the sum then being squared and the result then being divided by the number of observations in the group. This calculation is carried out for each group with the results then being summed. The term after the minus sign indicates that all observations are to be summed and the result squared. The division of this term is by N which represents the total number of observations i.e., n 1 + n n k.

14 7.2 One-Way ANOVA F Test 14/52 Example Use the data in the table on slide #9 to calculate MS b. Then calculate the One-Way ANOVA F statistic.

15 7.2 One-Way ANOVA F Test 15/52 Solution By Equation 7.8 SS b = ( n1 i=1 x ) 2 ( n2 i1 i=1 + x ) 2 ( n3 i2 i=1 + x ) 2 i3 ( All x..) 2 n 1 n 2 n 3 N = (1016)2 + (1055)2 + (922) = = (2993)2 15

16 1 The result of provided on page 269 of the text is based on a different calculation where rounding was a bit differently. 7.2 One-Way ANOVA F Test 16/52 Solution (continued) Dividing SS b by the numerator degrees of freedom of k 1 = 3 1 = 2 yields MS b = = Using the mean square within calculation from slide #11 F = MS b MS w = = Thus, obtained F for the test of significance is 1.40.

17 7.2 One-Way ANOVA F Test 17/52 The Test of Significance The test of significance is conducted by comparing obtained F to critical F. If the former is greater than or equal to the latter, the null hypothesis is rejected. Otherwise, the null hypothesis is not rejected. Critical F is obtained by first noting that the numerator degrees of freedom for the analysis are k 1 = 3 1 = 2 and the denominator degrees of freedom are N k = 15 3 = 12. To use Appendix C, the numerator degrees of freedom are located across the top of the table and the denominator degrees of freedom down the side. For α =.05 with 2 and 12 degrees of freedom, Appendix C shows that critical F is In this case 1.50 is not greater than or equal to 3.89 so the null hypothesis is not rejected.

18 7.2 One-Way ANOVA F Test 18/52 Example Suppose a study is conducted with treatments being administered to four independent groups of subjects. Suppose further that n 1 = 5, n 2 = 7, n 3 = 8 and n 4 = 4. Obtained F is calculated to be Use this information to conduct a One-Way ANOVA F test at α =.05. What is the null hypothesis being tested? What is your decision regarding the null hypothesis?

19 7.2 One-Way ANOVA F Test 19/52 Solution The numerator degrees of freedom are k 1 = 4 1 = 3. N = = 24 so that the denominator degrees of freedom are N k = 24 4 = 20. Reference to Appendix C give critical F as Because obtained F of 4.19 is greater than critical F of 2.38, the null hypothesis H 0 : µ 1 = µ 2 = µ 3 = µ 4 is rejected.

20 7.2 One-Way ANOVA F Test 20/52 The ANOVA Table The results of a One-Way ANOVA analysis are traditionally reported in a table similar to the one shown here. Source of Sum of Mean F Critical Variation Squares df Squares Ratio F p-value Between SS b k 1 SS b /k 1 MS b /MS w (table) (computer) Within SS w N k SS w /N k Total SS t N 1

21 7.2 One-Way ANOVA F Test 21/52 Assumptions The assumptions underlying the ANOVA F test are the same as those underlying the independent samples t test, namely 1 Population normality 2 Homogeneous variances 3 Independence of observations

22 7.3 The 2 By k Chi-Square Test 22/52 The 2 By k Chi-Square Test: Hypotheses In Chapter 6 on page 230 you learned to test the null hypothesis H 0 : π 1 = π 2 by means of an independent samples Z test. The 2 by k chi-square test extends this concept to test for equality of any number of proportions. This null hypothesis is stated as H 0 : π 1 = π 2 = = π k which asserts that all population proportions are equal. The notation indicates that the equality extends to any number of groups with the last group characterized as group k.

23 The Alternative Hypothesis The alternative hypothesis is any condition that renders the null hypothesis false. Thus, given three groups, any of the following conditions, baring a Type II error, would cause rejection of the null hypothesis. 1 π 1 = π 2 π 3 2 π 1 π 2 = π 3 3 π 1 = π 3 π 2 4 π 1 π 2 π 3 When the null hypothesis is rejected, there is no way to know which of the four conditions listed above caused the rejection. 7.3 The 2 By k Chi-Square Test 23/52

24 7.3 The 2 By k Chi-Square Test 24/52 Obtained χ 2 As with other statistics with which you are now familiar, the hypothesis test is carried out by calculating an obtained value with a subsequent comparison to a critical value. For the chi-square test the obtained value is calculated by χ 2 = [ ] (f o f e ) 2 all cells where f o and f e are referred to respectively as the observed and expected frequencies. The observed frequency is simply the number of outcomes occurring in the given cell as shown in the table on the next slide (slide #25). f e

25 7.3 The 2 By k Chi-Square Test 25/52 2 by 3 Chi-Square Table In this table we have used double subscripts to indicate the row and column of each cell entry. Group Group Group One Two Three Outcome 1 f o11 f o12 f o13 f e11 f e12 f e13 Outcome 2 f o21 f o22 f o23 f e21 f e22 f e23

26 7.3 The 2 By k Chi-Square Test 26/52 Observed (f 0 ) and expected (f e ) frequencies The observed frequency is simply the number of outcomes falling into a given cell of the chi-square table. The expected frequency represents the expected number of outcomes to be found in each cell if the null hypothesis is true. The expected frequency is calculated as follows. f e = (N R) (N C ) N where N R is the row total for the cell whose expected frequency is being calculated and N C is the column total for the same cell.

27 7.3 The 2 By k Chi-Square Test 27/52 Example Suppose that in the treatment of a terminal illness, the following results are obtained. Of the patients receiving treatment one, 17 are dead at the end of five years while 52 are still alive. For treatment two, 29 are dead while 54 remain alive and for treatment three 11 are dead and 26 remain alive. Use these data to construct a chi-square table then test the hypothesis H 0 : π 1 = π 2 = π 3.

28 7.3 The 2 By k Chi-Square Test 28/52 Solution We begin by placing the observed frequency of each cell into a chi-square table as shown on the next slide (#29). We then calculate the expected frequency for each cell as follows. f e11 = (N D) ( ) N G1 (57) (69) = = N f e12 = (N D) (N G2 ) N f e13 = (N D) (N G3 ) N f e21 = (N A) (N G1 ) N f e22 = (N A) (N G2 ) N f e23 = (N A) (N G3 ) N 189 (57) (83) = = (57) (37) = = (132) (69) = = (132) (83) = = (132) (37) = =

29 7.3 The 2 By k Chi-Square Test 29/52 Solution (continued) Dead Alive Group Group Group One Two Three [17] [29] [11] 57 (20.81) (25.03) (11.16) [52] [54] [26] 132 (48.19) (57.97) (25.84)

30 7.3 The 2 By k Chi-Square Test 30/52 Solution (continued) Obtained chi-square is then χ 2 = [ ] (f o f e ) 2 all cells f e = ( ) ( ) ( ) ( )2 + ( ) = = ( )

31 7.3 The 2 By k Chi-Square Test 31/52 Solution (continued) The critical value is obtained by entering Appendix D with k 1 degrees of freedom where k is the number of groups. For α =.05 and 3 1 = 2 degrees of freedom, critical χ 2 is The null hypothesis is rejected when obtained chi-square is greater than or equal to critical chi-square. Because 1.9 is less than 5.991, the null hypothesis is not rejected. We conclude, therefore, that a difference between population proportions cannot be demonstrated. In research terms, we conclude that we could not show a difference in the effectiveness of the three treatments.

32 7.4 Multiple Comparison Procedures 32/52 Multiple Comparison Procedures: Introduction You have learned that rejecting a true null hypothesis when conducting a significance test results in a Type I error and that the probability of such is α. For the purposes that follow we will term this type of rejection as a Per Comparison Error (PCE) and will symbolize the probability of such as α PCE. A Familywise Error (FWE) occurs when one or more true null hypotheses are rejected in a series of tests. The probability of such is symbolized α FWE.

33 7.4 Multiple Comparison Procedures 33/52 Introduction (continued) Familywise errors occur in two broad contexts. 1 Multiple comparison analysis refers to the situation where multiple groups are being compared on a single outcome variable. 2 Multiple endpoint analysis refers to the situation where two groups are being compared on multiple outcome measures.

34 7.4 Multiple Comparison Procedures 34/52 Determinants of Familywise Error The following observations are demonstrated in the table on the following slide (#35). Other factors remaining fixed, as the number of comparisons (i.e. significance tests) increases, α FWE increases. Other factors remaining fixed, as α PCE decreases (increases), α FWE decreases (increases).

35 7.4 Multiple Comparison Procedures 35/52 Relationship Between α PCE and α FWE Number of Number of α PCE Groups Comparisons α FWE

36 7.4 Multiple Comparison Procedures 36/52 Controlling Familywise Errors When you reject a single null hypothesis the interpretation is clear. You have an α PCE probability that you did so incorrectly. When you perform a series of tests and reject one or more null hypotheses, the interpretation is not so clear. Did you reject these hypotheses because they are false or because the familywise Type I error rate is so high that rejections were highly likely even in the face of true null hypotheses? You were confident in your result for the single test because you were able to control the probability of a false rejection at α PCE. You could gain this same confidence in your results for multiple tests if you could control α FWE to some specified level.05 for example.

37 7.4 Multiple Comparison Procedures 37/52 The Bonferroni Method Of Controlling Familywise Error As shown in the table on slide #35, α FWE can be reduced by reducing α PCE. But suppose you wish to establish α FWE at some specified value for example.05. How low must you set α PCE in order to have α FWE be.05? One of the oldest, simplest, and most widely used methods for finding this level is known as the Bonferroni adjustment.

38 7.4 Multiple Comparison Procedures 38/52 The Bonferroni Method (continued) The adjustment is made by the following equation. α PCE = α FWE NT where N T represents the number of tests to be performed. Thus, for example, if we wish to control α FWE at.05 while we perform three tests, each test would be carried out at the.05 3 =.017 level of significance.

39 7.4 Multiple Comparison Procedures 39/52 The Step-Down Bonferroni Method In 1979, Holm proposed a modification to the Bonferroni procedure that is usually more powerful than, is never less powerful than, and maintains familywise error at the same level as, the classical procedure. This modified Bonferroni, or more properly, step-down Bonferroni procedure is illustrated on slide #41 and is carried out as follows.

40 7.4 Multiple Comparison Procedures 40/52 The Step-Down Bonferroni Method (continued) 1 The multiple test statistics are calculated. 2 The p-value for each statistic calculated in 1 is obtained. 3 The p-values are ordered from smallest to largest with the smallest being designated p (1), the second smallest p (2) and so forth with the largest being p (NT ) where NT is the number of tests. 4 At the first step, p (1) is compared to α FWE NT. If p (1) α FWE NT, the test is declared significant and the second step is carried out. If p (1) > α FWE NT, the test is declared nonsignificant and testing ceases with all remaining comparisons being declared not significant. 5 If the first step is significant, step two is carried out by comparing p (2) with α FWE NT 1. If p (2) α FWE NT 1, the result is declared significant and testing continues to the next step. Otherwise, the test is declared nonsignificant and testing ceases with all remaining tests being declared nonsignificant. 6 The steps are continued as shown in the figure on slide #41 until a nonsignificant result is obtained or until the last step is completed.

41 7.4 Multiple Comparison Procedures 41/52 The Step-Down Bonferroni Method (continued) Figure: An illustration of the step-down Bonferroni multiple comparison procedure. P-value Step One P (1) Step Two P (2) Step Three P (3) Step NT P (NT) Step-down FWE NT FWE NT-1 FWE NT-2... FWE 1 Classical FWE NT FWE NT FWE NT... FWE NT

42 7.4 Multiple Comparison Procedures 42/52 Example A researcher involved in a study employing multiple groups of subjects wishes to test a series of null hypotheses by means of independent samples t tests. The null hypotheses with accompanying p-values associated with each test are given below. Use these results to perform a step-down Bonferroni procedure with α FWE not to exceed.05. How do these results compare to results that would be obtained from classical Bonferroni tests? H 0 : p-value µ 1 = µ µ 2 = µ µ 2 = µ µ 3 = µ µ 4 = µ

43 7.4 Multiple Comparison Procedures 43/52 Solution The five p values, along with the hypothesis test from which each was derived, are listed in ascending order below. Also shown are the step-down values of α PCE (S-D) and the classical Bonferroni values of α PCE (CB) for each test of significance. As may be seen the tests of µ 2 µ 5 and µ 1 µ 3 are significant while the remaining tests are not. It is important to understand that the tests of µ 3 µ 4 and µ 2 µ 4 are automatically declared nonsignificant at this point due to the stopping rule. Notice that had the researcher employed the classical Bonferroni method, which unfortunately is still common practice, only µ 2 µ 5 would have been significant.

44 7.4 Multiple Comparison Procedures 44/52 Solution (continued) Test µ 2 µ 5 µ 1 µ 3 µ 4 µ 5 µ 3 µ 4 µ 2 µ 4 p-value S-D α PCE CB α PCE S S NS NS NS

45 7.4 Multiple Comparison Procedures 45/52 Tukey s HSD Method Tukey s HSD (Honestly Significant Difference) test is designed for use in multiple comparison settings where all pairwise comparisons of group means are to be carried out. These tests are conducted by computing the test statistic, commonly symbolized as q, for each of the k(k 1) 2 comparisons with the resultant q statistics then being referenced to an appropriate table of critical values.

46 7.4 Multiple Comparison Procedures 46/52 Tukey s HSD Method (continued) The test statistic is defined as follows. q ij = x i x j MSw n h The subscripts i and j denote the two groups being compared so that x i and x j are the means of groups i and j respectively. MS w is the mean square within as computed for a one-way ANOVA via Equations 7.3 and 7.4.

47 7.4 Multiple Comparison Procedures 47/52 Tukey s HSD Method (continued) The symbol n h represents the harmonic mean of the two sample sizes and is computed as 2 n h = 1 n i + 1 n j When n i = n j, n h = n which is the sample size of either group.

48 7.4 Multiple Comparison Procedures 48/52 Example Use the data from the dieting study depicted on slide #9 to perform Tukey s HSD test. Begin by stating the null hypotheses to be tested, then perform the tests and finally, state you conclusions. Maintain α FWE at.05.

49 Solution Because there are three groups and we wish to make all pairwise comparisons, we will have 3(2) 2 = 3 hypotheses to test. They are H 0 : µ 1 = µ 2 H 0 : µ 1 = µ 3 H 0 : µ 2 = µ Multiple Comparison Procedures 49/52

50 7.4 Multiple Comparison Procedures 50/52 Solution (continued) The means of the three groups are as follows. x 1 = x 2 = x 3 = Previous calculations (see slides #10 and 11) obtained when performing a one-way ANOVA on these data provide the following. MS w = 625 Because sample sizes are the same for all groups, n h will be n h = 2 1 n i + 1 = 2 1 n j = 5 for all comparisons.

51 7.4 Multiple Comparison Procedures 51/52 Solution (continued) The test statistics for the three comparisons are by Equation 7.13 q 12 = x 1 x 2 = MSw n h q 13 = x 1 x 3 = MSw n h q 23 = x 2 x 3 = MSw n h =.698 = = 2.379

52 7.4 Multiple Comparison Procedures 52/52 Solution (continued) Critical values of q are obtained from Appendix E. The table is entered with the number of means in the analysis and the appropriate degrees of freedom which are N k. Referencing Appendix E for 3 means and 12 degrees of freedom yields a critical value of As may be seen, none of the hypotheses are rejected so that no differences between group means can be demonstrated.

Statistical methods for comparing multiple groups. Lecture 7: ANOVA. ANOVA: Definition. ANOVA: Concepts

Statistical methods for comparing multiple groups. Lecture 7: ANOVA. ANOVA: Definition. ANOVA: Concepts Statistical methods for comparing multiple groups Lecture 7: ANOVA Sandy Eckel seckel@jhsph.edu 30 April 2008 Continuous data: comparing multiple means Analysis of variance Binary data: comparing multiple

More information

Multiple comparisons - subsequent inferences for two-way ANOVA

Multiple comparisons - subsequent inferences for two-way ANOVA 1 Multiple comparisons - subsequent inferences for two-way ANOVA the kinds of inferences to be made after the F tests of a two-way ANOVA depend on the results if none of the F tests lead to rejection of

More information

CHAPTER 10 ONE-WAY ANALYSIS OF VARIANCE. It would be very unusual for all the research one might conduct to be restricted to

CHAPTER 10 ONE-WAY ANALYSIS OF VARIANCE. It would be very unusual for all the research one might conduct to be restricted to CHAPTER 10 ONE-WAY ANALYSIS OF VARIANCE It would be very unusual for all the research one might conduct to be restricted to comparisons of only two samples. Respondents and various groups are seldom divided

More information

Multiple t Tests. Introduction to Analysis of Variance. Experiments with More than 2 Conditions

Multiple t Tests. Introduction to Analysis of Variance. Experiments with More than 2 Conditions Introduction to Analysis of Variance 1 Experiments with More than 2 Conditions Often the research that psychologists perform has more conditions than just the control and experimental conditions You might

More information

COMPARING SEVERAL MEANS: ANOVA

COMPARING SEVERAL MEANS: ANOVA LAST UPDATED: November 15, 2012 COMPARING SEVERAL MEANS: ANOVA Objectives 2 Basic principles of ANOVA Equations underlying one-way ANOVA Doing a one-way ANOVA in R Following up an ANOVA: Planned contrasts/comparisons

More information

While you wait: Enter the following in your calculator. Find the mean and sample variation of each group. Bluman, Chapter 12 1

While you wait: Enter the following in your calculator. Find the mean and sample variation of each group. Bluman, Chapter 12 1 While you wait: Enter the following in your calculator. Find the mean and sample variation of each group. Bluman, Chapter 12 1 Chapter 12 Analysis of Variance McGraw-Hill, Bluman, 7th ed., Chapter 12 2

More information

Multiple Testing. Gary W. Oehlert. January 28, School of Statistics University of Minnesota

Multiple Testing. Gary W. Oehlert. January 28, School of Statistics University of Minnesota Multiple Testing Gary W. Oehlert School of Statistics University of Minnesota January 28, 2016 Background Suppose that you had a 20-sided die. Nineteen of the sides are labeled 0 and one of the sides is

More information

1 One-way Analysis of Variance

1 One-way Analysis of Variance 1 One-way Analysis of Variance Suppose that a random sample of q individuals receives treatment T i, i = 1,,... p. Let Y ij be the response from the jth individual to be treated with the ith treatment

More information

9 One-Way Analysis of Variance

9 One-Way Analysis of Variance 9 One-Way Analysis of Variance SW Chapter 11 - all sections except 6. The one-way analysis of variance (ANOVA) is a generalization of the two sample t test to k 2 groups. Assume that the populations of

More information

One-Way ANOVA Source Table J - 1 SS B / J - 1 MS B /MS W. Pairwise Post-Hoc Comparisons of Means

One-Way ANOVA Source Table J - 1 SS B / J - 1 MS B /MS W. Pairwise Post-Hoc Comparisons of Means One-Way ANOVA Source Table ANOVA MODEL: ij = µ* + α j + ε ij H 0 : µ 1 = µ =... = µ j or H 0 : Σα j = 0 Source Sum of Squares df Mean Squares F Between Groups n j ( j - * ) J - 1 SS B / J - 1 MS B /MS

More information

Hypothesis Tests and Estimation for Population Variances. Copyright 2014 Pearson Education, Inc.

Hypothesis Tests and Estimation for Population Variances. Copyright 2014 Pearson Education, Inc. Hypothesis Tests and Estimation for Population Variances 11-1 Learning Outcomes Outcome 1. Formulate and carry out hypothesis tests for a single population variance. Outcome 2. Develop and interpret confidence

More information

Difference in two or more average scores in different groups

Difference in two or more average scores in different groups ANOVAs Analysis of Variance (ANOVA) Difference in two or more average scores in different groups Each participant tested once Same outcome tested in each group Simplest is one-way ANOVA (one variable as

More information

1. What does the alternate hypothesis ask for a one-way between-subjects analysis of variance?

1. What does the alternate hypothesis ask for a one-way between-subjects analysis of variance? 1. What does the alternate hypothesis ask for a one-way between-subjects analysis of variance? 2. What is the difference between between-group variability and within-group variability? 3. What does between-group

More information

Week 14 Comparing k(> 2) Populations

Week 14 Comparing k(> 2) Populations Week 14 Comparing k(> 2) Populations Week 14 Objectives Methods associated with testing for the equality of k(> 2) means or proportions are presented. Post-testing concepts and analysis are introduced.

More information

STAT 5200 Handout #7a Contrasts & Post hoc Means Comparisons (Ch. 4-5)

STAT 5200 Handout #7a Contrasts & Post hoc Means Comparisons (Ch. 4-5) STAT 5200 Handout #7a Contrasts & Post hoc Means Comparisons Ch. 4-5) Recall CRD means and effects models: Y ij = µ i + ϵ ij = µ + α i + ϵ ij i = 1,..., g ; j = 1,..., n ; ϵ ij s iid N0, σ 2 ) If we reject

More information

One-Way ANOVA. Some examples of when ANOVA would be appropriate include:

One-Way ANOVA. Some examples of when ANOVA would be appropriate include: One-Way ANOVA 1. Purpose Analysis of variance (ANOVA) is used when one wishes to determine whether two or more groups (e.g., classes A, B, and C) differ on some outcome of interest (e.g., an achievement

More information

CHAPTER 17 CHI-SQUARE AND OTHER NONPARAMETRIC TESTS FROM: PAGANO, R. R. (2007)

CHAPTER 17 CHI-SQUARE AND OTHER NONPARAMETRIC TESTS FROM: PAGANO, R. R. (2007) FROM: PAGANO, R. R. (007) I. INTRODUCTION: DISTINCTION BETWEEN PARAMETRIC AND NON-PARAMETRIC TESTS Statistical inference tests are often classified as to whether they are parametric or nonparametric Parameter

More information

Extending the Robust Means Modeling Framework. Alyssa Counsell, Phil Chalmers, Matt Sigal, Rob Cribbie

Extending the Robust Means Modeling Framework. Alyssa Counsell, Phil Chalmers, Matt Sigal, Rob Cribbie Extending the Robust Means Modeling Framework Alyssa Counsell, Phil Chalmers, Matt Sigal, Rob Cribbie One-way Independent Subjects Design Model: Y ij = µ + τ j + ε ij, j = 1,, J Y ij = score of the ith

More information

A posteriori multiple comparison tests

A posteriori multiple comparison tests A posteriori multiple comparison tests 11/15/16 1 Recall the Lakes experiment Source of variation SS DF MS F P Lakes 58.000 2 29.400 8.243 0.006 Error 42.800 12 3.567 Total 101.600 14 The ANOVA tells us

More information

PLSC PRACTICE TEST ONE

PLSC PRACTICE TEST ONE PLSC 724 - PRACTICE TEST ONE 1. Discuss briefly the relationship between the shape of the normal curve and the variance. 2. What is the relationship between a statistic and a parameter? 3. How is the α

More information

IEOR165 Discussion Week 12

IEOR165 Discussion Week 12 IEOR165 Discussion Week 12 Sheng Liu University of California, Berkeley Apr 15, 2016 Outline 1 Type I errors & Type II errors 2 Multiple Testing 3 ANOVA IEOR165 Discussion Sheng Liu 2 Type I errors & Type

More information

N J SS W /df W N - 1

N J SS W /df W N - 1 One-Way ANOVA Source Table ANOVA MODEL: ij = µ* + α j + ε ij H 0 : µ = µ =... = µ j or H 0 : Σα j = 0 Source Sum of Squares df Mean Squares F J Between Groups nj( j * ) J - SS B /(J ) MS B /MS W = ( N

More information

Sampling distribution of t. 2. Sampling distribution of t. 3. Example: Gas mileage investigation. II. Inferential Statistics (8) t =

Sampling distribution of t. 2. Sampling distribution of t. 3. Example: Gas mileage investigation. II. Inferential Statistics (8) t = 2. The distribution of t values that would be obtained if a value of t were calculated for each sample mean for all possible random of a given size from a population _ t ratio: (X - µ hyp ) t s x The result

More information

An Old Research Question

An Old Research Question ANOVA An Old Research Question The impact of TV on high-school grade Watch or not watch Two groups The impact of TV hours on high-school grade Exactly how much TV watching would make difference Multiple

More information

Chapter Eight: Assessment of Relationships 1/42

Chapter Eight: Assessment of Relationships 1/42 Chapter Eight: Assessment of Relationships 1/42 8.1 Introduction 2/42 Background This chapter deals, primarily, with two topics. The Pearson product-moment correlation coefficient. The chi-square test

More information

Multiple Pairwise Comparison Procedures in One-Way ANOVA with Fixed Effects Model

Multiple Pairwise Comparison Procedures in One-Way ANOVA with Fixed Effects Model Biostatistics 250 ANOVA Multiple Comparisons 1 ORIGIN 1 Multiple Pairwise Comparison Procedures in One-Way ANOVA with Fixed Effects Model When the omnibus F-Test for ANOVA rejects the null hypothesis that

More information

ANOVA Multiple Comparisons

ANOVA Multiple Comparisons ANOVA Multiple Comparisons Multiple comparisons When we carry out an ANOVA on k treatments, we test H 0 : µ 1 = =µ k versus H a : H 0 is false Assume we reject the null hypothesis, i.e. we have some evidence

More information

Orthogonal, Planned and Unplanned Comparisons

Orthogonal, Planned and Unplanned Comparisons This is a chapter excerpt from Guilford Publications. Data Analysis for Experimental Design, by Richard Gonzalez Copyright 2008. 8 Orthogonal, Planned and Unplanned Comparisons 8.1 Introduction In this

More information

Statistics for EES Factorial analysis of variance

Statistics for EES Factorial analysis of variance Statistics for EES Factorial analysis of variance Dirk Metzler June 12, 2015 Contents 1 ANOVA and F -Test 1 2 Pairwise comparisons and multiple testing 6 3 Non-parametric: The Kruskal-Wallis Test 9 1 ANOVA

More information

The legacy of Sir Ronald A. Fisher. Fisher s three fundamental principles: local control, replication, and randomization.

The legacy of Sir Ronald A. Fisher. Fisher s three fundamental principles: local control, replication, and randomization. 1 Chapter 1: Research Design Principles The legacy of Sir Ronald A. Fisher. Fisher s three fundamental principles: local control, replication, and randomization. 2 Chapter 2: Completely Randomized Design

More information

Analysis of Variance

Analysis of Variance Analysis of Variance Blood coagulation time T avg A 62 60 63 59 61 B 63 67 71 64 65 66 66 C 68 66 71 67 68 68 68 D 56 62 60 61 63 64 63 59 61 64 Blood coagulation time A B C D Combined 56 57 58 59 60 61

More information

LECTURE 5 HYPOTHESIS TESTING

LECTURE 5 HYPOTHESIS TESTING October 25, 2016 LECTURE 5 HYPOTHESIS TESTING Basic concepts In this lecture we continue to discuss the normal classical linear regression defined by Assumptions A1-A5. Let θ Θ R d be a parameter of interest.

More information

Introduction to the Analysis of Variance (ANOVA)

Introduction to the Analysis of Variance (ANOVA) Introduction to the Analysis of Variance (ANOVA) The Analysis of Variance (ANOVA) The analysis of variance (ANOVA) is a statistical technique for testing for differences between the means of multiple (more

More information

Chapter 13 Section D. F versus Q: Different Approaches to Controlling Type I Errors with Multiple Comparisons

Chapter 13 Section D. F versus Q: Different Approaches to Controlling Type I Errors with Multiple Comparisons Explaining Psychological Statistics (2 nd Ed.) by Barry H. Cohen Chapter 13 Section D F versus Q: Different Approaches to Controlling Type I Errors with Multiple Comparisons In section B of this chapter,

More information

Introduction to the Analysis of Variance (ANOVA) Computing One-Way Independent Measures (Between Subjects) ANOVAs

Introduction to the Analysis of Variance (ANOVA) Computing One-Way Independent Measures (Between Subjects) ANOVAs Introduction to the Analysis of Variance (ANOVA) Computing One-Way Independent Measures (Between Subjects) ANOVAs The Analysis of Variance (ANOVA) The analysis of variance (ANOVA) is a statistical technique

More information

The One-Way Independent-Samples ANOVA. (For Between-Subjects Designs)

The One-Way Independent-Samples ANOVA. (For Between-Subjects Designs) The One-Way Independent-Samples ANOVA (For Between-Subjects Designs) Computations for the ANOVA In computing the terms required for the F-statistic, we won t explicitly compute any sample variances or

More information

Lecture 5: ANOVA and Correlation

Lecture 5: ANOVA and Correlation Lecture 5: ANOVA and Correlation Ani Manichaikul amanicha@jhsph.edu 23 April 2007 1 / 62 Comparing Multiple Groups Continous data: comparing means Analysis of variance Binary data: comparing proportions

More information

One-Way Analysis of Variance: ANOVA

One-Way Analysis of Variance: ANOVA One-Way Analysis of Variance: ANOVA Dr. J. Kyle Roberts Southern Methodist University Simmons School of Education and Human Development Department of Teaching and Learning Background to ANOVA Recall from

More information

Sociology 6Z03 Review II

Sociology 6Z03 Review II Sociology 6Z03 Review II John Fox McMaster University Fall 2016 John Fox (McMaster University) Sociology 6Z03 Review II Fall 2016 1 / 35 Outline: Review II Probability Part I Sampling Distributions Probability

More information

7.2 One-Sample Correlation ( = a) Introduction. Correlation analysis measures the strength and direction of association between

7.2 One-Sample Correlation ( = a) Introduction. Correlation analysis measures the strength and direction of association between 7.2 One-Sample Correlation ( = a) Introduction Correlation analysis measures the strength and direction of association between variables. In this chapter we will test whether the population correlation

More information

The entire data set consists of n = 32 widgets, 8 of which were made from each of q = 4 different materials.

The entire data set consists of n = 32 widgets, 8 of which were made from each of q = 4 different materials. One-Way ANOVA Summary The One-Way ANOVA procedure is designed to construct a statistical model describing the impact of a single categorical factor X on a dependent variable Y. Tests are run to determine

More information

Chapter 10: Chi-Square and F Distributions

Chapter 10: Chi-Square and F Distributions Chapter 10: Chi-Square and F Distributions Chapter Notes 1 Chi-Square: Tests of Independence 2 4 & of Homogeneity 2 Chi-Square: Goodness of Fit 5 6 3 Testing & Estimating a Single Variance 7 10 or Standard

More information

B. Weaver (18-Oct-2006) MC Procedures Chapter 1: Multiple Comparison Procedures ) C (1.1)

B. Weaver (18-Oct-2006) MC Procedures Chapter 1: Multiple Comparison Procedures ) C (1.1) B. Weaver (18-Oct-2006) MC Procedures... 1 Chapter 1: Multiple Comparison Procedures 1.1 Introduction The omnibus F-test in a one-way ANOVA is a test of the null hypothesis that the population means of

More information

Inferences for Regression

Inferences for Regression Inferences for Regression An Example: Body Fat and Waist Size Looking at the relationship between % body fat and waist size (in inches). Here is a scatterplot of our data set: Remembering Regression In

More information

Outline. Topic 19 - Inference. The Cell Means Model. Estimates. Inference for Means Differences in cell means Contrasts. STAT Fall 2013

Outline. Topic 19 - Inference. The Cell Means Model. Estimates. Inference for Means Differences in cell means Contrasts. STAT Fall 2013 Topic 19 - Inference - Fall 2013 Outline Inference for Means Differences in cell means Contrasts Multiplicity Topic 19 2 The Cell Means Model Expressed numerically Y ij = µ i + ε ij where µ i is the theoretical

More information

Summary of Chapter 7 (Sections ) and Chapter 8 (Section 8.1)

Summary of Chapter 7 (Sections ) and Chapter 8 (Section 8.1) Summary of Chapter 7 (Sections 7.2-7.5) and Chapter 8 (Section 8.1) Chapter 7. Tests of Statistical Hypotheses 7.2. Tests about One Mean (1) Test about One Mean Case 1: σ is known. Assume that X N(µ, σ

More information

2 Hand-out 2. Dr. M. P. M. M. M c Loughlin Revised 2018

2 Hand-out 2. Dr. M. P. M. M. M c Loughlin Revised 2018 Math 403 - P. & S. III - Dr. McLoughlin - 1 2018 2 Hand-out 2 Dr. M. P. M. M. M c Loughlin Revised 2018 3. Fundamentals 3.1. Preliminaries. Suppose we can produce a random sample of weights of 10 year-olds

More information

Lecture 28. Ingo Ruczinski. December 3, Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Johns Hopkins University

Lecture 28. Ingo Ruczinski. December 3, Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Johns Hopkins University Lecture 28 Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Johns Hopkins University December 3, 2015 1 2 3 4 5 1 Familywise error rates 2 procedure 3 Performance of with multiple

More information

Lec 1: An Introduction to ANOVA

Lec 1: An Introduction to ANOVA Ying Li Stockholm University October 31, 2011 Three end-aisle displays Which is the best? Design of the Experiment Identify the stores of the similar size and type. The displays are randomly assigned to

More information

Multiple Comparison Methods for Means

Multiple Comparison Methods for Means SIAM REVIEW Vol. 44, No. 2, pp. 259 278 c 2002 Society for Industrial and Applied Mathematics Multiple Comparison Methods for Means John A. Rafter Martha L. Abell James P. Braselton Abstract. Multiple

More information

Independent Samples ANOVA

Independent Samples ANOVA Independent Samples ANOVA In this example students were randomly assigned to one of three mnemonics (techniques for improving memory) rehearsal (the control group; simply repeat the words), visual imagery

More information

CH.9 Tests of Hypotheses for a Single Sample

CH.9 Tests of Hypotheses for a Single Sample CH.9 Tests of Hypotheses for a Single Sample Hypotheses testing Tests on the mean of a normal distributionvariance known Tests on the mean of a normal distributionvariance unknown Tests on the variance

More information

Chap The McGraw-Hill Companies, Inc. All rights reserved.

Chap The McGraw-Hill Companies, Inc. All rights reserved. 11 pter11 Chap Analysis of Variance Overview of ANOVA Multiple Comparisons Tests for Homogeneity of Variances Two-Factor ANOVA Without Replication General Linear Model Experimental Design: An Overview

More information

Multiple Comparison Procedures Cohen Chapter 13. For EDUC/PSY 6600

Multiple Comparison Procedures Cohen Chapter 13. For EDUC/PSY 6600 Multiple Comparison Procedures Cohen Chapter 13 For EDUC/PSY 6600 1 We have to go to the deductions and the inferences, said Lestrade, winking at me. I find it hard enough to tackle facts, Holmes, without

More information

CHL 5225H Advanced Statistical Methods for Clinical Trials: Multiplicity

CHL 5225H Advanced Statistical Methods for Clinical Trials: Multiplicity CHL 5225H Advanced Statistical Methods for Clinical Trials: Multiplicity Prof. Kevin E. Thorpe Dept. of Public Health Sciences University of Toronto Objectives 1. Be able to distinguish among the various

More information

PSYC 331 STATISTICS FOR PSYCHOLOGISTS

PSYC 331 STATISTICS FOR PSYCHOLOGISTS PSYC 331 STATISTICS FOR PSYCHOLOGISTS Session 4 A PARAMETRIC STATISTICAL TEST FOR MORE THAN TWO POPULATIONS Lecturer: Dr. Paul Narh Doku, Dept of Psychology, UG Contact Information: pndoku@ug.edu.gh College

More information

In a one-way ANOVA, the total sums of squares among observations is partitioned into two components: Sums of squares represent:

In a one-way ANOVA, the total sums of squares among observations is partitioned into two components: Sums of squares represent: Activity #10: AxS ANOVA (Repeated subjects design) Resources: optimism.sav So far in MATH 300 and 301, we have studied the following hypothesis testing procedures: 1) Binomial test, sign-test, Fisher s

More information

T.I.H.E. IT 233 Statistics and Probability: Sem. 1: 2013 ESTIMATION AND HYPOTHESIS TESTING OF TWO POPULATIONS

T.I.H.E. IT 233 Statistics and Probability: Sem. 1: 2013 ESTIMATION AND HYPOTHESIS TESTING OF TWO POPULATIONS ESTIMATION AND HYPOTHESIS TESTING OF TWO POPULATIONS In our work on hypothesis testing, we used the value of a sample statistic to challenge an accepted value of a population parameter. We focused only

More information

Analysis of variance

Analysis of variance Analysis of variance 1 Method If the null hypothesis is true, then the populations are the same: they are normal, and they have the same mean and the same variance. We will estimate the numerical value

More information

Presented to the Graduate Council of the. North Texas State University. in Partial. Fulfillment of the Requirements. For the Degree of.

Presented to the Graduate Council of the. North Texas State University. in Partial. Fulfillment of the Requirements. For the Degree of. AN EMPIRICAL INVESTIGATION OF TUKEY'S HONESTLY SIGNIFICANT DIFFERENCE TEST WITH VARIANCE HETEROGENEITY AND UNEQUAL SAMPLE SIZES, UTILIZING KRAMER'S PROCEDURE AND THE HARMONIC MEAN DISSERTATION Presented

More information

DETAILED CONTENTS PART I INTRODUCTION AND DESCRIPTIVE STATISTICS. 1. Introduction to Statistics

DETAILED CONTENTS PART I INTRODUCTION AND DESCRIPTIVE STATISTICS. 1. Introduction to Statistics DETAILED CONTENTS About the Author Preface to the Instructor To the Student How to Use SPSS With This Book PART I INTRODUCTION AND DESCRIPTIVE STATISTICS 1. Introduction to Statistics 1.1 Descriptive and

More information

Factorial designs. Experiments

Factorial designs. Experiments Chapter 5: Factorial designs Petter Mostad mostad@chalmers.se Experiments Actively making changes and observing the result, to find causal relationships. Many types of experimental plans Measuring response

More information

Notes for Week 13 Analysis of Variance (ANOVA) continued WEEK 13 page 1

Notes for Week 13 Analysis of Variance (ANOVA) continued WEEK 13 page 1 Notes for Wee 13 Analysis of Variance (ANOVA) continued WEEK 13 page 1 Exam 3 is on Friday May 1. A part of one of the exam problems is on Predictiontervals : When randomly sampling from a normal population

More information

Unit 12: Analysis of Single Factor Experiments

Unit 12: Analysis of Single Factor Experiments Unit 12: Analysis of Single Factor Experiments Statistics 571: Statistical Methods Ramón V. León 7/16/2004 Unit 12 - Stat 571 - Ramón V. León 1 Introduction Chapter 8: How to compare two treatments. Chapter

More information

Hypothesis testing: Steps

Hypothesis testing: Steps Review for Exam 2 Hypothesis testing: Steps Repeated-Measures ANOVA 1. Determine appropriate test and hypotheses 2. Use distribution table to find critical statistic value(s) representing rejection region

More information

BIOL Biometry LAB 6 - SINGLE FACTOR ANOVA and MULTIPLE COMPARISON PROCEDURES

BIOL Biometry LAB 6 - SINGLE FACTOR ANOVA and MULTIPLE COMPARISON PROCEDURES BIOL 458 - Biometry LAB 6 - SINGLE FACTOR ANOVA and MULTIPLE COMPARISON PROCEDURES PART 1: INTRODUCTION TO ANOVA Purpose of ANOVA Analysis of Variance (ANOVA) is an extremely useful statistical method

More information

Solutions to Final STAT 421, Fall 2008

Solutions to Final STAT 421, Fall 2008 Solutions to Final STAT 421, Fall 2008 Fritz Scholz 1. (8) Two treatments A and B were randomly assigned to 8 subjects (4 subjects to each treatment) with the following responses: 0, 1, 3, 6 and 5, 7,

More information

Multiple Testing. Tim Hanson. January, Modified from originals by Gary W. Oehlert. Department of Statistics University of South Carolina

Multiple Testing. Tim Hanson. January, Modified from originals by Gary W. Oehlert. Department of Statistics University of South Carolina Multiple Testing Tim Hanson Department of Statistics University of South Carolina January, 2017 Modified from originals by Gary W. Oehlert Type I error A Type I error is to wrongly reject the null hypothesis

More information

POLI 443 Applied Political Research

POLI 443 Applied Political Research POLI 443 Applied Political Research Session 6: Tests of Hypotheses Contingency Analysis Lecturer: Prof. A. Essuman-Johnson, Dept. of Political Science Contact Information: aessuman-johnson@ug.edu.gh College

More information

Unit 27 One-Way Analysis of Variance

Unit 27 One-Way Analysis of Variance Unit 27 One-Way Analysis of Variance Objectives: To perform the hypothesis test in a one-way analysis of variance for comparing more than two population means Recall that a two sample t test is applied

More information

13: Additional ANOVA Topics. Post hoc Comparisons

13: Additional ANOVA Topics. Post hoc Comparisons 13: Additional ANOVA Topics Post hoc Comparisons ANOVA Assumptions Assessing Group Variances When Distributional Assumptions are Severely Violated Post hoc Comparisons In the prior chapter we used ANOVA

More information

Introduction. Chapter 8

Introduction. Chapter 8 Chapter 8 Introduction In general, a researcher wants to compare one treatment against another. The analysis of variance (ANOVA) is a general test for comparing treatment means. When the null hypothesis

More information

PSY 307 Statistics for the Behavioral Sciences. Chapter 20 Tests for Ranked Data, Choosing Statistical Tests

PSY 307 Statistics for the Behavioral Sciences. Chapter 20 Tests for Ranked Data, Choosing Statistical Tests PSY 307 Statistics for the Behavioral Sciences Chapter 20 Tests for Ranked Data, Choosing Statistical Tests What To Do with Non-normal Distributions Tranformations (pg 382): The shape of the distribution

More information

Section 9.5. Testing the Difference Between Two Variances. Bluman, Chapter 9 1

Section 9.5. Testing the Difference Between Two Variances. Bluman, Chapter 9 1 Section 9.5 Testing the Difference Between Two Variances Bluman, Chapter 9 1 This the last day the class meets before spring break starts. Please make sure to be present for the test or make appropriate

More information

Review of Statistics 101

Review of Statistics 101 Review of Statistics 101 We review some important themes from the course 1. Introduction Statistics- Set of methods for collecting/analyzing data (the art and science of learning from data). Provides methods

More information

These are all actually contrasts (the coef sum to zero). What are these contrasts representing? What would make them large?

These are all actually contrasts (the coef sum to zero). What are these contrasts representing? What would make them large? Lecture 12 Comparing treatment effects Orthogonal Contrasts What use are contrasts? Recall the Cotton data In this case, the treatment levels have an ordering to them this is not always the case) Consider

More information

Hypothesis testing: Steps

Hypothesis testing: Steps Review for Exam 2 Hypothesis testing: Steps Exam 2 Review 1. Determine appropriate test and hypotheses 2. Use distribution table to find critical statistic value(s) representing rejection region 3. Compute

More information

Using SPSS for One Way Analysis of Variance

Using SPSS for One Way Analysis of Variance Using SPSS for One Way Analysis of Variance This tutorial will show you how to use SPSS version 12 to perform a one-way, between- subjects analysis of variance and related post-hoc tests. This tutorial

More information

Analysis of Variance II Bios 662

Analysis of Variance II Bios 662 Analysis of Variance II Bios 662 Michael G. Hudgens, Ph.D. mhudgens@bios.unc.edu http://www.bios.unc.edu/ mhudgens 2008-10-24 17:21 BIOS 662 1 ANOVA II Outline Multiple Comparisons Scheffe Tukey Bonferroni

More information

Lecture 7: Hypothesis Testing and ANOVA

Lecture 7: Hypothesis Testing and ANOVA Lecture 7: Hypothesis Testing and ANOVA Goals Overview of key elements of hypothesis testing Review of common one and two sample tests Introduction to ANOVA Hypothesis Testing The intent of hypothesis

More information

(Foundation of Medical Statistics)

(Foundation of Medical Statistics) (Foundation of Medical Statistics) ( ) 4. ANOVA and the multiple comparisons 26/10/2018 Math and Stat in Medical Sciences Basic Statistics 26/10/2018 1 / 27 Analysis of variance (ANOVA) Consider more than

More information

Comparing Several Means

Comparing Several Means Comparing Several Means Some slides from R. Pruim STA303/STA1002: Methods of Data Analysis II, Summer 2016 Michael Guerzhoy The Dating World of Swordtail Fish In some species of swordtail fish, males develop

More information

Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2

Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2 Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2 Fall, 2013 Page 1 Random Variable and Probability Distribution Discrete random variable Y : Finite possible values {y

More information

Institute of Actuaries of India

Institute of Actuaries of India Institute of Actuaries of India Subject CT3 Probability & Mathematical Statistics May 2011 Examinations INDICATIVE SOLUTION Introduction The indicative solution has been written by the Examiners with the

More information

Regression models. Categorical covariate, Quantitative outcome. Examples of categorical covariates. Group characteristics. Faculty of Health Sciences

Regression models. Categorical covariate, Quantitative outcome. Examples of categorical covariates. Group characteristics. Faculty of Health Sciences Faculty of Health Sciences Categorical covariate, Quantitative outcome Regression models Categorical covariate, Quantitative outcome Lene Theil Skovgaard April 29, 2013 PKA & LTS, Sect. 3.2, 3.2.1 ANOVA

More information

http://www.statsoft.it/out.php?loc=http://www.statsoft.com/textbook/ Group comparison test for independent samples The purpose of the Analysis of Variance (ANOVA) is to test for significant differences

More information

Rejection regions for the bivariate case

Rejection regions for the bivariate case Rejection regions for the bivariate case The rejection region for the T 2 test (and similarly for Z 2 when Σ is known) is the region outside of an ellipse, for which there is a (1-α)% chance that the test

More information

Section VII. Chi-square test for comparing proportions and frequencies. F test for means

Section VII. Chi-square test for comparing proportions and frequencies. F test for means Section VII Chi-square test for comparing proportions and frequencies F test for means 0 proportions: chi-square test Z test for comparing proportions between two independent groups Z = P 1 P 2 SE d SE

More information

Department of Economics. Business Statistics. Chapter 12 Chi-square test of independence & Analysis of Variance ECON 509. Dr.

Department of Economics. Business Statistics. Chapter 12 Chi-square test of independence & Analysis of Variance ECON 509. Dr. Department of Economics Business Statistics Chapter 1 Chi-square test of independence & Analysis of Variance ECON 509 Dr. Mohammad Zainal Chapter Goals After completing this chapter, you should be able

More information

Two-Sample Inferential Statistics

Two-Sample Inferential Statistics The t Test for Two Independent Samples 1 Two-Sample Inferential Statistics In an experiment there are two or more conditions One condition is often called the control condition in which the treatment is

More information

Analysis of Variance

Analysis of Variance Statistical Techniques II EXST7015 Analysis of Variance 15a_ANOVA_Introduction 1 Design The simplest model for Analysis of Variance (ANOVA) is the CRD, the Completely Randomized Design This model is also

More information

Class 24. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Class 24. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700 Class 4 Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science Copyright 013 by D.B. Rowe 1 Agenda: Recap Chapter 9. and 9.3 Lecture Chapter 10.1-10.3 Review Exam 6 Problem Solving

More information

Introduction to Analysis of Variance (ANOVA) Part 2

Introduction to Analysis of Variance (ANOVA) Part 2 Introduction to Analysis of Variance (ANOVA) Part 2 Single factor Serpulid recruitment and biofilms Effect of biofilm type on number of recruiting serpulid worms in Port Phillip Bay Response variable:

More information

Statistical Analysis for QBIC Genetics Adapted by Ellen G. Dow 2017

Statistical Analysis for QBIC Genetics Adapted by Ellen G. Dow 2017 Statistical Analysis for QBIC Genetics Adapted by Ellen G. Dow 2017 I. χ 2 or chi-square test Objectives: Compare how close an experimentally derived value agrees with an expected value. One method to

More information

SEVERAL μs AND MEDIANS: MORE ISSUES. Business Statistics

SEVERAL μs AND MEDIANS: MORE ISSUES. Business Statistics SEVERAL μs AND MEDIANS: MORE ISSUES Business Statistics CONTENTS Post-hoc analysis ANOVA for 2 groups The equal variances assumption The Kruskal-Wallis test Old exam question Further study POST-HOC ANALYSIS

More information

One-Way Analysis of Variance. With regression, we related two quantitative, typically continuous variables.

One-Way Analysis of Variance. With regression, we related two quantitative, typically continuous variables. One-Way Analysis of Variance With regression, we related two quantitative, typically continuous variables. Often we wish to relate a quantitative response variable with a qualitative (or simply discrete)

More information

Question. Hypothesis testing. Example. Answer: hypothesis. Test: true or not? Question. Average is not the mean! μ average. Random deviation or not?

Question. Hypothesis testing. Example. Answer: hypothesis. Test: true or not? Question. Average is not the mean! μ average. Random deviation or not? Hypothesis testing Question Very frequently: what is the possible value of μ? Sample: we know only the average! μ average. Random deviation or not? Standard error: the measure of the random deviation.

More information

Analysis Of Variance Compiled by T.O. Antwi-Asare, U.G

Analysis Of Variance Compiled by T.O. Antwi-Asare, U.G Analysis Of Variance Compiled by T.O. Antwi-Asare, U.G 1 ANOVA Analysis of variance compares two or more population means of interval data. Specifically, we are interested in determining whether differences

More information

Review for Final. Chapter 1 Type of studies: anecdotal, observational, experimental Random sampling

Review for Final. Chapter 1 Type of studies: anecdotal, observational, experimental Random sampling Review for Final For a detailed review of Chapters 1 7, please see the review sheets for exam 1 and. The following only briefly covers these sections. The final exam could contain problems that are included

More information

Design of Experiments. Factorial experiments require a lot of resources

Design of Experiments. Factorial experiments require a lot of resources Design of Experiments Factorial experiments require a lot of resources Sometimes real-world practical considerations require us to design experiments in specialized ways. The design of an experiment is

More information