Chi-Square. Heibatollah Baghi, and Mastee Badii

Transcription

1 1 Chi-Square Heibatollah Baghi, and Mastee Badii

2 Different Scales, Different Measures of Association Scale of Both Variables Nominal Scale Measures of Association Pearson Chi-Square: χ 2 Ordinal Scale Spearman s rho Interval or Ratio Scale Pearson r 2

3 Chi-Square (χ 2 ) and Frequency Data Up to this point, the inference to the population has been concerned with scores on one or more variables, such as CAT scores, mathematics achievement, and hours spent on the computer. We used these scores to make the inferences about population means. To be sure not all research questions involve score data. Today the data that we analyze consists of frequencies; that is, the number of individuals falling into categories. In other words, the variables are measured on a nominal scale. The test statistic for frequency data is Pearson Chi-Square. The magnitude of Pearson Chi-Square reflects the amount of discrepancy between observed frequencies and expected frequencies. 3

4 Steps in Test of Hypothesis 1. Determine the appropriate test 2. Establish the level of significance:α 3. Formulate the statistical hypothesis 4. Calculate the test statistic 5. Determine the degree of freedom 6. Compare computed test statistic against a tabled/critical value 4

5 1. Determine Appropriate Test Chi Square is used when both variables are measured on a nominal scale. It can be applied to interval or ratio data that have been categorized into a small number of groups. It assumes that the observations are randomly sampled from the population. All observations are independent (an individual can appear only once in a table and there are no overlapping categories). It does not make any assumptions about the shape of the distribution nor about the homogeneity of variances. 5

6 2. Establish Level of Significance α is a predetermined value The convention α=.05 α=.01 α=.001 6

7 3. Determine The Hypothesis: Whether There is an Association or Not H o : The two variables are independent H a : The two variables are associated 7

8 4. Calculating Test Statistics Contrasts observedfrequencies in each cell of a contingency table with expected frequencies. The expected frequencies represent the number of cases that would be found in each cell if the null hypothesis were true ( i.e. the nominal variables are unrelated). Expected frequency of two unrelated events is product of the row and column frequency divided by number of cases. F e = F r F c / N 8

9 4. Calculating Test Statistics ( F F ) χ 2 = o e Fe 2 9

10 4. Calculating Test Statistics ( F F ) χ 2 = o e Fe 2 10

11 11 5. Determine Degrees of Freedom df = (R-1)(C-1)

12 6. Compare computed test statistic against a tabled/critical value The computed value of the Pearson chisquare statistic is compared with the critical value to determine if the computed value is improbable The critical tabled values are based on sampling distributions of the Pearson chisquare statistic If calculated χ 2 is greater than χ 2 table value, reject H o 12

13 Example Suppose a researcher is interested in voting preferences on gun control issues. A questionnaire was developed and sent to a random sample of 90 voters. The researcher also collects information about the political party membership of the sample of 90 respondents. 13

14 Bivariate Frequency Table or Contingency Table Favor Neutral Oppose f row Democrat Republican f column n = 90 14

15 Bivariate Frequency Table or Contingency Table Favor Neutral Oppose f row Democrat Republican f column n = 90 15

16 Bivariate Frequency Table or Contingency Table Favor Neutral Oppose f row Row frequency Democrat Republican f column n = 90 16

17 Bivariate Frequency Table or Contingency Table Favor Neutral Oppose f row Democrat Republican f column n = 90 Column frequency 17

18 1. Determine Appropriate Test 1. Party Membership ( 2 levels) and Nominal 2. Voting Preference ( 3 levels) and Nominal 18

19 19 2. Establish Level of Significance Alpha of.05

20 3. Determine The Hypothesis Ho : There is no difference between D & R in their opinion on gun control issue. Ha : There is an association between responses to the gun control survey and the party membership in the population. 20

21 4. Calculating Test Statistics Favor Neutral Oppose f row Democrat f o =10 f o =10 f o =30 50 f e =13.9 f e =13.9 f e =22.2 Republican f o =15 f o =15 f o =10 40 f e =11.1 f e =11.1 f e =17.8 f column n = 90 21

22 4. Calculating Test Statistics Democrat f o =10 f e =13.9 Republican f o =15 f e =11.1 Favor Neutral Oppose f row f o =10 = 50*25/90 f o =30 f e =13.9 f e =22.2 f o =15 f o =10 f e =11.1 f e = f column n = 90 22

23 4. Calculating Test Statistics Favor Neutral Oppose f row Democrat f o =10 f e =13.9 Republican f o =15 f e =11.1 f o =10 f o =30 50 f e =13.9 = 40* 25/90 f o =15 f e =22.2 f o =10 f e =11.1 f e =17.8 f column n =

24 4. Calculating Test Statistics 2 χ = ( ) ( ) ( ) ( ) ( ) ( ) =

25 25 5. Determine Degrees of Freedom df = (R-1)(C-1) = (2-1)(3-1) = 2

26 6. Compare computed test statistic against a tabled/critical value α= 0.05 df = 2 Critical tabled value = Test statistic, 11.03, exceeds critical value Null hypothesis is rejected Democrats & Republicans differ significantly in their opinions on gun control issues 26

27 SPSS Output for Gun Control Example Pearson Chi-Square Likelihood Ratio Linear-by-Linear Association N of Valid Cases Chi-Square Tests Asymp. Sig. Value df (2-sided) a a. 0 cells (.0%) have expected count less than 5. The minimum expected count is

28 Additional Information in SPSS Output Exceptions that might distort χ 2 Assumptions Associations in some but not all categories Low expected frequency per cell Extent of association is not same as statistical significance Demonstrated through an example 28

29 Another Example Heparin Lock Placement Complication Incidence Total Had Compilca Had NO Compilca Count Expected Count % within Heparin Lock Placement Time Grou Count Expected Count % within Heparin Lock Placement Time Grou Count Expected Count % within Heparin Lock Placement Time Grou Heparin Lock Placement Time Group 1 2 Total % 22.0% 20.0% % 78.0% 80.0% % 100.0% 100.0% Time: 1 = 72 hrs 2 = 96 hrs from Polit Text: Table

30 Hypotheses in Heparin Lock Placement H o :There is no association between complication incidence and length of heparin lock placement. (The variables are independent). H a :There is an association between complication incidence and length of heparin lock placement. (The variables are related). 30

31 More of SPSS Output 31

32 Pearson Chi-Square Pearson Chi-Square =.250, p =.617 Since the p >.05, we fail to reject the null hypothesis that the complication rate is unrelated to heparin lock placement time. Continuity correction is used in situations in which the expected frequency for any cell in a 2 by 2 table is less than

33 More SPSS Output Nominal by Nominal Phi Cramer's V Interval by IntervaPearson's R Ordinal by Ordin N of Valid Cases Spearman Correlatio a. Not assuming the null hypothesis. Symmetric Measures Asymp. Value Std. Error a Approx. T b Approx. Sig c c 100 b. Using the asymptotic standard error assuming the null hypothesis. c. Based on normal approximation. 33

34 Phi Coefficient Pearson Chi-Square provides information about the existence of relationship between 2 nominal variables, but not about the magnitude of the relationship Phi coefficient is the measure of the strength of the association Nominal by Nominal Interval by Interval Ordinal by Ordinal N of Valid Cases a. b. c. Phi Cramer's V Pearson's R Not assuming the null hypothesis. Spearman Correlation Using the asymptotic standard error assuming the null hypothesis. Based on normal approximation. φ = 2 χ N Value

35 Cramer s V When the table is larger than 2 by 2, a different index must be used to measure the strength of the relationship between the variables. One such index is Cramer s V. If Cramer s V is large, it means that there is a tendency for particular categories of the first variable to be associated with particular categories of the second variable. Nominal by Nominal V Interval by Interval Ordinal by Ordinal N of Valid Cases a. b. c. Phi Cramer's V Pearson's R Not assuming the null hypothesis. Spearman Correlation Using the asymptotic standard error assuming the null hypothesis. Based on normal approximation. = χ N( k 2 1) Value

36 Cramer s V When the table is larger than 2 by 2, a different index must be used to measure the strength of the relationship between the variables. One such index is Cramer s V. If Cramer s V is large, it means that there is a tendency for particular categories of the first variable to be associated with particular categories of the second variable. Nominal by Nominal V Interval by Interval Ordinal by Ordinal N of Valid Cases a. b. c. Phi Cramer's V Pearson's R Not assuming the null hypothesis. Spearman Correlation Using the asymptotic standard error assuming the null hypothesis. Based on normal approximation. = χ N( k 2 1) Value Number of cases Smallest of number of rows or columns 36

37 37 Take Home Lesson How to Test Association between Frequency of Two Nominal Variables