Ch. 11 Inference for Distributions of Categorical Data

Transcription

1 Ch. 11 Inference for Distributions of Categorical Data CH INFERENCES FOR RELATIONSHIPS

2 The two sample z procedures from Ch. 10 allowed us to compare proportions of successes in two populations or for two treatments. What if we want to compare the distributions of a single categorical variable across several populations or treatments? For this new test, we use two-way tables to present the data.

3 2 populations 1 categorical variable 3 categories Are we looking at row totals or column totals? row totals 20 Not much 100 = 20% per day 100 = 50% per week 100 = 30% Grand Total

4 Are we looking at 1 row or 1 column? 1 column (Granada column) 4 Not much 50 = 8% 1+ per week 1+ per day = 32% = 60%

5 % of ECRCHS is expected to use Facebook 1+ per week row total column total grand total (# of rows 1)(# of columns 1) = r 1 c 1 = 15

6 In Ch. 11-1, we used a χ 2 GOF test the claimed distribution of a categorical variable. No. We are not comparing a sample distribution to a claimed distribution. We are comparing a sample distribution to another sample distribution.

7 row 1, column 1: = 10 (10) (15) (10) (15) (25) (25) State: H 0 : H a : There is no difference in the distribution of Facebook habits between ECRCHS and Granada. There is some difference in the distribution of Facebook habits between ECRCHS and Granada. α = 0.05

8 When comparing a sample distribution to another sample distribution, we use the Plan: χ 2 test of homogeneity Random: Large Sample Size: random sample from each high school All expected counts are at least 5. (10, 10, 15, 15, 25, 25) Independent: Two things to check: 1) Both samples or groups need to be independent of each other. 2) Individual observations in each sample or group have to be independent. When sampling without replacement for both samples, must check 10% condition for both. We clearly have two independent samples one from each school. There must be at least and Granada. = 500 students at both ECRCHS

9 Do: χ 2 distribution, df = 2 df = r 1 c 1 = (3 1)(2 1) = 2 χ 2 = O E 2 E = = χ 2 = 9.34 χ 2 cdf lower bound, upper bound, df = χ 2 cdf 9.34, 99999, 2 =.0094 p-value

10 Conclude: Assuming H 0 is true (there is no difference in the distribution of Facebook habits between ECRCHS and Granada), there is a probability of getting a χ 2 value of 9.34 or more purely by chance. This provides strong evidence against H 0 and is statistically significant at α = 0.05 level (.0094 <.05). Therefore, we reject H 0 and can conclude that there is some difference in Facebook habits between ECRCHS and Granada. The largest component of χ 2 is 3.6 because the number of ECRCHS and Granada students who don t go on Facebook much was higher than expected and lower than expected, respectively. one one one 2+

11 Just by looking at the data, what do you think the p-value will be? Totals Totals Not appropriate to round expected counts to whole numbers State: H 0 : H a : There is no difference in the success rates for the three test preparation strategies. There is a difference in the success rates for the three test preparation strategies. α = 0.05

12 Plan: χ 2 test of homogeneity Random: random sample of 149 students who had passed the exam and separate sample of 101 students who did not pass the exam Large Sample Size: All expected counts are at least 5. (29.8, 59.6, 59.6, 20.2, 40.4, 40.4) Independent: Independent samples were taken. There must be at least = 1490 students who have passed the AP Stats exam and at least = 1010 students who did not.

13 Do: χ 2 distribution, df = 2 df = r 1 c 1 = (3 1)(2 1) = 2 χ 2 = O E 2 E = = χ 2 = You can use χ 2 GOF-Test to get the contribution values quickly, but don t say you used χ 2 GOF-Test for a test of homogeneity. χ 2 cdf lower bound, upper bound, df = χ 2 cdf , 9999, 2 = 0 p-value

14 Conclude: Assuming H 0 is true (there is no difference in the success rates for the three test preparation strategies), there is a 0 probability of getting a χ 2 value of or more purely by chance. This provides very strong evidence against H 0 and is statistically significant at α = 0.05 level (0 <.05). Therefore, we reject H 0 and can conclude that there is a difference in success rates for the three types of test preparations. The largest component of χ 2 is 60.9 because the number of students who didn t pass the exam with no review was much higher than expected.

15 What if we have a single random sample from a single population that s classified according to two categorical variables, and our goal is to see if the two categorical variables have a relationship/association? New Test! Why can t we use χ 2 GOF? There s more than one categorical variable. Why can t we use χ 2 Homogeneity? There s one population and more than one categorical variable.

16 Totals two categorical variables Totals State: H 0 : H a : H 0 : H a : There is no association between the math class and sport played for high school students. There is some association between the math class and sport played for high school students. OR Math class and sport played are independent in the population of high school students. Math class and sport played are not independent in the population of high school students. α = 0.05

17 Plan: χ 2 test of association/independence Random: Large Sample Size: random sample of 335 high school students All expected counts are at least 5. The lowest expected count is (see table) Independent: One thing to check: Individual observations in the sample or group have to be independent. When sampling without replacement, must check 10% condition for both. There must be at least = 3350 high school students in the USA that play a sport and take a math class.

18 Do: χ 2 distribution, df = 6 df = r 1 c 1 = (3 1)(4 1) = 6 χ 2 = You can use χ 2 GOF-Test to get the contribution values quickly, but don t say you used χ 2 GOF-Test for a test of homogeneity. O E = E = χ 2 = χ 2 cdf lower bound, upper bound, df = χ 2 cdf 28.96, 9999, 6 = 0 p-value

19 Conclude: Assuming H 0 is true (there is no association between math class and sport played for HS students), there is about a 0 probability of getting a χ 2 value of or more purely by chance. This provides strong evidence against H 0 and is statistically significant at α = 0.05 level 0 <.05. Therefore, we reject H 0 and can conclude that there is some association between math class and sport played. The largest component of χ 2 is because the number of Geometry students who play football is much less than expected.

20 1 1 Skittles problem. Tests the null hypothesis that a categorical variable has a claimed distribution. 1 2 or more Facebook habits at ECRCHS vs Granada Comparing the distribution of one categorical variable in two or more populations. 2 1 Math class vs sport played Investigating the relationship between two categorical variables in one population.

21 Is there an association between resemblance and dog breed? Totals Totals χ 2 test of association/independence χ 2 = 3.73

22 Does the data give convincing evidence of a difference in resemblance and an owner s choice in dog breed? p 1 = 16 Two-proportion z test (two-sided) 25 = z = the same.053 p 2 = 7 20 =.35 This only works for two-sided two proportion z tests. z 2 = χ = 3.73