Analysis of data in square contingency tables
|
|
- Shanon Casey
- 5 years ago
- Views:
Transcription
1 Analysis of data in square contingency tables Iva Pecáková Let s suppose two dependent samples: the response of the nth subject in the second sample relates to the response of the nth subject in the first sample There are two common forms of sample dependency: (1) the same subjects are surveyed at different points in time (before-after and studies including panel studies); (2) the different subjects with a natural pairing are surveyed (a husband and his wife, a parent and his child, two people rate the same object, etc) The first form is often called repeated measures or longitudinal data, the second one matched pairs data In such a case, the responses of a categorical variable are summarized by a two-way contingency table in which row and column classifications have the same categories Thus, the table is square, r = c (r is number of rows and c is number of columns in the table) There are usually the large values on the main diagonal of such a table, cell probabilities or associations may exhibit more or less symmetric pattern about this diagonal Two marginal distributions may agree (there is marginal homogeneity) or they may differ in some systematic way If r = 2 (table 1) and the hypothesis Table 1 The binary variable (r = 2) Occasion 2 Occasion 1 X = 0 X = 1 Σ X = 0 n 11 n 12 n 1 X = 1 n 21 n 22 n 2 Σ n 1 n 2 n n ij ( i = 1, 2; j = 1, 2) dete frequencies, p ij = n i j /n dete relative frequencies π = π π = π (1) holds (for 2 x 2 table it is marginal homogeneity and symmetry, too), the frequency n 12 has a bimial distribution with parameters n 12 n 21 and 0,5 A p-value (for two-sided test) is then double probability P[n 12 min(n 12, n 21 )], the asterisk detes here observed frequencies For large samples, as kwn, the statistic has a standard rmal distribution and n 0,5( n n ) n n U = = 0,5 n n n n U (n n ) = n n has chi-square distribution with one degree of freedom (the significance test for this statistic is kwn as McNemar test) 2 (2) (3)
2 2 If this test is significant, we can estimate the true difference between π 1 and π 1 as where ( p p ) ± u SE ˆ( p p ) 1, (4) α /2 1 [ ] SE ˆ( p p ) = p (1 p ) p (1 p ) 2( p p p p ) / n If r > 2 (table 2), the hypothesis π π = i i Table 2 The categorical variable (r > 2) Occasion 2 Occasion 1 x 1 x r Σ x 1 n 11 n 1r n 1 x r n r1 n rr n r Σ n 1 n r n, i = 1, 2, r (5) is marginal homogeneity and the hypothesis π ij = π, i = 1, 2, r; j = 1, 2, r (6) ji is symmetry Symmetry is equivalent marginal homogeneity, but for r > 2 marginal homogeneity doesn t mean symmetry (the example in the table 3) Table 3 Marginal homogeneity, t symmetry X 1 X 2 X 3 Σ X X X Σ The saturated loglinear model for such square contingency table can be written as ln m ij = λ λ i λ j λ ij, (7) 1 1 where λ = ln m 2 ij, λi = ln mij λ, r r i j 1 λ j = ln mij λ, λij = ln mij λi λj λ r i j The parameters of this model are the linear combinations of expected frequencies m ij, i = 1, 2, r; j = 1, 2,, r and their number is 1 r 1 r 1 (r 1) 2 = r 2 (their identifiability requires constraints Σ λ i = 0, Σ λ ij = 0) The cell expected frequencies m ij are estimated with n ij
3 3 When the independence model holds, all the association parameters λ ij in (7) are zero The cell expected frequencies are estimated with np i p j To test the goodness of fit of this model, the well-kwn Pearson statistic (X 2 ) or likelihood ratio chi-squared statistics (deviance) G 2, G 2 r r nij = 2 nij ln, (8) m ˆ i j ij can be used The degrees of freedom is (r 1) 2 However, the square tables for repeated measures or matched pairs data usually have large counts on the main diagonal and this model is t useful In this case, there is important a structure of frequencies off the main diagonal When the row response differs from the column response in this table, the variables are quasi independent While the independence loglinear model can be written as ln m ij = λ λ i λ j ; (9) the quasi-independence loglinear model can be written as ln m ij λ λ i λ j δ i I ij =, (10) where I ij indicates the diagonal elements in the table (I ij = 1 for i = j and I ij = 0 for i j) In this model mˆ ii = n ii holds, but the expected frequencies haven t direct estimates To obtain the maximum likelihood estimates, the set of likelihood equations is to solve The likelihood equations do t have a direct solution and can be solved using an iterative algorithm (Newton- Raphson methods for example) The number of parameters of the quasi-independence model is 1 2(r 1) r and the residual degrees of freedom are then df = r 2 [1 2(r 1) r] = (r 1) 2 r For the symmetry model, in (7) all λ ij = λ ji The parameters λ i, i = 1, 2, r, are the same for both classifications (there is a marginal homogeneity) Expected frequencies m ij are estimated as (n ij n ji )/2 in this case It results from this, that mˆ ii = n ii The number of parameters of the model is w 1 (r 1) r(r 1)/2 and the residual degrees of freedom are df = r 2 [1 (r 1) r(r 1)/2] = r(r 1)/2 The Pearson statistic X 2 can be simplified for this model to form 2 ( n ) 2 ij nji Χ = (11) n n i< j ij ji For r = 2 this is the statistics (3) The symmetry model is often too simple to fit a table, because of the imposition of identical marginals In the quasi symmetry model, the marginal homogeneity doesn t hold more, the parameters λ i, i = 1, 2, r, aren t the same In this model mˆ ii = n ii, too, but there aren t a direct estimates for expected frequencies To obtain these estimates, Newton-Raphson methods, iterative proportional fitting or iterative methods must be used again This model has the property of symmetric association (symmetry of odds ratios), when
4 4 θ mm mm ij rr ji rr ij = = = θ ji for all i and j (12) mm ir rj mjrmri The number of parameters of this model is 1 (r 1) (r 1) r(r 1)/2 and the residual degrees of freedom are w df = r 2 [1 2(r 1) r(r 1)/2] = (r 1)(r 2)/2 Some loglinear models imply marginal homogeneity If a table satisfies symmetry, it also satisfies both quasi symmetry and marginal homogeneity As we can see for example in [1], the converse holds too When quasi symmetry holds, marginal homogeneity is equivalent to symmetry and we can test marginal homogeneity by comparing goodness-of-fit statistics (deviances) for the symmetry (S) and quasi-symmetry (QS) models: G S QS G S G QS ( / ) = ( ) ( ) (13) This difference has chi-squared distribution with (r 1) degrees of freedom Let s remind that the well-kwn Stuart-Maxwell test can be used to test marginal homogeneity, too The Stuart-Maxwell statistic X 2 = d' S -1 d, (14) where d = [d 1, d 2, d r 1 ], d i = n i n i, i = 1, 2, r 1 and S detes the (r 1) x (r 1) covariance matrix of the elements of d, has asymptotically chi-square distribution with r 1 degrees of freedom The results of both tests are usually very similar The following data (table 4) were provided by Factum Invenio, s r o Data come from election researches realized in June 2003, in April 2004 (shortly before the end of the Špidla s cabinet), in June 2005 (after the end of the Gross cabinet) and in April 2006 (shortly before the parliamentary election) All these data files include the same questions: Which party did you in the election (the variable is ) and Which party would you at the moment (the variable is preference ) Thus, each respondent expresses whether his inclination has changed or t since the last election Table 4 Data from election researches * preference 2003 Crosstabulation US preference 2003 US
5 5 US * preference 2004 Crosstabulation preference 2004 US US * preference 2005 Crosstabulation preference 2005 US US * preference 2006 Crosstabulation preference 2006 US As we could expect, independence is strongly rejected for all four data files (X 2 runs from 1876 by 25 degrees of freedom) The symmetry model is also unpromising For example, in 2004 only 9 people changed their inclination from to and 25 people did so in the opposite direction Only 2 people changed their inclination from to and 19 people did so in the opposite direction, and so on The results of this model are contained in table 5
6 6 The majority of rs did t change their preference and their frequencies are always on the main diagonal This suggests fitting a quasi independence model, omitting the diagonal The results are also contained in table 5 As we can see, for years 2003 and 2005 this model fits well It s t possible to prove differences in pattern of changed preferences of several parties in these years However, this difference is proved for years 2004 and 2006 The quasi symmetry model doesn t fit well only for year 2006 The last test confirms expected marginal heterogeneity in all files The table 6 with sign schemas (for quasi-independence in 2004 and 2006, quasi symmetry in 2006) appends the most interesting results Let s remark that true distribution of statistics used for testing fit may be far from chisqared when expected frequencies are small Our tables are sparse and fitted cell counts small, but for loglinear models the expected values refer to marginal totals and the chi-sqared approximation is likely to be adequate (In the next paper we would like to verify our results with exact tests) Table 5 Results of the analysis X 2 p-value df G 2 p-value Year Symmetry ,3 0, ,2 0, ,4 0, ,7 0, ,6 0, ,4 0, ,5 0, ,8 0,00 Quasi independence ,4 0, ,9 0, ,7 0, ,7 0, ,9 0, ,1 0, ,6 0, ,9 0,00 Quasi symmetry ,6 0, ,4 0, ,8 0, ,8 0, ,9 0, ,1 0, ,1 0, ,6 0,00 Marginal homogeneity ,8 0, ,9 0, ,3 0, ,2 0,00
7 7 Table 6 Sign schemas US References: US [1] Agresti, A: Categorical Data Analysis, John Wiley & Sons, 1995 [2] Anděl, J: Matematická statistika, SNTL, Praha 1978 [3] Jobson, JD: Applied Multivariate Data Analysis, Volume II: Categorical and Multivariate Methods, 1991 [4] Řeháková,B-Řehák,J: Analýza kategorizovaných dat v sociologii, Academia Praha 1986 [5] SPSS Manuals, SPSS Inc, [6] Simoff, J S: Analyzing Categorical Data, Springer-Verlag Inc, New York 2003 [7] Stokes, ME- Davis, CS- Koch, GG: Categorical data Analysis Using the SAS System, SAS Institute Inc, 1995 Doc Ing Iva Pecáková, CSc The University of Ecomics Faculty of Informatics and Probability Department of Statistics and Probability Prague, Czech Republic pecakova@vsecz
Topic 21 Goodness of Fit
Topic 21 Goodness of Fit Contingency Tables 1 / 11 Introduction Two-way Table Smoking Habits The Hypothesis The Test Statistic Degrees of Freedom Outline 2 / 11 Introduction Contingency tables, also known
More informationCategorical Data Analysis Chapter 3
Categorical Data Analysis Chapter 3 The actual coverage probability is usually a bit higher than the nominal level. Confidence intervals for association parameteres Consider the odds ratio in the 2x2 table,
More informationij i j m ij n ij m ij n i j Suppose we denote the row variable by X and the column variable by Y ; We can then re-write the above expression as
page1 Loglinear Models Loglinear models are a way to describe association and interaction patterns among categorical variables. They are commonly used to model cell counts in contingency tables. These
More informationCorrespondence Analysis
Correspondence Analysis Q: when independence of a 2-way contingency table is rejected, how to know where the dependence is coming from? The interaction terms in a GLM contain dependence information; however,
More information13.1 Categorical Data and the Multinomial Experiment
Chapter 13 Categorical Data Analysis 13.1 Categorical Data and the Multinomial Experiment Recall Variable: (numerical) variable (i.e. # of students, temperature, height,). (non-numerical, categorical)
More informationDecomposition of Parsimonious Independence Model Using Pearson, Kendall and Spearman s Correlations for Two-Way Contingency Tables
International Journal of Statistics and Probability; Vol. 7 No. 3; May 208 ISSN 927-7032 E-ISSN 927-7040 Published by Canadian Center of Science and Education Decomposition of Parsimonious Independence
More informationANALYSING BINARY DATA IN A REPEATED MEASUREMENTS SETTING USING SAS
Libraries 1997-9th Annual Conference Proceedings ANALYSING BINARY DATA IN A REPEATED MEASUREMENTS SETTING USING SAS Eleanor F. Allan Follow this and additional works at: http://newprairiepress.org/agstatconference
More informationThe goodness-of-fit test Having discussed how to make comparisons between two proportions, we now consider comparisons of multiple proportions.
The goodness-of-fit test Having discussed how to make comparisons between two proportions, we now consider comparisons of multiple proportions. A common problem of this type is concerned with determining
More information1 Interaction models: Assignment 3
1 Interaction models: Assignment 3 Please answer the following questions in print and deliver it in room 2B13 or send it by e-mail to rooijm@fsw.leidenuniv.nl, no later than Tuesday, May 29 before 14:00.
More informationGeneralized Linear Models (GLZ)
Generalized Linear Models (GLZ) Generalized Linear Models (GLZ) are an extension of the linear modeling process that allows models to be fit to data that follow probability distributions other than the
More informationMSH3 Generalized linear model
Contents MSH3 Generalized linear model 7 Log-Linear Model 231 7.1 Equivalence between GOF measures........... 231 7.2 Sampling distribution................... 234 7.3 Interpreting Log-Linear models..............
More informationConfidence Intervals, Testing and ANOVA Summary
Confidence Intervals, Testing and ANOVA Summary 1 One Sample Tests 1.1 One Sample z test: Mean (σ known) Let X 1,, X n a r.s. from N(µ, σ) or n > 30. Let The test statistic is H 0 : µ = µ 0. z = x µ 0
More informationThree-Way Contingency Tables
Newsom PSY 50/60 Categorical Data Analysis, Fall 06 Three-Way Contingency Tables Three-way contingency tables involve three binary or categorical variables. I will stick mostly to the binary case to keep
More informationMARGINAL HOMOGENEITY MODEL FOR ORDERED CATEGORIES WITH OPEN ENDS IN SQUARE CONTINGENCY TABLES
REVSTAT Statistical Journal Volume 13, Number 3, November 2015, 233 243 MARGINAL HOMOGENEITY MODEL FOR ORDERED CATEGORIES WITH OPEN ENDS IN SQUARE CONTINGENCY TABLES Authors: Serpil Aktas Department of
More informationChapter 10. Chapter 10. Multinomial Experiments and. Multinomial Experiments and Contingency Tables. Contingency Tables.
Chapter 10 Multinomial Experiments and Contingency Tables 1 Chapter 10 Multinomial Experiments and Contingency Tables 10-1 1 Overview 10-2 2 Multinomial Experiments: of-fitfit 10-3 3 Contingency Tables:
More informationUNIVERSITY OF TORONTO. Faculty of Arts and Science APRIL 2010 EXAMINATIONS STA 303 H1S / STA 1002 HS. Duration - 3 hours. Aids Allowed: Calculator
UNIVERSITY OF TORONTO Faculty of Arts and Science APRIL 2010 EXAMINATIONS STA 303 H1S / STA 1002 HS Duration - 3 hours Aids Allowed: Calculator LAST NAME: FIRST NAME: STUDENT NUMBER: There are 27 pages
More informationChi-Square. Heibatollah Baghi, and Mastee Badii
1 Chi-Square Heibatollah Baghi, and Mastee Badii Different Scales, Different Measures of Association Scale of Both Variables Nominal Scale Measures of Association Pearson Chi-Square: χ 2 Ordinal Scale
More informationCategorical Variables and Contingency Tables: Description and Inference
Categorical Variables and Contingency Tables: Description and Inference STAT 526 Professor Olga Vitek March 3, 2011 Reading: Agresti Ch. 1, 2 and 3 Faraway Ch. 4 3 Univariate Binomial and Multinomial Measurements
More informationStatistics for Managers Using Microsoft Excel
Statistics for Managers Using Microsoft Excel 7 th Edition Chapter 1 Chi-Square Tests and Nonparametric Tests Statistics for Managers Using Microsoft Excel 7e Copyright 014 Pearson Education, Inc. Chap
More informationNATIONAL UNIVERSITY OF SINGAPORE EXAMINATION. ST3241 Categorical Data Analysis. (Semester II: ) April/May, 2011 Time Allowed : 2 Hours
NATIONAL UNIVERSITY OF SINGAPORE EXAMINATION Categorical Data Analysis (Semester II: 2010 2011) April/May, 2011 Time Allowed : 2 Hours Matriculation No: Seat No: Grade Table Question 1 2 3 4 5 6 Full marks
More informationEPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7
Introduction to Generalized Univariate Models: Models for Binary Outcomes EPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7 EPSY 905: Intro to Generalized In This Lecture A short review
More informationDiscrete Multivariate Statistics
Discrete Multivariate Statistics Univariate Discrete Random variables Let X be a discrete random variable which, in this module, will be assumed to take a finite number of t different values which are
More informationModule 10: Analysis of Categorical Data Statistics (OA3102)
Module 10: Analysis of Categorical Data Statistics (OA3102) Professor Ron Fricker Naval Postgraduate School Monterey, California Reading assignment: WM&S chapter 14.1-14.7 Revision: 3-12 1 Goals for this
More informationReview. Timothy Hanson. Department of Statistics, University of South Carolina. Stat 770: Categorical Data Analysis
Review Timothy Hanson Department of Statistics, University of South Carolina Stat 770: Categorical Data Analysis 1 / 22 Chapter 1: background Nominal, ordinal, interval data. Distributions: Poisson, binomial,
More informationSolution to Tutorial 7
1. (a) We first fit the independence model ST3241 Categorical Data Analysis I Semester II, 2012-2013 Solution to Tutorial 7 log µ ij = λ + λ X i + λ Y j, i = 1, 2, j = 1, 2. The parameter estimates are
More informationMultinomial Logistic Regression Models
Stat 544, Lecture 19 1 Multinomial Logistic Regression Models Polytomous responses. Logistic regression can be extended to handle responses that are polytomous, i.e. taking r>2 categories. (Note: The word
More informationChapter 10. Discrete Data Analysis
Chapter 1. Discrete Data Analysis 1.1 Inferences on a Population Proportion 1. Comparing Two Population Proportions 1.3 Goodness of Fit Tests for One-Way Contingency Tables 1.4 Testing for Independence
More informationNegative Multinomial Model and Cancer. Incidence
Generalized Linear Model under the Extended Negative Multinomial Model and Cancer Incidence S. Lahiri & Sunil K. Dhar Department of Mathematical Sciences, CAMS New Jersey Institute of Technology, Newar,
More informationCorrespondence Analysis of Longitudinal Data
Correspondence Analysis of Longitudinal Data Mark de Rooij* LEIDEN UNIVERSITY, LEIDEN, NETHERLANDS Peter van der G. M. Heijden UTRECHT UNIVERSITY, UTRECHT, NETHERLANDS *Corresponding author (rooijm@fsw.leidenuniv.nl)
More informationNATIONAL UNIVERSITY OF SINGAPORE EXAMINATION (SOLUTIONS) ST3241 Categorical Data Analysis. (Semester II: )
NATIONAL UNIVERSITY OF SINGAPORE EXAMINATION (SOLUTIONS) Categorical Data Analysis (Semester II: 2010 2011) April/May, 2011 Time Allowed : 2 Hours Matriculation No: Seat No: Grade Table Question 1 2 3
More informationUnit 9: Inferences for Proportions and Count Data
Unit 9: Inferences for Proportions and Count Data Statistics 571: Statistical Methods Ramón V. León 12/15/2008 Unit 9 - Stat 571 - Ramón V. León 1 Large Sample Confidence Interval for Proportion ( pˆ p)
More informationNOMINAL VARIABLE CLUSTERING AND ITS EVALUATION
NOMINAL VARIABLE CLUSTERING AND ITS EVALUATION Hana Řezanková Abstract The paper evaluates clustering of nominal variables using different similarity measures. The created clusters can serve for dimensionality
More informationInstitute of Actuaries of India
Institute of Actuaries of India Subject CT3 Probability & Mathematical Statistics May 2011 Examinations INDICATIVE SOLUTION Introduction The indicative solution has been written by the Examiners with the
More informationPrincipal Component Analysis for Mixed Quantitative and Qualitative Data
Principal Component Analysis for Mixed Quantitative and Qualitative Data Susana Agudelo-Jaramillo Manuela Ochoa-Muñoz Tutor: Francisco Iván Zuluaga-Díaz EAFIT University Medelĺın-Colombia Research Practise
More informationover Time line for the means). Specifically, & covariances) just a fixed variance instead. PROC MIXED: to 1000 is default) list models with TYPE=VC */
CLP 944 Example 4 page 1 Within-Personn Fluctuation in Symptom Severity over Time These data come from a study of weekly fluctuation in psoriasis severity. There was no intervention and no real reason
More informationLongitudinal Modeling with Logistic Regression
Newsom 1 Longitudinal Modeling with Logistic Regression Longitudinal designs involve repeated measurements of the same individuals over time There are two general classes of analyses that correspond to
More informationStatistics 3858 : Contingency Tables
Statistics 3858 : Contingency Tables 1 Introduction Before proceeding with this topic the student should review generalized likelihood ratios ΛX) for multinomial distributions, its relation to Pearson
More informationModel Estimation Example
Ronald H. Heck 1 EDEP 606: Multivariate Methods (S2013) April 7, 2013 Model Estimation Example As we have moved through the course this semester, we have encountered the concept of model estimation. Discussions
More informationAn Overview of Methods in the Analysis of Dependent Ordered Categorical Data: Assumptions and Implications
WORKING PAPER SERIES WORKING PAPER NO 7, 2008 Swedish Business School at Örebro An Overview of Methods in the Analysis of Dependent Ordered Categorical Data: Assumptions and Implications By Hans Högberg
More information11-2 Multinomial Experiment
Chapter 11 Multinomial Experiments and Contingency Tables 1 Chapter 11 Multinomial Experiments and Contingency Tables 11-11 Overview 11-2 Multinomial Experiments: Goodness-of-fitfit 11-3 Contingency Tables:
More informationPOLI 443 Applied Political Research
POLI 443 Applied Political Research Session 6: Tests of Hypotheses Contingency Analysis Lecturer: Prof. A. Essuman-Johnson, Dept. of Political Science Contact Information: aessuman-johnson@ug.edu.gh College
More informationRidit Score Type Quasi-Symmetry and Decomposition of Symmetry for Square Contingency Tables with Ordered Categories
AUSTRIAN JOURNAL OF STATISTICS Volume 38 (009), Number 3, 183 19 Ridit Score Type Quasi-Symmetry and Decomposition of Symmetry for Square Contingency Tables with Ordered Categories Kiyotaka Iki, Kouji
More informationLecture 25. Ingo Ruczinski. November 24, Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Johns Hopkins University
Lecture 25 Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Johns Hopkins University November 24, 2015 1 2 3 4 5 6 7 8 9 10 11 1 Hypothesis s of homgeneity 2 Estimating risk
More informationSTAT 135 Lab 11 Tests for Categorical Data (Fisher s Exact test, χ 2 tests for Homogeneity and Independence) and Linear Regression
STAT 135 Lab 11 Tests for Categorical Data (Fisher s Exact test, χ 2 tests for Homogeneity and Independence) and Linear Regression Rebecca Barter April 20, 2015 Fisher s Exact Test Fisher s Exact Test
More informationINFORMATION THEORY AND STATISTICS
INFORMATION THEORY AND STATISTICS Solomon Kullback DOVER PUBLICATIONS, INC. Mineola, New York Contents 1 DEFINITION OF INFORMATION 1 Introduction 1 2 Definition 3 3 Divergence 6 4 Examples 7 5 Problems...''.
More informationST3241 Categorical Data Analysis I Two-way Contingency Tables. Odds Ratio and Tests of Independence
ST3241 Categorical Data Analysis I Two-way Contingency Tables Odds Ratio and Tests of Independence 1 Inference For Odds Ratio (p. 24) For small to moderate sample size, the distribution of sample odds
More informationGeneralized Linear Model under the Extended Negative Multinomial Model and Cancer Incidence
Generalized Linear Model under the Extended Negative Multinomial Model and Cancer Incidence Sunil Kumar Dhar Center for Applied Mathematics and Statistics, Department of Mathematical Sciences, New Jersey
More informationExercise 7.4 [16 points]
STATISTICS 226, Winter 1997, Homework 5 1 Exercise 7.4 [16 points] a. [3 points] (A: Age, G: Gestation, I: Infant Survival, S: Smoking.) Model G 2 d.f. (AGIS).008 0 0 (AGI, AIS, AGS, GIS).367 1 (AG, AI,
More informationTesting Independence
Testing Independence Dipankar Bandyopadhyay Department of Biostatistics, Virginia Commonwealth University BIOS 625: Categorical Data & GLM 1/50 Testing Independence Previously, we looked at RR = OR = 1
More informationChapter 11: Models for Matched Pairs
: Models for Matched Pairs Dipankar Bandyopadhyay Department of Biostatistics, Virginia Commonwealth University BIOS 625: Categorical Data & GLM [Acknowledgements to Tim Hanson and Haitao Chu] D. Bandyopadhyay
More informationLing 289 Contingency Table Statistics
Ling 289 Contingency Table Statistics Roger Levy and Christopher Manning This is a summary of the material that we ve covered on contingency tables. Contingency tables: introduction Odds ratios Counting,
More informationLOG-MULTIPLICATIVE ASSOCIATION MODELS AS LATENT VARIABLE MODELS FOR NOMINAL AND0OR ORDINAL DATA. Carolyn J. Anderson* Jeroen K.
3 LOG-MULTIPLICATIVE ASSOCIATION MODELS AS LATENT VARIABLE MODELS FOR NOMINAL AND0OR ORDINAL DATA Carolyn J. Anderson* Jeroen K. Vermunt Associations between multiple discrete measures are often due to
More informationINTRODUCTION TO LOG-LINEAR MODELING
INTRODUCTION TO LOG-LINEAR MODELING Raymond Sin-Kwok Wong University of California-Santa Barbara September 8-12 Academia Sinica Taipei, Taiwan 9/8/2003 Raymond Wong 1 Hypothetical Data for Admission to
More informationRepeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models
Repeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models EPSY 905: Multivariate Analysis Spring 2016 Lecture #12 April 20, 2016 EPSY 905: RM ANOVA, MANOVA, and Mixed Models
More informationGoodness of Fit Tests: Homogeneity
Goodness of Fit Tests: Homogeneity Mathematics 47: Lecture 35 Dan Sloughter Furman University May 11, 2006 Dan Sloughter (Furman University) Goodness of Fit Tests: Homogeneity May 11, 2006 1 / 13 Testing
More informationOptimal exact tests for complex alternative hypotheses on cross tabulated data
Optimal exact tests for complex alternative hypotheses on cross tabulated data Daniel Yekutieli Statistics and OR Tel Aviv University CDA course 29 July 2017 Yekutieli (TAU) Optimal exact tests for complex
More informationFrequency Distribution Cross-Tabulation
Frequency Distribution Cross-Tabulation 1) Overview 2) Frequency Distribution 3) Statistics Associated with Frequency Distribution i. Measures of Location ii. Measures of Variability iii. Measures of Shape
More informationMaximum Likelihood Estimation; Robust Maximum Likelihood; Missing Data with Maximum Likelihood
Maximum Likelihood Estimation; Robust Maximum Likelihood; Missing Data with Maximum Likelihood PRE 906: Structural Equation Modeling Lecture #3 February 4, 2015 PRE 906, SEM: Estimation Today s Class An
More informationGeneralized Linear Models
York SPIDA John Fox Notes Generalized Linear Models Copyright 2010 by John Fox Generalized Linear Models 1 1. Topics I The structure of generalized linear models I Poisson and other generalized linear
More informationSTA 4504/5503 Sample Exam 1 Spring 2011 Categorical Data Analysis. 1. Indicate whether each of the following is true (T) or false (F).
STA 4504/5503 Sample Exam 1 Spring 2011 Categorical Data Analysis 1. Indicate whether each of the following is true (T) or false (F). (a) (b) (c) (d) (e) In 2 2 tables, statistical independence is equivalent
More informationLecture 25: Models for Matched Pairs
Lecture 25: Models for Matched Pairs Dipankar Bandyopadhyay, Ph.D. BMTRY 711: Analysis of Categorical Data Spring 2011 Division of Biostatistics and Epidemiology Medical University of South Carolina Lecture
More informationUnit 9: Inferences for Proportions and Count Data
Unit 9: Inferences for Proportions and Count Data Statistics 571: Statistical Methods Ramón V. León 1/15/008 Unit 9 - Stat 571 - Ramón V. León 1 Large Sample Confidence Interval for Proportion ( pˆ p)
More informationBasic Business Statistics, 10/e
Chapter 1 1-1 Basic Business Statistics 11 th Edition Chapter 1 Chi-Square Tests and Nonparametric Tests Basic Business Statistics, 11e 009 Prentice-Hall, Inc. Chap 1-1 Learning Objectives In this chapter,
More informationLecture 22. December 19, Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Johns Hopkins University.
Lecture 22 Department of Biostatistics Johns Hopkins Bloomberg School of Public Health Johns Hopkins University December 19, 2007 1 2 3 4 5 6 7 8 9 1 tests for equivalence of two binomial 2 tests for,
More informationMULTINOMIAL LOGISTIC REGRESSION
MULTINOMIAL LOGISTIC REGRESSION Model graphically: Variable Y is a dependent variable, variables X, Z, W are called regressors. Multinomial logistic regression is a generalization of the binary logistic
More informationA general non-parametric approach to the analysis of ordinal categorical data Vermunt, Jeroen
Tilburg University A general non-parametric approach to the analysis of ordinal categorical data Vermunt, Jeroen Published in: Sociological Methodology Document version: Peer reviewed version Publication
More informationA bias-correction for Cramér s V and Tschuprow s T
A bias-correction for Cramér s V and Tschuprow s T Wicher Bergsma London School of Economics and Political Science Abstract Cramér s V and Tschuprow s T are closely related nominal variable association
More informationThe material for categorical data follows Agresti closely.
Exam 2 is Wednesday March 8 4 sheets of notes The material for categorical data follows Agresti closely A categorical variable is one for which the measurement scale consists of a set of categories Categorical
More informationSTA 4504/5503 Sample Exam 1 Spring 2011 Categorical Data Analysis. 1. Indicate whether each of the following is true (T) or false (F).
STA 4504/5503 Sample Exam 1 Spring 2011 Categorical Data Analysis 1. Indicate whether each of the following is true (T) or false (F). (a) T In 2 2 tables, statistical independence is equivalent to a population
More informationMore Accurately Analyze Complex Relationships
SPSS Advanced Statistics 17.0 Specifications More Accurately Analyze Complex Relationships Make your analysis more accurate and reach more dependable conclusions with statistics designed to fit the inherent
More informationWORKSHOP 3 Measuring Association
WORKSHOP 3 Measuring Association Concepts Analysing Categorical Data o Testing of Proportions o Contingency Tables & Tests o Odds Ratios Linear Association Measures o Correlation o Simple Linear Regression
More informationChapter 11: Analysis of matched pairs
Chapter 11: Analysis of matched pairs Timothy Hanson Department of Statistics, University of South Carolina Stat 770: Categorical Data Analysis 1 / 42 Chapter 11: Models for Matched Pairs Example: Prime
More informationModel Based Statistics in Biology. Part V. The Generalized Linear Model. Chapter 16 Introduction
Model Based Statistics in Biology. Part V. The Generalized Linear Model. Chapter 16 Introduction ReCap. Parts I IV. The General Linear Model Part V. The Generalized Linear Model 16 Introduction 16.1 Analysis
More informationComputing and using the deviance with classification trees
Computing and using the deviance with classification trees Gilbert Ritschard Dept of Econometrics, University of Geneva Compstat, Rome, August 2006 Outline 1 Introduction 2 Motivation 3 Deviance for Trees
More informationSTAT Chapter 13: Categorical Data. Recall we have studied binomial data, in which each trial falls into one of 2 categories (success/failure).
STAT 515 -- Chapter 13: Categorical Data Recall we have studied binomial data, in which each trial falls into one of 2 categories (success/failure). Many studies allow for more than 2 categories. Example
More informationMinimum Phi-Divergence Estimators and Phi-Divergence Test Statistics in Contingency Tables with Symmetry Structure: An Overview
Symmetry 010,, 1108-110; doi:10.3390/sym01108 OPEN ACCESS symmetry ISSN 073-8994 www.mdpi.com/journal/symmetry Review Minimum Phi-Divergence Estimators and Phi-Divergence Test Statistics in Contingency
More informationParametric Modelling of Over-dispersed Count Data. Part III / MMath (Applied Statistics) 1
Parametric Modelling of Over-dispersed Count Data Part III / MMath (Applied Statistics) 1 Introduction Poisson regression is the de facto approach for handling count data What happens then when Poisson
More informationSupplemental Materials. In the main text, we recommend graphing physiological values for individual dyad
1 Supplemental Materials Graphing Values for Individual Dyad Members over Time In the main text, we recommend graphing physiological values for individual dyad members over time to aid in the decision
More informationA general non-parametric approach to the analysis of ordinal categorical data Vermunt, Jeroen
Tilburg University A general non-parametric approach to the analysis of ordinal categorical data Vermunt, Jeroen Published in: Sociological Methodology Document version: Peer reviewed version Publication
More informationGeneralized linear models
Generalized linear models Outline for today What is a generalized linear model Linear predictors and link functions Example: estimate a proportion Analysis of deviance Example: fit dose- response data
More informationCohen s s Kappa and Log-linear Models
Cohen s s Kappa and Log-linear Models HRP 261 03/03/03 10-11 11 am 1. Cohen s Kappa Actual agreement = sum of the proportions found on the diagonals. π ii Cohen: Compare the actual agreement with the chance
More informationReview of One-way Tables and SAS
Stat 504, Lecture 7 1 Review of One-way Tables and SAS In-class exercises: Ex1, Ex2, and Ex3 from http://v8doc.sas.com/sashtml/proc/z0146708.htm To calculate p-value for a X 2 or G 2 in SAS: http://v8doc.sas.com/sashtml/lgref/z0245929.htmz0845409
More informationMultivariate Extensions of McNemar s Test
Multivariate Extensions of McNemar s Test Bernhard Klingenberg Department of Mathematics and Statistics, Williams College Williamstown, MA 01267, U.S.A. e-mail: bklingen@williams.edu and Alan Agresti Department
More informationCHAPTER 17 CHI-SQUARE AND OTHER NONPARAMETRIC TESTS FROM: PAGANO, R. R. (2007)
FROM: PAGANO, R. R. (007) I. INTRODUCTION: DISTINCTION BETWEEN PARAMETRIC AND NON-PARAMETRIC TESTS Statistical inference tests are often classified as to whether they are parametric or nonparametric Parameter
More informationStatistics of Contingency Tables - Extension to I x J. stat 557 Heike Hofmann
Statistics of Contingency Tables - Extension to I x J stat 557 Heike Hofmann Outline Testing Independence Local Odds Ratios Concordance & Discordance Intro to GLMs Simpson s paradox Simpson s paradox:
More informationChapter 19: Logistic regression
Chapter 19: Logistic regression Self-test answers SELF-TEST Rerun this analysis using a stepwise method (Forward: LR) entry method of analysis. The main analysis To open the main Logistic Regression dialog
More informationHypothesis Testing hypothesis testing approach
Hypothesis Testing In this case, we d be trying to form an inference about that neighborhood: Do people there shop more often those people who are members of the larger population To ascertain this, we
More informationLecture 28 Chi-Square Analysis
Lecture 28 STAT 225 Introduction to Probability Models April 23, 2014 Whitney Huang Purdue University 28.1 χ 2 test for For a given contingency table, we want to test if two have a relationship or not
More informationLISA Short Course Series Generalized Linear Models (GLMs) & Categorical Data Analysis (CDA) in R. Liang (Sally) Shan Nov. 4, 2014
LISA Short Course Series Generalized Linear Models (GLMs) & Categorical Data Analysis (CDA) in R Liang (Sally) Shan Nov. 4, 2014 L Laboratory for Interdisciplinary Statistical Analysis LISA helps VT researchers
More information10: Crosstabs & Independent Proportions
10: Crosstabs & Independent Proportions p. 10.1 P Background < Two independent groups < Binary outcome < Compare binomial proportions P Illustrative example ( oswege.sav ) < Food poisoning following church
More informationThe purpose of this section is to derive the asymptotic distribution of the Pearson chi-square statistic. k (n j np j ) 2. np j.
Chapter 9 Pearson s chi-square test 9. Null hypothesis asymptotics Let X, X 2, be independent from a multinomial(, p) distribution, where p is a k-vector with nonnegative entries that sum to one. That
More informationSection 4.6 Simple Linear Regression
Section 4.6 Simple Linear Regression Objectives ˆ Basic philosophy of SLR and the regression assumptions ˆ Point & interval estimation of the model parameters, and how to make predictions ˆ Point and interval
More informationST3241 Categorical Data Analysis I Multicategory Logit Models. Logit Models For Nominal Responses
ST3241 Categorical Data Analysis I Multicategory Logit Models Logit Models For Nominal Responses 1 Models For Nominal Responses Y is nominal with J categories. Let {π 1,, π J } denote the response probabilities
More informationOrdinal Variables in 2 way Tables
Ordinal Variables in 2 way Tables Edps/Psych/Soc 589 Carolyn J. Anderson Department of Educational Psychology c Board of Trustees, University of Illinois Fall 2018 C.J. Anderson (Illinois) Ordinal Variables
More informationInvestigating Models with Two or Three Categories
Ronald H. Heck and Lynn N. Tabata 1 Investigating Models with Two or Three Categories For the past few weeks we have been working with discriminant analysis. Let s now see what the same sort of model might
More informationRelate Attributes and Counts
Relate Attributes and Counts This procedure is designed to summarize data that classifies observations according to two categorical factors. The data may consist of either: 1. Two Attribute variables.
More informationNominal Data. Parametric Statistics. Nonparametric Statistics. Parametric vs Nonparametric Tests. Greg C Elvers
Nominal Data Greg C Elvers 1 Parametric Statistics The inferential statistics that we have discussed, such as t and ANOVA, are parametric statistics A parametric statistic is a statistic that makes certain
More informationSTATISTIC OF QUASI-PERIODIC SIGNAL WITH RANDOM PERIOD - FIRST APPLICATION ON VOCAL CORDS OSCILLATION
STATISTIC OF QUASI-PERIODIC SIGNAL WITH RANDOM PERIOD - FIRST APPLICATION ON VOCAL CORDS OSCILLATION KROUPA Lukáš (CZ), VÁVRA František (CZ), NOVÝ Pavel (CZ) Abstract. This paper will introduce problem
More informationParametric versus Nonparametric Statistics-when to use them and which is more powerful? Dr Mahmoud Alhussami
Parametric versus Nonparametric Statistics-when to use them and which is more powerful? Dr Mahmoud Alhussami Parametric Assumptions The observations must be independent. Dependent variable should be continuous
More informationHypothesis Testing for Var-Cov Components
Hypothesis Testing for Var-Cov Components When the specification of coefficients as fixed, random or non-randomly varying is considered, a null hypothesis of the form is considered, where Additional output
More information