Research Design: Topic 18 Hierarchical Linear Modeling (Measures within Persons) 2010 R.C. Gardner, Ph.d.

Similar documents
Hypothesis Testing for Var-Cov Components

Research Design - - Topic 19 Multiple regression: Applications 2009 R.C. Gardner, Ph.D.

Summary of the model specified

Assessing the relation between language comprehension and performance in general chemistry. Appendices

Summary of the model specified

The Application and Promise of Hierarchical Linear Modeling (HLM) in Studying First-Year Student Programs

Research Design - - Topic 12 MRC Analysis and Two Factor Designs: Completely Randomized and Repeated Measures 2010 R.C. Gardner, Ph.D.

A Re-Introduction to General Linear Models (GLM)

Formula for the t-test

Technical Appendix C: Methods

Repeated-Measures ANOVA in SPSS Correct data formatting for a repeated-measures ANOVA in SPSS involves having a single line of data for each

Newsom Psy 510/610 Multilevel Regression, Spring

HLM Models and Type VI Errors

Additional Notes: Investigating a Random Slope. When we have fixed level-1 predictors at level 2 we show them like this:

Supplemental Materials. In the main text, we recommend graphing physiological values for individual dyad

TUTORIAL IN BIOSTATISTICS AN INTRODUCTION TO HIERARCHICAL LINEAR MODELLING

Time-Invariant Predictors in Longitudinal Models

Time-Invariant Predictors in Longitudinal Models

Interactions between Binary & Quantitative Predictors

Multilevel Models in Matrix Form. Lecture 7 July 27, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2

Time-Invariant Predictors in Longitudinal Models

Hierarchical Generalized Linear Models. ERSH 8990 REMS Seminar on HLM Last Lecture!

y response variable x 1, x 2,, x k -- a set of explanatory variables

STT 843 Key to Homework 1 Spring 2018

Testing and Interpreting Interaction Effects in Multilevel Models

Hierarchical Linear Models (HLM) Using R Package nlme. Interpretation. 2 = ( x 2) u 0j. e ij

Dyadic Data Analysis. Richard Gonzalez University of Michigan. September 9, 2010

Introduction to Random Effects of Time and Model Estimation

Multilevel Analysis of Grouped and Longitudinal Data

Introduction to Within-Person Analysis and RM ANOVA

Research Design - - Topic 15a Introduction to Multivariate Analyses 2009 R.C. Gardner, Ph.D.

Designing Multilevel Models Using SPSS 11.5 Mixed Model. John Painter, Ph.D.

A Re-Introduction to General Linear Models

Multilevel Structural Equation Modeling

Statistical Distribution Assumptions of General Linear Models

Technical Appendix C: Methods. Multilevel Regression Models

Computationally Efficient Estimation of Multilevel High-Dimensional Latent Variable Models

Specifying Latent Curve and Other Growth Models Using Mplus. (Revised )

Time-Invariant Predictors in Longitudinal Models

Longitudinal Modeling with Logistic Regression

ANCOVA. ANCOVA allows the inclusion of a 3rd source of variation into the F-formula (called the covariate) and changes the F-formula

Introduction to Regression

Binary Logistic Regression

Categorical Predictor Variables

Review of CLDP 944: Multilevel Models for Longitudinal Data

Estimation of Curvilinear Effects in SEM. Rex B. Kline, September 2009

Utilizing Hierarchical Linear Modeling in Evaluation: Concepts and Applications

Multiple OLS Regression

Introduction to Confirmatory Factor Analysis

Research Design - - Topic 13a Split Plot Design with Either a Continuous or Categorical Between Subjects Factor 2008 R.C. Gardner, Ph.D.

How to run the RI CLPM with Mplus By Ellen Hamaker March 21, 2018

CAMPBELL COLLABORATION

Business Statistics. Lecture 10: Correlation and Linear Regression

Time Invariant Predictors in Longitudinal Models

EPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7

Correlation and Regression

Generalized Linear Models for Non-Normal Data

CENTERING IN MULTILEVEL MODELS. Consider the situation in which we have m groups of individuals, where

Two-Variable Regression Model: The Problem of Estimation

Hierarchical Linear Modeling. Lesson Two

Advanced Quantitative Data Analysis

Introducing Generalized Linear Models: Logistic Regression

MLMED. User Guide. Nicholas J. Rockwood The Ohio State University Beta Version May, 2017

THE PEARSON CORRELATION COEFFICIENT

Lecture 4 Multiple linear regression

Introduction and Background to Multilevel Analysis

Ron Heck, Fall Week 8: Introducing Generalized Linear Models: Logistic Regression 1 (Replaces prior revision dated October 20, 2011)

over Time line for the means). Specifically, & covariances) just a fixed variance instead. PROC MIXED: to 1000 is default) list models with TYPE=VC */

Generalized Linear Probability Models in HLM R. B. Taylor Department of Criminal Justice Temple University (c) 2000 by Ralph B.

FIT CRITERIA PERFORMANCE AND PARAMETER ESTIMATE BIAS IN LATENT GROWTH MODELS WITH SMALL SAMPLES

Lecture 2: Linear and Mixed Models

Regression: Main Ideas Setting: Quantitative outcome with a quantitative explanatory variable. Example, cont.

Path Analysis. PRE 906: Structural Equation Modeling Lecture #5 February 18, PRE 906, SEM: Lecture 5 - Path Analysis

2/26/2017. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2

CHAPTER 9 EXAMPLES: MULTILEVEL MODELING WITH COMPLEX SURVEY DATA

WU Weiterbildung. Linear Mixed Models

Some general observations.

Hierarchical Linear Models-Redux

In Class Review Exercises Vartanian: SW 540

Practice with Interactions among Continuous Predictors in General Linear Models (as estimated using restricted maximum likelihood in SAS MIXED)

Lecture 3: Linear Models. Bruce Walsh lecture notes Uppsala EQG course version 28 Jan 2012

Hierarchical Linear Models. Jeff Gill. University of Florida

Multilevel Modeling: A Second Course

Estimation and Centering

Interactions among Continuous Predictors

Describing Within-Person Change over Time

Lab 11. Multilevel Models. Description of Data

Random Intercept Models

36-309/749 Experimental Design for Behavioral and Social Sciences. Sep. 22, 2015 Lecture 4: Linear Regression

Tutorial 6: Tutorial on Translating between GLIMMPSE Power Analysis and Data Analysis. Acknowledgements:

36-309/749 Experimental Design for Behavioral and Social Sciences. Dec 1, 2015 Lecture 11: Mixed Models (HLMs)

Investigating Models with Two or Three Categories

MLA Software for MultiLevel Analysis of Data with Two Levels

Introduction and Single Predictor Regression. Correlation

SAS Syntax and Output for Data Manipulation:

Difference in two or more average scores in different groups

Systematic error, of course, can produce either an upward or downward bias.

Three Factor Completely Randomized Design with One Continuous Factor: Using SPSS GLM UNIVARIATE R. C. Gardner Department of Psychology

Model Estimation Example

Ron Heck, Fall Week 3: Notes Building a Two-Level Model

Transcription:

Research Design: Topic 8 Hierarchical Linear Modeling (Measures within Persons) R.C. Gardner, Ph.d. General Rationale, Purpose, and Applications Linear Growth Models HLM can also be used with repeated measures designs. In this case, it is typically referred to as Measures within Persons or Linear Growth Models. In this case, the individual is Level and Time (or the repeated measures factor) is Level. This is depicted on the figure presented on slide.. Random Coefficients Model Level : DV f(time); Level ; Individual. and -as-outcomes Model Level ; DV f(time): Level ; Sex of Individual. Random Coefficients Model Level ; DV f(cov): Level ; Individual In essence, the focus here is to calculate a regression for each individual using the repeated observations as the replication. The model can be bivariate with respect to Level or multivariate, but the number of repeated observations will determine how many variables can be handled at level. With repeated measures, for example, you are limited to one predictor. This predictor can be trials or any other variable repeated over trials and can be both (or many) assuming there are enough repeated measures. In this form, HLM can be applied to: (a) estimate a mean growth curve and the extent of individual variation around it (b) Assess the reliability of measures for studying both status and change (c) estimate the correlation between initial status and rate of change, and (d) model relations of person-level predictors to both status and change (Raudenbush & Bryk,, p. ). We will consider only (a) and (d) in this Topic. The simplest form of the random coefficients model is concerned with the regression of the individual s score on each trial against the trial number (i.e., (a) above). This can be expressed in equation form in a manner very similar to that used for persons within groups. The equations are shown in Slides and 8. The examples make use of the Raudenbush & Bryk HLM program. Level Level HLM Measures within Persons Format Individuals Repeated measures of the individual over time Variables Individual difference variables Measures taken over time

Sample Data to be used in Topic 0 (Note: This is the Level data file) Subject Time DV Cov 9 8 8 Sex If your data are not sorted, you will also need a Level file presenting the data common to an individual. In this case, it is Sex (which wouldn t have to be shown in the Level file). Subject Level file Sex Level model where: γ β0 j γ γ 0 j j γ Random Coefficients Model y β + β C + γ j where: β 0j is the intercept for individual j β j is the unstandardized regression coefficient (slope) for individual j C is a code for individual j (i.e., Trial i) γ is the error in prediction. Level models ( ) where: ( ) β j γ0 j β 0 β γ mean of the intercepts deviation of each intercept from the mean intercept mean of the slopes deviation of each slope from the mean slope Substituting the two Level values into the Level equation yields the full equation: y + γ 0C j γ C + γ Given this equation we can solve simultaneously (i.e., the unique solution) for the following parameters and their standard errors of estimate: γ ( i. e., ) γ i. e., ) Mean Intercept Mean Slope Variance of the intercepts - - based on Variance of the slopes - - based on Error - - based on γ i j β 0 ( β0 j 8

Basic set-up of Level and Level models. Note that Time is not centered, though it could be if desired. Merged Level and Level model 9 Following are the OLS and ML estimates for each person (i.e., Level ). They can be output if desired but they are not part of the default. The OLS values can be requested in Other Settings but the ML values can be output in the Resfil output under Basic Settings. Note that the values differ even though the means are the same. Person Means Ordinary Least Squares.... 0...... 0. -0.0. 0.0 0..8 Maximum Likelihood (REML)..89.9..8 -.0.8.8..0.89.9....8 0 Final estimation of fixed effects: Standard Approx. Fixed Effect Coefficient Error T-ratio d.f. P-value For INTRCPT, P0 INTRCPT, B.90 0..9 0.0 For TIME slope, P INTRCPT, B0 0.8 0.8.8 0. Interpretation of Results The tests of fixed effects indicate that: a. The mean intercept (.) differs significantly from 0, t().9, p<. 0. Note that Time was not centered so that this value refers to the mean intercept when Time 0. b. The mean slope (.8) does not differ significantly from 0, t().8. Final estimation of variance components: ----------------------------------------------------------------------------------------------- Random Effect Standard Variance df Chi-square P-value Deviation Component ----------------------------------------------------------------------------------------------- INTRCPT, R0 0.0 0.8.9 >. TIME slope, R 0.8 0.9.98 0. level-, E 0.990 0.9 ---------------------------------------------------------------------------------------------- The tests of the random effects indicate that: a. The variance of the intercepts for the subjects (.8) is not significantly greater than 0, χ²().9, ns. That is, there is no evidence of individual differences among the subjects. b. The variance of the slopes for the subjects (.9) does not differ significantly from 0 χ²().98, ns. That is, there is no evidence of individual differences in the slopes. c. The variance due to error in Level is.9.

and -as-outcome Variables This model is comparable to the Random Coefficients model except that in addition to solving for the slopes and intercepts for each subject, we can also determine whether the slopes and intercepts vary as a function of a Level variable (in this case Sex). This is an example of point (d) in slide. Level model y + β j β C + γ where: β 0j is the intercept for individual j β j is the unstandardized regression coefficient (slope) for individual j C is a code for individual j γ is the error in prediction. Level models ( ) β γ + γ 0W j ( ) β j γ 0 + γ 0W j j where: γ mean of the intercepts γ mean of the slopes 0 W j Level variable β0 j γ deviation of each intercept from the mean intercept j j γ and -as-outcome Variables β 0 deviation of each slope from the mean slope Following are the OLS and ML estimates that can be obtained for this run. Often individual researchers do not output this information. It is done here to show you precisely what HLM does. Note that the values differ, but the means are the same (this isn t always necessarily the case). Person Means Ordinary Least Squares.... 0...... 0. -0.0. 0.0 0..8 Maximum Likelihood (REML)...08......99.8..0..9.0.8

Final estimation of fixed effects: Standard Approx. Fixed Effect Coefficient Error T-ratio d.f. P-value For INTRCPT, P0 INTRCPT, B.90 0.9. 0. SEX, B0 0.8889 0.9 0.9 0. For TIME slope, P INTRCPT, B0 0.8 0.8889. 0.8 SEX, B -0. 0. -0.9 0. - Final estimation of variance components: ------------------------------------------------------------------------------------------------ Random Effect Standard Variance df Chi-square P-value Deviation Component ------------------------------------------------------------------------------------------------ INTRCPT, R0 0.89 0.9. >. TIME slope, R 0.0 0..9 0. level-, E 0.8 0.80 The next example is concerned with whether the Outcome variable at each trial covaries as a function of the other variable (COV), but does not include trial number (i.e., Time) as part of the model. If it were desired to include Time along with COV you would need at least one more trial because with only three data points, you cannot have more than one predictor. Note that this analysis is identical to what would be done for Persons within Groups, and in fact we could run the example through this option and obtain identical results. 8 Basic Level and Level models Person Means Ordinary Least Squares.90.8.0..80.8..8 0.0 0.0 0.0.0.0 0.8.0 0.9 Maximum Likelihood (REML).9.8.9.89.8.9.9.80..8..80.8..0.8 Merged (mixed) model Note, in this case the mean OLS and ML values do not agree. 9 0

Final estimation of fixed effects: Standard Approx. Fixed Effect Coefficient Error T-ratio d.f. P-value For INTRCPT, P0 INTRCPT, B.0 0.888. 0.0 For COV slope, P INTRCPT, B0 0.8 0.08 8.8 0.0 References Gardner, R. C. () Hierarchical Linear Modeling: Measures within Persons. Unpublished manuscript. Department of Psychology, University of Western Ontario. http://publish.uwo.ca/~gardner/dataanalysisdotcalm Final estimation of variance components: Random Effect Standard Variance df Chi-square P-value Deviation Component INTRCPT, R0 0. 0.809. 0. COV slope, R 0. 0..989 >. level-, E 0.99 0.98 Raudenbush, S., Bryk, A., Cheong, Y. F., & du Toit, M. (). HLM:Hierarchical and NonLinear Modeling. Lincolnwood, NJ: SSI Scientific Softward International.