MULTILEVEL MODELS. Multilevel-analysis in SPSS - step by step
|
|
- Oswald Andrew Henderson
- 5 years ago
- Views:
Transcription
1 MULTILEVEL MODELS Multilevel-analysis in SPSS - step by step Dimitri Mortelmans Centre for Longitudinal and Life Course Studies (CLLS) University of Antwerp Overview of a strategy. Data preparation (centering and standardizing). Null random intercept model 3. Random intercept with Level- predictors 4. Adding Level- predictors to step 3 5. Testing random slopes level 6. Testing significant random slopes Level 7. Testing random slopes with level- predictors 8. Reducing parameters in var-covar 9. Testing cross-level interactions. Change estimation method and compare models. Standardizing
2 The basic formula General multilevel-model Y ij = + X ij + Z j + Z j X ij + u j X ij + j + r ij All fixed parameters are in this part = FIXED PART All random parameters are in this part = RANDOM PART 3 Overview of ML models Model RI Null random intercept / Intercept only / Unconditional means RI Random intercept FR Fully Random 4
3 PHASE : PREPARATION. Data preparation STEP Data preparation Actions: Look at the distribution of variables Check outliers Data centering and standardizing Check your centering and standardizing (see slides data management) 6 3
4 PHASE : VARIANCE COMPONENT MODELS. Null random intercept model 3. Random intercept with Level- predictors 4. Adding Level- predictors to step 3 PHASE. Null random intercept model PURPOSE: estimate a basic model to compare other models with 3. Random intercept with level- variables PURPOSE: how much variance can be explained with your level- predictors? 4. Random intercept with level and level variables PURPOSE: how much (additional) variance can be explained with your level- predictors? 8 4
5 STEP Null random intercept model THEORETICAL: Y ij = + j + r ij In the example: = Overall intercept: mean income over all countries j r ij = Non explained differences in income between the countries = Non explained differences in income between the individuals 9 STEP Null random intercept model *. STEP : Null random intercept model; * **********************************************; MIXED ink_centr /PRINT = SOLUTION TESTCOV /METHOD = REML /FIXED = INTERCEPT /RANDOM = INTERCEPT SUBJECT(cntry). 5
6 STEP Null random intercept model *. STEP : Null random intercept model; * **********************************************; MIXED ink_centr Put the Dependent variable after MIXED /PRINT = SOLUTION TESTCOV /METHOD = REML /FIXED = INTERCEPT /RANDOM = INTERCEPT SUBJECT(cntry). STEP Null random intercept model * *. STEP : Null random intercept model; * **********************************************; MIXED ink_centr /PRINT = SOLUTION TESTCOV /METHOD = REML PRINT /FIXED = INTERCEPT SOLUTION = Show the Fixed effects in the output /RANDOM = INTERCEPT SUBJECT(cntry). with the standard errors TESTCOV = Show significance tests for the variance components METHOD The estimation method Used method here = Restricted Maximum Likelihood 6
7 STEP Null random intercept model * *. STEP : Null random intercept model; * **********************************************; MIXED ink_centr /PRINT = SOLUTION TESTCOV /METHOD = REML FIXED /FIXED = INTERCEPT Add the fixed variables (independent variables) here. /RANDOM = INTERCEPT SUBJECT(cntry). RANDOM Add the random parts here. HERE we add only the intercept (for now). 3 STEP Null random intercept model OUTPUT FOR: Y ij = + j + r ij Grouping variable Number of parameters in the model 4 7
8 STEP Null random intercept model OUTPUT FOR: Y ij = + j + r ij with r ij ~ N, r j ~ N, : Estimated mean income over all countries is -.97 Unexplained variance (differences) on individuea level equals 4.58 Unexplained variance (differences) on Country level (level ) equals STEP Null random intercept model Summary table RI Intercept σ² r σ² σ² // 6 8
9 STEP Null random intercept model No explanation of the variance in income BUT a decomposition of the variance in income in parts σ² = Inter-group variance: differences between countries σ² r = Intra-group variance: differences between individuals QUESTION: Are there enough differences between countries to justify a multi-level analysis? 7 STEP Null random intercept model QUESTION: Are there enough differences between countries to justify a multi-level analysis? ANSWER: Intra-class correlation-coefficient (RHO) = σ² / ( σ² + σ² r ) 8 9
10 STEP Null random intercept model Intra-class correlation-coefficient (RHO) ( = σ² / ( σ² + σ² r ) ) =.484 / ( ) =.383 INTERPRETATION: 38.3 % of the total variance can be ascribed to level. PUT DIFFERENTLY: For 38.3 %, the differences in income between countries in the ESS are due to differences between countries (richer and poorer countries). 6.7 % is due to differences in individuals within these countries (richer and poorer individuals within a country). 9 STEP 3 Random intercept (level ) THEORETICAL: Y ij = + X ij + j + r ij In the example: = Overall intercept: mean income over all countries j r ij X ij = Non explained differences in income between the countries = Non explained differences in income between the individuals = General slope of the independent variable X (gender or education) QUESTION: How much of the original variance in j has been explained now?
11 STEP 3 Random intercept (level ) BASIC IDEA: Add all your level- predictors De variance components in the residuals should become smaller BECAUSE the level- predictors now take up a part of the explanation of the total variance. QUESTION: How big is the explained part? STEP 3 Random intercept (level ) * 3. STEP 3: Random intercept model with level predictors; * **********************************************************************; WITH: treat the independent as a continuous variable BY: treat the independent as a categorical variable MIXED ink_centr BY geslacht WITH opl_centr /PRINT = SOLUTION TESTCOV /METHOD = REML /FIXED = INTERCEPT geslacht opl_centr /RANDOM = INTERCEPT SUBJECT(cntry). Add your Level- independent variables
12 STEP 3 Random intercept (level ) OUTPUT FOR: Y ij = + X ij + j + r ij r ij ~ N, r j ~ N, : Overall intercept Coefficients at level- Error-variance on level Error-variance on level 3 STEP 3 Random intercept (level ) OUTPUT FOR: Y ij = + X ij + j + r ij r j ~ N, : ij ~ N, r The effect of gender and education on income is significant. Even after controlling for level- predictors there still are significant differences between individuals on level- and significant differences between the countries on level. 4
13 STEP 3 Random intercept (level ) Reduction of individual differences: From 4.58 to Reduction of differences between countries: From.4855 to.33 Is this enough? We need an R²-measure 5 STEP 3 Random intercept (level ) Regression-like R²-measure on level : r Basis -r Model / r Basis / 4.58 Regression-like R²-measure on level : Basis - Model / Basis /.4855 BUT: The estimation methods make this easy solution erroneous. 6 3
14 STEP 3 Random intercept (level ) No consensus yet about a good R²-measure. Correction of Bosker&Snijders (994) level : (r Basis + Basis )-(r Model + Model ) / (r Basis + Basis ) Correction of Bosker&Snijders (994) level : (r Basis +( Basis /n) )-(r Model +( Model /n) ) / (r Basis +( Basis /n) ) Whereby n = mean cluster size at level 7 STEP 3 Random intercept (level ) Correction of Bosker&Snijders (994) level : (r Basis + Basis )-(r Model + Model ) / (r Basis + Basis ) =.4 Correction of Bosker&Snijders (994) level : (r Basis +( Basis /n) )-(r Model +( Model /n) ) / (r Basis +( Basis /n) ) =.4 8 4
15 STEP 4 Random intercept (level +) THEORETICAL : Y ij = + X ij + Z j + j + r ij In the example: = Overall intercept: mean income over all countries j r ij = Non explained differences in income between the countries = Non explained differences in income between the individuals X ij = General slope of the independent variable X (gender or education) Z j = Direct effect of country variables on income (BNP or religion) QUESTION: How much variance in j from step 3 is now further explained? 9 STEP 4 Random intercept (level +) BASIC IDEA: Look how much the level predictors can explain (as a group) 3 5
16 STEP 4 Random intercept (level +) * 4. STEP 4: Random intercept model with level and level predictors; * *********************************************************; MIXED ink_centr BY geslacht WITH opl_centr bnp_centr bnppps_centr romkath_centr relig_centr /PRINT = SOLUTION TESTCOV /METHOD = REML /FIXED = INTERCEPT geslacht opl_centr bnp_centr bnppps_centr romkath_centr relig_centr /RANDOM = INTERCEPT SUBJECT(cntry). 3 STEP 4 Random intercept (level +) OUTPUT FOR: Y ij = + X ij + Z j + j + r ij r j ~ N, : ij ~ N, r Overall intercept Coefficients on level- Coefficients on level- Error-variance on level Error-variance on level 3 6
17 STEP 4 Random intercept (level +) OUTPUT FOR: Y ij = + X ij + Z j + j + r ij r j ~ N, : ij ~ N, r BNPPPS and % Roman Catholics are significant, BNP and Religiosity not. Even after controlling for level- predictors there still are significant differences between individuals on level- and significant differences between the countries on level. 33 STEP 4 Random intercept (level +) OUTPUT FOR: Y ij = + X ij + Z j + j + r ij r j ~ N, : ij ~ N, r Problem with BNP? 34 7
18 STEP 4 Random intercept (level +) Reduction of individual differences: 3 vs From to vs From 4.6 to Reduction of country differences: 3 vs From.3 to.55 3 vs From.486 to STEP 4 Random intercept (level +) Correction of Bosker&Snijders (994) level : Pseudo R² =.38 Correction of Bosker&Snijders (994) level : Pseudo R² =
19 STEP 4 Random intercept (level +) Preliminary conclusions:. The error-variance on level is only significant to the.6 level.. Two level- variables do not seem to work in this model: BNP and Religiosity. We remove them from the model when they are less important from a theoretical perspective. 3. Our model strongly explains differences on level. But also on the individual level the explanatory power of the independent variables is satisfactory. 37 PHASE 3: testing random slopes 5. Testing random slopes level 6. Testing significant random slopes Level 7. Testing random slopes with level- predictors 8. Reducing the parameters in var-covar 9
20 PHASE 3 5. Testing random slopes level PURPOSE: looking which level- predictor has significant slopes (without the level- predictors). 6. Testing significant random slopes Level PURPOSE: joining all significant random slopes from step 5 in one model 7. Testing random slopes with level- predictors PURPOSE: adding the level predictors back to model, including the random slopes from step 6 8. Reducing parameters in var-covar PURPOSE: simplifying the model (removing nonsignificant co-variances) in order to ease the estimation of the model. 39 STEP 5 Testing random slopes level THEORETICAL : Y ij = + X ij + j X ij + j + r ij In the example: = Overall intercept: mean income over all countries j r ij = Non explained differences in income between the countries = Non explained differences in income between the individuals X ij = General slope of the independent variable X (gender or education) j X ij = Differences in slopes (effect) of variable X (gender or education) between the countries REMARK: No longer country differences in this model! REMARK : Model is estimated for each independent variable on level separately QUESTION: Are there significant differences in the effect of X between the countries? 4
21 STEP 5 Testing random slopes level BASIC IDEA: Until now we did not allow for differences in slopes of the independent variables at level. FOR EACH INDEPENDENT, we will test if there are significant differences in slopes at level-. 4 STEP 5 Testing random slopes level * STEP 5: Testing the significance of the random slopes step-by-step. ***********************************************************************************; MIXED ink_centr BY geslacht WITH opl_centr /PRINT = SOLUTION TESTCOV COVTYPE should be Unstructured. /METHOD = REML /FIXED = INTERCEPT geslacht opl_centr /RANDOM = INTERCEPT opl_centr SUBJECT(cntry) COVTYPE(UN). We make eduction RANDOM here. 4
22 STEP 5 Testing random slopes level OUTPUT FOR: Y ij = + X ij + j X ij + j + r ij ij ~ N, r j j r ~N, : Overall intercept Coefficients on level- Error-variance on level Error-variance on level 43 STEP 5 Testing random slopes level Structure of the variance-covariance matrix Theoretical: j ~N, : j In SPSS: UN, UN, UN,
23 STEP 5 Testing random slopes level Structure of the variance-covariance matrix In SPSS: UN, UN, UN, The random slope is significant on the. level. MEANING: there is a significant different effect of education between the countries 45 STEP 5 Testing random slopes level * STEP 5: Testing the significance of the random slopes step-by-step. **********************************************************************************. MIXED ink_centr BY geslacht WITH opl_centr /PRINT = SOLUTION TESTCOV /METHOD = REML /FIXED = INTERCEPT geslacht opl_centr /RANDOM = INTERCEPT geslacht SUBJECT(cntry) COVTYPE(UN). Gender is made RANDOM here. 46 3
24 STEP 5 Testing random slopes level OUTPUT FOR: Y ij = + X ij + j X ij + j + r ij ij ~ N, r j j r ~N, : Overall intercept Coefficients on level- Error-variance on level Error-variance on level 47 STEP 5 Testing random slopes level Structure of the variance-covariance matrix Theoretical: j ~N, : j In SPSS: UN, UN, UN,
25 STEP 5 Testing random slopes level Evaluation of the random slope of gender In SPSS: UN, UN, UN, The random slope of the dichotomous variable gender can not be tested. If you include gender as a continuous variable in the model, this random slope turns out to be significant. 49 STEP 5 Testing random slopes level Conclusion: - Education and gender have significant slopes between the countries. - Gender is only estimable when you include the variable as a continuous measure. BUT: the effect of gender is unclear. In this example I will keep gender in the model with a random slope (only for educational purposes). 5 5
26 STEP 6 Testing random slopes level + THEORETICAL : Y ij = + X ij + j X ij + j + r ij j r ij = Overall intercept: mean income over all countries = Non explained differences in income between the countries = Non explained differences in income between the individuals X ij j X ij = General slope of the independent variable X (gender or education) = Differences in slopes (effect) of variable X (gender or education) between the countries Theoretically this is the same model as in step 5 but now we include ALL significant random slopes in the model. 5 STEP 6 Testing random slopes level + * STEP 6: Including all level- variables with significant random slopes. * ****************************************************************************************. MIXED ink_centr BY geslacht WITH opl_centr /PRINT = SOLUTION TESTCOV /METHOD = REML /FIXED = INTERCEPT geslacht opl_centr /RANDOM = INTERCEPT opl_centr geslacht SUBJECT(cntry) COVTYPE(UN). 5 6
27 STEP 6 Testing random slopes level + OUTPUT FOR: Y ij = + X ij + j X ij + j + r ij ij ~ N, r j j r ~N, : Error-variance on level Error-variance on level Equal digits are error-variances: UN(,) UN(,) UN (3,3) Intercept Error-variance of education Error-variance of gender 53 STEP 6 Testing random slopes level + OUTPUT FOR: Y ij = + X ij + j X ij + j + r ij ij ~ N, r j j r ~N, : Equal digits are error-variances: UN(,) Intercept UN(,) Error-variance of education Significant on the. level UN (3,3) Error-variance of gender NOT significant: SO: Gender NOT random in the model! 54 7
28 STEP 7 Testing random slopes with level- predictors THEORETICAL : Y ij = + X ij + Z j + j X ij + j + r ij j r ij = Overall intercept: mean income over all countries = Non explained differences in income between the countries = Non explained differences in income between the individuals X ij j X ij Z j = General slope of the independent variable X (gender or education) = Differences in slopes (effect) of variable X (gender or education) between the countries = Direct effect of country variables on income (BNP or religion) 55 STEP 7 Testing random slopes with level- predictors BASIC IDEA: We now check which influence the level- predictors have on income in a model with random slopes (= step 6). 56 8
29 STEP 7 Testing random slopes with level- predictors * STEP 7: Including all level- variables in the model of step 6 *. ******************************************************************************. MIXED ink_centr BY geslacht WITH opl_centr bnppps_centr romkath_centr /PRINT = SOLUTION TESTCOV /METHOD = REML /FIXED = INTERCEPT geslacht opl_centr bnppps_centr romkath_centr /RANDOM = INTERCEPT opl_centr SUBJECT(cntry) COVTYPE(UN). 57 STEP 7 Testing random slopes with level- predictors OUTPUT FOR: Y ij = + X ij + Z j + j X ij + j + r ij ij ~ N, r j j r ~N, : Overall intercept Coefficients on level- Coefficients on level- Error-variance on level Error-variance on level 58 9
30 STEP 7 Testing random slopes with level- predictors OUTPUT FOR: Y ij = + X ij + Z j + j X ij + j + r ij ij ~ N, r j j r ~N, : Both the predictors on level as on level are significant. Significant differences remain between the intercepts of the countries. Significant differences remain on level for the effect of education 59 STEP 8 Simplifying the model THEORETICAL : Y ij = + X ij + Z j + j X ij + j + r ij j r ij = Overall intercept: mean income over all countries = Non explained differences in income between the countries = Non explained differences in income between the individuals X ij j X ij Z j = General slope of the independent variable X (gender or education) = Differences in slopes (effect) of variable X (gender or education) between the countries = Direct effect of country variables on income (BNP or religion) We now look at the variance-covariance matrix 6 3
31 STEP 8 Simplifying the model Differences in intercept and slope between units of level. Y ij = + X ij + j X ij + j + r ij These are the conditions: rij ~ N(, σ²r) j ~N, : j This is the covariance between the random intercepts and the random slopes for variabele Xij. If this covariance is significant (= different from ), then it means that the changes in intercepts is systematically correlated to the changes in slopes. 6 STEP 8 Simplifying the model Model intercept Slopes Covariance FR many many Negative FR many many Positive FR many many Not significant () 6 3
32 3 63 STEP 8 Simplifying the model With independent X-variable on level With independent X-variables on level j j : ~N, Covariance between the random intercepts and the random slopes for variabele X ij. j j j : ~N, independents = 3 covariances 64 STEP 8 Simplifying the model With 3 independent X-variable on level With random slopes models, the number of parameters to be estimated increases very rapidly j j j j : ~N, 3 independents = 6 covariances
33 33 65 STEP 8 Simplifying the model With 3 independent X-variables on level j j j j : ~N, Non-significant covariances = The covariances is not significantly different from. SO: We might as well fix these to. CONSEQUENCE: Each fixed covariance is one parameter less to be estimated. 66 STEP 8 Simplifying the model With 3 independent X-variables on level j j j j : ~N, SPSS does not allow to fix each separate covariance to. BUT: there is an option to fix all co-variances to in one time.
34 34 67 STEP 8 Simplifying the model With 3 independent X-variables on level j j j j : ~N, COVTYPE(UN) 3 3j j j j : ~N, Without COVTYPE 68 STEP 8 Simplifying the model Look at the (significance of) the co-variances in the output of step 7 Covariance is NOT significant Consequence: Estimate the model in STEP 7 again without the COVTYPE-option.
35 STEP 8 Simplifying the model STEP 8: Reduction of parameters in var-covar matrix *********************************************************. MIXED ink_centr BY geslacht WITH opl_centr bnppps_centr romkath_centr /PRINT = SOLUTION TESTCOV /METHOD = REML /FIXED = INTERCEPT geslacht opl_centr bnppps_centr romkath_centr /RANDOM = INTERCEPT opl_centr SUBJECT(cntry). 69 STEP 8 Simplifying the model The co-variances are fixed at : there is no estimation of co-variances any more. Only the variances are given in the output. 7 35
36 PHASE 4: Refining and finishing 9. Testing cross-level interactions. Change the estimation method and compare your models. Standardizing PHASE 4 9. Testing cross-level interactions PURPOSE: checking if level- predictors correlate with level- predictors.changing the estimation method and comparing models PURPOSE: Compare models with Full Maximum Likelihood.Standardizing PURPOSE: Estimating the end model again with standardized variables to check the relative influence 7 36
37 STEP 9 Testing cross-level interactions THEORETICAL : Y ij = + X ij + Z j + Z j X ij + j X ij + j + r ij j r ij = Overall intercept: mean income over all countries = Non explained differences in income between the countries = Non explained differences in income between the individuals X ij j X ij Z j = General slope of the independent variable X (gender or education) = Differences in slopes (effect) of variable X (gender or education) between the countries = Direct effect of country variables on income (BNP or religion) Z j X ij = Interaction of country variables and individual variables on income 73 STEP 9 Testing cross-level interactions What is an interaction effect? A (significant) interaction effect shows how the effect of one independent variable changes within the levels of another independent variable
38 STEP 9 Testing cross-level interactions In regular OLS regression EG. Interaction between gender and education: How does the effect of education on income change between boys and girls? In multilevel regression EG. Interaction between education and GDP: How does the effect of education on income change for countries with a different GDP? 75 STEP 9 Testing cross-level interactions TWO BASIC PRINCIPLES.When an interaction effect is significant, the main effects NEED TO BE included in the model. EG: When the interaction effect between education and GDP_PPS is included THEN you also need the main effect of education and the main effect of GDP_PPS in the model
39 STEP 9 Testing cross-level interactions TWO BASIC PRINCIPLES. When an interaction effect is present in a model, the main effects have a different meaning. Meaning without interaction-effect - Education: the change in income when the educational level rises with one unit - BNP_PPS: the change in income when BNP_PPS rises with one unit 77 STEP 9 Testing cross-level interactions TWO BASIC PRINCIPLES. When an interaction effect is present in a model, the main effects have a different meaning. Meaning without interaction-effect - Education: the change in income when the educational level rises with one unit at a level of from BNP_PPS - BNP_PPS: the change in income when BNP_PPS rises with one unit at a level of from education 78 39
40 STEP 9 Testing cross-level interactions * * STEP 9: Testing cross-level interactions * **********************************************************************. MIXED ink_centr BY geslacht WITH opl_centr bnppps_centr romkath_centr /PRINT = SOLUTION TESTCOV /METHOD = REML /FIXED = INTERCEPT geslacht opl_centr bnppps_centr romkath_centr opl_centr*bnppps_centr /RANDOM = INTERCEPT opl_centr SUBJECT(cntry). Specifying an interaction effect = repeating both variables with * between both. 79 STEP 9 Testing cross-level interactions Main effects (both are significant) Interaction effect (not significant) 8 4
41 STEP 9 Testing cross-level interactions How to interpret the interaction effect? (if it had been significant). Interpret the main effects. Choose an interpretation perspective 3. Write the regression equation for one of the independent variables 8 STEP 9 Testing cross-level interactions Interpretation. Interpret the main effects Main effect education: When BNPPPS_centr is equal to, someone's income will increase with.59 scale points when his educational level increases with one unit. Main effect GDP: When education is equal to, someone's income will increase with.65 scale points when his countries BNP_PPS increases with one unit. 8 4
42 STEP 9 Testing cross-level interactions Interpretation. Interpret the main effects Because of the centering (mean = ) we can also say: Main effect education: At a mean BNPPPS_centr level, someone's income will increase with.59 scale points when his educational level increases with one unit. Main effect GDP: At a mean educational level, someone's income will increase with.65 scale points when his countries BNP_PPS increases with one unit. 83 STEP 9 Testing cross-level interactions Interpretation. Choose an interpretation perspective perspectives:. How does the effect of education on income changes for different levels of BNP_PPS?. How does the effect of BNP_PPS on income changes for different levels of education? 84 4
43 STEP 9 Testing cross-level interactions Interpretation. Choose an interpretation perspective How does the effect of education on income changes for different levels of BNP_PPS? is theoretically the only possibility here. BECAUSE: BNP_PPS will not change if people have a higher degree. But the educational effects can indeed change for countries with different BNP_PPS. BUT REMEMBER: Statistically, both perspectives are always possible. 85 STEP 9 Testing cross-level interactions Interpretation 3. Work out the regression equation PERSPECTIVE: How does the effect of education on income changes for different levels of BNP_PPS? - Write out the regression equation for education, when BNP_PPS takes on different levels. - WHICH levels of BNP_PPS? Usually: minimum, 5 th percentile, median, mean, 75 th percentile and maximum
44 STEP 9 Testing cross-level interactions Interpretation 3. Work out the regression equation STEP : Search in the EXAMINE output for the values of the minimum, 5 th percentile, median, mean, 75 th percentile and the maximum of BNPPPS_centr. EXAMINE VARIABLES=bnppps_centr /PERCENTILES(5,75) /STATISTICS DESCRIPTIVES. 87 STEP 9 Testing cross-level interactions Interpretation 3. Work out the regression equation STEP : Search in the EXAMINE output for the values of the minimum, 5 th percentile, median, mean, 75 th percentile and the maximum of BNPPPS_centr
45 STEP 9 Testing cross-level interactions Interpretation 3. Work out the regression equation STEP Minimum Q Mean Median.85 Q maximum 6.95 Remark: We assume that the other independent variable also take on the value of (and disappear from the equation). 89 STEP 9 Testing cross-level interactions Interpretation 3. Work out the regression equation Income = education +.65 BNPPPS +.8 EDUC*BNPPPS STEP : Vul in Minimum Q Median Mean Q3 maximum Income = opleiding +.65 (-65.88) +.8 OPL*(-65.88) Income = opleiding +.65 (-3.85) +.8 OPL*(-3.85) Income = opleiding +.65 () +.8 OPL*() Income = opleiding +.65 (.85) +.8 OPL*(.85) Income = opleiding +.65 (4.685) +.8 OPL*(4.685) Income = opleiding +.65 (6.9) +.8 OPL*(6.9) 9 45
46 STEP 9 Testing cross-level interactions Interpretation 3. Work out the regression equation Income = education+.65 BNPPPS +.8 EDUC*BNPPPS STEP : Vul in Minimum Income = -,999 +,4665 OPL Q Income = -,87 +,56 OPL Median Income = -,97 +,59 OPL Mean Income = -,53 +,59 OPL Q3 Income =,34 +,539 OPL maximum Income = 3, +,67 OPL Cfr main effect of education when BNP_PPS is equal to (see the main effect in the output). Interpretation interaction effect The effect of education rises (very slightly) as BNP_PPS increases. 9 STEP Comparing models with Full Maximum Likelihood Estimation in multilevel analysis - Maximum Likelihood - Generalized Least Squares (not in SPSS) - Generalized Estimation Equations (not in SPSS) - Markov Chain Monte Carlo (not in SPSS) - Bootstrapping (not in SPSS) 9 46
47 STEP Comparing models with Full Maximum Likelihood Maximum Likelihood - Maximizing the likelihood function - Population parameters are estimated in such a way that the probability of finding that particular model is maximized with the data at hand. - TWO versions: Full Maximum Likelihood (ML) Restricted Maximum Likelihood (REML) 93 STEP Comparing models with Full Maximum Likelihood Restricted Maximum Likelihood - Only the variance components are used in the estimation. - Standard in SAS (but not in SPSS) and in almost all multilevel programs - Best estimation for the variance components - CONSEQUENCE: Gives you the best estimation for the parameters and you should use this estimation method to obtain your parameters 94 47
48 STEP Comparing models with Full Maximum Likelihood Full Maximum Likelihood - Variance components and regression coefficients are involved in the estimation. - Disadvantage: Variance components are underestimated. USEFULL? - Easier estimation method - The difference between two models can be used in a chi²-difference test (is not possible with REML!). 95 STEP Comparing models with Full Maximum Likelihood CONSEQUENCE - Use REML for all models - Use ML at the end to compare estimated models with each other
49 STEP Comparing models with Full Maximum Likelihood * STEP : Using Full Maximum Likelihood to compare models. * ************************************************************************************. *Step. MIXED ink_centr /PRINT = SOLUTION TESTCOV Use Method=ML (or leave the METHOD line out). /METHOD = ML /FIXED = INTERCEPT /RANDOM = INTERCEPT SUBJECT(cntry). 97 STEP Comparing models with Full Maximum Likelihood Use the difference in DEVIANCE (- LOG LIKELIHOOD) and the difference in degrees of freedom in a Chi²-difference test 98 49
50 STEP Comparing models with Full Maximum Likelihood Calculating the degrees of freedom of your model Calculating the degrees of freedom by hand: Intercept Error variance level- Fixed slopes on level- p Error-variances for slopes on level- p Co-variances of slopes and intercept p Whereby: p = number of level- predictors q = number of level- predictors Co-variances between the slopes p(p-)/ Fixed slopes on level- Slopes for cross-level interactions q p*q 99 STEP Comparing models with Full Maximum Likelihood Make an overview table with tests DEVIANCE D(f) Prob. Chi² vs null model Prob. Chi² vs previous model STEP Null random intercept model 464,68 STEP 3 Random intercept with level ,937 9, STEP 4 Random intercept w level and 43,4 3,, STEP 6 Random slopes model 3647,95 9, STEP 7 Random slopes with level- 75,3,, STEP 8 Random slopes with level- (reduction) 77,357 7,,79 STEP 9 Cross level interactions 77,357,, 5
51 STEP Comparing models with Full Maximum Likelihood Make an overview table with tests DEVIANCE D(f) Prob. Chi² vs null model Prob. Chi² vs previous model STEP Null random intercept model 464,68 STEP 3 Random intercept with level ,937 9, STEP 4 Random intercept w level and 43,4 3,, This is the basic model. Chi²-difference test STEP 6 Random slopes model 3647,95 9, In the fourth column, you compare with this model - Test value = = Degrees of freedom = 9 = 7 STEP 7 Random slopes with level- 75,3,, - Result: Probability =. STEP 8 Random slopes with level- (reduction) 77,357 - Interpretation: 7 The model in, STEP3 is a significant,79 improvement of the Null random intercept model (STEP ) STEP 9 Cross level interactions 77,357,, STEP Comparing models with Full Maximum Likelihood Make an overview table with tests DEVIANCE D(f) Prob. Chi² vs null model Prob. Chi² vs previous model STEP Null random intercept model 464,68 STEP 3 Random intercept with level ,937 9, STEP 4 Random intercept w level and 43,4 3,, STEP 6 Comparison with Random the Null slopes random model intercept 3647,95 model (STEP ) 9, Interpretation: Is this model a significant improvement vs STEP? STEP 7 Random slopes met level- 75,3,, Comparison with the previous model (= STEP 3) STEP 8 Random slopes met level- (reductie) 77,357 Interpretation: 7 Is this model a significant, improvement,79 vs STEP 3? STEP 9 Cross level interacties 77,357,, 5
52 STEP Comparing models with Full Maximum Likelihood Make an overview table with tests DEVIANCE D(f) Prob. Chi² vs null model Prob. Chi² vs previous model STEP Null random intercept model 464,68 STEP 3 Random intercept met level ,937 9, STEP 4 Random intercept met level en 43,4 3,, STEP 6 Random slopes model 3647,95 9, STEP 7 Random slopes met level- 75,3,, BE CAREFULL here!! Random slopes met level- STEP 8Previous model is the model 77,357 7 (reductie) with co-variances. SO is the model without covariances,,79 a significant worsening vs. the previous model? STEP 9 Cross level interacties 77,357,, CONSEQUENCE: A probability higher than.5 points to a good model. 3 STEP The final model with standardized variables Standard output of multilevel models = not standardized. Interpretation in original (scale) units DISADVANTAGE: no comparison of the actual size of the parameters. 4 5
53 STEP The final model with standardized variables methods. Estimate the last model again with standardized variables (disadvantage = variance components also change). Standardize the parameter by hand 5 STEP The final model with standardized variables METHOD * STEP : Standardising in order to compare parameters. * ********************************************************************************************; MIXED ink_std BY gesl_std WITH opl_std bnppps_std romkath_std /PRINT = SOLUTION TESTCOV /METHOD = ML /FIXED = INTERCEPT geslacht opl_std bnppps_std romkath_std /RANDOM = INTERCEPT opl_std SUBJECT(cntry). 6 53
54 STEP The final model with standardized variables METHOD Stand. Coeff. = (non stand. Coeff) x (stan dev INdep.) (stan dev DEpendent) 7 STEP The final model with standardized variables METHOD DESCRIPTIVES VARIABLES=ink_centr geslacht opl_centr bnppps_centr romkath_centr /STATISTICS=STDDEV. 8 54
55 STEP The final model with standardized variables RESULT: Non standardized Standardized Non standardized Standardized Gender,8,6 BNP PPS,7,4 Education,59,3 % Rom Cath -,95 -,5 9 MULTILEVEL MODELS Multilevel-analysis in SPSS - step by step Dimitri Mortelmans Centre for Longitudinal and Life Course Studies (CLLS) University of Antwerp 55
Designing Multilevel Models Using SPSS 11.5 Mixed Model. John Painter, Ph.D.
Designing Multilevel Models Using SPSS 11.5 Mixed Model John Painter, Ph.D. Jordan Institute for Families School of Social Work University of North Carolina at Chapel Hill 1 Creating Multilevel Models
More informationReview of CLDP 944: Multilevel Models for Longitudinal Data
Review of CLDP 944: Multilevel Models for Longitudinal Data Topics: Review of general MLM concepts and terminology Model comparisons and significance testing Fixed and random effects of time Significance
More informationHierarchical Generalized Linear Models. ERSH 8990 REMS Seminar on HLM Last Lecture!
Hierarchical Generalized Linear Models ERSH 8990 REMS Seminar on HLM Last Lecture! Hierarchical Generalized Linear Models Introduction to generalized models Models for binary outcomes Interpreting parameter
More informationIntroduction to Within-Person Analysis and RM ANOVA
Introduction to Within-Person Analysis and RM ANOVA Today s Class: From between-person to within-person ANOVAs for longitudinal data Variance model comparisons using 2 LL CLP 944: Lecture 3 1 The Two Sides
More informationLongitudinal Data Analysis of Health Outcomes
Longitudinal Data Analysis of Health Outcomes Longitudinal Data Analysis Workshop Running Example: Days 2 and 3 University of Georgia: Institute for Interdisciplinary Research in Education and Human Development
More informationA Re-Introduction to General Linear Models (GLM)
A Re-Introduction to General Linear Models (GLM) Today s Class: You do know the GLM Estimation (where the numbers in the output come from): From least squares to restricted maximum likelihood (REML) Reviewing
More informationAdditional Notes: Investigating a Random Slope. When we have fixed level-1 predictors at level 2 we show them like this:
Ron Heck, Summer 01 Seminars 1 Multilevel Regression Models and Their Applications Seminar Additional Notes: Investigating a Random Slope We can begin with Model 3 and add a Random slope parameter. If
More informationSubject-specific observed profiles of log(fev1) vs age First 50 subjects in Six Cities Study
Subject-specific observed profiles of log(fev1) vs age First 50 subjects in Six Cities Study 1.4 0.0-6 7 8 9 10 11 12 13 14 15 16 17 18 19 age Model 1: A simple broken stick model with knot at 14 fit with
More informationHypothesis Testing for Var-Cov Components
Hypothesis Testing for Var-Cov Components When the specification of coefficients as fixed, random or non-randomly varying is considered, a null hypothesis of the form is considered, where Additional output
More informationAn Introduction to Multilevel Models. PSYC 943 (930): Fundamentals of Multivariate Modeling Lecture 25: December 7, 2012
An Introduction to Multilevel Models PSYC 943 (930): Fundamentals of Multivariate Modeling Lecture 25: December 7, 2012 Today s Class Concepts in Longitudinal Modeling Between-Person vs. +Within-Person
More informationRandom Intercept Models
Random Intercept Models Edps/Psych/Soc 589 Carolyn J. Anderson Department of Educational Psychology c Board of Trustees, University of Illinois Spring 2019 Outline A very simple case of a random intercept
More informationMultilevel Models in Matrix Form. Lecture 7 July 27, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2
Multilevel Models in Matrix Form Lecture 7 July 27, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2 Today s Lecture Linear models from a matrix perspective An example of how to do
More informationCan you tell the relationship between students SAT scores and their college grades?
Correlation One Challenge Can you tell the relationship between students SAT scores and their college grades? A: The higher SAT scores are, the better GPA may be. B: The higher SAT scores are, the lower
More informationStatistical Distribution Assumptions of General Linear Models
Statistical Distribution Assumptions of General Linear Models Applied Multilevel Models for Cross Sectional Data Lecture 4 ICPSR Summer Workshop University of Colorado Boulder Lecture 4: Statistical Distributions
More informationIntroducing Generalized Linear Models: Logistic Regression
Ron Heck, Summer 2012 Seminars 1 Multilevel Regression Models and Their Applications Seminar Introducing Generalized Linear Models: Logistic Regression The generalized linear model (GLM) represents and
More informationLogistic Regression. Continued Psy 524 Ainsworth
Logistic Regression Continued Psy 524 Ainsworth Equations Regression Equation Y e = 1 + A+ B X + B X + B X 1 1 2 2 3 3 i A+ B X + B X + B X e 1 1 2 2 3 3 Equations The linear part of the logistic regression
More informationTime-Invariant Predictors in Longitudinal Models
Time-Invariant Predictors in Longitudinal Models Topics: Summary of building unconditional models for time Missing predictors in MLM Effects of time-invariant predictors Fixed, systematically varying,
More informationRon Heck, Fall Week 8: Introducing Generalized Linear Models: Logistic Regression 1 (Replaces prior revision dated October 20, 2011)
Ron Heck, Fall 2011 1 EDEP 768E: Seminar in Multilevel Modeling rev. January 3, 2012 (see footnote) Week 8: Introducing Generalized Linear Models: Logistic Regression 1 (Replaces prior revision dated October
More informationTime Invariant Predictors in Longitudinal Models
Time Invariant Predictors in Longitudinal Models Longitudinal Data Analysis Workshop Section 9 University of Georgia: Institute for Interdisciplinary Research in Education and Human Development Section
More informationIntroduction to Random Effects of Time and Model Estimation
Introduction to Random Effects of Time and Model Estimation Today s Class: The Big Picture Multilevel model notation Fixed vs. random effects of time Random intercept vs. random slope models How MLM =
More informationRepeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models
Repeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models EPSY 905: Multivariate Analysis Spring 2016 Lecture #12 April 20, 2016 EPSY 905: RM ANOVA, MANOVA, and Mixed Models
More informationInteractions among Continuous Predictors
Interactions among Continuous Predictors Today s Class: Simple main effects within two-way interactions Conquering TEST/ESTIMATE/LINCOM statements Regions of significance Three-way interactions (and beyond
More informationTime-Invariant Predictors in Longitudinal Models
Time-Invariant Predictors in Longitudinal Models Today s Class (or 3): Summary of steps in building unconditional models for time What happens to missing predictors Effects of time-invariant predictors
More informationANOVA Longitudinal Models for the Practice Effects Data: via GLM
Psyc 943 Lecture 25 page 1 ANOVA Longitudinal Models for the Practice Effects Data: via GLM Model 1. Saturated Means Model for Session, E-only Variances Model (BP) Variances Model: NO correlation, EQUAL
More informationCorrelation. A statistics method to measure the relationship between two variables. Three characteristics
Correlation Correlation A statistics method to measure the relationship between two variables Three characteristics Direction of the relationship Form of the relationship Strength/Consistency Direction
More informationRegression: Main Ideas Setting: Quantitative outcome with a quantitative explanatory variable. Example, cont.
TCELL 9/4/205 36-309/749 Experimental Design for Behavioral and Social Sciences Simple Regression Example Male black wheatear birds carry stones to the nest as a form of sexual display. Soler et al. wanted
More informationResiduals from regression on original data 1
Residuals from regression on original data 1 Obs a b n i y 1 1 1 3 1 1 2 1 1 3 2 2 3 1 1 3 3 3 4 1 2 3 1 4 5 1 2 3 2 5 6 1 2 3 3 6 7 1 3 3 1 7 8 1 3 3 2 8 9 1 3 3 3 9 10 2 1 3 1 10 11 2 1 3 2 11 12 2 1
More informationReview of Unconditional Multilevel Models for Longitudinal Data
Review of Unconditional Multilevel Models for Longitudinal Data Topics: Course (and MLM) overview Concepts in longitudinal multilevel modeling Model comparisons and significance testing Describing within-person
More informationover Time line for the means). Specifically, & covariances) just a fixed variance instead. PROC MIXED: to 1000 is default) list models with TYPE=VC */
CLP 944 Example 4 page 1 Within-Personn Fluctuation in Symptom Severity over Time These data come from a study of weekly fluctuation in psoriasis severity. There was no intervention and no real reason
More informationTime-Invariant Predictors in Longitudinal Models
Time-Invariant Predictors in Longitudinal Models Today s Topics: What happens to missing predictors Effects of time-invariant predictors Fixed vs. systematically varying vs. random effects Model building
More information36-309/749 Experimental Design for Behavioral and Social Sciences. Sep. 22, 2015 Lecture 4: Linear Regression
36-309/749 Experimental Design for Behavioral and Social Sciences Sep. 22, 2015 Lecture 4: Linear Regression TCELL Simple Regression Example Male black wheatear birds carry stones to the nest as a form
More informationy response variable x 1, x 2,, x k -- a set of explanatory variables
11. Multiple Regression and Correlation y response variable x 1, x 2,, x k -- a set of explanatory variables In this chapter, all variables are assumed to be quantitative. Chapters 12-14 show how to incorporate
More informationEPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7
Introduction to Generalized Univariate Models: Models for Binary Outcomes EPSY 905: Fundamentals of Multivariate Modeling Online Lecture #7 EPSY 905: Intro to Generalized In This Lecture A short review
More informationIntroduction and Background to Multilevel Analysis
Introduction and Background to Multilevel Analysis Dr. J. Kyle Roberts Southern Methodist University Simmons School of Education and Human Development Department of Teaching and Learning Background and
More informationCategorical Predictor Variables
Categorical Predictor Variables We often wish to use categorical (or qualitative) variables as covariates in a regression model. For binary variables (taking on only 2 values, e.g. sex), it is relatively
More informationModel Estimation Example
Ronald H. Heck 1 EDEP 606: Multivariate Methods (S2013) April 7, 2013 Model Estimation Example As we have moved through the course this semester, we have encountered the concept of model estimation. Discussions
More informationBusiness Statistics. Lecture 10: Correlation and Linear Regression
Business Statistics Lecture 10: Correlation and Linear Regression Scatterplot A scatterplot shows the relationship between two quantitative variables measured on the same individuals. It displays the Form
More informationSAS Code for Data Manipulation: SPSS Code for Data Manipulation: STATA Code for Data Manipulation: Psyc 945 Example 1 page 1
Psyc 945 Example page Example : Unconditional Models for Change in Number Match 3 Response Time (complete data, syntax, and output available for SAS, SPSS, and STATA electronically) These data come from
More informationClass Notes: Week 8. Probit versus Logit Link Functions and Count Data
Ronald Heck Class Notes: Week 8 1 Class Notes: Week 8 Probit versus Logit Link Functions and Count Data This week we ll take up a couple of issues. The first is working with a probit link function. While
More informationA Re-Introduction to General Linear Models
A Re-Introduction to General Linear Models Today s Class: Big picture overview Why we are using restricted maximum likelihood within MIXED instead of least squares within GLM Linear model interpretation
More informationMultilevel/Mixed Models and Longitudinal Analysis Using Stata
Multilevel/Mixed Models and Longitudinal Analysis Using Stata Isaac J. Washburn PhD Research Associate Oregon Social Learning Center Summer Workshop Series July 2010 Longitudinal Analysis 1 Longitudinal
More informationLab 3: Two levels Poisson models (taken from Multilevel and Longitudinal Modeling Using Stata, p )
Lab 3: Two levels Poisson models (taken from Multilevel and Longitudinal Modeling Using Stata, p. 376-390) BIO656 2009 Goal: To see if a major health-care reform which took place in 1997 in Germany was
More informationDescribing Change over Time: Adding Linear Trends
Describing Change over Time: Adding Linear Trends Longitudinal Data Analysis Workshop Section 7 University of Georgia: Institute for Interdisciplinary Research in Education and Human Development Section
More informationDescribing Within-Person Change over Time
Describing Within-Person Change over Time Topics: Multilevel modeling notation and terminology Fixed and random effects of linear time Predicted variances and covariances from random slopes Dependency
More informationTopic 17 - Single Factor Analysis of Variance. Outline. One-way ANOVA. The Data / Notation. One way ANOVA Cell means model Factor effects model
Topic 17 - Single Factor Analysis of Variance - Fall 2013 One way ANOVA Cell means model Factor effects model Outline Topic 17 2 One-way ANOVA Response variable Y is continuous Explanatory variable is
More informationA Non-parametric bootstrap for multilevel models
A Non-parametric bootstrap for multilevel models By James Carpenter London School of Hygiene and ropical Medicine Harvey Goldstein and Jon asbash Institute of Education 1. Introduction Bootstrapping is
More informationSTA441: Spring Multiple Regression. This slide show is a free open source document. See the last slide for copyright information.
STA441: Spring 2018 Multiple Regression This slide show is a free open source document. See the last slide for copyright information. 1 Least Squares Plane 2 Statistical MODEL There are p-1 explanatory
More informationGeneral Linear Model (Chapter 4)
General Linear Model (Chapter 4) Outcome variable is considered continuous Simple linear regression Scatterplots OLS is BLUE under basic assumptions MSE estimates residual variance testing regression coefficients
More informationTopic 20: Single Factor Analysis of Variance
Topic 20: Single Factor Analysis of Variance Outline Single factor Analysis of Variance One set of treatments Cell means model Factor effects model Link to linear regression using indicator explanatory
More information36-309/749 Experimental Design for Behavioral and Social Sciences. Dec 1, 2015 Lecture 11: Mixed Models (HLMs)
36-309/749 Experimental Design for Behavioral and Social Sciences Dec 1, 2015 Lecture 11: Mixed Models (HLMs) Independent Errors Assumption An error is the deviation of an individual observed outcome (DV)
More informationTime-Invariant Predictors in Longitudinal Models
Time-Invariant Predictors in Longitudinal Models Topics: What happens to missing predictors Effects of time-invariant predictors Fixed vs. systematically varying vs. random effects Model building strategies
More informationdf=degrees of freedom = n - 1
One sample t-test test of the mean Assumptions: Independent, random samples Approximately normal distribution (from intro class: σ is unknown, need to calculate and use s (sample standard deviation)) Hypotheses:
More informationCourse Introduction and Overview Descriptive Statistics Conceptualizations of Variance Review of the General Linear Model
Course Introduction and Overview Descriptive Statistics Conceptualizations of Variance Review of the General Linear Model PSYC 943 (930): Fundamentals of Multivariate Modeling Lecture 1: August 22, 2012
More information2) For a normal distribution, the skewness and kurtosis measures are as follows: A) 1.96 and 4 B) 1 and 2 C) 0 and 3 D) 0 and 0
Introduction to Econometrics Midterm April 26, 2011 Name Student ID MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. (5,000 credit for each correct
More informationRon Heck, Fall Week 3: Notes Building a Two-Level Model
Ron Heck, Fall 2011 1 EDEP 768E: Seminar on Multilevel Modeling rev. 9/6/2011@11:27pm Week 3: Notes Building a Two-Level Model We will build a model to explain student math achievement using student-level
More informationVariance component models part I
Faculty of Health Sciences Variance component models part I Analysis of repeated measurements, 30th November 2012 Julie Lyng Forman & Lene Theil Skovgaard Department of Biostatistics, University of Copenhagen
More informationUNIVERSITY OF MASSACHUSETTS. Department of Mathematics and Statistics. Basic Exam - Applied Statistics. Tuesday, January 17, 2017
UNIVERSITY OF MASSACHUSETTS Department of Mathematics and Statistics Basic Exam - Applied Statistics Tuesday, January 17, 2017 Work all problems 60 points are needed to pass at the Masters Level and 75
More informationLab 11. Multilevel Models. Description of Data
Lab 11 Multilevel Models Henian Chen, M.D., Ph.D. Description of Data MULTILEVEL.TXT is clustered data for 386 women distributed across 40 groups. ID: 386 women, id from 1 to 386, individual level (level
More informationSupplemental Materials. In the main text, we recommend graphing physiological values for individual dyad
1 Supplemental Materials Graphing Values for Individual Dyad Members over Time In the main text, we recommend graphing physiological values for individual dyad members over time to aid in the decision
More informationAn Introduction to Mplus and Path Analysis
An Introduction to Mplus and Path Analysis PSYC 943: Fundamentals of Multivariate Modeling Lecture 10: October 30, 2013 PSYC 943: Lecture 10 Today s Lecture Path analysis starting with multivariate regression
More informationTechnical Appendix C: Methods. Multilevel Regression Models
Technical Appendix C: Methods Multilevel Regression Models As not all readers may be familiar with the analytical methods used in this study, a brief note helps to clarify the techniques. The firewall
More informationTHE PEARSON CORRELATION COEFFICIENT
CORRELATION Two variables are said to have a relation if knowing the value of one variable gives you information about the likely value of the second variable this is known as a bivariate relation There
More informationFrom Practical Data Analysis with JMP, Second Edition. Full book available for purchase here. About This Book... xiii About The Author...
From Practical Data Analysis with JMP, Second Edition. Full book available for purchase here. Contents About This Book... xiii About The Author... xxiii Chapter 1 Getting Started: Data Analysis with JMP...
More informationMultiple Regression. Peerapat Wongchaiwat, Ph.D.
Peerapat Wongchaiwat, Ph.D. wongchaiwat@hotmail.com The Multiple Regression Model Examine the linear relationship between 1 dependent (Y) & 2 or more independent variables (X i ) Multiple Regression Model
More informationChapter 4 Regression with Categorical Predictor Variables Page 1. Overview of regression with categorical predictors
Chapter 4 Regression with Categorical Predictor Variables Page. Overview of regression with categorical predictors 4-. Dummy coding 4-3 4-5 A. Karpinski Regression with Categorical Predictor Variables.
More informationTechnical Appendix C: Methods
Technical Appendix C: Methods As not all readers may be familiar with the multilevel analytical methods used in this study, a brief note helps to clarify the techniques. The general theory developed in
More informationA (Brief) Introduction to Crossed Random Effects Models for Repeated Measures Data
A (Brief) Introduction to Crossed Random Effects Models for Repeated Measures Data Today s Class: Review of concepts in multivariate data Introduction to random intercepts Crossed random effects models
More informationIntroduction to SAS proc mixed
Faculty of Health Sciences Introduction to SAS proc mixed Analysis of repeated measurements, 2017 Julie Forman Department of Biostatistics, University of Copenhagen 2 / 28 Preparing data for analysis The
More informationSTAT 3900/4950 MIDTERM TWO Name: Spring, 2015 (print: first last ) Covered topics: Two-way ANOVA, ANCOVA, SLR, MLR and correlation analysis
STAT 3900/4950 MIDTERM TWO Name: Spring, 205 (print: first last ) Covered topics: Two-way ANOVA, ANCOVA, SLR, MLR and correlation analysis Instructions: You may use your books, notes, and SPSS/SAS. NO
More informationREVIEW 8/2/2017 陈芳华东师大英语系
REVIEW Hypothesis testing starts with a null hypothesis and a null distribution. We compare what we have to the null distribution, if the result is too extreme to belong to the null distribution (p
More informationStats Review Chapter 14. Mary Stangler Center for Academic Success Revised 8/16
Stats Review Chapter 14 Revised 8/16 Note: This review is meant to highlight basic concepts from the course. It does not cover all concepts presented by your instructor. Refer back to your notes, unit
More informationInteractions among Categorical Predictors
Interactions among Categorical Predictors Today s Class: Reviewing significance tests Manual contrasts for categorical predictors Program-created contrasts for categorical predictors SPLH 861: Lecture
More informationReview of Statistics 101
Review of Statistics 101 We review some important themes from the course 1. Introduction Statistics- Set of methods for collecting/analyzing data (the art and science of learning from data). Provides methods
More informationOutline. Mixed models in R using the lme4 package Part 3: Longitudinal data. Sleep deprivation data. Simple longitudinal data
Outline Mixed models in R using the lme4 package Part 3: Longitudinal data Douglas Bates Longitudinal data: sleepstudy A model with random effects for intercept and slope University of Wisconsin - Madison
More informationNewsom Psy 510/610 Multilevel Regression, Spring
Psy 510/610 Multilevel Regression, Spring 2017 1 Diagnostics Chapter 10 of Snijders and Bosker (2012) provide a nice overview of assumption tests that are available. I will illustrate only one statistical
More informationResearch Design: Topic 18 Hierarchical Linear Modeling (Measures within Persons) 2010 R.C. Gardner, Ph.d.
Research Design: Topic 8 Hierarchical Linear Modeling (Measures within Persons) R.C. Gardner, Ph.d. General Rationale, Purpose, and Applications Linear Growth Models HLM can also be used with repeated
More informationIntroduction to SAS proc mixed
Faculty of Health Sciences Introduction to SAS proc mixed Analysis of repeated measurements, 2017 Julie Forman Department of Biostatistics, University of Copenhagen Outline Data in wide and long format
More informationStat 579: Generalized Linear Models and Extensions
Stat 579: Generalized Linear Models and Extensions Linear Mixed Models for Longitudinal Data Yan Lu April, 2018, week 14 1 / 64 Data structure and Model t1 t2 tn i 1st subject y 11 y 12 y 1n1 2nd subject
More informationTrends in Human Development Index of European Union
Trends in Human Development Index of European Union Department of Statistics, Hacettepe University, Beytepe, Ankara, Turkey spxl@hacettepe.edu.tr, deryacal@hacettepe.edu.tr Abstract: The Human Development
More informationNormal distribution We have a random sample from N(m, υ). The sample mean is Ȳ and the corrected sum of squares is S yy. After some simplification,
Likelihood Let P (D H) be the probability an experiment produces data D, given hypothesis H. Usually H is regarded as fixed and D variable. Before the experiment, the data D are unknown, and the probability
More informationPath Analysis. PRE 906: Structural Equation Modeling Lecture #5 February 18, PRE 906, SEM: Lecture 5 - Path Analysis
Path Analysis PRE 906: Structural Equation Modeling Lecture #5 February 18, 2015 PRE 906, SEM: Lecture 5 - Path Analysis Key Questions for Today s Lecture What distinguishes path models from multivariate
More informationReview of Multiple Regression
Ronald H. Heck 1 Let s begin with a little review of multiple regression this week. Linear models [e.g., correlation, t-tests, analysis of variance (ANOVA), multiple regression, path analysis, multivariate
More informationDyadic Data Analysis. Richard Gonzalez University of Michigan. September 9, 2010
Dyadic Data Analysis Richard Gonzalez University of Michigan September 9, 2010 Dyadic Component 1. Psychological rationale for homogeneity and interdependence 2. Statistical framework that incorporates
More informationStat/F&W Ecol/Hort 572 Review Points Ané, Spring 2010
1 Linear models Y = Xβ + ɛ with ɛ N (0, σ 2 e) or Y N (Xβ, σ 2 e) where the model matrix X contains the information on predictors and β includes all coefficients (intercept, slope(s) etc.). 1. Number of
More informationCorrelation and Regression Bangkok, 14-18, Sept. 2015
Analysing and Understanding Learning Assessment for Evidence-based Policy Making Correlation and Regression Bangkok, 14-18, Sept. 2015 Australian Council for Educational Research Correlation The strength
More informationCentering Predictor and Mediator Variables in Multilevel and Time-Series Models
Centering Predictor and Mediator Variables in Multilevel and Time-Series Models Tihomir Asparouhov and Bengt Muthén Part 2 May 7, 2018 Tihomir Asparouhov and Bengt Muthén Part 2 Muthén & Muthén 1/ 42 Overview
More information2 Regression Analysis
FORK 1002 Preparatory Course in Statistics: 2 Regression Analysis Genaro Sucarrat (BI) http://www.sucarrat.net/ Contents: 1 Bivariate Correlation Analysis 2 Simple Regression 3 Estimation and Fit 4 T -Test:
More informationReview of the General Linear Model
Review of the General Linear Model EPSY 905: Multivariate Analysis Online Lecture #2 Learning Objectives Types of distributions: Ø Conditional distributions The General Linear Model Ø Regression Ø Analysis
More informationGeneralized Linear Models for Non-Normal Data
Generalized Linear Models for Non-Normal Data Today s Class: 3 parts of a generalized model Models for binary outcomes Complications for generalized multivariate or multilevel models SPLH 861: Lecture
More informationTesting Indirect Effects for Lower Level Mediation Models in SAS PROC MIXED
Testing Indirect Effects for Lower Level Mediation Models in SAS PROC MIXED Here we provide syntax for fitting the lower-level mediation model using the MIXED procedure in SAS as well as a sas macro, IndTest.sas
More informationCorrelation and regression
1 Correlation and regression Yongjua Laosiritaworn Introductory on Field Epidemiology 6 July 2015, Thailand Data 2 Illustrative data (Doll, 1955) 3 Scatter plot 4 Doll, 1955 5 6 Correlation coefficient,
More informationAnalysis of Covariance
Analysis of Covariance Using categorical and continuous predictor variables Example An experiment is set up to look at the effects of watering on Oak Seedling establishment Three levels of watering: (no
More informationAn Introduction to Path Analysis
An Introduction to Path Analysis PRE 905: Multivariate Analysis Lecture 10: April 15, 2014 PRE 905: Lecture 10 Path Analysis Today s Lecture Path analysis starting with multivariate regression then arriving
More informationIn matrix algebra notation, a linear model is written as
DM3 Calculation of health disparity Indices Using Data Mining and the SAS Bridge to ESRI Mussie Tesfamicael, University of Louisville, Louisville, KY Abstract Socioeconomic indices are strongly believed
More informationPanel Data. March 2, () Applied Economoetrics: Topic 6 March 2, / 43
Panel Data March 2, 212 () Applied Economoetrics: Topic March 2, 212 1 / 43 Overview Many economic applications involve panel data. Panel data has both cross-sectional and time series aspects. Regression
More informationLectures 5 & 6: Hypothesis Testing
Lectures 5 & 6: Hypothesis Testing in which you learn to apply the concept of statistical significance to OLS estimates, learn the concept of t values, how to use them in regression work and come across
More informationOrdinary Least Squares Regression Explained: Vartanian
Ordinary Least Squares Regression Explained: Vartanian When to Use Ordinary Least Squares Regression Analysis A. Variable types. When you have an interval/ratio scale dependent variable.. When your independent
More informationCorrelated data. Repeated measurements over time. Typical set-up for repeated measurements. Traditional presentation of data
Faculty of Health Sciences Repeated measurements over time Correlated data NFA, May 22, 2014 Longitudinal measurements Julie Lyng Forman & Lene Theil Skovgaard Department of Biostatistics University of
More informationAn R # Statistic for Fixed Effects in the Linear Mixed Model and Extension to the GLMM
An R Statistic for Fixed Effects in the Linear Mixed Model and Extension to the GLMM Lloyd J. Edwards, Ph.D. UNC-CH Department of Biostatistics email: Lloyd_Edwards@unc.edu Presented to the Department
More informationStatistical Inference. Part IV. Statistical Inference
Part IV Statistical Inference As of Oct 5, 2017 Sampling Distributions of the OLS Estimator 1 Statistical Inference Sampling Distributions of the OLS Estimator Testing Against One-Sided Alternatives Two-Sided
More information