MULTIVARIATE ANALYSIS OF VARIANCE
|
|
- Amber Freeman
- 5 years ago
- Views:
Transcription
1 MULTIVARIATE ANALYSIS OF VARIANCE RAJENDER PARSAD AND L.M. BHAR Indian Agricultural Statistics Research Institute Library Avenue, New Delhi lmb@iasri.res.in. Introduction In many agricultural experiments, generally the data on more than one character is observed. One common example is grain yield and straw yield. The other characters on which the data is generally observed are the plant height, number of green leaves, germination count, etc. The analysis is normally done only on the grain yield and the best treatment is identified on the basis of this character alone. The straw yield is generally not taken into account. If we see the system as a whole, the straw yield is also important either for the cattle feed or for mulching or manuring, etc. Therefore, while analyzing the data, the straw yield should also be taken into consideration. Similarly, in varietal trials also the data is collected on several plant characteristics and quality parameters. In these experimental situations also the data is generally analyzed separately for each of the characters. The best treatment or genotype is identified separately for each of the characters. In these situations, Multivariate Analysis of Variance (MANOVA) can be helpful. Before discussing about MANOVA, a brief description about Analysis of Variance (ANOVA) is given in Section. A general procedure of performing MANOVA on the data generated from RCB design is given in Section 3. The procedure of MANOVA has been illustrated with the help of an example in Section 4.. Overview of ANOVA The ANOVA looks at the variance within classes relative to the overall variance. The dependent variable must be metric, and the independent variables, which can be many, must be nominal. ANOVA is used to uncover the main and interaction effects of categorical independent variables (called "factors") on an interval dependent variable. A main effect is the direct effect of an independent variable on the dependent variable. An interaction effect is the joint effect of two or more independent variables on the dependent variable. Whereas regression models cannot handle interaction unless explicit crossproduct interaction terms are added, ANOVA uncovers interaction effects on a builtin basis. The key statistic in ANOVA is the F-test of difference of group means, testing if the means of the groups formed by values of the independent variable (or combinations of values for multiple independent variables) are different enough not to have occurred by chance. If the group means do not differ significantly then it is inferred that the independent variable(s) did not have an effect on the dependent variable. If the F test shows that overall the independent variable(s) is (are) related to the dependent variable, then multiple comparison tests of significance are used to explore just which values of the independent(s) have the most to do with the relationship. 3. Multivariate Analysis of Variance Why do MANOVA, when one can get also much more information by doing a series of ANOVAs? Even if all our dependent variables are completely independent of one another,
2 when we do lots of tests like that, error inflates. But in many ecological or biological studies, the variables are not independent at all. Many times they have strong actual or potential interactions, inflating the error even more highly. In many cases where multiple ANOVAs were done, MANOVA was actually the more appropriate test. Consider an experiment conducted to compare v treatments using a randomized complete block (RCB) design with r replications and the data is collected on p-variables. Let y denote the observed value of the k th response variable for the i th treatment in the j th ijk replication i =,,..., v; j=,,..., r;k=,,..., p. The data is rearranged as follows: Replications Treatments j r Treatment Mean y y y j y r y. y y y j y r y. i y i y i y ij y ir y i. v y v y v y v y v y v. Replication y. y. y. j y. r y.. Mean Here y = ( y y...y... y ) is a p-variate vector of observations taken from the plot ij ij ij receiving the treatment i in replication j. ijk r v v r y i. = yij ; y.j = yij and.. = r v vr j= ijp i= y y. i= j= The observations can be represented by a two way classified multivariate model Ω Ω : y = µ + t + b + e i =,,,v; j =,,,b, (3.) ij i j ij µ = (µ µ µ k µ p ) is the p vector of general means, t i = (t i t i t ik t ip ) are the effects of treatment i on p-characters, and b j =(b j b j b jk b jp ) are the effects of replication j on p-characters. e ij = (e ij e ij e ijk e ijp ) is a p-variate random vector associated with y ij and assumed to be distributed independently as p variate normal distribution N p ( 0, Σ). The equality of treatment effects is to be tested i.e. H 0 : (t i t i t ik t ip ) = (t t t k t p ) (say) i=,,, p against the alternative H : at least two of the treatment effects are unequal. Under the null hypothesis, the model (3.) reduces to Ω : y = α+ b + e (3.) 0 ij j ij ( µ + t µ + t,...,µ p+ t p where α = ). An outline of MANOVA Table for testing the equality of treatment effects and replication effects is ij
3 MANOVA Source DF SSCPM (Sum of Squares and Cross Product Matrix) Treatment v- = h v H = = ( )( ) b i y i. y.. yi. y.. Replication r- = t b B= v = ( y y )( y y ) Residual Total (v-)(r-) = s vr- j.j...j.. v b R= ( y y y + y )( y y y + y ) i = j = ij i..j.. ij i..j.. v b T= ( y y )( y y ) i = j = ij.. ij.. =H+B+R Here H, B, R and T are the sum of squares and sum of cross product matrices of treatments, replications, errors (residuals) and totals respectively. The residual sum of squares and cross products matrix for the reduced model Ω 0 is denoted by R 0 and is given by R 0 = R+ H. The null hypothesis of equality of treatment mean vectors is rejected if the ratio of R generalized variance (Wilk's lambda statistic) Λ = is too small. Assuming the H+ R normal distribution, Rao (973) showed that under null hypothesis Λ is distributed as the product of independent beta variables. A better but more complicated approximation of the distribution of Λ is Λ Λ / b / b (ab c) ~ F (ph, ab-c) ph where a, b {( p h 4) /( p + h 5) } p h+ = s =, c= ph For some particular values of h and p, it reduces to exact F-distribution. The special cases are given below: For h = and any p, this reduces to For h= and any p, it reduces to ( Λ)(s p+ ) ~ F (p, s p + ) Λ p ( Λ)(s p+ ) ~ F (p, (s p + )) Λ p ( Λ)(s ) For p= and any h: ~ F (h, (s )). Λ h For p =, the statistic reduces to the usual variance ratio statistics. The hypothesis regarding the equality of replication effects can be tested by replacing Λ R by and h by t in the above. B+ R 3
4 Several other criteria viz. Pillai's Trace, Hotelling-Lawley Trace or Roy's Greatest Root are available in literature for testing the null hypothesis in MANOVA. Wilks' Lamda is, however, the commonly used criterion. Here, we shall restrict to the use of Wilks' Lamda criterion. For further details on MANOVA, a reference may be made to Seber (983) and Johnson and Wichern (988). Remark 3.: One complication of multivariate analysis that does not arise in the univariate case is the ranks of the matrices. The rank of R should not be smaller than p or in other words error degrees of freedom s should be greater than or equal to p (s p). 3. Multivariate Treatment Contrast Analysis If the treatments are found to be significantly different through MANOVA, then the next question is which treatments are significantly different? This question can be answered through multivariate treatment contrast analysis. In the literature, the multivariate treatment contrast analysis is generally carried out using the χ -statistic. The χ -statistic is based on the assumption that the error variance-covariance matrix is known. The error variance-covariance matrix is, however, generally unknown. Therefore, the estimated value of error variance-covariance matrix is used. The error variance-covariance matrix is estimated by sum of squares and cross products (SSCP) matrix for error divided by the error degrees of freedom. As a consequence, test based on χ -statistic is an approximate solution. The procedure using the Wilk s Lambda criterion is also described in the sequel. Suppose the hypothesis to be tested is H 0 : be rewritten as t = against H : t. This hypothesis can i t i ' i t i ' H 0 : = ( t ' ) = 0 against H : = ( t ' ) 0, i t i i t i i t i t i i i i ik i k ip i p t = ( t t t... t t... t t ) (3.3) where ( ' ). Here t ik denote the effect of treatment i for the dependent variable k. The best linear unbiased estimate of ( ti t i ' ) is ( ) y y = ( y y y y... y y... y y ) i. i. i i i i ik i k ip ' where y ik is the mean of treatment i for variable k. 3.. χ Test The statistic based on χ, requires covariance matrix of the contrast of interest. The covariance matrix, in case of a RCB design for elementary treatment contrast is obtained by dividing the SSCP matrix for errors obtained in MANOVA by half of the product of error degrees of freedom and the number of replications. Let this variance-covariance matrix is denoted by Σ c. Under null hypothesis, x = yi. y ' follows p- variate normal i. distribution with mean vector 0 and variance-covariance matrix Σ c. Applying the Aitken's / transformation, it can be shown that z= Σc x follows a p-variate normal distribution with mean vector 0 and variance-covariance matrix I g, where I g, denotes the identity matrix of order g. Then using the results of quadratic forms, it can easily be seen that z z x = Σ x follows a χ distribution with p-degrees of freedom. i p 4
5 3.. Wilk s Lambda Criterion For testing the null hypothesis (3.3), we obtain a sum of squares and products matrix for the above elementary treatment contrast. Let the SSCP matrix for above elementary treatment contrast be G p p. The diagonal elements of G are then obtained by r g kk = ( yik yi'k) k=,,...,p; i i' =,,..., v (3.4) and the off diagonal elements are obtained by r g kk' = ( y ik y i'k )( y ik' y i'k' ) (3.5) R The null hypothesis is rejected if the value of Wilk's Lambda Λ* = is small, G+ R where R is the SSCP matrix due to residuals as obtained through MANOVA. The hypothesis is then tested using the following F-test statistics based on Wilk's Lambda for h = Λ * edf p+ F(p, s-p+). Λ * p 4. Illustration using Multivariate Techniques In this section, the results obtained from bivariate analysis of variance of the data generated from the experiments conducted under PDCSR are given, where the data on grain yield and straw yield were observed. Illustration 4.: An experiment entitled Studies on the experimentation on conservation of organic carbon in the soil to improve soil condition was conducted at Bhubaneshwar on rice crop. The experiment was initiated in the year 997. The data on grain and straw used for the illustration pertains to the Kharif season of 00. Ten treatments were tried in the experiment. The details of the treatments are given below: T - Recommended N 00% T - Recommended N 00% out of which 0 Kg at first ploughing T3 - Recommended N 00% out of which 0 Kg at first ploughing T4 - Recommended N 00% and add 0 Kg N/ha at first ploughing T5 - Recommended N 00% and add 0 Kg N/ha at first ploughing T6 - Recommended N + 0 Kg N/ha T7 - Recommended N + 0 Kg N/ha T8 - Recommended N + cellulose decomposing enzyme (FYM) T9 - Recommended N + FYM 5 t/ha during Kharif T0 - Recommended N + FYM 5 t/ha during Rabi The results of multivariate analysis of variance are given in the sequel. First the results for each of the two characters are presented separately. ANOVA: Grain Yield (GYLD) Source DF SS MS F Value Pr > F Model <.000 Error Total
6 R-Square CV Root MSE GYLD Mean Source DF SS MS F -ratio Pr > F REP TRT <.000 ANOVA: Straw Yield (SYLD) Source DF SS MS F -ratio Pr > F Model <.000 Error Total R-Square CV RMSE SYLD Mean Source DF SS MS F -ratio Pr > F REP TRT <.000 It can be seen that for both the characters, the replication effects are not significantly different whereas the treatments are significantly different. Therefore, for making all possible paired comparisons, the least significant difference procedure of multiple comparisons was used. The results are given in the sequel: t Tests (LSD) for GYLD Alpha 0.05 Error Degrees of Freedom 7 Error Mean Square.4689 Critical Value of t.058 Least Significant Difference at 5%.7584 t Grouping Mean N TRT A A A A A A A B C D C D *The treatments with the same alphabet are not significantly different. 6
7 t Tests (LSD) for SYLD Alpha 0.05 Error Degrees of Freedom 7 Error Mean Square Critical Value of t.0583 Least Significant Difference.073 t Grouping Mean N TRT A A B A B A B A B A C B C D C E D E *The treatments with the same alphabet are not significantly different. It can be concluded that the treatment T8 is at Rank for GYLD and T7 gets rank for SYLD, although the two treatments are not significantly different among themselves. The treatments T4 and T are not significantly different for GYLD and significantly different for SYLD. Therefore, to rank the treatments collectively for both the characters, the multivariate analysis of variance was carried out. The results obtained are given below: Multivariate Analysis of Variance E = Error SSCP Matrix gyld syld gyld syld Partial Correlation Coefficients from the Error SSCP Matrix / Prob > r DF = 7 gyld syld gyld <.000 syld <.000 MANOVA Test Criteria and F Approximations for the Hypothesis of No Overall TRT Effects. Statistic Value F-ratio Num DF Den DF Pr > F Wilks' Lambda <.000 Pillai's Trace <.000 Hotelling-Lawley Trace <.000 Roy's Greatest Root <.000 7
8 From the above Table, it can be concluded that the treatment effects are significantly different. Now the next question is that what is ranking of treatments? Which treatments are significantly different? This can be achieved through multivariate contrast analysis. However, most of the software, carry out the univariate contrast analysis on the combined average values of all the dependent variables. To account for the correlation structure between the two variables, the principal component analysis was carried out. The results are: Eigenvalues of the Correlation Matrix Eigenvalue Difference Proportion Cumulative Prin Prin gyld syld Eigenvectors It can be seen that the first principal component explains 99.% of the variance. Therefore, the principal component scores of the observations for the first principal components are obtained and the univariate analysis of variance was carried out. The results obtained are: ANOVA: Principal Component Scores Source DF SS MS F -ratio Pr > F Model <.000 Error Corrected Total R-Square CV Root MSE Prin Mean Source DF SS MS F -ratio Pr > F REP TRT <.000 It can be seen that the treatments are highly significantly different. Therefore, multiple comparisons using the least significant difference procedure was used. t Tests (LSD) for prin Alpha 0.05 Error Degrees of Freedom 7 Error Mean Square Critical Value of t.058 Least Significant Difference
9 t Grouping Mean N TRT A A A A A B A B A B C D C.3 4 D The treatment T7 gets the first rank and is non-significantly different from T8. The treatments T4 and T are significantly different among themselves. This procedure answers the question to some extent. But a multivariate contrasts analysis is the best answer for this situation. The results of multivariate treatment contrast analysis for making all possible paired comparisons of the treatments are given in the sequel. Probabilities of Significance of All Possible Paired Treatment Comparisons using Wilks' Lamda Criterion Treats < < *bold face type shows the treatment pairs that are not significantly different. From the above results, it is seen that treatments T7 and T8 are significantly different where as they were found to be not significantly different when analyzed for individual characters or st principal component score was used. Note: The MANOVA described in Sections and 3 can usefully be employed for the experimental situations where the experiment is continued for several years/ seasons with same treatments and same randomized layout. For a detailed discussion on this one may refer to Parsad et al. (004). 9
10 SPSS Commands for MANOVA. Enter the data. Click Analyze General Linear Model Multivariate 3. Put dependent variables (grain, straw) in Dependent Variables box and independent variables (treat., rep) in Fixed Factors box 4. Then Click model Custom and bring the independent variables in model box. Then click continue 0
11 5. If you want contrast analysis, then click contrast and mark the variables for which you want contrast analysis otherwise click continue 6. If you want post-hoc analysis, then click post hoc and bring the required variables in Post hoc test for box and then click continue 7. For other statistics, then click Options and for diagnostics results, then click Save
12 8. Finally click OK button and get the results References and Suggested Reading Johnson, R.A. and Wichern, D.W. (988). Applied Multivariate Statistical Analysis, nd Edition. Prentice-Hall International, Inc., London. Parsad, R., Gupta, V.K., Batra, P.K., Srivastava, R., Kaur, R., Kaur, A. and Arya, P. (004). A diagnostic study of design and analysis of field exeriments. Project Report, IASRI, New Delhi. Rao, C.R.(973). Linear Statistical Inference and Application. Wiley Eastern Ltd., New Delhi. Seber, G.A.F.(983). Multivariate Observations. Wiley series in Probability and Statistics.
COVARIANCE ANALYSIS. Rajender Parsad and V.K. Gupta I.A.S.R.I., Library Avenue, New Delhi
COVARIANCE ANALYSIS Rajender Parsad and V.K. Gupta I.A.S.R.I., Library Avenue, New Delhi - 110 012 1. Introduction It is well known that in designed experiments the ability to detect existing differences
More informationChapter 7, continued: MANOVA
Chapter 7, continued: MANOVA The Multivariate Analysis of Variance (MANOVA) technique extends Hotelling T 2 test that compares two mean vectors to the setting in which there are m 2 groups. We wish to
More information4.1 Computing section Example: Bivariate measurements on plants Post hoc analysis... 7
Master of Applied Statistics ST116: Chemometrics and Multivariate Statistical data Analysis Per Bruun Brockhoff Module 4: Computing 4.1 Computing section.................................. 1 4.1.1 Example:
More informationNeuendorf MANOVA /MANCOVA. Model: X1 (Factor A) X2 (Factor B) X1 x X2 (Interaction) Y4. Like ANOVA/ANCOVA:
1 Neuendorf MANOVA /MANCOVA Model: X1 (Factor A) X2 (Factor B) X1 x X2 (Interaction) Y1 Y2 Y3 Y4 Like ANOVA/ANCOVA: 1. Assumes equal variance (equal covariance matrices) across cells (groups defined by
More informationMultivariate analysis of variance and covariance
Introduction Multivariate analysis of variance and covariance Univariate ANOVA: have observations from several groups, numerical dependent variable. Ask whether dependent variable has same mean for each
More informationMANOVA is an extension of the univariate ANOVA as it involves more than one Dependent Variable (DV). The following are assumptions for using MANOVA:
MULTIVARIATE ANALYSIS OF VARIANCE MANOVA is an extension of the univariate ANOVA as it involves more than one Dependent Variable (DV). The following are assumptions for using MANOVA: 1. Cell sizes : o
More informationNeuendorf MANOVA /MANCOVA. Model: MAIN EFFECTS: X1 (Factor A) X2 (Factor B) INTERACTIONS : X1 x X2 (A x B Interaction) Y4. Like ANOVA/ANCOVA:
1 Neuendorf MANOVA /MANCOVA Model: MAIN EFFECTS: X1 (Factor A) X2 (Factor B) Y1 Y2 INTERACTIONS : Y3 X1 x X2 (A x B Interaction) Y4 Like ANOVA/ANCOVA: 1. Assumes equal variance (equal covariance matrices)
More informationNeuendorf MANOVA /MANCOVA. Model: X1 (Factor A) X2 (Factor B) X1 x X2 (Interaction) Y4. Like ANOVA/ANCOVA:
1 Neuendorf MANOVA /MANCOVA Model: X1 (Factor A) X2 (Factor B) X1 x X2 (Interaction) Y1 Y2 Y3 Y4 Like ANOVA/ANCOVA: 1. Assumes equal variance (equal covariance matrices) across cells (groups defined by
More informationCOMBINED ANALYSIS OF DATA
COMBINED ANALYSIS OF DATA Krishan Lal I.A.S.R.I., Library Avenue, New Delhi- 110 01 klkalra@iasri.res.in 1. Introduction In large-scale experimental programmes it is necessary to repeat the trial of a
More informationLecture 6: Single-classification multivariate ANOVA (k-group( MANOVA)
Lecture 6: Single-classification multivariate ANOVA (k-group( MANOVA) Rationale and MANOVA test statistics underlying principles MANOVA assumptions Univariate ANOVA Planned and unplanned Multivariate ANOVA
More informationApplied Multivariate Statistical Modeling Prof. J. Maiti Department of Industrial Engineering and Management Indian Institute of Technology, Kharagpur
Applied Multivariate Statistical Modeling Prof. J. Maiti Department of Industrial Engineering and Management Indian Institute of Technology, Kharagpur Lecture - 29 Multivariate Linear Regression- Model
More informationMultivariate Statistical Analysis
Multivariate Statistical Analysis Fall 2011 C. L. Williams, Ph.D. Lecture 17 for Applied Multivariate Analysis Outline Multivariate Analysis of Variance 1 Multivariate Analysis of Variance The hypotheses:
More informationMANOVA MANOVA,$/,,# ANOVA ##$%'*!# 1. $!;' *$,$!;' (''
14 3! "#!$%# $# $&'('$)!! (Analysis of Variance : ANOVA) *& & "#!# +, ANOVA -& $ $ (+,$ ''$) *$#'$)!!#! (Multivariate Analysis of Variance : MANOVA).*& ANOVA *+,'$)$/*! $#/#-, $(,!0'%1)!', #($!#$ # *&,
More informationG E INTERACTION USING JMP: AN OVERVIEW
G E INTERACTION USING JMP: AN OVERVIEW Sukanta Dash I.A.S.R.I., Library Avenue, New Delhi-110012 sukanta@iasri.res.in 1. Introduction Genotype Environment interaction (G E) is a common phenomenon in agricultural
More informationMultivariate Linear Models
Multivariate Linear Models Stanley Sawyer Washington University November 7, 2001 1. Introduction. Suppose that we have n observations, each of which has d components. For example, we may have d measurements
More informationSAMPLING IN FIELD EXPERIMENTS
SAMPLING IN FIELD EXPERIMENTS Rajender Parsad I.A.S.R.I., Library Avenue, New Delhi-0 0 rajender@iasri.res.in In field experiments, the plot size for experimentation is selected for achieving a prescribed
More informationApplied Multivariate and Longitudinal Data Analysis
Applied Multivariate and Longitudinal Data Analysis Chapter 2: Inference about the mean vector(s) II Ana-Maria Staicu SAS Hall 5220; 919-515-0644; astaicu@ncsu.edu 1 1 Compare Means from More Than Two
More informationRepeated-Measures ANOVA in SPSS Correct data formatting for a repeated-measures ANOVA in SPSS involves having a single line of data for each
Repeated-Measures ANOVA in SPSS Correct data formatting for a repeated-measures ANOVA in SPSS involves having a single line of data for each participant, with the repeated measures entered as separate
More informationPrepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti
Prepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Putra Malaysia Serdang Use in experiment, quasi-experiment
More informationAnalysis of variance, multivariate (MANOVA)
Analysis of variance, multivariate (MANOVA) Abstract: A designed experiment is set up in which the system studied is under the control of an investigator. The individuals, the treatments, the variables
More informationBLOCK DESIGNS WITH FACTORIAL STRUCTURE
BLOCK DESIGNS WITH ACTORIAL STRUCTURE V.K. Gupta and Rajender Parsad I.A.S.R.I., Library Avenue, New Delhi - 0 0 The purpose of this talk is to expose the participants to the interesting work on block
More informationAn Introduction to Multivariate Statistical Analysis
An Introduction to Multivariate Statistical Analysis Third Edition T. W. ANDERSON Stanford University Department of Statistics Stanford, CA WILEY- INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION Contents
More informationRepeated Measures Part 2: Cartoon data
Repeated Measures Part 2: Cartoon data /*********************** cartoonglm.sas ******************/ options linesize=79 noovp formdlim='_'; title 'Cartoon Data: STA442/1008 F 2005'; proc format; /* value
More informationLecture 5: Hypothesis tests for more than one sample
1/23 Lecture 5: Hypothesis tests for more than one sample Måns Thulin Department of Mathematics, Uppsala University thulin@math.uu.se Multivariate Methods 8/4 2011 2/23 Outline Paired comparisons Repeated
More informationANOVA Longitudinal Models for the Practice Effects Data: via GLM
Psyc 943 Lecture 25 page 1 ANOVA Longitudinal Models for the Practice Effects Data: via GLM Model 1. Saturated Means Model for Session, E-only Variances Model (BP) Variances Model: NO correlation, EQUAL
More informationExample 1 describes the results from analyzing these data for three groups and two variables contained in test file manova1.tf3.
Simfit Tutorials and worked examples for simulation, curve fitting, statistical analysis, and plotting. http://www.simfit.org.uk MANOVA examples From the main SimFIT menu choose [Statistcs], [Multivariate],
More informationWITHIN-PARTICIPANT EXPERIMENTAL DESIGNS
1 WITHIN-PARTICIPANT EXPERIMENTAL DESIGNS I. Single-factor designs: the model is: yij i j ij ij where: yij score for person j under treatment level i (i = 1,..., I; j = 1,..., n) overall mean βi treatment
More informationOther hypotheses of interest (cont d)
Other hypotheses of interest (cont d) In addition to the simple null hypothesis of no treatment effects, we might wish to test other hypothesis of the general form (examples follow): H 0 : C k g β g p
More informationM M Cross-Over Designs
Chapter 568 Cross-Over Designs Introduction This module calculates the power for an x cross-over design in which each subject receives a sequence of treatments and is measured at periods (or time points).
More informationMultivariate Linear Regression Models
Multivariate Linear Regression Models Regression analysis is used to predict the value of one or more responses from a set of predictors. It can also be used to estimate the linear association between
More informationData Analyses in Multivariate Regression Chii-Dean Joey Lin, SDSU, San Diego, CA
Data Analyses in Multivariate Regression Chii-Dean Joey Lin, SDSU, San Diego, CA ABSTRACT Regression analysis is one of the most used statistical methodologies. It can be used to describe or predict causal
More informationMultivariate Analysis of Variance
Chapter 15 Multivariate Analysis of Variance Jolicouer and Mosimann studied the relationship between the size and shape of painted turtles. The table below gives the length, width, and height (all in mm)
More informationLeast Squares Estimation
Least Squares Estimation Using the least squares estimator for β we can obtain predicted values and compute residuals: Ŷ = Z ˆβ = Z(Z Z) 1 Z Y ˆɛ = Y Ŷ = Y Z(Z Z) 1 Z Y = [I Z(Z Z) 1 Z ]Y. The usual decomposition
More informationCovariance Structure Approach to Within-Cases
Covariance Structure Approach to Within-Cases Remember how the data file grapefruit1.data looks: Store sales1 sales2 sales3 1 62.1 61.3 60.8 2 58.2 57.9 55.1 3 51.6 49.2 46.2 4 53.7 51.5 48.3 5 61.4 58.7
More informationPOWER AND TYPE I ERROR RATE COMPARISON OF MULTIVARIATE ANALYSIS OF VARIANCE
POWER AND TYPE I ERROR RATE COMPARISON OF MULTIVARIATE ANALYSIS OF VARIANCE Supported by Patrick Adebayo 1 and Ahmed Ibrahim 1 Department of Statistics, University of Ilorin, Kwara State, Nigeria Department
More informationOne-Way Repeated Measures Contrasts
Chapter 44 One-Way Repeated easures Contrasts Introduction This module calculates the power of a test of a contrast among the means in a one-way repeated measures design using either the multivariate test
More informationGLM Repeated Measures
GLM Repeated Measures Notation The GLM (general linear model) procedure provides analysis of variance when the same measurement or measurements are made several times on each subject or case (repeated
More informationAnalysis of Longitudinal Data: Comparison Between PROC GLM and PROC MIXED. Maribeth Johnson Medical College of Georgia Augusta, GA
Analysis of Longitudinal Data: Comparison Between PROC GLM and PROC MIXED Maribeth Johnson Medical College of Georgia Augusta, GA Overview Introduction to longitudinal data Describe the data for examples
More informationApplication of Ghosh, Grizzle and Sen s Nonparametric Methods in. Longitudinal Studies Using SAS PROC GLM
Application of Ghosh, Grizzle and Sen s Nonparametric Methods in Longitudinal Studies Using SAS PROC GLM Chan Zeng and Gary O. Zerbe Department of Preventive Medicine and Biometrics University of Colorado
More informationExperimental Design and Data Analysis for Biologists
Experimental Design and Data Analysis for Biologists Gerry P. Quinn Monash University Michael J. Keough University of Melbourne CAMBRIDGE UNIVERSITY PRESS Contents Preface page xv I I Introduction 1 1.1
More informationGregory Carey, 1998 Regression & Path Analysis - 1 MULTIPLE REGRESSION AND PATH ANALYSIS
Gregory Carey, 1998 Regression & Path Analysis - 1 MULTIPLE REGRESSION AND PATH ANALYSIS Introduction Path analysis and multiple regression go hand in hand (almost). Also, it is easier to learn about multivariate
More informationVARIANCE COMPONENT ANALYSIS
VARIANCE COMPONENT ANALYSIS T. KRISHNAN Cranes Software International Limited Mahatma Gandhi Road, Bangalore - 560 001 krishnan.t@systat.com 1. Introduction In an experiment to compare the yields of two
More informationMultilevel Models in Matrix Form. Lecture 7 July 27, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2
Multilevel Models in Matrix Form Lecture 7 July 27, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2 Today s Lecture Linear models from a matrix perspective An example of how to do
More informationANOVA in SPSS. Hugo Quené. opleiding Taalwetenschap Universiteit Utrecht Trans 10, 3512 JK Utrecht.
ANOVA in SPSS Hugo Quené hugo.quene@let.uu.nl opleiding Taalwetenschap Universiteit Utrecht Trans 10, 3512 JK Utrecht 7 Oct 2005 1 introduction In this example I ll use fictitious data, taken from http://www.ruf.rice.edu/~mickey/psyc339/notes/rmanova.html.
More informationCOMPLETELY RANDOM DESIGN (CRD) -Design can be used when experimental units are essentially homogeneous.
COMPLETELY RANDOM DESIGN (CRD) Description of the Design -Simplest design to use. -Design can be used when experimental units are essentially homogeneous. -Because of the homogeneity requirement, it may
More informationGroup comparison test for independent samples
Group comparison test for independent samples The purpose of the Analysis of Variance (ANOVA) is to test for significant differences between means. Supposing that: samples come from normal populations
More informationNESTED BLOCK DESIGNS
NESTED BLOCK DESIGNS Rajender Parsad I.A.S.R.I., Library Avenue, New Delhi 0 0 rajender@iasri.res.in. Introduction Heterogeneity in the experimental material is the most important problem to be reckoned
More informationMultivariate Regression (Chapter 10)
Multivariate Regression (Chapter 10) This week we ll cover multivariate regression and maybe a bit of canonical correlation. Today we ll mostly review univariate multivariate regression. With multivariate
More informationAnalysis of Variance (ANOVA)
Analysis of Variance (ANOVA) Two types of ANOVA tests: Independent measures and Repeated measures Comparing 2 means: X 1 = 20 t - test X 2 = 30 How can we Compare 3 means?: X 1 = 20 X 2 = 30 X 3 = 35 ANOVA
More informationPrincipal component analysis
Principal component analysis Motivation i for PCA came from major-axis regression. Strong assumption: single homogeneous sample. Free of assumptions when used for exploration. Classical tests of significance
More informationConfidence Intervals for One-Way Repeated Measures Contrasts
Chapter 44 Confidence Intervals for One-Way Repeated easures Contrasts Introduction This module calculates the expected width of a confidence interval for a contrast (linear combination) of the means in
More informationApplied Multivariate Analysis
Department of Mathematics and Statistics, University of Vaasa, Finland Spring 2017 Discriminant Analysis Background 1 Discriminant analysis Background General Setup for the Discriminant Analysis Descriptive
More informationGlossary. The ISI glossary of statistical terms provides definitions in a number of different languages:
Glossary The ISI glossary of statistical terms provides definitions in a number of different languages: http://isi.cbs.nl/glossary/index.htm Adjusted r 2 Adjusted R squared measures the proportion of the
More informationAnalysis of Variance. ภาว น ศ ร ประภาน ก ล คณะเศรษฐศาสตร มหาว ทยาล ยธรรมศาสตร
Analysis of Variance ภาว น ศ ร ประภาน ก ล คณะเศรษฐศาสตร มหาว ทยาล ยธรรมศาสตร pawin@econ.tu.ac.th Outline Introduction One Factor Analysis of Variance Two Factor Analysis of Variance ANCOVA MANOVA Introduction
More informationM A N O V A. Multivariate ANOVA. Data
M A N O V A Multivariate ANOVA V. Čekanavičius, G. Murauskas 1 Data k groups; Each respondent has m measurements; Observations are from the multivariate normal distribution. No outliers. Covariance matrices
More informationDesigns for asymmetrical factorial experiment through confounded symmetricals
Statistics and Applications Volume 9, Nos. 1&2, 2011 (New Series), pp. 71-81 Designs for asymmetrical factorial experiment through confounded symmetricals P.R. Sreenath (Retired) Indian Agricultural Statistics
More informationNON-PARAMETRIC METHODS IN ANALYSIS OF EXPERIMENTAL DATA
NON-PARAMETRIC METHODS IN ANALYSIS OF EXPERIMENTAL DATA Rajender Parsad I.A.S.R.I., Library Aenue, New Delhi 0 0. Introduction In conentional setup the analysis of experimental data is based on the assumptions
More informationChapter 9. Multivariate and Within-cases Analysis. 9.1 Multivariate Analysis of Variance
Chapter 9 Multivariate and Within-cases Analysis 9.1 Multivariate Analysis of Variance Multivariate means more than one response variable at once. Why do it? Primarily because if you do parallel analyses
More informationSTAT 501 EXAM I NAME Spring 1999
STAT 501 EXAM I NAME Spring 1999 Instructions: You may use only your calculator and the attached tables and formula sheet. You can detach the tables and formula sheet from the rest of this exam. Show your
More informationI L L I N O I S UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN
Comparisons of Several Multivariate Populations Edps/Soc 584 and Psych 594 Applied Multivariate Statistics Carolyn J Anderson Department of Educational Psychology I L L I N O I S UNIVERSITY OF ILLINOIS
More informationDETAILED CONTENTS PART I INTRODUCTION AND DESCRIPTIVE STATISTICS. 1. Introduction to Statistics
DETAILED CONTENTS About the Author Preface to the Instructor To the Student How to Use SPSS With This Book PART I INTRODUCTION AND DESCRIPTIVE STATISTICS 1. Introduction to Statistics 1.1 Descriptive and
More informationLec 5: Factorial Experiment
November 21, 2011 Example Study of the battery life vs the factors temperatures and types of material. A: Types of material, 3 levels. B: Temperatures, 3 levels. Example Study of the battery life vs the
More informationOne-way ANOVA. Experimental Design. One-way ANOVA
Method to compare more than two samples simultaneously without inflating Type I Error rate (α) Simplicity Few assumptions Adequate for highly complex hypothesis testing 09/30/12 1 Outline of this class
More informationT. Mark Beasley One-Way Repeated Measures ANOVA handout
T. Mark Beasley One-Way Repeated Measures ANOVA handout Profile Analysis Example In the One-Way Repeated Measures ANOVA, two factors represent separate sources of variance. Their interaction presents an
More informationSTAT 730 Chapter 5: Hypothesis Testing
STAT 730 Chapter 5: Hypothesis Testing Timothy Hanson Department of Statistics, University of South Carolina Stat 730: Multivariate Analysis 1 / 28 Likelihood ratio test def n: Data X depend on θ. The
More informationDESAIN EKSPERIMEN Analysis of Variances (ANOVA) Semester Genap 2017/2018 Jurusan Teknik Industri Universitas Brawijaya
DESAIN EKSPERIMEN Analysis of Variances (ANOVA) Semester Jurusan Teknik Industri Universitas Brawijaya Outline Introduction The Analysis of Variance Models for the Data Post-ANOVA Comparison of Means Sample
More informationSimultaneous Optimization of Incomplete Multi-Response Experiments
Open Journal of Statistics, 05, 5, 430-444 Published Online August 05 in SciRes. http://www.scirp.org/journal/ojs http://dx.doi.org/0.436/ojs.05.55045 Simultaneous Optimization of Incomplete Multi-Response
More informationStevens 2. Aufl. S Multivariate Tests c
Stevens 2. Aufl. S. 200 General Linear Model Between-Subjects Factors 1,00 2,00 3,00 N 11 11 11 Effect a. Exact statistic Pillai's Trace Wilks' Lambda Hotelling's Trace Roy's Largest Root Pillai's Trace
More informationMULTIVARIATE ANALYSIS OF VARIANCE UNDER MULTIPLICITY José A. Díaz-García. Comunicación Técnica No I-07-13/ (PE/CIMAT)
MULTIVARIATE ANALYSIS OF VARIANCE UNDER MULTIPLICITY José A. Díaz-García Comunicación Técnica No I-07-13/11-09-2007 (PE/CIMAT) Multivariate analysis of variance under multiplicity José A. Díaz-García Universidad
More informationCh 2: Simple Linear Regression
Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component
More informationI L L I N O I S UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN
Introduction Edps/Psych/Stat/ 584 Applied Multivariate Statistics Carolyn J Anderson Department of Educational Psychology I L L I N O I S UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN c Board of Trustees,
More information5 Inferences about a Mean Vector
5 Inferences about a Mean Vector In this chapter we use the results from Chapter 2 through Chapter 4 to develop techniques for analyzing data. A large part of any analysis is concerned with inference that
More informationMultivariate Analysis of Variance
Multivariate Analysis of Variance 1 Multivariate Analysis of Variance Objective of Multivariate Analysis of variance (MANOVA) is to determine whether the differences on criterion or dependent variables
More informationTopic 13. Analysis of Covariance (ANCOVA) - Part II [ST&D Ch. 17]
Topic 13. Analysis of Covariance (ANCOVA) - Part II [ST&D Ch. 17] 13.5 Assumptions of ANCOVA The assumptions of analysis of covariance are: 1. The X s are fixed, measured without error, and independent
More informationRepeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models
Repeated Measures ANOVA Multivariate ANOVA and Their Relationship to Linear Mixed Models EPSY 905: Multivariate Analysis Spring 2016 Lecture #12 April 20, 2016 EPSY 905: RM ANOVA, MANOVA, and Mixed Models
More informationOne-way between-subjects ANOVA. Comparing three or more independent means
One-way between-subjects ANOVA Comparing three or more independent means Data files SpiderBG.sav Attractiveness.sav Homework: sourcesofself-esteem.sav ANOVA: A Framework Understand the basic principles
More informationPerformance In Science And Non Science Subjects
Canonical Correlation And Hotelling s T 2 Analysis On Students Performance In Science And Non Science Subjects Mustapha Usman Baba 1, Nafisa Muhammad 1,Ibrahim Isa 1, Rabiu Ado Inusa 1 and Usman Hashim
More informationIndependent Samples ANOVA
Independent Samples ANOVA In this example students were randomly assigned to one of three mnemonics (techniques for improving memory) rehearsal (the control group; simply repeat the words), visual imagery
More information4:3 LEC - PLANNED COMPARISONS AND REGRESSION ANALYSES
4:3 LEC - PLANNED COMPARISONS AND REGRESSION ANALYSES FOR SINGLE FACTOR BETWEEN-S DESIGNS Planned or A Priori Comparisons We previously showed various ways to test all possible pairwise comparisons for
More informationTopic 12. The Split-plot Design and its Relatives (continued) Repeated Measures
12.1 Topic 12. The Split-plot Design and its Relatives (continued) Repeated Measures 12.9 Repeated measures analysis Sometimes researchers make multiple measurements on the same experimental unit. We have
More informationI L L I N O I S UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN
Canonical Edps/Soc 584 and Psych 594 Applied Multivariate Statistics Carolyn J. Anderson Department of Educational Psychology I L L I N O I S UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN Canonical Slide
More informationANCOVA. Lecture 9 Andrew Ainsworth
ANCOVA Lecture 9 Andrew Ainsworth What is ANCOVA? Analysis of covariance an extension of ANOVA in which main effects and interactions are assessed on DV scores after the DV has been adjusted for by the
More informationSTA2601. Tutorial letter 203/2/2017. Applied Statistics II. Semester 2. Department of Statistics STA2601/203/2/2017. Solutions to Assignment 03
STA60/03//07 Tutorial letter 03//07 Applied Statistics II STA60 Semester Department of Statistics Solutions to Assignment 03 Define tomorrow. university of south africa QUESTION (a) (i) The normal quantile
More informationOUTLIERS IN DESIGNED EXPERIMENTS
OUTLIERS IN DESIGNED EXPERIMENTS Lalmohan Bhar I.A.S.R.I., Library Avenue, New Delhi- 0 0 lmbhar@iasri.res.in. Introduction From the time when man started exploiting and employing the information in the
More informationChapter 2 Multivariate Normal Distribution
Chapter Multivariate Normal Distribution In this chapter, we define the univariate and multivariate normal distribution density functions and then we discuss the tests of differences of means for multiple
More informationTopic 13. Analysis of Covariance (ANCOVA) [ST&D chapter 17] 13.1 Introduction Review of regression concepts
Topic 13. Analysis of Covariance (ANCOVA) [ST&D chapter 17] 13.1 Introduction The analysis of covariance (ANCOVA) is a technique that is occasionally useful for improving the precision of an experiment.
More informationComparisons of Several Multivariate Populations
Comparisons of Several Multivariate Populations Edps/Soc 584, Psych 594 Carolyn J Anderson Department of Educational Psychology I L L I N O I S university of illinois at urbana-champaign c Board of Trustees,
More informationSMA 6304 / MIT / MIT Manufacturing Systems. Lecture 10: Data and Regression Analysis. Lecturer: Prof. Duane S. Boning
SMA 6304 / MIT 2.853 / MIT 2.854 Manufacturing Systems Lecture 10: Data and Regression Analysis Lecturer: Prof. Duane S. Boning 1 Agenda 1. Comparison of Treatments (One Variable) Analysis of Variance
More informationY (Nominal/Categorical) 1. Metric (interval/ratio) data for 2+ IVs, and categorical (nominal) data for a single DV
1 Neuendorf Discriminant Analysis The Model X1 X2 X3 X4 DF2 DF3 DF1 Y (Nominal/Categorical) Assumptions: 1. Metric (interval/ratio) data for 2+ IVs, and categorical (nominal) data for a single DV 2. Linearity--in
More informationAnalysis of Covariance (ANCOVA) Lecture Notes
1 Analysis of Covariance (ANCOVA) Lecture Notes Overview: In experimental methods, a central tenet of establishing significant relationships has to do with the notion of random assignment. Random assignment
More informationCHAPTER-V GENOTYPE-ENVIRONMENT INTERACTION: ANALYSIS FOR NEIGHBOUR EFFECTS
CHAPTER-V GENOTYPE-ENVIRONMENT INTERACTION: ANALYSIS FOR NEIGHBOUR EFFECTS 5.1 Introduction Designs of experiments deal with planning, conducting, analyzing and interpreting tests to evaluate the factors
More informationChapter 5: Multivariate Analysis and Repeated Measures
Chapter 5: Multivariate Analysis and Repeated Measures Multivariate -- More than one dependent variable at once. Why do it? Primarily because if you do parallel analyses on lots of outcome measures, the
More informationThe legacy of Sir Ronald A. Fisher. Fisher s three fundamental principles: local control, replication, and randomization.
1 Chapter 1: Research Design Principles The legacy of Sir Ronald A. Fisher. Fisher s three fundamental principles: local control, replication, and randomization. 2 Chapter 2: Completely Randomized Design
More informationOn MANOVA using STATA, SAS & R
On MANOVA using STATA, SAS & R Department of Internal Medicine Division of Epidemiology, Biostatistics, & Preventive Medicine University of New Mexico Health Sciences Center July 13, 2015 On MANOVA (Department
More informationz = β βσβ Statistical Analysis of MV Data Example : µ=0 (Σ known) consider Y = β X~ N 1 (β µ, β Σβ) test statistic for H 0β is
Example X~N p (µ,σ); H 0 : µ=0 (Σ known) consider Y = β X~ N 1 (β µ, β Σβ) H 0β : β µ = 0 test statistic for H 0β is y z = β βσβ /n And reject H 0β if z β > c [suitable critical value] 301 Reject H 0 if
More informationUV Absorbance by Fish Slime
Data Set 1: UV Absorbance by Fish Slime Statistical Setting This handout describes a repeated-measures ANOVA, with two crossed amongsubjects factors and repeated-measures on a third (within-subjects) factor.
More informationOne-Way ANOVA. Some examples of when ANOVA would be appropriate include:
One-Way ANOVA 1. Purpose Analysis of variance (ANOVA) is used when one wishes to determine whether two or more groups (e.g., classes A, B, and C) differ on some outcome of interest (e.g., an achievement
More informationTopic 17 - Single Factor Analysis of Variance. Outline. One-way ANOVA. The Data / Notation. One way ANOVA Cell means model Factor effects model
Topic 17 - Single Factor Analysis of Variance - Fall 2013 One way ANOVA Cell means model Factor effects model Outline Topic 17 2 One-way ANOVA Response variable Y is continuous Explanatory variable is
More information20.0 Experimental Design
20.0 Experimental Design Answer Questions 1 Philosophy One-Way ANOVA Egg Sample Multiple Comparisons 20.1 Philosophy Experiments are often expensive and/or dangerous. One wants to use good techniques that
More informationA Power Analysis of Variable Deletion Within the MEWMA Control Chart Statistic
A Power Analysis of Variable Deletion Within the MEWMA Control Chart Statistic Jay R. Schaffer & Shawn VandenHul University of Northern Colorado McKee Greeley, CO 869 jay.schaffer@unco.edu gathen9@hotmail.com
More information