arxiv: v1 [math.st] 17 Feb 2018

Transcription

1 Tests about R multivariate simple linear models arxiv: v [mathst] 7 Feb 208 José A Díaz-García Universidad Autónoma de Chihuahua Facultad de Zootecnia y Ecología Periférico Francisco R Almada Km, Zootecnia Chihuahua, Chihuahua, México jadiaz@uachmx Oscar Alejro Martínez-Jaime Universidad de Guanajuato Departamento de Agronomía División Ciencias de la Vida, Campus Irapuato-Salamanca Ex-Hacienda El Copal, Km 9; carretera Irapuato-Silao Irapuato, Guanajuato, México oscarja@ugtomx Abstract Hypothesis about the parallelism of the regression lines in R multivariate simple linear models are studied in this paper Tests on common intercept sets of lines intersected at a fixed value, are also developed An application in an agricultural entomology context is provided Introduction There a number of research studies involving the behavior of a dependent variable Y as a function of one independent variable X Sometimes the experiment accepts a simple linear model usually this model is proposed for different experimental or observational situations Then the following situations can emerge: the simple linear models have the same intercept; or these lines are parallel; or given a particular value of the independent variable X, say x 0, the lines are intersected in such value We illustrate these situations through the following examples: Example Several diets are used to feed goats in order to determine the effect for losing or gaining weight Three goat breeds are used, for each breed the relationship between the gain or loss of weight in pounds per goat Y the amount of diet in pounds ingested for each goat X is given by y j = α +β x j +ǫ j y 2k = α 2 +β 2 x 2k +ǫ 2k y 3r = α 3 +β 3 x 3r +ǫ 3r, Corresponding author Key words Matrix multivariate elliptical distributions, multivariate linear model, likelihood ratio test, union-intersection criterion 2000 Mathematical Subject Classification 62J05; 62H5; 62H0

2 j =,2,,n, k =,2,,n 2, r =,2,,n 3, n s 2, s =,2,3 The investigator claims for a parallelism of the lines, that is, if β = β 2 = β 3 (if the increase in the average weight of each goat per unit of diet is the same for all breeds Or the researcher can ask for equality in the intercepts, that is, if α = α 2 = α 3 (if the average weight of each goat breed is the same when all breeds are fed with the same diet Example 2 An essay is carried out to study the relationship of the age X the cholesterolcontentinbloody ofindividualsbetween4055yearsofage Inthissituation, a simple linear model is assumed, but in the essay is considered female male individuals, then, it is proposed that a model for each sex is more appropriate The models are y j = α +β x j +ǫ j, for famales, y 2k = α 2 +β 2 x 2k +ǫ 2k, for males; j =,2,,n, k =,2,,n 2, n s 2, s =,2 The investigator wants to know if α +β x 0 = α 2 +β 2 x 0 (if at age x 0 the cholesterol content in blood is the same for female male individuals However, more realistic situations ask for the behavior of more than one dependent variable y = (y,,y R as a function of an independent variable X In the statistical modeling of such situations, the multivariate simple linear model appears as an interesting alternative In a wider context, the research can ask the same preceding hypothesis about the parallelism of a set of lines, or the same intercept, or a common given intersection point Some preliminary results about matrix algebra, matrix multivariate distributions general multivariate linear model are showed, see Section 2 By using likelihood rate union-intersection principles, Section 3 derive the multivariate statistics versions for the above mentioned hypotheses: same intercept, parallelism intersection in a known point Also, these results are extended to the elliptical case when the x s are fixed or rom Section 4 applies the developed theory in the context of agricultural entomology 2 Preliminary results A detailed discussion of the univariate linear model related topics may be found in Graybill (976 Draper Smith (98 for the multivariate linear model see Rencher (995 Seber (984, among many others For completeness, we shall introduce some notations, although in general we adhere to stard notation forms 2 Notation, matrix algebra matrix multivariate distribution For our purposes: if A R n m denotes a matrix, this is, A have n rows m columns, then A R m n denotes its transpose matrix, if A R n n has an inverse, it shall be denoted by A R n n An identity matrix shall be denoted by I R n n, to specified the size of the identity, we will use I n A null matrix shall be denoted as 0 R n m A vector of ones shall be denoted by R n For all matrix A R n m exist A R m n which is termed Moore-Penrose inverse Similarly given A R n m exist A c R m n such that AA c A = A, A c is termed conditional inverse It is said A R n n is symmetric matrix if A = A if all their eigenvalues are positive the matrix A is said to be positive definite, which shall be denoted as A > 0 If A R n m is writing in terms of its m columns, A = (A,A 2,,A m, A j R n, j =,2,m, vec(a R nm denotes the vectorization of A, moreover, vec (A = (vec(a = (A,A 2,,A m Let A R r s 2

3 B R n m, then A B R sn rm denotes its Kronecker product Given a null matrix A R n n with diagonal elements a ii 0 for at least one i, this shall be denoted by A = diag(a,a 22,,a nn Given a R n, a vector, its Euclidean norm shall be defined as a = a a = a 2 +a a2 n IfarommatrixY R n m hasamatrixmultivariatenormaldistribution with matrix mean E(X = µ R n m covariance matrix Cov(vecY = Θ Σ, Θ = Θ R n n Σ = Σ R m m this fact shall be denoted as Y N n m (µ,θ Σ Observe that, if A R n r, B R m s C R r s matrices of constants, A YB+C N r s (A µb +C,A ΘA B ΣB ( Finally, consider that Y N n m (µ,θ Σ then the rom matrix V = Y Θ Y has a noncentral Wishart distribution with n degrees of freedom non-centrality parameter matrix Ω = Σ µ Θ µ/2 This fact shall be denoted as V W m (n,σ,ω Observe that if µ = 0, then Ω = 0, V is said to have a central Wishart distribution W m (n,σ,0 W m (n,σ, see Srivastava Khatri (979 Muirhead ( General multivariate linear model Consider the general multivariate linear model Y = Xβ +ǫ (2 where: Y R n q is the matrix of the observed values; β R p q is the parameter matrix; X R n p is the design matrix or the regression matrix of rank r p n > p + q; ǫ R n q istheerrormatrixwhichhasamatrixmultivariatenormaldistribution, specifically ǫ N n q (0,I n Σ, see Muirhead (2005, p430 Σ R q q, Σ > 0 For this model, we want to test the hypothesis H 0 : CβM = 0 versus H a : CβM 0 (3 where C R νh p of rank ν H r M R q g of rank g q As in the univariate case, the matrix C concerns to the hypothesis among the elements of the parameter matrix columns, while the matrix M allows hypothesis among the different response parameters The matrix M plays a role in profile analysis, for example; in ordinary hypothesis testing it assumes the identity matrix, namely, M = I p Let S H be the matrix of sums of squares sums of products due to the hypothesis let S E be the matrix of sums of squares sums of products due to the error These are defined as S H = (C βm (C(X X c C (C βm = M Y (I n XX c (4 YM, S E respectively; where β = X c Y Note that, under the null hypothesis, S H has a g-dimensional noncentral Wishart distribution with ν H degrees of freedom parameter matrix M ΣM ie S H W g (ν H,M ΣM; similarly S E has a g-dimensional Wishart distribution with ν E degrees of freedom parameter matrix M ΣM, ie S E W g (ν E,M ΣM; specifically, ν H ν E denote the degrees of freedom of the hypothesis the error, respectively All the results given below are true for M I q, just compute S H S E from (4 replace q by g Now, let λ,,λ s be the s = min(ν H,g non null eigenvalues of the matrix S H S E such that 0 < λ s < < λ < let θ,,θ s be the s non null eigenvalues of the matrix S H (S H + S E with 0 < θ s < < θ < ; here we note λ i = θ i /( θ i θ i = λ i /(+λ i, i =,,s Various authors have proposed a number of different criteria for testing the hypothesis (3 But it is known, that all the tests can be expressed in terms 3

4 of the eigenvalues λ s or θ s, see for example Kres (983 The likelihood ratio test statistics termed Wilks s Λ, given next, is one of such statistic The likelihood ratio test of size α of H 0 : CβM = 0 against H a : CβM 0 reject if Λ Λ α,q,νh,ν E, where Λ = S E s S E +S H = i= s (+λ i = i= ( θ i (5 Exact critical values of Λ α,q,νh,ν E can be found in Rencher (995, Table A9 or Kres (983, Table 3 Test about R multivariate simple linear models Consider the following R multivariate simple linear models Y r = X r B r +ǫ r (6 Y r R nr q, X r R nr 2 such that its rank is 2; B r R 2 q, n r > 2 n r > q +2 for all r =,2,,R; R r= n r = N ǫ r N nr q(0,i nr Σ, with Σ > 0; where B r = ( ( αr α r2 α rq α = r β r β r2 β rq β r We are interested in the following hypotheses, X r = i H 0 : β = β 2 = = β R, that is, the set of lines are parallel; x r x r2 = ( n r x r x rnr ii H 0 : α = α 2 = = α R, that is, the set of lines have a common vector intercept; iii H 0 : α +β x 0 = α 2 +β 2 x 0 = = α R +β R x 0, (x 0 known, that is, the set of lines intersect at the x value x 0 which is specified in advance First observe that the R multivariate simple linear models can be written as a general multivariate linear model, Y = XB+E, such that Y X 0 0 B E Y 2 Y = N q, X 0 X 2 0 = N 2R, B B 2 = 2R q, E E 2 = N q Y R 0 0 X R B R E R Namely, E N N q (0,I NR Σ Thus X X 0 0 X 0 X 2X 2 0 X =, X Y = 0 0 X R X R X Y X 2Y 2 X R Y R, by Graybill (976, Theorem 3, p 9 (X X 0 0 (X X 0 (X 2 = X (X R X R 4

5 Therefore by Muirhead (2005, Theorem 0, p 430, see also Rencher (995, equation 046, p 339, (X X 0 0 X B = (X X X 0 (X 2X 2 0 Y X 2Y 2 Y = 0 0 (X R X R X R Y R (X X X Y X (X 2X 2 X Y 2Y 2 = = X 2 Y 2, (X R X R X R Y R X R Y R that is, B r = (X r X r X r Y r = X r Y r S E = (Y B X Y (Y B X Y = = R r= R R Y r Y r B rx ry r r= r= Y r ( Inr X r X r Yr R q q (7 Hence by Muirhead (2005, Theorem 02, p 43 Srivastava Khatri (979, equation 638, p 7 we have that B N 2R q (B,(X X Σ Note that B B 2 ( ( B r = 0 B = 0 I2 r 0R I2 r 0R thus, Br N 2 q (B r,(x r X r Σ S E W q (N 2R,Σ Observe that B r is computed from the data for the rth model S E is computed by pooling the estimators of S E from each model S Er Generalising the results in Graybill (976, Example 62, pp using matrix notation in the multivariate case, we have B r = ( α r β r = B R, (Ȳr β r x r ( ( Y r Inr nr n r /n r xr (, I nr nr n r /n r xr 2 where Ȳr = Y r n r /n r x r = x r n r /n r, r =,2,,R And where R S E = S Er, r= S Er = Y r ( Inr nr n r /n r Yr ( ( Y r Inr nr n r /n r xr x r Inr nr n r /n r Yr ( I nr nr n r /n r xr 2 5

6 Theorem 3 Given the R multivariate simple linear models (6 known constants a b, the likelihood ratio test of size α of H 0 : aα +bβ = aα 2 +bβ 2 = = aα R +bβ R versus is given by Where H : at least ane equality is an inequality, Λ = S E S E +S H (8 S E = S H = R Y r (I n r X r X r Y r, (9 r= ( ( D /2 Z I R D /2 R R D/2 / R D R ( D /2 Z, (0 where D = diag(d,d 22,,d RR, d rr = n r ( I nr nr n r /n r xr 2 (ax r b nr 2 Z = a α α 2 +b β β 2 RR q α R β R We reject H 0 if where ν H = (R, ν E = N 2R Λ Λ α,,νh,ν E, Proof This theorem is a special case of the results obtained for testing the hypotheses (3 it can be proved by selecting the proper C M matrices into Equation (4 Alternatively we extend the proof in Graybill(976, Theorem 86, p 288 for an univariate case into the multivariate case The result follows from (5, we just need to define explicit matrices of sums of squares products S E S H First define the rom vectors z r = a α r + b β r, r =,2,,R, where a b are known constants to be define later Hence, given that B r N 2 q (B r,(x r X r Σ, we have E(z r = E (a α r +b β r = aα r +bβ r In our case taking, M = I q a b a b a b a b C = a b a b into to Equation 4, the desired result is obtained RR 2R, 6

7 Also note that, z r = B r ( a b = a α r +b β r, thus ( ( Cov(z r = Cov(z r = Cov vec B a r b (( ( a = Cov I b q vec B r ( (( = ((a,b I q (X r X r a Σ b ( = (a,b(x rx r a Σ b I q With d rr = d rr Σ = d rr Σ = (a,b(x rx r ( a b ( ( nr = (a, b 2 nrx r a x r nr x r 2 b = = n r ( I nr nr n r /n r xr 2(a,b (ax r b nr 2 n r ( I nr nr n r /n r xr 2, ( xr 2 nr x r x r nr n r ( a b Therefore ( z r = a α r +b β r N q aαr +bβ r,d rr Σ Now, consider the rom matrix Z defined by Thus Z = z z 2 z R = a E(Z = a α α 2 α R α α 2 α R +b +b β β 2 β R β β 2 β R RR q Cov(vecZ = Cov((z,z 2,z R = D Σ, where D = diag(d,d 22,,d RR Thus α Z N R q a α 2 +b α R β β 2 β R,D Σ, 7

8 furthermore D /2 Z N R q D/2 a α α 2 +b β β 2,I R Σ α R β R Considertheconstantmatrix ( I R D /2 R R D/2 / R D R, whichissymmetricidempotent Then S H = ( ( ( D /2 Z I R D /2 R R D/2 / R D R D /2 Z, moreover, S H has a Wishart distribution is independently distributed of S E (see Equation (7, where S H W q (R,Σ,Ω S E W q (N 2R,Σ; in addition, Ω = ( ( 2 Σ ( D /2 E(Z I R D /2 R R D/2 / R D R D /2 E(Z observe that Ω = 0 if an only if aα +bβ = aα 2 +bβ 2 = = aα R +bβ R Which is the desired result As we mentioned before, different test statistics have been proposed for verifying the hypothesis (3 Next we propose three of them in our particular case Theorem 32 Given the R multivariate simple linear models (6 known constants a b, the union-intersection test, Pillai test Lawley-Hotelling test of size α of versus are given respectively by H 0 : aα +bβ = aα 2 +bβ 2 = = aα R +bβ R H : at least ane equality is an inequality, θ = λ +λ ( ( which is termed Roy s largest root test Where λ is the maximum eigenvalue of SH S E, where SH S E are given by (0 (9, respectively We reject H 0 if θ θ α,s,m,h Exact critical values of θ α,s,m,h are found in Rencher (995, Table A0 or Kres (983, Tables 2, This way we reject H 0 if V (s = tr[s H (S E +S H ] = where the exact critical values of V (s Kres (983, Table 7 s i= V (s V (s α,s,m,h, α,s,m,h λ i +λ i = s θ i (2 i= are found in Rencher (995, Table A or 8

9 3 We reject H 0 if s U (s = tr[s H S E ] = λ i = i= U (s U (s α,s,m,h s i= θ i θ i (3 The upper percentage points, U (s α,s,m,h, are given in Kres (983, Table 6 The parameters s, m h are defined as s = min(,ν H, m = ( ν H /2, h = (ν E 2/2 where ν H = (R, ν E = N 2R N = R r= n r As a special case of Theorem 3 ( Theorem 32, we obtain the test of the hypotheses i, ii iii established above Theorem 33 Consider the R multivariate simple linear models (6 The likelihood ratio test of size α of tests of hypotheses i, ii iii are given as follows: The test of H 0 vs H is this: Reject H 0 if only if where Λ = S E S E +S H Λ α,,ν H,ν E, S E = S H = R Y r (I n r X r X r Y r, (4 r= ( ( D /2 Z (I R D /2 R RD /2 / RD R D /2 Z, (5 i With H 0 : α = α 2 = = α R (R set of lines with the same vector intercept vs H : α i = α j for at least one i j, i,j =,2,,R Where D = diag(d,d 22,,d RR, d rr = n r ( I nr nr n r /n r xr 2 x r 2 Z = α α 2 RR q α R ii H 0 : β = β 2 = = β R (R set of lines are parallel vs H : β i = β j for at least one i j, i,j =,2,,R With D = diag(d,d 22,,d RR, d rr = ( I nr nr n r /n r xr 2 Z = β β 2 RR q β R 9

10 iii H 0 : α +β x 0 = α 2 +β 2 x 0 = = α R +β R x 0 (all R set of lines intersect at x = x 0, known vs H at least one equality is an inequality (all R set of lines do not intersect at x = x 0 Where D = diag(d,d 22,,d RR, d rr = n r ( I nr nr n r /n r xr 2 (x r x 0 nr 2 Z = α + β x 0 α 2 + β 2x 0 RR q α R + β Rx 0 Where ν H = (R, ν E = N 2R Proof This is a simple consequence of Theorem 3 To test that a set of R lines have the same vector intercept, take a = b = 0; to test whether set of R lines are parallel, we set a = 0 b =, to test that a set of R lines intersect at x = x 0, we set a = b = x 0 3 Test about R multivariate simple linear model under matrix multivariate elliptical model In order to consider phenomena experiments under more flexible robust conditions than the usual normality, various works have appeared in the statistical literature since the 80 s Those efforts has been collected in various books papers which are consolidated in the so termed generalised multivariate analysis or multivariate statistics analysis under elliptically contoured distributions, see Gupta Varga (993 y Fang Zhang (990, among other authors These new techniques generalize the classical matrix multivariate normal distribution by a robust family of matrix multivariate distributions with elliptical contours Recall that Y R n m has a matrix multivariate elliptically contoured distribution if its density with respect to the Lebesgue measure is given by: df Y (Y = Σ n/2 Θ m/2h{ tr [ (Y µ Θ (Y µσ ]} (dy, where µ R n m, Σ R m m, Θ R n n, Σ > 0 Θ > 0 (dy is the Lebesgue measure The function h : R [0, is termed the generator function satisfies 0 u mn h(u 2 du < Such a distribution is denoted by Y E n m (µ,θ Σ,h, Gupta Varga (993 Observe that this class of matrix multivariate distributions includes normal, contaminated normal, Pearson type II VI, Kotz, logistic, power exponential, so on; these distributions have tails that are weighted more or less, /or they have greater or smaller degree of kurtosis than the normal distribution Among other properties of this family of distributions, the invariance of some test statistics under this family of distributions sts out, that is, some test statistics have the same distribution under normality as under the whole family of elliptically contoured distributions, see theorems of Gupta Varga (993, pp Therefore, the distributions of Wilks, Roy, Lawley-Hotelling Pillai test statistics are invariant under the whole family of elliptically contoured distributions, see Gupta Varga (993, pp

11 Finally, note that, in multivariate linear model, it was assumed that the x s were fixed However, in many applications, the x s are rom variables Then, as in the normal case, see Rencher (995, Section 08, p 358, if we assume that (y,y 2,,y q,x has a multivariate elliptically contoured distribution, then all estimations tests have the same formulation as in the fixed-x, case Thus there is no essential difference in our procedures between the fixed-x case the rom-x case 4 Application The rosebush (Rosa sp L is the ornamental species of major importance in the State of Mexico, Mexico, being the red spider (Tetranychus urticae Koch (Acari: Tetranychidae its main entomological problem, the control has been based almost exclusively using acaricide, which has caused this plague to acquire resistance in a short time In order to counteract this problem in part, an experiment was carried out using the variety of red petals Vega in two greenhouses located in the Ejido 2 Los Morales, in Tenancingo, State of Mexico, Mexico, from October 2008 to August 2009 In a greenhouse, chemical control was applied exclusively, while in the other, combined control (chemical biological was used, where applications of acaricide were reduced releases of two predatory mites were made: Phytoseiulus persimilis Athias-Henriot Neoseiulus californicus McGregor (Acari: Phytoseiidae The red spider infestations decrease the length of the stem (Y the size of the floral button (Y 2, preponderant characteristics so that the final product reaches the best commercial value, so that a total of 5 stems were measured romly weekly from each greenhouse, their respective floral button, to quantify their length diameter in centimeters, respectively, for a total of 5 weeks (X, see Preciado-Ramírez (204 The measurements of the variables were carried out from January to April 2009 the application of the treatments was initiated in week 44 of 2008 The investigator considers 3 that a multivariate simple linear model for the results of each greenhouse is the appropriate model to relate the two dependent variables Y Y 2 in terms of the independent variable X The corresponding multivariate simple linear models are Y r = X r β r +ǫ r, r =,2 ǫ r E nr 2(0,I nr Σ, Σ R 2 2, Σ > 0, with n = 5, n 2 = 5 ( ( αr α β r = r2 α = r β r β r2 β r The researcher ask for the following hypotheses testing i H 0 : β = β 2, that is, the set of lines are parallel (if the average stem length the average floral button diameter of each sample of roses per week are the same under the two methods of pest control; ii H 02 : α = α 2, that is, the set of lines have a common vector intercept (if the average stem length the average floral button diameter of each sample roses in week zero are the same under the two methods of pest control The results of the experiment are presented in the next Table 2 A piece of l farmed communally, pasture l, other uncultivated ls, the fundo legal, or town site, under a system supported by the state 3 In the original work, the analysis was made based on univariate statistical techniques only

12 Table : Experimental results of length of the stem (cms the diameter of the floral button (cms of Vega rose variety Biological control Chemical control X Y Y 2 X Y Y Thus the matrices β, β 2 S E are given by ( ( β =, β = Moreover, S E = i from Theorem 33 ii we have S H = ( ( , Table 2: Four criteria to proof H 0 : β = β 2 Criteria Statistic α Critical value Wilks a Roy Pillai Lawley-Hotelling b a Remember that for this tests, the decision rule is: statistics critical value b Using an F approximation, see equation (626 in Rencher (995, p66, 995 Thus, from Table 2, there is no doubt that the four criterions reject the null hypothesis H 0 : β = β 2 for α = 005 2

13 ii Similarly, from Theorem 33i, the matrix S H is given by ( S H = Table 3: Four criteria to proof H 02 : α = α 2 Criteria Statistic α Critical value Wilks a Roy Pillai Lawley-Hotelling b a Remember that for this tests, the decision rule is: statistics critical value b Using an F approximation, see equation (626 in Rencher (995, p66, 995 From Table 3 we can conclude that under the four criterions of test the hypothesis H 02 : α = α 2 is rejected for a level of significance of α = 005 cms Biological control Chemical control cms Biological control Chemical control Weeks Weeks (a Length of the stem (b Diameter of the floral button Figure : Observations adjusted values Given that R = 2, we can easily check graphically the conclusions reached in the hypothesis testing Figure (b shows the intersection of lines for the floral button diameters, which explains the rejection of parallelism hypothesis However, Figure (a shows parallel lines, which certainly implies that the average length of stem for each sample per week is the same for both pest control Similarly, Figure (a depicts very different intercepts associated to the length of the stem, explaining the rejecting of the hypothesis for equal intercepts Also, Figure (b shows equal intercepts, which implies that the average floral button diameter for each sample in week zero is the same for both pest control The thesis Preciado-Ramírez(204 concludes that the biological control method reduces infestation of the pest as a consequence both the stem length the button size are increased This aspect promotes a higher sale price, but this result was not incorporated in the addressed work Our analysis confirms these conclusions, but in a robust way that include all the variables simultaneously 3

14 5 Conclusions As a consequence of Subsection 3 the three hypotheses testing of this paper are valid under the complete family of elliptically contoured distribution, ie in any practical circumstance we can assume that our information have a matrix multivariate elliptically contoured distribution instead of considering the usual non realistic normality References N R Draper H Smith, Applied regression analysis, 2nd edition Wiley, New York, 98 K T Fang Y T Zhang, Generalized Multivariate Analysis, Science Press, Springer- Verlag, Beijing, 990 F A Graybill, Theory Application of the Linear Model, Wadsworth & Brooks/Cole, Advances Books Softwere, Pacific Grove, California, 976 A K Gupta T Varga, Elliptically Contoured Models in Statistics, Kluwer Academic Publishers, Dordrecht, 993 H Kres, Statistical Tables for Multivariate Analysis, Springer-Verlag, New York, 983 D F Morrison, Multivariate Sattistical Methods, 4th Revision Edition Duxbury Advances Series, London, 2003 R J Muirhead, Aspects of Multivariate Statistical Theory, John Wiley & Sons, New York, 2005 M R Preciado-Ramírez, Validation of Phytoseiulus persimilis Athias-Henriot Neoseiulus californicus for control of Tetranychus urticae Koch in the cultivation of roses in greenhouses Thesis of Agronomical Engineering University of Guanajuato Irapuato, Guanajuato, Mexico, 204 (In Spanish S J Press, Applied Multivariate Analysis: Using Bayesian Frequentist Methods of Inference, Second Edition, Robert E Krieger Publishing Company, Malabar, FL, 982 A C Rencher, Methods of Multivariate Analysis, John Wiley & Sons, New York, 995 S N Roy, Some Aspect of Multivariate Analysis, John Wiley & Sons, New York, 957 G A F Seber, Multivariate Observations John Wiley & Sons, New York, 984 M S Srivastava, C G Khatri, An Introduction to Multivariate Analysis North-Holl Publ, Amsterdam, 979 4