On the Power Function of the Likelihood Ratio Test for MANOVA

Similar documents
Journal of Multivariate Analysis

Supplementary Material: Learning Structured Weight Uncertainty in Bayesian Neural Networks

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

First Year Examination Department of Statistics, University of Florida

Nested case-control and case-cohort studies

Strong Markov property: Same assertion holds for stopping times τ.

ON AUTOMATIC CONTINUITY OF DERIVATIONS FOR BANACH ALGEBRAS WITH INVOLUTION

Integral Formula of Minkowski Type and New Characterization of the Wulff Shape

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

COXREG. Estimation (1)

Optimum Selection Combining for M-QAM on Fading Channels

Interference Alignment and Degrees of Freedom Region of Cellular Sigma Channel

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

A note on almost sure behavior of randomly weighted sums of φ-mixing random variables with φ-mixing weights

Randić Energy and Randić Estrada Index of a Graph

G : Statistical Mechanics

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

D hh ν. Four-body charm semileptonic decay. Jim Wiss University of Illinois

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

QUARTERLY OF APPLIED MATHEMATICS

Convexity preserving interpolation by splines of arbitrary degree

Math1110 (Spring 2009) Prelim 3 - Solutions

A Unified Elementary Approach to the Dyson, Morris, Aomoto, and Forrester Constant Term Identities

Xin Li Department of Information Systems, College of Business, City University of Hong Kong, Hong Kong, CHINA

Note 2. Ling fong Li. 1 Klein Gordon Equation Probablity interpretation Solutions to Klein-Gordon Equation... 2

Goodness of fit and Wilks theorem

LOW-DENSITY Parity-Check (LDPC) codes have received

The Jacobsthal and Jacobsthal-Lucas Numbers via Square Roots of Matrices

Ph 219a/CS 219a. Exercises Due: Wednesday 23 October 2013

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Computing MLE Bias Empirically

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

The line method combined with spectral chebyshev for space-time fractional diffusion equation

The lower and upper bounds on Perron root of nonnegative irreducible matrices

Analysis of Bipartite Graph Codes on the Binary Erasure Channel

A finite difference method for heat equation in the unbounded domain

KMT theory applied to approximations of SDE

Randomness and Computation

Composite Hypotheses testing

The Order Relation and Trace Inequalities for. Hermitian Operators

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A Note on Test of Homogeneity Against Umbrella Scale Alternative Based on U-Statistics

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

Monica Purcaru and Nicoleta Aldea. Abstract

A DIMENSION-REDUCTION METHOD FOR STOCHASTIC ANALYSIS SECOND-MOMENT ANALYSIS

Test for Intraclass Correlation Coefficient under Unequal Family Sizes

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

arxiv: v1 [cs.gt] 28 Mar 2017

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of

Research Article H Estimates for Discrete-Time Markovian Jump Linear Systems

A Note on Bound for Jensen-Shannon Divergence by Jeffreys

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

A Hybrid Variational Iteration Method for Blasius Equation

3. Stress-strain relationships of a composite layer

MATH 281A: Homework #6

Problem Set 9 Solutions

Y. Guo. A. Liu, T. Liu, Q. Ma UDC

DIOPHANTINE EQUATIONS WITH BINOMIAL COEFFICIENTS AND PERTURBATIONS OF SYMMETRIC BOOLEAN FUNCTIONS

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Research on Complex Networks Control Based on Fuzzy Integral Sliding Theory

Perron Vectors of an Irreducible Nonnegative Interval Matrix

Continuous Time Markov Chain

EXPANSIVE MAPPINGS. by W. R. Utz

Lower bounds for the Crossing Number of the Cartesian Product of a Vertex-transitive Graph with a Cycle

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Multispectral Remote Sensing Image Classification Algorithm Based on Rough Set Theory

However, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values

Note On Some Identities of New Combinatorial Integers

Estimation: Part 2. Chapter GREG estimation

A nonparametric two-sample wald test of equality of variances

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

Lecture 6/7 (February 10/12, 2014) DIRAC EQUATION. The non-relativistic Schrödinger equation was obtained by noting that the Hamiltonian 2

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

Chapter 12 Analysis of Covariance

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Chapter 6. Rotations and Tensors

Appendix for An Efficient Ascending-Bid Auction for Multiple Objects: Comment For Online Publication

An (almost) unbiased estimator for the S-Gini index

Norm Bounds for a Transformed Activity Level. Vector in Sraffian Systems: A Dual Exercise

corresponding to those of Heegaard diagrams by the band moves

Lecture 12: Discrete Laplacian

On Finite Rank Perturbation of Diagonalizable Operators

Tail Dependence Comparison of Survival Marshall-Olkin Copulas

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

A generalization of Picard-Lindelof theorem/ the method of characteristics to systems of PDE

Discrete Mathematics

Lecture Notes on Linear Regression

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9

The Geometry of Logit and Probit

Lecture 6 More on Complete Randomized Block Design (RBD)

A particle in a state of uniform motion remain in that state of motion unless acted upon by external force.

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Signal Processing 142 (2018) Contents lists available at ScienceDirect. Signal Processing. journal homepage:

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

Supplementary material: Margin based PU Learning. Matrix Concentration Inequalities

MLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012

Neural network-based athletics performance prediction optimization model applied research

Transcription:

Journa of Mutvarate Anayss 8, 416 41 (00) do:10.1006/jmva.001.036 On the Power Functon of the Lkehood Rato Test for MANOVA Dua Kumar Bhaumk Unversty of South Aabama and Unversty of Inos at Chcago and Sanat K. Sarkar Tempe Unversty Receved October 7, 1999; pubshed onne January 11, 00 We prove that the power functon of the kehood rato test for MANOVA attans ts mnmum when the rank of the ocaton parameter matrx G decreases from s to 1. Ths provdes a theoretca justfcaton of a resut that s known n the terature based ony on numerca studes. 00 Esever Scence AMS 1980 subject cassfcatons: 6H10; 6H15. Key words and phrases: Wshart dstrbuton; maxma nvarant; zona poynoma; product of beta varates. 0047-59X/0 $35.00 00 Esever Scence A rghts reserved. 1. INTRODUCTION Suppose X: r p s a random matrx whose rows are ndependenty dstrbuted as mutvarate norma wth common covarance matrx S:p p, and et E(X)=G. Let the random matrx S: p p be ndependent of X and have the Wshart dstrbuton W p (S,n), where S s postve defnte and n \ p. Consder the probem of testng the hypothess H 0 : G=O aganst H 1 : G ] O. (1) Ths s the canonca form of the MANOVA probem. Ths testng probem remans nvarant under a transformatons of the type (X, S) Q (CXPŒ, PSPŒ), () where C:r r s an orthogona matrx, and P: p p s a nonsnguar rea matrx. Let a \ a \ \ a t >0 be the ordered t=mn(r, p) argest egenvaues of XS 1 XŒ and d 1 \ d \ d s >0 be those of W=GS 1 GŒ, 416

LIKELIHOOD RATIO TEST FOR MANOVA 417 where s=rank G. A maxma nvarant statstc under ths group of transformatons s (a 1,a,...,a t ), wth (d 1, d,...,d s ) beng a maxma nvarant parameter. The four we-known tests for the above testng probem wth ther acceptance regons are gven beow. 1. Roy s maxmum root test:. Lawey Hoteng trace test: t K =3 (X, S): C K 1 ={(X, S): a 1 [ k 1 }, k 1 >0, a [ k 4,k >0, 3. Lkehood rato test (LRT): t K 3 =3 (X, S): D (1+a ) [ k 3 4,k3 >1, 4. Pa s trace test: t K 4 =3 (X, S): C a /(1+a ) [ k 4 4,0<k4 <1. A number of theoretca resuts expanng how the power functons of these four tests behave wth respect to the non-centraty parameters d 1,...,d s have been derved n the terature. Perman and Okn (1980) proved that any test wth ncreasng rejecton regon n the space of a 1,...,a t,.e., a regon of the form {g(a 1,...,a t ) \ k}, where g s nondecreasng n each argument, s unbased, from whch t foows that a of these four tests are unbased. Let the power functon of a test wth the acceptance regon K be defned as foows p K (D,r,n,p)=P G, S {(X, S) K c }, (3) where K c s the compement of K and D=dag(d 1,...,d s ). Das Gupta et a. (1964) proved that f K s convex n each row of X when S and the remanng rows of X are fxed and f t remans nvarant under a the transformatons defned n (), then the correspondng power functon s ncreasng n each component d,,...,s. Eaton and Perman (1974) notced that the acceptance regons K 1 of Roy s maxmum root test and K of the Lawey Hoteng trace test are convex n (X, S), and they reman nvarant under a the transformatons mentoned n (). Usng a resut of Mudhokar (1966), they proved that for an nvarant convex acceptance regon of ths type, the power functon s Schur-convex n ( `d 1,...,`d s ). Thus, for fxed ; s u=1 `d, the power functons of Roy s maxmum root

418 BHAUMIK AND SARKAR test and the Lawey Hoteng trace test ncrease as ( `d 1,...,`d s ) ncreases wth respect to the majorzaton parta orderng. The same monotoncty resut, however, cannot be estabshed for the kehood rato test or Pa s trace test usng the resut of Eaton and Perman (1974) as nether K 3 nor K 4 s a convex set n (X, S). Das Gupta and Perman (1973) proved that the power of the kehood rato test strcty decreases wth p and s. What s conjectured about these tests n the terature based on numerca studes (Fujkosh, 1970) s that for fxed trd=; s d ther power functons decrease as the rank of G decreases from s to 1. Ths artce provdes a parta theoretca support to ths conjecture for the kehood rato test. More specfcay, we prove theoretcay that the power functon of ths test, when ; s d s constant, attans ts mnmum when the rank of D s 1.. THE POWER FUNCTION OF THE LIKELIHOOD RATIO TEST Let us denote the kehood rato test statstc by U and the ower 100a % pont of the nu dstrbuton of U by U a (p,r,n). Let C o (D) denote the zona poynoma of D for the partton o=(k 1,...,k s ), k 1 \ \ k s \ 0, of the nteger k. Let Z s be mutuay ndependent random varabes, where,,...,s, Z = Beta5 n +1, r/+k 6 Beta5 n +1, r/6, =s+1,..., p. We denote the product < p Z by U p, o (r, n) and wrte U p, 0 (r, n) smpy as U p (r, n). Sarkar (1984) has proved that U E K U p, K (r, n), (4) where the expectaton s taken wth respect to K havng the foowng probabty mass functon at o P(o, D)=e C o(d/) trd/. (5) k! Let V s (r, n)=< s Z g, where condtonay gven K=o,Z g s are ndependenty dstrbuted as Beta[ n+r +1,k ],,..., s respectvey. It s assumed that Beta[n, 0]=1 wth probabty one. As defned before o=(k 1,k,...,k s ), where k 1 \ k \ k s \ 0, and k=; s k. If a the k s are not strcty postve then there exsts a postve nteger (1 [ <s),

LIKELIHOOD RATIO TEST FOR MANOVA 419 such that k 1 \ k \ \ k >0 and k +1 = =k s =0. From a property of the beta dstrbuton (Rao, 1973, p. 168), t foows that U V s (r, n) U p (r, n). (6) Now we w defne a sequence of random varabes Y g s from Z g s to construct a new random varabe V g wth the property that t s stochastcay arger than V s. To ths end, et us consder Y g Beta1 n+r +k +1, C j=1 k j,,,..., 1, (7) and then defne V g =Y g 1Z g,,...,, wth Y g 0 =1. In the foowng, the nequates between random varabes are referred to as stochastc nequates. Note that V g =Beta1 n+r +1, C k j j=1 k j [ Beta1 n+r +k +1, C =Y g,,..., 1. The second nequaty above hods from the fact that k +1 \ 1, = 1,,..., 1, and that a beta random varabe Beta(p, q) stochastcay ncreases wth p. Thus we have s V s =D Z g =D Z g j=1 [ Y g 1 D Z g =V g D Z g = =3 [ Y g D Z g =V g 3 D Z g =3 =4 [ [ V g. (8) In other words, we have V g n+r +1 Beta(, ; n+r +1 k )=Beta(,k) whch s stochastcay arger than V s (r, n). Aso note that V g s stochastcay smaer than V 1 Beta( n+r,k) as \ 1. Usng ; o C o (D)=(trD) k we

40 BHAUMIK AND SARKAR now see that the power functon, say p s (D), of the kehood rato test for MANOVA satsfes the foowng p s (D)=P(U [ U a (p,r,n)) =P(V s U p (r, n) [ U a (p,r,n)) \ P(V g U p (r, n) [ U a (p,r,n)) \ P(V 1 U p (r, n) [ U a (p,r,n)). = C k=0 C o e C o(d/) trd/ P(V k! 1 U p (r, n) [ U a (p,r,n)). trd/ (trd/)k = C e P(V k=0 k! 1 U p (r, n) [ U a (p,r,n)) =p 1 (trd). (9) Thus, the power functon of the kehood rato test for MANOVA, for fxed trd, attans ts mnmum at s=1. Ths proves our man resut. Remark 1. From a computatona pont of vew, the extreme rghthand sde of (9) s very usefu. It provdes a frst-hand approxmaton to the power functon of the kehood rato test for MANOVA whch, beng based on the Posson dstrbuton as opposed to the more compcated dstrbuton nvovng zona poynomas, coud be computed reatvey easy. It s mportant to pont out that n (9) we have ony proved that the power of the kehood rato test for MANOVA at D=(d 1,...,d s ) s more than that at D 0 =(trd,0,...,0). Athough D 0 majorzes D, the current resut cannot be generazed to make a cam that whenever any D s majorzed by D 0, the power of the kehood rato test for MANOVA at D s more than D 0, or n other words, the power functon s Schur-concave. Aso, the current technque does not work to study the smar property of the power functon of Pa s trace test. ACKNOWLEDGMENTS The authors are gratefu to two referees and an edtor for ther usefu comments and suggestons.

LIKELIHOOD RATIO TEST FOR MANOVA 41 REFERENCES 1. S. Das Gupta, T. W. Anderson, and G. S. Mudhokar, Monotoncty of the power functons of some tests of the mutvarate near hypothess, Ann. Math. Statst. 35 (1964), 00 05.. S. Das Gupta, and M. D. Perman, On the power of Wks U-test for MANOVA, J. Mutvarate Ana. 3 (1973), 0 5. 3. M. L. Eaton, and M. D. Perman, A monotoncty property of the power functons of some nvarant tests for MANOVA, Ann. Statst. 5 (1974), 10 108. 4. Y. Fujkosh, Asymptotc expansons of the dstrbutons of test statstcs n mutvarate statstcs, J. Sc. Hroshma Unv. Ser. A-I. 34 (1970), 73 144. 5. G. S. Mudhokar, The ntegra of an nvarant unmoda functon over an nvarant convex set- an nequaty an appcatons, Proc. Amer. Math. Soc. 17 (1966), 137 1333. 6. R. J. Murhead, Aspects of Mutvarate Statstca Theory, Wey, New York, 198. 7. M. D. Perman, and I. Okn, Unbasedness of nvarant tests for MANOVA and other mutvarate probems, Ann. Statst. 6 (1980), 136 1341. 8. C. R. Rao, Lnear Statstca Inference and Its Appcatons, second ed., Wey, New York, 1973. 9. S. K. Sarkar, A note on the power of the kehood rato test for MANOVA, Sankhya, Ser. A 46 (1984), 303 308.