arxiv: v3 [math.st] 2 Aug 2011

Transcription

1 O two simple tests for ormality with high power Mås Thuli First versio: August 3, 00. Updated: May 9, 08 arxiv: v3 [math.st] Aug 0 Abstract The test statistics of two powerful tests for ormality (Li & Mudholkar, 980; Mudholkar et al., 00) are estimators of the correlatio coefficiet betwee certai sample momets. We derive ew versios of the test statistics that are fuctios of the sample skewess ad sample kurtosis. This sheds some light o the ature of these tests ad leads to easier computatios. Itroductio The assumptio of ormality is the basis of may of the most commo statistical methods. Tests for ormality, used to assess the ormality assumptio, is therefore a widely studied field. Thode (00) provides a overview. Some popular tests for ormality are based o the sample skewess ad sample kurtosis, described i Sectio. below. Others use characterizatios of the ormal distributio. Oesuchwell-kowcharacterizatio isthatthesamplemea X adsamplevariace S are idepedet if ad oly if the uderlyig populatio is ormal. Similarly, X ad i= (X i X) 3 are idepedet if ad oly if X is ormal; see Kaga et al. (973), Sectios 4. ad 4.7. Li & Mudholkar (980) proposed a test based o the idepedece of X ad S. They oted that it is difficult to test the idepedece of X ad S but that the correlatio coefficiet betwee the two is possible to estimate. They used a jackkife procedure to estimate ρ( X,S ), ad used this for a test for ormality agaist asymmetric alteratives. The test has bee modified, geeralized ad discussed i Brow et al. (004), Mudholkar et al. (99) ad Wildig & Mudholkar (007). I Mudholkar et al. (00) a test based o the idepedece of X ad i= (X i X) 3 was proposed, costructed usig the same jackkife procedure. The authors amed the tests the Z test ad Z 3 test. I this paper we show that it is possible to replace the jackkife estimators used by Li ad Mudholkar ad Mudholkar et al. by estimators that are smooth fuctios of the sample skewess ad sample kurtosis. I Sectio we describe the Z ad Z 3 tests Departmet of Mathematics, Uppsala Uiversity, P.O.Box 480, Uppsala, Swede. Phoe: +46(0) ; Fax: +46(0)84730; thuli@math.uu.se

2 ad derive the ew estimators. I Sectio 3 we preset some simulatio results that idicate that the tests have very good power properties. Throughout the text we use the otatio µ k = E(X µ) k to deote cetral momets. The Z tests ad correlatio coefficiets. The Z ad Z 3 tests Li ad Mudholkar used the jackkife replicatios ( X i,s i ), where X i = j i X j, S i = j i (X j X i ), to study the depedece betwee X ad S. They applied the cube-root trasformatio Y i = (S i )/3 ad cocluded that the sample correlatio coefficiet r( X i,y i ) equals the sample correlatio coefficiet i= r = r(x i,y i ) = (X i X)(Y i Ȳ) i= (X i X). i= (Y i Ȳ) Fially, they used Fisher s z-trasform to obtai the test statistic Z = ( log +r ) r ad used this for their test for ormality. The test is sesitive to departures from ormality i the form of skewess. If the sig of the skewess of the alterative is kow, a oe-tailed test ca be used. If it is ukow, a two-tailed test is used. The latter will be refered to as the Z test. Mudholkar et al. (00) used the same jackkife approach to costruct aother test for ormality. This time they cosidered the mea X ad the third cetral sample momet ˆµ 3 = i= (X i X) 3. Lettig X i = j i X j, ˆµ 3, i = (X j X i ) 3 = Y i, they used the sample correlatio coefficiet i= r 3 = r(x i,y i ) = (X i X)Y i i= (X i X) i= (Y i Ȳ) i the same maer as i the above test, obtaiig the test statistic Z 3 = ( log +r3 ). r 3 The simulatio results i Mudholkar et al. (00) idicate that both tests have high power agaist some iterestig alteratives. j i

3 . Explicit expressios Next, wederiveexplicitexpressiosforthecorrelatio coefficiets ρ( X,S )adρ( X, ˆµ 3 ), which eables us to estimate the correlatio coefficiets usig sample momets. The estimators cosidered i the correlatios will be the ubiased estimators S ad ˆµ 3 = ( )( ) i= (X i X) 3. The formulae obtaied are somewhat easier to express usig stadardized cumulats. Let κ,κ,... deote the cumulats of X. The kth stadardized cumulat of X is κ k. We are particularly iterested i γ = κ 3 κ 3/ = µ 3 σ 3, κ = κ 4 κ = µ 4 σ 4 3, λ = κ 6 κ 3 = µ 6 σ 6 5κ 0γ 5. κ k/ γ is the skewess of X ad κ is the (excess) kurtosis of X. All cumulats are 0 for the ormal distributio. Lemma. Suppose that X,...,X are idepedet ad idetically distributed radom variables. Deote their mea µ, variace σ, skewess γ ad kurtosis κ. Let X = i= X i, S = i= (X i X) ad ˆµ 3 = ( )( ) i= (X i X) 3. The the followig results hold. (i) If EX 4 < ad, (ii) If EX 6 < ad 3, ρ = ρ( X,S ) = µ 3 σ 3 µ4 σ 3 4 = γ κ+3 3. () ρ 3 = ρ( X,ˆµ 3 ) = = µ 4 3σ 4 µ σ ( 5) µ 4 σ 6 ( 0) µ σ 4 3 ( ) + ( ) σ 6 ( )( ) κ λ+9 (κ+γ 6 )+ ( )( ), () where λ is the sixth stadardized cumulat of X. Proof. The proof amouts to calculatig the momets ivolved: (i) It is well-kow that var( X) = σ / ad from theresults of Sectio 7.4 of Cramér (946) it follows that ad that ( var(s ) = var (X i X) ) ) i= cov( X,S ) = µ 3 = µ 3. = µ 4 3 ( ) σ4 The result follows from the above momets ad the fact that µ 4 = σ 4 (κ+3). 3

4 (ii) From Fisher (930) we have var(ˆµ 3 ) = λσ6 + 9(κ+γ6 )σ 6 + 6σ 6 ( )( ). Furthermore, cov( X,ˆµ 3 ) = E(( X µ)ˆµ 3 ) E(( X µ)µ 3 ) = E(( X µ)ˆµ 3 ), but this expressio does ot deped o µ, so we ca study the case where µ = 0 without loss of geerality. The cov( X, ˆµ 3 ) = E( Xˆµ ( ( 3 ) = ( )( ) E X Xi 3 3 X Xi +3 X i i i ( = E( ( )( ) X Xi 3 ) 3E( X Xi )+E( X ) 4 ). i i X i X 3)) The three expectatios above are all foud i Sectios 7.4 ad 7.5 of Cramér (946). Isertig their values, routie calculatios give that the above expressios reduces to Thus ρ( X, ˆµ 3 ) = σ cov( X,ˆµ 3 ) = µ 4 3σ 4. µ 4 3σ 4 λσ6 + 9(κ+γ6 )σ 6 κ = = λ+9 (κ+γ 6 )+ ( )( ) + 6σ6 ( )( ) µ 4 3σ 4 µ σ ( 5) µ 4 σ 6 ( 0) µ σ 4 3 ( ) + ( ) σ 6 ( )( ). Remark. Kedall & Stuart (967), Sectio 3.3, preset the asymptotic result that ρ( X,S ) γ κ+. The followig little-kow lemma, relatig the stadardized cumulats to each other, tells us what the possible values of (γ,κ,λ) are. This allows us to study ρ ad ρ 3 as fuctios of the stadardized cumulats. Lemma. Let X,X,X,... be idepedet ad idetically distributed radom variables that satisfy the coditios i Lemma. The (i) γ κ+, with equality if ad oly if X has a two-poit distributio. (ii) κ λ+9(κ+γ )+6, with equality if X has a two-poit distributio. 4

5 The iequality i (i) was first show by Dubkov & Malakhov (976). The etire statemet was later show by Rohatgi & Székely (989). (ii) follows from expressio (3) i Dubkov & Malakhov (976) whe γ < κ+. It is readily verified that equality holds for two-poit distributios. We have ot foud a X distributed o more tha two poits for which equality holds i (ii), ad cojecture that κ = λ+9(κ+γ )+6 oly if X has a two-poit distributio. Remark. Icidetally, Lemma ca be used to verify that ρ ad ρ 3 are bouded by ad. Sice κ + γ we have γ / κ+3 3 < γ / κ+ ad hece ρ <, as expected. We see that the correlatio coefficiet ever equals ±. Lookig at ρ 3 we similarly get ρ 3 < sice κ λ+9(κ+γ )+6. Coversely, the fact that ρ ad ρ 3 must be bouded by ad ca be used as a partial proof of Lemma..3 Test statistics The momet estimators of the two correlatio coefficiets are ow obtaied by replacig the momets by their sample couterparts i= ˆγ = (x i x) 3 i= ( ) 3/, ˆκ = (x i x) 4 ( i= (x i x) ) 3, i= (x i x) ˆλ = ( i= (x i x) 6 ) 3 5ˆκ 0ˆγ 5. i= (x i x) The estimators are thus defied as Z 3 = Z = ˆγ ˆκ+3 3 ˆκ ˆλ+9 (ˆκ+ˆγ 6 )+ ( )( ), (3). (4) From the above equatios ad Lemma it is clear that Z i fact is othig but a smooth fuctio of the sample skewess ad sample kurtosis, relatig the size of these two quatities. Likewise, Z 3 is a smooth fuctio of the sample kurtosis, skewess ad sixth cumulat. The estimators are clearly scale ad locatio ivariat, i.e. idepedet of µ ad σ, as ˆγ, ˆκ ad ˆλ all share that property. They are therefore suitable as test statistics for tests for ormality. Furthermore, it follows from the Cramér-Slutsky lemma that they are cosistet wheever the ecessary momets exist. Asymptotic ormality ca be show as well, but the covergece is slow ad we therefore prefer to obtai the ull distributio usig Mote Carlo simulatio..4 Testig From Lemma we coclude that ρ is large whe the uderlyig distributio has high skewess, ad that high kurtosis brigs the correlatio coefficiet closer to 0. Whe 5

6 usig Z as test statistic for a ormality test, we should thus reject the ull hypothesis of ormality if, whe the alterative distributio has positive skewess, Z is uusually large, or if, whe the alterative distributio has egative skewess, Z is egative ad uusually large. If the sig of the skewess of the alterative is ukow, Z ca be studied istead. Similarly, the hypothesis of ormality should be rejected if Z 3 is far from 0. If the sig of the kurtosis of the alterative is kow, a oe-tailed test should be used. From the cosistecy of the estimators (3) ad (4) it is clear that Z test is cosistet agaist alteratives with γ 0 ad that the Z 3 test is cosistet agaist alteratives with κ 0. A R implemetatio of the test is foud i the corormtest package, available from the author. 3 A simulatio power study 3. Study To evalute the performace of the tests a simulatio power study was performed, where the Z, Z ad Z 3 test were compared to the Z, Z ad Z 3 tests, oe-tailed versios of the sample momet tests b = ˆγ ad b = ˆκ, the Shapiro Wilk test W (Shapiro & Wilk, 965), Vasicek s test K (Vasicek, 976) ad the Jarque-Bera test LM (Bera & Jarque, 987). The latter test has performed poorly i previous comparisos of power, but is evertheless popular i ecoometrics. It is of some iterest to us sice it is based o the sample skewess ad kurtosis; the test statistic is LM = ( 6ˆγ + 4ˆκ ). The tests were studied for χ, Weibull, logormal, beta, Studet s t, Laplace, logistic ad ormal mixture alteratives ad were thus compared for both symmetric ad asymmetric distributios as well as short-tailed ad log-tailed oes. The skewess, kurtosis ad limit correlatio coefficiets of the alteratives are give i Table. To estimate their powers agaist the various alterative distributios at the sigificace level α = 0 05, the tests were applied to,000,000 simulated radom samples of size = 0 ad = 50 from each distributio. It should be oted that the Studet s t distributios cosidered i the study do t satisfy the coditios of Lemma, rederig ρ ad ρ 3 meaigless. This is discussed further i the results sectio below. The simulatios were carried out i R, usig shapiro.test i the stats package for the Shapiro Wilk test ad jarque.bera.test i the tseries package for the Jarque- Bera test. For Vasicek s test the critical values give i Vasicek(976) were used. Critical values for b, b, Z, Z, Z 3, Z, Z ad Z 3 were estimated usig 0,000 simulated ormal samples for each. 3. Results The Z, Z 3, Z ad Z 3 tests all performed very well i the study. The results are preseted i Tables -3 below. There was little differece betwee the performace of 6

7 Table : Skewess, kurtosis ad correlatio coefficiets for distributios i the study Distributio γ κ lim ρ lim ρ 3 Normal χ () Expoetial χ (4) Weib(/,) Weib(,) LN(σ = /4) LN(σ = /) Beta(/,/) Uiform Beta(,) Beta(3,3) 0 -/ Beta(,) Beta(,3) Cauchy t() t(3) t(4) t(5) t(6) Laplace Logistic N(0,)+ N(,) N(4,) N(0,)+ 9 0 N(0,)+ 0 N(4,) the Z ad Z tests ad betwee the Z 3 ad Z 3 tests. The former is iterestig, sice the Z test statistic is a estimator of ρ( X,(S ) /3 ) while Z is a estimator of ρ( X,S ). Judgig from the simulatio results, we make the recommedatios that follow below. Naturally, these are limited to the tests cosidered i the study. It should however be oted that the Shapiro Wilk, Vasicek, b ad b tests have displayed good performace compared to other tests for ormality i previous power studies. For asymmetric alteratives either the Z or the Z test should be used. They had the highest power agaist most asymmetric alteratives i the study, ad power close to that of the best test wheever they did t have the highest power. The oe-sided tests are particularly powerful, but the two-sided tests are ofte more powerful tha the competig tests. For symmetricalteratives either thez 3 or thez 3 test ca berecommeded, bothfor platykurtic (κ < 0) ad leptokurtic (κ > 0) distributios. Vasicek s test ad the b test are more powerful agaist some alteratives ad should be cosidered to be iterestig alteratives to the Z 3 or the Z 3 tests. It would be of some iterest to compare these tests i a larger power study. As for the Studet s t distributios studied, we ote that ρ is udefied for the distributios with 4 or fewer degrees of freedom ad that ρ 3 is udefied for all six dis- 7

8 Table : Power of tests for ormality agaist some alteratives, α = 0 05, = 0 = 0 W K LM b b Z Z Z 3 Z Z Z 3 χ () Expoetial χ (4) Weib(/,) Weib(,) LN(σ = /4) LN(σ = /) Beta(/,/) Uiform Beta(,) Beta(3,3) Beta(,) Beta(,3) Cauchy t() t(3) t(4) t(5) t(6) Laplace Logistic N(0,)+ N(,) N(4,) N(0,)+ 9 0 N(0,)+ 0 N(4,) tributios. Nevertheless, both tests perform quite well agaist those alteratives. This is perhaps ot uexpected, sice the heavy tails of those distributios will cause observatios that are so large that they domiate i (x i x) k completely. Such observatios force Z to be close to either - or ad Z 3 to be close to. 3.3 Cocludig remarks I may situatios of practical iterest the practitioer has some idea about the type of o-ormality that ca occur; ideas about the sig of the skewess of the alterative ad whether or ot is has log or short tails. Similarly, it might be of iterest to guard agaist some special class of alteratives. For istace, leptokurtic alteratives with κ > 0 are ofte cosidered to be a greater problem tha platykurtic alteratives with κ < 0. Judgig from the simulatio results preseted here, the oe-tailed Z ad Z 3 tests ca be recommeded above some of the most commo tests for ormality i such cases. The good performace of the Z ad Z tests ad the fact that the jackkife approach yields tests with essetially the same power as the exact tests is ecouragig. Jackkifig or bootstrapig to estimate correlatios, or other quatities, could perhaps be used for other idepedece characterizatios as well, as metioed i Wildig & Mudholkar 8

9 Table 3: Power of tests for ormality agaist some alteratives, α = 0 05, = 50 = 50 W K LM b b Z Z Z 3 Z Z Z 3 χ () Expoetial χ (4) Weib(/,) Weib(,) LN(σ = /4) LN(σ = /) Beta(/,/) Uiform Beta(,) Beta(3,3) Beta(,) Beta(,3) Cauchy t() t(3) t(4) t(5) t(6) Laplace Logistic N(0,)+ N(,) N(4,) N(0,)+ 9 0 N(0,)+ 0 N(4,) (007). Brow et al. (004) studied some sub- ad resamplig based tests based o idepedece characterizatios ad oted that the bootstrap ad jackkife tests seemed to complemet each other. Refereces Bera, A.K., Jarque, C.M. (987), A test for ormality of observatios ad regressio residuals, It. Stat. Rev., 55, 63-7 Brow, L, DasGupta, A., Marde, J., Politis, D. (004), Characterizatios, sub ad resamplig, ad goodess of fit, DasGupta, A. (editor) Lecture Notes-Moograph Series, Vol. 45, A Festschrift for Herma Rubi, Beachwood: IMS, Cramér, H. (946), Mathematical Methods of Statistics, Priceto: Priceto Uiversity Press, ISBN Dubkov, A. A., Malakhov, A. N. (976), Properties ad iterdepedece of the cumulats of a radom variable, Radiophys. ad Quatum Electroics, 9, Fisher, R.A. (930), Momets ad product momets of samplig distributios, P. Lod. Math. Soc.,,

10 Kaga, A.M., Liik, Y.V., Rao, C.R. (973), Characterizatio Problems i Mathematical Statistics, New York: Wiley, ISBN Kedall, M.G., Stuart, A. (967), The Advaced Theory of Statistics Vol., Lodo: Griffi, ISBN Li, C.-C., Mudholkar, G.S. (980), A simple test for ormality agaist asymmetric alteratives, Biometrika, 67, Mudholkar, G.S., McDermott, M., Srivastava, D.K. (99), A test of p-variate ormality, Biometrika, 79, Mudholkar, G.S., Marchetti, C.E., Li, C.T. (00), Idepedece characterizatios ad testig ormality agaist restricted skewess-kurtosis alteratives, J. Stat. Pla. Ifer., 04, Rohatgi, V., Székely, G.J. (989), Sharp iequalities betwee skewess ad kurtosis, Stat. Probabil. Lett., 8, Shapiro, S.S., Wilk, M.B. (965), A aalysis of variace test for ormality, Biometrika, 5, 59-6 Thode, H.C. (00), Testig for Normality, New York: Marcel Dekker, ISBN Vasicek, O. (976), A test for ormality based o sample etropy, J. Roy Stat. Soc. B, 38, Wildig, G.E., Mudholkar, G.S. (007), Some modificatios of the Z-tests of ormality ad their isotoes, Stat. Meth., 5,