arxiv: v1 [math.st] 26 Apr 2018

Transcription

1 On Mesuring the Vribility of Sll Are Estitors in Multivrite Fy-Herriot Model rxiv: v1 th.st 26 Apr 2018 Tsubs Ito nd Ttsuy Kubokw Abstrct This pper is concerned with the sll re estition in the ultivrite Fy-Herriot odel where covrince trix of rndo effects re fully unknown. The covrince trix is estited by Prsd-Ro type consistent estitor, nd the epiricl best liner unbised predictor (LUP) of vector of sll re chrcteristics is provided. When the LUP is esured in ters of en squred error trix (MSEM), second-order pproxition of MSEM of the LUP nd second-order unbised estitor of the MSEM is derived nlyticlly in closed fors. The perfornce is investigted through nuericl nd epiricl studies. Key words nd phrses: Epiricl Byes ethod, epiricl best liner unbised prediction, en squred error trix, second-order pproxition, sll re estition. 1 Introduction Mixed effects odels nd their odel-bsed estitors hve been recognized s useful ethod in sttisticl inference. In prticulr, sll re estition is n iportnt ppliction of ixed effects odels. Although direct design-bsed estites for sll re ens hve lrge stndrd errors becuse of sll sple sizes fro sll res, the epiricl best liner unbised predictors (LUP) induced fro ixed effects odels provide relible estites by borrowing strength fro neighboring res nd by using dt of uxiliry vribles. Such odel-bsed ethod for sll re estition hs been studied extensively nd ctively fro both theoreticl nd pplied spects, ostly for hndling univrite survey dt. For coprehensive reviews of sll re estition, see Ghosh nd Ro (1994), Dtt nd Ghosh (2012), Pfeffernn (2013) nd Ro nd Molin (2015). When ultivrite dt with correltions re observed fro sll res for estiting ultidiensionl chrcteristics, like poverty nd uneployent indictors, Fy (1987) suggested ultivrite extension of the univrite Fy-Herriot odel, clled ultivrite Fy-Herriot odel, to produce relible estites of edin incoes for four-, three- nd five-person filies. Fuller nd Hrter (1987) lso considered ultivrite odeling for estiting finite popultion en vector. Dtt, Dy nd Bsw (1999) provided unified theories in epiricl liner unbised prediction or epiricl Byes estition in generl ultivrite ixed liner Grdute School of Econoics, University of Tokyo, Hongo, Bunkyo-ku, Tokyo , JAPAN. E-Mil: tsubs ito.0710@gil.co Fculty of Econoics, University of Tokyo, Hongo, Bunkyo-ku, Tokyo , JAPAN. E-Mil: ttsuy@e.u-tokyo.c.jp 1

2 odels. Dtt, Dy nd Miti (1998) suggested hierrchicl Byesin pproch to ultivrite sll re estition. Dtt, et l. (1999) showed the interesting result tht the ultivrite odeling produces ore efficient predictors thn the conventionl univrite odeling. Porter, Wikle nd Holn (2015) used the ultivrite Fy-Herriot odel for odeling sptil dt. Ngruye, von Rosen nd Singull (2016) pplied ultivrite ixed liner odel to crop yield estition in Rwnd. Although Dtt, et l. (1999) developed the generl nd unified theories concerning the epiricl best liner unbised predictors (LUP) nd their uncertinty, it is definitely ore helpful nd useful to provide concrete fors with closed expressions for LUP, the secondorder pproxition of the en squred error trix (MSEM) nd the second-order unbised estitor of the en squred error trix. Recently, Benvent nd Morles (2016) treted the ultivrite Fy-Herriot odel with the covrince trix of rndo effects depending on unknown preters. As structure in the covrince trix, they considered digonl, AR(1) nd the relted structures nd eployed the residul xiu likelihood (REML) ethod for estiting the unknown preters ebedded in the covrince trix. A second-order pproxition nd estition of the MESM were lso derived. For soe exples, however, we cnnot ssue specific structures without prior knowledge or infortion on covrince trices. In this pper, we tret the ultivrite Fy-Herriot odel where the covrince trix of rndo effects is fully unknown. This sitution hs been studied by Fy (1987), Fuller nd Hrter (1987), Dtt, et l. (1998), nd useful in the cse tht sttisticins hve little knowledge on structures in correltion. As specific estitor of the covrince trix, we eploy Prsd- Ro type estitors with closed fors nd use the odified versions which re restricted over the spce of nonnegtive definite trices. The epiricl best liner unbised predictors re provided bsed on the Prsd-Ro type estitors, nd second-order pproxition of their en squred error trices nd their second-order unbised estitors of the MSEM re derived with closed expressions. These re ultivrite extensions of the results given by Prsd nd Ro (1990) nd Dtt, et l. (2005) for the univrite cse. The pper is orgnized s follows: Section 2 gives the Prsd-Ro type estitors nd their nonnegtive-definite odifictions for the covrince trix of the rndo effects, nd shows their consistency. In Sections 3 nd 4, the second-order pproxition of MSEM of LUP nd the second-order unbised estitor of the MSEM re derived in closed fors. The perfornce of LUP nd the MSEM estitor re investigted in Section 5. This nuericl study illustrtes tht the proposls hve good perfornces for the low-diensionl cse. However, k k covrince trix hs k(k+1)/2 preters, nd we need ore dt so s to intin the perfornces of the proposls for higher-diensionl cses. Finlly, it is noted tht epiricl best liner unbised predictors for sll re ens re epiricl Byes estitors nd relted to the so-clled Jes-Stein estitors. In this sense, the prediction in the ultivrite Fy-Herriot odel corresponds to the epiricl Byes estition of en trix of ultivrite norl distribution, which is relted to the estition of precision trix fro theoreticl spect s discussed in Efron nd Morris (1976). In this frework, severl types of estitors re suggested for estition of the precision trix, nd it y be n interesting query whether those estitors provide iproveents in the ultivrite sll re estition. 2

3 2 Epiricl Best Liner Unbised Prediction In this pper, we ssue tht re-level dt (y 1,X 1 ),...,(y,x ) re observed, where is the nuber of sll res, y i is k-vrite vector of direct survey estites nd X i is k s trix of covrites ssocited with y i for the i-th re. Then, the ultivrite Fy-Herriot odel is described s y i = X i β +v i +ε i, i = 1,...,, (1) where β is n s-vrite vector of unknown regression coefficients, v i is k-vrite vector of rndo effects depending on the i-th re nd ε i is k-vrite vector of spling errors. It is ssued tht v i nd ε i re utully independently distributed s v i N k (0,Ψ) nd ε i N k (0,D i ), where Ψ is k k unknown nd nonsingulr covrince trix nd D 1,...,D re k k known covrince trices. This is ultivrite extension of the so-clled Fy-Herriot odel suggested by Fy nd Herriot (1979). For exple, we consider the crop dt of Bttese, Hrter nd Fuller (1988), who nlyze the dt in the nested error regression odel. For the i-th county, let y i1 nd y i2 be survey dt of verge res of corn nd soyben, respectively. Also let x i1 nd x i2 be stellite dt of verge res of corn nd soyben, respectively. In this cse, y i, X i nd β correspond to ( ) y i = (y i1,y i2 ) 1 xi1 x, X i = i , β = (β x i1 x 1,...,β 6 ) i2 for k = 2 nd s = 6. Bttese, et l. (1988) pplied univrite nested error regression odel for ech of y i1 nd y i2, while we cn use the ultivrite odel (1) for nlyzing both dt siultneously. We now express odel (1) in trix for. Let y = (y 1,...,y ), X = (X 1,...,X ), v = (v 1,...,v ) nd ε = (ε 1,...,ε ). Then, odel (1) is expressed s y = Xβ +v +ε, (2) where v N k (0,I Ψ) nd ε N k (0,D) for D = block dig(d 1,...,D ). For the -th re, we wnt to predict the quntity θ = X β+v, which is the conditionl en Ey v given v. A resonble estitor cn be derived fro the conditionl expecttion Eθ y = X β + Ev y. The conditionl distribution of v i given y i nd the rginl distribution of y i re where v i y i N k (v i(β,ψ),(ψ 1 +D 1 i ) 1 ), y i N k (X i β,ψ+d i ), i = 1,...,, (3) v i(β,ψ) = Ψ(Ψ+D i ) 1 (y i X i β) = { I k D i (Ψ+D i ) 1} (y i X i β). (4) Thus, we get the estitor θ (β,ψ) =X β +Ev y = X β +v (β,ψ) =y D (Ψ+D ) 1 (y X β), 3

4 which corresponds to the Byes estitor of θ in the Byesin frework. When Ψ is known, the xiu likelihood estitor or generlized lest squres estitor of β is β(ψ) ={X (I Ψ+D) 1 X} 1 X (I Ψ+D) 1 y } 1 = X i (Ψ+D i ) 1 X i X i (Ψ+D i ) 1 y i. (5) Substituting β(ψ) into θ (β,ψ) yields the estitor (Ψ) = y D (Ψ+D ) 1{ y X β(ψ) }. (6) Dtt, et l. (1999) showed tht (Ψ)is thebestliner unbisedpredictor (BLUP) ofθ. Itcn be lso deonstrted tht (Ψ) is the Byes estitor ginst the unifor prior distribution of β s well s the epiricl Byes estitor s shown bove, which is clled the Byes epiricl Byes estitor. Concerning estition of Ψ, it is noted tht E(y i X i β)(y i X i β) = Ψ + D i for i = 1,...,, whichipliestht E(y i X i β)(y i X i β) = Ψ+ D i. Substituting the ordinry lest squres estitor β = (X X) 1 X y into β, we get the consistent estitor Ψ 0 = 1 { (yi X i β)(yi X i β) } D i. (7) Tking the expecttion of Ψ 0, we cn see tht E Ψ 0 = Ψ+Bis Ψ0 (Ψ), where Bis Ψ0 (Ψ) = 1 X i (X X) 1 X j (Ψ+D j )X j }(X X) 1 X i 1 j=1 (Ψ+D i )X i (X X) 1 X i 1 Substituting Ψ 0 into Bis Ψ0 (Ψ), we get bis-corrected given by X i (X X) 1 X i (Ψ+D i). (8) Ψ 1 = Ψ 0 Bis Ψ0 ( Ψ 0 ). (9) For nottionl convenience, we use the se nottion Ψ for Ψ 0 nd Ψ 1 without ny confusion. It is noted tht both estitors re not necessrily nonnegtive definite. In this cse, there exist k k orthogonl trix H nd digonl trix Λ = dig(λ 1,...,λ k ) such tht Ψ = HΛH. Let Λ + = dig(x{0,λ 1 },...,x{0,λ k }), nd let Ψ + = HΛ + H. Replce Ψ in (Ψ) with the estitor Ψ +, nd the resulting estitor is the epiricl Byes () estitor = ( Ψ + ). (10) 4

5 To gurntee syptotic properties of Ψ +, we ssue the following conditions: (H1) 0 < k <, 0 < s <. (H2) There exist positive constnts d nd d such tht d nd d do not depend on nd stify di k D i di k for i = 1,...,. (H3) X X is nonsingulr nd X X/ converges to positive definite trix. Theore 1 Under conditions (H1)-(H3), the following properties hold for Ψ = Ψ 0 nd Ψ 1 : (1) Bis Ψ0 (Ψ) = O( 1 ), which ens tht Ψ 0 hs the second-order bis, while Ψ 1 is second-order unbised estitor of Ψ. (2) Ψ Ψ = O p ( 1/2 ) nd β( Ψ) β = O p ( 1/2 ). (3) The nonnegtive defnite trix Ψ + is consistent for lrge, nd P( Ψ + Ψ) = O( K ) for ny K. Proof. We begin with writing Ψ 0 Ψ s Ψ 0 Ψ = 1 {(y i X i β)(y i X i β) (Ψ+D i )}+ 1 1 (y i X i β)( β β) X i 1 X i ( β β)( β β) X i X i ( β β)(y i X i β), which yields the bis given in (8). It is esy to check tht the bis is of order O( 1 ). For (2), it is noted tht Ψ Ψ is pproxited s Ψ Ψ = 1 = 1 {(y i X i β)(y i X i β) (Ψ+D i )}+O p ( 1 ) {u i u i (Ψ+D i )}+O p ( 1 ), (11) where u i = y i X i β, hving N k (0,Ψ +D i ). It is here noted tht (u i u i (Ψ+D i ))/ for i = 1,..., re utully independent nd E(u i u i (Ψ+D i ))/ = 0 for i = 1,...,. Then the consistency follows becuse E(u iu i (Ψ+D i )) 2 / 2 = (2(Ψ+D i) 2 +tr(ψ+ D i )I k )/ 2 = O( 1 ) under condition (H2). Using condition (H2) nd finiteness of oents of norl rndo vribles, we cn show tht ( Ψ Ψ) converges to ultivrite norl distribution, which iplies tht Ψ Ψ = O p ( 1/2 ). We next verify tht β( Ψ) β = O p ( 1/2 ). Note tht β( Ψ) β is decoposed s { β( Ψ) β(ψ)}+{ β(ψ) β}. For β(ψ) β, it is noted tht β(ψ) β } 1 = X i (Ψ+D i) 1 X i X i (Ψ+D i) 1 (y i Ey i ). (12) Then, Vr( β(ψ) β) = X i (Ψ+D i) 1 X i } 1 = O(1/) nd this iplies β(ψ) β = 5

6 O p ( 1/2 ). We next evlute β( Ψ) β(ψ) s β( Ψ) β(ψ) } 1 = X i ( Ψ+D i ) 1 X i X i ( Ψ+D i ) 1 y i } 1 X i (Ψ+D i) 1 X i X i (Ψ+D i) 1 y i } 1 = X i ( Ψ+D i ) 1 X i X i { ( Ψ+D i ) 1 (Ψ+D i ) 1} y i } 1 } 1 + X i ( Ψ+D i ) 1 X i X i (Ψ+D i ) 1 X i X i (Ψ+D i ) 1 y i = I 1 +I 2. First, I 1 is written s } 1 I 1 = X i ( Ψ+D i ) 1 X i X i ( Ψ+D i ) 1 ( Ψ Ψ)(Ψ+D i ) 1 y i, (14) which is of order O p ( 1/2 ), becuse X i ( Ψ + D i ) 1 X i = O p () nd X i ( Ψ + D i ) 1 ( Ψ Ψ)(Ψ+D i ) 1 y i = O p ( 1/2 ). Next, I 2 is rewritten s } 1 I 2 = X i ( Ψ+D { i ) 1 X i ( Ψ+D i ) 1 (Ψ+D i ) 1} X i X i } 1 X i (Ψ+D i ) 1 X i X i (Ψ+D i ) 1 y i } 1 = X i ( Ψ+D i ) 1 X i X i ( Ψ+D i ) 1 ( Ψ Ψ)(Ψ+D i ) 1 X i } 1 X i (Ψ+D i) 1 X i X i (Ψ+D i) 1 y i, (15) whichisofordero p ( 1/2 ),becuse X i ( Ψ+D i ) 1 X i = O p (), X i ( Ψ+D i ) 1 ( Ψ Ψ)(Ψ+D i ) 1 X i = O p ( 1/2 ), X i (Ψ+D i) 1 X i = O() nd X i ( Ψ+D i ) 1 y i = O p (). Thus, we hve β( Ψ) β(ψ) = O p ( 1/2 ), nd it is concluded tht β( Ψ) β = O p ( 1/2 ). For (3), let ˆλ 1,...,ˆλ k be eigenvlues of Ψ, nd let λ 1,...,λ k be eigenvlues of Ψ. Then, for j = 1,...,k, P(ˆλ j < 0) = P(ˆλ j λ j < λ j ) = P( (ˆλ j λ j ) > λ j ) P( (ˆλ j λ j ) > λ j ). Note tht λ j > 0. It follows fro the Mrkov inequlity tht for ny K > 0, P( (ˆλ j λ j ) > λ j ) E{ (ˆλ j λ j ) } 2K ( λ j ) 2K = O( K ), becuse ˆλ j λ j = O p ( 1/2 ) fro Ψ Ψ = O p ( 1/2 ). 6 (13)

7 3 Second-order Approxition of Men Squred Error Mtrix Uncertinty of the epiricl Byes estitor in (10) is esured by the en squred error trix (MSEM), defined s MSEM( ) = E{ θ }{ θ }. It is noted tht θ = {θ (β,ψ) θ }+{ (Ψ) θ (β,ψ)}+{ (Ψ)} nd tht (Ψ) θ (β,ψ) = D (Ψ +D ) 1 X { β(ψ) β}. The following le is useful for evluting the en squre error trix. Le 1 β(ψ) is independent of y X β or Ψ. Also, β(ψ) is independent of Proof. The covrince of y X β nd β(ψ) is E(y X β)( β(ψ) β) {X (I Ψ+D) 1 X} = E(y X β)(y Xβ) (I Ψ+D) 1 X = (I Ψ+D) X{X (I Ψ+D) 1 X} 1 X (I Ψ+D) 1 X = 0. This iplies tht β(ψ) is independent of y X β or Ψ. It is lso noted tht (Ψ) = D ( Ψ+D ) 1 (y X β( Ψ))+D (Ψ+D ) 1 (y X β(ψ)) =D {(Ψ+D ) 1 ( Ψ+D ) 1 }(y X β) (Ψ). +D ( Ψ+D ) 1 X {X (I Ψ+D) 1 X} 1 X (I Ψ+D) 1 (y X β) D (Ψ+D ) 1 X {X (I Ψ+D) 1 X} 1 X (I Ψ+D) 1 (y X β), which is function of y X β. Hence, where (Ψ) is independent of β(ψ). Using Le 1, we cn decopose the en squred error trix s MSEM( ) =E{θ (β,ψ) θ }{θ (β,ψ) θ } +E{ (Ψ) θ (β,ψ)}{ (Ψ) θ (β,ψ)} +E{ (Ψ)}{ (Ψ)} =G 1 (Ψ)+G 2i (Ψ)+E{ (Ψ)}{ (Ψ)}, (16) G 1 (Ψ) =(Ψ 1 +D 1 ) 1 = Ψ(Ψ+D ) 1 D, G 2 (Ψ) =D (Ψ+D ) 1 X {X (I Ψ+D) 1 X} 1 X (Ψ+D ) 1 D. The third ter cn be pproxited s G 3 (Ψ) = 1 2D (Ψ+D ) 1 (Ψ+D i )(Ψ+D ) 1 (Ψ+D i ) + (17) {tr(ψ+d i )(Ψ+D ) 1 }(Ψ+D i ) (Ψ+D ) 1 D. (18) 7

8 Theore 2 The en squred error trix of the epiricl Byes estitor is pproxited s MSEM( ) = G 1 (Ψ)+G 2 (Ψ)+G 3 (Ψ)+O( 3/2 ). (19) Proof. We shll prove tht E{ (Ψ)}{ (Ψ)} = G 3 (Ψ) + O p ( 3/2 ). Also fro (2) in Theore 1, it is sufficient to show this pproxition for Ψ insted of Ψ +. It is observed tht (Ψ) =D {(Ψ+D ) 1 ( Ψ+D ) 1 }(y X β)+d ( Ψ+D ) 1 X { β( Ψ) β} Using the eqution we cn see tht nd D (Ψ+D ) 1 X { β(ψ) β}. ( Ψ+D i ) 1 = (Ψ+D i ) 1 (Ψ+D i ) 1 ( Ψ Ψ)( Ψ+D i ) 1, (20) D {(Ψ+D ) 1 ( Ψ+D ) 1 }(y X β) =D (Ψ+D ) 1 ( Ψ Ψ)( Ψ+D ) 1 (y X β) =D (Ψ+D ) 1 ( Ψ Ψ)(Ψ+D ) 1 (y X β)+o p ( 1 ) D ( Ψ+D ) 1 X { β( Ψ) β} =D (Ψ+D ) 1 X { β( Ψ) β} D (Ψ+D ) 1 ( Ψ Ψ)( Ψ+D ) 1 X { β( Ψ) β} =D (Ψ+D ) 1 X { β( Ψ) β}+o p ( 1 ). Thus, we hve For I 2, it is noted tht (Ψ) =D (Ψ+D ) 1 ( Ψ Ψ)(Ψ+D ) 1 (y X β) +D (Ψ+D ) 1 X { β( Ψ) β(ψ)}+o p ( 1 ) =I 1 +I 2 +O p ( 1 ). (sy) β( Ψ) β(ψ) } 1 { = X j ( Ψ+D } 1 j ) 1 X j X j (Ψ+D j) 1 X j j=1 X i ( Ψ+D i ) 1 (y i X i β) } 1 + X j (Ψ+D j ) 1 X j j=1 =I 21 +I 22. j=1 X i { ( Ψ+D i ) 1 (Ψ+D i ) 1} (y i X i β) 8

9 We cn evlute I 21 s } 1 I 21 = X j (Ψ+D j ) 1 X j X i (Ψ+D i ) 1 ( Ψ Ψ)(Ψ+D i ) 1 X i }{ β( Ψ) β} j=1 =O p ( 1 ), becuse j=1 X j (Ψ + D j ) 1 X j = O(), X i (Ψ + D i ) 1 ( Ψ Ψ)(Ψ + D i ) 1 X i = O p ( 1/2 ) nd β( Ψ) β = O p ( 1/2 ) fro Theore 1 (2). We next estite I 22 s } 1 { I 22 = X j (Ψ+D } j) 1 X j X i A( Ψ,D i )X i j=1 } 1 X i A( Ψ,D i )X i X i A( Ψ,D i )(y i X i β) for A( Ψ,D i ) = ( Ψ+D i ) 1 ( Ψ Ψ)(Ψ +D i ) 1. It cn be seen tht I 22 = O p ( 1 ) fro the se rguents s in I 21. Thus, it follows tht I 2 = O p ( 1 ). Hence, we hve E{ (Ψ)}{ (Ψ)} =D (Ψ+D ) 1 E ( Ψ Ψ)(Ψ+D ) 1 (y X β)(y X β) (Ψ+D ) 1 ( Ψ Ψ) (Ψ+D ) 1 D +O( 3/2 ). It is noted fro (3) tht Ψ Ψ is pproxited s Ψ Ψ = 1 {u i u i (Ψ+D i )}+O p ( 1 ), which is used to evlute E ( Ψ Ψ)(Ψ+D ) 1 (y X β)(y X β) (Ψ+D ) 1 ( Ψ Ψ) = 1 2 E {u i u i (Ψ+D i )}(Ψ+D ) 1 u u (Ψ+D ) 1 {u j u j (Ψ+D i)} j=1 +O( 3/2 ) = 1 2 E {u i u i (Ψ+D i )}(Ψ+D ) 1 u u (Ψ+D ) 1 {u i u i (Ψ+D i )} +O( 3/2 ), since E {u i u i (Ψ +D i )}(Ψ +D ) 1 u u (Ψ +D ) 1 {u j u j (Ψ +D i)} = 0 for i j. Letting z i = (Ψ+D i ) 1/2 u i, we cn see tht z i N k (0,I k ). Then, 1 2 E {u i u i (Ψ+D i )}(Ψ+D ) 1 u u (Ψ+D ) 1 {u i u i (Ψ+D i )} = 1 2 (Ψ+D i ) 1/2 E (z i z i I)Bz z B (z i z i I) (Ψ+D i ) 1/2 +O( 2 ), i 9

10 for B = (Ψ+D i ) 1/2 (Ψ+D ) 1/2. Let C = BB = (Ψ+D i ) 1/2 (Ψ+D ) 1 (Ψ+D i ) 1/2. For i, E(z i z i I)Bz z B (z i z i I) =Ez i z i Bz z B z i z i +Bz z B z i z i Bz z B Bz z B z i z i =Ez i z i Cz i z i C = C +(trc)i k, becuse Ez i z i Cz iz i = 2C +(trc)i k. Thus, 1 2 (Ψ+D i ) 1/2 {C +(trc)i k }(Ψ+D i ) 1/2 i = 1 2 (Ψ+D i ) 1/2 {C +(trc)i k }(Ψ+D i ) 1/2 +O( 2 ), which leds to the expression in (18). 4 Estition of Men Squred Error Mtrix In this section, we obtin second-order unbised estitor of the en squred error trix of the epiricl Byes estitor in (10). A nive estitor of MSEM( ) is the plug-in estitor of (19) given by G 1 ( Ψ + ) +G 2 ( Ψ + ) +G 3 ( Ψ + ), but this hs second-order bis, becuse EG 1 ( Ψ + ) = G 1 (Ψ)+O( 1 ). Thus, we need to correct the second-order bis. Let G 4 (Ψ) = D (Ψ+D ) 1 Bis Ψ(Ψ)(Ψ+D ) 1 D, (21) where Bis( Ψ) is the bis of Ψ given by { Bis Ψ(Ψ) = Bis Ψ0 (Ψ) for Ψ = Ψ 0, 0 for Ψ = Ψ 1, where Bis Ψ0 (Ψ) is given in (8). Define the estitor se( ) by se( ) = G 1 ( Ψ + )+G 2 ( Ψ + )+2G 3 ( Ψ + )+G 4 ( Ψ + ). (22) Theore 3 Under the ssuption, EG 1 ( Ψ + )+G 3 ( Ψ + )+G 4 ( Ψ + ) = G 1 (Ψ)+O( 3/2 ), nd Ese( ) = MSEM( )+O( 3/2 ), nely, se( ) is second-order unbised estitor of MSEM( ). Proof. Fro (2) in Theore 1, it is sufficient to show this pproxition for Ψ insted of Ψ +. Using the eqution in (20), we cn rewrite G 1 ( Ψ) s G 1 ( Ψ) =( Ψ 1 +D 1 ) 1 = D D ( Ψ+D ) 1 D =G 1 (Ψ)+D (Ψ+D ) 1 ( Ψ Ψ)(Ψ+D ) 1 D (23) D (Ψ+D ) 1 ( Ψ Ψ)(Ψ+D ) 1 ( Ψ Ψ)(Ψ+D ) 1 D +O p ( 3/2 ). 10

11 We shll evlute ech ter in RHS of the bove equlity. It is esy to see fro (3) tht E Ψ Ψ = Bis( Ψ), which is written s (8). We next evlute E( Ψ Ψ)(Ψ+D ) 1 ( Ψ Ψ), which is, fro (3), pproxited s E( Ψ Ψ)(Ψ+D ) 1 ( Ψ Ψ) = 1 { } 2 E (y i X i β)(y i X i β) (Ψ+D i ) (Ψ+D ) 1 = 1 2 j=1 { (y j X j β)(y j X j β) (Ψ+D j ) j=1 } +O( 3/2 ) (Σ+D i ) 1/2 E(z i z i I)C(z j z j I)(Ψ+D j) 1/2 +O( 3/2 ), for C = (Ψ + D i ) 1/2 (Ψ +D ) 1 (Ψ + D i ) 1/2. For i j, E(z i z i I)C(z j z j hve E(z i z i I)C(z j z j I) = Ez i z i Cz iz i C. j=1 Becuse Ez i z i Cz iz i = 2C +(trc)i k, it is concluded tht I) = 0, we D (Ψ+D ) 1 E( Ψ Ψ)(Ψ+D ) 1 ( Ψ Ψ)(Ψ+D ) 1 D = G 3 (Ψ)+O( 3/2 ). The bove rguents iply tht second-order unbised estitor of G 1 (Ψ) is G 1 ( Ψ + )+ G 3 ( Ψ + )+G 4 ( Ψ + ). The estitors G 2 ( Ψ + ) nd G 3 ( Ψ + ) do not hve second-order bises, nd the results in Theore 3 re estblished. 5 Siultion nd Epiricl Studies 5.1 Finite sple perfornces We now investigte finite sple perfornces of LUP in ters of MSEM nd the secondorder unbised estitor of MSEM by siultion. 1 Setup of siultion experients. We tret the ultivrite Fy-Herriot odel (1) for k = 2,3 nd = 30,60 without covrites, nely X i = I k. As setup of the covrince trix Ψ of the rndo effects, we consider { ρψ2 ψ 2 +(1 ρ)dig(ψ Ψ = 2 ψ 2 ) for k = 2, ρψ 3 ψ 3 +(1 ρ)dig(ψ 3 ψ 3 ) for k = 3, where ψ 2 = ( 1.5, 0.5), ψ 3 = ( 1.5,1, 0.5), nd dig(a) denotes the digonl trix consisting of digonl eleents of trix A. Here, ρ is the correltion coefficient, nd we hndle the three cses ρ = 0.25,0.5,0.75. The cses of negtive correltions re oitted, becuse we observe the se results with those of positive ones. Concerning the dispersion trices D i of spling errors ε i, we tret the two D i -ptterns: () 0.7I k, 0.6I k, 0.5I k, 0.4I k, 0.3I k nd (b) 2.0I k, 0.6I k, 0.5I k, 0.4I k, 0.2I k. In the univrite Fy- Herriot odel, these cses re treted by Dtt, et l. (2005). There re five groups G 1,...,G 5 11

12 corresponding to these D i -ptterns, nd there re six nd twelve sll res in ech group for = 30 nd 60, respectively, where the spling covrince trices D i re the se for res within the se group. 2 Coprison of MSEM. We begin with obtining the true en squred error trices of the LUP = ( Ψ + ) by siultion. Let {y (r) i,i = 1,...,} be the siulted dt in the r-th repliction for r = 1,...,R with R = 50,000. Let Ψ +(r) nd θ (r) be the vlues of Ψ + nd θ in the r-th repliction. Then the siulted vlue of the true en squred error trices is clculted by MSEM( ) = R 1 R { ( Ψ +(r) ) θ (r) }{ ( Ψ +(r) ) θ (r) }. As n estitor of Ψ, we here use the siple estitor Ψ + 0, becuse there is little difference between Ψ + 0 nd Ψ + 1 in siulted vlues of MSEM under the setup of X i = I k. Siulted vlues of the en squred error trices, verged over res within groups G t, re reported in Tbles 1, 3, nd 5. To esure reltive iproveent of LUP, we clculte the percentge reltive iproveent in the verge loss (PRIAL) of PRIAL(,y ) = It is lso interesting to copre with the LUP Herriot odel. Thus, we clculte the PRIAL given by over y, defined by tr{msem( )} tr{msem(y )} u PRIAL(, u tr{msem( )} ) = tr{msem( u, )} nd those vlues re reported in Tbles 2, 4 nd 6.. derived fro the univrite Fy- Tble 1 reports the siulted vlues of the true MSEM of for k = 2, D i -ptterns (), = 30,60 nd ρ = 0.25,0.5,0.75. For fixed, the vlues of MSEM decrese s the correltion ρ in the rndo effect becoes lrge. For fixed ρ, the vlues of MSEM decrese s becoes lrge. Tble 2 reports the vlues of PRIAL of over y nd u under the se setup s in Tble 1. In ll the cses, iproves on y lrgely nd the iproveent rtes re lrger for u u lrger ρ. In coprison with, the univrite LUP is slightly better thn for ρ = 0.25, but the difference is not significnt. The vlues of PRIAL of over get lrger s ρ increses. In the cse of = 60, the iproveents of u in light of PRIAL get lrger u is better for = 60 for lrger ρ. In the cse of ρ = 0.25, the iproveent of over thn for = 30. This is becuse the low ccurcy in estition of the covrince trix Ψ hs ore dverse influence on prediction thn the benefit fro incorporting the sll correltion into the estition. The coprison of perfornces between D i -ptterns () nd (b) is investigted in Tbles 3 nd 4. The siulted vlues of the MSEM of 12 in D i -ptterns () nd (b) re reported in

13 Tble 3 for k = 2, = 30,60 nd ρ = 0.5. As the increent of vrince of spling error in G 1, the MSEM in G 1 becoes lrger, nd the other groups hve slightly lrger MSEM except G 5. The vlues of PRIAL of over y nd u re given in Tble 4 for D i -ptterns () nd (b). under the se setup s in Tble 3. As seen fro the tble, the iproveent of y in G 1 is lrger for D i -pttern (b) becuse of the lrge spling vrince. However, not better thn u in G 4 nd G 5 for = 30 nd in G 5 for = 60 in D i -pttern (b). This iplies tht incorporting the infortion of res with lrge spling vrinces ffects ore dversely estition of res with sll spling vrinces in the ultivrite odel thn in the univrite odel. Tbles 5 nd 6 report the vlues of MSEM nd PRIAL for k = 3, = 30, ρ = 0.5 nd u D i -pttern (). Fro Tble 6, it is reveled tht PRIAL of over y nd re lrger for k = 3 thn for k = 2 in the cse of ρ = 0.75, but sller in the cse of ρ = When is fixed s = 30, the ccurcy in estition of the covrince trix Ψ gets sller for the lrger diension. This deonstrtes tht it is not pproprite to tret the ultivrite Fy-Herriot odel with lrge covrince trix when is not lrge. 3 MSEM pproxition nd its estitor. We next investigte the perfornce of the second-order pproxition of MSEM of LUP given in Theore 2 nd the secondorder unbised estitor se( ) of MSEN given in Theore 3. The vlues of the secondorder pproxition of MSEM re given in Tble 7 for k = 2, = 3 nd D i -pttern (). Copring the vlues in Tble 7 with the corresponding true vlues of the MSEM in Tble 1, we cn see tht the second-order pproxition cn pproxite the true MSEM precisely for every G t nd ρ. Concerning the perfornce of the second-order unbised estitor se( ) given in (22), we copute the siulted vlues of reltive bis of the estitor se( ), verged over res within groups G t. Those vlues re reported in Tble 8 for k = 2, = 30,60 nd D i -pttern (). It is reveled fro Tble 8 tht the reltive bis gets lrger for lrger ρ. Also, the vlues of the reltive bis re sller for = 60 thn for = 30, nely, the reltive bis gets sll s increses. 5.2 Illustrtive exple This exple, pririly for illustrtion, uses the ultivrite Fy-Herriot odel (1) nd dt fro the 2016 Survey of Fily Incoe nd Expenditure in Jpn, which is bsed on two or ore person households (excluding griculturl, forestry nd fisheries households). The trget doins re the 47 Jpnese prefecturl cpitls. The 47 prefectures re divided into 10 regions: Hokkido, Tohoku, Knto, Hokuriku, Toki, Kinki, Chugoku, Shikoku, Kyushu nd Okinw. Ech region consists of severl prefectures except Hokkido nd Okinw, which consist of one prefecture. In this study, s observtions (y i1,y i2 ), we use the reported dt of the yerly verged onthly spendings on Eduction nd Culturl-useent per worker s household, scled by 1,000 Yen, t ech cpitl city of 47 prefectures. In ddition, we use the dt in the 2014 Ntionl Survey of Fily Incoe nd Expenditure. The verge spending dt in this survey over is 13

14 Tble 1: Siulted vlues of en squred error trices of ultipled by 100 for k = 2, D i -ptterns () = 30 ρ = 0.25 ρ = 0.5 ρ = G G G G G = 60 ρ = 0.25 ρ = 0.5 ρ = G G G G G Tble 2: PRIAL of over y nd u for k = 2, D i -ptterns () vs y u vs = 30 ρ = 0.25 ρ = 0.5 ρ = 0.75 ρ = 0.25 ρ = 0.5 ρ = 0.75 G G G G G vs y u vs = 60 ρ = 0.25 ρ = 0.5 ρ = 0.75 ρ = 0.25 ρ = 0.5 ρ = 0.75 G G G G G

15 Tble 3: Siulted vlues of en squred error trices of ultipled by 100 for k = 2, ρ = 0.5 = 30 Pttern () Pttern (b) = 60 Pttern () Pttern (b) G 1 G G 2 G G 3 G G 4 G G 5 G Tble 4: PRIAL of over y nd u for k = 2, = 30,60, ρ = 0.5, D i -ptterns (), (b) u vs y vs = 30 Pttern () Pttern (b) Pttern () Pttern (b) G G G G G vs y u vs = 60 Pttern () Pttern (b) Pttern () Pttern (b) G G G G G

16 Tble 5: Siulted vlues of en squred error trices of ultiplied by 100 for k = 3, = 30, D i -ptterns () G1 G2 G3 G4 G5 = 30 ρ = 0.25 ρ = 0.5 ρ = Tble 6: PRIAL of over y nd u for k = 2,3, = 30, D i -ptterns () u vs y vs k = 2 ρ = 0.25 ρ = 0.5 ρ = 0.75 ρ = 0.25 ρ = 0.5 ρ = 0.75 G G G G G vs y u vs k = 3 ρ = 0.25 ρ = 0.5 ρ = 0.75 ρ = 0.25 ρ = 0.5 ρ = 0.75 G G G G G

17 Tble 7: Second order pproxitions of en squred error trices of () = 30 ρ = 0.25 ρ = 0.5 ρ = G G G G G ultiplied by 100 for k = 2, D i -ptterns Tble 8: Siulted vlues of percentge verge reltive bis of en squred error trices of for k = 2, = 30,60, D i -pttern () Pttern () = 30 ρ = 0.25 ρ = 0.5 ρ = G G G G G Pttern () = 60 ρ = 0.25 ρ = 0.5 ρ = G G G G G ultiplied by

18 re ore relible thn the Survey of Fily Incoe nd Expenditure since the sple sizes re uch lrger. However, this survey is conducted only once in every five yers. As uxiliry vribles, we use the dt of the verge spendings on Eduction nd Culturl-useent, which is denoted by EDU i nd CUL i, respectively. Then the regressor in the odel (1) is ( ) 1 EDUi 0 0 X i = CUL i Then we pply the ultivrite Fy-Herriot odel (1), where spling covrince trices D i of the i-th region for i = 1,...,10 re clculted bsed on dt of yerly verged onthly spendings on Eduction nd Culturl-useent in the pst ten yers ( ), where D i is given s the verge of the spling covrince trices of prefectures within the i-th region. Tht is, the spling covrince trix D i re the se for prefectures within the se region. The estites of the covrince trix Ψ nd the correltion coefficient ρ is ( ) Ψ = nd ˆρ = The estites of the regression coefficients nd the p-vlues for testing H 0 : β k = 0 for k = 1,...,4 re given in Tble 9. All the estites re significnt. Tble 9: Estites of regression coefficients nd p-vlues vrbles Constnt(EDU) EDU Constnt(CUL) CUL β p-vlue The vlues of LUP nd direct estite of spendings on Eduction nd Culturluseent re reported in Tble 10. We only pick up the three prefectures fro three different regions: Tokyo prefecture fro the Knto region, Osk prefecture fro the Kinki region nd Fukushi prefecture fro the Tohoku region, whose spling covrince trices re ( ), ( ) nd ( respectively. It is seen tht s the spling vrinces becoe lrger, the direct estites re ore shrunken by the LUP in the sense of (direct estite - LUP)/(direct estite). The uncertinty of LUP is provided by the second-order unbised estitor of MSEM of LUP. Tble 11 reports the estites of MSEM verged over prefectures within ech region for 10 regions. We lso clculte the percentge reltive iproveent in the verge loss u estite (PRIAL estite) of over y nd. Tble 12 reports the verge of those vlues over ech region for spendings on eduction nd culturl-useent. It is reveled fro Tble 12 tht the ultivrite LUP iproves on the direct estites significntly nd tht the ultivrite LUP is slightly better thn the univrite LUP for ost regions except Okinw, which hs sller spling covrince trix. 18 ),

19 Tble 10: LUP nd direct estites Tokyo Osk Fukushi direct estitor (EDU) LUP (EDU) direct estitor (CUL) LUP (CUL) Tble 11: Estites of the en squred error trices of Hokkido Tohoku Knto Hokuriku Toki Kinki Chugoku Shikoku Kyushu Okinw Tble 12: PRIAL estites of over y nd u vs y Hokkido Tohoku Knto Hokuriku Toki Kinki Chugoku Shikoku Kyushu Okinw u vs Hokkido Tohoku Knto Hokuriku Toki Kinki Chugoku Shikoku Kyushu Okinw

20 Acknowledgents Reserch of the second uthor ws supported in prt by Grnt-in-Aid for Scientific Reserch (15H01943 nd ) fro Jpn Society for the Prootion of Science. References 1 G.E. Bttese, R.M. Hrter, W.A. Fuller, An error coponent odel for prediction of en crop res using survey nd stellite dt., J. A. Sttist. Assoc. 95 (1988) R. Benvent, D. Morles, Multivrite Fy-Herriot odels for sll re estition, Cop. Sttist. Dt Anl. 94 (2016) G.S. Dtt, B. Dy, I.V. Bsw, Epiricl best liner unbised nd epiricl Byes prediction in ultivrite sll re estition, J. Sttist. Pln. Inf. 75 (1999) G.S. Dtt, B. Dy, T. Miti, Multivrite Byesin sll re estition: An ppliction to survey nd stelite dt, Snkhy 60 (1998) G.S. Dtt, M. Ghosh, Sll re shrinkge estition, Sttist. Science 27 (2012) G.S. Dtt, J.N.K. Ro, D.D. Sith, On esuring the vribility of sll re estitors under bsic re level odel, Bioetrik 92 (2005) B. Efron, C. Morris, Multivrite epiricl Byes estition of covrince trices, Ann. Sttist. 4 (1976) R. Fy, Appliction of ultivrite regression to sll doin estition, Sll Are Sttistics (R. Pltek, J.N.K. Ro, C.E. Srndl, M.P. Singh, eds) (1987) R. Fy, R. Herriot, Estitors of incoe for sll re plces: n ppliction of Jes Stein procedures to census, J. Aer. Sttist. Assoc. 74 (1979) W.A. Fuller, R.M. Hrter, The ultivrite coponents of vrince odel for sll re estition, Sll Are Sttistics (R. Pltek, J.N.K. Ro, C.E. Srndl, M.P. Singh, eds) (1987) M. Ghosh, J.N.K. Ro, Sll re estition: An pprisl, Sttist. Science 9(1994) I. Ngruye, D. von Rosen, M. Singull, Crop yield estition t district level for griculturl sesons 2014 in Rwnd, Africn J. Applied Sttist. 3 (2016) D. Pfeffernn, New iportnt developents in sll re estition, Sttist. Science 28 (2013) A.T. Porter, C.K. Wikle, S.H. Holn, Sll re estition vi ultivrite Fy-Herriot odels with ltent sptil dependence, Austrlin nd New Zelnd J. Sttist. 57 (2015) N.G.N. Prsd, J.N.K. Ro, The estition of en squred errors of sll re estitors, J. A. Sttist. Assoc. 85 (1990)

21 16 J.N.K. Ro, I. Molin, Sll Are Estition, 2nd Edition (2015) Wiley. 21