Predicting Random Effects from a Finite Population of Unequal Size Clusters based. on Two-Stage Sampling. Edward J. Stanek III

Size: px
Start display at page:

Download "Predicting Random Effects from a Finite Population of Unequal Size Clusters based. on Two-Stage Sampling. Edward J. Stanek III"

Transcription

1 Predctng Random Effect from a Fnte Populaton of Unequal Sze Cluter baed on To-Stage Samplng Edard J. Stanek III Department of Publc Health 40 Arnold Houe Unverty of Maachuett 75 orth Pleaant Street Amhert, MA USA tanek@choolph.uma.edu Julo M. Snger Departamento de Etatítca Unverdade de São Paulo São Paulo, Brazl jmnger@me.up.br C07ed3.doc /9/007 :37 PM

2 ABSTRACT Predcton of random effect an mportant problem th expandng applcaton. In the mplet context, the problem correpond to predcton of the latent value (the mean) of a realzed cluter elected va to-tage amplng. Bet lnear unbaed predctor developed from mxed model are dely ued, but ther development requre dtrbutonal aumpton or an nfnte populaton frameork. When the number and ze of cluter fnte, uper populaton model have been ued to predct the contrbuton of the unoberved unt to a realzed cluter mean. Recently, predctor developed from a to-tage amplng model have been hon to out-perform the modelbaed predctor. Hoever, the random permutaton model underlyng thee predctor lmted to ettng here cluter ze and ample ze per cluter are equal. We preent a ne to-tage amplng model that can be ued hen cluter ze and ample ze per cluter dffer. The model expand the et of random varable from the to-tage amplng model to accommodate the dfferent ze cluter. The reultng bet lnear unbaed predctor out perform any of the competng predctor, even hen cluter and ample ze per cluter are equal. The reducton n expected mean quared error relatve to predctor developed under mxed model or uper populaton model aumpton lkely due to the pecfcty of the expanded random permutaton model to the problem. Th ugget fathfully capturng the tochatc apect of a problem more mportant than mplfyng aumpton n developng optmal oluton. Many other problem may be amenable to mproved oluton baed on extenon of th approach. C07ed3.doc /9/007 :37 PM

3 Contact Addre: Edard J. Stanek III Department of Publc Health 40 Arnold Houe Unverty of Maachuett at Amhert Amhert, Ma. 000 Phone: Fax: Emal: KEYWORDS: uperpopulaton, bet lnear unbaed predctor, random permutaton, optmal etmaton, degn-baed nference, mxed model. ACKOWLEDGEMET. Th ork a developed th the upport of the Conelho aconal de Deenvolvmento Centífco e Tecnológco (CPq), Fundação de Amparo à Pequa do Etado de São Paulo (FAPESP), Brazl and the atonal Inttute of Health (IH-PHS-R0-HD36848, R0-HL0788-0), USA. C07ed3.doc /9/007 :37 PM

4 . ITRODUCTIO There often nteret n the mean unt repone of a cluter here repone oberved for only a ubet of the cluter unt. In t mplet form, th problem often addreed n the context of a mxed model, and correpond to predctng the mean of a realzed cluter n a to tage mple random ample. There are many applcaton here uch predcton of nteret. Henderon (984) a ntereted n predctng a co mlk producton, and tuded lactaton record of dary co. In the current U.S. educatonal envronment, hgh chool tandardzed tet core are of nteret, th chool havng hgh take n the reult due to ther ue n reource allocaton. The trength of a famly emotonal upport of nteret n tude of copng th ubequent llne n agng (Yorgaon, et al. 006). A patent bomarker level may be mportant n quantfyng rk of deae or ubequent nterventon. Although applcaton vary dely, each problem can be defned ung a common clutered populaton frameork, here the target parameter can be defned a the average expected repone of unt n a realzed cluter. In the example, a cluter may correpond to a co, a chool, a famly, or a patent, hle the unt may correpond to lactaton perod, tudent, famly member, or tme perod, repectvely. Ideally, the number and ze of cluter knon, nce the practcal relevance and nterpretaton of the tattcal nference enhanced by a clear problem defnton. It rarely poble to oberve the expected repone on all unt n each cluter. Intead, repone oberved on a ubet of unt for a ubet of cluter. An mportant C07ed3.doc /9/007 :37 PM

5 queton ho to ue uch nformaton to gue the average repone of unt n a pecfed cluter. To aner th queton, the oberved data are lnked to the populaton va an aumed probablty model, objectve crtera are defned that can be ued to evaluate competng guee, and the bet gue then determned. Ideally, the problem defned n the populaton hould be dentcal to the problem anered va the tochatc model. The typcal ue of mxed model to gue the mean repone for a cluter an example here the problem anered va the probablty model a lghtly dfferent problem. In a mxed model, ho bet to etmate a parameter correpondng to a cluter mean tranlated nto the queton of ho bet to predct a realzed random effect. The cluter dentfed n the populaton repreented a a random varable n the tochatc model. Th tranlaton change the problem, nce the dentty of the cluter lot n the uual repreentaton of the tochatc model. The dfference ubtle, nce the ubcrpt that dentfe a cluter n the populaton uually replaced by a ubcrpt repreentng the poton of a elected cluter n the ample (Cael, Sarndal, and Wretman 979). For example, the frt cluter n a populaton ltng not the ame a the frt ample cluter, hch e refer to a the frt prmary amplng unt, or PSU (a n Stanek and Snger, 004). A mlar ubttuton occur for the ubcrpt dentfyng unt n a cluter, and ample unt for a ample cluter, hch e refer to a econdary amplng unt, or SSU. The dfference beteen a cluter and a PSU are often a ource of confuon n nterpretng predctor of realzed random effect. C07ed3.doc /9/007 :37 PM

6 Model baed approache to predct a realzed random effect are characterzed by a gap beteen the problem tated n term of dentfable cluter and unt n the fnte populaton and the random effect n a mxed model that do not dentfy cluter or unt. Snce multple probablty model can be poted, dfferent optmal oluton can be clamed for the ame bac problem. Each oluton uffer from the lmtaton that the underlyng model can not be connected back to the dentfable fnte populaton. Thu, hle each oluton optmal for t theoretcal frameork, none of the frameork match realty, and t unclear hch optmal oluton bet. There are other dffculte th model-baed approache that occur hen cluter ze dffer n the populaton. A problem occur hen tryng to ue a model to repreent ample SSU n a PSU. Such a repreentaton mportant for the model to nclude charactertc of unt (thn cluter varable) that may be related to repone. The problem occur nce vector repreentng ample SSU for a ample PSU are of dfferent ze (correpondng to dfferent number of ampled unt). Interpretaton of repone for an element n a ample vector then depend on the orderng of the PSU, nce vector repreentng dfferent ample PSU have dfferent length. The mxed model aumpton that PSU are elected at random conflct th the condtonng needed to nterpret repone for a SSU. In part to detep th dffculty, model baed approache may aume the number of SSU nfntely large (a n the mxed model approache of Goldberger 96; Henderon 984, McLean, Sander and Stroup 99; Robnon 99; and McCulloch and Searle 00), or condton on cluter ze (a n the uperpopulaton model baed approache of Scott and Smth 969; Ghoh and Lahr 987; Bolfarne and C07ed3.doc /9/007 :37 PM 3

7 Zach 99; Vallant, Dorfman and Royall, 000). Such aumpton den the gap beteen the problem defned n the fnte populaton, and the oluton to the problem defned n the model. Mxed model method are dely accepted and ued n pte of thee ue, but the foundaton for uch method not completely ecure. We preent a ne expanded to tage random permutaton (RP) model that overcome ome of the lmtaton of prevou probablty model. A key feature of the expanded model multaneouly retanng the cluter dentfy and the PSU poton n the model, hle dtnguhng for a PSU the relevant contrbuton of ample SSU, and non-ampled SSU to a target random varable uch a a cluter mean. The model extend the expanded model for mple random amplng of Stanek, Snger, and Lencna (004) to the to-tage RP model ued by Stanek and Snger (004), hle allong for poble unequal ze cluter. We develop the bet lnear unbaed predctor (BLUP) of a PSU mean ung th model, and ho that the predctor ha maller mean quared error than other predctor, ncludng the uual mxed model predctor. Begnnng th an explct repreentaton of random varable underlyng a to tage RP of a fnte populaton, e ho that hen predctng a PSU mean va a lnear unbaed predctor, the expanded model can not be further reduced thout lo of nformaton. Snce the expanded model retan th nformaton, the bet lnear unbaed predctor (developed n an dentcal manner a the development n Stanek and Snger (004)), ha maller expected MSE than any prevouly developed predctor (ncludng commonly ued mxed model predctor, uper populaton model predctor). We characterze the extent of the reducton n the theoretcal expected mean quared error, C07ed3.doc /9/007 :37 PM 4

8 and llutrate reult for emprcal predctor va mulaton relatve to mxed model and uper populaton model predctor. We conclude by hghlghtng model feature that have conequence n extendng th ork and related ork that offer promng poblte for future mprovement.. A EXPADED RP MODEL FOR A FIITE CLUSTERED POPULATIO We frt defne notaton and termnology for a clutered fnte populaton. Let a fnte populaton be defned by a ltng of M unt labeled t =,..., M n each of cluter, labeled =,...,, here the non-tochatc repone for unt t n cluter gven by y t. We aume that the repone for a unt can be oberved thout error, and correpond to the expected value for the unt. The fnte populaton parameter correpondng to the mean and varance of cluter, =,...,, are defned by M M M μ = yt and σ ( ) = yt μ M t= M M t= (here e ue the urvey amplng defnton of the parameter σ ). Smlarly, the populaton mean, and the varance beteen cluter mean are defned a μ μ = =. = = and σ ( μ μ) Ung thee parameter, e repreent the potentally obervable repone for unt t n cluter a y t = μ + β + ε t C07ed3.doc /9/007 :37 PM 5

9 here β = ( μ μ the devaton of the mean for cluter from the overall mean, and ) ε t ( y μ ) = the devaton of unt t repone (n cluter ) from the mean for t y = ( y y y ) cluter. Defnng model can be ummarzed a here y = y y y, the y = Xμ + Zβ + ε ( ) M here X =, Z = M = a column vector of one,,, and = ( ) = = M = β β β β. Here, an A denote a block dagonal matrx th block gven by a A (Graybll 983), and ε defned mlarly to y. one of the term n the model are random varable... Random Varable and The To Stage Random Permutaton Model We explctly defne a vector of random varable that repreent a to tage RP of the populaton. Aumng that each realzaton of the permutaton equally lkely, th probablty! M! =, the random varable formally repreent to-tage amplng (Cochran 977). We aume that the ample cluter are n the frt n poton n a permutaton of cluter. Smlarly, e aume that the ample unt n cluter correpond to the unt n the frt m poton n a permutaton of the cluter unt. C07ed3.doc /9/007 :37 PM 6

10 ote that thee defnton repreent random varable a a equence a oppoed to the more uual et notaton. When all cluter are of equal ze uch that M = M for all =,...,, Stanek and Snger (004) defned ndcator random varable to explctly repreent a random vector of dmenon M correpondng to a to-tage permutaton of the populaton. We follo a mlar trategy hen cluter ze dffer, but note to dfference. Frt, to retan the dentty of cluter and PSU n the vector repreentng a RP, e expand the number of random varable from to. Second, e nclude a et of fxed knon eght aocated th the SSU n a cluter. Dfferent target parameter (uch a the cluter mean, total, or a cluter regreon parameter) can be formed ealy by changng the eght. The expanded model ue a larger et of random varable than the random varable ued n Stanek and Snger model, or n uper-populaton model approache. Thee random varable are feer than the random varable that ould reult from a further expanon that ould retan the dentty of unt and SSU, and even feer than the very general repreentaton of the model ued by Godambe (955). We attrbute the better effcency of predctor (to be hon) under the expanded model n part to the larger number of random varable ued to repreent the bac problem. Alo notce that the to-tage RP model fathfully repreent a to-tage cluter amplng degn, o that the method are degned baed. We defne the eghted expanded random varable, and llutrate the need for the expanon next. C07ed3.doc /9/007 :37 PM 7

11 Sample ndcator random varable relate the repone for unt t n cluter, to the repone for a unt n poton j of a cluter n poton n a to tage permutaton of cluter and unt. We defne U a an ndcator random varable that ( ) jt y t, take on a value of one hen SSU j n cluter unt t, and zero othere, and ue t to repreent the random varable correpondng to SSU j n cluter gven by Y j M = U t= ( ) jt y. Let t denote a fxed non-tochatc eght for =,...,, j =,..., M, j and defne the eghted repone a Y = Y j j j. For example, M Y j correpond to a j= cluter total hen = for all j =,..., M, or a cluter mean hen j j = for M all j =,..., M. otce that e can defne ( ) = y U here Y j j j ( ) ( ) ( ) ( ) ( ) U j = U j U j U jm, and Y = ( Y Y Y M ). The vector Y repreent a permutaton of eghted repone for SSU n cluter. A permutaton of cluter defned ung the ndcator random varable =,..., and =,...,, that take on a value of one hen PSU cluter, and a value of zero othere. If all cluter ere equal n ze, e could repreent a U for permutaton of SSU for PSU by expreon are defned only hen = U Y. When cluter ze dffer, element n th j mn( M, =,..., ). Mxed model and C07ed3.doc /9/007 :37 PM 8

12 uperpopulaton model repreentaton of to tage cluter amplng do not formally account for th range retrcton n lnkng the random varable to the fnte populaton.. We drectly account for dfferent ze cluter, and avod the requrement of range contrant for ubcrpt by expandng the number of random varable ued to repreent a permutaton of cluter and unt. For PSU, the expanded random varable are defned by the vector Y = ( U Y ) = U Y U Y U Y ( ) ( ), th a to tage random permutaton of the populaton repreented by the vector, Y = Y = Y Y Y. An element of Y gven by UY j. (( )) ( ) A mple example llutrate the notaton. Suppoe the populaton cont of three cluter ( = 3), here the frt to cluter have to unt ( M = M = ), the thrd cluter ha three unt ( M 3 = 3 ), = 7, and = for all =,...,, j =,..., M. We repreent a permutaton of unt for cluter by Y, =,...,3. Suppoe the frt permutaton of cluter reult n cluter =, =, and = 3 n poton repectvely, hle a econd permutaton reult n cluter j =,...,3 = 3, =, and = n poton =,...,3 repectvely. The repreentaton of the random varable realzed by the frt permutaton of PSU the random vector ( Y Y Y 3), and by the econd permutaton of PSU the random vector ( Y 3 Y Y ). Although both vector are of dmenon, the thrd SSU n the frt permutaton n PSU =, hle the thrd SSU n the econd permutaton n PSU =. The poton of a SSU n the permuted C07ed3.doc /9/007 :37 PM 9

13 populaton not uffcent to retan the dentty of the PSU for the SSU. In contrat, ung the expanded random varable repreentaton, the random varable realzed by the frt permutaton of PSU are repreented by ( Y Y Y3), hle thoe realzed by the econd, here permutaton are repreented by ( 0 0 Y 3 0 Y 0 3 Y 0 03) 0 a an a vector th all element equal to zero. Th notaton preerve the dentty of the PSU for each SSU, avodng the ambguty that are n mxed model and uperpopulaton model.. A Mxed Effect Model for the Expanded Random Varable We repreent a mxed model for the expanded RP model ndexng repreentng expectaton th repect to permutaton of cluter th the ubcrpt ξ and expectaton th repect to permutaton of unt n a cluter th the ubcrpt ξ. For PSU, e expre here Eξξ ( ) = Y = E Y + E Y E Y ( ) ( ) ( ) +E ξξ ξξ ξξ Y = μ (( )) ( ) j M, E ξ ξ ( ) Y = μ U =, E = Y E ξ ξ ( Y ) = =, μ = ( μ ) = μ μ μ and (( )) ( ( ) ( ) U = U = U U U ). The fxed effect are gven by μ, the vector of, C07ed3.doc /9/007 :37 PM 0

14 cluter mean. The random effect, Eξ ξ( Y ) Eξ ξ( Y ), are defned a the devaton from the fxed effect of the expected repone condtonal on a realzed PSU. In the RP model of Stanek and Snger (004), the random effect for the mean of PSU a defned explctly a Uβ, th the random varable U explctly lnkng the cluter to = PSU. In the expanded RP model, random effect are defned for SSU j n PSU a ( j μ U Eξ ( U )). For both model, the expected value of the random effect (th repect to ξ ) zero, but th reult are from qute dfferent crcumtance. The devaton of repone from the expected repone thn a PSU repreented by E. We combne thee expreon arrvng at the expanded RP mxed model gven by Y = + μ vec( Eξ ( )) + = μ I = U U E () here var ξξ U = ( U U U ). The varance of random effect gven by I μ vec( U Eξ ( U) ) = P μ P μ = = = hle varξξ ( ) M M σ E = I j M j = P, here j= j= Pa = Ia J a and a J a denote an a a matrx th all element equal to one..3. Defnng Random Varable of Interet C07ed3.doc /9/007 :37 PM

15 Model () an expanded veron of a mxed model that retan the dentty of cluter, hle accountng for a to tage RP. Our nteret n predctng a lnear combnaton of thee random varable defned by T = gy, here g non-tochatc. Although many lnear combnaton are poble, e lmt the dcuon to lnear combnaton gven by T = gy here g = c and c a vector of contant. In partcular, e focu on the ettng here c = e an vector th all element equal to zero, except for element hch ha the value of one. Of prncpal nteret the ettng here n, uch that the cluter of nteret realzed n the ample. When j = for all =,...,, j =,..., M, the target random varable, M M T = U jy j the mean of PSU ; hen j = for all =,...,, = j= M j =,..., M, the target random varable, T = U jy j the total of PSU. = j= 3. PREDICTIG A PSU MEA USIG A EXPADED RP MODEL The bac trategy for developng a predctor under a model-baed approach gven n many place (Scott and Smth 969; Royall 976; Bolfarne and Zack 99; Vallant et al. 000), and appled n a degn-baed frameork to a balanced to tage cluter amplng by Stanek and Snger (004). Stanek and Snger hoed that the predctor of a realzed PSU mean from the RP model outperform the mxed model and C07ed3.doc /9/007 :37 PM

16 uperpopulaton model predctor. We develop mlar reult ung the expanded RP model, and llutrate that the reultng predctor of a realzed PSU mean ha even loer expected MSE relatve to the predctor gven by Stanek and Snger (004). We aume that the element n the ample porton of Y ll be oberved, and expre T a the um of to part, one hch a functon of the ample, and the other hch a functon of the remanng random varable. Then, requrng the predctor to be a lnear functon of the ample random varable and to be unbaed, coeffcent are evaluated that mnmze, the expected value of the MSE gven by var ( ˆ ξξ T T). Whle n theory, an optmal predctor can be expreed follong th predcton recpe, n practce, the hgh dmenonalty of the vector from the expanon of random varable may reult n ngularte that prevent unque oluton (a n Stanek, Snger, and Lencna (004)). In part for th reaon, e project the random varable nto a loer dmenonal pace that retan the neceary nformaton for an optmal oluton, mplfyng the problem. The projecton dffer from the projecton ued hen all cluter have equal ze. 3.. Partal Collapng of the Expanded RP Random Varable Rao and Bellhoue (978) (ee Theorem.) provde a ay of determnng hether the optmal lnear unbaed predctor of a target random varable, T = gy be obtaned a the optmal lnear unbaed predctor of T = g Y baed on Y = CY, a vector of random varable that pan a loer dmenonal pace. We apply th p p p can C07ed3.doc /9/007 :37 PM 3

17 ( ) m 0 M m = = theorem hen C = ( 0 m ) M m = = g p = g C CC and ( ), here m repreent the number of ample unt n cluter. The addtonal ubcrpt p denote the partal collapng of the expanded random varable. The collapng um the SSU for the ample and remander n each cluter for each PSU, reducng the number of random varable from to. Snce P = I C CC C C M that = [ ] p Y = C CC Y + P Y, here ( ) p C ( ), e can expre ( ) g c, gp Y = 0 unbaed predctor of T baed on g = ( P Y ) 0, T ˆ ll be optmal for C C Y p g Y = g CCC Y + g PY. otce and T p p p C = g Y. Defnng Tˆ a the optmal lnear, and ˆB a a lnear unbaed predctor of T determne condton under hch ( ) E Tˆ T Bˆ ξξ = 0. We = gy f and only f ( ) E Tˆ T Bˆ ξξ = 0 by ung the unbaed contrant of the predctor, and expreng E ( ˆ ξξ T T) Bˆ a a functon of E ξξ ( YY ) Smplfyng term, e fnd that hen j = for all,..., j = M, E ( ˆ ) ˆ ξξ T T B = 0 (ee c06ed54.doc for detal). Th mean that e can obtan the optmal predctor ung the partally collaped random varable a long a thn each cluter, the eght are equal for SSU.. C07ed3.doc /9/007 :37 PM 4

18 We aume that j = for all j =,..., M n ubequent development, and develop the bet lnear unbaed predctor of T = g py p baed on Y p. The vector Y p contan random varable. The frt random varable are of the form UmY I, hle the remanng random varable are of the form ( ) U M m Y II, here Y I = m Y j and m j = Y II = M Y j. j m M m = + p It natural to conder hether or not t uffcent to predct T = g py p here [ ] g = c ung ( ) * Yp = C Y p here * C = I. ote that * T = g Y * here * * * * * g = gp C C C. ote that ( *) = * C C C I and g = c. We refer to the random varable n Y a the collaped random varable. Th et p of random varable mlar to thoe ued by Stanek and Snger (004) for a populaton th equal ze cluter and equal ze ample per cluter. When there no repone error, the collaped random varable can be ued to develop the ame predctor of a lnear combnaton of PSU mean a that obtaned by Stanek and Snger (004). Our goal to ee hether or not e loe nformaton n dong th collapng by applyng the Rao-Bellhoue theorem. Frt, e fnd that an unbaed predctor of T ung Y p can be obtaned only f amplng of cluter th probablty proportonal to ze. baed on. We proceed n a mlar manner further collapng of the random varable to a et of random varable, th one varable for the ample SSU and one for the remanng SSU n each PSU. Th can be accomplhed by er(would t be poble to collape thee random varable further?) p 3.. Predctng a Parameter for a PSU Ung Collapng Expanded RP Random Varable C07ed3.doc /9/007 :37 PM 5

19 Y I We partton Y p nto the frt n random varable correpondng to the ample,, and the remanng random varable, Y II to predct T = gy I I + giiyii, here g I = ci and II = ( II ) c = c c, here ci an n vector of contant. Explctly, the parttoned RP model defned by Y I XI Y I Y I E I = μ + Eξ E ξξ + YII XII YII YII EII g c c, and ( I II ) n m = here XI = n m = and XII =, random effect ( M m) = In fd vec( UI Eξ ( U )) I = Y I Y I are gven by E E n fd vec( II Eξ ( )) ξ II ξξ = I U U =, YII YII I ( f) d vec Eξ ( ) = U U m E I Y I Y I here f =, d = Mμ, = E ξ M EII YII Y, and U = ( UI U II ), II UI = (( U) ) = ( U U U n ) and UII = (( U )) = ( Un+ Un+ U ). We Y VI VI, II I partton the varance n a mlar manner, repreentng t by varξξ = Y II VIII, VII * here V I = n n fd fd + n f e = = = I J P I v,, V III, J n ( ) n ( n) fd f d I 0 J n ( n) n P = = = * fd fd P n f ve = = I 0 n ( n) = C07ed3.doc /9/007 :37 PM 6

20 I n J n n 0 I J ( n) n ( n) fd P fd fd ( f) d = = P = = I n 0 I n ( n) n * VII = 0 n ( n) + 0 f ( ) v n n e = J P I ( n) n I I n ( f) d ( f) d P = = ( f) dp fd = = * f Mσ and ve =. f We develop an expreon for the bet lnear unbaed predctor of T next. The predctor a lnear functon of the ample, T ˆ = LY. Snce ˆ Y I T T = ( L g I g II ), the unbaed contrant gven by YII ( ) 0 L g I XI g IIX II =. Mnmzng var ( ˆ ξξ T T) accountng for the unbaed contrant ung Lagrange multpler, reult n the famlar oluton, I ( ), ( ) ˆ L = gi + VI VI XI XI VI X I XI VI VI IIgII + VI XI XI VI XI XIIgI I. Th reult mplfe to (ee c06ed56.doc, p4 and c07ed0.doc p) ˆ k n L = P c + + * n I c n cii n = f n = f n ( ) here k k k k d, * * = * d * = k k d = d v * + ( ) e, k k = =, c II = c and n = + n c = = c. The predctor T ˆ = LY ˆ I can be expreed a (ee page 6 of c07ed0.doc) C07ed3.doc /9/007 :37 PM 7

21 n ( ) ( ) ( ) n Tˆ = c Yˆ Yˆ + c I M Y + c I M f Y I II I = n = n = here * = MkYI = Yˆ U, Yˆ n = Yˆ, n = I n = U an ndcator ncluon random = varable for cluter n the ample, and Y I m = Y j m j =. An expreon for the expected mean quared error (EMSE) of the predctor can be developed drectly ung expreon for the parttoned varance, and mplfy to (ee c07ed7.doc, p5) n ( ˆ ) ( ) ( c ) * * * I kd kd, d e e = = n = c c ( c nci ) σ d = n varξξ T T = c c σ σ + k v + v + + here c I n n = = c, μd = d, = μ * kd kd =, * =, σ = ( kd μ ) kd kd = σd = ( d ) * μ and σ ( )( ) d kd, d = kd μkd d μd =. = When predctng a PSU mean, =, and the predctor mplfe to M ˆ ( ) ˆ T = IYI + Y Yˆ f n, and to ˆ T = I( YI) n = n hen > n. The EMSE of the = ample PSU mean predctor (hen n) mplfe to (ee c07ed5.doc, page 3) ( ˆ n * * varξξ T T) = ( ) ( ) k k n μ μ = =, * σ + + ( n ) k ( f) n m = C07ed3.doc /9/007 :37 PM 8

22 hle the EMSE of a PSU not n the ample gven by 4. COMPARISO OF EMSE ( ˆ n + T T) = σ + ( f ) σ varξξ. n n = m 5. EMPIRICAL PREDICTOR SIMULTIO 6. APPLICATIO 7. DISCUSSIO OLD STUFF 4. APPLICATIO Table. Predctor of latent value of a realzed PSU Mean baed on Dfferent model Predctor Target Sample SSU Remanng SSU Y Smple Mean μ U = * * cy + ( c ) Y P ˆMM Mxed Model P ˆSS Scott&Smth Model P P ˆ μ + k ( ˆ Y μ ) f Y + ( f ) ˆ * * ( ˆ * μ + k Y μ ) P ˆ* RP (PPS) P * fy + ( f ) Y + k ( Y Y) C07ed3.doc /9/007 :37 PM 9

23 P ˆ RP (General) P cy + ( c) Y + k ( Y Y) C07ed3.doc /9/007 :37 PM 0

24 REFERECES Bolfarne, H., and Zack, S. (99), Predcton Theory for Fnte Populaton, e York: Sprnger-Verlag. Cael, C.M., Sarndal, C.E., and Wretman, J.H. (977), Foundaton of Inference n Survey Samplng, e York: Wley. Cochran, W. (977), Survey Samplng, e York: Wley. Devlle, J.C., and Sarndal, C.E. (99), Calbraton Etmaton n Survey Samplng, Journal of the Amercan Stattcal Aocaton, 87, Dggle, P. L., Heagerty, P., Lang, K. Y. and Zeger, S. (00), Analy of Longtudnal Data, Oxford Unverty Pre. Ghoh, M. and Lahr, P. (987), Robut Emprcal Baye Etmaton of Mean from Stratfed Sample, Journal of the Amercan Stattcal Aocaton, 8,53-6. Goldberger, A. S. (96), Bet Lnear Unbaed Predcton n the Generalzed Lnear Regreon Model, Journal of the Amercan Stattcal Aocaton, 57, C07ed3.doc /9/007 :37 PM

25 Graybll, F. A. (983), Matrce th applcaton n tattc, Belmont, Calforna: Wadorth Internatonal. Henderon, C.R. (984), Applcaton of Lnear Model n Anmal Breedng, Guelph, Canada: Unverty of Guelph. Henderon, C. R., Kempthorne, O., Searle, S. R. and von Krogk, C. M., (959), The Etmaton of Envronmental and Genetc Trend from Record Subject to Cullng, Bometrc, 5, 9-8. Hnkelmann, K., and Kempthorne, O. (994), Degn and Analy of Experment, Vol., Introducton to Expermental Degn, e York: Wley. L, W. (003), Ue of random Permutaton Model n rate Standardzaton and Calbraton, unpublhed doctoral the, Unverty of Maachuett, Maachuett. McCulloch, C. E. and Searle, S. R. (00), Generalzed, Lnear, and Mxed Model, e York: John Wley and Son. McLean, R. A., Sander, W. L. and Stroup, W. W. (99), A Unfed Approach to Mxed Lnear Model, The Amercan Stattcan, 45(), C07ed3.doc /9/007 :37 PM

26 Ockene, I. S., Hebert, J. R., Ockene, J. K., Sapera, G. M., colo, R., Merram, P.A. and Hurley, T. G. (999), Effect of Phycan-delvered utrton Counelng Tranng and an Offce-upport Program on Saturated Fat Intake, Weght, and Serum Lpd Meaurement n a Hyperlpdemc Populaton: Worceter Area Tral for Counelng n Hyperlpdema (WATCH), Archve of Internal Medcne, Apr, 59(7), Rao, J..K. (003), Small Area Etmaton, e York: Wley. Robnon, G. K. (99). That BLUP a Good Thng: the Etmaton of Random Effect, Stattcal Scence, 6(), 5-5. Royall, R. M. (976), The Lnear Leat-quare Predcton Approach to To-tage Samplng, Journal of the Amercan Stattcal Aocaton, 7, Sarndal, C-E, Senon, B., and Wretman, J. (99), Model Ated Survey Samplng, e York: Sprnger-Verlag. Scott, A. and T. M. F. Smth (969), Etmaton n Mult-tage Survey, Journal of the Amercan Stattcal Aocaton, 64(37), C07ed3.doc /9/007 :37 PM 3

27 Searle, S. R., Caella, G. and McCulloch, C. E. (99), Varance Component. e York: Wley. Stanek, E. J. III and Snger, J. M. (004), Predctng Random Effect from Fnte Populaton Clutered Sample th Repone Error, Journal of the Amercan Stattcal Aocaton, 99, Vallant, R., Dorfman, H. A. and Royall, R. M. (000), Fnte Populaton Samplng and Inference, e York: Wley. Verbeke, G., and Molenbergh, G. (000), Lnear Mxed Model for Longtudnal Data, e York: Sprnger-Verlag. C07ed3.doc /9/007 :37 PM 4

Predicting Random Effects from a Finite Population of Unequal Size Clusters based on Two Stage Sampling

Predicting Random Effects from a Finite Population of Unequal Size Clusters based on Two Stage Sampling Predctng Random Effect from a Fnte Populaton of Unequal Sze Cluter baed on Two Stage Samplng Edward J. Stanek Department of Publc Health 40 Arnold Houe Unverty of aachuett 75 orth Pleaant Street Amhert,

More information

Team. Outline. Statistics and Art: Sampling, Response Error, Mixed Models, Missing Data, and Inference

Team. Outline. Statistics and Art: Sampling, Response Error, Mixed Models, Missing Data, and Inference Team Stattc and Art: Samplng, Repone Error, Mxed Model, Mng Data, and nference Ed Stanek Unverty of Maachuett- Amhert, USA 9/5/8 9/5/8 Outlne. Example: Doe-repone Model n Toxcology. ow to Predct Realzed

More information

Specification -- Assumptions of the Simple Classical Linear Regression Model (CLRM) 1. Introduction

Specification -- Assumptions of the Simple Classical Linear Regression Model (CLRM) 1. Introduction ECONOMICS 35* -- NOTE ECON 35* -- NOTE Specfcaton -- Aumpton of the Smple Clacal Lnear Regreon Model (CLRM). Introducton CLRM tand for the Clacal Lnear Regreon Model. The CLRM alo known a the tandard lnear

More information

Predictors Using Partially Conditional 2 Stage Response Error Ed Stanek

Predictors Using Partially Conditional 2 Stage Response Error Ed Stanek Predctor ng Partally Condtonal Stage Repone Error Ed Stane TRODCTO We explore the predctor that wll relt n a mple random ample wth repone error when a dfferent model potlated The model we decrbe here cloely

More information

Estimation of Finite Population Total under PPS Sampling in Presence of Extra Auxiliary Information

Estimation of Finite Population Total under PPS Sampling in Presence of Extra Auxiliary Information Internatonal Journal of Stattc and Analy. ISSN 2248-9959 Volume 6, Number 1 (2016), pp. 9-16 Reearch Inda Publcaton http://www.rpublcaton.com Etmaton of Fnte Populaton Total under PPS Samplng n Preence

More information

Additional File 1 - Detailed explanation of the expression level CPD

Additional File 1 - Detailed explanation of the expression level CPD Addtonal Fle - Detaled explanaton of the expreon level CPD A mentoned n the man text, the man CPD for the uterng model cont of two ndvdual factor: P( level gen P( level gen P ( level gen 2 (.).. CPD factor

More information

Statistical Properties of the OLS Coefficient Estimators. 1. Introduction

Statistical Properties of the OLS Coefficient Estimators. 1. Introduction ECOOMICS 35* -- OTE 4 ECO 35* -- OTE 4 Stattcal Properte of the OLS Coeffcent Etmator Introducton We derved n ote the OLS (Ordnary Leat Square etmator ˆβ j (j, of the regreon coeffcent βj (j, n the mple

More information

Estimating Realized Random Effects in Mixed Models

Estimating Realized Random Effects in Mixed Models Etimating Realized Random Effect in Mixed Model (Can parameter for realized random effect be etimated in mixed model?) Edward J. Stanek III Dept of Biotatitic and Epidemiology, UMASS, Amhert, MA USA Julio

More information

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson

More information

Chapter 6 The Effect of the GPS Systematic Errors on Deformation Parameters

Chapter 6 The Effect of the GPS Systematic Errors on Deformation Parameters Chapter 6 The Effect of the GPS Sytematc Error on Deformaton Parameter 6.. General Beutler et al., (988) dd the frt comprehenve tudy on the GPS ytematc error. Baed on a geometrc approach and aumng a unform

More information

Inference for Two Stage Cluster Sampling: Equal SSU per PSU. Projections of SSU Random Variables on Each SSU selection.

Inference for Two Stage Cluster Sampling: Equal SSU per PSU. Projections of SSU Random Variables on Each SSU selection. Inference for Two Stage Cluter Sampling: Equal SSU per PSU Projection of SSU andom Variable on Eac SSU election By Ed Stanek Introduction We review etimating equation for PSU mean in a two tage cluter

More information

MULTIPLE REGRESSION ANALYSIS For the Case of Two Regressors

MULTIPLE REGRESSION ANALYSIS For the Case of Two Regressors MULTIPLE REGRESSION ANALYSIS For the Cae of Two Regreor In the followng note, leat-quare etmaton developed for multple regreon problem wth two eplanator varable, here called regreor (uch a n the Fat Food

More information

The multivariate Gaussian probability density function for random vector X (X 1,,X ) T. diagonal term of, denoted

The multivariate Gaussian probability density function for random vector X (X 1,,X ) T. diagonal term of, denoted Appendx Proof of heorem he multvarate Gauan probablty denty functon for random vector X (X,,X ) px exp / / x x mean and varance equal to the th dagonal term of, denoted he margnal dtrbuton of X Gauan wth

More information

Chapter 11. Supplemental Text Material. The method of steepest ascent can be derived as follows. Suppose that we have fit a firstorder

Chapter 11. Supplemental Text Material. The method of steepest ascent can be derived as follows. Suppose that we have fit a firstorder S-. The Method of Steepet cent Chapter. Supplemental Text Materal The method of teepet acent can be derved a follow. Suppoe that we have ft a frtorder model y = β + β x and we wh to ue th model to determne

More information

Confidence intervals for the difference and the ratio of Lognormal means with bounded parameters

Confidence intervals for the difference and the ratio of Lognormal means with bounded parameters Songklanakarn J. Sc. Technol. 37 () 3-40 Mar.-Apr. 05 http://www.jt.pu.ac.th Orgnal Artcle Confdence nterval for the dfference and the rato of Lognormal mean wth bounded parameter Sa-aat Nwtpong* Department

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Improvements on Waring s Problem

Improvements on Waring s Problem Improvement on Warng Problem L An-Png Bejng, PR Chna apl@nacom Abtract By a new recurve algorthm for the auxlary equaton, n th paper, we wll gve ome mprovement for Warng problem Keyword: Warng Problem,

More information

2.3 Least-Square regressions

2.3 Least-Square regressions .3 Leat-Square regreon Eample.10 How do chldren grow? The pattern of growth vare from chld to chld, o we can bet undertandng the general pattern b followng the average heght of a number of chldren. Here

More information

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

Alpha Risk of Taguchi Method with L 18 Array for NTB Type QCH by Simulation

Alpha Risk of Taguchi Method with L 18 Array for NTB Type QCH by Simulation Proceedng of the World Congre on Engneerng 00 Vol II WCE 00, July -, 00, London, U.K. Alpha Rk of Taguch Method wth L Array for NTB Type QCH by Smulaton A. Al-Refae and M.H. L Abtract Taguch method a wdely

More information

Harmonic oscillator approximation

Harmonic oscillator approximation armonc ocllator approxmaton armonc ocllator approxmaton Euaton to be olved We are fndng a mnmum of the functon under the retrcton where W P, P,..., P, Q, Q,..., Q P, P,..., P, Q, Q,..., Q lnwgner functon

More information

Pattern Classification

Pattern Classification Pattern Classfcaton All materals n these sldes ere taken from Pattern Classfcaton (nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wley & Sons, 000 th the permsson of the authors and the publsher

More information

AP Statistics Ch 3 Examining Relationships

AP Statistics Ch 3 Examining Relationships Introducton To tud relatonhp between varable, we mut meaure the varable on the ame group of ndvdual. If we thnk a varable ma eplan or even caue change n another varable, then the eplanator varable and

More information

Collapsing to Sample and Remainder Means. Ed Stanek. In order to collapse the expanded random variables to weighted sample and remainder

Collapsing to Sample and Remainder Means. Ed Stanek. In order to collapse the expanded random variables to weighted sample and remainder Collapg to Saple ad Reader Mea Ed Staek Collapg to Saple ad Reader Average order to collape the expaded rado varable to weghted aple ad reader average, we pre-ultpled by ( M C C ( ( M C ( M M M ( M M M,

More information

Scattering of two identical particles in the center-of. of-mass frame. (b)

Scattering of two identical particles in the center-of. of-mass frame. (b) Lecture # November 5 Scatterng of two dentcal partcle Relatvtc Quantum Mechanc: The Klen-Gordon equaton Interpretaton of the Klen-Gordon equaton The Drac equaton Drac repreentaton for the matrce α and

More information

Small signal analysis

Small signal analysis Small gnal analy. ntroducton Let u conder the crcut hown n Fg., where the nonlnear retor decrbed by the equaton g v havng graphcal repreentaton hown n Fg.. ( G (t G v(t v Fg. Fg. a D current ource wherea

More information

Pythagorean triples. Leen Noordzij.

Pythagorean triples. Leen Noordzij. Pythagorean trple. Leen Noordz Dr.l.noordz@leennoordz.nl www.leennoordz.me Content A Roadmap for generatng Pythagorean Trple.... Pythagorean Trple.... 3 Dcuon Concluon.... 5 A Roadmap for generatng Pythagorean

More information

Lecture 6: Introduction to Linear Regression

Lecture 6: Introduction to Linear Regression Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6

More information

Optimal inference of sameness Supporting information

Optimal inference of sameness Supporting information Optmal nference of amene Supportng nformaton Content Decon rule of the optmal oberver.... Unequal relablte.... Equal relablte... 5 Repone probablte of the optmal oberver... 6. Equal relablte... 6. Unequal

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

Introduction to Interfacial Segregation. Xiaozhe Zhang 10/02/2015

Introduction to Interfacial Segregation. Xiaozhe Zhang 10/02/2015 Introducton to Interfacal Segregaton Xaozhe Zhang 10/02/2015 Interfacal egregaton Segregaton n materal refer to the enrchment of a materal conttuent at a free urface or an nternal nterface of a materal.

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

Predicting Random Effects in Group Randomized Trials. Edward J. Stanek III. PredictingRandomEffects1-stanek.doc 10/29/2003 8:55 AM

Predicting Random Effects in Group Randomized Trials. Edward J. Stanek III. PredictingRandomEffects1-stanek.doc 10/29/2003 8:55 AM Predicting Random Effect in Group Randomized Trial Edward J. Stanek III Abtract The main objective in a group randomized trial i a comparion between treatment. Often, there i interet in the expected repone

More information

Supporting Information for: The Regionalization of National-Scale SPARROW Models for Stream Nutrients

Supporting Information for: The Regionalization of National-Scale SPARROW Models for Stream Nutrients Supportng Informaton for: The Regonalzaton of atonal-scale SPRROW Model for Stream utrent regory E. Scharz, Rchard B. lexer, Rchard. Smth, Stephen D. Preton Decrpton of the SPRROW method The SPRROW aterhed

More information

A Result on a Cyclic Polynomials

A Result on a Cyclic Polynomials Gen. Math. Note, Vol. 6, No., Feruary 05, pp. 59-65 ISSN 9-78 Copyrght ICSRS Pulcaton, 05.-cr.org Avalale free onlne at http:.geman.n A Reult on a Cyclc Polynomal S.A. Wahd Department of Mathematc & Stattc

More information

Start Point and Trajectory Analysis for the Minimal Time System Design Algorithm

Start Point and Trajectory Analysis for the Minimal Time System Design Algorithm Start Pont and Trajectory Analy for the Mnmal Tme Sytem Degn Algorthm ALEXANDER ZEMLIAK, PEDRO MIRANDA Department of Phyc and Mathematc Puebla Autonomou Unverty Av San Claudo /n, Puebla, 757 MEXICO Abtract:

More information

Chapter 5 Multilevel Models

Chapter 5 Multilevel Models Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level

More information

Image Registration for a Series of Chest Radiograph Images

Image Registration for a Series of Chest Radiograph Images Proceedng of the 5th WE Internatonal Conference on gnal Proceng, Itanbul, Turkey, May 7-9, 006 (pp179-184) Image Regtraton for a ere of Chet Radograph Image Omar Mohd. Rjal*, Norlza Mohd. Noor, hee Lee

More information

A Novel Approach for Testing Stability of 1-D Recursive Digital Filters Based on Lagrange Multipliers

A Novel Approach for Testing Stability of 1-D Recursive Digital Filters Based on Lagrange Multipliers Amercan Journal of Appled Scence 5 (5: 49-495, 8 ISSN 546-939 8 Scence Publcaton A Novel Approach for Tetng Stablty of -D Recurve Dgtal Flter Baed on Lagrange ultpler KRSanth, NGangatharan and Ponnavakko

More information

Variance Estimation for Measures of Income Inequality and Polarization ± The Estimating Equations Approach

Variance Estimation for Measures of Income Inequality and Polarization ± The Estimating Equations Approach Journal of Of cal Stattc, Vol. 13, No. 1, 1997, pp. 41±58 Varance Etmaton for Meaure of Income Inequalty and Polarzaton ± The Etmatng Equaton Approach Mlorad S. KovacÆevc 1 and Davd A. Bnder 2 The etmatng

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Supporting Information. Hydroxyl Radical Production by H 2 O 2 -Mediated. Conditions

Supporting Information. Hydroxyl Radical Production by H 2 O 2 -Mediated. Conditions Supportng Informaton Hydroxyl Radcal Producton by H 2 O 2 -Medated Oxdaton of Fe(II) Complexed by Suwannee Rver Fulvc Acd Under Crcumneutral Frehwater Condton Chrtopher J. Mller, Andrew L. Roe, T. Davd

More information

Natalie Shlomo, Chris J. Skinner and Barry Schouten Estimation of an indicator of the representativeness of survey response

Natalie Shlomo, Chris J. Skinner and Barry Schouten Estimation of an indicator of the representativeness of survey response Natale Shlomo, Chr J. Sknner and Barry Schouten Etmaton of an ndcator of the repreentatvene of urvey repone Artcle (Accepted veron) (Refereed) Orgnal ctaton: Shlomo, Natale and Sknner, Chr J. and Schouten,

More information

and decompose in cycles of length two

and decompose in cycles of length two Permutaton of Proceedng of the Natona Conference On Undergraduate Reearch (NCUR) 006 Domncan Unverty of Caforna San Rafae, Caforna Apr - 4, 007 that are gven by bnoma and decompoe n cyce of ength two Yeena

More information

Chapter 9: Statistical Inference and the Relationship between Two Variables

Chapter 9: Statistical Inference and the Relationship between Two Variables Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,

More information

Negative Binomial Regression

Negative Binomial Regression STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...

More information

A Tutorial on Data Reduction. Linear Discriminant Analysis (LDA) Shireen Elhabian and Aly A. Farag. University of Louisville, CVIP Lab September 2009

A Tutorial on Data Reduction. Linear Discriminant Analysis (LDA) Shireen Elhabian and Aly A. Farag. University of Louisville, CVIP Lab September 2009 A utoral on Data Reducton Lnear Dscrmnant Analss (LDA) hreen Elhaban and Al A Farag Unverst of Lousvlle, CVIP Lab eptember 009 Outlne LDA objectve Recall PCA No LDA LDA o Classes Counter eample LDA C Classes

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

JOLTS Variance Estimation: Accounting for CES-JOLTS Alignment

JOLTS Variance Estimation: Accounting for CES-JOLTS Alignment JOLTS Varance Estmaton: Accountng for CES-JOLTS Algnment Mark Cranksha*, Mchael Sverchkov* Januar 21, 2016 Abstract The Bureau of Labor Statstcs produces a monthl measure of labor demand and emploment

More information

Extended Prigogine Theorem: Method for Universal Characterization of Complex System Evolution

Extended Prigogine Theorem: Method for Universal Characterization of Complex System Evolution Extended Prgogne Theorem: Method for Unveral Characterzaton of Complex Sytem Evoluton Sergey amenhchkov* Mocow State Unverty of M.V. Lomonoov, Phycal department, Rua, Mocow, Lennke Gory, 1/, 119991 Publhed

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study

More information

Chapter 13: Multiple Regression

Chapter 13: Multiple Regression Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to

More information

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an

More information

Primer on High-Order Moment Estimators

Primer on High-Order Moment Estimators Prmer on Hgh-Order Moment Estmators Ton M. Whted July 2007 The Errors-n-Varables Model We wll start wth the classcal EIV for one msmeasured regressor. The general case s n Erckson and Whted Econometrc

More information

A Bound for the Relative Bias of the Design Effect

A Bound for the Relative Bias of the Design Effect A Bound for the Relatve Bas of the Desgn Effect Alberto Padlla Banco de Méxco Abstract Desgn effects are typcally used to compute sample szes or standard errors from complex surveys. In ths paper, we show

More information

ENTROPY BOUNDS USING ARITHMETIC- GEOMETRIC-HARMONIC MEAN INEQUALITY. Guru Nanak Dev University Amritsar, , INDIA

ENTROPY BOUNDS USING ARITHMETIC- GEOMETRIC-HARMONIC MEAN INEQUALITY. Guru Nanak Dev University Amritsar, , INDIA Internatonal Journal of Pure and Appled Mathematc Volume 89 No. 5 2013, 719-730 ISSN: 1311-8080 prnted veron; ISSN: 1314-3395 on-lne veron url: http://.jpam.eu do: http://dx.do.org/10.12732/jpam.v895.8

More information

GREY PREDICTIVE PROCESS CONTROL CHARTS

GREY PREDICTIVE PROCESS CONTROL CHARTS The 4th Internatonal Conference on Qualty Relablty Augut 9-th, 2005 Bejng, Chna GREY PREDICTIVE PROCESS CONTROL CHARTS RENKUAN GUO, TIM DUNNE Department of Stattcal Scence, Unverty of Cape Town, Prvate

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

This is a repository copy of An iterative orthogonal forward regression algorithm.

This is a repository copy of An iterative orthogonal forward regression algorithm. Th a repotory copy of An teratve orthogonal forward regreon algorthm. Whte Roe Reearch Onlne URL for th paper: http://eprnt.whteroe.ac.uk/0735/ Veron: Accepted Veron Artcle: Guo, Y., Guo, L. Z., Bllng,

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

Verification of Selected Precision Parameters of the Trimble S8 DR Plus Robotic Total Station

Verification of Selected Precision Parameters of the Trimble S8 DR Plus Robotic Total Station 81 Verfcaton of Selected Precon Parameter of the Trmble S8 DR Plu Robotc Total Staton Sokol, Š., Bajtala, M. and Ježko, J. Slovak Unverty of Technology, Faculty of Cvl Engneerng, Radlnkého 11, 81368 Bratlava,

More information

A METHOD TO REPRESENT THE SEMANTIC DESCRIPTION OF A WEB SERVICE BASED ON COMPLEXITY FUNCTIONS

A METHOD TO REPRESENT THE SEMANTIC DESCRIPTION OF A WEB SERVICE BASED ON COMPLEXITY FUNCTIONS UPB Sc Bull, Sere A, Vol 77, I, 5 ISSN 3-77 A METHOD TO REPRESENT THE SEMANTIC DESCRIPTION OF A WEB SERVICE BASED ON COMPLEXITY FUNCTIONS Andre-Hora MOGOS, Adna Magda FLOREA Semantc web ervce repreent

More information

Root Locus Techniques

Root Locus Techniques Root Locu Technque ELEC 32 Cloed-Loop Control The control nput u t ynthezed baed on the a pror knowledge of the ytem plant, the reference nput r t, and the error gnal, e t The control ytem meaure the output,

More information

Conditional and unconditional models in modelassisted estimation of finite population totals

Conditional and unconditional models in modelassisted estimation of finite population totals Unversty of Wollongong Research Onlne Faculty of Informatcs - Papers Archve) Faculty of Engneerng and Informaton Scences 2011 Condtonal and uncondtonal models n modelasssted estmaton of fnte populaton

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

Modeling of Wave Behavior of Substrate Noise Coupling for Mixed-Signal IC Design

Modeling of Wave Behavior of Substrate Noise Coupling for Mixed-Signal IC Design Modelng of Wave Behavor of Subtrate Noe Couplng for Mxed-Sgnal IC Degn Georgo Veron, Y-Chang Lu, and Robert W. Dutton Center for Integrated Sytem, Stanford Unverty, Stanford, CA 9435 yorgo@gloworm.tanford.edu

More information

arxiv: v1 [cs.gt] 15 Jan 2019

arxiv: v1 [cs.gt] 15 Jan 2019 Model and algorthm for tme-content rk-aware Markov game Wenje Huang, Pham Vet Ha and Wllam B. Hakell January 16, 2019 arxv:1901.04882v1 [c.gt] 15 Jan 2019 Abtract In th paper, we propoe a model for non-cooperatve

More information

Two Approaches to Proving. Goldbach s Conjecture

Two Approaches to Proving. Goldbach s Conjecture Two Approache to Provng Goldbach Conecture By Bernard Farley Adved By Charle Parry May 3 rd 5 A Bref Introducton to Goldbach Conecture In 74 Goldbach made h mot famou contrbuton n mathematc wth the conecture

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

The Essential Dynamics Algorithm: Essential Results

The Essential Dynamics Algorithm: Essential Results @ MIT maachuett nttute of technology artfcal ntellgence laboratory The Eental Dynamc Algorthm: Eental Reult Martn C. Martn AI Memo 003-014 May 003 003 maachuett nttute of technology, cambrdge, ma 0139

More information

Improvements on Waring s Problem

Improvements on Waring s Problem Imrovement on Warng Problem L An-Png Bejng 85, PR Chna al@nacom Abtract By a new recurve algorthm for the auxlary equaton, n th aer, we wll gve ome mrovement for Warng roblem Keyword: Warng Problem, Hardy-Lttlewood

More information

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) ,

A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS. Dr. Derald E. Wentzien, Wesley College, (302) , A LINEAR PROGRAM TO COMPARE MULTIPLE GROSS CREDIT LOSS FORECASTS Dr. Derald E. Wentzen, Wesley College, (302) 736-2574, wentzde@wesley.edu ABSTRACT A lnear programmng model s developed and used to compare

More information

Method Of Fundamental Solutions For Modeling Electromagnetic Wave Scattering Problems

Method Of Fundamental Solutions For Modeling Electromagnetic Wave Scattering Problems Internatonal Workhop on MehFree Method 003 1 Method Of Fundamental Soluton For Modelng lectromagnetc Wave Scatterng Problem Der-Lang Young (1) and Jhh-We Ruan (1) Abtract: In th paper we attempt to contruct

More information

Multivariate Ratio Estimation With Known Population Proportion Of Two Auxiliary Characters For Finite Population

Multivariate Ratio Estimation With Known Population Proportion Of Two Auxiliary Characters For Finite Population Multvarate Rato Estmaton Wth Knon Populaton Proporton Of To Auxlar haracters For Fnte Populaton *Raesh Sngh, *Sachn Mal, **A. A. Adeara, ***Florentn Smarandache *Department of Statstcs, Banaras Hndu Unverst,Varanas-5,

More information

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6 Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.

More information

APPROXIMATE FUZZY REASONING BASED ON INTERPOLATION IN THE VAGUE ENVIRONMENT OF THE FUZZY RULEBASE AS A PRACTICAL ALTERNATIVE OF THE CLASSICAL CRI

APPROXIMATE FUZZY REASONING BASED ON INTERPOLATION IN THE VAGUE ENVIRONMENT OF THE FUZZY RULEBASE AS A PRACTICAL ALTERNATIVE OF THE CLASSICAL CRI Kovác, Sz., Kóczy, L.T.: Approxmate Fuzzy Reaonng Baed on Interpolaton n the Vague Envronment of the Fuzzy Rulebae a a Practcal Alternatve of the Clacal CRI, Proceedng of the 7 th Internatonal Fuzzy Sytem

More information

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression 11 MACHINE APPLIED MACHINE LEARNING LEARNING MACHINE LEARNING Gaussan Mture Regresson 22 MACHINE APPLIED MACHINE LEARNING LEARNING Bref summary of last week s lecture 33 MACHINE APPLIED MACHINE LEARNING

More information

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε Chapter 3 Secton 3.1 Model Assumptons: Multple Regresson Model Predcton Equaton Std. Devaton of Error Correlaton Matrx Smple Lnear Regresson: 1.) Lnearty.) Constant Varance 3.) Independent Errors 4.) Normalty

More information

USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE

USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE STATISTICA, anno LXXV, n. 4, 015 USE OF DOUBLE SAMPLING SCHEME IN ESTIMATING THE MEAN OF STRATIFIED POPULATION UNDER NON-RESPONSE Manoj K. Chaudhary 1 Department of Statstcs, Banaras Hndu Unversty, Varanas,

More information

Support Vector Machines CS434

Support Vector Machines CS434 Support Vector Machnes CS434 Lnear Separators Many lnear separators exst that perfectly classfy all tranng examples Whch of the lnear separators s the best? Intuton of Margn Consder ponts A, B, and C We

More information

Discrete Simultaneous Perturbation Stochastic Approximation on Loss Function with Noisy Measurements

Discrete Simultaneous Perturbation Stochastic Approximation on Loss Function with Noisy Measurements 0 Amercan Control Conference on O'Farrell Street San Francco CA USA June 9 - July 0 0 Dcrete Smultaneou Perturbaton Stochatc Approxmaton on Lo Functon wth Noy Meaurement Q Wang and Jame C Spall Abtract

More information

2 More examples with details

2 More examples with details Physcs 129b Lecture 3 Caltech, 01/15/19 2 More examples wth detals 2.3 The permutaton group n = 4 S 4 contans 4! = 24 elements. One s the dentty e. Sx of them are exchange of two objects (, j) ( to j and

More information

Decomposing Travel Times Measured by Probe-based Traffic Monitoring Systems to Individual Road Segments

Decomposing Travel Times Measured by Probe-based Traffic Monitoring Systems to Individual Road Segments Decompong Travel Tme Meaured by Probe-baed Traffc Montorng Sytem to Indvdual Road Segment Correpondng Author Bruce Hellnga PhD PEng Aocate Profeor Dept. of Cvl and Envronmental Engneerng Unverty of Waterloo

More information

Estimation of a proportion under a certain two-stage sampling design

Estimation of a proportion under a certain two-stage sampling design Etmaton of a roorton under a certan two-tage amng degn Danutė Kraavcatė nttute of athematc and nformatc Lthuana Stattc Lthuana Lthuana e-ma: raav@tmt Abtract The am of th aer to demontrate wth exame that

More information

A Comparative Study for Estimation Parameters in Panel Data Model

A Comparative Study for Estimation Parameters in Panel Data Model A Comparatve Study for Estmaton Parameters n Panel Data Model Ahmed H. Youssef and Mohamed R. Abonazel hs paper examnes the panel data models when the regresson coeffcents are fxed random and mxed and

More information

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function

A Particle Filter Algorithm based on Mixing of Prior probability density and UKF as Generate Importance Function Advanced Scence and Technology Letters, pp.83-87 http://dx.do.org/10.14257/astl.2014.53.20 A Partcle Flter Algorthm based on Mxng of Pror probablty densty and UKF as Generate Importance Functon Lu Lu 1,1,

More information

Outline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3.

Outline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3. Outlne 3. Multple Regresson Analyss: Estmaton I. Motvaton II. Mechancs and Interpretaton of OLS Read Wooldrdge (013), Chapter 3. III. Expected Values of the OLS IV. Varances of the OLS V. The Gauss Markov

More information

Marginal Effects in Probit Models: Interpretation and Testing. 1. Interpreting Probit Coefficients

Marginal Effects in Probit Models: Interpretation and Testing. 1. Interpreting Probit Coefficients ECON 5 -- NOE 15 Margnal Effects n Probt Models: Interpretaton and estng hs note ntroduces you to the two types of margnal effects n probt models: margnal ndex effects, and margnal probablty effects. It

More information

The Mixed Models Controversy Revisited

The Mixed Models Controversy Revisited The Mxed Models Controversy Revsted Vvana eatrz Lencna Departamento de Metodología e Investgacón, FM Unversdad Naconal de Tucumán Julo da Motta Snger Departamento de Estatístca, IME Unversdade de São Paulo

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

Lecture outline. Optimal Experimental Design: Where to find basic information. Theory of D-optimal design

Lecture outline. Optimal Experimental Design: Where to find basic information. Theory of D-optimal design v I N N O V A T I O N L E C T U R E (I N N O l E C) Lecture outlne Bndng and Knetc for Expermental Bologt Lecture 8 Optmal degn of experment The problem: How hould we plan an experment uch we learn the

More information

Adaptive Centering with Random Effects in Studies of Time-Varying Treatments. by Stephen W. Raudenbush University of Chicago.

Adaptive Centering with Random Effects in Studies of Time-Varying Treatments. by Stephen W. Raudenbush University of Chicago. Adaptve Centerng wth Random Effect n Stde of Tme-Varyng Treatment by Stephen W. Radenbh Unverty of Chcago Abtract Of wdepread nteret n ocal cence are obervatonal tde n whch entte (peron chool tate contre

More information

Variable Structure Control ~ Basics

Variable Structure Control ~ Basics Varable Structure Control ~ Bac Harry G. Kwatny Department of Mechancal Engneerng & Mechanc Drexel Unverty Outlne A prelmnary example VS ytem, ldng mode, reachng Bac of dcontnuou ytem Example: underea

More information

Bias-correction under a semi-parametric model for small area estimation

Bias-correction under a semi-parametric model for small area estimation Bas-correcton under a sem-parametrc model for small area estmaton Laura Dumtrescu, Vctora Unversty of Wellngton jont work wth J. N. K. Rao, Carleton Unversty ICORS 2017 Workshop on Robust Inference for

More information

Learning Objectives for Chapter 11

Learning Objectives for Chapter 11 Chapter : Lnear Regresson and Correlaton Methods Hldebrand, Ott and Gray Basc Statstcal Ideas for Managers Second Edton Learnng Objectves for Chapter Usng the scatterplot n regresson analyss Usng the method

More information

Computer Control Systems

Computer Control Systems Computer Control ytem In th chapter we preent the element and the bac concept of computercontrolled ytem. The dcretaton and choce of amplng frequency wll be frt examned, followed by a tudy of dcrete-tme

More information

A NEW OPTIMAL QUADRATIC PREDICTOR OF A RESIDUAL LINEAR MODEL IN A FINITE POPULATION

A NEW OPTIMAL QUADRATIC PREDICTOR OF A RESIDUAL LINEAR MODEL IN A FINITE POPULATION 5 Augut 0. Vol. o. 005-0 JATIT & LLS. All right reerved. ISS: 99-865 www.jatit.org E-ISS: 87-395 A EW OPTIMAL QUADRATIC PREDICTOR OF A RESIDUAL LIEAR MODEL I A FIITE POPULATIO MOHAMMED EL HAJ TIRARI, ABDELLATIF

More information