Chapter 3 Experimental Design Models
|
|
- Bertram Williams
- 5 years ago
- Views:
Transcription
1 Chater 3 Exermetal Desg Models We cosder the models whch are used desgg a exermet. The exermetal codtos, exermetal setu ad the obectve of the study essetally determe that what tye of desg s to be used ad hece whch tye of desg model ca be used for the further statstcal aalyss to coclude about the decsos. These models are based o oe-way classfcato, two way classfcatos (wth or wthout teractos), etc. We dscuss them ow detal few setus whch ca be exteded further to ay order of classfcato. We dscuss them ow uder the set u of oe-way ad two-way classfcatos. t may be oted that t has already bee descrbed how to develo the lkelhood rato tests for the testg the hyothess of equalty of more tha two meas from ormal dstrbutos ad ow we wll cocetrate more o dervg the same tests through the least squares rcle uder the setu of lear regresso model.the desg matrx s assumed to be ot ecessarly of full rak ad cossts of 0 s ad s oly. Oe way classfcato: Let radom samles from ormal oulatos wth same varaces but dfferet meas ad dfferet samle szes have bee deedetly draw. Let the observatos Y follow the lear regresso model setu ad Y deotes the th observato of deedet varable Y whe effect of th level of factor s reset. The Y are deedetly ormally dstrbuted wth EY ( ) µ + α,,,...,,,,..., VY ( ) where µ s the geeral mea effect. - s fxed. - gves a dea about the geeral codtos of the exermetal uts ad treatmets. α s the effect of th level of the factor. - ca be fxed or radom. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur
2 Examle: Cosder a medce exermet whch there are three dfferet dosages of medces - mg., 5 mg., 0 mg. whch are gve to atets for cotrollg the fever. These are the 3 levels of medces, ad so deote α mg., α 5 mg., α 3 0 mg. Let Y deotes the tme take by the medce to reduce the body temerature from hgh to ormal. Suose two atets have bee gve mg. of dosage, so Y ad Y wll deote ther resoses. So we ca wrte that whe α mg s gve to the two atets, the EY ( ) µ + α ;,. Smlarly, f α 5 mg. ad α 3 0 mg. of dosages are gve to 4 ad 7 atets resectvely the the resoses follow the model EY ( ) µ + α;,,3,4 EY ( ) µ + α ;,,3, 4,5,6, Here µ deotes the geeral mea effect whch may be thought as follows: The huma body has tedecy to fght agast the fever, so the tme take by the medce to brg dow the temerature deeds o may factors lke body weght, heght, geeral health codto etc. of the atet. So µ deotes the geeral effect of all these factors whch s reset all the observatos. the termology of lear regresso model, µ deotes the tercet term whch s the value of the resose varable whe all the deedet varables are set to take value zero. exermetal desgs, the models wth tercet term are more commoly used ad so geerally we cosder these tyes of models. Also, we ca exress Y µ + α + ε;,,...,,,,..., where ε s the radom error comoet Y. t dcates the varatos due to ucotrolled causes whch ca fluece the observatos. We assume that ε s are detcally ad deedetly dstrbuted as N(0, ) wth E( ε ) 0, ( ε ) Var. Note that the geeral lear model cosdered s EY ( ) Xβ Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur
3 for whch Y ca be wrtte as EY ( ) β. Whe all the etres X are 0 s or s, the ths model ca also be re-exressed the form of EY ( ) µ + α. Ths gves rse to some more ssues. Cosder ad rewrte EY ( ) β where β + ( β β) µ + α µ β β α β β. Now let us see the chages the structure of desg matrx ad the vector of regresso coeffcets. The model EY ( ) β µ + α ca ow be rewrtte as EY ( ) X* β * Cov( Y ) where β * ( µ, α, α,..., α ) s a vector ad X X* s a ( + ) matrx, ad X deotes the earler defed desg matrx whch - frst rows as (,0,0,,0), - secod rows as (0,,0,,0) -, ad - last rows as (0,0,0,,). Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 3
4 We earler assumed that rak ( X ) but ca we also say that rak ( X *) s also the reset case? Sce the frst colum of X* s the vector sum of all ts remag colums, so rak ( X *). t s thus aaret that all the lear arametrc fuctos of α, α,..., α are ot estmable. The questo ow arses that what kd of lear arametrc fuctos are estmable? Cosder ay lear estmator L wth ay C a Now EL ( ) a EY ( ) a ( µ + α ) µ a + a α µ ( C ) + Cα. Thus C C α s estmable f ad oly f 0,.e., C α s a cotrast. Thus, geeral ether estmable. α or ay µα,, α,..., α s estmable. f t s a cotrast, the t s Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 4
5 Ths effect ad outcome ca also be see from the followg exlaato based o the estmato of arameters µα,, α,..., α. Cosder the least squares estmato ˆ, µαˆ ˆ ˆ, α,..., α of µ, α, α,..., α resectvely. Mmze the sum of squares due to ε ( y µ α ) S to obta ˆ, µαˆ ˆ,..., α. ε ' s S ( a) 0 ( y µ α ) 0 µ S ( b) 0 ( y µ α ) 0,,,...,. α Note that (a) ca be obtaed from (b) or vce versa. So (a) ad (b) are learly deedet the sese that there are ( + ) ukows ad learly deedet equatos. Cosequetly ˆ, µαˆ,..., ˆ α do ot have a uque soluto. Same ales to the maxmum lkelhood estmato of µα,,... α.. f a sde codto that ˆ α 0 or α 0 s mosed the (a) ad (b) have a uque soluto as ˆ µ y yoo, ˆ α ˆ y µ o y y oo where. case, all the samle szes are same, the the codto αˆ 0 or α 0 reduces to ˆ α 0 or α 0. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 5
6 So the model y µ + α + ε eeds to be rewrtte so that all the arameters ca be uquely estmated. Thus Y µ + α + ε ( µ + α) + ( α α) + ε * * µ + α + ε where * µ µ + α * α α α α α ad α 0 * Ths s a rearameterzed form of the lear model. Thus a lear model whe X s ot of full rak, the the arameters do ot have uque estmates. such codtos, a restrcto α 0 (or equvaletly α 0 case all s are ot same) ca be added ad the the least squares (or maxmum lkelhood) estmators obtaed are uque. The model * * EY ( ) µ * + α ; α 0 s called a rearametrzato of the orgal lear model. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 6
7 Let us ow cosder the aalyss of varace wth addtoal costrat. Let Y β + ε,,,..., ;,,..., β + ( β β) + ε µ + α + ε wth µ β β, α β β, α 0, ad ε s are detcally ad deedetly dstrbuted wth mea 0 ad varace. The ull hyothess s H : α α... α 0 0 ad the alteratve hyothess s H : atleast oe α α for all,. Ths model s a oe-way layout the sese that the observatos y ' s are assumed to be affected by oly oe treatmet effect α. So the ull hyothess s equvalet to testg the equalty of oulato meas or equvaletly the equalty of treatmet effects. We use the rcal of least squares to estmate the arameters µα,, α,... α. Mmze the error sum of squares ε ( y µ α ) E wth resect to µα,, α,..., α. The ormal equatos are obtaed as Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 7
8 E 0 ( y µ α ) 0 µ or E 0 ( y µ α ) 0 α or µ + α y () µ + α y (,,..., ). () Usg α 0 () gves G ˆ µ y y oo where G y s the grad total of all the observatos. Substtutg ˆµ () gves ˆ α ˆ y µ T ˆ µ y y o oo wheret y s the treatmet total due to th effect α,.e., total of all the observatos recevg the th treatmet ad y o y. Now the ftted model s y ˆ µ + ˆ α ad the error sum of squares after substtutg ˆµ ad ˆ α E becomes Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 8
9 E ( y ˆ µ ˆ α ) ( y yoo) ( yo yoo) ( y yoo) ( yo yoo) G T G y where the total sum of squares ( TSS ) TSS ( y y ) G y oo, ad G s called as correcto factor ( CF ). To obta a measure of varato due to treatmets, let H0 α α... α 0 be true. The the model becomes Y µ + ε,,,..., ;,,...,. Mmzg the error sum of squares E ( y µ ) wth resect to µ, the ormal equato s obtaed as E 0 ( y µ ) 0 µ or G ˆ µ y oo. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 9
10 Substtutg ˆ µ E, the error sum of squares becomes E ( y ˆ µ ) ( y y ) G y. oo Note that E : Cotas varato due to treatmet ad error both E: Cotas varato due to treatmet oly So E E: cota varato due to treatmet oly. The sum of quares due to treatmet ( SSTr ) s gve by SSTr E E SSTr ( y y ) o oo T G. The followg quatty s called the error sum of squares or sum of squares due to error (SSE) ( o). SSE y y These sum of squares forms the bass for the develomet of tools the aalyss of varace. We ca wrte TSS SSTr + SSE. The dstrbuto of degrees of freedom amog these sum of squares s as follows: The total sum of squares s based o quattes subect to the costrat that ( y yoo) 0 so TSS carres ( ) degrees of freedom. The sum of squares due to the treatmets s based o quattes subect to the costrat Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 0
11 ( yo yoo) 0so SSTr has ( ) degrees of freedom. The sum of squares due to errors s based o quattes subect to costrats ( y y ) 0,,,..., o so SSE carres ( ) degrees of freedom. Also ote that TSS SSTr + SSE, the TSS has bee dvded to two orthogoal comoets - SSTr ad SSE. Moreover, all TSS, SSTr ad SSE ca be exressed a quadratc form. Sce ε are assumed to be detcally ad deedetly dstrbuted followg N(0, ), so y are also deedetly dstrbuted followg N µ α ( +, ). Now usg the theorems 7 ad 8 wth q SSTr, q SSE, we have uder H, 0 SSTr ad SSE ~ χ ( ) χ ~ ( ). Moreover, SSTr ad SSE are deedetly dstrbuted. The mea squares s defed as the sum of squares dvded by the degrees of freedom. So the mea square due to treatmet s SSTr MSTr ad the mea square due to error s SSE MSE. Thus, uder H, 0 Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur
12 MSTr F ~ F(, ). MSE The decso rule s that reect H 0 f F > F α,, atα % level of sgfcace. f H 0 does ot hold true, the MSTr ~ ocetral F(,, δ ) MSE α whereδ s the ocetralty arameter. Note that the test statstc MSTr MSE ca also be obtaed from the lkelhood rato test. f H 0 s reected, the we go for multle comarso tests ad try to dvde the oulato to several grous havg the same effects. The aalyss of varace table s as follows: Source Degrees Sum of Mea sum F-value of varato of freedom squares of squares Treatmet SSTr MSTr MSTr MSE Error SSE MSE Total TSS Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur
13 Now we fd the exectatos of SSTr ad SSE. E( SSTr) E ( yo yoo) where E {( µ α ε ) ( µ ε )} o oo α ε ε, ε ε ad 0. o oo E( SSTr) E + ( o oo) Sce { α ε ε } E ( α ) E ( εo εoo) E( ε ) Var( ε ) Var ε o o E( εoo) Var( εoo) Var ε E( ε ε ) Cov( ε, ε ) o oo o oo Cov εε. E( SSTr) α + or α + ( ) α SSTr + E α or ( ). E MSTr + Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 3
14 Next E( SSE) E ( y yo ) E { ( µ α ε ) ( µ α εo) } E ( ε εo) E + ( ε εo εε o) + or ( ). ( ) ( ) ( ) SSE or E E MSE Thus MSE s a ubased estmator of. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 4
15 Two way classfcato uder fxed effects model Suose the resose of a outcome s affected by the two factors A ad B. For examle, suose vartes of magoes are grow o dfferet lots of same sze each of the dfferet locatos. All lots are gve same treatmet lke equal amot of water, equal amout of fertlzer etc. So there are two factors the exermet whch affect the yeld of magoes. - Locato (A) - Varety of magoes (B) Such a exermet s called two factor exermet. The dfferet locatos corresod to the dfferet levels of A ad the dfferet vartes corresod to the dfferet levels of factor B. The observatos are collected o the bass of er lot. The combed effect of the two factors (A ad B our case) s called the teracto effect (of A ad B). Mathematcally, let a ad b be the levels of factors A ad B resectvely the a fucto f( ab, ) s called a fucto of o teracto f ad oly f there exsts fuctos gaad ( ) hb ( ) such that f( ab, ) ga ( ) + hb ( ). Otherwse the factors are sad to teract. For a fucto f( ab, ) of o teracto, f( a, b) ga ( ) + hb ( ) f( a, b) ga ( ) + hb ( ) f( a, b) f( a, b) ga ( ) ga ( ) ad so t s deedet of b. Such o teracto fuctos are called addtve fuctos. Now there are two otos: - Oly oe observato er lot s collected. - More tha oe observatos er lot are collected. f there s oly oe observato er lot the there caot be ay teracto effect amog the observtos ad we assume t to be zero. f there are more tha oe observatos er lot the teracto effect amog the observatos ca be cosdered. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 5
16 We cosder here two cases. Oe observato er lot whch the teracto effect s zero.. More tha oe observatos er lot whch the teracto effect s reset. Two way classfcato wthout teracto Let y be the resose of observato from th level of frst factor, say A ad th level of secod factor, say B. So assume Y are deedetly dstrbuted as Ths ca be rereseted the form of a lear model as EY ( ) µ where µ µ wth µ + ( µ µ ) + ( µ µ ) + ( µ µ µ + µ ) oo o oo o oo o o oo µ + α + β + γ oo α µ µ o oo β µ µ o oo γ µ µ µ + µ o o oo α ( µ µ ) 0 o oo β ( µ µ ) 0 o oo Here α : effect of th level of factor A or excess of mea of th level of A over the geeral mea. β : effect of th level of B or excess of mea of th level of B over the geeral mea. γ : teracto effect of th level of A ad th level of B. Here we assume γ 0 as we have oly oe observato er lot. N µ (, ),,...,,,,...,. We also assume that the model EY ( ) µ s a full rak model so that µ ad all lear arametrc fuctos of µ are estmable. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 6
17 The total umber of observatos are whch ca be arraged a two way calssfed table where the rows corresods to the dfferet levels of A ad the colum corresods to the dfferet levels of B. The observatos o Y ad the desg matrx X ths case are Y µ α α α β β β y y y y y y f the desg matrx s ot of full rak, the the model ca be rearameterzed. such a case, we ca start the aalyss by assumg that the model EY ( ) µ + α + β s obtaed after rearameterzato. There are two ull hyothess of terest: H H : α α... α 0 0α : β β... β 0 0β agast H α : at least oe α (,,..., ) s dfferet from others H β at least oe β (,,..., ) s dfferet from others. : Now we derve the least squares estmators (or equvaletly the maxmum lkelhood estmator) of µα, ad β,,,...,,,,..., by mmzg the error sum of squares ( ). E y µ α β The ormal equatos are obtaed as Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 7
18 E 0 ( y µ α β ) 0 µ E 0 ( y µ α β ) 0,,,..., α E 0 ( y µ α β ) 0,,,...,. β, Solvg the ormal equatos ad usg α 0 ad β 0, the least squares estmator are obtaaed as G ˆ µ y y T ˆ α y y y y y,,..., oo oo o oo ˆ B β y y y y y,,,..., oo oo o oo where T oo : treatmet totals due to th α effect,.e., sum of all the observatos recevg the th treatmet effect. B : block totals due to th β effect,.e., sum of all the observatos the th block. Thus the error sum of squares s SSE M E µα,, β ˆ ( y ˆ ˆ µ α β ) y yoo yo yoo yo y oo ( y yo yo yoo) y yoo yo yoo yo yoo ( ) ( ) ( ) + ( ) ( ) ( ) whch carres ( ) ( ) ( )( ) degrees of freedom. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 8
19 Next we cosder the estmato of µ ad β uder the ull hyothess H 0 α : α α... α 0 by mmzg the error sum of squares E ( y µ β ). The ormal equato are obtaed by E µ 0 E ad 0,,,..., β whch o solvg gves the least square estmates ˆ µ yoo ˆ β y y. o oo The sum of squares due to H0 α s M E M( y µ β ) µβ, µβ, ˆ ( y ˆ µ β ) yo yoo + y yo yo + yoo ( ) ( ). Sum of squares due to factor A Error sum of squares Thus the sum of squares due to devato from H 0α (or sum of squares due to rows or sum of squares are to factor A) ( o oo) o oo SSA y y y y ad carres ( ) ( )( ). degrees of freedom. Now we fd the estmates of µ ad α uder H0 β : β β... β 0 by mmzg E ( y µ α ). Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 9
20 The ormal equatos are E µ 0 E ad 0,,,..., α whch o solvg gve the estmators as ˆ µ y oo ˆ α y y. o oo The mmum value of the error sum of squares s obtaed by M E µα, ( y ˆ µ ˆ α ) ( y y ) o ( o oo) ( o o oo) y y + y y y + y Sum of squares due to factor B Error sum of squares The sum of squares due to devato from H0 β (or the sum of squares due to colums or sum of squares due to factor B) s SSB ( y y ) y y o oo o oo ad ts degrees of freedom are ( ) ( )( ). Note that the total sum of squares s ( oo) ( yo yoo) ( yo yoo) ( y yo yo y ) oo ( yo yoo) ( yo yoo) ( y yo yo yoo) TSS y y SSA + SSB + SSE. The arttog of degrees of freedom to the corresodg grous s ( ) + ( ) + ( )( ). Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 0
21 Note that SSA, SSB ad SSE are mutually orthogoal ad that s why the degrees of freedom ca be dvded lke ths. Now usg the theory exlaed whle dscussg the lkelhood rato test or assumg y ' s to be deedetly dstrbuted as N µ + α + β afd usg the Theorems (, ),,,..., ;,,...,, 6 ad 7, we ca wrte SSA SSB SSE ~ χ ( ) χ ~ ( ) χ ~ (( )( )). So the test statstc for H0 α s obtaed as SSA / F SSE / ( )( ) ( )( ) SSA. ( ) SSE MSA ~ F (( ), ( ) ( )) uder H MSE where SSA MSA SSE MSE. ( )( ) 0α Same statstc s also obtaed usg the lkelhood rato test for H0 α. The decso rule s 0α α [ ] Reect H f F > F ( ), ( ) ( ). Uder H α, F α follows a ocetral F dstrbuto F ( δ, ( ), ( )( )) where δ the assocated ocetralty arameter. s Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur
22 Smlarly, the test statstc for H0 β s obtaed as SSB / F SSE / ( )( ) ( )( ) SSB ( ) SSE MSB ~ F (( ),( )( )) uder H MSE SSB where MSB. The decso rule s Reect H f F > F (( ),( )( )). 0β α 0β The same test statstc ca also be obtaed from the lkelhood rato test. The aalyss of varace table s as follows: Source of Degrees Sum of Mea sum F-value varato of freedom squares of squares Factor A (or rows) ( ) SSA MSA F MSA MSE Factor B (or colum) ( ) SSB MSB F Error ( )( ) SSE MSE (by subtracto) Total TSS MSB MSE t ca be foud o smlar les as the case of oe way classfcato that E( MSA) + ( ). α E( MSB) + E MSE β Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur
23 f the ull hyothess s reected, the we use the multle comarso tests to dvde the α ' s (or β ' s) to grous such that α ' s (or β ' s) belogg to the same grou are equal ad those belogg to dfferet grous are dfferet. Geerally, ractce, the terest of exermeter s more usg the multle comarso test for treatmet effects rather o the block effects. So the multle comarso test are used geerally for the treatmet effects oly. Two way classfcato wth teractos: Cosder the two way classfcato wth a equal umber, say K observatos er cell. Let yk : k th observato (, ) th cell,.e., recevg the treatmets th level of factor A ad th level of factor B,,,..., ;,,..., k ;,,..., Kad y are deedetly draw from k y k µ + εk N µ so that the lear model uder cosderato s (, ) whereε k are detcally ad deedetly dstrbuted followg N(0, ). Thus E( y ) µ where wth k µ µ µ + ( µ µ ) + ( µ µ ) + ( µ µ µ + µ ) oo α µ µ o oo o oo oo o oo o oo o o oo µ + α + β + γ β µ µ γ µ µ µ + µ o o oo α 0, β 0, γ 0, γ 0. Assume that the desg matrx X s of full rak so that all the arametrc fuctos of µ are estmable. The ull hyothess are H H H 0α 0β 0γ : α α... α 0 : β β... β 0 :All γ 0 for all,. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 3
24 The corresodg alteratve hyothess s H : At least oe α α, for α H : At least oe β β, for β H : At least oe γ γ, for k. γ Mmzg the error sum of squares K ( k ), k E y µ α β γ The ormal equatos are obtaed as k E E E E 0, 0 for all, 0 for all ad 0 for all ad µ α β γ The least squares estmates are obtaed as ˆ µ yooo K k ˆ α y y y y oo ooo k ooo K ˆ β y y y y ˆ γ oo ooo k ooo K y y y + y K K y y y + y o oo oo ooo y k k oo oo ooo. The error sum of square s SSE M ( y µ α β γ ) ˆ µ, ˆ α, ˆ β, ˆ γ k K ( y ˆ µ ˆ α ˆ β ˆ γ ) k K ( y y ) k SSE K k wth ~ ( ( )). k k o χ K Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 4
25 Now mmzg the error sum of squares uder H 0α α α... α 0,.e., mmzg K k E ( y µ β γ ) k wth resect to µβ, ad γ ad solvg the ormal equatos E E E 0, 0 for all ad 0 for all ad µ β γ gves the least squares estmates as ˆ µ yˆ ooo ˆ β y y oo ooo ˆ γ y y y + y. o ooo oo ooo The sum of squares due to H0 α, s M µβ,, γ K k K k ( y µ β γ ) k ( y ˆ µ ˆ β ˆ γ ) k K ( yk yo ) K( yoo yooo) k + ( oo ooo). SSE + K y y Thus the sum of squares due to devato from H0 α or the sum of squares due to effect A s SSA Sum of squares due to H SSE K ( y y ) SSA χ wth ~ ( ). 0α Mmzg the error sum of squares uder H0 β : β β... β 0.e., mmzg K E ( y k µ α γ ), k ad solvg the ormal equatos E E E 0, 0 for all ad 0 for all ad µ α γ yelds the least squares estmators as oo ooo Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 5
26 ˆ µ y ooo ˆ α y y ooo ooo ˆ γ y y y + y. o oo oo ooo The mmum error sum of squares s K k ( y ˆ µ ˆ α ˆ γ ) k SSE + K ( y y ) oo ooo ad the sum of squares due to devato from wth ~ ( ). SSB Sum of squares due to H SSE K ( y y ) SSB χ 0β Ho β or the sum of squares due to effect B s oo ooo Next, mmzg the error sum of squares uder H0 γ : all γ 0 for all,,.e., mmzg E ( y µ α β ) 3 K k k wth resect to µα, ad β ad solvg the ormal equatos E3 E3 E3 0, 0 for all ad 0 for all µ α β yelds the least squares estmators ˆ µ y ooo ˆ α y y oo ooo ˆ β y y. oo ooo The sum of squarers due to H0 γ s K M ( yk µ α β ) µα,, β k K ˆ ( y ˆ ˆ k µ α β ) k SSE + K( yo yoo yoo + yooo). Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 6
27 Thus the sum of squares due to devato from H0 γ or the sum of squares due to teracto effect AB s SSAB Sum of squares due to H SSE K ( y y y + y ) SSAB χ wth ~ (( ) )). 0γ o oo oo ooo The total sum of squares ca be arttoed as TSS SSA + SSB + SSAB + SSE where SSA, SSB, SSAB ad SSE are mutually orthogoal. So ether usg the deedece of SSA, SSB, SSAB ad SSE as well as ther resectve χ dstrbutos or usg the lkelhood rato test aroach, the decso rules for the ull hyothess at α level of sgfcace are based o F- statstc as follows ( K ) SSA F. ~ F [ (, ( K ) ] uder H0 α, SSE ( K ) SSB F. ~ F [ (, ( K ) ] uder H0β, SSE ad ( K ) SSAB F3. ~ F [( )( ), ( K ) ] uder H0γ. ( )( ) SSE So Reect H0 α f F > F α[ ( ), ( K ) ] Reect H0β f F > F α[ ( ), ( K ) ] Reect H f F > F ( )( ), ( K ). 0γ 3 α [ ] f H0 α or H0 β s reected, oe ca use t -test or multle comarso test to fd whch ars of α ' s or β ' s are sgfcatly dfferet. f H0 γ s reected, oe would ot usually exlore t further but theoretcally t- test or multle comarso tests ca be used. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 7
28 t ca also be show that K E( SSA) + ( ). α K E( SSB) + E( SSAB) + E SSE β K γ ( )( ) The aalyss of varace table s as follows: Source of Degrees Sum of Mea sum F-value varato of freedom squares of squares Factor A ( ) SSA Factor B ( ) SSB teracto AB ( )( ) SSAB Error ( K ) SSE MSA SSA F MSA MSE SSB MSB MSB F MSE SSAB MSAB MSAB F3 ( )( ) MSE SSE MSE ( K ) Total ( K ) TSS Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 8
29 Tukey s test for oaddtvty: Cosder the set u of two way classfcato wth oe observato er cell ad teracto as y µ + α + β + γ + ε,,...,,,,..., wth α 0, β 0. The dstrbuto of degrees of freedom ths case s as follows: Source Degrees of freedom A B AB(teracto) ( )( ) Error 0 Total There s o degree of freedom for error. The roblem s that the two factor teracto effect ad radom error comoet are subsumed together ad caot be searated out. There s o estmate for. f o teracto exsts, the H : γ 0 for all, s acceted ad the addtve model 0 y µ + α + β + ε s well eough to test the hyothess H : α 0 ad H : β wth error havg ( )( ) degrees of freedom. f teracto exsts, the H : γ 0 s reected. such a case, f we assume that the structure of 0 teracto effect s such that t s roortoal to the roduct of dvdual effects,.e., γ λα β the a test for testg H : 0 0 λ ca be costructed. Such a test wll serve as a test for oaddtvty. t wll hel kowg the effect of resece of teract effect ad whether the teracto eters to the model addtvely. Such a test s gve by Tukey s test for oaddtvty whch requres oe degree of freedom leavg ( -)( -) - degrees of freedom for error. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 9
30 Let us assume that dearture from addtvty ca be secfed by troducg a roduct term ad wrtg the model as E( y ) µ + α + β + λα β ;,,...,,,,..., wth α 0, β 0. Whe λ 0, the model becomes olear model ad the least squares theory for lear models s ot alcable. Note that usg α 0, β 0, we have y y µ + α + β + λα β + ε oo λ µ + α + β + ( α )( β ) + ε µ + ε oo E( y ) µ oo ˆ µ y. oo oo Next y y µ + α + β + λα β + ε o µ + α + β + λα β + ε µ + α + ε E( y ) µ + α o o o ˆ α y ˆ µ y y. o o oo Smlarly y o µ + β ˆ β y ˆ µ y y o o oo Thus ˆ, µαˆ ad ˆβ rema the ubased estmators of µα, ad β, resectvely rresectve of whether λ 0 or ot. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 30
31 Also E y yo yo + y oo λαβ or E ( y yoo) ( yo yoo) ( yo yoo) λαβ. Cosder the estmato of µα,, β ad λ based o the mmzato of S ( y µ α β λα β ) S. The ormal equatos are solved as S 0 S 0 µ ˆ µ y S 0 ( + λβ ) S 0 α S 0 ( + λα ) S 0 β oo S 0 αβ S 0 λ or αβ ( y µ α β λαβ ) 0 αβ y or λ λ (say α β ) whch ca be estmated rovded α ad β are assumed to be kow. Sce α ad β ca be estmated by ˆα y y ad ˆβ y y rresectve of whether λ 0 o oo o oo or ot, so we ca substtute them lace of α ad β λ whch gves Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 3
32 ˆ αβˆ ˆ ˆ y ( ) αβ y ˆ λ ˆ ˆ ˆ α ˆ β α β ( y y )( y y ) y o oo o oo SS ˆ A α o oo where S ( y y ) A S y y B ˆ B β ( o oo Assumg α ad β to be kow ). Var ( λ) ( ) 0 αβ Var y + αβ α β α β α β usg Var( y ), ( Cov y, y ) 0 for all k. k Whe α ad β are estmated by ˆα ad ˆ β, the substtute them back the exresso of Var( λ) ad treatg t as Var( ˆ λ ) gves ˆ Var( λ) ˆ ˆ α β SS A for gve ˆα ad ˆβ. B Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 3
33 Note that f λ 0, the αβ y ˆ ˆ E λ/ ˆ α, β for all, E αβ αβ ( µ + α + β ε ) E ( α )( β ) 0 0. ( α ) ( β ) As ˆα ad ˆβ remas vald rresectve of λ 0 or ot, ths sese ˆλ s a fucto of y ad hece ormally dstrbuted as ˆ λ ~ N 0,. SS A B Thus the statstc ˆ ( λ) Var( ˆ λ) N A B A B ( yo yoo)( yo yoo)( y yo yo + yoo) SS S follows a S N ˆ ˆ αβ y SS ( yo yoo)( yo yoo) y SS A χ - dstrbuto wth oe degree of freedom where ( yo yoo)( yo yoo)( y yo yo + yoo) SS s the sum of squares due to oaddtvty. A B B Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 33
34 Note that S ( y y y + y ) o o oo AB follows χ (( )( )). so SN SAB χ. s oegatve ad follows [ ( )( ) ] The reaso for ths s as follows: y µ + α + β + o addtvty + ε ad so TSS SSA + SSB + SN + SSE SSE TSS SSA SSB S has degrees of freedom ( ) ( ) ( ) ( )( ) We eed to esure that SSE > 0. So usg the result f QQ, ad Q are quadratc forms such that N Q Q+ Q wth Q~ χ ( a), Q ~ χ ( b) ad Q s o-egatve, the Q ~ χ ( a b)" esures that the dfferece SN SAB s oegatve. Moreover S N (SS due to oaddtvty) ad SSE are orthogoal. Thus the F-test for oaddtvty s S N / F SSE / ( )( ) SSN SSE ~ F,( )( ) uder H. [( )( ) ] [ ] 0 Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 34
35 So the decso rule s Reect H : λ 0 wheever 0 [ ] F> F α, ( )( ) The aalyss of varace table for the model cludg a term for oaddtvty s as follows: Source of Degrees Sum of Mea sum F-value varato of freedom squares of squares A B S A S B Noaddtvty N MS MS A B S A SB S MSN SN MS N MSE Error ( )( ) SSE (By substracto) SSE MSE ( )( ) Total TSS Comarso of Varaces Oe of the basc assumtos the aalyss of varace s that the samles are draw from dfferet ormal oulatos wth dfferet meas but same varaces. So before gog for aalyss of varace, the test of hyothess about the equalty of varace s eeded to be doe. We dscuss the test of equalty of two varaces ad more tha two varaces. Case : Equalty of two varaces H :. 0 Suose there are two deedet radom samles A: x, x,..., x ; x ~ N( µ, ) A A B: y, y,..., y ; y ~ N( µ, ) B B The samle varace corresodg to the two samles are Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 35
36 s x x x ( ) s ( y y). y Uder H0 : A B, ( ) s ( ) s x χ y χ ~ ( ) ~ ( ). Moreover, the samle varaces s ad s ad are deedet. So x y ( ) s x ( ) s y s s x y ~ F., So for testg H0 : versus H:, the ull hyothess H 0 s reected f F > F or F < F where F α α ;, ; ;, α ;, F α. ;, f the ull hyothess H : s reected, the the roblem s termed as the Fster-Behre s 0 roblem. The solutos are avalable for ths roblem. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 36
37 Case : Equalty of more tha two varaces: Bartlett s test H :... k ad 0 H k : for atleast oe,,...,. Let there be k deedet ormal oulato N µ each of sze,,,..., k. Let (, ) s, s,..., s k be k deedet ubased estmators of oulato varaces,,..., k resectvely wth ν, ν,..., ν k degrees of freedom. Uder H 0, all the varaces are same as, say ad a ubased estmate of s s ν s where,. k k ν ν ν ν Bartlett has show that uder H 0 k s ν l s k + 3( ) k ν ν s dstrbuted as χ ( k ) based o whch H 0 ca be tested. Aalyss of Varace Chater 3 Exermetal Desg Models Shalabh, T Kaur 37
Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Aalyss of Varace ad Desg of Exermets-I MODULE II LECTURE - GENERAL LINEAR HYPOTHESIS AND ANALYSIS OF VARIANCE Dr Shalabh Deartmet of Mathematcs ad Statstcs Ida Isttute of Techology Kaur Tukey s rocedure
More informationTraining Sample Model: Given n observations, [[( Yi, x i the sample model can be expressed as (1) where, zero and variance σ
Stat 74 Estmato for Geeral Lear Model Prof. Goel Broad Outle Geeral Lear Model (GLM): Trag Samle Model: Gve observatos, [[( Y, x ), x = ( x,, xr )], =,,, the samle model ca be exressed as Y = µ ( x, x,,
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationChapter 2 General Linear Hypothesis and Analysis of Variance
Chater Geeral Lear Hyothess ad Aalyss of Varace Regresso model for the geeral lear hyothess Let Y, Y,..., Y be a seuece of deedet radom varables assocated wth resoses. The we ca wrte t as EY ( ) = β x,
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More information2SLS Estimates ECON In this case, begin with the assumption that E[ i
SLS Estmates ECON 3033 Bll Evas Fall 05 Two-Stage Least Squares (SLS Cosder a stadard lear bvarate regresso model y 0 x. I ths case, beg wth the assumto that E[ x] 0 whch meas that OLS estmates of wll
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationMultiple Linear Regression Analysis
LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple
More informationSTK3100 and STK4100 Autumn 2017
SK3 ad SK4 Autum 7 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Sectos 4..5, 4.3.5, 4.3.6, 4.4., 4.4., ad 4.4.3 Sectos 5.., 5.., ad 5.5. Ørulf Borga Deartmet of Mathematcs
More informationSTK3100 and STK4100 Autumn 2018
SK3 ad SK4 Autum 8 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Cofdece tervals by vertg tests Cosder a model wth a sgle arameter β We may obta a ( α% cofdece terval for
More informationå 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018
Chrs Pech Fal Practce CS09 Dec 5, 08 Practce Fal Examato Solutos. Aswer: 4/5 8/7. There are multle ways to obta ths aswer; here are two: The frst commo method s to sum over all ossbltes for the rak of
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More information2. Independence and Bernoulli Trials
. Ideedece ad Beroull Trals Ideedece: Evets ad B are deedet f B B. - It s easy to show that, B deedet mles, B;, B are all deedet ars. For examle, ad so that B or B B B B B φ,.e., ad B are deedet evets.,
More informationECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity
ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationSimple Linear Regression
Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato
More informationCHAPTER 6. d. With success = observation greater than 10, x = # of successes = 4, and
CHAPTR 6 Secto 6.. a. We use the samle mea, to estmate the oulato mea µ. Σ 9.80 µ 8.407 7 ~ 7. b. We use the samle meda, 7 (the mddle observato whe arraged ascedg order. c. We use the samle stadard devato,
More informationObjectives of Multiple Regression
Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of
More informationChapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance
Chapter, Part A Aalyss of Varace ad Epermetal Desg Itroducto to Aalyss of Varace Aalyss of Varace: Testg for the Equalty of Populato Meas Multple Comparso Procedures Itroducto to Aalyss of Varace Aalyss
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More information1 Solution to Problem 6.40
1 Soluto to Problem 6.40 (a We wll wrte T τ (X 1,...,X where the X s are..d. wth PDF f(x µ, σ 1 ( x µ σ g, σ where the locato parameter µ s ay real umber ad the scale parameter σ s > 0. Lettg Z X µ σ we
More informationLINEAR REGRESSION ANALYSIS
LINEAR REGRESSION ANALYSIS MODULE V Lecture - Correctg Model Iadequaces Through Trasformato ad Weghtg Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Aalytcal methods for
More informationDr. Shalabh. Indian Institute of Technology Kanpur
Aalyss of Varace ad Desg of Expermets-I MODULE -I LECTURE - SOME RESULTS ON LINEAR ALGEBRA, MATRIX THEORY AND DISTRIBUTIONS Dr. Shalabh Departmet t of Mathematcs t ad Statstcs t t Ida Isttute of Techology
More informationChapter 2 Supplemental Text Material
-. Models for the Data ad the t-test Chapter upplemetal Text Materal The model preseted the text, equato (-3) s more properl called a meas model. ce the mea s a locato parameter, ths tpe of model s also
More informationSTK4011 and STK9011 Autumn 2016
STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More information( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model
Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch
More informationChapter 3 Sampling For Proportions and Percentages
Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys
More informationENGI 3423 Simple Linear Regression Page 12-01
ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationChapter 11 The Analysis of Variance
Chapter The Aalyss of Varace. Oe Factor Aalyss of Varace. Radomzed Bloc Desgs (ot for ths course) NIPRL . Oe Factor Aalyss of Varace.. Oe Factor Layouts (/4) Suppose that a expermeter s terested populatos
More informationChapter -2 Simple Random Sampling
Chapter - Smple Radom Samplg Smple radom samplg (SRS) s a method of selecto of a sample comprsg of umber of samplg uts out of the populato havg umber of samplg uts such that every samplg ut has a equal
More informationChapter 8. Inferences about More Than Two Population Central Values
Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationSTA302/1001-Fall 2008 Midterm Test October 21, 2008
STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from
More informationESS Line Fitting
ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here
More informationLECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR
amplg Theory MODULE II LECTURE - 4 IMPLE RADOM AMPLIG DR. HALABH DEPARTMET OF MATHEMATIC AD TATITIC IDIA ITITUTE OF TECHOLOGY KAPUR Estmato of populato mea ad populato varace Oe of the ma objectves after
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationSTA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1
STA 08 Appled Lear Models: Regresso Aalyss Sprg 0 Soluto for Homework #. Let Y the dollar cost per year, X the umber of vsts per year. The the mathematcal relato betwee X ad Y s: Y 300 + X. Ths s a fuctoal
More informationChapter -2 Simple Random Sampling
Chapter - Smple Radom Samplg Smple radom samplg (SRS) s a method of selecto of a sample comprsg of umber of samplg uts out of the populato havg umber of samplg uts such that every samplg ut has a equal
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationQualifying Exam Statistical Theory Problem Solutions August 2005
Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),
More informationSampling Theory MODULE V LECTURE - 14 RATIO AND PRODUCT METHODS OF ESTIMATION
Samplg Theor MODULE V LECTUE - 4 ATIO AND PODUCT METHODS OF ESTIMATION D. SHALABH DEPATMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOG KANPU A mportat objectve a statstcal estmato procedure
More informationBASIC PRINCIPLES OF STATISTICS
BASIC PRINCIPLES OF STATISTICS PROBABILITY DENSITY DISTRIBUTIONS DISCRETE VARIABLES BINOMIAL DISTRIBUTION ~ B 0 0 umber of successes trals Pr E [ ] Var[ ] ; BINOMIAL DISTRIBUTION B7 0. B30 0.3 B50 0.5
More information12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model
1. Estmatg Model parameters Assumptos: ox ad y are related accordg to the smple lear regresso model (The lear regresso model s the model that says that x ad y are related a lear fasho, but the observed
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationLecture 8: Linear Regression
Lecture 8: Lear egresso May 4, GENOME 56, Sprg Goals Develop basc cocepts of lear regresso from a probablstc framework Estmatg parameters ad hypothess testg wth lear models Lear regresso Su I Lee, CSE
More informationMean is only appropriate for interval or ratio scales, not ordinal or nominal.
Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot
More informationChapter 5 Properties of a Random Sample
Lecture 3 o BST 63: Statstcal Theory I Ku Zhag, /6/006 Revew for the revous lecture Cocets: radom samle, samle mea, samle varace Theorems: roertes of a radom samle, samle mea, samle varace Examles: how
More informationLecture 9. Some Useful Discrete Distributions. Some Useful Discrete Distributions. The observations generated by different experiments have
NM 7 Lecture 9 Some Useful Dscrete Dstrbutos Some Useful Dscrete Dstrbutos The observatos geerated by dfferet eermets have the same geeral tye of behavor. Cosequetly, radom varables assocated wth these
More informationChapter 9 Jordan Block Matrices
Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.
More informationMEASURES OF DISPERSION
MEASURES OF DISPERSION Measure of Cetral Tedecy: Measures of Cetral Tedecy ad Dsperso ) Mathematcal Average: a) Arthmetc mea (A.M.) b) Geometrc mea (G.M.) c) Harmoc mea (H.M.) ) Averages of Posto: a) Meda
More informationMultivariate Transformation of Variables and Maximum Likelihood Estimation
Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty
More informationTHE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5
THE ROYAL STATISTICAL SOCIETY 06 EAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 The Socety s provdg these solutos to assst cadtes preparg for the examatos 07. The solutos are teded as learg ads ad should
More informationBayes (Naïve or not) Classifiers: Generative Approach
Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More informationTHE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA
THE ROYAL STATISTICAL SOCIETY EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER II STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for
More informationhp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations
HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several
More informationSTRONG CONSISTENCY FOR SIMPLE LINEAR EV MODEL WITH v/ -MIXING
Joural of tatstcs: Advaces Theory ad Alcatos Volume 5, Number, 6, Pages 3- Avalable at htt://scetfcadvaces.co. DOI: htt://d.do.org/.864/jsata_7678 TRONG CONITENCY FOR IMPLE LINEAR EV MODEL WITH v/ -MIXING
More informationThe Mathematical Appendix
The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.
More informationComparison of Dual to Ratio-Cum-Product Estimators of Population Mean
Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract
More informationbest estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best
Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg
More informationAnalysis of Variance with Weibull Data
Aalyss of Varace wth Webull Data Lahaa Watthaacheewaul Abstract I statstcal data aalyss by aalyss of varace, the usual basc assumptos are that the model s addtve ad the errors are radomly, depedetly, ad
More informationWu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1
Wu-Hausma Test: Detectg Falure of E( ε X ) Caot drectly test ths assumpto because lack ubased estmator of ε ad the OLS resduals wll be orthogoal to X, by costructo as ca be see from the momet codto X'
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experments- MODULE LECTURE - 6 EXPERMENTAL DESGN MODELS Dr. Shalabh Department of Mathematcs and Statstcs ndan nsttute of Technology Kanpur Two-way classfcaton wth nteractons
More informationIntroduction to local (nonparametric) density estimation. methods
Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest
More information4. Standard Regression Model and Spatial Dependence Tests
4. Stadard Regresso Model ad Spatal Depedece Tests Stadard regresso aalss fals the presece of spatal effects. I case of spatal depedeces ad/or spatal heterogeet a stadard regresso model wll be msspecfed.
More informationBounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy
Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled
More informationLogistic regression (continued)
STAT562 page 138 Logstc regresso (cotued) Suppose we ow cosder more complex models to descrbe the relatoshp betwee a categorcal respose varable (Y) that takes o two (2) possble outcomes ad a set of p explaatory
More informationECON 482 / WH Hong The Simple Regression Model 1. Definition of the Simple Regression Model
ECON 48 / WH Hog The Smple Regresso Model. Defto of the Smple Regresso Model Smple Regresso Model Expla varable y terms of varable x y = β + β x+ u y : depedet varable, explaed varable, respose varable,
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationMultiple Choice Test. Chapter Adequacy of Models for Regression
Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to
More informationCS 2750 Machine Learning Lecture 5. Density estimation. Density estimation
CS 750 Mache Learg Lecture 5 esty estmato Mlos Hausrecht mlos@tt.edu 539 Seott Square esty estmato esty estmato: s a usuervsed learg roblem Goal: Lear a model that rereset the relatos amog attrbutes the
More informationChapter 3 Multiple Linear Regression Model
Chapter 3 Multple Lear Regresso Model We cosder the problem of regresso whe study varable depeds o more tha oe explaatory or depedet varables, called as multple lear regresso model. Ths model geeralzes
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationMidterm Exam 1, section 1 (Solution) Thursday, February hour, 15 minutes
coometrcs, CON Sa Fracsco State Uversty Mchael Bar Sprg 5 Mdterm am, secto Soluto Thursday, February 6 hour, 5 mutes Name: Istructos. Ths s closed book, closed otes eam.. No calculators of ay kd are allowed..
More informationSTATISTICAL INFERENCE
(STATISTICS) STATISTICAL INFERENCE COMPLEMENTARY COURSE B.Sc. MATHEMATICS III SEMESTER ( Admsso) UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION CALICUT UNIVERSITY P.O., MALAPPURAM, KERALA, INDIA -
More information: At least two means differ SST
Formula Card for Eam 3 STA33 ANOVA F-Test: Completely Radomzed Desg ( total umber of observatos, k = Number of treatmets,& T = total for treatmet ) Step : Epress the Clam Step : The ypotheses: :... 0 A
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationThe equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.
INTRODUCTORY NOTE ON LINEAR REGREION We have data of the form (x y ) (x y ) (x y ) These wll most ofte be preseted to us as two colum of a spreadsheet As the topc develops we wll see both upper case ad
More informationLecture Note to Rice Chapter 8
ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,
More informationTHE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the
More informationIS 709/809: Computational Methods in IS Research. Simple Markovian Queueing Model
IS 79/89: Comutatoal Methods IS Research Smle Marova Queueg Model Nrmalya Roy Deartmet of Iformato Systems Uversty of Marylad Baltmore Couty www.umbc.edu Queueg Theory Software QtsPlus software The software
More informationIntroduction to Matrices and Matrix Approach to Simple Linear Regression
Itroducto to Matrces ad Matrx Approach to Smple Lear Regresso Matrces Defto: A matrx s a rectagular array of umbers or symbolc elemets I may applcatos, the rows of a matrx wll represet dvduals cases (people,
More informationChapter 8: Statistical Analysis of Simulated Data
Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample
More informationThird handout: On the Gini Index
Thrd hadout: O the dex Corrado, a tala statstca, proposed (, 9, 96) to measure absolute equalt va the mea dfferece whch s defed as ( / ) where refers to the total umber of dvduals socet. Assume that. The
More informationIntroduction to Econometrics (3 rd Updated Edition, Global Edition) Solutions to Odd-Numbered End-of-Chapter Exercises: Chapter 9
Itroducto to Ecoometrcs (3 rd Udated Edto, Global Edto) by James H. Stock ad Mark W. Watso Solutos to Odd-Numbered Ed-of-Chater Exercses: Chater 9 (Ths verso August 7, 04) 05 Pearso Educato, Ltd. Stock/Watso
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationD KL (P Q) := p i ln p i q i
Cheroff-Bouds 1 The Geeral Boud Let P 1,, m ) ad Q q 1,, q m ) be two dstrbutos o m elemets, e,, q 0, for 1,, m, ad m 1 m 1 q 1 The Kullback-Lebler dvergece or relatve etroy of P ad Q s defed as m D KL
More informationAssignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)
Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form
More informationε. Therefore, the estimate
Suggested Aswers, Problem Set 3 ECON 333 Da Hugerma. Ths s ot a very good dea. We kow from the secod FOC problem b) that ( ) SSE / = y x x = ( ) Whch ca be reduced to read y x x = ε x = ( ) The OLS model
More informationMS exam problems Fall 2012
MS exam problems Fall 01 (From: Rya Mart) 1. (Stat 401) Cosder the followg game wth a box that cotas te balls two red, three blue, ad fve gree. A player selects two balls from the box at radom, wthout
More informationDimensionality Reduction and Learning
CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that
More informationChannel Models with Memory. Channel Models with Memory. Channel Models with Memory. Channel Models with Memory
Chael Models wth Memory Chael Models wth Memory Hayder radha Electrcal ad Comuter Egeerg Mchga State Uversty I may ractcal etworkg scearos (cludg the Iteret ad wreless etworks), the uderlyg chaels are
More information