Lecture 10: Factorial Designs with Random Factors
|
|
- Theodore Clark
- 5 years ago
- Views:
Transcription
1 Lecture 10: Factorial Designs with Random Factors Montgomery, Section 13.2 and Lecture 10 Page 1
2 Factorial Experiments with Random Effects Lecture 9 has focused on fixed effects Always use MSE in denominator of F-test Use MSE in std error of linear contrasts Not always correct when random factors present May use interaction MS or combination of MS s Will now use EMS as guide for tests 2 Lecture 10 Page 2
3 Two-Factor Mixed Effects Model One factor random and one factor fixed (aka Model III) Assume A fixed and B random Mixed Factor Effects Model: Y ijk = µ+τ i +β j +(τβ) ij +ε ijk i τ i = 0 andβ j iid N(0,σ 2 β ) (τβ) ij N(0,(a 1)στβ 2 /a) subject to the restrictions i (τβ) ij = 0 for eachj ε ijk iid N(0,σ 2 ) {β j },{(τβ) ij } and{ε ijk } are pairwise independent Known as restricted mixed effects model 3 Lecture 10 Page 3
4 Not all(τβ) ij are independent Cov((τβ) ij,(τβ) i j) = 1 a σ2 τβ, i i IfX i iid N(µ,σ 2 ) then X i X N(0, n 1 n σ2 ) Cov(X i X,X j X) = 1 n σ2 The(a 1)/a simplifies the EMS E(MSE)=σ 2 E(MSA) =σ 2 +bn i τ2 i /(a 1)+nσ2 τβ E(MSB) =σ 2 +anσβ 2 E(MSAB) =σ 2 +nστβ 2 4 Lecture 10 Page 4
5 Hypotheses Testing and Diagnostics Hypothesis tests require different MS terms in the denominators H 0 : τ 1 = τ 2 =... = 0 MSA/MSAB H 0 : σβ 2 = 0 MSB/MSE H 0 : στβ 2 = 0 MSAB/MSE Variance Estimates (Using ANOVA method) ˆσ 2 = MSE ˆσ β 2 = (MSB MSE)/(an) ˆσ τβ 2 = (MSAB MSE)/n Diagnostics Histogram or QQplot Normality or Unusual Observations Residual Plots Constant variance or Unusual Observations 5 Lecture 10 Page 5
6 Estimates & Multiple Comparisons for Fixed Effects y ijk = µ+τ i +β j +(τβ) ij +ǫ ijk y i.. = µ+τ i +β. +(τβ) i. +ǫ i.. Var(y i.. ) = σβ/b+(a 1)σ 2 τβ/ab+σ 2 2 /bn ˆτ i = ȳ i.. ȳ... var(ˆτ i ) =? ˆτ i ˆτ i = y i.. y i.. = τ i τ i +(τβ) i. (τβ) i. +ǫ i.. ǫ i.. Var(ˆτ i ˆτ i ) = 2στβ/b+2σ 2 2 /bn = 2(nστβ 2 +σ 2 )/bn Need to plug in variance estimates to compute Var(y i.. ) What are the DF? For pairwise comparisons, use estimate2ms AB /bn Use df AB for t-statistic or Tukey s method. 6 Lecture 10 Page 6
7 The Measurement Systems Capability Experiment (Example 13.3 in Text) options nocenter ls=75; data gaugerr; input part operator resp cards; ; proc glm data=gaugerr; class operator part; model resp=operator part; means operator; run; quit; 7 Lecture 10 Page 7
8 Sum of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error CorrTotal Source DF Type I SS Mean Square F Value Pr > F operator part <.0001 operator*part Level of resp operator N Mean Std Dev Lecture 10 Page 8
9 TestH 0 : τ 1 = τ 2 = τ 3 = 0, P-value based onf 2,38 : H 0 : σ 2 β = 0: P-value based onf 19,60 : H 0 : σ 2 τβ = 0: P-value based onf 38,60 : 0.86 F 0 = MS A MS AB = = 1.84 F 0 = MS B MS E = = F 0 = MS AB MS E = = Lecture 10 Page 9
10 Variance components estimates: ˆσ 2 β = (3)(2) = 10.23,ˆσ 2 τβ = =.14( 0),ˆσ 2 = 0.99 Pairwise comparison forτ 1,τ 2 andτ 3 (Ȳi.. Ȳi..)/ 2MS AB /bn H 0 t (a 1)(b 1) ; (t /(2 3),38 = ) i i Ȳ i.. Ȳi.. 2MSAB /bn t 1 2 ( )/ /(20 2) ( )/ /(20 2) ( )/ /(20 2) Tukey s method usesq α (a,(a 1)(b 1)): q 0.05 (3,38)/ Lecture 10 Page 10
11 proc glm data=gaugerr; class operator part; model resp=operator part; random part operator*part; test H=operator E=operator*part; lsmeans operator / adjust=tukey E=operator*part tdiff; /* or means */ run; quit; Sum of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error Corrected Total Source DF Type III SS Mean Square F Value Pr > F operator x part <.0001 operator*part Tests of Hypotheses Using the Type III MS for operator*part as an Error Term Source DF Type III SS Mean Square F Value Pr > F operator Lecture 10 Page 11
12 Least Squares Means Adjustment for Multiple Comparisons: Tukey Standard Errors and Probabilities Calculated Using the Type III MS for operator*part as an Error Term LSMEAN operator resp LSMEAN Number Least Squares Means for Effect operator t for H0: LSMean(i)=LSMean(j) / Pr > t i/j NOTE:PROC GLM does NOT use a restricted mixed model 12 Lecture 10 Page 12
13 Alternate Two-Factor Mixed Effects Model Reduce the restrictions on(τβ) ij = unrestricted mixed model i τ i = 0 andβ j iid N(0,σ 2 β ) (τβ) ij N(0,σ 2 τβ ) ε ijk iid N(0,σ 2 ) {β j },{(τβ) ij } and{ε ijk } are pairwise independent SAS uses unrestricted mixed model in analysis Connection to Restricted Mixed Model: letting(τβ).j = ( i (τβ) ij)/a y ijk = µ+τ i +(β j +(τβ).j )+((τβ) ij (τβ).j )+ǫ ijk The above model satisfies the conditions of restricted mixed model Restricted mixed model is slightly more general since(y ij,y i j) 0 (Y ij,y i j) 0 in unrestricted mixed model. 13 Lecture 10 Page 13
14 Two-Factor Unrestricted Mixed Model Reduced restrictions alter EMS E(MSE)=σ 2 E(MSA) =σ 2 + bn τi 2 /(a 1) + nσ2 τβ E(MSB) =σ 2 + anσβ 2 + nσ2 τβ E(MSAB) =σ 2 + nστβ 2 RANDOM statement in SAS also gives these results Differences TestH 0 : σ 2 β = 0 using MSAB (Note: MSE in Restricted Models) Often more conservative test ˆσ 2 β = (MSB MSAB)/(an) Var(Y i.. ) =(nσ 2 β + nσ2 τβ + σ2 )/(bn) though Var(y i.. y i.. ) =2(nσ 2 τβ + σ2 )/bn To decide which model is appropriate, suppose you ran experiment again and sampled some of the same levels of the random effect. Does this mean that the interaction effects for these levels are the same as before? Yes: Restricted No: Unrestricted 14 Lecture 10 Page 14
15 The Measurement Systems Capability Experiment (Unrestricted Model) proc glm data=gaugerr; class operator part; model resp=operator part; random part operator*part / test; means operator / tukey E=operator*part cldiff; /* lsmeans operator / adjust=tukey E=operator*part tdiff; */ run; quit; Source operator part operator*part Type III Expected Mean Square Var(Error) + 2 Var(operator*part) + Q(operator) Var(Error) + 2 Var(operator*part) + 6 Var(part) Var(Error) + 2 Var(operator*part) 15 Lecture 10 Page 15
16 Usetest option inrandom statement to request the correctf tests for unrestricted mixed models. Tests of Hypotheses for Mixed Model Analysis of Variance Dependent Variable: resp Source DF Type III SS Mean Square F Value Pr > F operator part <.0001 Error Error: MS(operator*part) Source DF Type III SS Mean Square F Value Pr > F operator*part Error: MS(Error) Lecture 10 Page 16
17 Tukey s Studentized Range (HSD) Test for resp NOTE: This test controls the Type I experimentwise error rate. Alpha 0.05 Error Degrees of Freedom 38 Error Mean Square Critical Value of Studentized Range Minimum Significant Difference Comparisons significant at the 0.05 level are indicated by ***. Difference Simultaneous operator Between 95% Confidence Comparison Means Limits Lecture 10 Page 17
18 /* DDFM = SATTERTH: Use Satterthwaite approximation procedure to compute the denominator degrees of freedom for testing fixed effects*/ /* METHOD=REML: by default */ proc mixed alpha=.05 cl covtest method=reml data=gaugerr; class operator part; model resp=operator / ddfm=satterth; random part operator*part; lsmeans operator / alpha=.05 cl diff adjust=tukey; run; quit; Covariance Parameter Estimates Standard Z Cov Parm Estimate Error Value Pr > Z Alpha Lower Upper part operator*part Residual < Type 3 Tests of Fixed Effects Num Den Effect DF DF F Value Pr > F operator x Least Squares Means Standard Effect operator Estimate Error DF t Value Pr> t Alpha Lower Upper operator < operator < operator < Lecture 10 Page 18
19 Differences of Least Squares Means Effect operator _operator Estimate Error DF t Value Pr > t Adjustment operator Tukey-Kramer operator Tukey-Kramer operator Tukey-Kramer Differences of Least Squares Means Adj Adj Effect operator _operator Adj P Alpha Lower Upper Lower Upper operator operator operator BothPROC VARCOMP andproc MIXED compute estimates of variance components (different estimation procedures available) ANOVA method:method = TYPE1 RMLE method:method = REML (default forproc MIXED) MIVQUE0: default forvarcomp PROC MIXED can provide hypothesis tests and confidence intervals Not all outputs fromproc MIXED are correct! 19 Lecture 10 Page 19
20 Rules For Expected Mean Squares (Restricted Model) EMS could be calculated using brute force method but may be difficult sometime For mixed models, good to have formal procedure Will take the two-factor mixed model (A fixed) as an example 1. Write each variable term in model as a row heading in a two-way table (the error term in the model asǫ (ij..)m, withmfor the replicate subscript) 2. Write the subscripts in the model as column headings. Over each subscript, write F for fixed factor and R for random one. Over this, write down the levels of each subscript F R R a b n term i j k τ i β j (τβ) ij ǫ (ij)k 20 Lecture 10 Page 20
21 3. For each row, copy the number of observations under each subscript, providing the subscript does not appear in the row variable term F R R a b n term i j k τ i b n β j a n (τβ) ij n ǫ (ij)k 4. For any bracketed subscripts in the model, place a 1 under those subscripts that are inside the brackets F R R a b n term i j k τ i b n β j a n (τβ) ij n ǫ (ij)k Lecture 10 Page 21
22 5. Fill in remaining cells with a 0 (if column subscript represents a fixed factor) or a 1 (if random factor). F R R a b n term i j k τ i 0 b n β j a 1 n (τβ) ij 0 1 n ǫ (ij)k The expected mean square for error ise(ms E ) = σ 2. For every other model term (row), the expected mean square containsσ 2 plus Cover the entries in the columns that contain non-bracketed subscript letters in this term; For rows including the same subscripts, multiply the remaining numbers to get coefficient for corresponding term in the model; A fixed effect is represented by the sum of squares of the model components associated with that factor divided by its degrees of freedom: τ i = Q(τ) = a i=1 τ2 i /(a 1) 22 Lecture 10 Page 22
23 Two-Factor Mixed Model (Restricted Model) ConsiderE[MS A ] = σ 2 +, Ignore the first column (underi); Model terms (rows) including subscripti: τ i and(τβ) ij Termτ i = b n a i=1 τ2 i /(a 1) Term(τβ) ij = 1 nσ 2 τβ E[MS A ] = σ 2 +bn a i=1 τ2 i /(a 1)+nσ 2 τβ F R R a b n term i j k EMS τ i 0 b n σ 2 + bn a i=1 τ2 i /(a 1) + nσ2 τβ β j a 1 n σ 2 + anσβ 2 (τβ) ij 0 1 n σ 2 + nστβ 2 ǫ (ij)k σ 2 23 Lecture 10 Page 23
24 Rules For Expected Mean Squares (Unrestricted Model) Replace Step 5 with the following step 5. For any (interactive) model term (row) including a subscript for a random factor, place a 1 in the remaining cells of this row; and fill in remaining cells with a 0 (if column subscript represents a fixed factor) or a 1 (if random factor). Two-factor mixed model (A Fixed): F R R a b n term i j k EMS τ i 0 b n σ 2 +bn a i=1 τ2 i /(a 1)+nσ2 τβ β j a 1 n σ 2 +anσ β 2+nσ 2 τβ (τβ) ij 1 1 n σ 2 +nστβ 2 ǫ (ij)k σ 2 Hasse Diagrams (Oehlert, 2000) can also be used to calculate the expected mean squares for balanced data (both restricted and unrestricted models). 24 Lecture 10 Page 24
25 Two-Factor Fixed Model y ijk = µ+τ i +β j +(τβ) ij +ǫ ijk F F R a b n term i j k EMS τ i 0 b n σ 2 + bnστ2 i a 1 β j a 0 n σ 2 + anσβ2 j b 1 (τβ) ij 0 0 n σ 2 + nσσ(τβ)2 ij (a 1)(b 1) ǫ (ij)k σ 2 25 Lecture 10 Page 25
26 Two-Factor Random Model y ijk = µ+τ i +β j +(τβ) ij +ǫ ijk R R R a b n term i j k EMS τ i 1 b n σ 2 +nστβ 2 +bnστ 2 β j a 1 n σ 2 +nσ 2 τβ +anσ 2 β (τβ) ij 1 1 n σ 2 +nσ 2 τβ ǫ (ij)k σ 2 26 Lecture 10 Page 26
27 Statistical Model with Two Random Factors y ijk = µ+τ i +β j +(τβ) ij +ǫ ijk τ i N(0,στ) 2 β j N(0,σβ) 2 (τβ) ij N(0,στβ) 2 Var(y ijk ) =σ 2 +στ 2 +σβ 2 +στβ 2 EMS determine what MS to use in denominator H 0 : στ 2 = 0 MS A /MS AB H 0 : σβ 2 = 0 MS B /MS AB H 0 : στβ 2 = 0 MS AB /MS E Estimating variance components using ANOVA method (METHOD=TYPE1) ˆσ 2 = MS E ˆσ τ 2 = (MS A MS AB )/bn ˆσ β 2 = (MS B MS AB )/an ˆσ τβ 2 = (MS AB MS E )/n May results in negative estimates,proc MIXED usesmethod=reml by default 27 Lecture 10 Page 27
28 The Measurement Systems Capability Experiment (Random-Effects Model) Assume the three operators were randomly selected= Random Factor proc glm data=gaugerr; class operator part; model resp=operator part; random operator part operator*part / test; test H=operator E=operator*part; test H=part E=operator*part; run; quit; Sum of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error CorreTotal Source DF Type III SS Mean Square F Value Pr > F operator part <.0001 operator*part Lecture 10 Page 28
29 Source operator part operator*part Type III Expected Mean Square Var(Error) + 2 Var(operator*part) + 40 Var(operator) Var(Error) + 2 Var(operator*part) + 6 Var(part) Var(Error) + 2 Var(operator*part) Tests of Hypotheses for Random Model Analysis of Variance Source DF Type III SS Mean Square F Value Pr > F operator part <.0001 Error Error: MS(operator*part) Source DF Type III SS Mean Square F Value Pr > F operator*part Error: MS(Error) Tests of Hypotheses Using the Type III MS for operator*part as an Error Term Source DF Type III SS Mean Square F Value Pr > F operator part < Lecture 10 Page 29
30 proc mixed cl maxiter=20 covtest method=type1 data=gaugerr; class operator part; model resp = ; random operator part operator*part; run; quit; Sum of Source DF Squares Mean Square operator part operator*part Residual Source Expected Mean Square Error Term Error DF operator Var(Residual) + 2 Var(operator*part) + 40 Var(operator) MS(operator*part) 38 part Var(Residual) + 2 Var(operator*part) + 6 Var(part) MS(operator*part) 38 operator*part Var(Residual) + 2 Var(operator*part) MS(Residual) 60 Residual Var(Residual). Source F Value Pr > F operator part <.0001 operator*part Covariance Parameter Estimates Standard Z Cov Parm Estimate Error Value Pr Z Alpha Lower Upper operator part operator*part Residual < Lecture 10 Page 30
31 proc mixed cl maxiter=20 covtest data=gaugerr; class operator part; model resp = ; random operator part operator*part; run; quit; Estimation Method REML Iteration History Iteration Evaluations -2 Res Log Like Criterion Convergence criteria met. Covariance Parameter Estimates Standard Z Cov Parm Estimate Error Value Pr Z Alpha Lower Upper operator E12 part operator*part Residual < Lecture 10 Page 31
32 Confidence Intervals for Variance Components Can use asymptotic variance estimates to form CI PROC MIXED withmethod=type1: Use standard normal 95% CI uses 1.96 ˆσ τ 2 ±1.96(.0330) = ( 0.05,0.08), ˆσ β 2 ±1.96(3.3738) = (3.67,16.89) PROC MIXED withmethod=reml (by default): Satterthwaite s Approximation Satterthwaite s Approximation (Lec 4): Testing the Significance ofσ 2 0 σ 2 0 = E[(MS r + +MS s ) (MS u + +MS v )]/k Estimate ˆσ 2 0 = [(MS r + +MS s ) (MS u + +MS v )]/k f i MS i /σ 2 i ind χ 2 f i Approximate(1 α) 100% CI ofσ 2 0 rˆσ 0 2 / χ 2 α/2,r σ0 2 rˆσ 0 2 / χ 2 1 α/2,r r = [(MS r + +MS s ) (MS u + +MS v )] 2 MSr 2 f r + + MS2 s f s + MS2 u f u + + MS2 v f v 32 Lecture 10 Page 32
33 Example: The Measurement Systems Capability Experiment (Random-Effects Model) ˆσ 2 τ = MS A MS AB bn = ( )/40 = df = ( ) 2 /( / /38) =.413 CI:(.413(.015)/3.079,.413(.015)/ ) = (.002,270781) ˆσ 2 β = MS B MS AB an = ( )/6 = df = ( ) 2 /( / /38) = CI:(18.57(10.28)/32.28, 18.57(10.28)/8.61) = (5.91, 22.17) 33 Lecture 10 Page 33
34 Three-Factor Mixed Model (A Fixed): Restricted Model y ijkl = µ+τ i +β j +γ k +(τβ) ij +(τγ) ik +(βγ) jk +(τβγ) ijk +ǫ ijkl F R R R a b c n term i j k l EMS τ i 0 b c n σ 2 + bcnστ2 i a 1 +cnσ 2 τβ +bnσ 2 τγ +nσ 2 τβγ β j a 1 c n σ 2 +acnσ 2 β +anσ 2 βγ γ k a b 1 n σ 2 +abnσ 2 γ +anσ 2 βγ (τβ) ij 0 1 c n σ 2 +cnσ 2 τβ +nσ 2 τβγ (τγ) ik 0 b 1 n σ 2 +bnσ 2 τγ +nσ 2 τβγ (βγ) jk a 1 1 n σ 2 +anσ 2 βγ (τβγ) ijk n σ 2 +nσ 2 τβγ ǫ (ijk)l σ 2 34 Lecture 10 Page 34
35 Three-Factor Mixed Model (A Fixed): Restricted Model Construct test statistics based on EMS H 0 : τ 1 = = τ a = 0? H 0 : σβ 2 = 0 MS B /MS BC H 0 : σγ 2 = 0 MS C /MS BC H 0 : στβ 2 = 0 MS AB /MS ABC H 0 : στγ 2 = 0 MS AC /MS ABC H 0 : σβγ 2 = 0 MS BC /MS E H 0 : στβγ 2 = 0 MS ABC /MS E 35 Lecture 10 Page 35
36 Three-Factor Mixed Model (A Fixed): Unrestricted Model y ijkl = µ+τ i +β j +γ k +(τβ) ij +(τγ) ik +(βγ) jk +(τβγ) ijk +ǫ ijkl F R R R a b c n term i j k l EMS τ i 0 b c n σ 2 + bcnστ2 i a 1 +cnσ 2 τβ +bnσ 2 τγ +nσ 2 τβγ β j a 1 c n σ 2 +acnσ 2 β +cnσ 2 τβ +anσ 2 βγ +nσ 2 τβγ γ k a b 1 n σ 2 +abnσ 2 γ +bnσ 2 τγ +anσ 2 βγ +nσ 2 τβγ (τβ) ij 1 1 c n σ 2 +cnσ 2 τβ +nσ 2 τβγ (τγ) ik 1 b 1 n σ 2 +bnσ 2 τγ +nσ 2 τβγ (βγ) jk a 1 1 n σ 2 +anσ 2 βγ +nσ 2 τβγ (τβγ) ijk n σ 2 +nσ 2 τβγ ǫ (ijk)l σ 2 36 Lecture 10 Page 36
37 Three-Factor Mixed Model (A Fixed): Unrestricted Model Construct test statistics based on EMS H 0 : τ 1 = = τ a = 0? H 0 : σβ 2 = 0? H 0 : σγ 2 = 0? H 0 : στβ 2 = 0 MS AB /MS ABC H 0 : στγ 2 = 0 MS AC /MS ABC H 0 : σβγ 2 = 0 MS BC /MS ABC H 0 : στβγ 2 = 0 MS ABC /MS E 37 Lecture 10 Page 37
38 Satterthwaite s Approximate F-test ForH 0 : effect = 0, no exact test exists. SupposeE(MS ) E(MS ) is a multiple of the effect Two linear combinations of mean squaresms andms MS = MS r + +MS s MS = MS u + +MS v MS andms do not share common mean squares Approximate test statisticf = MS MS = MS r+ +MS s MS u + +MS v F p,q p = (MS r+ +MS s ) 2 MS 2 r /f r+ +MS 2 s /f s andq = (MS u+ +MS v ) 2 MS 2 u /f u+...+ms 2 v /f v f i is the degrees of freedom associated with MS i Need interpolation whenporq are not be integers. SAS can handle noninteger dfs. 38 Lecture 10 Page 38
39 Example: Restricted Three-Factor Mixed Model (A Fixed) Based on EMS, no exact test forh 0 : τ 1 = = τ a = 0 or equivalently H 0 : τ 2 i = 0 Assumea = 3,b = 2,c = 3,n = 2 Source DF MS EMS F P A Q(A)+6σ 2 AB +4σ 2 AC?? +2σ 2 ABC +σ 2 B σ 2 B +6σ 2 BC +σ C σ 2 C +6σ 2 BC +σ AB σ 2 AB +2σ 2 ABC +σ AC σ 2 AC +2σ 2 ABC +σ BC σ 2 BC +σ ABC σ 2 ABC +σ Error σ 2 39 Lecture 10 Page 39
40 H 0 : τ 1 = τ 2 = τ 3 = 0 H 0 : Q(A) = a i=1 τ2 i /(a 1) = 0 MS = MS A +MS ABC MS = MS AB +MS AC E(MS MS ) = 12Q(A) = 12 Στ2 i 3 1 F = MS A +MS ABC MS AB +MS AC = = p = q = ( ) / /4 = 2.01, ( ) / /2 = 6.00 Interpolation needed P(F 2,6 > 48.41) =.0002, P(F 3,6 > 48.41) =.0001 P(F 2.01,6 > 48.41) =.99(.0002)+.01(.0001) = Lecture 10 Page 40
41 SAS can be used to compute P-values and quantile values for F andχ 2 values with noninteger degrees of freedom Upper tail probability:probf(x,df1,df2) andprobchi(x,df) Quantiles:FINV(p,df1,df2) andcinv(p,df) data one; p=1-probf(48.41,2.01,6); f=finv(.95,2.01,6); c1=cinv(.025,18.57); /* For Page 33 */ c2=cinv(.975,18.57); /* For Page 33 */ proc print data=one; run; quit; Obs p f c1 c Lecture 10 Page 41
42 In terms of linear model General Mixed Effect Model Y = Xβ +Zδ +ǫ β is a vector of fixed-effect parameters δ is a vector of random-effect parameters ǫ is the error vector δ and ǫ assumed uncorrelated means 0 covariance matricesgandr(allows correlation) Cov(Y ) =ZGZ +R IfR = σ 2 I andz = 0, back to standard linear model PROC MIXED in SAS allows one to specifygandr G through RANDOM, R through REPEATED Unrestricted linear mixed model is default 42 Lecture 10 Page 42
43 Sample Size Calculations Recall sample size calculations on a hypothesis test of a set of effects using For a set of fixed effects, F 0 = MS N MS D H 0 Fν1,ν 2 Use SAS to calculatepower=1-β=1-probf(f α,ν1,ν 2,ν 1,ν 2,δ) with δ = E[MS N MS D ] ν 1 E[MS D ] Use OCC in Chart V:β vs. Φ = δ/(ν 1 +1) For a set of random effects: ν 1 MS N /σn 2 χ 2 ν 1 andν 2 MS D /σd 2 χ 2 ν 2 F 0 /λ 2 F ν1,ν 2 withλ 2 = E[MS N ]/E[MS D ] Use OCC in Chart VI:β vs. λ = E[MS N ]/E[MS D ] Use SAS to calculatepower=1-β=1-probf(f α,ν1,ν 2 /λ 2,ν 1,ν 2 ). 43 Lecture 10 Page 43
44 Mixed Effects Model Restricted Mixed Model Factor Parameter ν 1 ν 2 bn τi A (Fixed) Φ = 2 a(σ 2 +nστβ 2 ) a 1 (a 1)(b 1) B (Random) λ = 1+ anσ2 β σ b 1 ab(n 1) 2 AB (Random) λ = 1+ nσ2 τβ σ (a 1)(b 1) ab(n 1) 2 Unrestricted Mixed Model Factor Parameter ν 1 ν 2 bn τi A (Fixed) Φ = 2 a(σ 2 +nστβ 2 ) a 1 (a 1)(b 1) B (Random) λ = AB (Random) λ = 1+ anσ2 β σ 2 +nστβ 2 b 1 (a 1)(b 1) 1+ nσ2 τβ σ 2 (a 1)(b 1) ab(n 1) 44 Lecture 10 Page 44
45 Random-Effects Model Factor λ ν 1 ν 2 A 1+ bnσ2 τ a 1 (a 1)(b 1) σ 2 +nστβ 2 B AB 1+ anσ2 β σ 2 +nστβ 2 b 1 (a 1)(b 1) 1+ nσ2 τβ σ 2 (a 1)(b 1) ab(n 1) 45 Lecture 10 Page 45
Lecture 10: Experiments with Random Effects
Lecture 10: Experiments with Random Effects Montgomery, Chapter 13 1 Lecture 10 Page 1 Example 1 A textile company weaves a fabric on a large number of looms. It would like the looms to be homogeneous
More informationTopic 32: Two-Way Mixed Effects Model
Topic 3: Two-Way Mixed Effects Model Outline Two-way mixed models Three-way mixed models Data for two-way design Y is the response variable Factor A with levels i = 1 to a Factor B with levels j = 1 to
More informationLecture 4. Random Effects in Completely Randomized Design
Lecture 4. Random Effects in Completely Randomized Design Montgomery: 3.9, 13.1 and 13.7 1 Lecture 4 Page 1 Random Effects vs Fixed Effects Consider factor with numerous possible levels Want to draw inference
More informationLecture 11: Nested and Split-Plot Designs
Lecture 11: Nested and Split-Plot Designs Montgomery, Chapter 14 1 Lecture 11 Page 1 Crossed vs Nested Factors Factors A (a levels)and B (b levels) are considered crossed if Every combinations of A and
More informationStatistics 512: Applied Linear Models. Topic 9
Topic Overview Statistics 51: Applied Linear Models Topic 9 This topic will cover Random vs. Fixed Effects Using E(MS) to obtain appropriate tests in a Random or Mixed Effects Model. Chapter 5: One-way
More informationTopic 25 - One-Way Random Effects Models. Outline. Random Effects vs Fixed Effects. Data for One-way Random Effects Model. One-way Random effects
Topic 5 - One-Way Random Effects Models One-way Random effects Outline Model Variance component estimation - Fall 013 Confidence intervals Topic 5 Random Effects vs Fixed Effects Consider factor with numerous
More informationThis is a Randomized Block Design (RBD) with a single factor treatment arrangement (2 levels) which are fixed.
EXST3201 Chapter 13c Geaghan Fall 2005: Page 1 Linear Models Y ij = µ + βi + τ j + βτij + εijk This is a Randomized Block Design (RBD) with a single factor treatment arrangement (2 levels) which are fixed.
More informationLec 5: Factorial Experiment
November 21, 2011 Example Study of the battery life vs the factors temperatures and types of material. A: Types of material, 3 levels. B: Temperatures, 3 levels. Example Study of the battery life vs the
More informationT-test: means of Spock's judge versus all other judges 1 12:10 Wednesday, January 5, judge1 N Mean Std Dev Std Err Minimum Maximum
T-test: means of Spock's judge versus all other judges 1 The TTEST Procedure Variable: pcwomen judge1 N Mean Std Dev Std Err Minimum Maximum OTHER 37 29.4919 7.4308 1.2216 16.5000 48.9000 SPOCKS 9 14.6222
More informationUnbalanced Designs Mechanics. Estimate of σ 2 becomes weighted average of treatment combination sample variances.
Unbalanced Designs Mechanics Estimate of σ 2 becomes weighted average of treatment combination sample variances. Types of SS Difference depends on what hypotheses are tested and how differing sample sizes
More informationSAS Commands. General Plan. Output. Construct scatterplot / interaction plot. Run full model
Topic 23 - Unequal Replication Data Model Outline - Fall 2013 Parameter Estimates Inference Topic 23 2 Example Page 954 Data for Two Factor ANOVA Y is the response variable Factor A has levels i = 1, 2,...,
More informationLecture 9: Factorial Design Montgomery: chapter 5
Lecture 9: Factorial Design Montgomery: chapter 5 Page 1 Examples Example I. Two factors (A, B) each with two levels (, +) Page 2 Three Data for Example I Ex.I-Data 1 A B + + 27,33 51,51 18,22 39,41 EX.I-Data
More informationContents. TAMS38 - Lecture 6 Factorial design, Latin Square Design. Lecturer: Zhenxia Liu. Factorial design 3. Complete three factor design 4
Contents Factorial design TAMS38 - Lecture 6 Factorial design, Latin Square Design Lecturer: Zhenxia Liu Department of Mathematics - Mathematical Statistics 28 November, 2017 Complete three factor design
More informationOutline. Topic 19 - Inference. The Cell Means Model. Estimates. Inference for Means Differences in cell means Contrasts. STAT Fall 2013
Topic 19 - Inference - Fall 2013 Outline Inference for Means Differences in cell means Contrasts Multiplicity Topic 19 2 The Cell Means Model Expressed numerically Y ij = µ i + ε ij where µ i is the theoretical
More informationTwo-factor studies. STAT 525 Chapter 19 and 20. Professor Olga Vitek
Two-factor studies STAT 525 Chapter 19 and 20 Professor Olga Vitek December 2, 2010 19 Overview Now have two factors (A and B) Suppose each factor has two levels Could analyze as one factor with 4 levels
More informationOutline Topic 21 - Two Factor ANOVA
Outline Topic 21 - Two Factor ANOVA Data Model Parameter Estimates - Fall 2013 Equal Sample Size One replicate per cell Unequal Sample size Topic 21 2 Overview Now have two factors (A and B) Suppose each
More informationHomework 3 - Solution
STAT 526 - Spring 2011 Homework 3 - Solution Olga Vitek Each part of the problems 5 points 1. KNNL 25.17 (Note: you can choose either the restricted or the unrestricted version of the model. Please state
More informationTWO OR MORE RANDOM EFFECTS. The two-way complete model for two random effects:
TWO OR MORE RANDOM EFFECTS Example: The factors that influence the breaking strength of a synthetic fiber are being studied. Four production machines and three operators are randomly selected. A two-way
More informationAnalysis of Variance and Design of Experiments-I
Analysis of Variance and Design of Experiments-I MODULE VIII LECTURE - 35 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS MODEL Dr. Shalabh Department of Mathematics and Statistics Indian
More informationMAT3378 ANOVA Summary
MAT3378 ANOVA Summary April 18, 2016 Before you do the analysis: How many factors? (one-factor/one-way ANOVA, two-factor ANOVA etc.) Fixed or Random or Mixed effects? Crossed-factors; nested factors or
More informationDifferences of Least Squares Means
STAT:5201 Homework 9 Solutions 1. We have a model with two crossed random factors operator and machine. There are 4 operators, 8 machines, and 3 observations from each operator/machine combination. (a)
More informationTopic 17 - Single Factor Analysis of Variance. Outline. One-way ANOVA. The Data / Notation. One way ANOVA Cell means model Factor effects model
Topic 17 - Single Factor Analysis of Variance - Fall 2013 One way ANOVA Cell means model Factor effects model Outline Topic 17 2 One-way ANOVA Response variable Y is continuous Explanatory variable is
More informationChapter 11. Analysis of Variance (One-Way)
Chapter 11 Analysis of Variance (One-Way) We now develop a statistical procedure for comparing the means of two or more groups, known as analysis of variance or ANOVA. These groups might be the result
More informationRandom and Mixed Effects Models - Part III
Random and Mixed Effects Models - Part III Statistics 149 Spring 2006 Copyright 2006 by Mark E. Irwin Quasi-F Tests When we get to more than two categorical factors, some times there are not nice F tests
More informationLecture 5: Comparing Treatment Means Montgomery: Section 3-5
Lecture 5: Comparing Treatment Means Montgomery: Section 3-5 Page 1 Linear Combination of Means ANOVA: y ij = µ + τ i + ɛ ij = µ i + ɛ ij Linear combination: L = c 1 µ 1 + c 1 µ 2 +...+ c a µ a = a i=1
More informationFactorial and Unbalanced Analysis of Variance
Factorial and Unbalanced Analysis of Variance Nathaniel E. Helwig Assistant Professor of Psychology and Statistics University of Minnesota (Twin Cities) Updated 04-Jan-2017 Nathaniel E. Helwig (U of Minnesota)
More informationFactorial designs. Experiments
Chapter 5: Factorial designs Petter Mostad mostad@chalmers.se Experiments Actively making changes and observing the result, to find causal relationships. Many types of experimental plans Measuring response
More informationWITHIN-PARTICIPANT EXPERIMENTAL DESIGNS
1 WITHIN-PARTICIPANT EXPERIMENTAL DESIGNS I. Single-factor designs: the model is: yij i j ij ij where: yij score for person j under treatment level i (i = 1,..., I; j = 1,..., n) overall mean βi treatment
More informationSTAT 5200 Handout #23. Repeated Measures Example (Ch. 16)
Motivating Example: Glucose STAT 500 Handout #3 Repeated Measures Example (Ch. 16) An experiment is conducted to evaluate the effects of three diets on the serum glucose levels of human subjects. Twelve
More informationAnalysis of Covariance
Analysis of Covariance (ANCOVA) Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 10 1 When to Use ANCOVA In experiment, there is a nuisance factor x that is 1 Correlated with y 2
More information13. The Cochran-Satterthwaite Approximation for Linear Combinations of Mean Squares
13. The Cochran-Satterthwaite Approximation for Linear Combinations of Mean Squares opyright c 2018 Dan Nettleton (Iowa State University) 13. Statistics 510 1 / 18 Suppose M 1,..., M k are independent
More informationEXST Regression Techniques Page 1. We can also test the hypothesis H :" œ 0 versus H :"
EXST704 - Regression Techniques Page 1 Using F tests instead of t-tests We can also test the hypothesis H :" œ 0 versus H :" Á 0 with an F test.! " " " F œ MSRegression MSError This test is mathematically
More informationLecture 5: Determining Sample Size
Lecture 5: Determining Sample Size Montgomery: Section 3.7 and 13.4 1 Lecture 5 Page 1 Choice of Sample Size: Fixed Effects Can determine the sample size for OverallF test Contrasts of interest For simplicity,
More informationTheorem A: Expectations of Sums of Squares Under the two-way ANOVA model, E(X i X) 2 = (µ i µ) 2 + n 1 n σ2
identity Y ijk Ȳ = (Y ijk Ȳij ) + (Ȳi Ȳ ) + (Ȳ j Ȳ ) + (Ȳij Ȳi Ȳ j + Ȳ ) Theorem A: Expectations of Sums of Squares Under the two-way ANOVA model, (1) E(MSE) = E(SSE/[IJ(K 1)]) = (2) E(MSA) = E(SSA/(I
More information5.3 Three-Stage Nested Design Example
5.3 Three-Stage Nested Design Example A researcher designs an experiment to study the of a metal alloy. A three-stage nested design was conducted that included Two alloy chemistry compositions. Three ovens
More informationUnit 7: Random Effects, Subsampling, Nested and Crossed Factor Designs
Unit 7: Random Effects, Subsampling, Nested and Crossed Factor Designs STA 643: Advanced Experimental Design Derek S. Young 1 Learning Objectives Understand how to interpret a random effect Know the different
More informationChapter 5 Introduction to Factorial Designs
Chapter 5 Introduction to Factorial Designs 5. Basic Definitions and Principles Stud the effects of two or more factors. Factorial designs Crossed: factors are arranged in a factorial design Main effect:
More informationTwo or more categorical predictors. 2.1 Two fixed effects
Two or more categorical predictors Here we extend the ANOVA methods to handle multiple categorical predictors. The statistician has to watch carefully to see whether the effects being considered are properly
More informationdm'log;clear;output;clear'; options ps=512 ls=99 nocenter nodate nonumber nolabel FORMCHAR=" = -/\<>*"; ODS LISTING;
dm'log;clear;output;clear'; options ps=512 ls=99 nocenter nodate nonumber nolabel FORMCHAR=" ---- + ---+= -/\*"; ODS LISTING; *** Table 23.2 ********************************************; *** Moore, David
More informationAnalysis of Variance
Statistical Techniques II EXST7015 Analysis of Variance 15a_ANOVA_Introduction 1 Design The simplest model for Analysis of Variance (ANOVA) is the CRD, the Completely Randomized Design This model is also
More informationStatistics 210 Part 3 Statistical Methods Hal S. Stern Department of Statistics University of California, Irvine
Thus far: Statistics 210 Part 3 Statistical Methods Hal S. Stern Department of Statistics University of California, Irvine sternh@uci.edu design of experiments two sample methods one factor ANOVA pairing/blocking
More informationOdor attraction CRD Page 1
Odor attraction CRD Page 1 dm'log;clear;output;clear'; options ps=512 ls=99 nocenter nodate nonumber nolabel FORMCHAR=" ---- + ---+= -/\*"; ODS LISTING; *** Table 23.2 ********************************************;
More informationdata proc sort proc corr run proc reg run proc glm run proc glm run proc glm run proc reg CONMAIN CONINT run proc reg DUMMAIN DUMINT run proc reg
data one; input id Y group X; I1=0;I2=0;I3=0;if group=1 then I1=1;if group=2 then I2=1;if group=3 then I3=1; IINT1=I1*X;IINT2=I2*X;IINT3=I3*X; *************************************************************************;
More informationMixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p.
STAT:5201 Applied Statistic II Mixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p.422 OLRT) Hamster example with three
More informationAssignment 6 Answer Keys
ssignment 6 nswer Keys Problem 1 (a) The treatment sum of squares can be calculated by SS Treatment = b a ȳi 2 Nȳ 2 i=1 = 5 (5.40 2 + 5.80 2 + 10 2 + 9.80 2 ) 20 7.75 2 = 92.95 Then the F statistic for
More informationGeneral Linear Model (Chapter 4)
General Linear Model (Chapter 4) Outcome variable is considered continuous Simple linear regression Scatterplots OLS is BLUE under basic assumptions MSE estimates residual variance testing regression coefficients
More informationFactorial ANOVA. Psychology 3256
Factorial ANOVA Psychology 3256 Made up data.. Say you have collected data on the effects of Retention Interval 5 min 1 hr 24 hr on memory So, you do the ANOVA and conclude that RI affects memory % corr
More informationLecture 3. Experiments with a Single Factor: ANOVA Montgomery 3-1 through 3-3
Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3-1 through 3-3 Page 1 Tensile Strength Experiment Investigate the tensile strength of a new synthetic fiber. The factor is the weight percent
More informationStat 217 Final Exam. Name: May 1, 2002
Stat 217 Final Exam Name: May 1, 2002 Problem 1. Three brands of batteries are under study. It is suspected that the lives (in weeks) of the three brands are different. Five batteries of each brand are
More informationDescriptions of post-hoc tests
Experimental Statistics II Page 81 Descriptions of post-hoc tests Post-hoc or Post-ANOVA tests! Once you have found out some treatment(s) are different, how do you determine which one(s) are different?
More informationPLS205 Lab 2 January 15, Laboratory Topic 3
PLS205 Lab 2 January 15, 2015 Laboratory Topic 3 General format of ANOVA in SAS Testing the assumption of homogeneity of variances by "/hovtest" by ANOVA of squared residuals Proc Power for ANOVA One-way
More informationThe factors in higher-way ANOVAs can again be considered fixed or random, depending on the context of the study. For each factor:
M. Two-way Random Effects ANOVA The factors in higher-way ANOVAs can again be considered fixed or random, depending on the context of the study. For each factor: Are the levels of that factor of direct
More informationSTAT 705 Chapter 19: Two-way ANOVA
STAT 705 Chapter 19: Two-way ANOVA Adapted from Timothy Hanson Department of Statistics, University of South Carolina Stat 705: Data Analysis II 1 / 41 Two-way ANOVA This material is covered in Sections
More informationSTAT 705 Chapter 19: Two-way ANOVA
STAT 705 Chapter 19: Two-way ANOVA Timothy Hanson Department of Statistics, University of South Carolina Stat 705: Data Analysis II 1 / 38 Two-way ANOVA Material covered in Sections 19.2 19.4, but a bit
More informationdf=degrees of freedom = n - 1
One sample t-test test of the mean Assumptions: Independent, random samples Approximately normal distribution (from intro class: σ is unknown, need to calculate and use s (sample standard deviation)) Hypotheses:
More informationSingle Factor Experiments
Single Factor Experiments Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 4 1 Analysis of Variance Suppose you are interested in comparing either a different treatments a levels
More informationAnalysis of Variance
Analysis of Variance Blood coagulation time T avg A 62 60 63 59 61 B 63 67 71 64 65 66 66 C 68 66 71 67 68 68 68 D 56 62 60 61 63 64 63 59 61 64 Blood coagulation time A B C D Combined 56 57 58 59 60 61
More informationChapter 13 Experiments with Random Factors Solutions
Solutions from Montgomery, D. C. (01) Design and Analysis of Experiments, Wiley, NY Chapter 13 Experiments with Random Factors Solutions 13.. An article by Hoof and Berman ( Statistical Analysis of Power
More informationLinear Combinations. Comparison of treatment means. Bruce A Craig. Department of Statistics Purdue University. STAT 514 Topic 6 1
Linear Combinations Comparison of treatment means Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 6 1 Linear Combinations of Means y ij = µ + τ i + ǫ ij = µ i + ǫ ij Often study
More informationCh 3: Multiple Linear Regression
Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery
More informationTopic 20: Single Factor Analysis of Variance
Topic 20: Single Factor Analysis of Variance Outline Single factor Analysis of Variance One set of treatments Cell means model Factor effects model Link to linear regression using indicator explanatory
More informationAnalysis of Longitudinal Data: Comparison Between PROC GLM and PROC MIXED. Maribeth Johnson Medical College of Georgia Augusta, GA
Analysis of Longitudinal Data: Comparison Between PROC GLM and PROC MIXED Maribeth Johnson Medical College of Georgia Augusta, GA Overview Introduction to longitudinal data Describe the data for examples
More informationTopic 29: Three-Way ANOVA
Topic 29: Three-Way ANOVA Outline Three-way ANOVA Data Model Inference Data for three-way ANOVA Y, the response variable Factor A with levels i = 1 to a Factor B with levels j = 1 to b Factor C with levels
More informationReference: Chapter 13 of Montgomery (8e)
Reference: Chapter 1 of Montgomery (8e) Maghsoodloo 89 Factorial Experiments with Random Factors So far emphasis has been placed on factorial experiments where all factors are at a, b, c,... fixed levels
More informationThese are multifactor experiments that have
Design of Engineering Experiments Nested Designs Text reference, Chapter 14, Pg. 525 These are multifactor experiments that have some important industrial applications Nested and split-plot designs frequently
More informationContents. TAMS38 - Lecture 8 2 k p fractional factorial design. Lecturer: Zhenxia Liu. Example 0 - continued 4. Example 0 - Glazing ceramic 3
Contents TAMS38 - Lecture 8 2 k p fractional factorial design Lecturer: Zhenxia Liu Department of Mathematics - Mathematical Statistics Example 0 2 k factorial design with blocking Example 1 2 k p fractional
More informationIncomplete Block Designs
Incomplete Block Designs Recall: in randomized complete block design, each of a treatments was used once within each of b blocks. In some situations, it will not be possible to use each of a treatments
More information1 Tomato yield example.
ST706 - Linear Models II. Spring 2013 Two-way Analysis of Variance examples. Here we illustrate what happens analyzing two way data in proc glm in SAS. Similar issues come up with other software where
More informationLecture 3. Experiments with a Single Factor: ANOVA Montgomery 3.1 through 3.3
Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3.1 through 3.3 Fall, 2013 Page 1 Tensile Strength Experiment Investigate the tensile strength of a new synthetic fiber. The factor is the
More informationThe Random Effects Model Introduction
The Random Effects Model Introduction Sometimes, treatments included in experiment are randomly chosen from set of all possible treatments. Conclusions from such experiment can then be generalized to other
More informationMixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p.
22s:173 Combining multiple factors into a single superfactor Mixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p.422 Oehlert)
More informationLecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2
Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2 Fall, 2013 Page 1 Random Variable and Probability Distribution Discrete random variable Y : Finite possible values {y
More informationLecture 7: Latin Square and Related Design
Lecture 7: Latin Square and Related Design Montgomery: Section 4.2-4.3 Page 1 Automobile Emission Experiment Four cars and four drivers are employed in a study for possible differences between four gasoline
More informationAnalysis of Variance II Bios 662
Analysis of Variance II Bios 662 Michael G. Hudgens, Ph.D. mhudgens@bios.unc.edu http://www.bios.unc.edu/ mhudgens 2008-10-24 17:21 BIOS 662 1 ANOVA II Outline Multiple Comparisons Scheffe Tukey Bonferroni
More information4.8 Alternate Analysis as a Oneway ANOVA
4.8 Alternate Analysis as a Oneway ANOVA Suppose we have data from a two-factor factorial design. The following method can be used to perform a multiple comparison test to compare treatment means as well
More informationEXST 7015 Fall 2014 Lab 11: Randomized Block Design and Nested Design
EXST 7015 Fall 2014 Lab 11: Randomized Block Design and Nested Design OBJECTIVES: The objective of an experimental design is to provide the maximum amount of reliable information at the minimum cost. In
More information17. Example SAS Commands for Analysis of a Classic Split-Plot Experiment 17. 1
17 Example SAS Commands for Analysis of a Classic SplitPlot Experiment 17 1 DELIMITED options nocenter nonumber nodate ls80; Format SCREEN OUTPUT proc import datafile"c:\data\simulatedsplitplotdatatxt"
More informationA Re-Introduction to General Linear Models (GLM)
A Re-Introduction to General Linear Models (GLM) Today s Class: You do know the GLM Estimation (where the numbers in the output come from): From least squares to restricted maximum likelihood (REML) Reviewing
More informationDesign of Engineering Experiments Chapter 5 Introduction to Factorials
Design of Engineering Experiments Chapter 5 Introduction to Factorials Text reference, Chapter 5 page 170 General principles of factorial experiments The two-factor factorial with fixed effects The ANOVA
More informationLecture 2. The Simple Linear Regression Model: Matrix Approach
Lecture 2 The Simple Linear Regression Model: Matrix Approach Matrix algebra Matrix representation of simple linear regression model 1 Vectors and Matrices Where it is necessary to consider a distribution
More informationCh 2: Simple Linear Regression
Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component
More informationV. Experiments With Two Crossed Treatment Factors
V. Experiments With Two Crossed Treatment Factors A.The Experimental Design Completely Randomized Design (CRD) Let A be a factor with levels i = 1,,a B be a factor with levels j = 1,,b Y ijt = the response
More informationLinear Combinations of Group Means
Linear Combinations of Group Means Look at the handicap example on p. 150 of the text. proc means data=mth567.disability; class handicap; var score; proc sort data=mth567.disability; by handicap; proc
More informationComparison of a Population Means
Analysis of Variance Interested in comparing Several treatments Several levels of one treatment Comparison of a Population Means Could do numerous two-sample t-tests but... ANOVA provides method of joint
More informationANOVA Longitudinal Models for the Practice Effects Data: via GLM
Psyc 943 Lecture 25 page 1 ANOVA Longitudinal Models for the Practice Effects Data: via GLM Model 1. Saturated Means Model for Session, E-only Variances Model (BP) Variances Model: NO correlation, EQUAL
More informationMEMORIAL UNIVERSITY OF NEWFOUNDLAND DEPARTMENT OF MATHEMATICS AND STATISTICS FINAL EXAM - STATISTICS FALL 1999
MEMORIAL UNIVERSITY OF NEWFOUNDLAND DEPARTMENT OF MATHEMATICS AND STATISTICS FINAL EXAM - STATISTICS 350 - FALL 1999 Instructor: A. Oyet Date: December 16, 1999 Name(Surname First): Student Number INSTRUCTIONS
More information6 Designs with Split Plots
6 Designs with Split Plots Many factorial experimental designs are incorrectly analyzed because the assumption of complete randomization is not true. Many factorial experiments have one or more restrictions
More informationRandomized Complete Block Designs
Randomized Complete Block Designs David Allen University of Kentucky February 23, 2016 1 Randomized Complete Block Design There are many situations where it is impossible to use a completely randomized
More informationChapter 8: Hypothesis Testing Lecture 9: Likelihood ratio tests
Chapter 8: Hypothesis Testing Lecture 9: Likelihood ratio tests Throughout this chapter we consider a sample X taken from a population indexed by θ Θ R k. Instead of estimating the unknown parameter, we
More informationUnit 8: A Mixed Two-Factor Design
Minitab Notes for STAT 6305 Dept. of Statistics CSU East Bay Unit 8: A Mixed Two-Factor Design 8.1. The Data We use data quoted in Brownlee: Statistical Theory and Methodology in Science and Engineering,
More informationStatistics for exp. medical researchers Comparison of groups, T-tests and ANOVA
Faculty of Health Sciences Outline Statistics for exp. medical researchers Comparison of groups, T-tests and ANOVA Lene Theil Skovgaard Sept. 14, 2015 Paired comparisons: tests and confidence intervals
More informationTopic 28: Unequal Replication in Two-Way ANOVA
Topic 28: Unequal Replication in Two-Way ANOVA Outline Two-way ANOVA with unequal numbers of observations in the cells Data and model Regression approach Parameter estimates Previous analyses with constant
More informationLecture 7: Latin Squares and Related Designs
Lecture 7: Latin Squares and Related Designs Montgomery: Section 4.2 and 4.3 1 Lecture 7 Page 1 Automobile Emission Experiment Four cars and four drivers are employed in a study of four gasoline additives(a,b,c,
More informationChap The McGraw-Hill Companies, Inc. All rights reserved.
11 pter11 Chap Analysis of Variance Overview of ANOVA Multiple Comparisons Tests for Homogeneity of Variances Two-Factor ANOVA Without Replication General Linear Model Experimental Design: An Overview
More informationRandom Coefficient Model (a.k.a. multilevel model) (Adapted from UCLA Statistical Computing Seminars)
STAT:5201 Applied Statistic II Random Coefficient Model (a.k.a. multilevel model) (Adapted from UCLA Statistical Computing Seminars) School math achievement scores The data file consists of 7185 students
More informationLecture 10: 2 k Factorial Design Montgomery: Chapter 6
Lecture 10: 2 k Factorial Design Montgomery: Chapter 6 Page 1 2 k Factorial Design Involving k factors Each factor has two levels (often labeled + and ) Factor screening experiment (preliminary study)
More informationSTAT 8200 Design of Experiments for Research Workers Lab 11 Due: Friday, Nov. 22, 2013
Example: STAT 8200 Design of Experiments for Research Workers Lab 11 Due: Friday, Nov. 22, 2013 An experiment is designed to study pigment dispersion in paint. Four different methods of mixing a particular
More informationUnit 8: A Mixed Two-Factor Design
Minitab Notes for STAT 3503 Dept. of Statistics CSU Hayward Unit 8: A Mixed Two-Factor Design 8.1. The Data We use data quoted in Brownlee: Statistical Theory and Methodology in Science and Engineering,
More informationSTAT 705 Chapters 23 and 24: Two factors, unequal sample sizes; multi-factor ANOVA
STAT 705 Chapters 23 and 24: Two factors, unequal sample sizes; multi-factor ANOVA Timothy Hanson Department of Statistics, University of South Carolina Stat 705: Data Analysis II 1 / 22 Balanced vs. unbalanced
More informationIntroduction to Design and Analysis of Experiments with the SAS System (Stat 7010 Lecture Notes)
Introduction to Design and Analysis of Experiments with the SAS System (Stat 7010 Lecture Notes) Asheber Abebe Discrete and Statistical Sciences Auburn University Contents 1 Completely Randomized Design
More information