Lecture 10: Factorial Designs with Random Factors

Size: px
Start display at page:

Download "Lecture 10: Factorial Designs with Random Factors"

Transcription

1 Lecture 10: Factorial Designs with Random Factors Montgomery, Section 13.2 and Lecture 10 Page 1

2 Factorial Experiments with Random Effects Lecture 9 has focused on fixed effects Always use MSE in denominator of F-test Use MSE in std error of linear contrasts Not always correct when random factors present May use interaction MS or combination of MS s Will now use EMS as guide for tests 2 Lecture 10 Page 2

3 Two-Factor Mixed Effects Model One factor random and one factor fixed (aka Model III) Assume A fixed and B random Mixed Factor Effects Model: Y ijk = µ+τ i +β j +(τβ) ij +ε ijk i τ i = 0 andβ j iid N(0,σ 2 β ) (τβ) ij N(0,(a 1)στβ 2 /a) subject to the restrictions i (τβ) ij = 0 for eachj ε ijk iid N(0,σ 2 ) {β j },{(τβ) ij } and{ε ijk } are pairwise independent Known as restricted mixed effects model 3 Lecture 10 Page 3

4 Not all(τβ) ij are independent Cov((τβ) ij,(τβ) i j) = 1 a σ2 τβ, i i IfX i iid N(µ,σ 2 ) then X i X N(0, n 1 n σ2 ) Cov(X i X,X j X) = 1 n σ2 The(a 1)/a simplifies the EMS E(MSE)=σ 2 E(MSA) =σ 2 +bn i τ2 i /(a 1)+nσ2 τβ E(MSB) =σ 2 +anσβ 2 E(MSAB) =σ 2 +nστβ 2 4 Lecture 10 Page 4

5 Hypotheses Testing and Diagnostics Hypothesis tests require different MS terms in the denominators H 0 : τ 1 = τ 2 =... = 0 MSA/MSAB H 0 : σβ 2 = 0 MSB/MSE H 0 : στβ 2 = 0 MSAB/MSE Variance Estimates (Using ANOVA method) ˆσ 2 = MSE ˆσ β 2 = (MSB MSE)/(an) ˆσ τβ 2 = (MSAB MSE)/n Diagnostics Histogram or QQplot Normality or Unusual Observations Residual Plots Constant variance or Unusual Observations 5 Lecture 10 Page 5

6 Estimates & Multiple Comparisons for Fixed Effects y ijk = µ+τ i +β j +(τβ) ij +ǫ ijk y i.. = µ+τ i +β. +(τβ) i. +ǫ i.. Var(y i.. ) = σβ/b+(a 1)σ 2 τβ/ab+σ 2 2 /bn ˆτ i = ȳ i.. ȳ... var(ˆτ i ) =? ˆτ i ˆτ i = y i.. y i.. = τ i τ i +(τβ) i. (τβ) i. +ǫ i.. ǫ i.. Var(ˆτ i ˆτ i ) = 2στβ/b+2σ 2 2 /bn = 2(nστβ 2 +σ 2 )/bn Need to plug in variance estimates to compute Var(y i.. ) What are the DF? For pairwise comparisons, use estimate2ms AB /bn Use df AB for t-statistic or Tukey s method. 6 Lecture 10 Page 6

7 The Measurement Systems Capability Experiment (Example 13.3 in Text) options nocenter ls=75; data gaugerr; input part operator resp cards; ; proc glm data=gaugerr; class operator part; model resp=operator part; means operator; run; quit; 7 Lecture 10 Page 7

8 Sum of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error CorrTotal Source DF Type I SS Mean Square F Value Pr > F operator part <.0001 operator*part Level of resp operator N Mean Std Dev Lecture 10 Page 8

9 TestH 0 : τ 1 = τ 2 = τ 3 = 0, P-value based onf 2,38 : H 0 : σ 2 β = 0: P-value based onf 19,60 : H 0 : σ 2 τβ = 0: P-value based onf 38,60 : 0.86 F 0 = MS A MS AB = = 1.84 F 0 = MS B MS E = = F 0 = MS AB MS E = = Lecture 10 Page 9

10 Variance components estimates: ˆσ 2 β = (3)(2) = 10.23,ˆσ 2 τβ = =.14( 0),ˆσ 2 = 0.99 Pairwise comparison forτ 1,τ 2 andτ 3 (Ȳi.. Ȳi..)/ 2MS AB /bn H 0 t (a 1)(b 1) ; (t /(2 3),38 = ) i i Ȳ i.. Ȳi.. 2MSAB /bn t 1 2 ( )/ /(20 2) ( )/ /(20 2) ( )/ /(20 2) Tukey s method usesq α (a,(a 1)(b 1)): q 0.05 (3,38)/ Lecture 10 Page 10

11 proc glm data=gaugerr; class operator part; model resp=operator part; random part operator*part; test H=operator E=operator*part; lsmeans operator / adjust=tukey E=operator*part tdiff; /* or means */ run; quit; Sum of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error Corrected Total Source DF Type III SS Mean Square F Value Pr > F operator x part <.0001 operator*part Tests of Hypotheses Using the Type III MS for operator*part as an Error Term Source DF Type III SS Mean Square F Value Pr > F operator Lecture 10 Page 11

12 Least Squares Means Adjustment for Multiple Comparisons: Tukey Standard Errors and Probabilities Calculated Using the Type III MS for operator*part as an Error Term LSMEAN operator resp LSMEAN Number Least Squares Means for Effect operator t for H0: LSMean(i)=LSMean(j) / Pr > t i/j NOTE:PROC GLM does NOT use a restricted mixed model 12 Lecture 10 Page 12

13 Alternate Two-Factor Mixed Effects Model Reduce the restrictions on(τβ) ij = unrestricted mixed model i τ i = 0 andβ j iid N(0,σ 2 β ) (τβ) ij N(0,σ 2 τβ ) ε ijk iid N(0,σ 2 ) {β j },{(τβ) ij } and{ε ijk } are pairwise independent SAS uses unrestricted mixed model in analysis Connection to Restricted Mixed Model: letting(τβ).j = ( i (τβ) ij)/a y ijk = µ+τ i +(β j +(τβ).j )+((τβ) ij (τβ).j )+ǫ ijk The above model satisfies the conditions of restricted mixed model Restricted mixed model is slightly more general since(y ij,y i j) 0 (Y ij,y i j) 0 in unrestricted mixed model. 13 Lecture 10 Page 13

14 Two-Factor Unrestricted Mixed Model Reduced restrictions alter EMS E(MSE)=σ 2 E(MSA) =σ 2 + bn τi 2 /(a 1) + nσ2 τβ E(MSB) =σ 2 + anσβ 2 + nσ2 τβ E(MSAB) =σ 2 + nστβ 2 RANDOM statement in SAS also gives these results Differences TestH 0 : σ 2 β = 0 using MSAB (Note: MSE in Restricted Models) Often more conservative test ˆσ 2 β = (MSB MSAB)/(an) Var(Y i.. ) =(nσ 2 β + nσ2 τβ + σ2 )/(bn) though Var(y i.. y i.. ) =2(nσ 2 τβ + σ2 )/bn To decide which model is appropriate, suppose you ran experiment again and sampled some of the same levels of the random effect. Does this mean that the interaction effects for these levels are the same as before? Yes: Restricted No: Unrestricted 14 Lecture 10 Page 14

15 The Measurement Systems Capability Experiment (Unrestricted Model) proc glm data=gaugerr; class operator part; model resp=operator part; random part operator*part / test; means operator / tukey E=operator*part cldiff; /* lsmeans operator / adjust=tukey E=operator*part tdiff; */ run; quit; Source operator part operator*part Type III Expected Mean Square Var(Error) + 2 Var(operator*part) + Q(operator) Var(Error) + 2 Var(operator*part) + 6 Var(part) Var(Error) + 2 Var(operator*part) 15 Lecture 10 Page 15

16 Usetest option inrandom statement to request the correctf tests for unrestricted mixed models. Tests of Hypotheses for Mixed Model Analysis of Variance Dependent Variable: resp Source DF Type III SS Mean Square F Value Pr > F operator part <.0001 Error Error: MS(operator*part) Source DF Type III SS Mean Square F Value Pr > F operator*part Error: MS(Error) Lecture 10 Page 16

17 Tukey s Studentized Range (HSD) Test for resp NOTE: This test controls the Type I experimentwise error rate. Alpha 0.05 Error Degrees of Freedom 38 Error Mean Square Critical Value of Studentized Range Minimum Significant Difference Comparisons significant at the 0.05 level are indicated by ***. Difference Simultaneous operator Between 95% Confidence Comparison Means Limits Lecture 10 Page 17

18 /* DDFM = SATTERTH: Use Satterthwaite approximation procedure to compute the denominator degrees of freedom for testing fixed effects*/ /* METHOD=REML: by default */ proc mixed alpha=.05 cl covtest method=reml data=gaugerr; class operator part; model resp=operator / ddfm=satterth; random part operator*part; lsmeans operator / alpha=.05 cl diff adjust=tukey; run; quit; Covariance Parameter Estimates Standard Z Cov Parm Estimate Error Value Pr > Z Alpha Lower Upper part operator*part Residual < Type 3 Tests of Fixed Effects Num Den Effect DF DF F Value Pr > F operator x Least Squares Means Standard Effect operator Estimate Error DF t Value Pr> t Alpha Lower Upper operator < operator < operator < Lecture 10 Page 18

19 Differences of Least Squares Means Effect operator _operator Estimate Error DF t Value Pr > t Adjustment operator Tukey-Kramer operator Tukey-Kramer operator Tukey-Kramer Differences of Least Squares Means Adj Adj Effect operator _operator Adj P Alpha Lower Upper Lower Upper operator operator operator BothPROC VARCOMP andproc MIXED compute estimates of variance components (different estimation procedures available) ANOVA method:method = TYPE1 RMLE method:method = REML (default forproc MIXED) MIVQUE0: default forvarcomp PROC MIXED can provide hypothesis tests and confidence intervals Not all outputs fromproc MIXED are correct! 19 Lecture 10 Page 19

20 Rules For Expected Mean Squares (Restricted Model) EMS could be calculated using brute force method but may be difficult sometime For mixed models, good to have formal procedure Will take the two-factor mixed model (A fixed) as an example 1. Write each variable term in model as a row heading in a two-way table (the error term in the model asǫ (ij..)m, withmfor the replicate subscript) 2. Write the subscripts in the model as column headings. Over each subscript, write F for fixed factor and R for random one. Over this, write down the levels of each subscript F R R a b n term i j k τ i β j (τβ) ij ǫ (ij)k 20 Lecture 10 Page 20

21 3. For each row, copy the number of observations under each subscript, providing the subscript does not appear in the row variable term F R R a b n term i j k τ i b n β j a n (τβ) ij n ǫ (ij)k 4. For any bracketed subscripts in the model, place a 1 under those subscripts that are inside the brackets F R R a b n term i j k τ i b n β j a n (τβ) ij n ǫ (ij)k Lecture 10 Page 21

22 5. Fill in remaining cells with a 0 (if column subscript represents a fixed factor) or a 1 (if random factor). F R R a b n term i j k τ i 0 b n β j a 1 n (τβ) ij 0 1 n ǫ (ij)k The expected mean square for error ise(ms E ) = σ 2. For every other model term (row), the expected mean square containsσ 2 plus Cover the entries in the columns that contain non-bracketed subscript letters in this term; For rows including the same subscripts, multiply the remaining numbers to get coefficient for corresponding term in the model; A fixed effect is represented by the sum of squares of the model components associated with that factor divided by its degrees of freedom: τ i = Q(τ) = a i=1 τ2 i /(a 1) 22 Lecture 10 Page 22

23 Two-Factor Mixed Model (Restricted Model) ConsiderE[MS A ] = σ 2 +, Ignore the first column (underi); Model terms (rows) including subscripti: τ i and(τβ) ij Termτ i = b n a i=1 τ2 i /(a 1) Term(τβ) ij = 1 nσ 2 τβ E[MS A ] = σ 2 +bn a i=1 τ2 i /(a 1)+nσ 2 τβ F R R a b n term i j k EMS τ i 0 b n σ 2 + bn a i=1 τ2 i /(a 1) + nσ2 τβ β j a 1 n σ 2 + anσβ 2 (τβ) ij 0 1 n σ 2 + nστβ 2 ǫ (ij)k σ 2 23 Lecture 10 Page 23

24 Rules For Expected Mean Squares (Unrestricted Model) Replace Step 5 with the following step 5. For any (interactive) model term (row) including a subscript for a random factor, place a 1 in the remaining cells of this row; and fill in remaining cells with a 0 (if column subscript represents a fixed factor) or a 1 (if random factor). Two-factor mixed model (A Fixed): F R R a b n term i j k EMS τ i 0 b n σ 2 +bn a i=1 τ2 i /(a 1)+nσ2 τβ β j a 1 n σ 2 +anσ β 2+nσ 2 τβ (τβ) ij 1 1 n σ 2 +nστβ 2 ǫ (ij)k σ 2 Hasse Diagrams (Oehlert, 2000) can also be used to calculate the expected mean squares for balanced data (both restricted and unrestricted models). 24 Lecture 10 Page 24

25 Two-Factor Fixed Model y ijk = µ+τ i +β j +(τβ) ij +ǫ ijk F F R a b n term i j k EMS τ i 0 b n σ 2 + bnστ2 i a 1 β j a 0 n σ 2 + anσβ2 j b 1 (τβ) ij 0 0 n σ 2 + nσσ(τβ)2 ij (a 1)(b 1) ǫ (ij)k σ 2 25 Lecture 10 Page 25

26 Two-Factor Random Model y ijk = µ+τ i +β j +(τβ) ij +ǫ ijk R R R a b n term i j k EMS τ i 1 b n σ 2 +nστβ 2 +bnστ 2 β j a 1 n σ 2 +nσ 2 τβ +anσ 2 β (τβ) ij 1 1 n σ 2 +nσ 2 τβ ǫ (ij)k σ 2 26 Lecture 10 Page 26

27 Statistical Model with Two Random Factors y ijk = µ+τ i +β j +(τβ) ij +ǫ ijk τ i N(0,στ) 2 β j N(0,σβ) 2 (τβ) ij N(0,στβ) 2 Var(y ijk ) =σ 2 +στ 2 +σβ 2 +στβ 2 EMS determine what MS to use in denominator H 0 : στ 2 = 0 MS A /MS AB H 0 : σβ 2 = 0 MS B /MS AB H 0 : στβ 2 = 0 MS AB /MS E Estimating variance components using ANOVA method (METHOD=TYPE1) ˆσ 2 = MS E ˆσ τ 2 = (MS A MS AB )/bn ˆσ β 2 = (MS B MS AB )/an ˆσ τβ 2 = (MS AB MS E )/n May results in negative estimates,proc MIXED usesmethod=reml by default 27 Lecture 10 Page 27

28 The Measurement Systems Capability Experiment (Random-Effects Model) Assume the three operators were randomly selected= Random Factor proc glm data=gaugerr; class operator part; model resp=operator part; random operator part operator*part / test; test H=operator E=operator*part; test H=part E=operator*part; run; quit; Sum of Source DF Squares Mean Square F Value Pr > F Model <.0001 Error CorreTotal Source DF Type III SS Mean Square F Value Pr > F operator part <.0001 operator*part Lecture 10 Page 28

29 Source operator part operator*part Type III Expected Mean Square Var(Error) + 2 Var(operator*part) + 40 Var(operator) Var(Error) + 2 Var(operator*part) + 6 Var(part) Var(Error) + 2 Var(operator*part) Tests of Hypotheses for Random Model Analysis of Variance Source DF Type III SS Mean Square F Value Pr > F operator part <.0001 Error Error: MS(operator*part) Source DF Type III SS Mean Square F Value Pr > F operator*part Error: MS(Error) Tests of Hypotheses Using the Type III MS for operator*part as an Error Term Source DF Type III SS Mean Square F Value Pr > F operator part < Lecture 10 Page 29

30 proc mixed cl maxiter=20 covtest method=type1 data=gaugerr; class operator part; model resp = ; random operator part operator*part; run; quit; Sum of Source DF Squares Mean Square operator part operator*part Residual Source Expected Mean Square Error Term Error DF operator Var(Residual) + 2 Var(operator*part) + 40 Var(operator) MS(operator*part) 38 part Var(Residual) + 2 Var(operator*part) + 6 Var(part) MS(operator*part) 38 operator*part Var(Residual) + 2 Var(operator*part) MS(Residual) 60 Residual Var(Residual). Source F Value Pr > F operator part <.0001 operator*part Covariance Parameter Estimates Standard Z Cov Parm Estimate Error Value Pr Z Alpha Lower Upper operator part operator*part Residual < Lecture 10 Page 30

31 proc mixed cl maxiter=20 covtest data=gaugerr; class operator part; model resp = ; random operator part operator*part; run; quit; Estimation Method REML Iteration History Iteration Evaluations -2 Res Log Like Criterion Convergence criteria met. Covariance Parameter Estimates Standard Z Cov Parm Estimate Error Value Pr Z Alpha Lower Upper operator E12 part operator*part Residual < Lecture 10 Page 31

32 Confidence Intervals for Variance Components Can use asymptotic variance estimates to form CI PROC MIXED withmethod=type1: Use standard normal 95% CI uses 1.96 ˆσ τ 2 ±1.96(.0330) = ( 0.05,0.08), ˆσ β 2 ±1.96(3.3738) = (3.67,16.89) PROC MIXED withmethod=reml (by default): Satterthwaite s Approximation Satterthwaite s Approximation (Lec 4): Testing the Significance ofσ 2 0 σ 2 0 = E[(MS r + +MS s ) (MS u + +MS v )]/k Estimate ˆσ 2 0 = [(MS r + +MS s ) (MS u + +MS v )]/k f i MS i /σ 2 i ind χ 2 f i Approximate(1 α) 100% CI ofσ 2 0 rˆσ 0 2 / χ 2 α/2,r σ0 2 rˆσ 0 2 / χ 2 1 α/2,r r = [(MS r + +MS s ) (MS u + +MS v )] 2 MSr 2 f r + + MS2 s f s + MS2 u f u + + MS2 v f v 32 Lecture 10 Page 32

33 Example: The Measurement Systems Capability Experiment (Random-Effects Model) ˆσ 2 τ = MS A MS AB bn = ( )/40 = df = ( ) 2 /( / /38) =.413 CI:(.413(.015)/3.079,.413(.015)/ ) = (.002,270781) ˆσ 2 β = MS B MS AB an = ( )/6 = df = ( ) 2 /( / /38) = CI:(18.57(10.28)/32.28, 18.57(10.28)/8.61) = (5.91, 22.17) 33 Lecture 10 Page 33

34 Three-Factor Mixed Model (A Fixed): Restricted Model y ijkl = µ+τ i +β j +γ k +(τβ) ij +(τγ) ik +(βγ) jk +(τβγ) ijk +ǫ ijkl F R R R a b c n term i j k l EMS τ i 0 b c n σ 2 + bcnστ2 i a 1 +cnσ 2 τβ +bnσ 2 τγ +nσ 2 τβγ β j a 1 c n σ 2 +acnσ 2 β +anσ 2 βγ γ k a b 1 n σ 2 +abnσ 2 γ +anσ 2 βγ (τβ) ij 0 1 c n σ 2 +cnσ 2 τβ +nσ 2 τβγ (τγ) ik 0 b 1 n σ 2 +bnσ 2 τγ +nσ 2 τβγ (βγ) jk a 1 1 n σ 2 +anσ 2 βγ (τβγ) ijk n σ 2 +nσ 2 τβγ ǫ (ijk)l σ 2 34 Lecture 10 Page 34

35 Three-Factor Mixed Model (A Fixed): Restricted Model Construct test statistics based on EMS H 0 : τ 1 = = τ a = 0? H 0 : σβ 2 = 0 MS B /MS BC H 0 : σγ 2 = 0 MS C /MS BC H 0 : στβ 2 = 0 MS AB /MS ABC H 0 : στγ 2 = 0 MS AC /MS ABC H 0 : σβγ 2 = 0 MS BC /MS E H 0 : στβγ 2 = 0 MS ABC /MS E 35 Lecture 10 Page 35

36 Three-Factor Mixed Model (A Fixed): Unrestricted Model y ijkl = µ+τ i +β j +γ k +(τβ) ij +(τγ) ik +(βγ) jk +(τβγ) ijk +ǫ ijkl F R R R a b c n term i j k l EMS τ i 0 b c n σ 2 + bcnστ2 i a 1 +cnσ 2 τβ +bnσ 2 τγ +nσ 2 τβγ β j a 1 c n σ 2 +acnσ 2 β +cnσ 2 τβ +anσ 2 βγ +nσ 2 τβγ γ k a b 1 n σ 2 +abnσ 2 γ +bnσ 2 τγ +anσ 2 βγ +nσ 2 τβγ (τβ) ij 1 1 c n σ 2 +cnσ 2 τβ +nσ 2 τβγ (τγ) ik 1 b 1 n σ 2 +bnσ 2 τγ +nσ 2 τβγ (βγ) jk a 1 1 n σ 2 +anσ 2 βγ +nσ 2 τβγ (τβγ) ijk n σ 2 +nσ 2 τβγ ǫ (ijk)l σ 2 36 Lecture 10 Page 36

37 Three-Factor Mixed Model (A Fixed): Unrestricted Model Construct test statistics based on EMS H 0 : τ 1 = = τ a = 0? H 0 : σβ 2 = 0? H 0 : σγ 2 = 0? H 0 : στβ 2 = 0 MS AB /MS ABC H 0 : στγ 2 = 0 MS AC /MS ABC H 0 : σβγ 2 = 0 MS BC /MS ABC H 0 : στβγ 2 = 0 MS ABC /MS E 37 Lecture 10 Page 37

38 Satterthwaite s Approximate F-test ForH 0 : effect = 0, no exact test exists. SupposeE(MS ) E(MS ) is a multiple of the effect Two linear combinations of mean squaresms andms MS = MS r + +MS s MS = MS u + +MS v MS andms do not share common mean squares Approximate test statisticf = MS MS = MS r+ +MS s MS u + +MS v F p,q p = (MS r+ +MS s ) 2 MS 2 r /f r+ +MS 2 s /f s andq = (MS u+ +MS v ) 2 MS 2 u /f u+...+ms 2 v /f v f i is the degrees of freedom associated with MS i Need interpolation whenporq are not be integers. SAS can handle noninteger dfs. 38 Lecture 10 Page 38

39 Example: Restricted Three-Factor Mixed Model (A Fixed) Based on EMS, no exact test forh 0 : τ 1 = = τ a = 0 or equivalently H 0 : τ 2 i = 0 Assumea = 3,b = 2,c = 3,n = 2 Source DF MS EMS F P A Q(A)+6σ 2 AB +4σ 2 AC?? +2σ 2 ABC +σ 2 B σ 2 B +6σ 2 BC +σ C σ 2 C +6σ 2 BC +σ AB σ 2 AB +2σ 2 ABC +σ AC σ 2 AC +2σ 2 ABC +σ BC σ 2 BC +σ ABC σ 2 ABC +σ Error σ 2 39 Lecture 10 Page 39

40 H 0 : τ 1 = τ 2 = τ 3 = 0 H 0 : Q(A) = a i=1 τ2 i /(a 1) = 0 MS = MS A +MS ABC MS = MS AB +MS AC E(MS MS ) = 12Q(A) = 12 Στ2 i 3 1 F = MS A +MS ABC MS AB +MS AC = = p = q = ( ) / /4 = 2.01, ( ) / /2 = 6.00 Interpolation needed P(F 2,6 > 48.41) =.0002, P(F 3,6 > 48.41) =.0001 P(F 2.01,6 > 48.41) =.99(.0002)+.01(.0001) = Lecture 10 Page 40

41 SAS can be used to compute P-values and quantile values for F andχ 2 values with noninteger degrees of freedom Upper tail probability:probf(x,df1,df2) andprobchi(x,df) Quantiles:FINV(p,df1,df2) andcinv(p,df) data one; p=1-probf(48.41,2.01,6); f=finv(.95,2.01,6); c1=cinv(.025,18.57); /* For Page 33 */ c2=cinv(.975,18.57); /* For Page 33 */ proc print data=one; run; quit; Obs p f c1 c Lecture 10 Page 41

42 In terms of linear model General Mixed Effect Model Y = Xβ +Zδ +ǫ β is a vector of fixed-effect parameters δ is a vector of random-effect parameters ǫ is the error vector δ and ǫ assumed uncorrelated means 0 covariance matricesgandr(allows correlation) Cov(Y ) =ZGZ +R IfR = σ 2 I andz = 0, back to standard linear model PROC MIXED in SAS allows one to specifygandr G through RANDOM, R through REPEATED Unrestricted linear mixed model is default 42 Lecture 10 Page 42

43 Sample Size Calculations Recall sample size calculations on a hypothesis test of a set of effects using For a set of fixed effects, F 0 = MS N MS D H 0 Fν1,ν 2 Use SAS to calculatepower=1-β=1-probf(f α,ν1,ν 2,ν 1,ν 2,δ) with δ = E[MS N MS D ] ν 1 E[MS D ] Use OCC in Chart V:β vs. Φ = δ/(ν 1 +1) For a set of random effects: ν 1 MS N /σn 2 χ 2 ν 1 andν 2 MS D /σd 2 χ 2 ν 2 F 0 /λ 2 F ν1,ν 2 withλ 2 = E[MS N ]/E[MS D ] Use OCC in Chart VI:β vs. λ = E[MS N ]/E[MS D ] Use SAS to calculatepower=1-β=1-probf(f α,ν1,ν 2 /λ 2,ν 1,ν 2 ). 43 Lecture 10 Page 43

44 Mixed Effects Model Restricted Mixed Model Factor Parameter ν 1 ν 2 bn τi A (Fixed) Φ = 2 a(σ 2 +nστβ 2 ) a 1 (a 1)(b 1) B (Random) λ = 1+ anσ2 β σ b 1 ab(n 1) 2 AB (Random) λ = 1+ nσ2 τβ σ (a 1)(b 1) ab(n 1) 2 Unrestricted Mixed Model Factor Parameter ν 1 ν 2 bn τi A (Fixed) Φ = 2 a(σ 2 +nστβ 2 ) a 1 (a 1)(b 1) B (Random) λ = AB (Random) λ = 1+ anσ2 β σ 2 +nστβ 2 b 1 (a 1)(b 1) 1+ nσ2 τβ σ 2 (a 1)(b 1) ab(n 1) 44 Lecture 10 Page 44

45 Random-Effects Model Factor λ ν 1 ν 2 A 1+ bnσ2 τ a 1 (a 1)(b 1) σ 2 +nστβ 2 B AB 1+ anσ2 β σ 2 +nστβ 2 b 1 (a 1)(b 1) 1+ nσ2 τβ σ 2 (a 1)(b 1) ab(n 1) 45 Lecture 10 Page 45

Lecture 10: Experiments with Random Effects

Lecture 10: Experiments with Random Effects Lecture 10: Experiments with Random Effects Montgomery, Chapter 13 1 Lecture 10 Page 1 Example 1 A textile company weaves a fabric on a large number of looms. It would like the looms to be homogeneous

More information

Topic 32: Two-Way Mixed Effects Model

Topic 32: Two-Way Mixed Effects Model Topic 3: Two-Way Mixed Effects Model Outline Two-way mixed models Three-way mixed models Data for two-way design Y is the response variable Factor A with levels i = 1 to a Factor B with levels j = 1 to

More information

Lecture 4. Random Effects in Completely Randomized Design

Lecture 4. Random Effects in Completely Randomized Design Lecture 4. Random Effects in Completely Randomized Design Montgomery: 3.9, 13.1 and 13.7 1 Lecture 4 Page 1 Random Effects vs Fixed Effects Consider factor with numerous possible levels Want to draw inference

More information

Lecture 11: Nested and Split-Plot Designs

Lecture 11: Nested and Split-Plot Designs Lecture 11: Nested and Split-Plot Designs Montgomery, Chapter 14 1 Lecture 11 Page 1 Crossed vs Nested Factors Factors A (a levels)and B (b levels) are considered crossed if Every combinations of A and

More information

Statistics 512: Applied Linear Models. Topic 9

Statistics 512: Applied Linear Models. Topic 9 Topic Overview Statistics 51: Applied Linear Models Topic 9 This topic will cover Random vs. Fixed Effects Using E(MS) to obtain appropriate tests in a Random or Mixed Effects Model. Chapter 5: One-way

More information

Topic 25 - One-Way Random Effects Models. Outline. Random Effects vs Fixed Effects. Data for One-way Random Effects Model. One-way Random effects

Topic 25 - One-Way Random Effects Models. Outline. Random Effects vs Fixed Effects. Data for One-way Random Effects Model. One-way Random effects Topic 5 - One-Way Random Effects Models One-way Random effects Outline Model Variance component estimation - Fall 013 Confidence intervals Topic 5 Random Effects vs Fixed Effects Consider factor with numerous

More information

This is a Randomized Block Design (RBD) with a single factor treatment arrangement (2 levels) which are fixed.

This is a Randomized Block Design (RBD) with a single factor treatment arrangement (2 levels) which are fixed. EXST3201 Chapter 13c Geaghan Fall 2005: Page 1 Linear Models Y ij = µ + βi + τ j + βτij + εijk This is a Randomized Block Design (RBD) with a single factor treatment arrangement (2 levels) which are fixed.

More information

Lec 5: Factorial Experiment

Lec 5: Factorial Experiment November 21, 2011 Example Study of the battery life vs the factors temperatures and types of material. A: Types of material, 3 levels. B: Temperatures, 3 levels. Example Study of the battery life vs the

More information

T-test: means of Spock's judge versus all other judges 1 12:10 Wednesday, January 5, judge1 N Mean Std Dev Std Err Minimum Maximum

T-test: means of Spock's judge versus all other judges 1 12:10 Wednesday, January 5, judge1 N Mean Std Dev Std Err Minimum Maximum T-test: means of Spock's judge versus all other judges 1 The TTEST Procedure Variable: pcwomen judge1 N Mean Std Dev Std Err Minimum Maximum OTHER 37 29.4919 7.4308 1.2216 16.5000 48.9000 SPOCKS 9 14.6222

More information

Unbalanced Designs Mechanics. Estimate of σ 2 becomes weighted average of treatment combination sample variances.

Unbalanced Designs Mechanics. Estimate of σ 2 becomes weighted average of treatment combination sample variances. Unbalanced Designs Mechanics Estimate of σ 2 becomes weighted average of treatment combination sample variances. Types of SS Difference depends on what hypotheses are tested and how differing sample sizes

More information

SAS Commands. General Plan. Output. Construct scatterplot / interaction plot. Run full model

SAS Commands. General Plan. Output. Construct scatterplot / interaction plot. Run full model Topic 23 - Unequal Replication Data Model Outline - Fall 2013 Parameter Estimates Inference Topic 23 2 Example Page 954 Data for Two Factor ANOVA Y is the response variable Factor A has levels i = 1, 2,...,

More information

Lecture 9: Factorial Design Montgomery: chapter 5

Lecture 9: Factorial Design Montgomery: chapter 5 Lecture 9: Factorial Design Montgomery: chapter 5 Page 1 Examples Example I. Two factors (A, B) each with two levels (, +) Page 2 Three Data for Example I Ex.I-Data 1 A B + + 27,33 51,51 18,22 39,41 EX.I-Data

More information

Contents. TAMS38 - Lecture 6 Factorial design, Latin Square Design. Lecturer: Zhenxia Liu. Factorial design 3. Complete three factor design 4

Contents. TAMS38 - Lecture 6 Factorial design, Latin Square Design. Lecturer: Zhenxia Liu. Factorial design 3. Complete three factor design 4 Contents Factorial design TAMS38 - Lecture 6 Factorial design, Latin Square Design Lecturer: Zhenxia Liu Department of Mathematics - Mathematical Statistics 28 November, 2017 Complete three factor design

More information

Outline. Topic 19 - Inference. The Cell Means Model. Estimates. Inference for Means Differences in cell means Contrasts. STAT Fall 2013

Outline. Topic 19 - Inference. The Cell Means Model. Estimates. Inference for Means Differences in cell means Contrasts. STAT Fall 2013 Topic 19 - Inference - Fall 2013 Outline Inference for Means Differences in cell means Contrasts Multiplicity Topic 19 2 The Cell Means Model Expressed numerically Y ij = µ i + ε ij where µ i is the theoretical

More information

Two-factor studies. STAT 525 Chapter 19 and 20. Professor Olga Vitek

Two-factor studies. STAT 525 Chapter 19 and 20. Professor Olga Vitek Two-factor studies STAT 525 Chapter 19 and 20 Professor Olga Vitek December 2, 2010 19 Overview Now have two factors (A and B) Suppose each factor has two levels Could analyze as one factor with 4 levels

More information

Outline Topic 21 - Two Factor ANOVA

Outline Topic 21 - Two Factor ANOVA Outline Topic 21 - Two Factor ANOVA Data Model Parameter Estimates - Fall 2013 Equal Sample Size One replicate per cell Unequal Sample size Topic 21 2 Overview Now have two factors (A and B) Suppose each

More information

Homework 3 - Solution

Homework 3 - Solution STAT 526 - Spring 2011 Homework 3 - Solution Olga Vitek Each part of the problems 5 points 1. KNNL 25.17 (Note: you can choose either the restricted or the unrestricted version of the model. Please state

More information

TWO OR MORE RANDOM EFFECTS. The two-way complete model for two random effects:

TWO OR MORE RANDOM EFFECTS. The two-way complete model for two random effects: TWO OR MORE RANDOM EFFECTS Example: The factors that influence the breaking strength of a synthetic fiber are being studied. Four production machines and three operators are randomly selected. A two-way

More information

Analysis of Variance and Design of Experiments-I

Analysis of Variance and Design of Experiments-I Analysis of Variance and Design of Experiments-I MODULE VIII LECTURE - 35 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS MODEL Dr. Shalabh Department of Mathematics and Statistics Indian

More information

MAT3378 ANOVA Summary

MAT3378 ANOVA Summary MAT3378 ANOVA Summary April 18, 2016 Before you do the analysis: How many factors? (one-factor/one-way ANOVA, two-factor ANOVA etc.) Fixed or Random or Mixed effects? Crossed-factors; nested factors or

More information

Differences of Least Squares Means

Differences of Least Squares Means STAT:5201 Homework 9 Solutions 1. We have a model with two crossed random factors operator and machine. There are 4 operators, 8 machines, and 3 observations from each operator/machine combination. (a)

More information

Topic 17 - Single Factor Analysis of Variance. Outline. One-way ANOVA. The Data / Notation. One way ANOVA Cell means model Factor effects model

Topic 17 - Single Factor Analysis of Variance. Outline. One-way ANOVA. The Data / Notation. One way ANOVA Cell means model Factor effects model Topic 17 - Single Factor Analysis of Variance - Fall 2013 One way ANOVA Cell means model Factor effects model Outline Topic 17 2 One-way ANOVA Response variable Y is continuous Explanatory variable is

More information

Chapter 11. Analysis of Variance (One-Way)

Chapter 11. Analysis of Variance (One-Way) Chapter 11 Analysis of Variance (One-Way) We now develop a statistical procedure for comparing the means of two or more groups, known as analysis of variance or ANOVA. These groups might be the result

More information

Random and Mixed Effects Models - Part III

Random and Mixed Effects Models - Part III Random and Mixed Effects Models - Part III Statistics 149 Spring 2006 Copyright 2006 by Mark E. Irwin Quasi-F Tests When we get to more than two categorical factors, some times there are not nice F tests

More information

Lecture 5: Comparing Treatment Means Montgomery: Section 3-5

Lecture 5: Comparing Treatment Means Montgomery: Section 3-5 Lecture 5: Comparing Treatment Means Montgomery: Section 3-5 Page 1 Linear Combination of Means ANOVA: y ij = µ + τ i + ɛ ij = µ i + ɛ ij Linear combination: L = c 1 µ 1 + c 1 µ 2 +...+ c a µ a = a i=1

More information

Factorial and Unbalanced Analysis of Variance

Factorial and Unbalanced Analysis of Variance Factorial and Unbalanced Analysis of Variance Nathaniel E. Helwig Assistant Professor of Psychology and Statistics University of Minnesota (Twin Cities) Updated 04-Jan-2017 Nathaniel E. Helwig (U of Minnesota)

More information

Factorial designs. Experiments

Factorial designs. Experiments Chapter 5: Factorial designs Petter Mostad mostad@chalmers.se Experiments Actively making changes and observing the result, to find causal relationships. Many types of experimental plans Measuring response

More information

WITHIN-PARTICIPANT EXPERIMENTAL DESIGNS

WITHIN-PARTICIPANT EXPERIMENTAL DESIGNS 1 WITHIN-PARTICIPANT EXPERIMENTAL DESIGNS I. Single-factor designs: the model is: yij i j ij ij where: yij score for person j under treatment level i (i = 1,..., I; j = 1,..., n) overall mean βi treatment

More information

STAT 5200 Handout #23. Repeated Measures Example (Ch. 16)

STAT 5200 Handout #23. Repeated Measures Example (Ch. 16) Motivating Example: Glucose STAT 500 Handout #3 Repeated Measures Example (Ch. 16) An experiment is conducted to evaluate the effects of three diets on the serum glucose levels of human subjects. Twelve

More information

Analysis of Covariance

Analysis of Covariance Analysis of Covariance (ANCOVA) Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 10 1 When to Use ANCOVA In experiment, there is a nuisance factor x that is 1 Correlated with y 2

More information

13. The Cochran-Satterthwaite Approximation for Linear Combinations of Mean Squares

13. The Cochran-Satterthwaite Approximation for Linear Combinations of Mean Squares 13. The Cochran-Satterthwaite Approximation for Linear Combinations of Mean Squares opyright c 2018 Dan Nettleton (Iowa State University) 13. Statistics 510 1 / 18 Suppose M 1,..., M k are independent

More information

EXST Regression Techniques Page 1. We can also test the hypothesis H :" œ 0 versus H :"

EXST Regression Techniques Page 1. We can also test the hypothesis H : œ 0 versus H : EXST704 - Regression Techniques Page 1 Using F tests instead of t-tests We can also test the hypothesis H :" œ 0 versus H :" Á 0 with an F test.! " " " F œ MSRegression MSError This test is mathematically

More information

Lecture 5: Determining Sample Size

Lecture 5: Determining Sample Size Lecture 5: Determining Sample Size Montgomery: Section 3.7 and 13.4 1 Lecture 5 Page 1 Choice of Sample Size: Fixed Effects Can determine the sample size for OverallF test Contrasts of interest For simplicity,

More information

Theorem A: Expectations of Sums of Squares Under the two-way ANOVA model, E(X i X) 2 = (µ i µ) 2 + n 1 n σ2

Theorem A: Expectations of Sums of Squares Under the two-way ANOVA model, E(X i X) 2 = (µ i µ) 2 + n 1 n σ2 identity Y ijk Ȳ = (Y ijk Ȳij ) + (Ȳi Ȳ ) + (Ȳ j Ȳ ) + (Ȳij Ȳi Ȳ j + Ȳ ) Theorem A: Expectations of Sums of Squares Under the two-way ANOVA model, (1) E(MSE) = E(SSE/[IJ(K 1)]) = (2) E(MSA) = E(SSA/(I

More information

5.3 Three-Stage Nested Design Example

5.3 Three-Stage Nested Design Example 5.3 Three-Stage Nested Design Example A researcher designs an experiment to study the of a metal alloy. A three-stage nested design was conducted that included Two alloy chemistry compositions. Three ovens

More information

Unit 7: Random Effects, Subsampling, Nested and Crossed Factor Designs

Unit 7: Random Effects, Subsampling, Nested and Crossed Factor Designs Unit 7: Random Effects, Subsampling, Nested and Crossed Factor Designs STA 643: Advanced Experimental Design Derek S. Young 1 Learning Objectives Understand how to interpret a random effect Know the different

More information

Chapter 5 Introduction to Factorial Designs

Chapter 5 Introduction to Factorial Designs Chapter 5 Introduction to Factorial Designs 5. Basic Definitions and Principles Stud the effects of two or more factors. Factorial designs Crossed: factors are arranged in a factorial design Main effect:

More information

Two or more categorical predictors. 2.1 Two fixed effects

Two or more categorical predictors. 2.1 Two fixed effects Two or more categorical predictors Here we extend the ANOVA methods to handle multiple categorical predictors. The statistician has to watch carefully to see whether the effects being considered are properly

More information

dm'log;clear;output;clear'; options ps=512 ls=99 nocenter nodate nonumber nolabel FORMCHAR=" = -/\<>*"; ODS LISTING;

dm'log;clear;output;clear'; options ps=512 ls=99 nocenter nodate nonumber nolabel FORMCHAR= = -/\<>*; ODS LISTING; dm'log;clear;output;clear'; options ps=512 ls=99 nocenter nodate nonumber nolabel FORMCHAR=" ---- + ---+= -/\*"; ODS LISTING; *** Table 23.2 ********************************************; *** Moore, David

More information

Analysis of Variance

Analysis of Variance Statistical Techniques II EXST7015 Analysis of Variance 15a_ANOVA_Introduction 1 Design The simplest model for Analysis of Variance (ANOVA) is the CRD, the Completely Randomized Design This model is also

More information

Statistics 210 Part 3 Statistical Methods Hal S. Stern Department of Statistics University of California, Irvine

Statistics 210 Part 3 Statistical Methods Hal S. Stern Department of Statistics University of California, Irvine Thus far: Statistics 210 Part 3 Statistical Methods Hal S. Stern Department of Statistics University of California, Irvine sternh@uci.edu design of experiments two sample methods one factor ANOVA pairing/blocking

More information

Odor attraction CRD Page 1

Odor attraction CRD Page 1 Odor attraction CRD Page 1 dm'log;clear;output;clear'; options ps=512 ls=99 nocenter nodate nonumber nolabel FORMCHAR=" ---- + ---+= -/\*"; ODS LISTING; *** Table 23.2 ********************************************;

More information

data proc sort proc corr run proc reg run proc glm run proc glm run proc glm run proc reg CONMAIN CONINT run proc reg DUMMAIN DUMINT run proc reg

data proc sort proc corr run proc reg run proc glm run proc glm run proc glm run proc reg CONMAIN CONINT run proc reg DUMMAIN DUMINT run proc reg data one; input id Y group X; I1=0;I2=0;I3=0;if group=1 then I1=1;if group=2 then I2=1;if group=3 then I3=1; IINT1=I1*X;IINT2=I2*X;IINT3=I3*X; *************************************************************************;

More information

Mixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p.

Mixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p. STAT:5201 Applied Statistic II Mixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p.422 OLRT) Hamster example with three

More information

Assignment 6 Answer Keys

Assignment 6 Answer Keys ssignment 6 nswer Keys Problem 1 (a) The treatment sum of squares can be calculated by SS Treatment = b a ȳi 2 Nȳ 2 i=1 = 5 (5.40 2 + 5.80 2 + 10 2 + 9.80 2 ) 20 7.75 2 = 92.95 Then the F statistic for

More information

General Linear Model (Chapter 4)

General Linear Model (Chapter 4) General Linear Model (Chapter 4) Outcome variable is considered continuous Simple linear regression Scatterplots OLS is BLUE under basic assumptions MSE estimates residual variance testing regression coefficients

More information

Factorial ANOVA. Psychology 3256

Factorial ANOVA. Psychology 3256 Factorial ANOVA Psychology 3256 Made up data.. Say you have collected data on the effects of Retention Interval 5 min 1 hr 24 hr on memory So, you do the ANOVA and conclude that RI affects memory % corr

More information

Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3-1 through 3-3

Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3-1 through 3-3 Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3-1 through 3-3 Page 1 Tensile Strength Experiment Investigate the tensile strength of a new synthetic fiber. The factor is the weight percent

More information

Stat 217 Final Exam. Name: May 1, 2002

Stat 217 Final Exam. Name: May 1, 2002 Stat 217 Final Exam Name: May 1, 2002 Problem 1. Three brands of batteries are under study. It is suspected that the lives (in weeks) of the three brands are different. Five batteries of each brand are

More information

Descriptions of post-hoc tests

Descriptions of post-hoc tests Experimental Statistics II Page 81 Descriptions of post-hoc tests Post-hoc or Post-ANOVA tests! Once you have found out some treatment(s) are different, how do you determine which one(s) are different?

More information

PLS205 Lab 2 January 15, Laboratory Topic 3

PLS205 Lab 2 January 15, Laboratory Topic 3 PLS205 Lab 2 January 15, 2015 Laboratory Topic 3 General format of ANOVA in SAS Testing the assumption of homogeneity of variances by "/hovtest" by ANOVA of squared residuals Proc Power for ANOVA One-way

More information

The factors in higher-way ANOVAs can again be considered fixed or random, depending on the context of the study. For each factor:

The factors in higher-way ANOVAs can again be considered fixed or random, depending on the context of the study. For each factor: M. Two-way Random Effects ANOVA The factors in higher-way ANOVAs can again be considered fixed or random, depending on the context of the study. For each factor: Are the levels of that factor of direct

More information

STAT 705 Chapter 19: Two-way ANOVA

STAT 705 Chapter 19: Two-way ANOVA STAT 705 Chapter 19: Two-way ANOVA Adapted from Timothy Hanson Department of Statistics, University of South Carolina Stat 705: Data Analysis II 1 / 41 Two-way ANOVA This material is covered in Sections

More information

STAT 705 Chapter 19: Two-way ANOVA

STAT 705 Chapter 19: Two-way ANOVA STAT 705 Chapter 19: Two-way ANOVA Timothy Hanson Department of Statistics, University of South Carolina Stat 705: Data Analysis II 1 / 38 Two-way ANOVA Material covered in Sections 19.2 19.4, but a bit

More information

df=degrees of freedom = n - 1

df=degrees of freedom = n - 1 One sample t-test test of the mean Assumptions: Independent, random samples Approximately normal distribution (from intro class: σ is unknown, need to calculate and use s (sample standard deviation)) Hypotheses:

More information

Single Factor Experiments

Single Factor Experiments Single Factor Experiments Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 4 1 Analysis of Variance Suppose you are interested in comparing either a different treatments a levels

More information

Analysis of Variance

Analysis of Variance Analysis of Variance Blood coagulation time T avg A 62 60 63 59 61 B 63 67 71 64 65 66 66 C 68 66 71 67 68 68 68 D 56 62 60 61 63 64 63 59 61 64 Blood coagulation time A B C D Combined 56 57 58 59 60 61

More information

Chapter 13 Experiments with Random Factors Solutions

Chapter 13 Experiments with Random Factors Solutions Solutions from Montgomery, D. C. (01) Design and Analysis of Experiments, Wiley, NY Chapter 13 Experiments with Random Factors Solutions 13.. An article by Hoof and Berman ( Statistical Analysis of Power

More information

Linear Combinations. Comparison of treatment means. Bruce A Craig. Department of Statistics Purdue University. STAT 514 Topic 6 1

Linear Combinations. Comparison of treatment means. Bruce A Craig. Department of Statistics Purdue University. STAT 514 Topic 6 1 Linear Combinations Comparison of treatment means Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 6 1 Linear Combinations of Means y ij = µ + τ i + ǫ ij = µ i + ǫ ij Often study

More information

Ch 3: Multiple Linear Regression

Ch 3: Multiple Linear Regression Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery

More information

Topic 20: Single Factor Analysis of Variance

Topic 20: Single Factor Analysis of Variance Topic 20: Single Factor Analysis of Variance Outline Single factor Analysis of Variance One set of treatments Cell means model Factor effects model Link to linear regression using indicator explanatory

More information

Analysis of Longitudinal Data: Comparison Between PROC GLM and PROC MIXED. Maribeth Johnson Medical College of Georgia Augusta, GA

Analysis of Longitudinal Data: Comparison Between PROC GLM and PROC MIXED. Maribeth Johnson Medical College of Georgia Augusta, GA Analysis of Longitudinal Data: Comparison Between PROC GLM and PROC MIXED Maribeth Johnson Medical College of Georgia Augusta, GA Overview Introduction to longitudinal data Describe the data for examples

More information

Topic 29: Three-Way ANOVA

Topic 29: Three-Way ANOVA Topic 29: Three-Way ANOVA Outline Three-way ANOVA Data Model Inference Data for three-way ANOVA Y, the response variable Factor A with levels i = 1 to a Factor B with levels j = 1 to b Factor C with levels

More information

Reference: Chapter 13 of Montgomery (8e)

Reference: Chapter 13 of Montgomery (8e) Reference: Chapter 1 of Montgomery (8e) Maghsoodloo 89 Factorial Experiments with Random Factors So far emphasis has been placed on factorial experiments where all factors are at a, b, c,... fixed levels

More information

These are multifactor experiments that have

These are multifactor experiments that have Design of Engineering Experiments Nested Designs Text reference, Chapter 14, Pg. 525 These are multifactor experiments that have some important industrial applications Nested and split-plot designs frequently

More information

Contents. TAMS38 - Lecture 8 2 k p fractional factorial design. Lecturer: Zhenxia Liu. Example 0 - continued 4. Example 0 - Glazing ceramic 3

Contents. TAMS38 - Lecture 8 2 k p fractional factorial design. Lecturer: Zhenxia Liu. Example 0 - continued 4. Example 0 - Glazing ceramic 3 Contents TAMS38 - Lecture 8 2 k p fractional factorial design Lecturer: Zhenxia Liu Department of Mathematics - Mathematical Statistics Example 0 2 k factorial design with blocking Example 1 2 k p fractional

More information

Incomplete Block Designs

Incomplete Block Designs Incomplete Block Designs Recall: in randomized complete block design, each of a treatments was used once within each of b blocks. In some situations, it will not be possible to use each of a treatments

More information

1 Tomato yield example.

1 Tomato yield example. ST706 - Linear Models II. Spring 2013 Two-way Analysis of Variance examples. Here we illustrate what happens analyzing two way data in proc glm in SAS. Similar issues come up with other software where

More information

Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3.1 through 3.3

Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3.1 through 3.3 Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3.1 through 3.3 Fall, 2013 Page 1 Tensile Strength Experiment Investigate the tensile strength of a new synthetic fiber. The factor is the

More information

The Random Effects Model Introduction

The Random Effects Model Introduction The Random Effects Model Introduction Sometimes, treatments included in experiment are randomly chosen from set of all possible treatments. Conclusions from such experiment can then be generalized to other

More information

Mixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p.

Mixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p. 22s:173 Combining multiple factors into a single superfactor Mixed Model: Split plot with two whole-plot factors, one split-plot factor, and CRD at the whole-plot level (e.g. fancier split-plot p.422 Oehlert)

More information

Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2

Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2 Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2 Fall, 2013 Page 1 Random Variable and Probability Distribution Discrete random variable Y : Finite possible values {y

More information

Lecture 7: Latin Square and Related Design

Lecture 7: Latin Square and Related Design Lecture 7: Latin Square and Related Design Montgomery: Section 4.2-4.3 Page 1 Automobile Emission Experiment Four cars and four drivers are employed in a study for possible differences between four gasoline

More information

Analysis of Variance II Bios 662

Analysis of Variance II Bios 662 Analysis of Variance II Bios 662 Michael G. Hudgens, Ph.D. mhudgens@bios.unc.edu http://www.bios.unc.edu/ mhudgens 2008-10-24 17:21 BIOS 662 1 ANOVA II Outline Multiple Comparisons Scheffe Tukey Bonferroni

More information

4.8 Alternate Analysis as a Oneway ANOVA

4.8 Alternate Analysis as a Oneway ANOVA 4.8 Alternate Analysis as a Oneway ANOVA Suppose we have data from a two-factor factorial design. The following method can be used to perform a multiple comparison test to compare treatment means as well

More information

EXST 7015 Fall 2014 Lab 11: Randomized Block Design and Nested Design

EXST 7015 Fall 2014 Lab 11: Randomized Block Design and Nested Design EXST 7015 Fall 2014 Lab 11: Randomized Block Design and Nested Design OBJECTIVES: The objective of an experimental design is to provide the maximum amount of reliable information at the minimum cost. In

More information

17. Example SAS Commands for Analysis of a Classic Split-Plot Experiment 17. 1

17. Example SAS Commands for Analysis of a Classic Split-Plot Experiment 17. 1 17 Example SAS Commands for Analysis of a Classic SplitPlot Experiment 17 1 DELIMITED options nocenter nonumber nodate ls80; Format SCREEN OUTPUT proc import datafile"c:\data\simulatedsplitplotdatatxt"

More information

A Re-Introduction to General Linear Models (GLM)

A Re-Introduction to General Linear Models (GLM) A Re-Introduction to General Linear Models (GLM) Today s Class: You do know the GLM Estimation (where the numbers in the output come from): From least squares to restricted maximum likelihood (REML) Reviewing

More information

Design of Engineering Experiments Chapter 5 Introduction to Factorials

Design of Engineering Experiments Chapter 5 Introduction to Factorials Design of Engineering Experiments Chapter 5 Introduction to Factorials Text reference, Chapter 5 page 170 General principles of factorial experiments The two-factor factorial with fixed effects The ANOVA

More information

Lecture 2. The Simple Linear Regression Model: Matrix Approach

Lecture 2. The Simple Linear Regression Model: Matrix Approach Lecture 2 The Simple Linear Regression Model: Matrix Approach Matrix algebra Matrix representation of simple linear regression model 1 Vectors and Matrices Where it is necessary to consider a distribution

More information

Ch 2: Simple Linear Regression

Ch 2: Simple Linear Regression Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component

More information

V. Experiments With Two Crossed Treatment Factors

V. Experiments With Two Crossed Treatment Factors V. Experiments With Two Crossed Treatment Factors A.The Experimental Design Completely Randomized Design (CRD) Let A be a factor with levels i = 1,,a B be a factor with levels j = 1,,b Y ijt = the response

More information

Linear Combinations of Group Means

Linear Combinations of Group Means Linear Combinations of Group Means Look at the handicap example on p. 150 of the text. proc means data=mth567.disability; class handicap; var score; proc sort data=mth567.disability; by handicap; proc

More information

Comparison of a Population Means

Comparison of a Population Means Analysis of Variance Interested in comparing Several treatments Several levels of one treatment Comparison of a Population Means Could do numerous two-sample t-tests but... ANOVA provides method of joint

More information

ANOVA Longitudinal Models for the Practice Effects Data: via GLM

ANOVA Longitudinal Models for the Practice Effects Data: via GLM Psyc 943 Lecture 25 page 1 ANOVA Longitudinal Models for the Practice Effects Data: via GLM Model 1. Saturated Means Model for Session, E-only Variances Model (BP) Variances Model: NO correlation, EQUAL

More information

MEMORIAL UNIVERSITY OF NEWFOUNDLAND DEPARTMENT OF MATHEMATICS AND STATISTICS FINAL EXAM - STATISTICS FALL 1999

MEMORIAL UNIVERSITY OF NEWFOUNDLAND DEPARTMENT OF MATHEMATICS AND STATISTICS FINAL EXAM - STATISTICS FALL 1999 MEMORIAL UNIVERSITY OF NEWFOUNDLAND DEPARTMENT OF MATHEMATICS AND STATISTICS FINAL EXAM - STATISTICS 350 - FALL 1999 Instructor: A. Oyet Date: December 16, 1999 Name(Surname First): Student Number INSTRUCTIONS

More information

6 Designs with Split Plots

6 Designs with Split Plots 6 Designs with Split Plots Many factorial experimental designs are incorrectly analyzed because the assumption of complete randomization is not true. Many factorial experiments have one or more restrictions

More information

Randomized Complete Block Designs

Randomized Complete Block Designs Randomized Complete Block Designs David Allen University of Kentucky February 23, 2016 1 Randomized Complete Block Design There are many situations where it is impossible to use a completely randomized

More information

Chapter 8: Hypothesis Testing Lecture 9: Likelihood ratio tests

Chapter 8: Hypothesis Testing Lecture 9: Likelihood ratio tests Chapter 8: Hypothesis Testing Lecture 9: Likelihood ratio tests Throughout this chapter we consider a sample X taken from a population indexed by θ Θ R k. Instead of estimating the unknown parameter, we

More information

Unit 8: A Mixed Two-Factor Design

Unit 8: A Mixed Two-Factor Design Minitab Notes for STAT 6305 Dept. of Statistics CSU East Bay Unit 8: A Mixed Two-Factor Design 8.1. The Data We use data quoted in Brownlee: Statistical Theory and Methodology in Science and Engineering,

More information

Statistics for exp. medical researchers Comparison of groups, T-tests and ANOVA

Statistics for exp. medical researchers Comparison of groups, T-tests and ANOVA Faculty of Health Sciences Outline Statistics for exp. medical researchers Comparison of groups, T-tests and ANOVA Lene Theil Skovgaard Sept. 14, 2015 Paired comparisons: tests and confidence intervals

More information

Topic 28: Unequal Replication in Two-Way ANOVA

Topic 28: Unequal Replication in Two-Way ANOVA Topic 28: Unequal Replication in Two-Way ANOVA Outline Two-way ANOVA with unequal numbers of observations in the cells Data and model Regression approach Parameter estimates Previous analyses with constant

More information

Lecture 7: Latin Squares and Related Designs

Lecture 7: Latin Squares and Related Designs Lecture 7: Latin Squares and Related Designs Montgomery: Section 4.2 and 4.3 1 Lecture 7 Page 1 Automobile Emission Experiment Four cars and four drivers are employed in a study of four gasoline additives(a,b,c,

More information

Chap The McGraw-Hill Companies, Inc. All rights reserved.

Chap The McGraw-Hill Companies, Inc. All rights reserved. 11 pter11 Chap Analysis of Variance Overview of ANOVA Multiple Comparisons Tests for Homogeneity of Variances Two-Factor ANOVA Without Replication General Linear Model Experimental Design: An Overview

More information

Random Coefficient Model (a.k.a. multilevel model) (Adapted from UCLA Statistical Computing Seminars)

Random Coefficient Model (a.k.a. multilevel model) (Adapted from UCLA Statistical Computing Seminars) STAT:5201 Applied Statistic II Random Coefficient Model (a.k.a. multilevel model) (Adapted from UCLA Statistical Computing Seminars) School math achievement scores The data file consists of 7185 students

More information

Lecture 10: 2 k Factorial Design Montgomery: Chapter 6

Lecture 10: 2 k Factorial Design Montgomery: Chapter 6 Lecture 10: 2 k Factorial Design Montgomery: Chapter 6 Page 1 2 k Factorial Design Involving k factors Each factor has two levels (often labeled + and ) Factor screening experiment (preliminary study)

More information

STAT 8200 Design of Experiments for Research Workers Lab 11 Due: Friday, Nov. 22, 2013

STAT 8200 Design of Experiments for Research Workers Lab 11 Due: Friday, Nov. 22, 2013 Example: STAT 8200 Design of Experiments for Research Workers Lab 11 Due: Friday, Nov. 22, 2013 An experiment is designed to study pigment dispersion in paint. Four different methods of mixing a particular

More information

Unit 8: A Mixed Two-Factor Design

Unit 8: A Mixed Two-Factor Design Minitab Notes for STAT 3503 Dept. of Statistics CSU Hayward Unit 8: A Mixed Two-Factor Design 8.1. The Data We use data quoted in Brownlee: Statistical Theory and Methodology in Science and Engineering,

More information

STAT 705 Chapters 23 and 24: Two factors, unequal sample sizes; multi-factor ANOVA

STAT 705 Chapters 23 and 24: Two factors, unequal sample sizes; multi-factor ANOVA STAT 705 Chapters 23 and 24: Two factors, unequal sample sizes; multi-factor ANOVA Timothy Hanson Department of Statistics, University of South Carolina Stat 705: Data Analysis II 1 / 22 Balanced vs. unbalanced

More information

Introduction to Design and Analysis of Experiments with the SAS System (Stat 7010 Lecture Notes)

Introduction to Design and Analysis of Experiments with the SAS System (Stat 7010 Lecture Notes) Introduction to Design and Analysis of Experiments with the SAS System (Stat 7010 Lecture Notes) Asheber Abebe Discrete and Statistical Sciences Auburn University Contents 1 Completely Randomized Design

More information