Design and Analysis of

Size: px
Start display at page:

Download "Design and Analysis of"

Transcription

1 Design and Analysis of Multi-Factored Experiments Module Engineering Two-level Factorial Designs L. M. Lye DOE Course 1 The 2 k Factorial Design Special case of the general factorial design; k factors, all at two levels The two levels are usually called low and high (they could be either quantitative or qualitative) Very widely used in industrial experimentation Form a basic building block for other very useful experimental designs (DNA) Special (short-cut) methods for analysis We will make use of Design-Expert for analysis L. M. Lye DOE Course 2 1

2 Chemical Process Example A = reactant concentration, B = catalyst amount, y = recovery L. M. Lye DOE Course 3 The Simplest Case: The and + denote the low and high levels of a factor, respectively Low and high are arbitrary terms Geometrically, the four runs form the corners of a square Factors can be quantitative or qualitative, although their treatment in the final model will be different L. M. Lye DOE Course 4 2

3 Estimating effects in two-factor two-level experiments Estimate of the effect of A a 1 b 1 -a 0 b 1 estimate of effect of A at high B a 1 b 0 -a 0 b 0 estimate t of effect of A at low B sum/2 estimate of effect of A over all B Or average of high As average of low As. Estimate of the effect of B a 1 b 1 - a 1 b 0 estimate of effect of B at high A a 0 b 1 -a 0 b 0 estimate of effect of B at high A sum/2 estimate of effect of B over all A Or average of high Bs average of low Bs L. M. Lye DOE Course 5 Estimating effects in two-factor two-level experiments Estimate the interaction of A and B a 1 b 1 -a 0 b 1 estimate of effect of A at high B a 1b 0 -a 0b 0 estimate of effect of A at low B difference/2 estimate of effect of B on the effect of A called as the interaction of A and B a 1 b 1 -a 1 b 0 a 0 b 1 -a 0 b 0 difference/2 estimate of effect of B at high A estimate of effect of B at low A estimate of the effect of A on the effect of B Called the interaction of B and A Or average of like signs average of unlike signs L. M. Lye DOE Course 6 3

4 Estimating effects, contd... Note that the two differences in the interaction estimate are identical; by definition, the interaction of A and B is the same as the interaction of B and A. In a given experiment one of the two literary statements of interaction may be preferred by the experimenter to the other; but both have the same numerical value. L. M. Lye DOE Course 7 Remarks on effects and estimates Note the use of all four yields in the estimates of the effect of A, the effect of B, and the effect of the interaction of A and B; all four yields are needed and are used in each estimates. Note also that the effect of each of the factors and their interaction can be and are assessed separately, this in an experiment in which both factors vary simultaneously. Note that with respect to the two factors studied, the factors themselves together with their interaction are, logically, all that can be studied. These are among the merits of these factorial designs. L. M. Lye DOE Course 8 4

5 Remarks on interaction Many scientists feel the need for experiments which will reveal the effect, on the variable under study, of factors acting jointly. This is what we have called interaction. The simple experimental design discussed here evidently provides a way of estimating such interaction, with the latter defined in a way which corresponds to what many scientists have in mind when they think of interaction. It is useful to note that interaction was not invented by statisticians. It is a joint effect existing, often prominently, in the real world. Statisticians have merely provided ways and means to measure it. L. M. Lye DOE Course 9 Symbolism and language A is called a main effect. Our estimate of A is often simply written A. B is called a main effect. Our estimate of B is often simply written B. AB is called an interaction effect. Our estimate of AB is often simply written AB. So the same letter is used, generally without confusion, to describe the factor, to describe its effect, and to describe our estimate of its effect. Keep in mind that it is only for economy in writing that we sometimes speak of an effect rather than an estimate of the effect. We should always remember that all quantities formed from the yields are merely estimates. L. M. Lye DOE Course 10 5

6 The following table is useful: Table of signs A B AB a 0 b 0 (1) a 0 b 1 (b) a 1 b 0 (a) a 1 b 1 (ab) Notice that in estimating A, the two treatments with A at high level are compared to the two treatments with A at low level. Similarly B. This is, of course, logical. Note that the signs of treatments in the estimate of AB are the products of the signs of A and B. Note that in each estimate, plus and minus signs are equal in number L. M. Lye DOE Course 11 Example 1 15 Example 1 Example 2 B Example 2 B 14 A Low High Low High 14 B + A= B=2 Y A - 12 Y11 B - Low 9 10 (1) b Low (1) b A B A High A Example 1 High 15 B + a ab a ab A= Y B Example 3 B Example 4 B 15 Example Low High Low High 14 A 13 B , 12 Y Example 3 Low Low 15 (1) b B + 14 B + 9 A A 13 B A Y11 High High A 10 (1) 13 a Example A B AB 1 3* b 10 ab 12 a 12 ab Discussion of examples: Notice that in examples 2 & 3 interaction is as large as or larger than main effects. *A = [-(1) - b + a + ab]/2 = [ ]/2 L. M. Lye DOE Course =

7 Change of scale, by multiplying each yield by a constant, multiplies each estimate by the constant but does not affect the relationship of estimates to each other. Addition of a constant to each yield does not affect the estimates. The numerical magnitude of estimates is not important here; it is their relationship to each other. L. M. Lye DOE Course 13 Modern notation and Yates order Modern notation: a 0 b 0 = 1 a 0 b 1 = b a 1 b 0 = a a 1 b 1 = ab We also introduce Yates (standard) order of treatments and yields; each letter in turn followed by all combinations of that letter and letters already introduced. This will be the preferred order for the purpose of analysis of the yields. It is not necessarily the order in which the experiment is conducted; that will be discussed later. For a two-factor two-level factorial design, Yates order is 1 a b ab Using modern notation and Yates order, the estimates of effects become: A = (-1 + a - b + ab)/2 B = (-1 - a + b +ab)/2 AB = (1 -a - b + ab)/2 L. M. Lye DOE Course 14 7

8 Three factors each at two levels Example: The variable is the yield of a nitration process. The yield forms the base material for certain dye stuffs and medicines. Low high A time of addition of nitric acid 2 hours 7 hours B stirring time 1/2 hour 4 hours C heel absent present Treatments (also yields) Yates order: 1 a b ab c ac bc abc L. M. Lye DOE Course 15 Estimating effects in three-factor two-level designs (2 3 ) Estimate of A (1) a - 1 estimate of A, with B low and C low (2) ab - b estimate of A, with B high and C low (3) ac - c estimate of A, with B low and C high (4) abc - bc estimate of A, with B high and C high = (a+ab+ac+abc - 1-b-c-bc)/4, = (-1+a-b+ab-c+ac-bc+abc)/4 (in Yates order) L. M. Lye DOE Course 16 8

9 Estimate of AB Effect of A with B high - effect of A with B low, all at C high plus effect of A with B high - effect of A with B low, all at C low Note that interactions are averages. Just as our estimate of A is an average of response to A over all B and all C, so our estimate of AB is an average response to AB over all C. AB = {[(4)-(3)] + [(2) - (1)]}/4 = {1-a-b+ab+c-ac-bc+abc)/4, in Yates order or, = [(abc+ab+c+1) - (a+b+ac+bc)]/4 L. M. Lye DOE Course 17 Estimate of ABC interaction of A and B, at C high minus interaction of A and B at C low ABC = {[(4) - (3)] - [(2) - (1)]}/4 =(-1+a+b-ab+c-ac-bc+abc)/4, in Yates order or, =[abc+a+b+c - (1+ab+ac+bc)]/4 L. M. Lye DOE Course 18 9

10 This is our first encounter with a three-factor interaction. It measures the impact, on the yield of the nitration process, of interaction AB when C (heel) goes from C absent to C present. Or it measures the impact on yield of interaction AC when B (stirring time) goes from 1/2 hour to 4 hours. Or finally, it measures the impact on yield of interaction BC when A (time of addition of nitric acid) goes from 2 hours to 7 hours. As with two-factor two-level factorial designs, the formation of estimates in three-factor two-level factorial designs can be summarized in a table. L. M. Lye DOE Course 19 Sign Table for a 2 3 design A B AB C AC BC ABC a b ab c ac bc abc L. M. Lye DOE Course 20 10

11 Example Yield of nitration process discussed earlier: 1 a b ab c ac bc abc Y = A = main effect of nitric acid time = 1.25 B = main effect of stirring time = AB = interaction of A and B = C = main effect of heel = 0.60 AC = interaction of A and C = 0.15 BC = interaction i of B and C = 0.45 ABC = interaction of A, B, and C = NOTE: ac = largest yield; AC = smallest effect L. M. Lye DOE Course 21 We describe several of these estimates, though on later analysis of this example, taking into account the unreliability of estimates based on a small number (eight) of yields, some estimates may turn out to be so small in magnitude as not to contradict the conjecture that the corresponding true effect is zero. The largest estimate is -4.85, the estimate of B; an increase in stirring time, from 1/2 to 4 hours, is associated with a decline in yield. The interaction AB = -0.6; an increase in stirring time from 1/2 to 4 hours reduces the effect of A, whatever it is (A = 1.25), on yield. Or equivalently L. M. Lye DOE Course 22 11

12 an increase in nitric acid time from 2 to 7 hours reduces (makes more negative) the already negative effect (B = -485) of stirring time on yield. Finally, ABC = Going from no heel to heel, the negative interaction effect AB on yield becomes even more negative. Or going from low to high stirring time, the positive interaction effect AC is reduced. Or going from low to high nitric acid time, the positive interaction effect BC is reduced. All three descriptions of ABC have the same numerical value; but the chemist would select one of them, then say it better. L. M. Lye DOE Course 23 Number and kinds of effects We introduce the notation 2 k. This means a factor design with each factor at two levels. The number of treatments in an unreplicated 2 k design is 2 k. The following table shows the number of each kind of effect for each of the six two-level designs shown across the top. L. M. Lye DOE Course 24 12

13 Main effect f factor interaction ti factor interaction factor interaction factor interaction factor interaction 7 factor interaction In a 2 k design, the number of r-factor effects is C k r = k!/[r!(k-r)!] L. M. Lye DOE Course 25 Notice that the total number of effects estimated in any design is always one less than the number of treatments In a 2 2 design, there are 2 2 =4 treatments; we estimate = 3 effects. In a 2 3 design, there are 2 3 =8 treatments; we estimate = 7 effects One need not repeat the earlier logic to determine the forms of estimates in 2 k designs for higher values of k. A table going up to 2 5 follows. L. M. Lye DOE Course 26 13

14 2 E f f e c t s A B AB C AC BC ABC D AD BD ABD CD ACD BCD ABCD E AE BE ABE CE ACE BCE ABCE DE ADE BDE ABDE CDE ACDE BCDE ABCDE T r e a t m e n t s a b ab c ac bc abc d ad bd abd cd acd bcd abcd e ae be abe ce ace bce abce de ade bde abde cde acde bcde abcde L. M. Lye DOE Course 27 Main effects in the face of large interactions Several writers have cautioned against making statements about main effects when the corresponding interactions are large; interactions describe the dependence of the impact of one factor on the level of another; in the presence of large interaction, main effects may not be meaningful. L. M. Lye DOE Course 28 14

15 Factors not studied In any experiment, factors other than those studied may be influential. Their presence is sometimes acknowledged under the dubious title experimental error. They may be neglected, but the usual cost of neglect is high. For they often have uneven impact, systematically affecting some treatments more than others, and thereby seriously confounding inferences on the studied factors. It is important to deal explicitly with them; even more, it is important to measure their impact. How? L. M. Lye DOE Course Hold them constant. 2. Randomize their effects. 3. Estimate t their magnitude by replicating the experiment. 4. Estimate their magnitude via side or earlier experiments. 5. Argue (convincingly) that the effects of some of these non-studied d factors are zero, either in advance of the experiment or in the light of the yields. 6. Confound certain non-studied factors. L. M. Lye DOE Course 30 15

16 Simplified Analysis Procedure for 2-level Factorial Design Eti Estimate t factor effects Formulate model using important effects Check for goodness-of-fit of the model. Interpret results Use model for Prediction L. M. Lye DOE Course 31 Example: Shooting baskets Consider an experiment with 3 factors: A, B, and C. Let the response variable be Y. For example, Y = number of fbaskets made out of 10 Factor A = distance from basket (2m or 5m) Factor B = direction of shot (0 or 90 ) Factor C = type of shot (set or jumper) Factor Name Units Low Level (-1) High Level (+1) A Distance m 2 5 B Direction Deg C Shot type Set Jump L. M. Lye DOE Course 32 16

17 Treatment Combinations and Results Order A B C Combination Y (1) a b ab c ac bc abc 2 L. M. Lye DOE Course 33 Estimating Effects Order A B AB C AC BC ABC Comb Y (1) a b ab c ac bc abc 2 Effect A = (a + ab + ac + abc)/4 - (1 + b + c + bc)/4 = ( )/4 - ( )/4 = L. M. Lye DOE Course 34 17

18 Effects and Overall Average Using the sign table, all 7 effects can be calculated: Effect A = Effect B = Effect C = Effect AC = 1.25 Effect AB = Effect BC = Effect ABC = The overall average value = ( )/8 = 5.13 L. M. Lye DOE Course 35 Formulate Model The most important effects are: A, B, C, and AC Model: Y = β 0 + β 1 X 1 + β 2 X 2 + β 3 X 3 + β 13 X 1 X 3 β 0 = overall average = 5.13 β 1 = Effect [A]/2 = -2.75/2 = β 2 = Effect [B]/2 = -2.25/2 = β 3 = Effect [C]/2 = -1.75/2 = β 13 = Effect [AC]/2 = 1.25/2 = Model in coded units: Y = X X X X 1 X 3 L. M. Lye DOE Course 36 18

19 Checking for goodness-of-fit Actual Predicted Value Value DESIGN-EXPERT Plot Baskets Predicted Predicted vs. Actual Amazing fit!! Actual L. M. Lye DOE Course 37 Interpreting Results # out of f ( )/4= Effect of B=4-6.25= ( )/4= B # out of C: Shot type C(-1) C (+1) 2m 5m A Interaction of A and C = 1.25 At 5m, Jump or set shot about the same BUT at 2m, set shot gave higher values compared to jump shots L. M. Lye DOE Course 38 19

20 Statistical Details: Errors of estimates in 2 k designs 1. Meaning of σ 2 Assume that each treatment has variance σ 2. This has the following meaning: consider any one treatment and imagine many replicates of it. As all factors under study are constant throughout these repetitions, the only sources of any variability in yield are the factors not under study. Any variability in yield is due to them and is measured by σ 2. L. M. Lye DOE Course 39 Errors of estimates in 2 k designs, Contd.. 2. Effect of the number of factors on the error of an estimate What is the variance of an estimate of an effect? In a 2 k design, 2 k treatments go into each estimate; the signs of the treatments are + or -, depending on the effect being estimated. Note: σ 2 (kx) = k 2 σ 2 (x) So, any estimate = 1/2 k-1 [generalized (+ or -) sum of 2 k treatments] σ 2 (any estimate) = 1/2 2k-2 [2 k σ 2 ] = σ 2 /2 k-2 ; The larger the number of factors, the smaller the error of each estimate. L. M. Lye DOE Course 40 20

21 Errors of estimates in 2 k designs, Contd.. 3. Effect of replication on the error of an estimate What is the effect of replication on the error of an estimate? Consider a 2 k design with each treatment replicated n times. 1 a b abc d L. M. Lye DOE Course 41 Errors of estimates in 2 k designs, Contd.. Any estimate = 1/2 k-1 [sums of 2 k terms, all of them means based on samples of size n] σ 2 (any estimate) = 1/2 2k-2 [2 k σ 2 /n] = σ 2 /(n2 k-2 ); The larger the replication per treatment, the smaller the error of each estimate. L. M. Lye DOE Course 42 21

22 So, the error of an estimate depends on k (the number of factors studied) and n (the replication per factor). It also (obviously) depends on σ 2. The variance σ 2 can be reduced holding some of the non-studied factors constant. But, as has been noted, this gain is offset by reduced generality of any conclusions. L. M. Lye DOE Course 43 Effects, Sum of Squares and Regression Coefficients Contrast Effect = k 1 n2 SS = [ Contrast] n2 k 2 β 0 = grandmean β 1 Effect = 2 i L. M. Lye DOE Course 44 22

23 Judging Significance of Effects a) p- values from ANOVA MSi F i = MSE Compute p-value of calculated F. IF p < α, then effect is significant. b) Comparing std. error of effect to size of effect Contrast V(effect) = V = k 1 n2 V(Contrast) = n2 k σ 2 (n2 1 k 1 ) 2 [ ] V Contrast t L. M. Lye DOE Course 45 Hence 1 V(Effect) = k (n2 se(effect) = 1 (n2 ) 1 2 k 2 n2 k σ 2 MSE ) 1 = k (n2 2 σ ) 2 If effect ± 2 (se), contains zero, then that effect is not significant. These intervals are approximately the 95% CI. e.g ± 1.56 (significant) ± 1.56 (not significant) L. M. Lye DOE Course 46 23

24 c) Normal probability plot of effects Significant effects are those that do not fit on normal probability plot. i. e. non-significant effects will lie along the line of a normal probability plot of the effects. Good visual tool - available in Design-Expert software. L. M. Lye DOE Course 47 Design and Analysis of Multi-Factored Experiments Examples of Computer Analysis L. M. Lye DOE Course 48 24

25 Analysis Procedure for a Factorial Design Estimate factor effects Formulate model With replication, use full model With an unreplicated design, use normal probability plots Statistical testing (ANOVA) Refine the model Analyze residuals (graphical) Interpret results L. M. Lye DOE Course 49 Chemical Process Example A = reactant concentration, B = catalyst amount, y = recovery L. M. Lye DOE Course 50 25

26 Estimation of Factor Effects A = (a + ab b)/2n = ( )/(2 x 3) = 8.33 B = (b + ab a)/2n The effect estimates are: = = 8.33, B = -5.00, AB = 1.67 C = (ab a - b)/2n = 1.67 Design-Expert analysis A L. M. Lye DOE Course 51 Statistical Testing - ANOVA Response:Conversion ANOVA for Selected Factorial Model Analysis of variance table [Partial sum of squares] Sum of Mean F Source Squares DF Square Value Prob > F Model A < B AB Pure Error Cor Total Std. Dev R-Squared Mean Adj R-Squared C.V Pred R-Squared PRESS Adeq Precision The F-test for the model source is testing the significance of the overall model; that is, is either A, B, or AB or some combination of these effects important? L. M. Lye DOE Course 52 26

27 Refine Model Response:Conversion ANOVA for Selected Factorial Model Analysis of variance table [Partial sum of squares] Sum of Mean F Source Squares DF Square Value Prob > F Model < A < B Residual Lack of Fit Pure Error Cor Total Std. Dev R-Squared Mean Adj R-Squared C.V Pred R-Squared PRESS Adeq Precision There is now a residual sum of squares, partitioned into a lack of fit component (the AB interaction) and a pure error component L. M. Lye DOE Course 53 Regression Model for the Process Coefficient Standard 95% CI 95% CI Factor Estimate DF Error Low High VIF Intercept A-Concent B-Catalyst Final Equation in Terms of Coded Factors: Conversion = * A -2.5 * B Final Equation in Terms of Actual Factors: Conversion = * Concentration -5 * Catalyst L. M. Lye DOE Course 54 27

28 Residuals and Diagnostic Checking DESIGN-EXPERT Plot Conversion Normal plot of residuals DESIGN-EXPERT Plot Conversion Residuals vs. Predicted Normal % probability Residuals Residual Predicted L. M. Lye DOE Course 55 t The Response Surface Conversion n B: Catalyst Conversion A: Concentration B: Catalyst A: Concentration L. M. Lye DOE Course 56 28

29 An Example of a 2 3 Factorial Design A = carbonation, B = pressure, C = speed, y = fill deviation L. M. Lye DOE Course 57 Estimation of Factor Effects Term Effect SumSqr % Contribution Model Intercept Error A Error B Error C Error AB Error AC Error BC Error ABC Error LOF 0 Error P Error Lenth's ME Lenth's SME L. M. Lye DOE Course 58 29

30 ANOVA Summary Full Model Response:Fill-deviation ANOVA for Selected Factorial Model Analysis of variance table [Partial sum of squares] Sum of Mean F Source Squares DF Square Value Prob > F Model A < B C AB AC BC ABC Pure Error Cor Total Std. Dev R-Squared Mean 1.00 Adj R-Squared C.V Pred R-Squared PRESS Adeq Precision L. M. Lye DOE Course 59 Refine Model Remove Nonsignificant Factors Response: Fill-deviation ANOVA for Selected Factorial Model Analysis of variance table [Partial sum of squares] Sum of Mean F Source Squares DF Square Value Prob > F Model < A < B C AB Residual LOF Pure E C Total Std. Dev R-Squared Mean 1.00 Adj R-Squared C.V Pred R-Squared PRESS Adeq Precision L. M. Lye DOE Course 60 30

31 Model Coefficients Reduced Model Coefficient Standard 95% CI 95% CI Factor Estimate DF Error Low High Intercept A-Carbonation B-Pressure C-Speed AB L. M. Lye DOE Course 61 Model Summary Statistics R 2 and adjusted R 2 2 SS R = Model = = SS R 2 Adj T SSE / dfe 5.00/8 = 1 = 1 = SS / df /15 T T R 2 for prediction i (based on PRESS) 2 PRESS RPred = 1 = 1 = SS T L. M. Lye DOE Course 62 31

32 Model Summary Statistics Standard error of model coefficients 2 ˆ ˆ σ MSE se( β) = V ( β) = = = = 0.20 k k n2 n2 2(8) Confidence interval on model coefficients ˆ β t se( ˆ β) β ˆ β + t se( ˆ β) α/2, df α/2, df E E L. M. Lye DOE Course 63 The Regression Model Final Equation in Terms of Coded Factors: Fill-deviation = * A * B * C * A * B Final Equation in Terms of Actual Factors: Fill-deviation = * Carbonation * Pressure * Speed * Carbonation * Pressure L. M. Lye DOE Course 64 32

33 Residual Plots are Satisfactory DESIGN-EXPERT Plot Fill-deviation Normal plot of residuals Normal % probability Studentized Residuals L. M. Lye DOE Course 65 Model Interpretation DESIGN-EXPERT Plot Fill-deviation X = A: Carbonation Y = B: Pressure B B Actual Factor C: Speed = Fill-deviation Interaction Graph B: Pressure Moderate interaction ti between carbonation level and pressure A: Carbonation L. M. Lye DOE Course 66 33

34 Model Interpretation DESIGN-EXPERT Plot Fill-deviation X = A: Carbonation Y = B: Pressure Z = C: Speed B: Pressure B Cube Graph Fill-deviation Cube plots are often useful visual displays of 3.13 experimental results C+ C: Speed B C- A- A+ A: Carbonation L. M. Lye DOE Course 67 Contour & Response Surface Plots Speed at the High Level DESIGN-EXPERT Plot Fill-deviation X = A: Carbonation Y = B: Pressure Design Points Actual Factor C: Speed = B: Pressure Fill-deviation Fill-deviation A: Carbonation B: Pressure A: Carbonation L. M. Lye DOE Course 68 34

35 Design and Analysis of Multi-Factored Experiments Unreplicated Factorials L. M. Lye DOE Course 69 Unreplicated 2 k Factorial Designs These are 2 k factorial designs with one observation at each corner of the cube An unreplicated 2 k factorial design is also sometimes called a single replicate of the 2 k These designs are very widely used Risks if there is only one observation at each corner, is there a chance of unusual response observations spoiling the results? Modeling noise? L. M. Lye DOE Course 70 35

36 Spacing of Factor Levels in the Unreplicated 2 k Factorial Designs If the factors are spaced too closely, it increases the chances that the noise will overwhelm the signal in the data More aggressive spacing is usually best L. M. Lye DOE Course 71 Unreplicated 2 k Factorial Designs Lack of replication causes potential problems in statistical testing Replication admits an estimate of pure error (a better phrase is an internal estimate of error) With no replication, fitting the full model results in zero degrees of freedom for error Potential solutions to this problem Pooling high-order h interactions i to estimate error Normal probability plotting of effects (Daniels, 1959) L. M. Lye DOE Course 72 36

37 Example of an Unreplicated 2 k Design A2 4 factorial was used to investigate the effects of four factors on the filtration rate of a resin The factors are A = temperature, B = pressure, C = mole ratio, D= stirring rate Experiment was performed in a pilot plant L. M. Lye DOE Course 73 The Resin Plant Experiment L. M. Lye DOE Course 74 37

38 The Half-Normal Probability Plot DESIGN-EXPERT Plot Filtration Rate Half Normal plot A: Temperature B: Pressure C: Concentration D: Stirring Rate Half Norm al % probability C D AC AD A E ffe ct L. M. Lye DOE Course 75 ANOVA Summary for the Model Response:Filtration Rate ANOVA for Selected Factorial Model Analysis of variance table [Partial sum of squares] Sum of Mean F Source Squares DF Square Value Prob >F Model < A < C D < AC < AD < Residual Cor Total Std. Dev R-Squared Mean Adj R-Squared C.V Pred R-Squared PRESS Adeq Precision L. M. Lye DOE Course 76 38

39 The Regression Model Final Equation in Terms of Coded Factors: Filtration Rate = * Temperature * Concentration * Stirring Rate * Temperature * Concentration * Temperature * Stirring Rate L. M. Lye DOE Course 77 Model Residuals are Satisfactory DESIGN-EXPERT Plot Filtration Rate Normal plot of residuals Normal % probability Studentized Residuals L. M. Lye DOE Course 78 39

40 Model Interpretation Interactions DESIGN-EXPERT Plot Filtration Rate X = A: Temperature Y = C: Concentration C C Actual Factors B: Pressure = 0.00 D: Stirring Rate = 0.00 Filtration Rate Interaction Graph C: Concentration DESIGN-EXPERT Plot Filtration Rate X = A: Temperature Y = D: Stirring Rate D D Actual Factors B: Pressure = 0.00 C: Concentration = 0.00 Filtration Rate Interaction Graph D: Stirring Rate A: Temperature A: Temperature L. M. Lye DOE Course 79 Model Interpretation Cube Plot DESIGN-EXPERT Plot Filtration Rate X = A: Temperature Y = C: Concentration Z = D: Stirring Rate Actual Factor B : P re ssu re = 0.00 C: Concentration C C Cube Graph Filtration Rate C D- A- A+ A: Temperature D+ D: Stirring Rate If one factor is dropped, the unreplicated 2 4 design will project into two replicates of a 2 3 Design projection is an extremely useful property, carrying over into fractional factorials L. M. Lye DOE Course 80 40

41 Model Interpretation Response Surface Plots DESIGN-EXPERT Plot Filtration Rate X = A: Temperature Y = D: Stirring Rate Actual Factors B: Pressure = 0.00 C: Concentration = Filtration Rate DESIGN-EXPERT Plot Filtration Rate X = A: Temperature Y = D: Stirring Rate Actual Factors B: Pressure = 0.00 C: Concentration = D: Stirring Rate Filtration Rate A: Temperature D: Stirring Rate A: Temperature With concentration at either the low or high level, high temperature and high stirring rate results in high filtration rates L. M. Lye DOE Course 81 The Drilling Experiment A = drill load, B = flow, C = speed, D = type of mud, y = advance rate of the drill L. M. Lye DOE Course 82 41

42 Effect Estimates - The Drilling Experiment Term Effect SumSqr % Contribution Model Intercept Error A Error B Error C Error D Error AB Error AC Error AD Error BC Error BD Error CD Error ABC Error ABD Error ACD Error BCD Error ABCD Lenth's ME Lenth's SME L. M. Lye DOE Course 83 Half-Normal Probability Plot of Effects DESIGN-EXPERT Plot adv._rate Half Normal plot A: load B: flow C: speed e D: mud Half Normal % probability BD BC D C B Effect L. M. Lye DOE Course 84 42

43 ot Normal plot of residuals Residual Plots t Residuals vs. Predicted Normal % probability Residuals Residual Predicted L. M. Lye DOE Course 85 Residual Plots The residual plots indicate that there are problems with the equality of variance assumption The usual approach to this problem is to employ a transformation on the response Power family transformations are widely used * y y λ Transformations are typically performed to Stabilize variance Induce normality Simplify the model = L. M. Lye DOE Course 86 43

44 Selecting a Transformation Empirical selection of lambda Prior (theoretical) knowledge or experience can often suggest the form of a transformation Analytical selection of lambda the Box-Cox (1964) method (simultaneously estimates the model parameters and the transformation parameter lambda) Box-Cox method implemented in Design-Expert L. M. Lye DOE Course 87 The Box-Cox Method DESIGN-EXPERT Plot adv._rate Lambda Current = 1 Best = Low C.I. = High C.I. = 0.32 Recommend transform: Log (Lambda = 0) Ln(ResidualSS) Box-Cox Plot for Power Transforms 6.85 A log transformation is recommended 5.40 The procedure provides a confidence interval on the transformation 3.95 parameter lambda If unity is included in the 2.50 confidence interval, no transformation would be needed Lambda L. M. Lye DOE Course 88 44

45 Effect Estimates Following the Log Transformation DESIGN-EXPERT Plot Ln(adv._rate) A: load B: flow C: speed D: m ud Half Norm al % probability Half Normal plot 99 Three main effects are 97 large D C B No indication of large interaction effects What happened to the interactions? Effect L. M. Lye DOE Course 89 ANOVA Following the Log Transformation Response: adv._rate Transform: Natural log Constant: ANOVA for Selected Factorial Model Analysis of variance table [Partial sum of squares] Sum of Mean F Source Squares DF Square Value Prob > F Model < B < C < D Residual Cor Total Std. Dev R-Squared Mean 1.60 Adj R-Squared C.V Pred R-Squared PRESS 0.31 Adeq Precision L. M. Lye DOE Course 90 45

46 Following the Log Transformation Final Equation in Terms of Coded Factors: Ln(adv._rate) = * B * C * D L. M. Lye DOE Course 91 Following the Log Transformation DESIGN-EXPERT Plot Ln(adv._rate) Normal plot of residuals DESIGN-EXPERT Plot Ln(adv._rate) Residuals vs. Predicted Normal % probability Residuals Residual Predicted L. M. Lye DOE Course 92 46

47 The Log Advance Rate Model Is the log model better? We would generally prefer a simpler model in a transformed scale to a more complicated model in the original metric What happened to the interactions? Sometimes transformations provide insight into the underlying mechanism L. M. Lye DOE Course 93 Design and Analysis of Multi-Factored Experiments Center points L. M. Lye DOE Course 94 47

48 Addition of Center Points to a 2 k Designs Based on the idea of replicating some of the runs in a factorial ldesign Runs at the center provide an estimate of error and allow the experimenter to distinguish between two possible models: 0 k k k First-order model (interaction) y = β + β x + β x x + ε 0 i i ij i j i= 1 i= 1 j> i k k k k 2 i i ij i j ii i i= 1 i= 1 j> i i= 1 Second-order model y = β + β x + β x x + β x + ε L. M. Lye DOE Course 95 y F = y C no "curvature" The hypotheses are: SS Pure Quad H 0 1 k : β = 0 i= 1 k i= 1 ii H : β 0 ii nn F C( yf yc) = n + n This sum of squares has a single degree of freedom F C 2 L. M. Lye DOE Course 96 48

49 Example n C = 5 Usually between 3 and 6 center points will work well Design-Expert provides the analysis, including the F-test for pure quadratic curvature L. M. Lye DOE Course 97 ANOVA for Example Response: yield ANOVA for Selected Factorial Model Analysis of variance table [Partial sum of squares] Sum of Mean F Source Squares DF Square Value Prob > F Model A B AB 2.500E E Curvature 2.722E E Pure Error Cor Total Std. Dev R-Squared Mean Adj R-Squared C.V Pred R-Squared N/A PRESS N/A Adeq Precision L. M. Lye DOE Course 98 49

50 If curvature is significant, augment the design with axial runs to create a central composite design. The CCD is a very effective design for fitting a second-order response surface model L. M. Lye DOE Course 99 Practical Use of Center Points Use current operating conditions as the center point Check for abnormal conditions during the time the experiment was conducted Check for time trends Use center points as the first few runs when there is little or no information available about the magnitude of error Can have only 1 center point for computer experiments hence requires a different type of design L. M. Lye DOE Course

Design and Analysis of Multi-Factored Experiments

Design and Analysis of Multi-Factored Experiments Design and Analysis of Multi-Factored Experiments Two-level Factorial Designs L. M. Lye DOE Course 1 The 2 k Factorial Design Special case of the general factorial design; k factors, all at two levels

More information

Design of Engineering Experiments Part 5 The 2 k Factorial Design

Design of Engineering Experiments Part 5 The 2 k Factorial Design Design of Engineering Experiments Part 5 The 2 k Factorial Design Text reference, Special case of the general factorial design; k factors, all at two levels The two levels are usually called low and high

More information

The 2 k Factorial Design. Dr. Mohammad Abuhaiba 1

The 2 k Factorial Design. Dr. Mohammad Abuhaiba 1 The 2 k Factorial Design Dr. Mohammad Abuhaiba 1 HoweWork Assignment Due Tuesday 1/6/2010 6.1, 6.2, 6.17, 6.18, 6.19 Dr. Mohammad Abuhaiba 2 Design of Engineering Experiments The 2 k Factorial Design Special

More information

Unreplicated 2 k Factorial Designs

Unreplicated 2 k Factorial Designs Unreplicated 2 k Factorial Designs These are 2 k factorial designs with one observation at each corner of the cube An unreplicated 2 k factorial design is also sometimes called a single replicate of the

More information

Addition of Center Points to a 2 k Designs Section 6-6 page 271

Addition of Center Points to a 2 k Designs Section 6-6 page 271 to a 2 k Designs Section 6-6 page 271 Based on the idea of replicating some of the runs in a factorial design 2 level designs assume linearity. If interaction terms are added to model some curvature results

More information

3.4. A computer ANOVA output is shown below. Fill in the blanks. You may give bounds on the P-value.

3.4. A computer ANOVA output is shown below. Fill in the blanks. You may give bounds on the P-value. 3.4. A computer ANOVA output is shown below. Fill in the blanks. You may give bounds on the P-value. One-way ANOVA Source DF SS MS F P Factor 3 36.15??? Error??? Total 19 196.04 Completed table is: One-way

More information

4. The 2 k Factorial Designs (Ch.6. Two-Level Factorial Designs)

4. The 2 k Factorial Designs (Ch.6. Two-Level Factorial Designs) 4. The 2 k Factorial Designs (Ch.6. Two-Level Factorial Designs) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University Introduction to 2 k Factorial Designs Special case of the general factorial

More information

4. Design of Experiments (DOE) (The 2 k Factorial Designs)

4. Design of Experiments (DOE) (The 2 k Factorial Designs) 4. Design of Experiments (DOE) (The 2 k Factorial Designs) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University 1 Example: Golfing How to improve my score in Golfing? Practice!!! Other than

More information

Chapter 6 The 2 k Factorial Design Solutions

Chapter 6 The 2 k Factorial Design Solutions Solutions from Montgomery, D. C. (004) Design and Analysis of Experiments, Wiley, NY Chapter 6 The k Factorial Design Solutions 6.. A router is used to cut locating notches on a printed circuit board.

More information

An Introduction to Design of Experiments

An Introduction to Design of Experiments An Introduction to Design of Experiments Douglas C. Montgomery Regents Professor of Industrial Engineering and Statistics ASU Foundation Professor of Engineering Arizona State University Bradley Jones

More information

Chapter 6 The 2 k Factorial Design Solutions

Chapter 6 The 2 k Factorial Design Solutions Solutions from Montgomery, D. C. () Design and Analysis of Experiments, Wiley, NY Chapter 6 The k Factorial Design Solutions 6.. An engineer is interested in the effects of cutting speed (A), tool geometry

More information

Design of Engineering Experiments Chapter 5 Introduction to Factorials

Design of Engineering Experiments Chapter 5 Introduction to Factorials Design of Engineering Experiments Chapter 5 Introduction to Factorials Text reference, Chapter 5 page 170 General principles of factorial experiments The two-factor factorial with fixed effects The ANOVA

More information

Chapter 11: Factorial Designs

Chapter 11: Factorial Designs Chapter : Factorial Designs. Two factor factorial designs ( levels factors ) This situation is similar to the randomized block design from the previous chapter. However, in addition to the effects within

More information

Experimental design (DOE) - Design

Experimental design (DOE) - Design Experimental design (DOE) - Design Menu: QCExpert Experimental Design Design Full Factorial Fract Factorial This module designs a two-level multifactorial orthogonal plan 2 n k and perform its analysis.

More information

Chapter 5 Introduction to Factorial Designs Solutions

Chapter 5 Introduction to Factorial Designs Solutions Solutions from Montgomery, D. C. (1) Design and Analysis of Experiments, Wiley, NY Chapter 5 Introduction to Factorial Designs Solutions 5.1. The following output was obtained from a computer program that

More information

Institutionen för matematik och matematisk statistik Umeå universitet November 7, Inlämningsuppgift 3. Mariam Shirdel

Institutionen för matematik och matematisk statistik Umeå universitet November 7, Inlämningsuppgift 3. Mariam Shirdel Institutionen för matematik och matematisk statistik Umeå universitet November 7, 2011 Inlämningsuppgift 3 Mariam Shirdel (mash0007@student.umu.se) Kvalitetsteknik och försöksplanering, 7.5 hp 1 Uppgift

More information

Strategy of Experimentation II

Strategy of Experimentation II LECTURE 2 Strategy of Experimentation II Comments Computer Code. Last week s homework Interaction plots Helicopter project +1 1 1 +1 [4I 2A 2B 2AB] = [µ 1) µ A µ B µ AB ] +1 +1 1 1 +1 1 +1 1 +1 +1 +1 +1

More information

Fractional Replications

Fractional Replications Chapter 11 Fractional Replications Consider the set up of complete factorial experiment, say k. If there are four factors, then the total number of plots needed to conduct the experiment is 4 = 1. When

More information

Higher Order Factorial Designs. Estimated Effects: Section 4.3. Main Effects: Definition 5 on page 166.

Higher Order Factorial Designs. Estimated Effects: Section 4.3. Main Effects: Definition 5 on page 166. Higher Order Factorial Designs Estimated Effects: Section 4.3 Main Effects: Definition 5 on page 166. Without A effects, we would fit values with the overall mean. The main effects are how much we need

More information

TWO-LEVEL FACTORIAL EXPERIMENTS: REGULAR FRACTIONAL FACTORIALS

TWO-LEVEL FACTORIAL EXPERIMENTS: REGULAR FRACTIONAL FACTORIALS STAT 512 2-Level Factorial Experiments: Regular Fractions 1 TWO-LEVEL FACTORIAL EXPERIMENTS: REGULAR FRACTIONAL FACTORIALS Bottom Line: A regular fractional factorial design consists of the treatments

More information

Design of Experiments SUTD - 21/4/2015 1

Design of Experiments SUTD - 21/4/2015 1 Design of Experiments SUTD - 21/4/2015 1 Outline 1. Introduction 2. 2 k Factorial Design Exercise 3. Choice of Sample Size Exercise 4. 2 k p Fractional Factorial Design Exercise 5. Follow-up experimentation

More information

ST3232: Design and Analysis of Experiments

ST3232: Design and Analysis of Experiments Department of Statistics & Applied Probability 2:00-4:00 pm, Monday, April 8, 2013 Lecture 21: Fractional 2 p factorial designs The general principles A full 2 p factorial experiment might not be efficient

More information

20g g g Analyze the residuals from this experiment and comment on the model adequacy.

20g g g Analyze the residuals from this experiment and comment on the model adequacy. 3.4. A computer ANOVA output is shown below. Fill in the blanks. You may give bounds on the P-value. One-way ANOVA Source DF SS MS F P Factor 3 36.15??? Error??? Total 19 196.04 3.11. A pharmaceutical

More information

Answer Keys to Homework#10

Answer Keys to Homework#10 Answer Keys to Homework#10 Problem 1 Use either restricted or unrestricted mixed models. Problem 2 (a) First, the respective means for the 8 level combinations are listed in the following table A B C Mean

More information

Assignment 9 Answer Keys

Assignment 9 Answer Keys Assignment 9 Answer Keys Problem 1 (a) First, the respective means for the 8 level combinations are listed in the following table A B C Mean 26.00 + 34.67 + 39.67 + + 49.33 + 42.33 + + 37.67 + + 54.67

More information

Suppose we needed four batches of formaldehyde, and coulddoonly4runsperbatch. Thisisthena2 4 factorial in 2 2 blocks.

Suppose we needed four batches of formaldehyde, and coulddoonly4runsperbatch. Thisisthena2 4 factorial in 2 2 blocks. 58 2. 2 factorials in 2 blocks Suppose we needed four batches of formaldehyde, and coulddoonly4runsperbatch. Thisisthena2 4 factorial in 2 2 blocks. Some more algebra: If two effects are confounded with

More information

What If There Are More Than. Two Factor Levels?

What If There Are More Than. Two Factor Levels? What If There Are More Than Chapter 3 Two Factor Levels? Comparing more that two factor levels the analysis of variance ANOVA decomposition of total variability Statistical testing & analysis Checking

More information

Session 3 Fractional Factorial Designs 4

Session 3 Fractional Factorial Designs 4 Session 3 Fractional Factorial Designs 3 a Modification of a Bearing Example 3. Fractional Factorial Designs Two-level fractional factorial designs Confounding Blocking Two-Level Eight Run Orthogonal Array

More information

2 k, 2 k r and 2 k-p Factorial Designs

2 k, 2 k r and 2 k-p Factorial Designs 2 k, 2 k r and 2 k-p Factorial Designs 1 Types of Experimental Designs! Full Factorial Design: " Uses all possible combinations of all levels of all factors. n=3*2*2=12 Too costly! 2 Types of Experimental

More information

IE 361 Exam 3 (Form A)

IE 361 Exam 3 (Form A) December 15, 005 IE 361 Exam 3 (Form A) Prof. Vardeman This exam consists of 0 multiple choice questions. Write (in pencil) the letter for the single best response for each question in the corresponding

More information

19. Blocking & confounding

19. Blocking & confounding 146 19. Blocking & confounding Importance of blocking to control nuisance factors - day of week, batch of raw material, etc. Complete Blocks. This is the easy case. Suppose we run a 2 2 factorial experiment,

More information

STAT451/551 Homework#11 Due: April 22, 2014

STAT451/551 Homework#11 Due: April 22, 2014 STAT451/551 Homework#11 Due: April 22, 2014 1. Read Chapter 8.3 8.9. 2. 8.4. SAS code is provided. 3. 8.18. 4. 8.24. 5. 8.45. 376 Chapter 8 Two-Level Fractional Factorial Designs more detail. Sequential

More information

Strategy of Experimentation III

Strategy of Experimentation III LECTURE 3 Strategy of Experimentation III Comments: Homework 1. Design Resolution A design is of resolution R if no p factor effect is confounded with any other effect containing less than R p factors.

More information

Fractional Factorial Designs

Fractional Factorial Designs Fractional Factorial Designs ST 516 Each replicate of a 2 k design requires 2 k runs. E.g. 64 runs for k = 6, or 1024 runs for k = 10. When this is infeasible, we use a fraction of the runs. As a result,

More information

Reference: Chapter 6 of Montgomery(8e) Maghsoodloo

Reference: Chapter 6 of Montgomery(8e) Maghsoodloo Reference: Chapter 6 of Montgomery(8e) Maghsoodloo 51 DOE (or DOX) FOR BASE BALANCED FACTORIALS The notation k is used to denote a factorial experiment involving k factors (A, B, C, D,..., K) each at levels.

More information

23. Fractional factorials - introduction

23. Fractional factorials - introduction 173 3. Fractional factorials - introduction Consider a 5 factorial. Even without replicates, there are 5 = 3 obs ns required to estimate the effects - 5 main effects, 10 two factor interactions, 10 three

More information

Chapter 13 Experiments with Random Factors Solutions

Chapter 13 Experiments with Random Factors Solutions Solutions from Montgomery, D. C. (01) Design and Analysis of Experiments, Wiley, NY Chapter 13 Experiments with Random Factors Solutions 13.. An article by Hoof and Berman ( Statistical Analysis of Power

More information

FRACTIONAL FACTORIAL

FRACTIONAL FACTORIAL FRACTIONAL FACTORIAL NURNABI MEHERUL ALAM M.Sc. (Agricultural Statistics), Roll No. 443 I.A.S.R.I, Library Avenue, New Delhi- Chairperson: Dr. P.K. Batra Abstract: Fractional replication can be defined

More information

CS 5014: Research Methods in Computer Science

CS 5014: Research Methods in Computer Science Computer Science Clifford A. Shaffer Department of Computer Science Virginia Tech Blacksburg, Virginia Fall 2010 Copyright c 2010 by Clifford A. Shaffer Computer Science Fall 2010 1 / 254 Experimental

More information

Unit 6: Fractional Factorial Experiments at Three Levels

Unit 6: Fractional Factorial Experiments at Three Levels Unit 6: Fractional Factorial Experiments at Three Levels Larger-the-better and smaller-the-better problems. Basic concepts for 3 k full factorial designs. Analysis of 3 k designs using orthogonal components

More information

Design of Experiments SUTD 06/04/2016 1

Design of Experiments SUTD 06/04/2016 1 Design of Experiments SUTD 06/04/2016 1 Outline 1. Introduction 2. 2 k Factorial Design 3. Choice of Sample Size 4. 2 k p Fractional Factorial Design 5. Follow-up experimentation (folding over) with factorial

More information

The One-Quarter Fraction

The One-Quarter Fraction The One-Quarter Fraction ST 516 Need two generating relations. E.g. a 2 6 2 design, with generating relations I = ABCE and I = BCDF. Product of these is ADEF. Complete defining relation is I = ABCE = BCDF

More information

5. Blocking and Confounding

5. Blocking and Confounding 5. Blocking and Confounding Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University 1 Why Blocking? Blocking is a technique for dealing with controllable nuisance variables Sometimes, it is

More information

Lecture 10: 2 k Factorial Design Montgomery: Chapter 6

Lecture 10: 2 k Factorial Design Montgomery: Chapter 6 Lecture 10: 2 k Factorial Design Montgomery: Chapter 6 Page 1 2 k Factorial Design Involving k factors Each factor has two levels (often labeled + and ) Factor screening experiment (preliminary study)

More information

Homework 04. , not a , not a 27 3 III III

Homework 04. , not a , not a 27 3 III III Response Surface Methodology, Stat 579 Fall 2014 Homework 04 Name: Answer Key Prof. Erik B. Erhardt Part I. (130 points) I recommend reading through all the parts of the HW (with my adjustments) before

More information

MATH602: APPLIED STATISTICS

MATH602: APPLIED STATISTICS MATH602: APPLIED STATISTICS Dr. Srinivas R. Chakravarthy Department of Science and Mathematics KETTERING UNIVERSITY Flint, MI 48504-4898 Lecture 10 1 FRACTIONAL FACTORIAL DESIGNS Complete factorial designs

More information

Confounding and fractional replication in 2 n factorial systems

Confounding and fractional replication in 2 n factorial systems Chapter 20 Confounding and fractional replication in 2 n factorial systems Confounding is a method of designing a factorial experiment that allows incomplete blocks, i.e., blocks of smaller size than the

More information

Factorial designs (Chapter 5 in the book)

Factorial designs (Chapter 5 in the book) Factorial designs (Chapter 5 in the book) Ex: We are interested in what affects ph in a liquide. ph is the response variable Choose the factors that affect amount of soda air flow... Choose the number

More information

CSCI 688 Homework 6. Megan Rose Bryant Department of Mathematics William and Mary

CSCI 688 Homework 6. Megan Rose Bryant Department of Mathematics William and Mary CSCI 688 Homework 6 Megan Rose Bryant Department of Mathematics William and Mary November 12, 2014 7.1 Consider the experiment described in Problem 6.1. Analyze this experiment assuming that each replicate

More information

Chapter 5 Introduction to Factorial Designs

Chapter 5 Introduction to Factorial Designs Chapter 5 Introduction to Factorial Designs 5. Basic Definitions and Principles Stud the effects of two or more factors. Factorial designs Crossed: factors are arranged in a factorial design Main effect:

More information

TWO-LEVEL FACTORIAL EXPERIMENTS: BLOCKING. Upper-case letters are associated with factors, or regressors of factorial effects, e.g.

TWO-LEVEL FACTORIAL EXPERIMENTS: BLOCKING. Upper-case letters are associated with factors, or regressors of factorial effects, e.g. STAT 512 2-Level Factorial Experiments: Blocking 1 TWO-LEVEL FACTORIAL EXPERIMENTS: BLOCKING Some Traditional Notation: Upper-case letters are associated with factors, or regressors of factorial effects,

More information

Design and Analysis of Experiments

Design and Analysis of Experiments Design and Analysis of Experiments Part VII: Fractional Factorial Designs Prof. Dr. Anselmo E de Oliveira anselmo.quimica.ufg.br anselmo.disciplinas@gmail.com 2 k : increasing k the number of runs required

More information

Review of Statistics 101

Review of Statistics 101 Review of Statistics 101 We review some important themes from the course 1. Introduction Statistics- Set of methods for collecting/analyzing data (the art and science of learning from data). Provides methods

More information

Fractional Factorial Designs

Fractional Factorial Designs k-p Fractional Factorial Designs Fractional Factorial Designs If we have 7 factors, a 7 factorial design will require 8 experiments How much information can we obtain from fewer experiments, e.g. 7-4 =

More information

6. Fractional Factorial Designs (Ch.8. Two-Level Fractional Factorial Designs)

6. Fractional Factorial Designs (Ch.8. Two-Level Fractional Factorial Designs) 6. Fractional Factorial Designs (Ch.8. Two-Level Fractional Factorial Designs) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University 1 Introduction to The 2 k-p Fractional Factorial Design

More information

Chap The McGraw-Hill Companies, Inc. All rights reserved.

Chap The McGraw-Hill Companies, Inc. All rights reserved. 11 pter11 Chap Analysis of Variance Overview of ANOVA Multiple Comparisons Tests for Homogeneity of Variances Two-Factor ANOVA Without Replication General Linear Model Experimental Design: An Overview

More information

APPENDIX 1. Binodal Curve calculations

APPENDIX 1. Binodal Curve calculations APPENDIX 1 Binodal Curve calculations The weight of salt solution necessary for the mixture to cloud and the final concentrations of the phase components were calculated based on the method given by Hatti-Kaul,

More information

a) Prepare a normal probability plot of the effects. Which effects seem active?

a) Prepare a normal probability plot of the effects. Which effects seem active? Problema 8.6: R.D. Snee ( Experimenting with a large number of variables, in experiments in Industry: Design, Analysis and Interpretation of Results, by R. D. Snee, L.B. Hare, and J. B. Trout, Editors,

More information

CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS

CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS 134 CHAPTER 6 A STUDY ON DISC BRAKE SQUEAL USING DESIGN OF EXPERIMENTS 6.1 INTRODUCTION In spite of the large amount of research work that has been carried out to solve the squeal problem during the last

More information

Factorial designs. Experiments

Factorial designs. Experiments Chapter 5: Factorial designs Petter Mostad mostad@chalmers.se Experiments Actively making changes and observing the result, to find causal relationships. Many types of experimental plans Measuring response

More information

Probability Distribution

Probability Distribution Probability Distribution 1. In scenario 2, the particle size distribution from the mill is: Counts 81

More information

Unit 9: Confounding and Fractional Factorial Designs

Unit 9: Confounding and Fractional Factorial Designs Unit 9: Confounding and Fractional Factorial Designs STA 643: Advanced Experimental Design Derek S. Young 1 Learning Objectives Understand what it means for a treatment to be confounded with blocks Know

More information

Third European DOE User Meeting, Luzern 2010

Third European DOE User Meeting, Luzern 2010 Correcting for multiple testing Old tricks, state-of-the-art solutions and common sense Ivan Langhans CQ Consultancy CQ Consultancy Expertise in Chemometrics; the interaction between Chemistry and Statistics

More information

A Statistical Approach to the Study of Qualitative Behavior of Solutions of Second Order Neutral Differential Equations

A Statistical Approach to the Study of Qualitative Behavior of Solutions of Second Order Neutral Differential Equations Australian Journal of Basic and Applied Sciences, (4): 84-833, 007 ISSN 99-878 A Statistical Approach to the Study of Qualitative Behavior of Solutions of Second Order Neutral Differential Equations Seshadev

More information

Design & Analysis of Experiments 7E 2009 Montgomery

Design & Analysis of Experiments 7E 2009 Montgomery Chapter 5 1 Introduction to Factorial Design Study the effects of 2 or more factors All possible combinations of factor levels are investigated For example, if there are a levels of factor A and b levels

More information

Fractional Factorials

Fractional Factorials Fractional Factorials Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 26 1 Fractional Factorials Number of runs required for full factorial grows quickly A 2 7 design requires 128

More information

Power Functions for. Process Behavior Charts

Power Functions for. Process Behavior Charts Power Functions for Process Behavior Charts Donald J. Wheeler and Rip Stauffer Every data set contains noise (random, meaningless variation). Some data sets contain signals (nonrandom, meaningful variation).

More information

CS 5014: Research Methods in Computer Science. Experimental Design. Potential Pitfalls. One-Factor (Again) Clifford A. Shaffer.

CS 5014: Research Methods in Computer Science. Experimental Design. Potential Pitfalls. One-Factor (Again) Clifford A. Shaffer. Department of Computer Science Virginia Tech Blacksburg, Virginia Copyright c 2015 by Clifford A. Shaffer Computer Science Title page Computer Science Clifford A. Shaffer Fall 2015 Clifford A. Shaffer

More information

2.830 Homework #6. April 2, 2009

2.830 Homework #6. April 2, 2009 2.830 Homework #6 Dayán Páez April 2, 2009 1 ANOVA The data for four different lithography processes, along with mean and standard deviations are shown in Table 1. Assume a null hypothesis of equality.

More information

USE OF COMPUTER EXPERIMENTS TO STUDY THE QUALITATIVE BEHAVIOR OF SOLUTIONS OF SECOND ORDER NEUTRAL DIFFERENTIAL EQUATIONS

USE OF COMPUTER EXPERIMENTS TO STUDY THE QUALITATIVE BEHAVIOR OF SOLUTIONS OF SECOND ORDER NEUTRAL DIFFERENTIAL EQUATIONS USE OF COMPUTER EXPERIMENTS TO STUDY THE QUALITATIVE BEHAVIOR OF SOLUTIONS OF SECOND ORDER NEUTRAL DIFFERENTIAL EQUATIONS Seshadev Padhi, Manish Trivedi and Soubhik Chakraborty* Department of Applied Mathematics

More information

FRACTIONAL REPLICATION

FRACTIONAL REPLICATION FRACTIONAL REPLICATION M.L.Agarwal Department of Statistics, University of Delhi, Delhi -. In a factorial experiment, when the number of treatment combinations is very large, it will be beyond the resources

More information

IE 361 Exam 1 October 2004 Prof. Vardeman

IE 361 Exam 1 October 2004 Prof. Vardeman October 5, 004 IE 6 Exam Prof. Vardeman. IE 6 students Demerath, Gottschalk, Rodgers and Watson worked with a manufacturer on improving the consistency of several critical dimensions of a part. One of

More information

DOE Wizard Screening Designs

DOE Wizard Screening Designs DOE Wizard Screening Designs Revised: 10/10/2017 Summary... 1 Example... 2 Design Creation... 3 Design Properties... 13 Saving the Design File... 16 Analyzing the Results... 17 Statistical Model... 18

More information

Confidence Interval for the mean response

Confidence Interval for the mean response Week 3: Prediction and Confidence Intervals at specified x. Testing lack of fit with replicates at some x's. Inference for the correlation. Introduction to regression with several explanatory variables.

More information

Statistical Modelling in Stata 5: Linear Models

Statistical Modelling in Stata 5: Linear Models Statistical Modelling in Stata 5: Linear Models Mark Lunt Arthritis Research UK Epidemiology Unit University of Manchester 07/11/2017 Structure This Week What is a linear model? How good is my model? Does

More information

SMA 6304 / MIT / MIT Manufacturing Systems. Lecture 10: Data and Regression Analysis. Lecturer: Prof. Duane S. Boning

SMA 6304 / MIT / MIT Manufacturing Systems. Lecture 10: Data and Regression Analysis. Lecturer: Prof. Duane S. Boning SMA 6304 / MIT 2.853 / MIT 2.854 Manufacturing Systems Lecture 10: Data and Regression Analysis Lecturer: Prof. Duane S. Boning 1 Agenda 1. Comparison of Treatments (One Variable) Analysis of Variance

More information

Design and Analysis of Experiments 8E 2012 Montgomery

Design and Analysis of Experiments 8E 2012 Montgomery 1 Why do Fractional Factorial Designs Work? The sparsity of effects principle There may be lots of factors, but few are important System is dominated by main effects, low-order interactions The projection

More information

Confounding and Fractional Replication in Factorial Design

Confounding and Fractional Replication in Factorial Design ISSN -580 (Paper) ISSN 5-05 (Online) Vol.6, No.3, 016 onfounding and Fractional Replication in Factorial esign Layla. hmed epartment of Mathematics, ollege of Education, University of Garmian, Kurdistan

More information

Lecture 12: 2 k Factorial Design Montgomery: Chapter 6

Lecture 12: 2 k Factorial Design Montgomery: Chapter 6 Lecture 12: 2 k Factorial Design Montgomery: Chapter 6 1 Lecture 12 Page 1 2 k Factorial Design Involvingk factors: each has two levels (often labeled+and ) Very useful design for preliminary study Can

More information

Inference for Regression Simple Linear Regression

Inference for Regression Simple Linear Regression Inference for Regression Simple Linear Regression IPS Chapter 10.1 2009 W.H. Freeman and Company Objectives (IPS Chapter 10.1) Simple linear regression p Statistical model for linear regression p Estimating

More information

Example: Four levels of herbicide strength in an experiment on dry weight of treated plants.

Example: Four levels of herbicide strength in an experiment on dry weight of treated plants. The idea of ANOVA Reminders: A factor is a variable that can take one of several levels used to differentiate one group from another. An experiment has a one-way, or completely randomized, design if several

More information

Soo King Lim Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7: Figure 8: Figure 9: Figure 10: Figure 11: Figure 12: Figure 13:

Soo King Lim Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7: Figure 8: Figure 9: Figure 10: Figure 11: Figure 12: Figure 13: 1.0 ial Experiment Design by Block... 3 1.1 ial Experiment in Incomplete Block... 3 1. ial Experiment with Two Blocks... 3 1.3 ial Experiment with Four Blocks... 5 Example 1... 6.0 Fractional ial Experiment....1

More information

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 2.830J / 6.780J / ESD.63J Control of Processes (SMA 6303) Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

Inferences for Regression

Inferences for Regression Inferences for Regression An Example: Body Fat and Waist Size Looking at the relationship between % body fat and waist size (in inches). Here is a scatterplot of our data set: Remembering Regression In

More information

On the Compounds of Hat Matrix for Six-Factor Central Composite Design with Fractional Replicates of the Factorial Portion

On the Compounds of Hat Matrix for Six-Factor Central Composite Design with Fractional Replicates of the Factorial Portion American Journal of Computational and Applied Mathematics 017, 7(4): 95-114 DOI: 10.593/j.ajcam.0170704.0 On the Compounds of Hat Matrix for Six-Factor Central Composite Design with Fractional Replicates

More information

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008

2.830J / 6.780J / ESD.63J Control of Manufacturing Processes (SMA 6303) Spring 2008 MIT OpenCourseWare http://ocw.mit.edu 2.830J / 6.780J / ESD.63J Control of Processes (SMA 6303) Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.

More information

Correlation Analysis

Correlation Analysis Simple Regression Correlation Analysis Correlation analysis is used to measure strength of the association (linear relationship) between two variables Correlation is only concerned with strength of the

More information

Contents. TAMS38 - Lecture 8 2 k p fractional factorial design. Lecturer: Zhenxia Liu. Example 0 - continued 4. Example 0 - Glazing ceramic 3

Contents. TAMS38 - Lecture 8 2 k p fractional factorial design. Lecturer: Zhenxia Liu. Example 0 - continued 4. Example 0 - Glazing ceramic 3 Contents TAMS38 - Lecture 8 2 k p fractional factorial design Lecturer: Zhenxia Liu Department of Mathematics - Mathematical Statistics Example 0 2 k factorial design with blocking Example 1 2 k p fractional

More information

10.0 REPLICATED FULL FACTORIAL DESIGN

10.0 REPLICATED FULL FACTORIAL DESIGN 10.0 REPLICATED FULL FACTORIAL DESIGN (Updated Spring, 001) Pilot Plant Example ( 3 ), resp - Chemical Yield% Lo(-1) Hi(+1) Temperature 160 o 180 o C Concentration 10% 40% Catalyst A B Test# Temp Conc

More information

. Example: For 3 factors, sse = (y ijkt. " y ijk

. Example: For 3 factors, sse = (y ijkt.  y ijk ANALYSIS OF BALANCED FACTORIAL DESIGNS Estimates of model parameters and contrasts can be obtained by the method of Least Squares. Additional constraints must be added to estimate non-estimable parameters.

More information

7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology)

7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology) 7. Response Surface Methodology (Ch.10. Regression Modeling Ch. 11. Response Surface Methodology) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University 1 Introduction Response surface methodology,

More information

df=degrees of freedom = n - 1

df=degrees of freedom = n - 1 One sample t-test test of the mean Assumptions: Independent, random samples Approximately normal distribution (from intro class: σ is unknown, need to calculate and use s (sample standard deviation)) Hypotheses:

More information

Solutions to Exercises

Solutions to Exercises 1 c Atkinson et al 2007, Optimum Experimental Designs, with SAS Solutions to Exercises 1. and 2. Certainly, the solutions to these questions will be different for every reader. Examples of the techniques

More information

Lecture 1 Linear Regression with One Predictor Variable.p2

Lecture 1 Linear Regression with One Predictor Variable.p2 Lecture Linear Regression with One Predictor Variablep - Basics - Meaning of regression parameters p - β - the slope of the regression line -it indicates the change in mean of the probability distn of

More information

Applied Multivariate Statistical Modeling Prof. J. Maiti Department of Industrial Engineering and Management Indian Institute of Technology, Kharagpur

Applied Multivariate Statistical Modeling Prof. J. Maiti Department of Industrial Engineering and Management Indian Institute of Technology, Kharagpur Applied Multivariate Statistical Modeling Prof. J. Maiti Department of Industrial Engineering and Management Indian Institute of Technology, Kharagpur Lecture - 29 Multivariate Linear Regression- Model

More information

Reference: Chapter 8 of Montgomery (8e)

Reference: Chapter 8 of Montgomery (8e) Reference: Chapter 8 of Montgomery (8e) 69 Maghsoodloo Fractional Factorials (or Replicates) For Base 2 Designs As the number of factors in a 2 k factorial experiment increases, the number of runs (or

More information

9. Linear Regression and Correlation

9. Linear Regression and Correlation 9. Linear Regression and Correlation Data: y a quantitative response variable x a quantitative explanatory variable (Chap. 8: Recall that both variables were categorical) For example, y = annual income,

More information

Statistics GIDP Ph.D. Qualifying Exam Methodology May 26 9:00am-1:00pm

Statistics GIDP Ph.D. Qualifying Exam Methodology May 26 9:00am-1:00pm Statistics GIDP Ph.D. Qualifying Exam Methodology May 26 9:00am-1:00pm Instructions: Put your ID (not name) on each sheet. Complete exactly 5 of 6 problems; turn in only those sheets you wish to have graded.

More information

Data Set 1A: Algal Photosynthesis vs. Salinity and Temperature

Data Set 1A: Algal Photosynthesis vs. Salinity and Temperature Data Set A: Algal Photosynthesis vs. Salinity and Temperature Statistical setting These data are from a controlled experiment in which two quantitative variables were manipulated, to determine their effects

More information

Design and Analysis of Experiments Prof. Jhareshwar Maiti Department of Industrial and Systems Engineering Indian Institute of Technology, Kharagpur

Design and Analysis of Experiments Prof. Jhareshwar Maiti Department of Industrial and Systems Engineering Indian Institute of Technology, Kharagpur Design and Analysis of Experiments Prof. Jhareshwar Maiti Department of Industrial and Systems Engineering Indian Institute of Technology, Kharagpur Lecture 51 Plackett Burman Designs Hello, welcome. We

More information