Stat 579: Generalized Linear Models and Extensions
|
|
- Shon Maxwell
- 5 years ago
- Views:
Transcription
1 Stat 579: Generalized Linear Models and Extensions Mixed models Yan Lu Feb, 2018, week 7 1 / 17
2 Some commonly used experimental designs related to mixed models Two way or three way random/mixed effects Randomized complete block designs Nested design Split plot designs Repeated measures, longitudinal data 2 / 17
3 Two way random effects model, A and B both random y ij = µ + α i + β j + ɛ ij, i = 1,, a, j = 1,, b one observation per combination, n T = ab iid α i N(0, σ 2 a ) iid β j N(0, σ 2 b ) iid ɛ ij N(0, σ 2 ) 3 / 17
4 Two way mixed effects model, A fixed, B random A and B crossed, h observations each cell y ijk = µ + α i + β j + (αβ) ij + ɛ ijk i = 1,, a, j = 1,, b, k = 1,, n, n T = abn α i are constants subject to the restriction a i=1 α i = 0 β j iid N(0, σ 2 b ) (αβ) ij iid N(0, σ 2 ab ) ɛ ijk iid N(0, σ 2 ) 4 / 17
5 4/42 Example 1: small factorial (From Paul Darius s slides, slightly adapted.) A field experiment is to be conducted using all combinations of three varieties (of some cereal) and two methods of fertilization. Each combination will replicated four times, so that 24 plots of land (observational units) are needed.
6 4/42 Example 1: small factorial (From Paul Darius s slides, slightly adapted.) A field experiment is to be conducted using all combinations of three varieties (of some cereal) and two methods of fertilization. Each combination will replicated four times, so that 24 plots of land (observational units) are needed. Factor Number Levels of levels Variety (A) 3 A1, A2, A3
7 4/42 Example 1: small factorial (From Paul Darius s slides, slightly adapted.) A field experiment is to be conducted using all combinations of three varieties (of some cereal) and two methods of fertilization. Each combination will replicated four times, so that 24 plots of land (observational units) are needed. Factor Number Levels of levels Variety (A) 3 A1, A2, A3 Method of Fertilization (B) 2 B1, B2
8 4/42 Example 1: small factorial (From Paul Darius s slides, slightly adapted.) A field experiment is to be conducted using all combinations of three varieties (of some cereal) and two methods of fertilization. Each combination will replicated four times, so that 24 plots of land (observational units) are needed. Factor Number Levels of levels Variety (A) 3 A1, A2, A3 Method of Fertilization (B) 2 B1, B2 Observational unit 24 1, 2, 3, 4, 5,..., 24
9 10/42 From Hasse diagram to degrees of freedom to anova U A B A B E
10 10/42 From Hasse diagram to degrees of freedom to anova 1 U 3 A B 2 6 A B 24 E Show the number of levels of each factor.
11 10/42 From Hasse diagram to degrees of freedom to anova 1, 1 U 3 A B 2 6 A B 24 E Show the number of levels of each factor. Calculate degrees of freedom recursively by subtraction.
12 10/42 From Hasse diagram to degrees of freedom to anova 1, 1 U 3, 2 A B 2 6 A B 24 E Show the number of levels of each factor. Calculate degrees of freedom recursively by subtraction.
13 10/42 From Hasse diagram to degrees of freedom to anova 1, 1 U 3, 2 A B 2, 1 6 A B 24 E Show the number of levels of each factor. Calculate degrees of freedom recursively by subtraction.
14 10/42 From Hasse diagram to degrees of freedom to anova 1, 1 U 3, 2 A B 2, 1 6, 2 A B 24 E Show the number of levels of each factor. Calculate degrees of freedom recursively by subtraction.
15 10/42 From Hasse diagram to degrees of freedom to anova 1, 1 U 3, 2 A B 2, 1 6, 2 A B 24, 18 E Show the number of levels of each factor. Calculate degrees of freedom recursively by subtraction.
16 10/42 From Hasse diagram to degrees of freedom to anova 1, 1 U 3, 2 A B 2, 1 6, 2 A B Skeleton analysis of variance Stratum Source df U Mean 1 E A 2 B 1 A B 2 residual 18 24, 18 E Show the number of levels of each factor. Calculate degrees of freedom recursively by subtraction. Each gives a stratum (eigenspace of the covariance matrix).
17 10/42 From Hasse diagram to degrees of freedom to anova 1, 1 U 3, 2 A B 2, 1 6, 2 A B Skeleton analysis of variance Stratum Source df U Mean 1 E A 2 B 1 A B 2 residual 18 24, 18 E Show the number of levels of each factor. Calculate degrees of freedom recursively by subtraction. Each gives a stratum (eigenspace of the covariance matrix). Each gives a source for a fixed effect, contained in the stratum given by the highest below or equal to it.
18 From Hasse diagram to degrees of freedom to anova 1, 1 U 3, 2 A B 2, 1 6, 2 A B Skeleton analysis of variance Stratum Source df U Mean 1 E A 2 B 1 A B 2 residual 18 24, 18 E Show the number of levels of each factor. Calculate degrees of freedom recursively by subtraction. Each gives a stratum (eigenspace of the covariance matrix). Each gives a source for a fixed effect, contained in the stratum given by the highest below or equal to it. shows a stratum with no residual. 10/42
19 Example: Miles per gallon An automobile manufacturer wished to study the effects of factors A and B on gasoline consumption. Factor A: Drivers, two drivers are selected at random Factor B: Cars, two cars of the same model with manual transmission were randomly selected from the assembly line. Each driver drove each car twice over a 40-mile test course and the miles per gallon were recorded. y ijk = µ + α i + β j + (αβ) ij + ɛ ijk i = 1, 2, j = 1, 2, k = 1, 2, n T = 8 β = µ, X = 1 8 α = (α 1, α 2, β 1, β 2, (αβ) 11, (αβ) 12, (αβ) 21, (αβ) 22 ) 5 / 17
20 ( α1 a = α 2 Z = ) ( β1, b = β 2 ), c = (αβ) 11 (αβ) 12 (αβ) 21 (αβ) 22, Z = Z 1 a + Z 2 b + Z 3 c ( I2 1 = I a + 2 I ) b + I c 6 / 17
21 Kronecker product: A m n, B p q a 11 B a 1n B A B =. a m1 B a mn B mp nq 7 / 17
22 R = I 8 σ 2 Var(y) = Var(Xβ + Zα + ɛ) Assume α i iid N(0, σ 2 a ), β j iid N(0, σ 2 b ), (αβ) ij iid N(0, σ 2 ab ), ɛ ij iid N(0, σ 2 ) G 8 8 = Var(α) = σ 2 a σ 2 a σ 2 b σ 2 b σ 2 ab σ 2 ab σ 2 ab σ 2 ab = ZVar(α)Z + Var(ɛ) = ZGZ + R 8 / 17
23 Randomized complete block designs Example: boy s shoes. Goal: want to know effect of materials A and B Paired experiments boy 1 has A on both feet, boy 2 has B on both feet, huge variability from boy to boy Unpaired experiments removes boy-to-boy variability block: boys treatment: A and B Left foot Right foot boy 1 A B boy 2 B A. boy n A B 9 / 17
24 Randomized complete block designs Each treatment is included once in each block Randomization is done within each block, this is a restricted randomization design -complete: each treatment occurs within each block -block: usually random, not of interest - treatment: fixed, of interest Purpose of blocking: sort experimental units into groups within each of which the elements are homogeneous with respect to the response variable, differences between groups are as great as possible. 10 / 17
25 Model: y ij = µ + ρ i + τ j + ɛ ij, i = 1,, m, j = 1,, r i: block, ρ i block effect j: treatment, τ j treatment effect ρ i iid N(0, σ 2 ρ ), ɛ ij iid N(0, σ 2 ) τ j constants, r j=1 τ j = 0 α = ρ 1 ρ 2. ρ m, β = τ 1 τ 2. τ r 11 / 17
26 Example from Paul Darius s A field experiment is to be conducted using a block design the field is divided into 4 blocks within each block, the experiment was conducted randomly using all combinations of factor A: three varieties (of some cereal) factor B: two methods of fertilization. A total of 24 observations available for experiment. 12 / 17
27 19/42 Variant of Example 1: blocks The field is divided into 4 blocks of 6 observational units each, to take account of known or suspected differences in the soil.
28 19/42 Variant of Example 1: blocks The field is divided into 4 blocks of 6 observational units each, to take account of known or suspected differences in the soil. To be able extrapolate our results to other plots in other fields, we need to assume that there is no interaction between the factor Block and the factor Treatment (where Treatment = A B).
29 19/42 Variant of Example 1: blocks The field is divided into 4 blocks of 6 observational units each, to take account of known or suspected differences in the soil. To be able extrapolate our results to other plots in other fields, we need to assume that there is no interaction between the factor Block and the factor Treatment (where Treatment = A B). So we do not include factors Block Treatment or Block A or Block B.
30 20/42 From Hasse diagram to degrees of freedom to anova Block 4, 3 1, 1 U 3, 2 A B 2, 1 6, 2 A B 24, 15 E
31 20/42 From Hasse diagram to degrees of freedom to anova Skeleton analysis of variance Block 4, 3 1, 1 U 3, 2 A B 2, 1 6, 2 A B 24, 15 E Stratum Source df U Mean 1 Block 3 E A 2 B 1 A B 2 residual 15
32 Split plot designs Split plot designs are originally developed for agriculture, and are frequently used in field, laboratory, industrial and social science experiments. Consider an investigation to study the effects of two irrigation methods (factor A) and two fertilizers (factor B) on yield of a crop, using four available fields as experimental units. 1. Completely randomized design A 1 B 1, A 1 B 2, A 2 B 1, A 2 B 2 would then be assigned at random to the four fields, no degrees of freedom 2. Consider split plot design: each of the two irrigation methods is randomly assigned to two of the four fields, called whole plots each whole plots are divided into two or more smaller areas called split plots two fertilizers are randomly assigned to the split plots within each whole plot 13 / 17
33 Model y ijk = µ + ρ i(j) + α j + β k + (αβ) jk + ɛ ijk i : whole plot, i = 1, 2, 3, 4 j: irrigation j = 1, 2 k = 1, 2, fertilizer α j : main effect of the jth irrigation method (jth whole plot treatment) β k : kth split plot treatment, main effect of the kth fertilizer ρ i(j) : effect of the ith whole plot, nested within the jth level of factor A (irrigation method) Two-stage of randomization 1. whole-plot treatments are randomly assigned to whole plots 2. split-plot treatments are randomly assigned to split plots 3. can be viewed as a type of incomplete block design, whole plots blocks, each whole plot being given only some of the full set of treatment 14 / 17
34 Example from Paul Darius s Consider an investigation to study the effects of two irrigation methods (factor I) and two fertilizers (factor F) on yield of a crop, using 8 available fields as experimental units. each of the two irrigation methods is randomly assigned to 4 of the 8 fields, called whole plots each whole plots are divided into two or more smaller areas called split plots two fertilizers are randomly assigned to the split plots within each whole plot 15 / 17
35 26/42 Example 3: Split plots (From Paul Darius s slides, slightly adapted.) A field trial is planned to study the effect of 2 irrigation methods (factor I) and 2 fertilizers (factor F). To irrigate a plot with a sprinkler without water spilling into the next plot, we need large plots, and there is room for only 8. Fertilizer can be applied to much smaller areas, so we can divide each plot into two subplots, one for each level of F.
36 26/42 Example 3: Split plots (From Paul Darius s slides, slightly adapted.) A field trial is planned to study the effect of 2 irrigation methods (factor I) and 2 fertilizers (factor F). To irrigate a plot with a sprinkler without water spilling into the next plot, we need large plots, and there is room for only 8. Fertilizer can be applied to much smaller areas, so we can divide each plot into two subplots, one for each level of F. I1, F1 I2, F2 I2, F2 I2, F1 I1, F1 I2, F2 I1, F1 I1, F2 I1, F2 I2, F1 I2, F1 I2, F2 I1, F2 I2, F1 I1, F2 I1, F1
37 27/42 Example 2: Hasse diagram and skeleton anova 1, 1 U 2, 1 I F 2, 1 Plot 8, 6 4, 1 I F 16, 6 E
38 27/42 Example 2: Hasse diagram and skeleton anova 1, 1 U 2, 1 I F 2, 1 Plot 8, 6 4, 1 I F 16, 6 E Skeleton analysis of variance Stratum Source df U Mean 1 Plots I 1 residual 6 E F 1 I F 1 residual 6
39 27/42 Example 2: Hasse diagram and skeleton anova 1, 1 U 2, 1 I F 2, 1 Plot 8, 6 4, 1 I F 16, 6 E Skeleton analysis of variance Stratum Source df U Mean 1 Plots I 1 residual 6 E F 1 I F 1 residual 6 Treatment = I F Plot Treatment = I
40 Example: repeated measures A: two types of incentives, on a persons ability to solve problem B: two types of problems, abstract and concrete problems each experimental subject could be asked to do each type of problem but could not be exposed to more than one type of incentive stimulus, because of potential interference effects 16 / 17
41 Incentive stimulus Subject Treatment order 1 2 A 1 1 A 1 B 1 A 1 B 2 2 A 1 B 2 A 1 B 1. n A 1 B 1 A 1 B 2 A 2 n+1 A 2 B 1 A 2 B 2 n+2 A 2 B 1 A 2 B 2. 2n A 2 B 2 A 2 B 1 Whole plot: subject, whole plot treatment: A 1 and A 2 Split plot: treatment orders 1 and 2, split plot treatment: B 1 and B 2 17 / 17
ETH p. 1/21. Split Plot Designs. Large and small units Confounding main effects Repeated measures anova
ETH p 1/21 Split Plot Designs Large and small units Confounding main effects Repeated measures anova ETH p 2/21 Study in Dental Medicine Can measurement of electric resistance help in detecting tooth decay?
More informationFactorial Treatment Structure: Part I. Lukas Meier, Seminar für Statistik
Factorial Treatment Structure: Part I Lukas Meier, Seminar für Statistik Factorial Treatment Structure So far (in CRD), the treatments had no structure. So called factorial treatment structure exists if
More informationRandom and Mixed Effects Models - Part II
Random and Mixed Effects Models - Part II Statistics 149 Spring 2006 Copyright 2006 by Mark E. Irwin Two-Factor Random Effects Model Example: Miles per Gallon (Neter, Kutner, Nachtsheim, & Wasserman, problem
More information3. Factorial Experiments (Ch.5. Factorial Experiments)
3. Factorial Experiments (Ch.5. Factorial Experiments) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University DOE and Optimization 1 Introduction to Factorials Most experiments for process
More informationStat 705: Completely randomized and complete block designs
Stat 705: Completely randomized and complete block designs Timothy Hanson Department of Statistics, University of South Carolina Stat 705: Data Analysis II 1 / 16 Experimental design Our department offers
More informationLec 5: Factorial Experiment
November 21, 2011 Example Study of the battery life vs the factors temperatures and types of material. A: Types of material, 3 levels. B: Temperatures, 3 levels. Example Study of the battery life vs the
More informationNested Designs & Random Effects
Nested Designs & Random Effects Timothy Hanson Department of Statistics, University of South Carolina Stat 506: Introduction to Design of Experiments 1 / 17 Bottling plant production A production engineer
More informationStat 217 Final Exam. Name: May 1, 2002
Stat 217 Final Exam Name: May 1, 2002 Problem 1. Three brands of batteries are under study. It is suspected that the lives (in weeks) of the three brands are different. Five batteries of each brand are
More informationLecture 10. Factorial experiments (2-way ANOVA etc)
Lecture 10. Factorial experiments (2-way ANOVA etc) Jesper Rydén Matematiska institutionen, Uppsala universitet jesper@math.uu.se Regression and Analysis of Variance autumn 2014 A factorial experiment
More informationTwo-Way Factorial Designs
81-86 Two-Way Factorial Designs Yibi Huang 81-86 Two-Way Factorial Designs Chapter 8A - 1 Problem 81 Sprouting Barley (p166 in Oehlert) Brewer s malt is produced from germinating barley, so brewers like
More informationStatistics Masters Comprehensive Exam March 21, 2003
Statistics Masters Comprehensive Exam March 21, 2003 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your answer
More informationSTAT22200 Spring 2014 Chapter 8A
STAT22200 Spring 2014 Chapter 8A Yibi Huang May 13, 2014 81-86 Two-Way Factorial Designs Chapter 8A - 1 Problem 81 Sprouting Barley (p166 in Oehlert) Brewer s malt is produced from germinating barley,
More informationPROBLEM TWO (ALKALOID CONCENTRATIONS IN TEA) 1. Statistical Design
PROBLEM TWO (ALKALOID CONCENTRATIONS IN TEA) 1. Statistical Design The purpose of this experiment was to determine differences in alkaloid concentration of tea leaves, based on herb variety (Factor A)
More informationAnalysis of Variance and Co-variance. By Manza Ramesh
Analysis of Variance and Co-variance By Manza Ramesh Contents Analysis of Variance (ANOVA) What is ANOVA? The Basic Principle of ANOVA ANOVA Technique Setting up Analysis of Variance Table Short-cut Method
More information11. Linear Mixed-Effects Models. Copyright c 2018 Dan Nettleton (Iowa State University) 11. Statistics / 49
11. Linear Mixed-Effects Models Copyright c 2018 Dan Nettleton (Iowa State University) 11. Statistics 510 1 / 49 The Linear Mixed-Effects Model y = Xβ + Zu + e X is an n p matrix of known constants β R
More informationSolution to Final Exam
Stat 660 Solution to Final Exam. (5 points) A large pharmaceutical company is interested in testing the uniformity (a continuous measurement that can be taken by a measurement instrument) of their film-coated
More informationTopic 32: Two-Way Mixed Effects Model
Topic 3: Two-Way Mixed Effects Model Outline Two-way mixed models Three-way mixed models Data for two-way design Y is the response variable Factor A with levels i = 1 to a Factor B with levels j = 1 to
More informationLecture 11: Nested and Split-Plot Designs
Lecture 11: Nested and Split-Plot Designs Montgomery, Chapter 14 1 Lecture 11 Page 1 Crossed vs Nested Factors Factors A (a levels)and B (b levels) are considered crossed if Every combinations of A and
More informationFactorial designs. Experiments
Chapter 5: Factorial designs Petter Mostad mostad@chalmers.se Experiments Actively making changes and observing the result, to find causal relationships. Many types of experimental plans Measuring response
More informationStatistics 512: Applied Linear Models. Topic 9
Topic Overview Statistics 51: Applied Linear Models Topic 9 This topic will cover Random vs. Fixed Effects Using E(MS) to obtain appropriate tests in a Random or Mixed Effects Model. Chapter 5: One-way
More informationKey Features: More than one type of experimental unit and more than one randomization.
1 SPLIT PLOT DESIGNS Key Features: More than one type of experimental unit and more than one randomization. Typical Use: When one factor is difficult to change. Example (and terminology): An agricultural
More informationStat 511 HW#10 Spring 2003 (corrected)
Stat 511 HW#10 Spring 003 (corrected) 1. Below is a small set of fake unbalanced -way factorial (in factors A and B) data from (unbalanced) blocks. Level of A Level of B Block Response 1 1 1 9.5 1 1 11.3
More informationTopic 9: Factorial treatment structures. Introduction. Terminology. Example of a 2x2 factorial
Topic 9: Factorial treatment structures Introduction A common objective in research is to investigate the effect of each of a number of variables, or factors, on some response variable. In earlier times,
More informationLinear Mixed-Effects Models. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 34
Linear Mixed-Effects Models Copyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 34 The Linear Mixed-Effects Model y = Xβ + Zu + e X is an n p design matrix of known constants β R
More informationBlocks are formed by grouping EUs in what way? How are experimental units randomized to treatments?
VI. Incomplete Block Designs A. Introduction What is the purpose of block designs? Blocks are formed by grouping EUs in what way? How are experimental units randomized to treatments? 550 What if we have
More informationMEMORIAL UNIVERSITY OF NEWFOUNDLAND DEPARTMENT OF MATHEMATICS AND STATISTICS FINAL EXAM - STATISTICS FALL 1999
MEMORIAL UNIVERSITY OF NEWFOUNDLAND DEPARTMENT OF MATHEMATICS AND STATISTICS FINAL EXAM - STATISTICS 350 - FALL 1999 Instructor: A. Oyet Date: December 16, 1999 Name(Surname First): Student Number INSTRUCTIONS
More information8/04/2011. last lecture: correlation and regression next lecture: standard MR & hierarchical MR (MR = multiple regression)
psyc3010 lecture 7 analysis of covariance (ANCOVA) last lecture: correlation and regression next lecture: standard MR & hierarchical MR (MR = multiple regression) 1 announcements quiz 2 correlation and
More information21.0 Two-Factor Designs
21.0 Two-Factor Designs Answer Questions 1 RCBD Concrete Example Two-Way ANOVA Popcorn Example 21.4 RCBD 2 The Randomized Complete Block Design is also known as the two-way ANOVA without interaction. A
More information20.0 Experimental Design
20.0 Experimental Design Answer Questions 1 Philosophy One-Way ANOVA Egg Sample Multiple Comparisons 20.1 Philosophy Experiments are often expensive and/or dangerous. One wants to use good techniques that
More informationDesign and Analysis of Experiments. David Yanez Department of Biostatistics University of Washington
Design and Analysis of Experiments David Yanez Department of Biostatistics University of Washington Outline Basic Ideas Definitions Structures of an Experimental Design Design Structure Treatment Structure
More information44.2. Two-Way Analysis of Variance. Introduction. Prerequisites. Learning Outcomes
Two-Way Analysis of Variance 44 Introduction In the one-way analysis of variance (Section 441) we consider the effect of one factor on the values taken by a variable Very often, in engineering investigations,
More informationSTAT 135 Lab 10 Two-Way ANOVA, Randomized Block Design and Friedman s Test
STAT 135 Lab 10 Two-Way ANOVA, Randomized Block Design and Friedman s Test Rebecca Barter April 13, 2015 Let s now imagine a dataset for which our response variable, Y, may be influenced by two factors,
More informationStat 579: Generalized Linear Models and Extensions
Stat 579: Generalized Linear Models and Extensions Linear Mixed Models for Longitudinal Data Yan Lu April, 2018, week 15 1 / 38 Data structure t1 t2 tn i 1st subject y 11 y 12 y 1n1 Experimental 2nd subject
More informationThe Random Effects Model Introduction
The Random Effects Model Introduction Sometimes, treatments included in experiment are randomly chosen from set of all possible treatments. Conclusions from such experiment can then be generalized to other
More informationFigure 9.1: A Latin square of order 4, used to construct four types of design
152 Chapter 9 More about Latin Squares 9.1 Uses of Latin squares Let S be an n n Latin square. Figure 9.1 shows a possible square S when n = 4, using the symbols 1, 2, 3, 4 for the letters. Such a Latin
More informationReference: Chapter 14 of Montgomery (8e)
Reference: Chapter 14 of Montgomery (8e) 99 Maghsoodloo The Stage Nested Designs So far emphasis has been placed on factorial experiments where all factors are crossed (i.e., it is possible to study the
More informationRCB - Example. STA305 week 10 1
RCB - Example An accounting firm wants to select training program for its auditors who conduct statistical sampling as part of their job. Three training methods are under consideration: home study, presentations
More informationExercise.13 Formation of ANOVA table for Latin square design (LSD) and comparison of means using critical difference values
xercise.13 Formation of NOV table for Latin square design (LS) and comparison of means using critical difference values Latin Square esign When the experimental material is divided into rows and columns
More informationStat 579: Generalized Linear Models and Extensions
Stat 579: Generalized Linear Models and Extensions Linear Mixed Models for Longitudinal Data Yan Lu April, 2018, week 12 1 / 34 Correlated data multivariate observations clustered data repeated measurement
More informationSTA 111: Probability & Statistical Inference
STA 111: Probability & Statistical Inference Lecture Twenty Analysis of Variance D.S. Sections 11.6, 11.7 & 11.8 Instructor: Olanrewaju Michael Akande Department of Statistical Science, Duke University
More informationSTAT Final Practice Problems
STAT 48 -- Final Practice Problems.Out of 5 women who had uterine cancer, 0 claimed to have used estrogens. Out of 30 women without uterine cancer 5 claimed to have used estrogens. Exposure Outcome (Cancer)
More informationFactorial BG ANOVA. Psy 420 Ainsworth
Factorial BG ANOVA Psy 420 Ainsworth Topics in Factorial Designs Factorial? Crossing and Nesting Assumptions Analysis Traditional and Regression Approaches Main Effects of IVs Interactions among IVs Higher
More informationEXST 7015 Fall 2014 Lab 11: Randomized Block Design and Nested Design
EXST 7015 Fall 2014 Lab 11: Randomized Block Design and Nested Design OBJECTIVES: The objective of an experimental design is to provide the maximum amount of reliable information at the minimum cost. In
More informationREPEATED MEASURES. Copyright c 2012 (Iowa State University) Statistics / 29
REPEATED MEASURES Copyright c 2012 (Iowa State University) Statistics 511 1 / 29 Repeated Measures Example In an exercise therapy study, subjects were assigned to one of three weightlifting programs i=1:
More informationDesign and Analysis of Experiments
Design and Analysis of Experiments Part VIII: Plackett-Burman, 3 k, Mixed Level, Nested, and Split-Plot Designs Prof. Dr. Anselmo E de Oliveira anselmo.quimica.ufg.br anselmo.disciplinas@gmail.com Plackett-Burman
More informationAnalysis of Variance
Analysis of Variance Blood coagulation time T avg A 62 60 63 59 61 B 63 67 71 64 65 66 66 C 68 66 71 67 68 68 68 D 56 62 60 61 63 64 63 59 61 64 Blood coagulation time A B C D Combined 56 57 58 59 60 61
More informationFormula for the t-test
Formula for the t-test: How the t-test Relates to the Distribution of the Data for the Groups Formula for the t-test: Formula for the Standard Error of the Difference Between the Means Formula for the
More informationWhat If There Are More Than. Two Factor Levels?
What If There Are More Than Chapter 3 Two Factor Levels? Comparing more that two factor levels the analysis of variance ANOVA decomposition of total variability Statistical testing & analysis Checking
More informationChapter 4: Randomized Blocks and Latin Squares
Chapter 4: Randomized Blocks and Latin Squares 1 Design of Engineering Experiments The Blocking Principle Blocking and nuisance factors The randomized complete block design or the RCBD Extension of the
More informationAnalysis of Variance and Design of Experiments-I
Analysis of Variance and Design of Experiments-I MODULE VIII LECTURE - 35 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS MODEL Dr. Shalabh Department of Mathematics and Statistics Indian
More informationpsyc3010 lecture 2 factorial between-ps ANOVA I: omnibus tests
psyc3010 lecture 2 factorial between-ps ANOVA I: omnibus tests last lecture: introduction to factorial designs next lecture: factorial between-ps ANOVA II: (effect sizes and follow-up tests) 1 general
More information20. REML Estimation of Variance Components. Copyright c 2018 (Iowa State University) 20. Statistics / 36
20. REML Estimation of Variance Components Copyright c 2018 (Iowa State University) 20. Statistics 510 1 / 36 Consider the General Linear Model y = Xβ + ɛ, where ɛ N(0, Σ) and Σ is an n n positive definite
More informationBattery Life. Factory
Statistics 354 (Fall 2018) Analysis of Variance: Comparing Several Means Remark. These notes are from an elementary statistics class and introduce the Analysis of Variance technique for comparing several
More informationDESAIN EKSPERIMEN BLOCKING FACTORS. Semester Genap 2017/2018 Jurusan Teknik Industri Universitas Brawijaya
DESAIN EKSPERIMEN BLOCKING FACTORS Semester Genap Jurusan Teknik Industri Universitas Brawijaya Outline The Randomized Complete Block Design The Latin Square Design The Graeco-Latin Square Design Balanced
More informationWritten Exam (2 hours)
M. Müller Applied Analysis of Variance and Experimental Design Summer 2015 Written Exam (2 hours) General remarks: Open book exam. Switch off your mobile phone! Do not stay too long on a part where you
More informationTopic 12. The Split-plot Design and its Relatives (Part II) Repeated Measures [ST&D Ch. 16] 12.9 Repeated measures analysis
Topic 12. The Split-plot Design and its Relatives (Part II) Repeated Measures [ST&D Ch. 16] 12.9 Repeated measures analysis Sometimes researchers make multiple measurements on the same experimental unit.
More informationLecture 7: Latin Square and Related Design
Lecture 7: Latin Square and Related Design Montgomery: Section 4.2-4.3 Page 1 Automobile Emission Experiment Four cars and four drivers are employed in a study for possible differences between four gasoline
More informationStatistics 203 Introduction to Regression Models and ANOVA Practice Exam
Statistics 203 Introduction to Regression Models and ANOVA Practice Exam Prof. J. Taylor You may use your 4 single-sided pages of notes This exam is 7 pages long. There are 4 questions, first 3 worth 10
More informationThese are multifactor experiments that have
Design of Engineering Experiments Nested Designs Text reference, Chapter 14, Pg. 525 These are multifactor experiments that have some important industrial applications Nested and split-plot designs frequently
More informationChapter 12. Analysis of variance
Serik Sagitov, Chalmers and GU, January 9, 016 Chapter 1. Analysis of variance Chapter 11: I = samples independent samples paired samples Chapter 1: I 3 samples of equal size J one-way layout two-way layout
More informationLec 1: An Introduction to ANOVA
Ying Li Stockholm University October 31, 2011 Three end-aisle displays Which is the best? Design of the Experiment Identify the stores of the similar size and type. The displays are randomly assigned to
More informationUnbalanced Designs Mechanics. Estimate of σ 2 becomes weighted average of treatment combination sample variances.
Unbalanced Designs Mechanics Estimate of σ 2 becomes weighted average of treatment combination sample variances. Types of SS Difference depends on what hypotheses are tested and how differing sample sizes
More informationAnalysis of Variance. Read Chapter 14 and Sections to review one-way ANOVA.
Analysis of Variance Read Chapter 14 and Sections 15.1-15.2 to review one-way ANOVA. Design of an experiment the process of planning an experiment to insure that an appropriate analysis is possible. Some
More informationWhat is Experimental Design?
One Factor ANOVA What is Experimental Design? A designed experiment is a test in which purposeful changes are made to the input variables (x) so that we may observe and identify the reasons for change
More information3. Design Experiments and Variance Analysis
3. Design Experiments and Variance Analysis Isabel M. Rodrigues 1 / 46 3.1. Completely randomized experiment. Experimentation allows an investigator to find out what happens to the output variables when
More informationChapter 12 - Lecture 2 Inferences about regression coefficient
Chapter 12 - Lecture 2 Inferences about regression coefficient April 19th, 2010 Facts about slope Test Statistic Confidence interval Hypothesis testing Test using ANOVA Table Facts about slope In previous
More informationStat 6640 Solution to Midterm #2
Stat 6640 Solution to Midterm #2 1. A study was conducted to examine how three statistical software packages used in a statistical course affect the statistical competence a student achieves. At the end
More informationAnalysis of Variance
Analysis of Variance Math 36b May 7, 2009 Contents 2 ANOVA: Analysis of Variance 16 2.1 Basic ANOVA........................... 16 2.1.1 the model......................... 17 2.1.2 treatment sum of squares.................
More informationSection 7.3 Nested Design for Models with Fixed Effects, Mixed Effects and Random Effects
Section 7.3 Nested Design for Models with Fixed Effects, Mixed Effects and Random Effects 1 TABLE 25.5 Mean Square MSA MSB Expected Mean Squares for Balanced Two-Factor ANOVA Models. Fixed AN OVA Model
More informationSTAT 135 Lab 9 Multiple Testing, One-Way ANOVA and Kruskal-Wallis
STAT 135 Lab 9 Multiple Testing, One-Way ANOVA and Kruskal-Wallis Rebecca Barter April 6, 2015 Multiple Testing Multiple Testing Recall that when we were doing two sample t-tests, we were testing the equality
More informationSTAT 8200 Design of Experiments for Research Workers Lab 11 Due: Friday, Nov. 22, 2013
Example: STAT 8200 Design of Experiments for Research Workers Lab 11 Due: Friday, Nov. 22, 2013 An experiment is designed to study pigment dispersion in paint. Four different methods of mixing a particular
More informationSTAT 135 Lab 11 Tests for Categorical Data (Fisher s Exact test, χ 2 tests for Homogeneity and Independence) and Linear Regression
STAT 135 Lab 11 Tests for Categorical Data (Fisher s Exact test, χ 2 tests for Homogeneity and Independence) and Linear Regression Rebecca Barter April 20, 2015 Fisher s Exact Test Fisher s Exact Test
More informationAnalysis of Covariance
Analysis of Covariance Timothy Hanson Department of Statistics, University of South Carolina Stat 506: Introduction to Experimental Design 1 / 11 ANalysis of COVAriance Add a continuous predictor to an
More informationChapter 16. Simple Linear Regression and dcorrelation
Chapter 16 Simple Linear Regression and dcorrelation 16.1 Regression Analysis Our problem objective is to analyze the relationship between interval variables; regression analysis is the first tool we will
More informationHierarchical Linear Models
Hierarchical Linear Models Statistics 220 Spring 2005 Copyright c 2005 by Mark E. Irwin The linear regression model Hierarchical Linear Models y N(Xβ, Σ y ) β σ 2 p(β σ 2 ) σ 2 p(σ 2 ) can be extended
More informationSTAT 430 (Fall 2017): Tutorial 8
STAT 430 (Fall 2017): Tutorial 8 Balanced Incomplete Block Design Luyao Lin November 7th/9th, 2017 Department Statistics and Actuarial Science, Simon Fraser University Block Design Complete Random Complete
More informationChapter 16. Simple Linear Regression and Correlation
Chapter 16 Simple Linear Regression and Correlation 16.1 Regression Analysis Our problem objective is to analyze the relationship between interval variables; regression analysis is the first tool we will
More informationStat 579: Generalized Linear Models and Extensions
Stat 579: Generalized Linear Models and Extensions Mixed models Yan Lu March, 2018, week 8 1 / 32 Restricted Maximum Likelihood (REML) REML: uses a likelihood function calculated from the transformed set
More informationOutline Topic 21 - Two Factor ANOVA
Outline Topic 21 - Two Factor ANOVA Data Model Parameter Estimates - Fall 2013 Equal Sample Size One replicate per cell Unequal Sample size Topic 21 2 Overview Now have two factors (A and B) Suppose each
More informationLecture 9: Factorial Design Montgomery: chapter 5
Lecture 9: Factorial Design Montgomery: chapter 5 Page 1 Examples Example I. Two factors (A, B) each with two levels (, +) Page 2 Three Data for Example I Ex.I-Data 1 A B + + 27,33 51,51 18,22 39,41 EX.I-Data
More informationSplit-plot Designs. Bruce A Craig. Department of Statistics Purdue University. STAT 514 Topic 21 1
Split-plot Designs Bruce A Craig Department of Statistics Purdue University STAT 514 Topic 21 1 Randomization Defines the Design Want to study the effect of oven temp (3 levels) and amount of baking soda
More informationUnit 12: Analysis of Single Factor Experiments
Unit 12: Analysis of Single Factor Experiments Statistics 571: Statistical Methods Ramón V. León 7/16/2004 Unit 12 - Stat 571 - Ramón V. León 1 Introduction Chapter 8: How to compare two treatments. Chapter
More informationRegression Models for Quantitative and Qualitative Predictors: An Overview
Regression Models for Quantitative and Qualitative Predictors: An Overview Polynomial regression models Interaction regression models Qualitative predictors Indicator variables Modeling interactions between
More informationChap The McGraw-Hill Companies, Inc. All rights reserved.
11 pter11 Chap Analysis of Variance Overview of ANOVA Multiple Comparisons Tests for Homogeneity of Variances Two-Factor ANOVA Without Replication General Linear Model Experimental Design: An Overview
More informationBIOSTATISTICAL METHODS
BIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH Cross-over Designs #: DESIGNING CLINICAL RESEARCH The subtraction of measurements from the same subject will mostly cancel or minimize effects
More informationCategorical Predictor Variables
Categorical Predictor Variables We often wish to use categorical (or qualitative) variables as covariates in a regression model. For binary variables (taking on only 2 values, e.g. sex), it is relatively
More informationAutomatic analysis of variance for orthogonal plot structures
Automatic analysis of variance for orthogonal plot structures Heiko Grossmann Queen Mary, University of London Isaac Newton Institute Cambridge, 13 October 2011 Outline 1. Introduction 2. Theory 3. AutomaticANOVA
More informationMixed models with correlated measurement errors
Mixed models with correlated measurement errors Rasmus Waagepetersen October 9, 2018 Example from Department of Health Technology 25 subjects where exposed to electric pulses of 11 different durations
More informationDesign & Analysis of Experiments 7E 2009 Montgomery
Chapter 5 1 Introduction to Factorial Design Study the effects of 2 or more factors All possible combinations of factor levels are investigated For example, if there are a levels of factor A and b levels
More informationOpen book and notes. 120 minutes. Covers Chapters 8 through 14 of Montgomery and Runger (fourth edition).
IE 330 Seat # Open book and notes 10 minutes Covers Chapters 8 through 14 of Montgomery and Runger (fourth edition) Cover page and eight pages of exam No calculator ( points) I have, or will, complete
More informationG. Nested Designs. 1 Introduction. 2 Two-Way Nested Designs (Balanced Cases) 1.1 Definition (Nested Factors) 1.2 Notation. 1.3 Example. 2.
G. Nested Designs 1 Introduction. 1.1 Definition (Nested Factors) When each level of one factor B is associated with one and only one level of another factor A, we say that B is nested within factor A.
More informationOne-way ANOVA (Single-Factor CRD)
One-way ANOVA (Single-Factor CRD) STAT:5201 Week 3: Lecture 3 1 / 23 One-way ANOVA We have already described a completed randomized design (CRD) where treatments are randomly assigned to EUs. There is
More informationCHAPTER-V GENOTYPE-ENVIRONMENT INTERACTION: ANALYSIS FOR NEIGHBOUR EFFECTS
CHAPTER-V GENOTYPE-ENVIRONMENT INTERACTION: ANALYSIS FOR NEIGHBOUR EFFECTS 5.1 Introduction Designs of experiments deal with planning, conducting, analyzing and interpreting tests to evaluate the factors
More informationFactorial ANOVA. Psychology 3256
Factorial ANOVA Psychology 3256 Made up data.. Say you have collected data on the effects of Retention Interval 5 min 1 hr 24 hr on memory So, you do the ANOVA and conclude that RI affects memory % corr
More informationMAS353 Experimental Design
MAS353 Experimental Design M. Farrow University of Newcastle upon Tyne Semester 2, 2005-6 1 Principles of Experimental Design 1.1 Why plan experiments? Planned experiments save time and money and help
More informationPh.D. Qualifying Exam Friday Saturday, January 3 4, 2014
Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014 Put your solution to each problem on a separate sheet of paper. Problem 1. (5166) Assume that two random samples {x i } and {y i } are independently
More informationMixed Designs: Between and Within. Psy 420 Ainsworth
Mixed Designs: Between and Within Psy 420 Ainsworth Mixed Between and Within Designs Conceptualizing the Design Types of Mixed Designs Assumptions Analysis Deviation Computation Higher order mixed designs
More informationTwo-Way Analysis of Variance - no interaction
1 Two-Way Analysis of Variance - no interaction Example: Tests were conducted to assess the effects of two factors, engine type, and propellant type, on propellant burn rate in fired missiles. Three engine
More informationLatin square designs are special block designs with two blocking factors and only one treatment per block instead of every treatment per block.
G. Latin Square Designs Latin square designs are special block designs with two blocking factors and only one treatment per block instead of every treatment per block. 500 CLASSIC AG EXAMPLE: A researcher
More information