G. Nested Designs. 1 Introduction. 2 Two-Way Nested Designs (Balanced Cases) 1.1 Definition (Nested Factors) 1.2 Notation. 1.3 Example. 2.
|
|
- Mark Small
- 5 years ago
- Views:
Transcription
1 G. Nested Designs 1 Introduction. 1.1 Definition (Nested Factors) When each level of one factor B is associated with one and only one level of another factor A, we say that B is nested within factor A. 1. Notation Use BωA to denote that B is nested within factor A. 1.3 Example PVPS Example (see Two-Way Fixed-Effects ANOVA Model on pages D. & D3.). Two-Way Nested Designs (Balanced Cases).1 Definition y ijl = µ + α i + β j(i) + ε ijl, i = 1,..., a, j = 1,..., b, l = 1,..., n, where µ = overall population mean α i = ith effect of factor A β j(i) = jth level effect of factor B nested within the ith level of factor A ε ijl = error (N = abn i.i.d. N(0, σ )).. Assumptions 1. Fixed effects case: a α i = 0 (A fixed); β j(i) = 0 for each i = 1,..., a (B is fixed within each level of A).. Random effects case: {α 1,, α a } form a random sample of N(0, σa) (A random); {β 1(i),, β b(i) } form a random sample of N(0, σb ) for each i = 1,..., a (B is random within each level of A); all a + ab + abn r.v. s are independent. 3. Mixed effects model: A is fixed; B is random: a α i = 0; {β 1(i),, β b(i) } form a random sample of N(0, σb ) for each i = 1,..., a; all ab + abn r.v. s are independent. 4. (Rare, not considered here): A is random; B is fixed. G.1
2 .3 Notation y ij. = l=1 y ijl/n = average response for the jth level of B nested within the ith level of A. y i.. = l=1 y ijl/bn = average response for the ith level of A. y... = a l=1 y ijl/abn = overall sample mean..4 Sums of Squares, Mean Squares, and Computational Formulas 1. SS T = a l=1 (y ijl y... ) = a l=1 y ijl T.../abn. SS E = a l=1 (y ijl y ij. ) ; MS E = SS E /ab(n 1). 3. SS A = a nb(y i.. y... ) = a T i../nb T.../abn; = SS A /(a 1). n(y ij. y i.. ) 4. SS B(A) = a SS B(A) /a(b 1)..5 Theorems 1. SS T = SS A + SS B(A) + SS E. = a. Regardless of which model is correct (in G.): α. SS E /σ χ (ab(n 1)). β. E[MS E ] = σ. Proof: Note that SS E = a l=1 (ε ijl ε ij. )..6 Hypotheses of interest 1. { H A Test A : 0 : α i = 0, i = 1,..., a (fixed) H0 A : σa = 0 (random) T ij./n a T i../nb; =. Test BωA : { H B 0 : β j(i) = 0, i and j (fixed) H0 B : σb = 0 (random).7 Definition If A is fixed: k a = 1 a 1 a α i. If B is fixed: k b = 1 a(b 1) a β j(i). G.
3 .8 ANOVA Table E[MS] Source SS DF MS fixed random mixed (A fixed, B random) A SS A a 1 σ + nbka σ + nσb + nbσ a σ + nσb + nbk a BωA SS B(A) a(b 1) σ + nkb σ + nσb σ + nσb Residual SS E ab(n 1) MS E σ σ σ Total SS T abn 1.9 More Theorems 1. An α-level test of H B 0 : σ b = 0 or HB 0 : k b = 0 is F = MS E > F α;a(b 1),ab(n 1) regardless of which model is correct.. An α-level test of H A 0 : α i = 0, i = 1,..., a is in the fixed effects models. F = MS E > F α;a 1,ab(n 1) 3. An α-level test of H A 0 : α i = 0, i = 1,..., a is in the mixed effects model. F = 4. An α-level test of H A 0 : σ a = 0 is in the random effects model. F = > F α;a 1,a(b 1) > F α;a 1,a(b 1) 5. For the random effects model: Var(y ijl ) = σ + σ a + σ b = σ tot and the variance components are estimated as: variance component σ σ b σ a σ tot estimate ˆσ = MS E ˆσ b = ( MS E )/n ˆσ a = ( )/nb ˆσ tot = ˆσ + ˆσ b + ˆσ b proportion ˆσ /ˆσ tot ˆσ b /ˆσ tot ˆσ a/ˆσ tot of ˆσ tot G.3
4 .10 PVPS Example, revisited Consider again the PVPS Example (pp. D. & D.3) with a = schools b = 3 classes/school n = 4 students per class/school y ijl = reading achievement score Assume the following pseudo data: S 1 S C 1 C C 3 C 4 C 5 C T ij T i T... = 390 SS T = 3 4 l=1 y ijl T.../4 = /4 = = SS A = T SS B(A) = i../1 T.../4 = ( )/ = = T ij./4 T i../1 = ( )/ = SS E = SS T SS A SS B(A) = AOV Table E(MS) Source SS DF MS fixed random mixed School σ + 1 α i σ + 4σ b + 1σ a σ + 4σ b + 1 α i Class(School) σ + 3 β j(i) σ + 4σb σ + 4σb Residual σ σ σ Total Case 1: Fixed effects School: /MS E = > 4.41 = F.05;1,18 significant Class: /MS E = 5.48 >.93 = F.05;4,18 significant.. Case : Random effects School: / = = F.05;1,4 insignificant. Class: Same as case Case 3: Mixed effects School: same as case. Class: same as case 1. G.4
5 .11 Inferences About the Fixed Factor Means For the fixed effects model and the mixed effects model, we make statistical inferences about the fixed A means: µ i = µ + α i for i = 1,..., a as follows. Let L = a h iµ i be a contrast ( a h i = 0) and ˆL = a h iy i.. { a std.err(ˆl) = h i /(nb) MS E, fixed effects a h i /(nb), random effects For the stage tests of H 0 : α i = α i, the following α-level procedures are used in the α-level protected LSD tests of H0 A : α 1 = = α a = 0 y i.. y i.. > t MSE α/;ab(n 1), if fixed effects /nb y i.. y i.. > t MSB(A) α/;a(b 1), /nb if random effects In the fixed-effects model stage tests of H 0 : µ ij = µ ij H 0 : β j(i) = β j (i), comparing the nested j and j levels of B within the ith level of A, are wanted. An α-level test of H 0 : µ ij = µ ij is y ij. y ij. > t α/;ab(n 1) MS E n For the fixed-effects cases Levene s test of H 0 : σij = σ for all i = 1,..., a, and j = 1,..., b can be obtained by inputting the k = ab groups of data into AOV, where the data for the (i, j)th group is y ij1,..., y ijn with s ij = l=1 (y ijl y ij. ) /(n 1) for i = 1,..., a, and j = 1,..., b. If L-prob. is insignificant at α =.5, then the stage tests of H 0 : α i = α i and H 0 : µ ij = µ ij using MS E are valid; otherwise these procedures are not valid. For the mixed model, Levene s procedure is not valid. The test for appropriateness of the use of as the stage error-term is open for these cases..1 Spray Example We consider a study of three different sprays used on trees. Each of the three sprays was applied to four trees. After one week the concentration of nitrogen was measured in each of six leaves picked in a random way from each tree. Here the experimental units are the 1 trees; we consider them to have been chosen at random from a large population of trees. The leaves thus form four subsamples, each consisting of six leaves from a large population of leaves on the particular tree. Note that in this experiment 1 trees were sprayed and 7 leaves were picked. Each measurement of nitrogen concentration is denoted by y ijk, where i, the number of the treatment, runs from 1 to a; j, the number of the experimental unit for the ith treatment, runs from 1 to b; and k, the observation number from the jth experimental unit on the ith treatment, runs from 1 to n. y ijk : the nitrogen concentration of the kth leaf from the jth tree that received spray i. G.5
6 See computer example online..13 Proofs of Theorems in G..9 TREE SPRAY Leaf Case 1: Fixed effects model. claim #1: SS B(A) /σ χ (a(b 1), λ = a nβ j(i) /σ ): SS B(A) /σ = a n/σ (y ij. y i.. ) = a n/σ b [(β j(i) + ε ij. ) ε i.. ] = a n/σ b (X ij X i. ), where β j(i) + ε ij. = X ij, X i. = ε i.., X i1,..., X ib are independent, X ij N(β j(i), σ /n) and X i. = X ij/b. So, Q i /σ = n/σ (X ij X i. ) χ (b 1, λ i = n/σ β j(i) ) for i = 1,..., a. Since the ε ijl s are independent and Q 1,..., Q a are functions of distinct ε ijl s, Q 1,..., Q a are independent. Therefore, SS B(A) /σ = a Q i/σ = sum of a independent non-central chi-square distributions, where Q i /σ is χ (b 1, λ i ). Consequently, SS B(A) /σ χ (a(b 1), λ = a λ i) χ (a(b 1), n/σ a β j(i) ). claim #: SS B(A) /σ = n/σ a [(β j(i) + ε ij. ) ε i.. ] and SS E /σ = 1/σ a l=1 (ε ijl ε ij. ) are independent: SS B(A) = f 1 (ε ij. ε i.. ) and SS E = f (ε ijl ε ij. ). SS B(A) and SS E are independent since ε ij. ε i.. and ε ijl ε ij. are orthogonal classes of contrasts when the ε ijl s are i.i.d. (why?) The fact that /MS E is non-central F (a(b 1), ab(n 1); n/σ a β j(i) ) G.6
7 follows from the above claims. It follows that /MS E is F (a(b 1), ab(n 1)) when H0 B : β j(i) = 0, i, j. Case : Random effects model. claim #3: SS B(A) /(σ + nσ b ) χ (a(b 1)) (proof: exercise). claim #4: SS B(A) and SS E are independent under the random effects model (proof:exercise). It follows from claims #3 and #4 that MS E σ σ + nσ b F (a(b 1), ab(n 1)) and that /MS E F (a(b 1), ab(n 1)) when H0 B : σb = 0 is true. Case 3: Mixed effects model. The result for the mixed effects model holds because this is identical to the distributional properties for the random effects cases.. The distributions of and MS E under the nested model are exactly equivalent to the distributions of and MS E under the balanced two-way fixed model (completely crossed). 3. SS A = nb a (y i.. y... ) = nb a [(α i+β.(i) +ε i.. ) (β.(.) +ε... )]. y i.. s are independent N(µ + α i, σ b /b + σ /bn). So, a (y i.. y... ) σ b /b + σ /bn = SS A σ + nσ b χ nb (a 1, σ + nσb a αi ) χ (a 1, nb(a 1) k σ + nσ a) b when B(A) is random, we have SS B(A) /(σ + nσ b ) χ (a(b 1)) (claim #3 above). Finally, SS A = f 1 (β.(i) β.(.), ε i.. ε... ) and SS B(A) = f (β j(i) β.(i), ε ij. ε i.. ). It can be shown under the mixed effects model that β.(i) β.(.), ε i.. ε..., β j(i) β.(i), and ε ij. ε i.. are four orthogonal classes of r.v. s. Hence, SS A and SS B(A) are independent. Hence, F (a 1, a(b 1); nb σ + nσ b a αi ) and F (a 1, a(b 1)) under H A 0 : α 1 = = α a = 0. G.7
Solution to Final Exam
Stat 660 Solution to Final Exam. (5 points) A large pharmaceutical company is interested in testing the uniformity (a continuous measurement that can be taken by a measurement instrument) of their film-coated
More informationLecture 22 Mixed Effects Models III Nested designs
Lecture 22 Mixed Effects Models III Nested designs 94 Introduction: Crossed Designs The two-factor designs considered so far involve every level of the first factor occurring with every level of the second
More informationLec 1: An Introduction to ANOVA
Ying Li Stockholm University October 31, 2011 Three end-aisle displays Which is the best? Design of the Experiment Identify the stores of the similar size and type. The displays are randomly assigned to
More informationAnalysis of Variance
Analysis of Variance Blood coagulation time T avg A 62 60 63 59 61 B 63 67 71 64 65 66 66 C 68 66 71 67 68 68 68 D 56 62 60 61 63 64 63 59 61 64 Blood coagulation time A B C D Combined 56 57 58 59 60 61
More informationTwo-Way Factorial Designs
81-86 Two-Way Factorial Designs Yibi Huang 81-86 Two-Way Factorial Designs Chapter 8A - 1 Problem 81 Sprouting Barley (p166 in Oehlert) Brewer s malt is produced from germinating barley, so brewers like
More informationMAT3378 ANOVA Summary
MAT3378 ANOVA Summary April 18, 2016 Before you do the analysis: How many factors? (one-factor/one-way ANOVA, two-factor ANOVA etc.) Fixed or Random or Mixed effects? Crossed-factors; nested factors or
More informationUnit 7: Random Effects, Subsampling, Nested and Crossed Factor Designs
Unit 7: Random Effects, Subsampling, Nested and Crossed Factor Designs STA 643: Advanced Experimental Design Derek S. Young 1 Learning Objectives Understand how to interpret a random effect Know the different
More informationNested Designs & Random Effects
Nested Designs & Random Effects Timothy Hanson Department of Statistics, University of South Carolina Stat 506: Introduction to Design of Experiments 1 / 17 Bottling plant production A production engineer
More informationSTAT22200 Spring 2014 Chapter 8A
STAT22200 Spring 2014 Chapter 8A Yibi Huang May 13, 2014 81-86 Two-Way Factorial Designs Chapter 8A - 1 Problem 81 Sprouting Barley (p166 in Oehlert) Brewer s malt is produced from germinating barley,
More informationSummary of Chapter 7 (Sections ) and Chapter 8 (Section 8.1)
Summary of Chapter 7 (Sections 7.2-7.5) and Chapter 8 (Section 8.1) Chapter 7. Tests of Statistical Hypotheses 7.2. Tests about One Mean (1) Test about One Mean Case 1: σ is known. Assume that X N(µ, σ
More informationOutline Topic 21 - Two Factor ANOVA
Outline Topic 21 - Two Factor ANOVA Data Model Parameter Estimates - Fall 2013 Equal Sample Size One replicate per cell Unequal Sample size Topic 21 2 Overview Now have two factors (A and B) Suppose each
More informationMultiple Sample Numerical Data
Multiple Sample Numerical Data Analysis of Variance, Kruskal-Wallis test, Friedman test University of California, San Diego Instructor: Ery Arias-Castro http://math.ucsd.edu/~eariasca/teaching.html 1 /
More informationStat 6640 Solution to Midterm #2
Stat 6640 Solution to Midterm #2 1. A study was conducted to examine how three statistical software packages used in a statistical course affect the statistical competence a student achieves. At the end
More informationStatistics 512: Applied Linear Models. Topic 9
Topic Overview Statistics 51: Applied Linear Models Topic 9 This topic will cover Random vs. Fixed Effects Using E(MS) to obtain appropriate tests in a Random or Mixed Effects Model. Chapter 5: One-way
More informationSection 7.3 Nested Design for Models with Fixed Effects, Mixed Effects and Random Effects
Section 7.3 Nested Design for Models with Fixed Effects, Mixed Effects and Random Effects 1 TABLE 25.5 Mean Square MSA MSB Expected Mean Squares for Balanced Two-Factor ANOVA Models. Fixed AN OVA Model
More information3. Factorial Experiments (Ch.5. Factorial Experiments)
3. Factorial Experiments (Ch.5. Factorial Experiments) Hae-Jin Choi School of Mechanical Engineering, Chung-Ang University DOE and Optimization 1 Introduction to Factorials Most experiments for process
More informationCh 2: Simple Linear Regression
Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component
More informationOne-way ANOVA (Single-Factor CRD)
One-way ANOVA (Single-Factor CRD) STAT:5201 Week 3: Lecture 3 1 / 23 One-way ANOVA We have already described a completed randomized design (CRD) where treatments are randomly assigned to EUs. There is
More informationCentral Limit Theorem ( 5.3)
Central Limit Theorem ( 5.3) Let X 1, X 2,... be a sequence of independent random variables, each having n mean µ and variance σ 2. Then the distribution of the partial sum S n = X i i=1 becomes approximately
More informationLecture 4. Random Effects in Completely Randomized Design
Lecture 4. Random Effects in Completely Randomized Design Montgomery: 3.9, 13.1 and 13.7 1 Lecture 4 Page 1 Random Effects vs Fixed Effects Consider factor with numerous possible levels Want to draw inference
More informationSTAT 430 (Fall 2017): Tutorial 8
STAT 430 (Fall 2017): Tutorial 8 Balanced Incomplete Block Design Luyao Lin November 7th/9th, 2017 Department Statistics and Actuarial Science, Simon Fraser University Block Design Complete Random Complete
More informationAnalysis of Variance and Design of Experiments-I
Analysis of Variance and Design of Experiments-I MODULE VIII LECTURE - 35 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS MODEL Dr. Shalabh Department of Mathematics and Statistics Indian
More informationSTAT Final Practice Problems
STAT 48 -- Final Practice Problems.Out of 5 women who had uterine cancer, 0 claimed to have used estrogens. Out of 30 women without uterine cancer 5 claimed to have used estrogens. Exposure Outcome (Cancer)
More informationCh. 5 Two-way ANOVA: Fixed effect model Equal sample sizes
Ch. 5 Two-way ANOVA: Fixed effect model Equal sample sizes 1 Assumptions and models There are two factors, factors A and B, that are of interest. Factor A is studied at a levels, and factor B at b levels;
More informationNesting and Mixed Effects: Part I. Lukas Meier, Seminar für Statistik
Nesting and Mixed Effects: Part I Lukas Meier, Seminar für Statistik Where do we stand? So far: Fixed effects Random effects Both in the factorial context Now: Nested factor structure Mixed models: a combination
More informationQUEEN MARY, UNIVERSITY OF LONDON
QUEEN MARY, UNIVERSITY OF LONDON MTH634 Statistical Modelling II Solutions to Exercise Sheet 4 Octobe07. We can write (y i. y.. ) (yi. y i.y.. +y.. ) yi. y.. S T. ( Ti T i G n Ti G n y i. +y.. ) G n T
More informationDesign of Engineering Experiments Chapter 5 Introduction to Factorials
Design of Engineering Experiments Chapter 5 Introduction to Factorials Text reference, Chapter 5 page 170 General principles of factorial experiments The two-factor factorial with fixed effects The ANOVA
More informationChapter 5 Introduction to Factorial Designs
Chapter 5 Introduction to Factorial Designs 5. Basic Definitions and Principles Stud the effects of two or more factors. Factorial designs Crossed: factors are arranged in a factorial design Main effect:
More informationSAS Commands. General Plan. Output. Construct scatterplot / interaction plot. Run full model
Topic 23 - Unequal Replication Data Model Outline - Fall 2013 Parameter Estimates Inference Topic 23 2 Example Page 954 Data for Two Factor ANOVA Y is the response variable Factor A has levels i = 1, 2,...,
More informationHomework 3 - Solution
STAT 526 - Spring 2011 Homework 3 - Solution Olga Vitek Each part of the problems 5 points 1. KNNL 25.17 (Note: you can choose either the restricted or the unrestricted version of the model. Please state
More informationOutline. Topic 19 - Inference. The Cell Means Model. Estimates. Inference for Means Differences in cell means Contrasts. STAT Fall 2013
Topic 19 - Inference - Fall 2013 Outline Inference for Means Differences in cell means Contrasts Multiplicity Topic 19 2 The Cell Means Model Expressed numerically Y ij = µ i + ε ij where µ i is the theoretical
More informationSection 4.6 Simple Linear Regression
Section 4.6 Simple Linear Regression Objectives ˆ Basic philosophy of SLR and the regression assumptions ˆ Point & interval estimation of the model parameters, and how to make predictions ˆ Point and interval
More informationFactorial designs. Experiments
Chapter 5: Factorial designs Petter Mostad mostad@chalmers.se Experiments Actively making changes and observing the result, to find causal relationships. Many types of experimental plans Measuring response
More informationConfidence Intervals, Testing and ANOVA Summary
Confidence Intervals, Testing and ANOVA Summary 1 One Sample Tests 1.1 One Sample z test: Mean (σ known) Let X 1,, X n a r.s. from N(µ, σ) or n > 30. Let The test statistic is H 0 : µ = µ 0. z = x µ 0
More information2 Hand-out 2. Dr. M. P. M. M. M c Loughlin Revised 2018
Math 403 - P. & S. III - Dr. McLoughlin - 1 2018 2 Hand-out 2 Dr. M. P. M. M. M c Loughlin Revised 2018 3. Fundamentals 3.1. Preliminaries. Suppose we can produce a random sample of weights of 10 year-olds
More informationTopic 17 - Single Factor Analysis of Variance. Outline. One-way ANOVA. The Data / Notation. One way ANOVA Cell means model Factor effects model
Topic 17 - Single Factor Analysis of Variance - Fall 2013 One way ANOVA Cell means model Factor effects model Outline Topic 17 2 One-way ANOVA Response variable Y is continuous Explanatory variable is
More informationEconometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018
Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate
More informationTwo-factor studies. STAT 525 Chapter 19 and 20. Professor Olga Vitek
Two-factor studies STAT 525 Chapter 19 and 20 Professor Olga Vitek December 2, 2010 19 Overview Now have two factors (A and B) Suppose each factor has two levels Could analyze as one factor with 4 levels
More informationSTAT 135 Lab 9 Multiple Testing, One-Way ANOVA and Kruskal-Wallis
STAT 135 Lab 9 Multiple Testing, One-Way ANOVA and Kruskal-Wallis Rebecca Barter April 6, 2015 Multiple Testing Multiple Testing Recall that when we were doing two sample t-tests, we were testing the equality
More informationLecture 3. Experiments with a Single Factor: ANOVA Montgomery 3-1 through 3-3
Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3-1 through 3-3 Page 1 Tensile Strength Experiment Investigate the tensile strength of a new synthetic fiber. The factor is the weight percent
More informationOrthogonal contrasts for a 2x2 factorial design Example p130
Week 9: Orthogonal comparisons for a 2x2 factorial design. The general two-factor factorial arrangement. Interaction and additivity. ANOVA summary table, tests, CIs. Planned/post-hoc comparisons for the
More informationPROBLEM TWO (ALKALOID CONCENTRATIONS IN TEA) 1. Statistical Design
PROBLEM TWO (ALKALOID CONCENTRATIONS IN TEA) 1. Statistical Design The purpose of this experiment was to determine differences in alkaloid concentration of tea leaves, based on herb variety (Factor A)
More informationLecture 9: Factorial Design Montgomery: chapter 5
Lecture 9: Factorial Design Montgomery: chapter 5 Page 1 Examples Example I. Two factors (A, B) each with two levels (, +) Page 2 Three Data for Example I Ex.I-Data 1 A B + + 27,33 51,51 18,22 39,41 EX.I-Data
More informationDESAIN EKSPERIMEN Analysis of Variances (ANOVA) Semester Genap 2017/2018 Jurusan Teknik Industri Universitas Brawijaya
DESAIN EKSPERIMEN Analysis of Variances (ANOVA) Semester Jurusan Teknik Industri Universitas Brawijaya Outline Introduction The Analysis of Variance Models for the Data Post-ANOVA Comparison of Means Sample
More information18.S096 Problem Set 3 Fall 2013 Regression Analysis Due Date: 10/8/2013
18.S096 Problem Set 3 Fall 013 Regression Analysis Due Date: 10/8/013 he Projection( Hat ) Matrix and Case Influence/Leverage Recall the setup for a linear regression model y = Xβ + ɛ where y and ɛ are
More informationBIOSTATISTICAL METHODS
BIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH Cross-over Designs #: DESIGNING CLINICAL RESEARCH The subtraction of measurements from the same subject will mostly cancel or minimize effects
More informationStat 217 Final Exam. Name: May 1, 2002
Stat 217 Final Exam Name: May 1, 2002 Problem 1. Three brands of batteries are under study. It is suspected that the lives (in weeks) of the three brands are different. Five batteries of each brand are
More informationLecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2
Lecture 2: Basic Concepts and Simple Comparative Experiments Montgomery: Chapter 2 Fall, 2013 Page 1 Random Variable and Probability Distribution Discrete random variable Y : Finite possible values {y
More informationn i n T Note: You can use the fact that t(.975; 10) = 2.228, t(.95; 10) = 1.813, t(.975; 12) = 2.179, t(.95; 12) =
MAT 3378 3X Midterm Examination (Solutions) 1. An experiment with a completely randomized design was run to determine whether four specific firing temperatures affect the density of a certain type of brick.
More informationFactorial Treatment Structure: Part I. Lukas Meier, Seminar für Statistik
Factorial Treatment Structure: Part I Lukas Meier, Seminar für Statistik Factorial Treatment Structure So far (in CRD), the treatments had no structure. So called factorial treatment structure exists if
More informationDr. Junchao Xia Center of Biophysics and Computational Biology. Fall /8/2016 1/38
BIO5312 Biostatistics Lecture 11: Multisample Hypothesis Testing II Dr. Junchao Xia Center of Biophysics and Computational Biology Fall 2016 11/8/2016 1/38 Outline In this lecture, we will continue to
More information20. REML Estimation of Variance Components. Copyright c 2018 (Iowa State University) 20. Statistics / 36
20. REML Estimation of Variance Components Copyright c 2018 (Iowa State University) 20. Statistics 510 1 / 36 Consider the General Linear Model y = Xβ + ɛ, where ɛ N(0, Σ) and Σ is an n n positive definite
More informationTopic 25 - One-Way Random Effects Models. Outline. Random Effects vs Fixed Effects. Data for One-way Random Effects Model. One-way Random effects
Topic 5 - One-Way Random Effects Models One-way Random effects Outline Model Variance component estimation - Fall 013 Confidence intervals Topic 5 Random Effects vs Fixed Effects Consider factor with numerous
More information3. Design Experiments and Variance Analysis
3. Design Experiments and Variance Analysis Isabel M. Rodrigues 1 / 46 3.1. Completely randomized experiment. Experimentation allows an investigator to find out what happens to the output variables when
More informationLecture 10. Factorial experiments (2-way ANOVA etc)
Lecture 10. Factorial experiments (2-way ANOVA etc) Jesper Rydén Matematiska institutionen, Uppsala universitet jesper@math.uu.se Regression and Analysis of Variance autumn 2014 A factorial experiment
More informationPage: 3, Line: 24 ; Replace 13 Building... with 13 More on Multiple Regression. Page: 83, Line: 9 ; Replace The ith ordered... with The jth ordered...
ERRATA FOR THE OTT/LONGNECKER BOOK AN INTRODUCTION TO STATISTICAL METHODS AND DATA ANALYSIS (Some of these typos have been corrected in later printings) Page: xiv, Line: 15 ; Replace these with the Page:
More information[y i α βx i ] 2 (2) Q = i=1
Least squares fits This section has no probability in it. There are no random variables. We are given n points (x i, y i ) and want to find the equation of the line that best fits them. We take the equation
More informationAnalysis of Variance Bios 662
Analysis of Variance Bios 662 Michael G. Hudgens, Ph.D. mhudgens@bios.unc.edu http://www.bios.unc.edu/ mhudgens 2008-10-21 13:34 BIOS 662 1 ANOVA Outline Introduction Alternative models SS decomposition
More informationAllow the investigation of the effects of a number of variables on some response
Lecture 12 Topic 9: Factorial treatment structures (Part I) Factorial experiments Allow the investigation of the effects of a number of variables on some response in a highly efficient manner, and in a
More informationhttp://www.statsoft.it/out.php?loc=http://www.statsoft.com/textbook/ Group comparison test for independent samples The purpose of the Analysis of Variance (ANOVA) is to test for significant differences
More informationPeter Hoff Linear and multilinear models April 3, GLS for multivariate regression 5. 3 Covariance estimation for the GLM 8
Contents 1 Linear model 1 2 GLS for multivariate regression 5 3 Covariance estimation for the GLM 8 4 Testing the GLH 11 A reference for some of this material can be found somewhere. 1 Linear model Recall
More informationStat 579: Generalized Linear Models and Extensions
Stat 579: Generalized Linear Models and Extensions Mixed models Yan Lu Feb, 2018, week 7 1 / 17 Some commonly used experimental designs related to mixed models Two way or three way random/mixed effects
More informationThe One-Way Repeated-Measures ANOVA. (For Within-Subjects Designs)
The One-Way Repeated-Measures ANOVA (For Within-Subjects Designs) Logic of the Repeated-Measures ANOVA The repeated-measures ANOVA extends the analysis of variance to research situations using repeated-measures
More informationI i=1 1 I(J 1) j=1 (Y ij Ȳi ) 2. j=1 (Y j Ȳ )2 ] = 2n( is the two-sample t-test statistic.
Serik Sagitov, Chalmers and GU, February, 08 Solutions chapter Matlab commands: x = data matrix boxplot(x) anova(x) anova(x) Problem.3 Consider one-way ANOVA test statistic For I = and = n, put F = MS
More informationCh 3: Multiple Linear Regression
Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery
More informationPLS205 Lab 2 January 15, Laboratory Topic 3
PLS205 Lab 2 January 15, 2015 Laboratory Topic 3 General format of ANOVA in SAS Testing the assumption of homogeneity of variances by "/hovtest" by ANOVA of squared residuals Proc Power for ANOVA One-way
More informationThe factors in higher-way ANOVAs can again be considered fixed or random, depending on the context of the study. For each factor:
M. Two-way Random Effects ANOVA The factors in higher-way ANOVAs can again be considered fixed or random, depending on the context of the study. For each factor: Are the levels of that factor of direct
More informationIntroduction to Design and Analysis of Experiments with the SAS System (Stat 7010 Lecture Notes)
Introduction to Design and Analysis of Experiments with the SAS System (Stat 7010 Lecture Notes) Asheber Abebe Discrete and Statistical Sciences Auburn University Contents 1 Completely Randomized Design
More informationUnbalanced Designs Mechanics. Estimate of σ 2 becomes weighted average of treatment combination sample variances.
Unbalanced Designs Mechanics Estimate of σ 2 becomes weighted average of treatment combination sample variances. Types of SS Difference depends on what hypotheses are tested and how differing sample sizes
More informationTwo or more categorical predictors. 2.1 Two fixed effects
Two or more categorical predictors Here we extend the ANOVA methods to handle multiple categorical predictors. The statistician has to watch carefully to see whether the effects being considered are properly
More information22s:152 Applied Linear Regression. Take random samples from each of m populations.
22s:152 Applied Linear Regression Chapter 8: ANOVA NOTE: We will meet in the lab on Monday October 10. One-way ANOVA Focuses on testing for differences among group means. Take random samples from each
More informationBIOS 2083: Linear Models
BIOS 2083: Linear Models Abdus S Wahed September 2, 2009 Chapter 0 2 Chapter 1 Introduction to linear models 1.1 Linear Models: Definition and Examples Example 1.1.1. Estimating the mean of a N(μ, σ 2
More informationLecture 10: Experiments with Random Effects
Lecture 10: Experiments with Random Effects Montgomery, Chapter 13 1 Lecture 10 Page 1 Example 1 A textile company weaves a fabric on a large number of looms. It would like the looms to be homogeneous
More informationRandomized Complete Block Designs Incomplete Block Designs. Block Designs. 1 Randomized Complete Block Designs. 2 Incomplete Block Designs
Block Designs Randomized Complete Block Designs 1 Randomized Complete Block Designs 2 0 / 18 1 Randomized Complete Block Designs 2 1 / 18 Randomized Complete Block Design RCBD is the most widely used experimental
More informationChapter 11 - Lecture 1 Single Factor ANOVA
Chapter 11 - Lecture 1 Single Factor ANOVA April 7th, 2010 Means Variance Sum of Squares Review In Chapter 9 we have seen how to make hypothesis testing for one population mean. In Chapter 10 we have seen
More informationOne-Way ANOVA Model. group 1 y 11, y 12 y 13 y 1n1. group 2 y 21, y 22 y 2n2. group g y g1, y g2, y gng. g is # of groups,
One-Way ANOVA Model group 1 y 11, y 12 y 13 y 1n1 group 2 y 21, y 22 y 2n2 group g y g1, y g2, y gng g is # of groups, n i denotes # of obs in the i-th group, and the total sample size n = g i=1 n i. 1
More informationANOVA: Analysis of Variance - Part I
ANOVA: Analysis of Variance - Part I The purpose of these notes is to discuss the theory behind the analysis of variance. It is a summary of the definitions and results presented in class with a few exercises.
More informationMore about Single Factor Experiments
More about Single Factor Experiments 1 2 3 0 / 23 1 2 3 1 / 23 Parameter estimation Effect Model (1): Y ij = µ + A i + ɛ ij, Ji A i = 0 Estimation: µ + A i = y i. ˆµ = y..  i = y i. y.. Effect Modell
More informationAnalysis of Variance. One-way analysis of variance (anova) shows whether j groups have significantly different means. X=10 S=1.14 X=5.8 X=2.4 X=9.
Analysis of Variance One-way analysis of variance (anova) shows whether j groups have significantly different means. A B C D 3 6 7 8 2 4 9 10 2 7 12 11 4 5 11 9 1 7 10 12 X=2.4 X=5.8 X=9.8 X=10 S=1.14
More informationStatistics 210 Part 3 Statistical Methods Hal S. Stern Department of Statistics University of California, Irvine
Thus far: Statistics 210 Part 3 Statistical Methods Hal S. Stern Department of Statistics University of California, Irvine sternh@uci.edu design of experiments two sample methods one factor ANOVA pairing/blocking
More information22s:152 Applied Linear Regression. There are a couple commonly used models for a one-way ANOVA with m groups. Chapter 8: ANOVA
22s:152 Applied Linear Regression Chapter 8: ANOVA NOTE: We will meet in the lab on Monday October 10. One-way ANOVA Focuses on testing for differences among group means. Take random samples from each
More informationAnalysis of Variance
Statistical Techniques II EXST7015 Analysis of Variance 15a_ANOVA_Introduction 1 Design The simplest model for Analysis of Variance (ANOVA) is the CRD, the Completely Randomized Design This model is also
More informationApplication of Variance Homogeneity Tests Under Violation of Normality Assumption
Application of Variance Homogeneity Tests Under Violation of Normality Assumption Alisa A. Gorbunova, Boris Yu. Lemeshko Novosibirsk State Technical University Novosibirsk, Russia e-mail: gorbunova.alisa@gmail.com
More informationFactorial and Unbalanced Analysis of Variance
Factorial and Unbalanced Analysis of Variance Nathaniel E. Helwig Assistant Professor of Psychology and Statistics University of Minnesota (Twin Cities) Updated 04-Jan-2017 Nathaniel E. Helwig (U of Minnesota)
More informationChapter 8: Hypothesis Testing Lecture 9: Likelihood ratio tests
Chapter 8: Hypothesis Testing Lecture 9: Likelihood ratio tests Throughout this chapter we consider a sample X taken from a population indexed by θ Θ R k. Instead of estimating the unknown parameter, we
More informationStat 511 HW#10 Spring 2003 (corrected)
Stat 511 HW#10 Spring 003 (corrected) 1. Below is a small set of fake unbalanced -way factorial (in factors A and B) data from (unbalanced) blocks. Level of A Level of B Block Response 1 1 1 9.5 1 1 11.3
More informationComparison of a Population Means
Analysis of Variance Interested in comparing Several treatments Several levels of one treatment Comparison of a Population Means Could do numerous two-sample t-tests but... ANOVA provides method of joint
More informationSimple Linear Regression
Simple Linear Regression In simple linear regression we are concerned about the relationship between two variables, X and Y. There are two components to such a relationship. 1. The strength of the relationship.
More informationAnalysis of Variance
Analysis of Variance Math 36b May 7, 2009 Contents 2 ANOVA: Analysis of Variance 16 2.1 Basic ANOVA........................... 16 2.1.1 the model......................... 17 2.1.2 treatment sum of squares.................
More information1-Way Fixed Effects ANOVA
1-Way Fixed Effects ANOVA James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 19 1-Way Fixed Effects ANOVA 1 Introduction
More informationTopic 9: Factorial treatment structures. Introduction. Terminology. Example of a 2x2 factorial
Topic 9: Factorial treatment structures Introduction A common objective in research is to investigate the effect of each of a number of variables, or factors, on some response variable. In earlier times,
More informationDesign & Analysis of Experiments 7E 2009 Montgomery
Chapter 5 1 Introduction to Factorial Design Study the effects of 2 or more factors All possible combinations of factor levels are investigated For example, if there are a levels of factor A and b levels
More informationBias Variance Trade-off
Bias Variance Trade-off The mean squared error of an estimator MSE(ˆθ) = E([ˆθ θ] 2 ) Can be re-expressed MSE(ˆθ) = Var(ˆθ) + (B(ˆθ) 2 ) MSE = VAR + BIAS 2 Proof MSE(ˆθ) = E((ˆθ θ) 2 ) = E(([ˆθ E(ˆθ)]
More informationERRATA FOR THE OTT/LONGNECKER BOOK AN INTRODUCTION TO STATISTICAL METHODS AND DATA ANALYSIS (3rd printing)
ERRATA FOR THE OTT/LONGNECKER BOOK AN INTRODUCTION TO STATISTICAL METHODS AND DATA ANALYSIS (3rd printing) Page: xiv, Line: 15 ; Replace these with the Page: xiv, Line: 7 ; Insert analysis after statistical
More informationLecture 3. Experiments with a Single Factor: ANOVA Montgomery 3.1 through 3.3
Lecture 3. Experiments with a Single Factor: ANOVA Montgomery 3.1 through 3.3 Fall, 2013 Page 1 Tensile Strength Experiment Investigate the tensile strength of a new synthetic fiber. The factor is the
More informationSociology 6Z03 Review II
Sociology 6Z03 Review II John Fox McMaster University Fall 2016 John Fox (McMaster University) Sociology 6Z03 Review II Fall 2016 1 / 35 Outline: Review II Probability Part I Sampling Distributions Probability
More informationChapter 15: Analysis of Variance
Chapter 5: Analysis of Variance 5. Introduction In this chapter, we introduced the analysis of variance technique, which deals with problems whose objective is to compare two or more populations of quantitative
More information1 One-way Analysis of Variance
1 One-way Analysis of Variance Suppose that a random sample of q individuals receives treatment T i, i = 1,,... p. Let Y ij be the response from the jth individual to be treated with the ith treatment
More informationCOMPARING SEVERAL MEANS: ANOVA
LAST UPDATED: November 15, 2012 COMPARING SEVERAL MEANS: ANOVA Objectives 2 Basic principles of ANOVA Equations underlying one-way ANOVA Doing a one-way ANOVA in R Following up an ANOVA: Planned contrasts/comparisons
More informationTheorem A: Expectations of Sums of Squares Under the two-way ANOVA model, E(X i X) 2 = (µ i µ) 2 + n 1 n σ2
identity Y ijk Ȳ = (Y ijk Ȳij ) + (Ȳi Ȳ ) + (Ȳ j Ȳ ) + (Ȳij Ȳi Ȳ j + Ȳ ) Theorem A: Expectations of Sums of Squares Under the two-way ANOVA model, (1) E(MSE) = E(SSE/[IJ(K 1)]) = (2) E(MSA) = E(SSA/(I
More information