Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Similar documents
Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Chapter 12 Analysis of Covariance

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

MD. LUTFOR RAHMAN 1 AND KALIPADA SEN 2 Abstract

Analysis of Variance and Design of Experiments-I

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables

where I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).

STAT 511 FINAL EXAM NAME Spring 2001

Analysis of Variance and Design of Experiments-II

x = , so that calculated

Chapter 11: I = 2 samples independent samples paired samples Chapter 12: I 3 samples of equal size J one-way layout two-way layout

Outline. EEC 686/785 Modeling & Performance Evaluation of Computer Systems. Lecture k r Factorial Designs with Replication

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.

Chapter 11: Simple Linear Regression and Correlation

Chapter 8 Indicator Variables

Lecture 6 More on Complete Randomized Block Design (RBD)

Chapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

# c i. INFERENCE FOR CONTRASTS (Chapter 4) It's unbiased: Recall: A contrast is a linear combination of effects with coefficients summing to zero:

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

Chapter 13: Multiple Regression

Tests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours

7.1. Single classification analysis of variance (ANOVA) Why not use multiple 2-sample 2. When to use ANOVA

F statistic = s2 1 s 2 ( F for Fisher )

First Year Examination Department of Statistics, University of Florida

BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

Polynomial Regression Models

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

Two-factor model. Statistical Models. Least Squares estimation in LM two-factor model. Rats

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

Topic 23 - Randomized Complete Block Designs (RCBD)

Lecture 16 Statistical Analysis in Biomaterials Research (Part II)

Comparison of Regression Lines

ANOVA. The Observations y ij

Sampling Theory MODULE V LECTURE - 17 RATIO AND PRODUCT METHODS OF ESTIMATION

However, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values

Correlation and Regression. Correlation 9.1. Correlation. Chapter 9

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Chapter 13 Analysis of Variance and Experimental Design

Department of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6

BETWEEN-PARTICIPANTS EXPERIMENTAL DESIGNS

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Y = β 0 + β 1 X 1 + β 2 X β k X k + ε

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

ANSWERS CHAPTER 9. TIO 9.2: If the values are the same, the difference is 0, therefore the null hypothesis cannot be rejected.

Regression Analysis. Regression Analysis

Statistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation

ECON 351* -- Note 23: Tests for Coefficient Differences: Examples Introduction. Sample data: A random sample of 534 paid employees.

Statistics for Economics & Business

PARTIALLY BALANCED INCOMPLETE BLOCK DESIGNS

a. (All your answers should be in the letter!

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

Now we relax this assumption and allow that the error variance depends on the independent variables, i.e., heteroskedasticity

Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Chapter 4 Experimental Design and Their Analysis

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

x i1 =1 for all i (the constant ).

Statistics for Business and Economics

Department of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution

NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis

Lecture 6: Introduction to Linear Regression

Answers Problem Set 2 Chem 314A Williamsen Spring 2000

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Chapter 5 Multilevel Models

Lecture 20: Hypothesis testing

Chapter 3 Describing Data Using Numerical Measures

Outline. Multivariate Parametric Methods. Multivariate Data. Basic Multivariate Statistics. Steven J Zeil

Resource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis

Economics 130. Lecture 4 Simple Linear Regression Continued

Chapter 15 Student Lecture Notes 15-1

Chapter 14 Simple Linear Regression

Lecture 2: Prelude to the big shrink

STATISTICS QUESTIONS. Step by Step Solutions.

Statistics Chapter 4

Lecture 4 Hypothesis Testing

/ n ) are compared. The logic is: if the two

Chapter 15 - Multiple Regression

CHAPTER 8. Exercise Solutions

8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore

PROBABILITY AND STATISTICS Vol. III - Analysis of Variance and Analysis of Covariance - V. Nollau ANALYSIS OF VARIANCE AND ANALYSIS OF COVARIANCE

Linear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

Professor Chris Murray. Midterm Exam

Learning Objectives for Chapter 11

Topic 7: Analysis of Variance

17 Nested and Higher Order Designs

STAT 3008 Applied Regression Analysis

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Modeling and Simulation NETW 707

Statistical Hypothesis Testing for Returns to Scale Using Data Envelopment Analysis

Composite Hypotheses testing

Testing for seasonal unit roots in heterogeneous panels

Homework 10 Stat 547. Problem ) Z D!

Lecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)

Transcription:

Analyss of Varance and Desgn of Experments- MODULE LECTURE - 6 EXPERMENTAL DESGN MODELS Dr. Shalabh Department of Mathematcs and Statstcs ndan nsttute of Technology Kanpur

Two-way classfcaton wth nteractons Consder the two-way classfcaton wth an equal number, say K observatons per cell. Let : k th observaton n (, th cell,.e., recevng the treatments th level of factor A and th level of factor B, and y are ndependently drawn from N ( μ, σ so that the lnear model under consderaton s y k yk = μ + ε k ε k where are dentcally and ndependently dstrbuted followng N (0, σ. Thus E( yk = μ = μoo + ( μo μoo + ( μo μoo + ( μ μo μo + μoo = μ+ α + β + γ where wth μ = μoo α = μo μoo β = μo μoo γ = μ μ μ + μ o o oo J J α = 0, β = 0, γ = 0, γ = 0. = = = = y k =,,..., ; =,,..., J; k =,,..., K Assume that the desgn matrx X s of full rank so that all the parametrc functons of μ are estmable.

3 The null hypothess are : α = α =... = α = 0 0α 0β 0γ : β = β =... = β = 0 : All γ = 0 for all,. J The correspondng alternatve hypothess s : At least one α α, for α : At least one β β, for β :,. γ At least one γ γk for k Mnmzng the error sum of squares J K ( k, = = k= E = y μ α β γ the normal equatons are obtaned as E = 0, μ E = 0 for all, α E β E γ = 0 for all and = 0 for all and.

4 The least squares estmates are obtaned as ˆ μ = y = JK J K = = k= y k ˆ α = y y = y y oo k JK = J ˆ β = y y = y y ˆ γ oo k K = = y y y + y o oo oo J yk yoo yoo y K =. = = + The error sum of square s J K SSE = Mn ( y μ α β γ wth SSE σ ˆ μ, ˆ α, ˆ β, ˆ γ = = k= J K k = ( y ˆ μ ˆ α ˆ β ˆ γ = = k= J K = ( y y = = k= k k ~ χ ( J ( K. o

5 0 α = α = α =... = α = 0 Now mnmzng the error sum of squares under,.e., mnmzng E J K = = k= = ( y μ β γ k wth respect to μ, β γ and and solvng the normal equatons E E E = 0, = 0 for all and = 0 for all and μ β γ gves the least squares estmates as ˆ μ = yˆ ˆ β = y y oo ˆ γ = y y y + y. o oo oo The sum of squares due to α s 0 Mn μβ,, γ J K = = k= J K = = k= ( y μ β γ k = ( y ˆ μ ˆ β ˆ γ k J K ( y k y o JK ( y oo y = = k= = = + ( oo. = = SSE + JK y y

6 Thus the sum of squares due to devaton from 0 α or the sum of squares due to effect A s wth SSA = Sum of squares due to SSE = JK ( y y SSA σ χ ~ (. 0α = oo Mnmzng the error sum of squares under 0 β : β = β =... = β J = 0.e., mnmzng E = ( y μ α γ J K = = k= k and solvng the normal equatons E E E = 0, = 0 for all and = 0 for all and μ α γ yelds the least squares estmators ˆ μ = y ˆ α = y y ˆ γ = y y y + y. o oo oo The mnmum error sum of squares s J K J ( y ˆ ˆ ˆ k μ α γ = SSE + K( yoo y = = k= =

7 and the sum of squares due to devaton from 0 β or the sum of squares due to effect B s SSB = Sum of squares due to SSE wth SSB σ = K ( y y = ~ χ ( J. J oo 0β Next, mnmzng the error sum of squares under E = ( y μ α β 3 J K = = k= k 0 γ : all γ = 0 for all,,.e., mnmzng wth respect to μ, α and β and solvng the normal equatons E3 E3 E3 = 0, = 0 = 0 μ α β for all and for all yelds the least squares estmators as ˆ μ = y ˆ α = y y oo ˆ β = y y. oo

8 The sum of squares due to 0 γ s Mn μα,, β J K = = k= J K ( y μ α β k = ( y ˆ μ ˆ α ˆ β = = k= k J ( o oo oo. = = = SSE + K y y y + y Thus the sum of squares due to devaton from SSAB = Sum of squares due to SSE 0γ 0 γ or the sum of squares due to nteracton effect AB s wth SSAB σ J = K ( y y y + y = = J ~ χ ((. o oo oo The total sum of squares can be parttoned as TSS = SSA + SSB + SSAB + SSE where SSA, SSB, SSAB and SSE are mutually orthogonal. So ether usng the ndependence of SSA, SSB, SSAB and SSE as well as ther respectve α χ dstrbutons or usng the lkelhood rato test approach, the decson rules for the null hypothess at level of sgnfcance are based on F - statstcs as follows:

9 J ( K SSA F =. ~ F[ (, J ( K ] under 0 α, SSE and So Reect Reect Reect J ( K SSB F =. ~ F [ ( J, J( K ] under 0 β, J SSE J ( K SSAB F3 =. ~ F[ ( ( J, J( K ] under 0γ. ( ( J SSE 0α α [(, ( ] f F > F J K 0 β f F F α > [( J, J( K ] [ ] 0γ f F3 > F α ( ( J, J( K. 0 α 0β f or s reected, one can use t -test or multple comparson test to fnd whch pars of α ' s or β ' s are sgnfcantly dfferent. f 0 γ s reected, one would not usually explore t further but theoretcally t- test or multple comparson tests can be used.

0 JK t can also be shown that ESSA ( = σ + α K ESSB ( = σ + ESSAB ( = σ + ESSE ( = σ. = J β J = K J γ ( ( J = = The analyss of varance table s as follows: Source of Degrees of Sum of squares Mean squares F - value varaton freedom Factor A ( - SSA MSA MSA MSA = F = MSE λ C = F α ( p, n p Factor B (J - SSB MSB = MSB J F = MSB MSE 0 nteracton AB ( -(J - : β = β 0 SSAB SSAB MSAB = ( ( J F 3 = MSAB MSE Error J (K - SSE Total ( J K TSS MSE = SSE J ( K