Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Similar documents
Chapter 2 General Linear Hypothesis and Analysis of Variance

STK3100 and STK4100 Autumn 2018

LINEAR REGRESSION ANALYSIS

Chapter 3 Experimental Design Models

STK3100 and STK4100 Autumn 2017

Training Sample Model: Given n observations, [[( Yi, x i the sample model can be expressed as (1) where, zero and variance σ

Multiple Linear Regression Analysis

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh. Indian Institute of Technology Kanpur

Summary of the lecture in Biostatistics

Module 7. Lecture 7: Statistical parameter estimation

Chapter 8: Statistical Analysis of Simulated Data

Econometric Methods. Review of Estimation

Special Instructions / Useful Data

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

Chapter 8. Inferences about More Than Two Population Central Values

BASIC PRINCIPLES OF STATISTICS

Chapter 14 Logistic Regression Models

Point Estimation: definition of estimators

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

CHAPTER VI Statistical Analysis of Experimental Data

TESTS BASED ON MAXIMUM LIKELIHOOD

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

Chapter 4 Multiple Random Variables

Chapter 11 The Analysis of Variance

Mean is only appropriate for interval or ratio scales, not ordinal or nominal.

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

Chapter 5 Properties of a Random Sample

Functions of Random Variables

Lecture 3. Sampling, sampling distributions, and parameter estimation

Continuous Distributions

X ε ) = 0, or equivalently, lim

ENGI 3423 Simple Linear Regression Page 12-01

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

STK4011 and STK9011 Autumn 2016

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

Chapter 5 Properties of a Random Sample

Parameter Estimation

Lecture 3 Probability review (cont d)

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d

The Mathematical Appendix

Improving coverage probabilities of confidence intervals in random effects meta-analysis with publication bias

Idea is to sample from a different distribution that picks points in important regions of the sample space. Want ( ) ( ) ( ) E f X = f x g x dx

Unimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods

A New Family of Transformations for Lifetime Data

Introduction to local (nonparametric) density estimation. methods

ρ < 1 be five real numbers. The

STRONG CONSISTENCY FOR SIMPLE LINEAR EV MODEL WITH v/ -MIXING

Analysis of Variance with Weibull Data

Continuous Random Variables: Conditioning, Expectation and Independence

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

ESS Line Fitting

Multivariate Transformation of Variables and Maximum Likelihood Estimation

Channel Models with Memory. Channel Models with Memory. Channel Models with Memory. Channel Models with Memory

Lecture 9. Some Useful Discrete Distributions. Some Useful Discrete Distributions. The observations generated by different experiments have

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Chain Rules for Entropy

Arithmetic Mean Suppose there is only a finite number N of items in the system of interest. Then the population arithmetic mean is

Likelihood Ratio, Wald, and Lagrange Multiplier (Score) Tests. Soccer Goals in European Premier Leagues

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades

Lecture Note to Rice Chapter 8

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Wu-Hausman Test: But if X and ε are independent, βˆ. ECON 324 Page 1

Dimensionality Reduction and Learning

Qualifying Exam Statistical Theory Problem Solutions August 2005

4. Standard Regression Model and Spatial Dependence Tests

Nonparametric Density Estimation Intro

Chapter 13 Student Lecture Notes 13-1

THE ROYAL STATISTICAL SOCIETY 2009 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA MODULAR FORMAT MODULE 2 STATISTICAL INFERENCE

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

STA302/1001-Fall 2008 Midterm Test October 21, 2008

Recall MLR 5 Homskedasticity error u has the same variance given any values of the explanatory variables Var(u x1,...,xk) = 2 or E(UU ) = 2 I

Probability and Statistics. What is probability? What is statistics?

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

CS 2750 Machine Learning Lecture 5. Density estimation. Density estimation

LECTURE - 4 SIMPLE RANDOM SAMPLING DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANPUR

Random Variables. ECE 313 Probability with Engineering Applications Lecture 8 Professor Ravi K. Iyer University of Illinois

Unit 9. The Tangent Bundle

Upper and lower risk bounds for estimating the Wasserstein barycenter of random measures on the real line

Two Fuzzy Probability Measures

22 Nonparametric Methods.

D KL (P Q) := p i ln p i q i

SPECIAL CONSIDERATIONS FOR VOLUMETRIC Z-TEST FOR PROPORTIONS

Comparison of Parameters of Lognormal Distribution Based On the Classical and Posterior Estimates

Simulation Output Analysis

Statistics MINITAB - Lab 5

Lecture 1 Review of Fundamental Statistical Concepts

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter

Bias Correction in Estimation of the Population Correlation Coefficient

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Chapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance

Lecture 8: Linear Regression

Bayes (Naïve or not) Classifiers: Generative Approach

Maximum Likelihood Estimation

Chapter 3 Sampling For Proportions and Percentages

Multiple Choice Test. Chapter Adequacy of Models for Regression

Transcription:

Aalyss of Varace ad Desg of Exermets-I MODULE II LECTURE - GENERAL LINEAR HYPOTHESIS AND ANALYSIS OF VARIANCE Dr Shalabh Deartmet of Mathematcs ad Statstcs Ida Isttute of Techology Kaur

Tukey s rocedure for multle comarso (T- method) The T-method uses the dstrbuto of studetzed rage statstc (The S-method (dscussed ext) utlzes the F- dstrbuto) The T-method ca be used to make the smultaeous cofdece statemets about cotrasts amog a set of arameters { β, β,, β} ( β β ) ad a estmate s of error varace f certa restrctos are satsfed These restrctos have to be vewed accordg to the gve codtos For examle, oe of the restrctos s that all ˆ ' s have equal varaces I the setu of oe way classfcato, ˆβ σ β β has ts mea Y ad ts varace s Ths reduces to a smle codto that all ' s are same, e, = for all so that all the varaces are same Aother assumto s to assume that ˆ β, ˆ β ˆ,, β ( ) ' the dffereces { β β, =,,, } are statstcally deedet ad the oly cotrasts cosdered are We make the followg assumtos: The ˆ β are statstcally deedet, ˆ β,, ˆ β ˆ β s a kow costat t ~ N( β, a σ ), =,,,, a > 0 s s s a deedet estmate of σ wth degrees of freedom e, ~ χ ( ) (Here = - ) ad σ v s s statstcally deedet of ˆ β ˆ ˆ, β,, β

3 The statemet t t of T-method d s as follows: Uder the assumtos ()-(v), the robablty s L = Cβ ( C = 0) = = smultaeously satsfy ˆ ˆ L Ts C L L + Ts C = = ( α) that the values of cotrasts where Lˆ = ˆ ˆ Cβ, β s the maxmum lkelhood (or least squares) estmate of β, T = aq α,,, wth qα,, beg the = uer 00 α % ot of the dstrbuto of Studetzed rage Note that f L s a cotrast lke β ( ) the ad the varace s so that ad the terval β C = σ a = = smlfes to ( ˆ β ˆ β ) Ts β β ( ˆ β ˆ β ) + Ts where T = q Thus the maxmum lkelhood (or least squares) estmate of s sad to be α,, Lˆ = ˆ β ˆ β L = β β sgfcatly dfferet from zero accordg to T-crtero f the terval ( ˆ β ˆ β Ts, ˆ β ˆ β + Ts) does ot cover β β = 0, e e, f ˆ β ˆ β > Ts Ts or more geeral f ˆ L > Ts C =

4 The stes volved the testg ow volve followg stes: Comute ( ˆ ˆ ) Lˆ β β or Comute all ossble arwse dffereces Comare all the dffereces wth s qα,, C = ˆ ( ˆ ˆ ) If L or β β > Ts C = the ˆ ad ˆ are sgfcatly dfferet where T β Tables for T are avalable q = α,, β Whe samle szes are ot equal, the Tukey-Kramer Procedure suggests to comare ˆL wth qα,, s + C = or T + C =

5 The Scheffe s method (S-method) of multle comarso S-method geerally gves shorter cofdece tervals the T-method It ca be used a umber of stuatos where T-method s ot alcable, eg, whe the samle szes are ot equal { ψ } A set L of estmable fuctos s called a -dmesoal sace of estmable fuctos f there exsts learly deedet estmable fuctos ( ψ, ψ,, ψ ) such that every ψ L s of the form ψ = Cy where C, C,, C = are kow costats I other words, L s the set of all lear combatos of,,, ψ ψ ψ Uder the assumto that the arametrc sace s Y ~ N( Xβ, σ I) wth rak( X ) =, β = ( β,, β ), X s matrx, cosder a -dmesoal sace L of estmable fuctos geerated by a set of learly deedet estmable fuctos { ψ, ψ,, ψ } Ω For ay ψ L, Let = Cy be ts least squares (or maxmum lkelhood) estmator, = C = Var( ) = σ = σ ψ ( say) ad ψ s C = ˆ σ = s ( ) where s the mea square due to error wth degrees of freedom

6 The statemet of S-method s as follows: Uder the arametrc sace Ω, the robablty s ( α) that smultaeously for all ψ L, S ˆ σ ψ + S ˆ σ where the costat S = F (, ) α Method For a gve sace L of estmable fuctos ad cofdece coeffcet ( α), the least square (or maxmum lkelhood) estmate of ψ L wll be sad to be sgfcatly dfferet from zero accordg to S-crtero f the cofdece terval ( S ˆ σ ψ + S ˆ σ ) does ot cover ψ = 0, e, f > ˆ σ S ψ ˆ The S-method s less sestve to the volato of assumtos of ormalty ad homogeety of varaces

7 Comarso of Tukey s ad Scheffe s methods Tukey s method ca be used oly wth equal samle sze for all factor level but S-method s alcable whether the samle szes are equal or ot Although, Tukey s method s alcable for ay geeral cotrast, the rocedure s more owerful whe comarg smle arwse dffereces ad ot makg more comlex comarsos 3 It oly arwse comarsos are of terest, ad all factor levels have equal samle szes, Tukey s method gves shorter cofdece terval ad thus s more owerful 4 I the case of comarsos volvg geeral cotrasts, Scheffe s method teds to gve arrower cofdece terval ad rovdes a more owerful test 5 Scheffe s method s less sestve to the volatos of assumtos of ormal dstrbuto ad homogeety of varaces