Chapter 12 Analysis of Covariance
|
|
- Bryan Copeland
- 6 years ago
- Views:
Transcription
1 Chapter Analyss of Covarance Any scentfc experment s performed to know somethng that s unknown about a group of treatments and to test certan hypothess about the correspondng treatment effect When varablty of expermental unts s small relatve to the treatment dfferences and the expermenter do not wshes to use expermental desgn, then ust take large number of observatons on each treatment effect and compute ts mean he varaton around mean can be made as small as desred by takng more observatons When there s consderable varaton among observatons on the same treatment and t s not possble to take an unlmted number of observatons, the technues used for reducng the varaton are ( use of proper expermental desgn and ( use of concomtant varables he use of concomtant varables s accomplshed through the technue of analyss of covarance If both the technues fal to control the expermental varablty then the number of replcatons of dfferent treatments (n other words, the number of expermental unts are needed to be ncreased to a pont where adeuate control of varablty s aaned Introducton to analyss of covarance model In the lnear model Y = Xβ+ Xβ + + X p β p + ε, f the explanatory varables are uanatve varables as well as ndcator varables, e, some of them are ualtatve and some are uanatve, then the lnear model s termed as analyss of covarance (ANCOVA model Note that the ndcator varables do not provde as much nformaton as the uanatve varables For example, the uanatve observatons on age can be converted nto ndcator varable Let an ndctor varable be Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur
2 f age 7 years D = 0 f age < 7 years Now the followng uanatve values of age can be changed nto ndcator varables Ages (years Ages In many real applcaton, some varables may be uanatve and others may be ualtatve In such cases, ANCOVA provdes a way out It helps s reducng the sum of suares due to error whch n turn reflects the beer model adeuacy dagnostcs See how does ths work: In one way model : Y = µ + α + ε, we have SS = SSA + SS In two way model : Y = µ + α + β + ε, we have SS = SSA + SSB + SS In three way model : Y = µ + α + β + γ + ε, we have SS = SSA + SSB + SSγ + SS k k If we have a gven data set, then deally SS = SS = SS3 SSA = SSA = SSA3; SSB = SSB 3 So SS SS SS Note that n the constructon of F -statstcs, we use So F -statstc essentally depends on the SSs Smaller SS large F more chance of reecton SS( effects/ df SS / df Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur
3 Snce SSA, SSB etc here are based on dummy varables, so obvously f SSA, SSB, etc are based on uanatve varables, they wll provde more nformaton Such deas are used n ANCOVA models and we construct the model by ncorporatng the uanatve explanatory varables n ANOVA models In another example, suppose our nterest s to compare several dfferent knds of feed for ther ablty to put weght on anmals If we use ANOVA, then we use the fnal weghts at the end of experment However, fnal weghts of the anmals depend upon the ntal weght of the anmals at the begnnng of the experment as well as upon the dfference n feeds Use of ANCOVA models enables us to adust or correct these ntal dfferences ANCOVA s useful for mprovng the precson of an experment Suppose response Y s lnearly related to covarate X (or concomtant varable Suppose expermenter cannot control X but can observe t ANCOVA nvolves adustng Y for the effect of X If such an adustment s not made, then the X can nflate the error mean suare and makes the true dfferences s Y due to treatment harder to detect If, for a gven expermental materal, the use of proper expermental desgn cannot control the expermental varaton, the use of concomtant varables (whch are related to expermental materal may be effectve n reducng the varablty Consder the one way classfcaton model as Y ( = β =,, p, =,, N, Var Y ( = σ If usual analyss of varance for testng the hypothess of eualty of treatment effects shows a hghly sgnfcant dfference n the treatment effects due to some factors affectng the experment, then consder the model whch takes nto account ths effect Y ( = β + γt =,, p, =,, N, Var( Y = σ where t are the observatons on concomtant varables (whch are related to X and γ s the regresson coeffcent assocated wth t Wth ths model, the varablty of treatment effects can be consderably reduced Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 3
4 For example, n any agrcultural expermental, f the expermental unts are plots of land then, t can be measure of fertlty characterstc of the th plot recevng th treatment and X can be yeld In another example, f expermental unts are anmals and suppose the obectve s to compare the growth rates of groups of anmals recevng dfferent dets Note that the observed dfferences n growth rates can be arbuted to det only f all the anmals are smlar n some observable characterstcs lke weght, age etc whch nfluence the growth rates In the absence of smlarty, use t whch s the weght or age of th anmal recevng th treatment If we consder the uadratc regresson n t then n Y t t p n ( = β + γ + γ, =,,, =,,, ( = σ Var Y ANCOVA n ths case s the same as ANCOVA wth two concomtant varables t and t In two way classfcaton wth one observaton per cell, Y ( = µ + α + β + γt, =,, I, =,, J or Y ( = µ + α + β + γ t + γ w wth α = 0, β = 0, then ( y, t or ( y, t, w are the observatons n (, cell and t, w are the concomtment varables th he concomtant varables can be fxed on random We consder the case of fxed concomtant varables only Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 4
5 One way classfcaton Let Y ( = n, = p be a random sample of sze n from th normal populatons wth mean µ = Y ( = β + γt Var( Y = σ where β, γ and a concomtant varable σ are the unknown parameters, t are known constants whch are the observatons on he null hypothess s H0 : β = = βp Let y = y ; y = y, y = y n p n o o t = t ; t = t, t = t n p n o o n= n Under the whole parametrc space ( π Ω, use lkelhd rato test for whch we obtan the ˆ β ' s and ˆ γ usng the least suares prncple or maxmum lkelhd estmaton as follows: Mnmze S = ( y S = 0 for fxed γ β β = y γt o o = ( y β γt S Put β n S and mnmze the functon by = 0, γ e,mnmze y yo γ( t to wth respect to γ gves ( y yo ( t to ˆ= γ ( t t hus ˆ β ˆ = yo γto ˆ µ = ˆ β + ˆ γt o Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 5
6 Snce y ˆ µ = y ˆ β ˆ γt = y y ˆ( γ t t, o o we have ( y y ( t t o o ( y ˆ = ( y yo ( t to Under H0 : β = = βp = β (say, consder w = β γ and mnmze w S y t S under sample space ( π w, Sw = 0, β Sw = 0 γ ˆ β = y ˆ γt ( y y( t t ˆ γ = ( t t ˆ µ = ˆ β + ˆ γt Hence ( y y ( t t ( y ˆ = ( y y ( t t and ( ( ( ˆ( ˆ µ ˆ ˆ ˆ = y y + γ t to γ t t he lkelhd rato test statstc n ths case s gven by Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 6
7 max L( βγσ,, w λ = max L( βγσ,, = Ω ( ˆ µ ˆ µ ( y ˆ µ Now we use the followng theorems: heorem : Let Y ( Y, Y,, Y n = follow a multvarate normal dstrbuton N ( µ, Σ wth mean vector µ and postve defnte covarance matrx Σ hen Y AY follows a noncentral ch-suare dstrbuton wth p degrees of freedom and noncentralty parameter µ Aµ, e, χ ( p, µ Aµ f and only f Σ A s an dempotent matrx of rank p heorem : Let Y = ( Y, Y,, Y n follows a multvarate normal dstrbuton N ( µ, wth mean vector µ and postve defnte covarance matrx Σ Let YAY follows χ ( p, µ Aµ and YAY follows χ ( p, µ A µ hen YAY and YAY are ndependently dstrbuted f AΣ A = 0 heorem 3: Let Y = ( Y, Y,, Y n follows a multvarate normal dstrbuton N (, I µσ, then the maxmum lkelhd (or least suares estmator L ˆ β of estmable lnear parametrc functon s ndependently dstrbuted of ˆ σ ; L ˆ β follow β and nσˆ σ N L, L( XX L follows χ ( n p where rank( X = p Usng these theorems on the ndependence of uadratc forms and dvdng the numerator and denomnator by respectve degrees of freedom, we have ( ˆ µ ˆ n p F = p ( y ˆ µ ~ F( p, n p under H So reect H 0 whenever F F α ( p, n p at α level of sgnfcance he terms nvolved n λ can be smplfed for computatonal convenence follows: 0 We can wrte Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 7
8 ( y ˆ µ = y ˆ ˆ β γ t = ( y ˆ y γ ( t t = ( y ˆ( ˆ( ˆ( ˆ y γ t t + γ t to γ t to = ( ˆ( ˆ y yo γ t to = ( y ˆ( ˆ y + γ t to γ( t t y ˆ ˆ ˆ µ µ µ = ( + ( For computatonal convenence ( ˆ µ ˆ ( y ˆ λ = = where = ( y y = ( t t = ( y y ( t t = ( y y o = ( t t o = ( y y ( t t o o Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 8
9 Analyss of covarance table for one way classfcaton s as follows: Source of varaton Populaton rror Degrees of freedom p n p Sum of products P ( = P ( = P ( = Adusted sum of suares Degress of feedom Sum of suares p = 0 n p = F n p p otal n n 0 = If H 0 s reected, employ multple comprses methods to determne whch of the contrasts n β are responsble for ths For any estmable lnear parametrc contrast p ϕ = Cβ wth C = 0, = = p p p ˆ ϕ = C ˆ β = Cy ˆ γ C t = = = p Var( ˆ γ = σ ( t t Var = + Ct C ( ˆ ϕ σ n ( t t Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 9
10 wo way classfcaton (wth one observatons per cell Consder the case of two way classfcaton wth one observaton per cell Let ~ (, y N µ σ be ndependently dstrbuted wth ( y = µ + α + β + γt, = I, = J V( y = σ where µ : Grand mean α : ffect of β : ffect of I th level of A satsfyng α = 0 J th level of B satsfyng β = 0 t : observaton (known on concomtant varable he null hypothess under consderaton are H0 α : α = α = = αi = 0 H : β = β = = β = 0 0β J Dmenson of whole parametrc space ( π Ω :I + J Dmenson of sample space ( π wα : J + under 0 H α Dmenson of sample space ( π wβ : I + under 0 wth respectve alternatve hypotheses as H α : At least one par of α 's s not eual H β : At least one par of β 's s not eual Consder the estmaton of parameters under the whole parametrc space ( π Ω H β Fnd mnmum value of ( y under π Ω o do ths, mnmze ( y α β γ t For fxed γ, whch gves on solvng the least suares estmates (or the maxmum lkelhd estmates of the respectve parameters as Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 0
11 µ = y γt o α = y y γ( t t ( o β = y y γ( t t o o Under these values of µα, and β, the sum of suares ( y µ α β γt reduces to y yo yo + y + γ ( t to to + t ( Now mnmzaton of ( wth respect to γ gves ˆ γ = I J = = ( y y y + y ( t t t + t o o o o I J = = Usng ˆ, γ we get from ( ˆ µ = y ˆ γt ˆ α = ( y y ˆ γ( t t o o ( t t t + t o o ˆ β = ( y y ˆ γ( t t o o Hence where ( y ˆ µ o o o o = ( y yo yo y + ( t to to + t = = ( y y y + y o o = ( y y y + y ( t t t + t o o o o = ( t t t + t o o ( y y y + y ( t t t + t Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur
12 Case ( : est of H0 α Mnmze ( y β γ t wth respect to, µβ and γ gves the least suares estmates (or the maxmum lkelhd estmates of respectve parameters as ˆ µ = y ˆ γt ˆ β = y y ˆ( γ t t o o ( y yo ( t to ˆ γ = (3 ( t t ˆ µ = ˆ µ + ˆ β + ˆ γt Subsutng these estmates n (3 we get o ( y y ( t t o o ( y ˆ = ( y y ( t to where = + A A = J( y y o A = J( t t o + A + A A = J( y y ( t t o o = ( y y y + y o o = ( t t t + t o o = ( y y y + y ( t t t + t o o o o hus the lkelhd rato test statstc for testng H0 α s λ ( y ˆ µ ( y ˆ µ = ( y ˆ Adustng wth degrees of freedom and usng the earler result for the ndependence of two uadratc forms and ther dstrbuton Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur
13 ( IJ I J ( I ( y ˆ µ F ( y ˆ µ ( y ˆ µ = So the decson rule s to reect H α whenever F > F ( I, IJ I J o α ~ F( I, IJ I J under Ho α Case b: est of H0 β Mnmze ( y α γ t wth respect to, µα and γ gves the least suares estmates (or maxmum lkelhd estmates of respectve parameters as ˆ µ = y γt α = y y γ( t t γ = o o µ = µ + α + γ From (4, we get ( y y ( t t o o ( t t o o o ( y µ = ( y yo ( t to B = I( y y o where B = I( t t o = + B = ( o ( o B I y y t t + B B hus the lkelhd rato test statstc for testng H0 β s (4 ( y y ( t t ( y ( ˆ µ y µ ( IJ I J F = ~ F( J, IJ I J ( J ( y ˆ µ So the decson rule s to reect H0 β whenever F F α ( J, IJ I J under Ho β Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 3
14 If Ho α s reected, use multple comparson methods to determne whch of the contrasts responsble for ths reecton he same s true for Ho β α are he analyss of covarance table for two way classfcaton s as follows: Source of varaton Degrees of freedom Sum of products F Between evels of A I A A A I = 0 3 F = IJ I J I 0 Between levels of B J B B B J = 4 F = IJ I J J rror ( I ( J IJ I J = otal IJ IJ rror + levels of A IJ J ( A + 3 = ( A + A + rror + levels of B IJ I ( B + 4 = ( B + B + Analyss of Varance Chapter Analyss of Covarance Shalabh, II Kanpur 4
Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experments- MODULE LECTURE - 6 EXPERMENTAL DESGN MODELS Dr. Shalabh Department of Mathematcs and Statstcs ndan nsttute of Technology Kanpur Two-way classfcaton wth nteractons
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationLINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables
LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationFirst Year Examination Department of Statistics, University of Florida
Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationTopic 23 - Randomized Complete Block Designs (RCBD)
Topc 3 ANOVA (III) 3-1 Topc 3 - Randomzed Complete Block Desgns (RCBD) Defn: A Randomzed Complete Block Desgn s a varant of the completely randomzed desgn (CRD) that we recently learned. In ths desgn,
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationF statistic = s2 1 s 2 ( F for Fisher )
Stat 4 ANOVA Analyss of Varance /6/04 Comparng Two varances: F dstrbuton Typcal Data Sets One way analyss of varance : example Notaton for one way ANOVA Comparng Two varances: F dstrbuton We saw that the
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have
More informationx = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationChapter 11: I = 2 samples independent samples paired samples Chapter 12: I 3 samples of equal size J one-way layout two-way layout
Serk Sagtov, Chalmers and GU, February 0, 018 Chapter 1. Analyss of varance Chapter 11: I = samples ndependent samples pared samples Chapter 1: I 3 samples of equal sze one-way layout two-way layout 1
More informationTwo-factor model. Statistical Models. Least Squares estimation in LM two-factor model. Rats
tatstcal Models Lecture nalyss of Varance wo-factor model Overall mean Man effect of factor at level Man effect of factor at level Y µ + α + β + γ + ε Eε f (, ( l, Cov( ε, ε ) lmr f (, nteracton effect
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours
UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationLecture 6 More on Complete Randomized Block Design (RBD)
Lecture 6 More on Complete Randomzed Block Desgn (RBD) Multple test Multple test The multple comparsons or multple testng problem occurs when one consders a set of statstcal nferences smultaneously. For
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationChapter 15 - Multiple Regression
Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationwhere I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).
11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationISQS 6348 Final Open notes, no books. Points out of 100 in parentheses. Y 1 ε 2
ISQS 6348 Fnal Open notes, no books. Ponts out of 100 n parentheses. 1. The followng path dagram s gven: ε 1 Y 1 ε F Y 1.A. (10) Wrte down the usual model and assumptons that are mpled by ths dagram. Soluton:
More informationSTATISTICS QUESTIONS. Step by Step Solutions.
STATISTICS QUESTIONS Step by Step Solutons www.mathcracker.com 9//016 Problem 1: A researcher s nterested n the effects of famly sze on delnquency for a group of offenders and examnes famles wth one to
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationChapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of
Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More information/ n ) are compared. The logic is: if the two
STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationChapter 3 Describing Data Using Numerical Measures
Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The
More informationLecture 16 Statistical Analysis in Biomaterials Research (Part II)
3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informationJoint Statistical Meetings - Biopharmaceutical Section
Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve
More information7.1. Single classification analysis of variance (ANOVA) Why not use multiple 2-sample 2. When to use ANOVA
Sngle classfcaton analyss of varance (ANOVA) When to use ANOVA ANOVA models and parttonng sums of squares ANOVA: hypothess testng ANOVA: assumptons A non-parametrc alternatve: Kruskal-Walls ANOVA Power
More information[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.
PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationSTAT 511 FINAL EXAM NAME Spring 2001
STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte
More informationPredictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore
Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.
More information10-701/ Machine Learning, Fall 2005 Homework 3
10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40
More informationEconometrics of Panel Data
Econometrcs of Panel Data Jakub Mućk Meetng # 8 Jakub Mućk Econometrcs of Panel Data Meetng # 8 1 / 17 Outlne 1 Heterogenety n the slope coeffcents 2 Seemngly Unrelated Regresson (SUR) 3 Swamy s random
More information1-FACTOR ANOVA (MOTIVATION) [DEVORE 10.1]
1-FACTOR ANOVA (MOTIVATION) [DEVORE 10.1] Hgh varance between groups Low varance wthn groups s 2 between/s 2 wthn 1 Factor A clearly has a sgnfcant effect!! Low varance between groups Hgh varance wthn
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationRegression Analysis. Regression Analysis
Regresson Analyss Smple Regresson Multvarate Regresson Stepwse Regresson Replcaton and Predcton Error 1 Regresson Analyss In general, we "ft" a model by mnmzng a metrc that represents the error. n mn (y
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationANOVA. The Observations y ij
ANOVA Stands for ANalyss Of VArance But t s a test of dfferences n means The dea: The Observatons y j Treatment group = 1 = 2 = k y 11 y 21 y k,1 y 12 y 22 y k,2 y 1, n1 y 2, n2 y k, nk means: m 1 m 2
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS
More informationHowever, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values
Fall 007 Soluton to Mdterm Examnaton STAT 7 Dr. Goel. [0 ponts] For the general lnear model = X + ε, wth uncorrelated errors havng mean zero and varance σ, suppose that the desgn matrx X s not necessarly
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationPrimer on High-Order Moment Estimators
Prmer on Hgh-Order Moment Estmators Ton M. Whted July 2007 The Errors-n-Varables Model We wll start wth the classcal EIV for one msmeasured regressor. The general case s n Erckson and Whted Econometrc
More informationLinear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the
Chapter 11 Student Lecture Notes 11-1 Lnear regresson Wenl lu Dept. Health statstcs School of publc health Tanjn medcal unversty 1 Regresson Models 1. Answer What Is the Relatonshp Between the Varables?.
More informationAnalysis of Variance and Design of Experiments-II
Analyss of Varance and Desgn of Experments-II MODULE - III LECTURE - 8 PARTIALLY BALANCED INCOMPLETE BLOCK DESIGN (PBIBD) Dr Shalah Department of Mathematcs & Statstcs Indan Insttute of Technology Kanpur
More informationBose (1942) showed b t r 1 is a necessary condition. PROOF (Murty 1961): Assume t is a multiple of k, i.e. t nk, where n is an integer.
Resolvable BIBD: An ncomplete bloc desgn n whch each treatment appears r tmes s resolvable f the blocs can be dvded nto r groups such that each group s a complete replcaton of the treatments (.e. each
More informationComposite Hypotheses testing
Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter
More informationResource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis
Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More informationNANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis
NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION 014-015 MTH35/MH3510 Regresson Analyss December 014 TIME ALLOWED: HOURS INSTRUCTIONS TO CANDIDATES 1. Ths examnaton paper contans FOUR (4) questons
More informationLecture 2: Prelude to the big shrink
Lecture 2: Prelude to the bg shrnk Last tme A slght detour wth vsualzaton tools (hey, t was the frst day... why not start out wth somethng pretty to look at?) Then, we consdered a smple 120a-style regresson
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study
More informationCHAPTER IV RESEARCH FINDING AND DISCUSSIONS
CHAPTER IV RESEARCH FINDING AND DISCUSSIONS A. Descrpton of Research Fndng. The Implementaton of Learnng Havng ganed the whole needed data, the researcher then dd analyss whch refers to the statstcal data
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationBOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu
BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationANALYSIS OF COVARIANCE
ANALYSIS OF COVARIANCE YOGITA GHARDE M.Sc. (Agrcultural Statstcs), Roll No. 4495 I.A.S.R.I., Lbrary Avenue, New Delh- 11 1 Charperson: Dr. V.K. Sharma Abstract: Analyss of covarance (ANCOVA) s a statstcal
More informationTopic- 11 The Analysis of Variance
Topc- 11 The Analyss of Varance Expermental Desgn The samplng plan or expermental desgn determnes the way that a sample s selected. In an observatonal study, the expermenter observes data that already
More informationDurban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications
Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationChapter 14 Simple Linear Regression
Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng
More informationMethods of Detecting Outliers in A Regression Analysis Model.
Methods of Detectng Outlers n A Regresson Analyss Model. Ogu, A. I. *, Inyama, S. C+, Achugamonu, P. C++ *Department of Statstcs, Imo State Unversty,Owerr +Department of Mathematcs, Federal Unversty of
More informationMD. LUTFOR RAHMAN 1 AND KALIPADA SEN 2 Abstract
ISSN 058-71 Bangladesh J. Agrl. Res. 34(3) : 395-401, September 009 PROBLEMS OF USUAL EIGHTED ANALYSIS OF VARIANCE (ANOVA) IN RANDOMIZED BLOCK DESIGN (RBD) ITH MORE THAN ONE OBSERVATIONS PER CELL HEN ERROR
More informationHere is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)
Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,
More informationSampling Theory MODULE VII LECTURE - 23 VARYING PROBABILITY SAMPLING
Samplng heory MODULE VII LECURE - 3 VARYIG PROBABILIY SAMPLIG DR. SHALABH DEPARME OF MAHEMAICS AD SAISICS IDIA ISIUE OF ECHOLOGY KAPUR he smple random samplng scheme provdes a random sample where every
More informationTests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions
ECONOMICS 35* -- NOTE ECON 35* -- NOTE Tests of Sngle Lnear Coeffcent Restrctons: t-tests and -tests Basc Rules Tests of a sngle lnear coeffcent restrcton can be performed usng ether a two-taled t-test
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationScatter Plot x
Construct a scatter plot usng excel for the gven data. Determne whether there s a postve lnear correlaton, negatve lnear correlaton, or no lnear correlaton. Complete the table and fnd the correlaton coeffcent
More informationIntroduction to Regression
Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes
More informationSampling Theory MODULE V LECTURE - 17 RATIO AND PRODUCT METHODS OF ESTIMATION
Samplng Theory MODULE V LECTURE - 7 RATIO AND PRODUCT METHODS OF ESTIMATION DR. SHALABH DEPARTMENT OF MATHEMATICS AND STATISTICS INDIAN INSTITUTE OF TECHNOLOG KANPUR Propertes of separate rato estmator:
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)
More informationBasically, if you have a dummy dependent variable you will be estimating a probability.
ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationLecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management
Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =
More information17 Nested and Higher Order Designs
54 17 Nested and Hgher Order Desgns 17.1 Two-Way Analyss of Varance Consder an experment n whch the treatments are combnatons of two or more nfluences on the response. The ndvdual nfluences wll be called
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationProfessor Chris Murray. Midterm Exam
Econ 7 Econometrcs Sprng 4 Professor Chrs Murray McElhnney D cjmurray@uh.edu Mdterm Exam Wrte your answers on one sde of the blank whte paper that I have gven you.. Do not wrte your answers on ths exam.
More informationLECTURE 9 CANONICAL CORRELATION ANALYSIS
LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of
More informationBiostatistics. Chapter 11 Simple Linear Correlation and Regression. Jing Li
Bostatstcs Chapter 11 Smple Lnear Correlaton and Regresson Jng L jng.l@sjtu.edu.cn http://cbb.sjtu.edu.cn/~jngl/courses/2018fall/b372/ Dept of Bonformatcs & Bostatstcs, SJTU Recall eat chocolate Cell 175,
More information