UCLA STAT 13 Introduction to Statistical Methods for the Life and Health Sciences. Chapter 11 Analysis of Variance - ANOVA. Instructor: Ivo Dinov,
|
|
- Kristin Phelps
- 5 years ago
- Views:
Transcription
1 UCLA STAT 3 ntroducton to Statstcal Methods for the Lfe and Health Scences nstructor: vo Dnov, Asst. Prof. of Statstcs and Neurology Chapter Analyss of Varance - ANOVA Teachng Assstants: Fred Phoa, Anwer Khan, Mng Zheng & Matlda Hseh Unversty of Calforna, Los Angeles, Fall Slde Slde Comparng the Means of ndependent Samples n Chapter 7 we consdered the comparsons of two ndependent group means usng the ndependent t test We need to expand our thnkng to compare ndependent samples The procedure we wll use s called Analyss of Varance (ANOVA) Comparng the Means of ndependent Samples Example: 5 varetes of peas are currently beng tested by a large agrbusness cooperatve to determne whch s best suted for producton. A feld was dvded nto 0 plots, wth each varety of peas planted n four plots. The yelds (n bushels of peas) produced from each plot are shown n the table below: Varety of Pea A B C D E Slde 3 Slde 4 Comparng the Means of ndependent Samples ssues n ANOVA n applyng ANOVA, the data are regarded as random samples from k populatons Notaton (let sub-ndces A, B, etc ): Populaton means: µ, µ, µ 3, µ 4, µ 5 Populaton standard devatons: σ, σ, σ 3, σ 4, σ 5 We have fve group means to compare Why not just carry out a bunch of t tests? Repeated t tests would mean: Ho: µ µ Ho: µ µ 3 Ho: µ 3 µ 4 Ho: µ 4 µ 5 Ho: µ µ 4 Ho: µ µ 5 Etc 5 0 We would have to make What s so bad about that? comparsons Slde 5 Slde 6
2 ssues n ANOVA Each test s carred out at α 0.05, so a type error s 5% for each The overall rsk of a type error s larger than 0.05 and gets larger as the number of groups () gets larger SOLUTON: Need to make multple comparsons wth an overall error of α 0.05 (or whchever level s specfed). ssues n ANOVA There are other postve aspects of usng ANOVA: Can see f there s a trend wthn the groups; low to hgh Estmaton of the standard devaton Global sharng of nformaton of all data yelds precson n the analyss The man dea behnd ANOVA s that we need to know how much nherent varablty there s n the data before we can judge whether there s a dfference n the sample means Slde 7 Slde 8 ssues n ANOVA ssues n ANOVA To make an nference about means we compare two types of varablty: varablty between sample means varablty wthn each group ndvdual Value Plot of yeld vs varety t s very mportant that we keep these two types of varablty n mnd as we work through the followng formulas t s our goal to come up wth a numerc quantty that descrbes each of these varablty s yeld A wthn B C varety between D E Slde 9 Slde 0 ssues n ANOVA The Basc ANOVA wthn Slde between Because we now have groups each wth t s own observatons, we need to modfy our notaton Notaton: y j group observaton j For the pea example: y 6. y 4.3 y 9. y 54. Slde
3 The Basc ANOVA More notaton: number of groups n number of observatons n group n * total number of observatons n + n + + n The Basc ANOVA Formulae: The group mean for group s: The grand mean s: y.. n n y j j * n y j j. n y To compute the dfference between the means we wll compare each group mean to the grand mean Slde 3 Slde 4 Varaton Between Groups Varaton Between Groups Goal # s to descrbe the varaton between the groups means RECALL: For the ndependent t test we descrbed the dfference between two group means as y y n ANOVA we descrbe the dfference between means as sums of squares between: SS(between) n ( y. ) Can be though of as the dfference between each group mean and the grand mean look at the formula As our other measures of varaton have used n the past s degrees of freedom, SS(between) also has degrees of freedom df (between) Fnally our measure of between group varablty s mean square between: MS(between) SS( between) df ( between) Ths measures varablty between the sample means Slde 5 Slde 6 Varaton Wthn Groups Varaton Wthn Groups Goal # s to descrbe the varaton wthn the groups RECALL: To measure the varablty wthn a sngle sample we used: ( y y ) s n n ANOVA to descrbe the combned varaton wthn groups we use sums of squares wthn: SS(wthn) ( yj y. ) j Can be though of as the combnaton of varaton wthn the groups Slde 7 SS(wthn) also has degrees of freedom df (wthn) n* - Fnally our measure of wthn varablty s mean square wthn: MS(wthn) SS( wthn) df ( wthn) Ths s a measure of varablty wthn the groups Slde 8 3
4 More on MS (wthn) The quantty for MS(wthn) s a measure of varablty wthn the groups f there were only one group wth n observatons, then n SS(wthn) ( y j y) df(wthn) n* - MS(wthn) j n ( y j y) j n Ths was s from chapter! More on MS (wthn) ANOVA deals wth several groups smultaneously. MS(wthn) s a combnaton of the varances of the groups t s poolng together measurements of varablty from the dfferent groups Wth smlar logc MS(wthn) for two groups can be transformed nto the pooled standard devaton remember our talk n chapter 7 about the pooled and unpooled methods? S pooled MS(wthn) Slde 9 Slde 0 A Fundamental Relatonshp of ANOVA The last formula based dscusson we need to have s regardng the total varablty n the data y y y. + y. ( ) ( ) ( ) j j A Fundamental Relatonshp of ANOVA Ths also corresponds to the sums of squares: ( yj ) ( yj y. ) + n ( y. ) j j Ths means SS(total) SS(wthn) + SS(between) Devaton of an observaton from the grand mean Total varablty wthn between SS(total) measures the varablty among all n * observatons n the groups df(total) df(wthn) + df(between) (n* - ) + ( ) n* - Slde Slde ANOVA Calculatons ANOVA Calculatons You ve probably notced that we haven t crunched any of these numbers yet Calculatons are farly ntense Computers are gong to rescue us: SOCR Slde 3 Example: peas (cont ) NOTE: between and wthn varances may be referred to as: SST (treatmentvarety) and SSE (Error, wthn) One-way ANOVA: yeld versus varety Source DF SS MS F P varety Error Total S.889 R-Sq 86.47% R-Sq(adj) 8.86% ndvdual 95% Cs For Mean Based on Pooled StDev Level N Mean StDev A (----*----) B (----*----) C (----*----) D (----*----) E (----*----) Pooled StDev.889 Slde 4 4
5 The ANOVA table Standard for all ANOVA s also helps keep you organzed Source df SS MS SS( between) ( ) Between n y. df ( between) SS( wthn) ( ) Wthn n * yj y. j df ( wthn) ( ) Total n * - yj j Ths s our hypothess test for ANOVA # General form of the hypotheses: H o : µ µ µ H a : at least two of the µ k s are dfferent H o s compound when >, so rejectng H o doesn't tell us whch µ k 's are not equal, only that two are dfferent Slde 5 Slde 6 # The test statstc: MS( between) F s MS( wthn) F s wll be large f there s a lot of between varaton when compared to the wthn varaton dscrepances n the means are large relatve to the varablty wthn the groups #3 The p-value based on the F dstrbuton named after Fsher depends on numerator df and denomnator df Table 0 pgs (or SOCR resource) #4 The concluson (TBD) Large values of F s provde evdence aganst H o Slde 7 Slde 8 Example s there a sgnfcant dfference between these 3 groups at α 0.05? MS( between) MSST SST / df F ~ F(,4) MS( wthn) MSSE MSSE / df SST / 9.86 / 3.4; p value 0.07 (SOCR) MSSE / 4 3/ y.86; SST SS( Between) 7 n ( y. ) (.36) + 3(0.86) + (.64) 9.86 SSE SS( Wthn) ( yj y. ) j [ ] + [ ] + [ ] 3 H : some µ µ j Reject H o! A Slde 9 N S µ H : µ µ... µ o A B C Example: Peas (cont ) Do the data provde evdence to suggest that there s a dfference n yeld among the fve varetes of peas? Test usng α H o : µ µ µ where A, B, etc H a : at least two of the µ k s are dfferent Slde 30 5
6 One-way ANOVA: yeld versus varety Source DF SS MS F P F varety Error Total p S.889 R-Sq 86.47% R-Sq(adj) 8.86% ndvdual 95% Cs For Mean Based on Pooled StDev Level N Mean StDev A (----*----) B (----*----) C (----*----) D (----*----) E (----*----) Pooled StDev.889 Because < 0.05 we wll reject H o. CONCLUSON: The data show that at least two of the true mean yelds of the fve varetes of peas, are statstcally sgnfcantly dfferent (p 0.000). Notce we can only say that at least two of the means are dfferent not whch two are dfferent! not all means are dfferent! Slde 3 Slde 3 Example: Peas (cont ) Suppose we need to get the p-value usng the table: Back to bracketng! numerator df 4 denomnator df 5 p < 0.000, so we wll agan reject H o Don t need to worry about doublng! Practce Example: Parents are frequently concerned when ther chld seems slow to begn walkng. n 97 Scence reported on an experment n whch the effects of several dfferent treatments on the age at whch a chld s frst walks were compared. Chldren n the frst group were gven specal walkng exercses for mnutes daly begnnng at the age week and lastng 7 weeks. The second group of chldren receved daly exercses, but not the walkng exercses admnstered to the frst group. The thrd and forth groups receved no specal treatment and dffered only n that the thrd group s progress was checked weekly and the forth was checked only at the end of the study. Observatons on age (months) when the chld began to walk are on the next slde Slde 33 Slde 34 Practce Practce Grp_ Grp_ Grp_3 Grp_ Suppose and n ( y.) j y j ( y. ) H o : µ µ µ 3 µ 4 H a : at least two of the µ k s are dfferent Source df SS MS F Between Wthn Total Slde 35 Slde 36 6
7 Practce Wth 3 numerator df and 9 denomnator df 0. < p < 0., so we fal to reject H o CONCLUSON: These data show that a chld's true mean walkng age s not statstcally sgnfcantly dfferent among any of the four treatment groups (0.< p < 0.). Now you try to replcate these results usng the computer and the fle walkng.mtw Slde 37 Practce One-way ANOVA: age versus treatment Source DF SS MS F P treatment Error Total S.56 R-Sq 5.8% R-Sq(adj) 3.48% ndvdual 95% Cs For Mean Based on Pooled StDev Level N Mean StDev ( * ) ( * ) ( * ) ( * ) Pooled StDev.56 Slde 38 Applcablty of Methods Standard Condtons ANOVA s vald f:. Desgn condtons: a. Reasonable that groups of observatons are random samples from ther respectve populatons. Observatons wthn each group must be ndependent of one another. b. The samples must be ndependent. Populaton condtons: - The populaton dstrbutons must be approxmately normal wth equal standard devatons σ σ σ * normalty s less crucal n the sample szes are large Applcablty of Methods Verfcaton of Condtons look for bas, herarchy, and dependence. normalty and normal probablty plot of each group. standard devatons are approxmately equal f (RULE OF THUMB): largest sd < smallest sd f not, we cannot be confdent n our p-value from the F dstrbuton Slde 39 Slde 40 Once we reject Ho for the ANOVA, we know that at least two of the µ k s are dfferent We need to fnd whch group means are dfferent, but we shouldn t use a bunch of ndependent t tests We dscussed n secton. that each ndependent t test for each two group combnaton can nflate the overall rsk of a type error A naïve approach would be to calculate one sample C s for the mean usng the pooled standard devaton assumpton that the sd s were approx. equal look for overlap n the C s, but the problem s that these are stll 95% C s wth each alpha 0.05 ndvdual 95% Cs For Mean Based on Pooled StDev Level N Mean StDev A (----*----) B (----*----) C (----*----) D (----*----) E (----*----) Slde 4 Slde 4 7
8 A better soluton s to compare each group wth an overall α of for ths we use a technque called a multple comparson (MC) procedure The dea s to compare means two at a tme at a reduced sgnfcance level, to ensure an "overall There are many dfferent MC Bonferron: smple and conservatve Each C calculated wth (overall error rate)/(# of comparsons) Newman-Keuls: less conservatve/more powerful, but complcated Tukey procedure: easy to use wth MTB We wll focus on the Tukey method Uses confdence ntervals for the dfference n means Confdence ntervals smlar to those n Chapter 7, for the dfference of two means usng an adjusted α RECALL: The zero rule We wll rely on the computer to calculate these ntervals Slde 43 Slde 44 Tukey 95% Smultaneous Confdence ntervals All Parwse Comparsons among Levels of varety ndvdual confdence level 99.5% varety A subtracted from: varety Lower Center Upper B (----*----) C (----*----) D (----*----) E (----*----) varety B subtracted from: varety Lower Center Upper C (----*-----) D (----*----) E (----*----) varety C subtracted from: varety Lower Center Upper D (-----*----) E (----*----) varety D subtracted from: varety Lower Center Upper E (----*-----) Slde 45 What does ths mean? The best was to summarze would be to thnk of the means n order from large to small and sght the dfferences (not necessary to repeat): The true mean yeld for varety A s statstcally sgnfcantly dfferent than the true means of varetes C, and E The true mean yeld for varety B s statstcally sgnfcantly dfferent than the true means of varetes D, and E The true mean yeld for varety C s statstcally sgnfcantly dfferent than the true means of varety A, D, and E (however C vs. A was prevously mentoned) Slde ndvdual Value Plot of yeld vs varety Example: Walkng age (cont ) yeld We do not need to carry out Tukey s test for ths data why? F.4, p A B C varety D E Slde 47 Slde 48 8
9 Tukey 95% Smultaneous Confdence ntervals All Parwse Comparsons among Levels of treatment ndvdual confdence level 98.89% treatment subtracted from: treatment Lower Center Upper ( * ) ( * ) ( * ) treatment subtracted from: treatment Lower Center Upper ( * ) ( * ) treatment 3 subtracted from: treatment Lower Center Upper ( * ) Slde 49 9
x = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationSTATISTICS QUESTIONS. Step by Step Solutions.
STATISTICS QUESTIONS Step by Step Solutons www.mathcracker.com 9//016 Problem 1: A researcher s nterested n the effects of famly sze on delnquency for a group of offenders and examnes famles wth one to
More informationTopic- 11 The Analysis of Variance
Topc- 11 The Analyss of Varance Expermental Desgn The samplng plan or expermental desgn determnes the way that a sample s selected. In an observatonal study, the expermenter observes data that already
More informationBOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu
BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More information/ n ) are compared. The logic is: if the two
STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence
More informationJoint Statistical Meetings - Biopharmaceutical Section
Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours
UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x
More informationChapter 11: I = 2 samples independent samples paired samples Chapter 12: I 3 samples of equal size J one-way layout two-way layout
Serk Sagtov, Chalmers and GU, February 0, 018 Chapter 1. Analyss of varance Chapter 11: I = samples ndependent samples pared samples Chapter 1: I 3 samples of equal sze one-way layout two-way layout 1
More informationChapter 14 Simple Linear Regression
Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationLecture 6 More on Complete Randomized Block Design (RBD)
Lecture 6 More on Complete Randomzed Block Desgn (RBD) Multple test Multple test The multple comparsons or multple testng problem occurs when one consders a set of statstcal nferences smultaneously. For
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationTopic 23 - Randomized Complete Block Designs (RCBD)
Topc 3 ANOVA (III) 3-1 Topc 3 - Randomzed Complete Block Desgns (RCBD) Defn: A Randomzed Complete Block Desgn s a varant of the completely randomzed desgn (CRD) that we recently learned. In ths desgn,
More informationF statistic = s2 1 s 2 ( F for Fisher )
Stat 4 ANOVA Analyss of Varance /6/04 Comparng Two varances: F dstrbuton Typcal Data Sets One way analyss of varance : example Notaton for one way ANOVA Comparng Two varances: F dstrbuton We saw that the
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationexperimenteel en correlationeel onderzoek
expermenteel en correlatoneel onderzoek lecture 6: one-way analyss of varance Leary. Introducton to Behavoral Research Methods. pages 246 271 (chapters 10 and 11): conceptual statstcs Moore, McCabe, and
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationLecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management
Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationANOVA. The Observations y ij
ANOVA Stands for ANalyss Of VArance But t s a test of dfferences n means The dea: The Observatons y j Treatment group = 1 = 2 = k y 11 y 21 y k,1 y 12 y 22 y k,2 y 1, n1 y 2, n2 y k, nk means: m 1 m 2
More informationAnswers Problem Set 2 Chem 314A Williamsen Spring 2000
Answers Problem Set Chem 314A Wllamsen Sprng 000 1) Gve me the followng crtcal values from the statstcal tables. a) z-statstc,-sded test, 99.7% confdence lmt ±3 b) t-statstc (Case I), 1-sded test, 95%
More information7.1. Single classification analysis of variance (ANOVA) Why not use multiple 2-sample 2. When to use ANOVA
Sngle classfcaton analyss of varance (ANOVA) When to use ANOVA ANOVA models and parttonng sums of squares ANOVA: hypothess testng ANOVA: assumptons A non-parametrc alternatve: Kruskal-Walls ANOVA Power
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationMultiple Contrasts (Simulation)
Chapter 590 Multple Contrasts (Smulaton) Introducton Ths procedure uses smulaton to analyze the power and sgnfcance level of two multple-comparson procedures that perform two-sded hypothess tests of contrasts
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More information18. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III US Domestc Beers: Calores vs. % Alcohol Ftted Values and Resduals To each observed x, there corresponds a y-value on the ftted lne, y ˆ ˆ = α + x. The are called ftted values.
More informationY = β 0 + β 1 X 1 + β 2 X β k X k + ε
Chapter 3 Secton 3.1 Model Assumptons: Multple Regresson Model Predcton Equaton Std. Devaton of Error Correlaton Matrx Smple Lnear Regresson: 1.) Lnearty.) Constant Varance 3.) Independent Errors 4.) Normalty
More information28. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III Ftted Values and Resduals US Domestc Beers: Calores vs. % Alcohol To each observed x, there corresponds a y-value on the ftted lne, y ˆ = βˆ + βˆ x. The are called ftted
More informationUnit 8: Analysis of Variance (ANOVA) Chapter 5, Sec in the Text
Unt 8: Analyss of Varance (ANOVA) Chapter 5, Sec. 13.1-13. n the Text Unt 8 Outlne Analyss of Varance (ANOVA) General format and ANOVA s F-test Assumptons for ANOVA F-test Contrast testng Other post-hoc
More informationChapter 15 - Multiple Regression
Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More informationIntroduction to Regression
Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes
More informationChapter 3 Describing Data Using Numerical Measures
Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The
More informationReduced slides. Introduction to Analysis of Variance (ANOVA) Part 1. Single factor
Reduced sldes Introducton to Analss of Varance (ANOVA) Part 1 Sngle factor 1 The logc of Analss of Varance Is the varance explaned b the model >> than the resdual varance In regresson models Varance explaned
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationHere is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)
Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,
More information# c i. INFERENCE FOR CONTRASTS (Chapter 4) It's unbiased: Recall: A contrast is a linear combination of effects with coefficients summing to zero:
1 INFERENCE FOR CONTRASTS (Chapter 4 Recall: A contrast s a lnear combnaton of effects wth coeffcents summng to zero: " where " = 0. Specfc types of contrasts of nterest nclude: Dfferences n effects Dfferences
More information1-FACTOR ANOVA (MOTIVATION) [DEVORE 10.1]
1-FACTOR ANOVA (MOTIVATION) [DEVORE 10.1] Hgh varance between groups Low varance wthn groups s 2 between/s 2 wthn 1 Factor A clearly has a sgnfcant effect!! Low varance between groups Hgh varance wthn
More informationChapter 13 Analysis of Variance and Experimental Design
Chapter 3 Analyss of Varance and Expermental Desgn Learnng Obectves. Understand how the analyss of varance procedure can be used to determne f the means of more than two populatons are equal.. Know the
More informationLearning Objectives for Chapter 11
Chapter : Lnear Regresson and Correlaton Methods Hldebrand, Ott and Gray Basc Statstcal Ideas for Managers Second Edton Learnng Objectves for Chapter Usng the scatterplot n regresson analyss Usng the method
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationDefinition. Measures of Dispersion. Measures of Dispersion. Definition. The Range. Measures of Dispersion 3/24/2014
Measures of Dsperson Defenton Range Interquartle Range Varance and Standard Devaton Defnton Measures of dsperson are descrptve statstcs that descrbe how smlar a set of scores are to each other The more
More informationNANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis
NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION 014-015 MTH35/MH3510 Regresson Analyss December 014 TIME ALLOWED: HOURS INSTRUCTIONS TO CANDIDATES 1. Ths examnaton paper contans FOUR (4) questons
More informationBasically, if you have a dummy dependent variable you will be estimating a probability.
ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy
More informationIntroduction to Analysis of Variance (ANOVA) Part 1
Introducton to Analss of Varance (ANOVA) Part 1 Sngle factor The logc of Analss of Varance Is the varance explaned b the model >> than the resdual varance In regresson models Varance explaned b regresson
More informationChapter 5 Multilevel Models
Chapter 5 Multlevel Models 5.1 Cross-sectonal multlevel models 5.1.1 Two-level models 5.1.2 Multple level models 5.1.3 Multple level modelng n other felds 5.2 Longtudnal multlevel models 5.2.1 Two-level
More informationStatistics MINITAB - Lab 2
Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that
More informationANSWERS CHAPTER 9. TIO 9.2: If the values are the same, the difference is 0, therefore the null hypothesis cannot be rejected.
ANSWERS CHAPTER 9 THINK IT OVER thnk t over TIO 9.: χ 2 k = ( f e ) = 0 e Breakng the equaton down: the test statstc for the ch-squared dstrbuton s equal to the sum over all categores of the expected frequency
More informationSTAT 511 FINAL EXAM NAME Spring 2001
STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte
More informationCHAPTER IV RESEARCH FINDING AND DISCUSSIONS
CHAPTER IV RESEARCH FINDING AND DISCUSSIONS A. Descrpton of Research Fndng. The Implementaton of Learnng Havng ganed the whole needed data, the researcher then dd analyss whch refers to the statstcal data
More informationTopic 7: Analysis of Variance
Topc 7: Analyss of Varance Outlne Parttonng sums of squares Breakdown the degrees of freedom Expected mean squares (EMS) F test ANOVA table General lnear test Pearson Correlaton / R 2 Analyss of Varance
More informationA Method for Analyzing Unreplicated Experiments Using Information on the Intraclass Correlation Coefficient
Journal of Modern Appled Statstcal Methods Volume 5 Issue Artcle 7 --5 A Method for Analyzng Unreplcated Experments Usng Informaton on the Intraclass Correlaton Coeffcent Jams J. Perrett Unversty of Northern
More informationChapter 12 Analysis of Covariance
Chapter Analyss of Covarance Any scentfc experment s performed to know somethng that s unknown about a group of treatments and to test certan hypothess about the correspondng treatment effect When varablty
More informationU-Pb Geochronology Practical: Background
U-Pb Geochronology Practcal: Background Basc Concepts: accuracy: measure of the dfference between an expermental measurement and the true value precson: measure of the reproducblty of the expermental result
More informationCS-433: Simulation and Modeling Modeling and Probability Review
CS-433: Smulaton and Modelng Modelng and Probablty Revew Exercse 1. (Probablty of Smple Events) Exercse 1.1 The owner of a camera shop receves a shpment of fve cameras from a camera manufacturer. Unknown
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More informationCorrelation and Regression
Correlaton and Regresson otes prepared by Pamela Peterson Drake Index Basc terms and concepts... Smple regresson...5 Multple Regresson...3 Regresson termnology...0 Regresson formulas... Basc terms and
More informationThe optimal delay of the second test is therefore approximately 210 hours earlier than =2.
THE IEC 61508 FORMULAS 223 The optmal delay of the second test s therefore approxmately 210 hours earler than =2. 8.4 The IEC 61508 Formulas IEC 61508-6 provdes approxmaton formulas for the PF for smple
More informationUsing Multivariate Rank Sum Tests to Evaluate Effectiveness of Computer Applications in Teaching Business Statistics
Usng Multvarate Rank Sum Tests to Evaluate Effectveness of Computer Applcatons n Teachng Busness Statstcs by Yeong-Tzay Su, Professor Department of Mathematcs Kaohsung Normal Unversty Kaohsung, TAIWAN
More informationStatistical tables are provided Two Hours UNIVERSITY OF MANCHESTER. Date: Wednesday 4 th June 2008 Time: 1400 to 1600
Statstcal tables are provded Two Hours UNIVERSITY OF MNCHESTER Medcal Statstcs Date: Wednesday 4 th June 008 Tme: 1400 to 1600 MT3807 Electronc calculators may be used provded that they conform to Unversty
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More information4.1. Lecture 4: Fitting distributions: goodness of fit. Goodness of fit: the underlying principle
Lecture 4: Fttng dstrbutons: goodness of ft Goodness of ft Testng goodness of ft Testng normalty An mportant note on testng normalty! L4.1 Goodness of ft measures the extent to whch some emprcal dstrbuton
More informationJanuary Examinations 2015
24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)
More informationCHAPTER IV RESEARCH FINDING AND ANALYSIS
CHAPTER IV REEARCH FINDING AND ANALYI A. Descrpton of Research Fndngs To fnd out the dfference between the students who were taught by usng Mme Game and the students who were not taught by usng Mme Game
More informationStatistical Inference. 2.3 Summary Statistics Measures of Center and Spread. parameters ( population characteristics )
Ismor Fscher, 8//008 Stat 54 / -8.3 Summary Statstcs Measures of Center and Spread Dstrbuton of dscrete contnuous POPULATION Random Varable, numercal True center =??? True spread =???? parameters ( populaton
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationLecture 16 Statistical Analysis in Biomaterials Research (Part II)
3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan
More informationLINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables
LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory
More informationDO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes
25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton
More informationBETWEEN-PARTICIPANTS EXPERIMENTAL DESIGNS
1 BETWEEN-PARTICIPANTS EXPERIMENTAL DESIGNS I. Sngle-factor desgns: the model s: y j = µ + α + ε j = µ + ε j where: y j jth observaton n the sample from the th populaton ( = 1,..., I; j = 1,..., n ) µ
More informationComparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method
Appled Mathematcal Scences, Vol. 7, 0, no. 47, 07-0 HIARI Ltd, www.m-hkar.com Comparson of the Populaton Varance Estmators of -Parameter Exponental Dstrbuton Based on Multple Crtera Decson Makng Method
More informationwhere I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).
11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e
More informationDurban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications
Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an
More information17 - LINEAR REGRESSION II
Topc 7 Lnear Regresson II 7- Topc 7 - LINEAR REGRESSION II Testng and Estmaton Inferences about β Recall that we estmate Yˆ ˆ β + ˆ βx. 0 μ Y X x β0 + βx usng To estmate σ σ squared error Y X x ε s ε we
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study
More informationBayesian Learning. Smart Home Health Analytics Spring Nirmalya Roy Department of Information Systems University of Maryland Baltimore County
Smart Home Health Analytcs Sprng 2018 Bayesan Learnng Nrmalya Roy Department of Informaton Systems Unversty of Maryland Baltmore ounty www.umbc.edu Bayesan Learnng ombnes pror knowledge wth evdence to
More informationDrPH Seminar Session 3. Quantitative Synthesis. Qualitative Synthesis e.g., GRADE
DrPH Semnar Sesson 3 Quanttatve Synthess Focusng on Heterogenety Qualtatve Synthess e.g., GRADE Me Chung, PhD, MPH Research Assstant Professor Nutrton/Infecton Unt, Department of Publc Health and Communty
More informationModeling and Simulation NETW 707
Modelng and Smulaton NETW 707 Lecture 5 Tests for Random Numbers Course Instructor: Dr.-Ing. Magge Mashaly magge.ezzat@guc.edu.eg C3.220 1 Propertes of Random Numbers Random Number Generators (RNGs) must
More informationGeneral Linear Models
General Lnear Models Revsed: 10/10/2017 Summary... 2 Analyss Summary... 6 Analyss Optons... 10 Model Coeffcents... 11 Scatterplot... 14 Table of Means... 15 Means Plot... 16 Interacton Plot... 19 Multple
More informationCHAPTER 6 GOODNESS OF FIT AND CONTINGENCY TABLE PREPARED BY: DR SITI ZANARIAH SATARI & FARAHANIM MISNI
CHAPTER 6 GOODNESS OF FIT AND CONTINGENCY TABLE Expected Outcomes Able to test the goodness of ft for categorcal data. Able to test whether the categorcal data ft to the certan dstrbuton such as Bnomal,
More informationCHAPTER 8. Exercise Solutions
CHAPTER 8 Exercse Solutons 77 Chapter 8, Exercse Solutons, Prncples of Econometrcs, 3e 78 EXERCISE 8. When = N N N ( x x) ( x x) ( x x) = = = N = = = N N N ( x ) ( ) ( ) ( x x ) x x x x x = = = = Chapter
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationa. (All your answers should be in the letter!
Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal
More information