experimenteel en correlationeel onderzoek
|
|
- Randolph Clarke
- 6 years ago
- Views:
Transcription
1 expermenteel en correlatoneel onderzoek lecture 6: one-way analyss of varance Leary. Introducton to Behavoral Research Methods. pages (chapters 10 and 11): conceptual statstcs Moore, McCabe, and Crag. Introducton to the Practce of Statstcs. pages (chapter 12): one-way analyss of varance pages (chapter 12): multple comparsons addtonal texts: 6, 7, and 8 Frank Busng, Leden Unversty, the Netherlands 1/40 ntroducton relaton between consumpton of alcohol and partner selecton n cafe s, dsco s, or nght-clubs research queston does subjectve percepton of physcal attractveness becomes more naccurate wth an ncreased alcohol level? three expermental groups (ndependent, categorcal varable, alcohol): 1 1. no alcohol group: some alcohol free beers (no alcohol whatsoever) 2. low alcohol group: some regular beers 3. hgh alcohol group: some strong beers (nce Belgum trples) dependent, nterval varable (attractveness): some objectve measure of the attractveness of the partner selected at the end of the evenng (values between 0 and 100) note: random assgnment to groups 2/40
2 hypothess research queston: s there a dfference n attractveness scores between the no alcohol, low alcohol, or hgh alcohol populatons? hypothess (always n terms of populaton parameters) H 0 : µ 1 = µ 2 = µ 3 H a : at least one µ µ j are the populaton means the same? or s there a dfference between at least two populaton means? 2 of course there s, but 3 s the dfference bg enough to dstngush t from samplng varablty? or s the dfference bg enough to pass some crtcal value? note: µ s the mean of populaton note: nformaton on varaton (CI) and sample sze (samplng dstrbuton) 3/40 soluton: t-tests we mght use a seres of t-tests n that case we have to do k(k 1)/2 tests (here 3): 4 1 test no alcohol versus low alcohol 2 test no alcohol versus hgh alcohol 3 test low alcohol versus hgh alcohol ths s possble, but holds a serous (type I error, type II error, power) problem, whch wll be solved later (when dscussng multple comparsons) note: k = number of groups 4/40
3 soluton: F-test between-group varablty wthn-group varablty no low hgh total total varablty splt the total sum-of-squares (SST) n a between-groups sum-of-squares (SSG) and a wthn-groups sum-of-squares (SSE) 5 SST = SSG + SSE the proporton varance explaned or the varance accounted for by the groups s VAF = SSG/SST note: sum-of-squares s used as a measure of varablty 5/40 soluton: F-test 90 between-group varablty 90 between-group varablty wthn-group varablty no low hgh 10 0 wthn-group varablty no low hgh between wthn = small between wthn = large 6/40
4 analyss of varance one-way analyss of varance one-way analyss of varance s an approprate analyss method for a study wth one quanttatve outcome varable and one categorcal explanatory varable 7/40 analyss of varance ANOVA Attractveness of Date Sum of Squares df Mean Square F Sg. Between Groups Wthn Groups Total hypothess: H 0 : µ 1 = µ 2 = µ 3 H a : at least one µ µ j statstcal concluson: H 0 s rejected, snce F > F or, equvalently, p < α substantve concluson: at least two alcohol groups dffer sgnfcantly n the mean attractveness of the partner at the end of the evenng 8/40
5 notaton source SS DF MS F p between groups SSG DFG MSG F p wthn groups SSE DFE MSE total SST DFT k s the number of groups (sometmes denoted as I) n s the sze of group N = n n k s the total sample sze x j s the score of subject j n group x s the mean of the scores for group (also denoted as x. ) x s the overall mean of the scores x j (sometmes denoted as x.. ) k n j s the sum over all subjects, arranged per group 9/40 total source SS DF MS F p between groups wthn groups total j (x j x) 2 N 1 SST = k n (x j x) 2 j DFT = N 1 SST DFT = total varance SSG 10 0 SSE SST no low hgh total 6 note: SS s the sum of N squared dfferences 10/40
6 between groups source SS DF MS F p between groups n (x x) 2 k 1 SSG/DFG wthn groups total SSG = = k n (x x) 2 j k n (x x) 2 DFG = k 1 MSG = SSG DFG j (x j x) 2 N SSE SSG SST no low hgh total 7 note: SS s the sum of N squared dfferences 11/40 wthn groups source SS DF MS F p between groups n (x x) 2 k 1 SSG/DFG wthn groups j (x j x ) 2 N k SSE/DFE total j (x j x) 2 N 1 SSE = k n (x j x ) 2 j DFE = N k MSE = SSE DFE SSG 10 0 SSE SST no low hgh total 8 note: SS s the sum of N squared dfferences 12/40
7 wrappng up source SS DF MS F p between groups n (x x) 2 k 1 SSG/DFG MSG/MSE table wthn groups j (x j x ) 2 N k SSE/DFE total j (x j x) 2 N 1 F = MSG MSE and remember that SST = SSG+SSE DFT = DFG+DFE = (N k)+(k 1) = N 1 p can be found n the table for crtcal values (F-dstrbuton) at F (DFG,DFE) 13/40 notes on F-test F = MSG/MSE f there s no effect for the ndependent varable (groups) then MSG estmates the same as MSE, or even less, because the group means are about equal to the overall mean, and the rato F 1.0 but, on the other hand f there s an effect for the ndependent varable (groups) then MSG wll be greater than MSE and the rato F > 1.0 possbly even larger than some crtcal value F crtcal values are found at F (DFG,DFE) = F (numerator,denomnator) the F-test n an ANOVA s an omnbus test t s an overall test that checks for at least one dfference although the hypothess s two-sded: dfferences n populaton means, the F-test n an ANOVA s always one-sded above all, a sgnfcant larger MSE s not what we re lookng for 14/40
8 effect szes suppose we found a sgnfcant result (F > F ) and at least one populaton mean dffers from another populaton mean s there an effect? does t mean anythng? s the dfference bg enough for mpact? what s the sze of the effect? measures for assocaton strength or proportonate reducton n error (PRE) frst, remember that test statstc = effect sze sample sze we may thus use an effect sze, but: 9 effect sze usage always look at the substantve sgnfcance of the results by placng them n a meanngful context and quantfyng ther contrbuton to knowledge note: IQ versus length 15/40 effect szes effect szes for one-way analyss of varance η 2 (eta squared) η 2 = SSG SST η 2 s the analyss-of-varance-name of R 2 = VAF = COD = η 2 η 2 s based on sample statstcs and often overestmates the populaton value 10 ω 2 corrects for ths overestmaton ω 2 (omega hat squared) ω 2 = SSG - DFG MSE SST + MSE ω 2 < η 2 snce the numerator decreases and the denomnator ncreases note: effect szes: small:.01; medum:.06; large:.14 16/40
9 one-way analyss of varance general lnear model for one-way ANOVA x j = µ+α + ǫ }{{}}{{} j }{{} data = ft + resdual assumpton: ǫ j N(0,σ), where σ s the common standard devaton compare: Moore, McCabe, and Crag: x j = µ +ǫ j, where µ = µ+α compare: multple regresson model: y = ŷ +ǫ, where ŷ = b 0 +b j x j components: µ s estmated by x = 1 N k n j x j µ s estmated by x = 1 n n j x j effect parameter α s estmated by x x 17/40 degrees of freedom (DF) source sze mean std.devaton no alcohol low alcohol hgh alcohol total DFG = k 1 DFE = N k DFT = N 1 source SS DF MS F p between groups 2 wthn groups 45 total 47 18/40
10 sum-of-squares between groups (SSG) source sze mean std.devaton no alcohol low alcohol hgh alcohol total SSG = k n (x x) 2 = k n (x x) 2 = k n α 2 j effect parameter α 1 = x 1 x = = 5.21 effect parameter α 2 = x 2 x = = 6.15, etc. SSG = = source SS DF MS F p between groups wthn groups 45 total 47 19/40 total sum-of-squares (SST) source sze mean std.devaton no alcohol low alcohol hgh alcohol total SST = 1 N 1 SST = 1 N 1 k n (x j x) 2 j k n (x j x) 2 = s 2 total = total varance j so SST = (N 1)s 2 total = = source SS DF MS F p between groups wthn groups 45 total /40
11 sum-of-squares wthn groups (SSE) source sze mean std.devaton no alcohol low alcohol hgh alcohol total f SST = SSG+SSE then SSE = SST SSG = = or use the fact that MSE = s 2 p (the pooled sample varance) source SS DF MS F p between groups wthn groups total /40 sde-step: pooled sample varance sde-step: pooled sample varance wthn-groups sum-of-squares = SSE = k n j (x j x ) 2 suppose for each group, we dvde the sum-of-squares by n 1 k 1 n n 1 j (x j x ) 2 = k s 2 = sum over group varances workng n the opposte drecton thus gves SSE from the group varances for example, a for 2 groups, SSE = (n 1 1)s 2 1 +(n 2 1)s 2 2 SSE DFE = MSE = (n 1 1)s 2 1 +(n 2 1)s 2 2 n 1 +n 2 2 = s 2 p = pooled sample varance note: see book for an explanaton of t 2 = F for two groups 22/40
12 wrappng up source sze mean std.devaton no alcohol low alcohol hgh alcohol total MSG = SSG/DFG MSE = SSE/DFE fnally F = MSG/MSE and p can be found n the table of crtcal values (F-dstrbuton) at F (DFG,DFE) source SS DF MS F p between groups wthn groups total /40 analyss n steps 1 check assumptons ndependence of resduals homogenety of varances normalty of errors 2 run analyss by hand or wth SPSS compute effect sze 3 nterpret results statstcal concluson based on F and effect sze substantve concluson 4 perform addtonal tests multple comparsons 5 report results 24/40
13 step 1: check assumptons ndependence of resduals (ndependent ǫ j ) why? ndcaton for wrong (lnear) model, correct estmaton of parameters how? plot resduals aganst number, predcted outcomes, and predctors homogenety of populaton varances (σ 2 1 =... = σ2 k ) why? pooled sample varance estmates wthn-groups σ 2 how? largest less than twce the smallest standard devaton (or test) normalty of error dstrbuton (ǫ j N(0,σ)) why? for nferental purpose how? QQ-plot or (modfed) box-plot f one of the assumptons fals: 1 re-check the data for outlers and other anomales or; 2 transform the data or; 3 use nonparametrc analyss technques 25/40 step 2: run analyss dependent varable (lst): attractveness of date ndependent varable (factor): alcohol consumpton 26/40
14 step 3: nterpret results (tables) Levene Statstc Test of Homogenety of Varances Attractveness of Date df1 2 df2 45 Sg..074 ANOVA Attractveness of Date Sum of Squares df Mean Square F Sg. Between Groups Wthn Groups Total compute by hand: effect sze η 2 = SSG/SST = effect sze ω 2 = (SSG - DFG MSE)/(SST + MSE) = /40 step 3: nterpret results (plots) Mean of Attractveness of Date x 1 { 2 { x 2 x 3 { 3 No Low Alcohol Consumpton Hgh one-way anova means plot wth group means x, overall mean x, and effect parameters α 28/40
15 step 4: multple comparsons suppose, the ANOVA omnbus F-test ndcates at least one dfference multple comparsons s a seres of two-sded tests to solate the dfferences two ways of testng all dfferences: 11 1 a seres of two-sded t-tests 2 smultaneous confdence ntervals n ths case, there are k = 3 groups, so we test 1 H 0 : µ 1 = µ 2 versus H a : µ 1 µ 2 2 H 0 : µ 1 = µ 3 versus H a : µ 1 µ 3 3 H 0 : µ 2 = µ 3 versus H a : µ 2 µ 3 n general, the number of t-tests or confdence ntervals equals k (k 1)/2 note: multple comparsons are also called post-hoc, a posteror, or follow-up tests 29/40 multple comparsons problem problem: ncreased type I error α (alpha) wth a test-wse type I error α =.05 we are wrong n 5% of the cases: reject H 0 whle H 0 s true we are rght n 95% of the cases: accept H 0 whle H 0 s true the probablty of makng 3 correct decsons n a row s (chance rule 5) =.857 the actual famly-wse type I error s then gven by =.143 whch s much larger than.05 note: problem s even more serous because these t-tests are not ndependent 30/40
16 multple comparsons soluton soluton: decrease α lower the type I error α or ncrease the p value for each test conducted multple comparsons dffer n the way these values are adjusted Bonferron ether dvde α or multply p by the number of tests thus wth 3 tests the Bonferron t s based on α =.05/ and the famly-wse type I error s then gven by =.0492 a lttle conservatve (.0492 <.05), but much better than the.143 type I error level =.05 /3=.0167 px3=.045 p=.015 t* t** t and compare wth t =.05 and compare wth 31/40 multple comparsons consequence consequence: ncreased type II error and decreased power whle lowerng the type I error, we ncrease type II error and lower power because we need bgger dfferences to fnd sgnfcant results H 0 = type I error =.05 =.0167 H a = type II error power 32/40
17 multple comparsons: two-sded t-tests note that the pooled sample varance uses the nformaton on all groups not only from the two groups that are compared t j = x x j s p 1 n + 1 n j = t for group versus group j f t j t, the populaton means µ and µ j are dfferent t uses the Bonferron correcton and s thus found at t (1 [α/2]/tests,dfe) for example, compare the low and hgh alcohol groups wth n 2 = 16,n 3 = 16,x 2 = 64.69,x 3 = 47.19,s 2 p = MSE = , and α = 0.05 t j = = = t (α,dfe) = t ( ,45) t (0.005,40) = (conservatve choce) 33/40 multple comparsons: smultaneous confdence ntervals a smultaneous confdence nterval for the dfferences between means m = t 1 s p + 1 n n j ths margn of error s called the mnmum sgnfcant dfference (MSD) for example, the MSD for the low and hgh alcohol groups wth n 2 = 16,n 3 = 16,s 2 p = MSE = , and α = 0.05 m = t 1 s p + 1 = = n n j f the absolute mean dfference, x 2 x 3 = = s larger than the margn of error , the dfference s sgnfcantly dfferent from zero 34/40
18 multple comparsons: smultaneous confdence ntervals f computed by hand the mnmum sgnfcant dfference s especally useful when group szes are equal n that case, only one mnmum sgnfcant dfference needs to be computed group means x 1 = 63.75, x 2 = 64.69, and x 3 = provde the followng table wth absolute mean dfferences no alcohol low alcohol hgh alcohol no alcohol low alcohol hgh alcohol absolute mean dfferences larger than the margn of error are sgnfcantly dfferent from zero 35/40 multple comparsons: Bonferron by SPSS 36/40
19 multple comparsons: Bonferron by SPSS Attractveness of Date Bonferron (I) Alcohol Consumpton No Low Hgh (J) Alcohol Consumpton Low Hgh No Hgh No Low *. The mean dfference s sgnfcant at the 0.05 level. Multple Comparsons Mean Dfference (I-J) Std. Error Sg. 95% Confdence Interval Lower Bound Upper Bound * * * * column Mean Dfference (I-J): dfference between means of group I and J column Std.Error: s p 1/n +1/n j = MSE 1/n +1/n j column Sg.: the t-test p-value tmes the number of tests = p tests column 95% CI: (x x j )±t SE, where t s based on α = (0.05/2)/3 37/40 other post-hoc tests many methods keep the famly-wse type I error under control at the cost of an ncreased type II error (and a decreased power) the followng lst runs from most lberal to most conservatve: 1 Fsher s least sgnfcant dfference (LSD): no correcton whatsoever 2 Duncan s new multple range test: famly-wse α = 1 (1 α) tests Dunnett s test: reference group aganst the rest 4 Tukey s range test: based on studentzed range dstrbuton q 5 Sdak correcton: famly-wse α = 1 (1 α) 1/tests 6 Bonferron correcton: famly-wse α = α/tests 7 Scheffé s method methods are more or less senstve to volaton of assumptons such as homogenety of varances, normalty, and ndependence 38/40
20 step 5: report results report (n text) There was a statstcally sgnfcant dfference between groups as determned by one-way ANOVA (F(2,45) = ,p =.000). A Bonferron post-hoc test revealed statstcally sgnfcant dfferences between groups: The hgh alcohol group (47.19 ± ) attracted statstcally sgnfcantly less attractve partners than the no alcohol group (63.75±8.466,p =.000) and the low alcohol group (64.69±9.911,p =.000). There were no statstcally sgnfcant dfferences between the no alcohol and the low alcohol group (p = 1.000). 39/40 overvew fnally analyss of varance tests dfferences between groups on a numercal varable by comparng wthn and between group varances n an F-test test results are summarzed n an ANOVA table effect szes can be computed from the ANOVA table table content can be found usng raw data t can also be found usng aggregated data (means and varances) post-hoc tests (afterwards) need specal attenton for nflated type I errors an analyss of varance follows a number of commonly accepted steps 40/40
x = , so that calculated
Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationSTATISTICS QUESTIONS. Step by Step Solutions.
STATISTICS QUESTIONS Step by Step Solutons www.mathcracker.com 9//016 Problem 1: A researcher s nterested n the effects of famly sze on delnquency for a group of offenders and examnes famles wth one to
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationLecture 6 More on Complete Randomized Block Design (RBD)
Lecture 6 More on Complete Randomzed Block Desgn (RBD) Multple test Multple test The multple comparsons or multple testng problem occurs when one consders a set of statstcal nferences smultaneously. For
More information7.1. Single classification analysis of variance (ANOVA) Why not use multiple 2-sample 2. When to use ANOVA
Sngle classfcaton analyss of varance (ANOVA) When to use ANOVA ANOVA models and parttonng sums of squares ANOVA: hypothess testng ANOVA: assumptons A non-parametrc alternatve: Kruskal-Walls ANOVA Power
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationTopic- 11 The Analysis of Variance
Topc- 11 The Analyss of Varance Expermental Desgn The samplng plan or expermental desgn determnes the way that a sample s selected. In an observatonal study, the expermenter observes data that already
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationUnit 8: Analysis of Variance (ANOVA) Chapter 5, Sec in the Text
Unt 8: Analyss of Varance (ANOVA) Chapter 5, Sec. 13.1-13. n the Text Unt 8 Outlne Analyss of Varance (ANOVA) General format and ANOVA s F-test Assumptons for ANOVA F-test Contrast testng Other post-hoc
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More informationUCLA STAT 13 Introduction to Statistical Methods for the Life and Health Sciences. Chapter 11 Analysis of Variance - ANOVA. Instructor: Ivo Dinov,
UCLA STAT 3 ntroducton to Statstcal Methods for the Lfe and Health Scences nstructor: vo Dnov, Asst. Prof. of Statstcs and Neurology Chapter Analyss of Varance - ANOVA Teachng Assstants: Fred Phoa, Anwer
More informationBOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS. M. Krishna Reddy, B. Naveen Kumar and Y. Ramu
BOOTSTRAP METHOD FOR TESTING OF EQUALITY OF SEVERAL MEANS M. Krshna Reddy, B. Naveen Kumar and Y. Ramu Department of Statstcs, Osmana Unversty, Hyderabad -500 007, Inda. nanbyrozu@gmal.com, ramu0@gmal.com
More informationANSWERS CHAPTER 9. TIO 9.2: If the values are the same, the difference is 0, therefore the null hypothesis cannot be rejected.
ANSWERS CHAPTER 9 THINK IT OVER thnk t over TIO 9.: χ 2 k = ( f e ) = 0 e Breakng the equaton down: the test statstc for the ch-squared dstrbuton s equal to the sum over all categores of the expected frequency
More informationChapter 14 Simple Linear Regression
Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng
More informationCorrelation and Regression
Correlaton and Regresson otes prepared by Pamela Peterson Drake Index Basc terms and concepts... Smple regresson...5 Multple Regresson...3 Regresson termnology...0 Regresson formulas... Basc terms and
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More information18. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III US Domestc Beers: Calores vs. % Alcohol Ftted Values and Resduals To each observed x, there corresponds a y-value on the ftted lne, y ˆ ˆ = α + x. The are called ftted values.
More information28. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III Ftted Values and Resduals US Domestc Beers: Calores vs. % Alcohol To each observed x, there corresponds a y-value on the ftted lne, y ˆ = βˆ + βˆ x. The are called ftted
More informationJoint Statistical Meetings - Biopharmaceutical Section
Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve
More informationChapter 15 - Multiple Regression
Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term
More informationAnswers Problem Set 2 Chem 314A Williamsen Spring 2000
Answers Problem Set Chem 314A Wllamsen Sprng 000 1) Gve me the followng crtcal values from the statstcal tables. a) z-statstc,-sded test, 99.7% confdence lmt ±3 b) t-statstc (Case I), 1-sded test, 95%
More informationIntroduction to Regression
Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes
More informationDepartment of Statistics University of Toronto STA305H1S / 1004 HS Design and Analysis of Experiments Term Test - Winter Solution
Department of Statstcs Unversty of Toronto STA35HS / HS Desgn and Analyss of Experments Term Test - Wnter - Soluton February, Last Name: Frst Name: Student Number: Instructons: Tme: hours. Ads: a non-programmable
More information/ n ) are compared. The logic is: if the two
STAT C141, Sprng 2005 Lecture 13 Two sample tests One sample tests: examples of goodness of ft tests, where we are testng whether our data supports predctons. Two sample tests: called as tests of ndependence
More informationLecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management
Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =
More informationDurban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications
Durban Watson for Testng the Lack-of-Ft of Polynomal Regresson Models wthout Replcatons Ruba A. Alyaf, Maha A. Omar, Abdullah A. Al-Shha ralyaf@ksu.edu.sa, maomar@ksu.edu.sa, aalshha@ksu.edu.sa Department
More informationY = β 0 + β 1 X 1 + β 2 X β k X k + ε
Chapter 3 Secton 3.1 Model Assumptons: Multple Regresson Model Predcton Equaton Std. Devaton of Error Correlaton Matrx Smple Lnear Regresson: 1.) Lnearty.) Constant Varance 3.) Independent Errors 4.) Normalty
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationChapter 11: I = 2 samples independent samples paired samples Chapter 12: I 3 samples of equal size J one-way layout two-way layout
Serk Sagtov, Chalmers and GU, February 0, 018 Chapter 1. Analyss of varance Chapter 11: I = samples ndependent samples pared samples Chapter 1: I 3 samples of equal sze one-way layout two-way layout 1
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationwhere I = (n x n) diagonal identity matrix with diagonal elements = 1 and off-diagonal elements = 0; and σ 2 e = variance of (Y X).
11.4.1 Estmaton of Multple Regresson Coeffcents In multple lnear regresson, we essentally solve n equatons for the p unnown parameters. hus n must e equal to or greater than p and n practce n should e
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationF statistic = s2 1 s 2 ( F for Fisher )
Stat 4 ANOVA Analyss of Varance /6/04 Comparng Two varances: F dstrbuton Typcal Data Sets One way analyss of varance : example Notaton for one way ANOVA Comparng Two varances: F dstrbuton We saw that the
More informationANOVA. The Observations y ij
ANOVA Stands for ANalyss Of VArance But t s a test of dfferences n means The dea: The Observatons y j Treatment group = 1 = 2 = k y 11 y 21 y k,1 y 12 y 22 y k,2 y 1, n1 y 2, n2 y k, nk means: m 1 m 2
More informationBETWEEN-PARTICIPANTS EXPERIMENTAL DESIGNS
1 BETWEEN-PARTICIPANTS EXPERIMENTAL DESIGNS I. Sngle-factor desgns: the model s: y j = µ + α + ε j = µ + ε j where: y j jth observaton n the sample from the th populaton ( = 1,..., I; j = 1,..., n ) µ
More informationRegression. The Simple Linear Regression Model
Regresson Smple Lnear Regresson Model Least Squares Method Coeffcent of Determnaton Model Assumptons Testng for Sgnfcance Usng the Estmated Regresson Equaton for Estmaton and Predcton Resdual Analss: Valdatng
More information[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.
PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton
More informationLearning Objectives for Chapter 11
Chapter : Lnear Regresson and Correlaton Methods Hldebrand, Ott and Gray Basc Statstcal Ideas for Managers Second Edton Learnng Objectves for Chapter Usng the scatterplot n regresson analyss Usng the method
More informationUNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours
UNIVERSITY OF TORONTO Faculty of Arts and Scence December 005 Examnatons STA47HF/STA005HF Duraton - hours AIDS ALLOWED: (to be suppled by the student) Non-programmable calculator One handwrtten 8.5'' x
More informationChapter 3 Describing Data Using Numerical Measures
Chapter 3 Student Lecture Notes 3-1 Chapter 3 Descrbng Data Usng Numercal Measures Fall 2006 Fundamentals of Busness Statstcs 1 Chapter Goals To establsh the usefulness of summary measures of data. The
More informationLINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables
LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory
More informationBiostatistics 360 F&t Tests and Intervals in Regression 1
Bostatstcs 360 F&t Tests and Intervals n Regresson ORIGIN Model: Y = X + Corrected Sums of Squares: X X bar where: s the y ntercept of the regresson lne (translaton) s the slope of the regresson lne (scalng
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationChapter 14 Simple Linear Regression Page 1. Introduction to regression analysis 14-2
Chapter 4 Smple Lnear Regresson Page. Introducton to regresson analyss 4- The Regresson Equaton. Lnear Functons 4-4 3. Estmaton and nterpretaton of model parameters 4-6 4. Inference on the model parameters
More informationNANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis
NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION 014-015 MTH35/MH3510 Regresson Analyss December 014 TIME ALLOWED: HOURS INSTRUCTIONS TO CANDIDATES 1. Ths examnaton paper contans FOUR (4) questons
More informationStatistics Chapter 4
Statstcs Chapter 4 "There are three knds of les: les, damned les, and statstcs." Benjamn Dsrael, 1895 (Brtsh statesman) Gaussan Dstrbuton, 4-1 If a measurement s repeated many tmes a statstcal treatment
More informationOutline. EEC 686/785 Modeling & Performance Evaluation of Computer Systems. Lecture k r Factorial Designs with Replication
EEC 66/75 Modelng & Performance Evaluaton of Computer Systems Lecture 3 Department of Electrcal and Computer Engneerng Cleveland State Unversty wenbng@eee.org (based on Dr. Ra Jan s lecture notes) Outlne
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More informationFirst Year Examination Department of Statistics, University of Florida
Frst Year Examnaton Department of Statstcs, Unversty of Florda May 7, 010, 8:00 am - 1:00 noon Instructons: 1. You have four hours to answer questons n ths examnaton.. You must show your work to receve
More informationPredictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore
Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationMultiple Contrasts (Simulation)
Chapter 590 Multple Contrasts (Smulaton) Introducton Ths procedure uses smulaton to analyze the power and sgnfcance level of two multple-comparson procedures that perform two-sded hypothess tests of contrasts
More informationLecture 16 Statistical Analysis in Biomaterials Research (Part II)
3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan
More informationA nonparametric two-sample wald test of equality of variances
Unversty of Wollongong Research Onlne Centre for Statstcal & Survey Methodology Workng Paper Seres Faculty of Engneerng and Informaton Scences 0 A nonparametrc two-sample wald test of equalty of varances
More informationx yi In chapter 14, we want to perform inference (i.e. calculate confidence intervals and perform tests of significance) in this setting.
The Practce of Statstcs, nd ed. Chapter 14 Inference for Regresson Introducton In chapter 3 we used a least-squares regresson lne (LSRL) to represent a lnear relatonshp etween two quanttatve explanator
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VIII LECTURE - 34 ANALYSIS OF VARIANCE IN RANDOM-EFFECTS MODEL AND MIXED-EFFECTS EFFECTS MODEL Dr Shalabh Department of Mathematcs and Statstcs Indan
More informationJanuary Examinations 2015
24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)
More informationGeneral Linear Models
General Lnear Models Revsed: 10/10/2017 Summary... 2 Analyss Summary... 6 Analyss Optons... 10 Model Coeffcents... 11 Scatterplot... 14 Table of Means... 15 Means Plot... 16 Interacton Plot... 19 Multple
More informationLinear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the
Chapter 11 Student Lecture Notes 11-1 Lnear regresson Wenl lu Dept. Health statstcs School of publc health Tanjn medcal unversty 1 Regresson Models 1. Answer What Is the Relatonshp Between the Varables?.
More informationDO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes
25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton
More informationStatistics MINITAB - Lab 2
Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that
More informationStat 642, Lecture notes for 01/27/ d i = 1 t. n i t nj. n j
Stat 642, Lecture notes for 01/27/05 18 Rate Standardzaton Contnued: Note that f T n t where T s the cumulatve follow-up tme and n s the number of subjects at rsk at the mdpont or nterval, and d s the
More informationProperties of Least Squares
Week 3 3.1 Smple Lnear Regresson Model 3. Propertes of Least Squares Estmators Y Y β 1 + β X + u weekly famly expendtures X weekly famly ncome For a gven level of x, the expected level of food expendtures
More informationDiagnostics in Poisson Regression. Models - Residual Analysis
Dagnostcs n Posson Regresson Models - Resdual Analyss 1 Outlne Dagnostcs n Posson Regresson Models - Resdual Analyss Example 3: Recall of Stressful Events contnued 2 Resdual Analyss Resduals represent
More informationSystematic Error Illustration of Bias. Sources of Systematic Errors. Effects of Systematic Errors 9/23/2009. Instrument Errors Method Errors Personal
9/3/009 Sstematc Error Illustraton of Bas Sources of Sstematc Errors Instrument Errors Method Errors Personal Prejudce Preconceved noton of true value umber bas Prefer 0/5 Small over large Even over odd
More informationChapter 15 Student Lecture Notes 15-1
Chapter 15 Student Lecture Notes 15-1 Basc Busness Statstcs (9 th Edton) Chapter 15 Multple Regresson Model Buldng 004 Prentce-Hall, Inc. Chap 15-1 Chapter Topcs The Quadratc Regresson Model Usng Transformatons
More informationResource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis
Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques
More informationChapter 13 Analysis of Variance and Experimental Design
Chapter 3 Analyss of Varance and Expermental Desgn Learnng Obectves. Understand how the analyss of varance procedure can be used to determne f the means of more than two populatons are equal.. Know the
More informationMethods in Epidemiology. Medical statistics 02/11/2014. Estimation How large is the effect? At the end of the lecture students should be able
Methods n Epdemology Estmaton How large s the effect? Medcal statstcs At the end of the lecture students should be able to llustrate the prncples of statstcal nference to nterpret confdence ntervals Methods
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationSTAT 511 FINAL EXAM NAME Spring 2001
STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte
More informationIntroduction to Analysis of Variance (ANOVA) Part 1
Introducton to Analss of Varance (ANOVA) Part 1 Sngle factor The logc of Analss of Varance Is the varance explaned b the model >> than the resdual varance In regresson models Varance explaned b regresson
More informationTopic 23 - Randomized Complete Block Designs (RCBD)
Topc 3 ANOVA (III) 3-1 Topc 3 - Randomzed Complete Block Desgns (RCBD) Defn: A Randomzed Complete Block Desgn s a varant of the completely randomzed desgn (CRD) that we recently learned. In ths desgn,
More information17 - LINEAR REGRESSION II
Topc 7 Lnear Regresson II 7- Topc 7 - LINEAR REGRESSION II Testng and Estmaton Inferences about β Recall that we estmate Yˆ ˆ β + ˆ βx. 0 μ Y X x β0 + βx usng To estmate σ σ squared error Y X x ε s ε we
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE II LECTURE - GENERAL LINEAR HYPOTHESIS AND ANALYSIS OF VARIANCE Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 3.
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationPubH 7405: REGRESSION ANALYSIS. SLR: INFERENCES, Part II
PubH 7405: REGRESSION ANALSIS SLR: INFERENCES, Part II We cover te topc of nference n two sessons; te frst sesson focused on nferences concernng te slope and te ntercept; ts s a contnuaton on estmatng
More informationCHAPTER 6 GOODNESS OF FIT AND CONTINGENCY TABLE PREPARED BY: DR SITI ZANARIAH SATARI & FARAHANIM MISNI
CHAPTER 6 GOODNESS OF FIT AND CONTINGENCY TABLE Expected Outcomes Able to test the goodness of ft for categorcal data. Able to test whether the categorcal data ft to the certan dstrbuton such as Bnomal,
More informationReduced slides. Introduction to Analysis of Variance (ANOVA) Part 1. Single factor
Reduced sldes Introducton to Analss of Varance (ANOVA) Part 1 Sngle factor 1 The logc of Analss of Varance Is the varance explaned b the model >> than the resdual varance In regresson models Varance explaned
More informationSimulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests
Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth
More informationChapter 12 Analysis of Covariance
Chapter Analyss of Covarance Any scentfc experment s performed to know somethng that s unknown about a group of treatments and to test certan hypothess about the correspondng treatment effect When varablty
More informationTopic 7: Analysis of Variance
Topc 7: Analyss of Varance Outlne Parttonng sums of squares Breakdown the degrees of freedom Expected mean squares (EMS) F test ANOVA table General lnear test Pearson Correlaton / R 2 Analyss of Varance
More informationCHAPTER IV RESEARCH FINDING AND DISCUSSIONS
CHAPTER IV RESEARCH FINDING AND DISCUSSIONS A. Descrpton of Research Fndng. The Implementaton of Learnng Havng ganed the whole needed data, the researcher then dd analyss whch refers to the statstcal data
More informationUnit 10: Simple Linear Regression and Correlation
Unt 10: Smple Lnear Regresson and Correlaton Statstcs 571: Statstcal Methods Ramón V. León 6/28/2004 Unt 10 - Stat 571 - Ramón V. León 1 Introductory Remarks Regresson analyss s a method for studyng the
More information