compare time needed for lexical recognition in healthy adults, patients with Wernicke s aphasia, patients with Broca s aphasia
|
|
- Daniel Hamilton
- 5 years ago
- Views:
Transcription
1 Analysis of Variance ANOVA ANalysis Of VAriance generalized t-test compares means of more than two groups fairly robust based on F distribution, compares variance two versions single ANOVA compare groups along 1 dim, eg school classes multiple ANOVA compare groups along > 1 dim, eg school classes and sex 1 Analysis of Variance Typical applications single ANOVA compare time needed for lexical recognition in healthy adults, patients with Wernicke s aphasia, patients with Broca s aphasia multiple ANOVA compare lexical recognition time in male and female in same three groups 2
2 Comparing Multiple Means for two groups: t-test testing at p = 005 shows significance 1 time in 20 if there is no difference in population mean (effect of chance) but suppose there are 7 groups, ie, ( 7 2) = 21 pairs caution: several tests (on same data) run the risk of finding significance through sheer chance 3 Phony Significance through Multiple Tests Example: Suppose you run three tests, always seeking a result significant at 005 The chance of finding this in one of the three is Bonferroni s family-wise α-level α F W = 1 (1 α) n = 1 (1 05) 3 = 1 (95) 3 = = 0143 to guarantee a family-wise alpha of 005, divide this by number of tests Example: 005/3 = 0017 (set α at 0017) note: ANOVA indicated, takes group effects into account 4
3 Analysis of Variance based on F distribution F distribution Moore & McCabe, 73, pp measures difference between two variances (variance = σ 2 ) F = s2 1 s 2 2 always positive, since variance positive two degrees of freedom interesting, one for s 1, one for s 2 5 F -Test vs F Distribution F = s2 1 s 2 2 used in F -test H 0 : samples from same distribution (s 1 = s 2 ) H a : samples from diff distribution (s 1 s 2 ) value 1 indicates same variance values near 0 or + indicate diff F -test very sensitive to deviations from normal ANOVA uses F distribution, but is different ANOVA F -test! 6
4 F Distribution Critical area for F -distribution at p = 005 Note symmetry: P ( s2 1 s 2 2 > x) = P ( s2 2 s 2 1 < 1 x ) 7 F -test Example: height group sample mean std dev size boys cm 6cm girls is the difference in std dev significant? (α = 005) examine F = s 2 boys s 2 girls degrees of freedom: s boys 16 1 s girls 9 1 8
5 F -test Critical Area (for 2-Tailed Test) P (F (15, 8) > f) = α 2 = = 0025 P (F (15, 8) < f) = P (F (15, 8) < 41) = 0975 from M&M, Tbl E, p706 (no values directly for P (F (df 1, df 2 ) > f)) P (F (15, 8) < x) = α 2 (= 0025) = P (F (8, 15) > x ) = α 2 x = 1 x = P (F (8, 15) > x ) = 0025 x = 1 x = P (F (8, 15) > 32)(tables) P (F (15, 8) < 1 32 ) = 0025 P (F (15, 8) < 031) = 0025 Reject H 0 if F < 031 or F > 41 Here, F = = 225 (no evidence of diff in distribution) 9 ANOVA Analysis of Variance (ANOVA) most popular statistical test for numerical data several types single one-way multiple, ie, two-, three-, n-way examines variation between-groups sex, age, within-subject, within-groups overall automatically corrects for looking at several relationships (like Bonferroni correction) uses F test, where F (n, m) fixes n typically at number of groups (less 1), m at number of subjects (data points) (less number of groups) 10
6 One-Way ANOVA to Analyse Function of Reviews Example: Gisela Redeker identified three roles for literary book reviews in newspapers Taalbeheersing 21(4), 1999, : communicate emotional reactions, subjective opinions communicate expert opinion, objective facts motivate reading and purchasing of book She investigated whether different reviewers emphasized different roles: Tom van Deel (Trouw), Arnold Heumakers (de Volkskrant), and Carel Peeters (Vrij Nederland) stylistic elements indicate one of the three functions, eg, ik, maar nee, ben ik bang, lijkt, eerlijk gezegd, ik bedoel, indicate subjective opinions; logical connectives want, temeer dat, and quotes indicate an objective point of view; etc Nb validating link between style and perspectives is important (see Redeker) 11 Redeker on Literary Criticism s Functions Gisela Redeker investigates role of lit criticism, asking whether different critics did not differ in the degree to which they emphasize one or another role Sample: reviews of the same books (by Hermans, Heijne and Mulisch), all published Similar in length Data: relative frequency of, eg, reader-oriented elements (per 1, 000 words) We are comparing three averages, asking whether their is a difference Because she compared more than two averages ANOVA is needed 12
7 Relative Frequency of Reader-Oriented Elements elements Critic van Deel Heumakers Peeters evocative questions dramquotes intensifiers ref to reader Totals H 0 : µ 1 = µ 2 = µ 3 H a : µ 1 µ 2 or µ 1 µ 3 or µ 2 µ 3 Results: statistically significant difference (p < 002) Similar comparisons for subjective style, and argumentative style (differences present, not statistically significant) 13 One-Way ANOVA Question: Are exam grades of four groups of foreign students Nederlands voor anderstaligen the same? More exactly, are four averages the same? H 0 : µ 1 = µ 2 = µ 3 = µ 4 H a : µ 1 µ 2 or µ 1 µ 3 or µ 3 µ 4 ie, alternative: at least one group has different mean for the question of whether any particular pair is the same, the t-test is appropriate for testing whether all language groups are the same, pairwise t-tests will exaggerate differences (increase the chance of type I error) we want to apply 1-way ANOVA 14
8 Data: Dutch Proficiency of Foreigners Four groups of ten each: Groups Eur Amer Af ri Asia Mean Samp SD Samp Variance Anova Conditions Assumption: normal distribution per group, check with normal quantile plot, eg, for Europeans (and to be repeated for every group): NormalQ-Q Plotoftoets nlvoor anderstalige Expected NormalValue Observed Value 16
9 Anova Conditions Normal Quantile plot for all values: 3 NormalQ-Q Plot of toets nl voor anderstalige 2 1 Expected Normal Value Observed Value 17 Anova Conditions ANOVA assumptions: normal distribution per subgroup same variance in subgroups: least sd > one-half of greatest sd independent observations: watch out for test-retest situations! Check differences in SD s! (some SPSS computing ) Valid Variable Std Dev N Label Europa America Africa Azie
10 Visualizing Anova Is there any significant difference in the means (of the groups being contrasted)? toets nlvoor anderstalige N = 10 Europa 10 America 10 Africa 10 Azie gebied van afkomst Take care that boxplots sketch medians, not means 19 Sketch of Anova Groups = I Eur Amer Afri Asia x 1,j x 2,j x 3,j x 4,j Sample Mean x 1 x i I number of groups For any data point x i,j (x i,j x) = ( x i x) + (x i,j x i ) total residue = group diff + error ANOVA question: is it sensible to include the group ( x i )? 20
11 Two Variances Reminder of high-school algebra: (a + b) 2 = a 2 + b 2 + 2ab A AB A 2 B B 2 AB 21 Two Variances (a + b) 2 = a 2 + b 2 + 2ab (x i,j x) = ( x i x) + (x i,j x i ) (x i,j x) 2 = ( x i x) 2 + (x i,j x i ) 2 + 2( x i x)(x i,j x i ) Sum over elements in i-th group: (x i,j x) 2 = ( x i x) 2 + (x i,j x i ) 2 + 2( x i x)(x i,j x i ) 22
12 Two Variances Note that this term must be zero: 2( x i x)(x i,j x i ) Since: 2( x i x)(x i,j x i ) = 2( x i x) (x i,j x i ) and (x i,j x i ) = 0 23 Sketch of Anova (x i,j x) 2 = ( x i x) 2 + (x i,j x i ) 2 (+ 2( x i x)(x i,j x i ) = 0) Therefore: (x i,j x) 2 = ( x i x) 2 + (x i,j x i ) 2 SST = SSG + SSE 24
13 Anova Terminology For any data point x i,j (x i,j x) = ( x i x) + (x i,j x i ) total residue = group diff + error (x i,j x) 2 = ( x i x) 2 + (x i,j x i ) 2 SST SSG + SSE Total Sum of Squares = Group Sum of Squares + Error Sum of Squares and DFT DFG + DFE (n 1) = (I 1) + (n I) Total Degrees of Freedom = Group Degrees of Freedom + Error Degrees of Freedom 25 Variances are Mean Squared Differences to Mean Note that (x i,j x) 2 n 1 is a variance, and likewise SST/DFT SSG/DFG (=MSG) & SSE/DFE (=MSE) In ANOVA, we compare MSG (variance betwee groups) and MSE (variance within groups), ie we measure F = MSG MSE If this is large, differences between groups overshadow differences within groups 26
14 Two Variances H 0 : µ 1 = µ 2 = µ 3 = µ 4 ANOVA: calculate MSG (σ 2 between groups) and MSE (σ 2 within groups), ie measure we F = MSG MSE If this is large, differences between groups overshadow differences within groups 27 Two Variances 1 estimate pooled variance of population (MSE) i G df i s2 i i G df i = (n 1 1)s2 1 +(n 2 1)s2 2 +(n 3 1)s2 3 +(n 4 1)s2 4 (n 1 1)+(n 2 1)+(n 3 1)+(n 4 1) = = = 4811 estimates variance in groups (using df ), aka within-groups estimate of variance 2 suppose H 0 true (a) then group have sample means µ, variance σ 2 /10, (& sd σ/ 10) (b) 4 means, 250, 219, 231, 213, where s = 163, s 2 = 266 (c) s 2 estimate of σ 2 /10, ie, 10 s 2 is estimate of σ 2 ( s 2 = 266) (d) this is between-groups variance (MSG) 28
15 Interpreting Estimates via F if H 0 true, then we have two variances: between-groups estimate s 2 b (266) and within-groups estimate s 2 w (4811) and their ratio s2 b s 2 follows an F distribution with w ( groups 1)dF from s 2 b (3), (n 4)dF from s 2 w (36) in this case, = 055 P (F (3, 30) > 292) = 005, (see tables), so no evidence of nonuniform behavior 29 ANOVA Summary Summary to-date (exam results for NL voor anderstalige) Source df SS M SS F between-g F(3,36) = 055 within-g Total P (F (3, 30) > 292) = 005, (see tables) so no evidence of nonuniform behavior 30
16 SPSS Summary O N E W A Y Variable NL_NIVO toets nl voor anderstalige By Variable GROUP gebied van afkomst Analysis of Variance Sum of Mean F F Source DF Squares Squares Ratio Prob Between Groups Within Groups Total Other Questions ANOVA has H 0 : µ 1 = µ 2 = = µ n But sometimes particular contrasts important eg, are Europeans better (in learning Dutch)? Distinguish (in reporting results): prior contrasts questions asked before data collected and analyzed post-hoc (posterior) questions questions after collection and analysis data-snooping is exploratory, cannot contribute to hypothesis testing 32
17 Prior Contrasts Questions asked before collection and analysis eg, are Europeans better (in learning Dutch)? Another formulation: is H a : µ Eur (µ Am = µ Afr = µ Asia ) where H 0 : µ Eur = (µ Am + µ Afr + µ Asia ) Reformulation: 0 = µ Eur + 033µ Am + 033µ Afr + 033µ Asia SPSS requires this (reformulated) version 33 Prior Contrasts in SPSS (the mean of) every group gets a coefficient sum of coefficients is zero a t-test is carried out, & two-tailed p value is reported (as usual) Eur Am Afr Azie Contrast Pooled Variance Estimate Value S Error T Value DF T Prob Contrast No significant difference here (of course) Note: prior contrasts are legitimate as hypothesis tests as long as they are formulated before collection and analysis 34
18 Post-hoc Questions Assume H 0 rejected: which means are distinct? Data-snooping problem: in large set, some distinctions are likely to be stat significant But we can still look (we just cannot claim to have tested the hypothesis) We are asking whether m 1 m 2 is significantly larger, we apply a variant of the t-test The relevant sd is MSE/n (differences among scores), but there s a correction since we re looking at half the scores in any one comparison 35 SD in Post-hoc ANOVA Questions NB SD (among diff in groups i and j): sd δ = MSE +N j N = + N j = = 2405 = 49/ and the t value is calculated as p/c where p is the desired significance level and c is number of comparisons For pairwise comparisons, c = ( I) 2 36
19 Post-hoc Questions in SPSS SPSS Post-Hoc Bonferroni searches among all groupings for statistically significant ones O N E W A Y Variable NL_NIVO toets nl voor anderstalige By Variable GROUP gebied van afkomst Multiple Range Tests: Modified LSD (Bonferroni) test w signif level 05 The difference between two means is significant if MEAN(J)-MEAN(I) >= * RANGE * SQRT(1/N(I) + 1/N(J)) with the following value(s) for RANGE: No two groups significantly different at 05 level Homogeneous Subsets (highest \& lowest means not sig diff) Group Azie America Africa Europa Mean but in this case there are none (of course) 37 How to Win at ANOVA Note ways in which F ratio increases (becomes more significant) F = MSG MSE 1 MSG increases, differences in means grow larger 2 MSE decreases, overall variation grows smaller 38
20 Two Models for Grouped Data x i,j = µ + ɛ i,j x i,j = µ + α i + ɛ i,j First model no group effect each datapoint represents error (ɛ) around a mean (µ) Second model real group effect each datapoint represents error (ɛ) around an overall mean (µ) combined with a group adjustment (α i ) ANOVA: is there sufficient evidence for α i? 39 Next: Two-way ANOVA 40
Analysis of Variance Inf. Stats. ANOVA ANalysis Of VAriance. Analysis of Variance Inf. Stats
Analysis of Variance ANOVA ANalysis Of VAriance generalized t-test compares means of more than two groups fairly robust based on F distribution, compares variance two versions single ANOVA compare groups
More informationStatistiek II. John Nerbonne using reworkings by Hartmut Fitz and Wilbert Heeringa. February 13, Dept of Information Science
Statistiek II John Nerbonne using reworkings by Hartmut Fitz and Wilbert Heeringa Dept of Information Science j.nerbonne@rug.nl February 13, 2014 Course outline 1 One-way ANOVA. 2 Factorial ANOVA. 3 Repeated
More informationExample: Four levels of herbicide strength in an experiment on dry weight of treated plants.
The idea of ANOVA Reminders: A factor is a variable that can take one of several levels used to differentiate one group from another. An experiment has a one-way, or completely randomized, design if several
More informationStatistiek II. John Nerbonne. February 26, Dept of Information Science based also on H.Fitz s reworking
Dept of Information Science j.nerbonne@rug.nl based also on H.Fitz s reworking February 26, 2014 Last week: one-way ANOVA generalized t-test to compare means of more than two groups example: (a) compare
More informationBasics on t-tests Independent Sample t-tests Single-Sample t-tests Summary of t-tests Multiple Tests, Effect Size Proportions. Statistiek I.
Statistiek I t-tests John Nerbonne CLCG, Rijksuniversiteit Groningen http://www.let.rug.nl/nerbonne/teach/statistiek-i/ John Nerbonne 1/46 Overview 1 Basics on t-tests 2 Independent Sample t-tests 3 Single-Sample
More information1-Way ANOVA MATH 143. Spring Department of Mathematics and Statistics Calvin College
1-Way ANOVA MATH 143 Department of Mathematics and Statistics Calvin College Spring 2010 The basic ANOVA situation Two variables: 1 Categorical, 1 Quantitative Main Question: Do the (means of) the quantitative
More informationANOVA: Analysis of Variation
ANOVA: Analysis of Variation The basic ANOVA situation Two variables: 1 Categorical, 1 Quantitative Main Question: Do the (means of) the quantitative variables depend on which group (given by categorical
More informationOne-way ANOVA Inference for one-way ANOVA
One-way ANOVA Inference for one-way ANOVA IPS Chater 12.1 2009 W.H. Freeman and Comany Objectives (IPS Chater 12.1) Inference for one-way ANOVA Comaring means The two-samle t statistic An overview of ANOVA
More informationANOVA Analysis of Variance
ANOVA Analysis of Variance ANOVA Analysis of Variance Extends independent samples t test ANOVA Analysis of Variance Extends independent samples t test Compares the means of groups of independent observations
More informationIn ANOVA the response variable is numerical and the explanatory variables are categorical.
1 ANOVA ANOVA means ANalysis Of VAriance. The ANOVA is a tool for studying the influence of one or more qualitative variables on the mean of a numerical variable in a population. In ANOVA the response
More informationWolf River. Lecture 19 - ANOVA. Exploratory analysis. Wolf River - Data. Sta 111. June 11, 2014
Aldrin in the Wolf River Wolf River Lecture 19 - Sta 111 Colin Rundel June 11, 2014 The Wolf River in Tennessee flows past an abandoned site once used by the pesticide industry for dumping wastes, including
More informationAn Analysis of College Algebra Exam Scores December 14, James D Jones Math Section 01
An Analysis of College Algebra Exam s December, 000 James D Jones Math - Section 0 An Analysis of College Algebra Exam s Introduction Students often complain about a test being too difficult. Are there
More informationANOVA continued. Chapter 10
ANOVA continued Chapter 10 Zettergren (003) School adjustment in adolescence for previously rejected, average, and popular children. Effect of peer reputation on academic performance and school adjustment
More informationOne-Way ANOVA. Some examples of when ANOVA would be appropriate include:
One-Way ANOVA 1. Purpose Analysis of variance (ANOVA) is used when one wishes to determine whether two or more groups (e.g., classes A, B, and C) differ on some outcome of interest (e.g., an achievement
More informationThe One-Way Independent-Samples ANOVA. (For Between-Subjects Designs)
The One-Way Independent-Samples ANOVA (For Between-Subjects Designs) Computations for the ANOVA In computing the terms required for the F-statistic, we won t explicitly compute any sample variances or
More informationANOVA continued. Chapter 10
ANOVA continued Chapter 10 Zettergren (003) School adjustment in adolescence for previously rejected, average, and popular children. Effect of peer reputation on academic performance and school adjustment
More informationSTAT 263/363: Experimental Design Winter 2016/17. Lecture 1 January 9. Why perform Design of Experiments (DOE)? There are at least two reasons:
STAT 263/363: Experimental Design Winter 206/7 Lecture January 9 Lecturer: Minyong Lee Scribe: Zachary del Rosario. Design of Experiments Why perform Design of Experiments (DOE)? There are at least two
More informationWolf River. Lecture 15 - ANOVA. Exploratory analysis. Wolf River - Data. Sta102 / BME102. October 22, 2014
Wolf River Lecture 15 - Sta102 / BME102 Colin Rundel October 22, 2014 The Wolf River in Tennessee flows past an abandoned site once used by the pesticide industry for dumping wastes, including chlordane
More informationN J SS W /df W N - 1
One-Way ANOVA Source Table ANOVA MODEL: ij = µ* + α j + ε ij H 0 : µ = µ =... = µ j or H 0 : Σα j = 0 Source Sum of Squares df Mean Squares F J Between Groups nj( j * ) J - SS B /(J ) MS B /MS W = ( N
More informationTwo-Way ANOVA. Chapter 15
Two-Way ANOVA Chapter 15 Interaction Defined An interaction is present when the effects of one IV depend upon a second IV Interaction effect : The effect of each IV across the levels of the other IV When
More informationIntroduction to the Analysis of Variance (ANOVA) Computing One-Way Independent Measures (Between Subjects) ANOVAs
Introduction to the Analysis of Variance (ANOVA) Computing One-Way Independent Measures (Between Subjects) ANOVAs The Analysis of Variance (ANOVA) The analysis of variance (ANOVA) is a statistical technique
More informationWolf River. Lecture 15 - ANOVA. Exploratory analysis. Wolf River - Data. Sta102 / BME102. October 26, 2015
Wolf River Lecture 15 - Sta102 / BME102 Colin Rundel October 26, 2015 The Wolf River in Tennessee flows past an abandoned site once used by the pesticide industry for dumping wastes, including chlordane
More informationANOVA continued. Chapter 11
ANOVA continued Chapter 11 Zettergren (003) School adjustment in adolescence for previously rejected, average, and popular children. Effect of peer reputation on academic performance and school adjustment
More informationWELCOME! Lecture 13 Thommy Perlinger
Quantitative Methods II WELCOME! Lecture 13 Thommy Perlinger Parametrical tests (tests for the mean) Nature and number of variables One-way vs. two-way ANOVA One-way ANOVA Y X 1 1 One dependent variable
More informationANOVA: Comparing More Than Two Means
1 ANOVA: Comparing More Than Two Means 10.1 ANOVA: The Completely Randomized Design Elements of a Designed Experiment Before we begin any calculations, we need to discuss some terminology. To make this
More informationStatistiek I ATW, CIW, IK John Nerbonne, spreekuur H , di. 11:15-12
Statistics Statistiek I ATW, CIW, IK John Nerbonne, JNerbonne@rugnl, spreekuur H1311436, di 11:15-12 Eleanora Rossi, ERossi@rugnl Mik van Es, MvanEs@rugnl 1 Statistics Statistics collecting, ordering,
More informationLecture 15 - ANOVA cont.
Lecture 15 - ANOVA cont. Statistics 102 Colin Rundel March 18, 2013 One-way ANOVA Example - Alfalfa Example - Alfalfa (11.6.1) Researchers were interested in the effect that acid has on the growth rate
More informationUsing SPSS for One Way Analysis of Variance
Using SPSS for One Way Analysis of Variance This tutorial will show you how to use SPSS version 12 to perform a one-way, between- subjects analysis of variance and related post-hoc tests. This tutorial
More informationMultiple Comparisons
Multiple Comparisons Error Rates, A Priori Tests, and Post-Hoc Tests Multiple Comparisons: A Rationale Multiple comparison tests function to tease apart differences between the groups within our IV when
More informationIntroduction to Analysis of Variance. Chapter 11
Introduction to Analysis of Variance Chapter 11 Review t-tests Single-sample t-test Independent samples t-test Related or paired-samples t-test s m M t ) ( 1 1 ) ( m m s M M t M D D D s M t n s s M 1 )
More informationThe One-Way Repeated-Measures ANOVA. (For Within-Subjects Designs)
The One-Way Repeated-Measures ANOVA (For Within-Subjects Designs) Logic of the Repeated-Measures ANOVA The repeated-measures ANOVA extends the analysis of variance to research situations using repeated-measures
More informationExample - Alfalfa (11.6.1) Lecture 14 - ANOVA cont. Alfalfa Hypotheses. Treatment Effect
(11.6.1) Lecture 14 - ANOVA cont. Sta102 / BME102 Colin Rundel March 19, 2014 Researchers were interested in the effect that acid has on the growth rate of alfalfa plants. They created three treatment
More informationHypothesis testing: Steps
Review for Exam 2 Hypothesis testing: Steps Repeated-Measures ANOVA 1. Determine appropriate test and hypotheses 2. Use distribution table to find critical statistic value(s) representing rejection region
More informationSimple Linear Regression: One Qualitative IV
Simple Linear Regression: One Qualitative IV 1. Purpose As noted before regression is used both to explain and predict variation in DVs, and adding to the equation categorical variables extends regression
More informationANOVA Situation The F Statistic Multiple Comparisons. 1-Way ANOVA MATH 143. Department of Mathematics and Statistics Calvin College
1-Way ANOVA MATH 143 Department of Mathematics and Statistics Calvin College An example ANOVA situation Example (Treating Blisters) Subjects: 25 patients with blisters Treatments: Treatment A, Treatment
More informationSimple Linear Regression: One Quantitative IV
Simple Linear Regression: One Quantitative IV Linear regression is frequently used to explain variation observed in a dependent variable (DV) with theoretically linked independent variables (IV). For example,
More informationAnalysis of Variance (ANOVA)
Analysis of Variance (ANOVA) Two types of ANOVA tests: Independent measures and Repeated measures Comparing 2 means: X 1 = 20 t - test X 2 = 30 How can we Compare 3 means?: X 1 = 20 X 2 = 30 X 3 = 35 ANOVA
More information16.400/453J Human Factors Engineering. Design of Experiments II
J Human Factors Engineering Design of Experiments II Review Experiment Design and Descriptive Statistics Research question, independent and dependent variables, histograms, box plots, etc. Inferential
More informationMultiple Pairwise Comparison Procedures in One-Way ANOVA with Fixed Effects Model
Biostatistics 250 ANOVA Multiple Comparisons 1 ORIGIN 1 Multiple Pairwise Comparison Procedures in One-Way ANOVA with Fixed Effects Model When the omnibus F-Test for ANOVA rejects the null hypothesis that
More informationAnnouncements. Unit 4: Inference for numerical variables Lecture 4: ANOVA. Data. Statistics 104
Announcements Announcements Unit 4: Inference for numerical variables Lecture 4: Statistics 104 Go to Sakai s to pick a time for a one-on-one meeting. Mine Çetinkaya-Rundel June 6, 2013 Statistics 104
More informationOne-Way ANOVA Source Table J - 1 SS B / J - 1 MS B /MS W. Pairwise Post-Hoc Comparisons of Means
One-Way ANOVA Source Table ANOVA MODEL: ij = µ* + α j + ε ij H 0 : µ 1 = µ =... = µ j or H 0 : Σα j = 0 Source Sum of Squares df Mean Squares F Between Groups n j ( j - * ) J - 1 SS B / J - 1 MS B /MS
More informationAnalysis of variance
Analysis of variance Tron Anders Moger 3.0.007 Comparing more than two groups Up to now we have studied situations with One observation per subject One group Two groups Two or more observations per subject
More informationExample - Alfalfa (11.6.1) Lecture 16 - ANOVA cont. Alfalfa Hypotheses. Treatment Effect
(11.6.1) Lecture 16 - ANOVA cont. Sta102 / BME102 Colin Rundel October 28, 2015 Researchers were interested in the effect that acid has on the growth rate of alfalfa plants. They created three treatment
More informationSociology Research Statistics I Final Exam Answer Key December 15, 1993
Sociology 592 - Research Statistics I Final Exam Answer Key December 15, 1993 Where appropriate, show your work - partial credit may be given. (On the other hand, don't waste a lot of time on excess verbiage.)
More informationInference for Regression Simple Linear Regression
Inference for Regression Simple Linear Regression IPS Chapter 10.1 2009 W.H. Freeman and Company Objectives (IPS Chapter 10.1) Simple linear regression p Statistical model for linear regression p Estimating
More informationNotes for Week 13 Analysis of Variance (ANOVA) continued WEEK 13 page 1
Notes for Wee 13 Analysis of Variance (ANOVA) continued WEEK 13 page 1 Exam 3 is on Friday May 1. A part of one of the exam problems is on Predictiontervals : When randomly sampling from a normal population
More informationSwarthmore Honors Exam 2012: Statistics
Swarthmore Honors Exam 2012: Statistics 1 Swarthmore Honors Exam 2012: Statistics John W. Emerson, Yale University NAME: Instructions: This is a closed-book three-hour exam having six questions. You may
More informationMultiple Regression. Inference for Multiple Regression and A Case Study. IPS Chapters 11.1 and W.H. Freeman and Company
Multiple Regression Inference for Multiple Regression and A Case Study IPS Chapters 11.1 and 11.2 2009 W.H. Freeman and Company Objectives (IPS Chapters 11.1 and 11.2) Multiple regression Data for multiple
More informationANOVA (Analysis of Variance) output RLS 11/20/2016
ANOVA (Analysis of Variance) output RLS 11/20/2016 1. Analysis of Variance (ANOVA) The goal of ANOVA is to see if the variation in the data can explain enough to see if there are differences in the means.
More informationWeek 14 Comparing k(> 2) Populations
Week 14 Comparing k(> 2) Populations Week 14 Objectives Methods associated with testing for the equality of k(> 2) means or proportions are presented. Post-testing concepts and analysis are introduced.
More informationDifference in two or more average scores in different groups
ANOVAs Analysis of Variance (ANOVA) Difference in two or more average scores in different groups Each participant tested once Same outcome tested in each group Simplest is one-way ANOVA (one variable as
More informationTwo-Sample Inferential Statistics
The t Test for Two Independent Samples 1 Two-Sample Inferential Statistics In an experiment there are two or more conditions One condition is often called the control condition in which the treatment is
More informationInference for Regression Inference about the Regression Model and Using the Regression Line
Inference for Regression Inference about the Regression Model and Using the Regression Line PBS Chapter 10.1 and 10.2 2009 W.H. Freeman and Company Objectives (PBS Chapter 10.1 and 10.2) Inference about
More information4:3 LEC - PLANNED COMPARISONS AND REGRESSION ANALYSES
4:3 LEC - PLANNED COMPARISONS AND REGRESSION ANALYSES FOR SINGLE FACTOR BETWEEN-S DESIGNS Planned or A Priori Comparisons We previously showed various ways to test all possible pairwise comparisons for
More information13: Additional ANOVA Topics
13: Additional ANOVA Topics Post hoc comparisons Least squared difference The multiple comparisons problem Bonferroni ANOVA assumptions Assessing equal variance When assumptions are severely violated Kruskal-Wallis
More informationAn Old Research Question
ANOVA An Old Research Question The impact of TV on high-school grade Watch or not watch Two groups The impact of TV hours on high-school grade Exactly how much TV watching would make difference Multiple
More informationHypothesis testing: Steps
Review for Exam 2 Hypothesis testing: Steps Exam 2 Review 1. Determine appropriate test and hypotheses 2. Use distribution table to find critical statistic value(s) representing rejection region 3. Compute
More informationLinear regression. We have that the estimated mean in linear regression is. ˆµ Y X=x = ˆβ 0 + ˆβ 1 x. The standard error of ˆµ Y X=x is.
Linear regression We have that the estimated mean in linear regression is The standard error of ˆµ Y X=x is where x = 1 n s.e.(ˆµ Y X=x ) = σ ˆµ Y X=x = ˆβ 0 + ˆβ 1 x. 1 n + (x x)2 i (x i x) 2 i x i. The
More informationOne-way between-subjects ANOVA. Comparing three or more independent means
One-way between-subjects ANOVA Comparing three or more independent means Data files SpiderBG.sav Attractiveness.sav Homework: sourcesofself-esteem.sav ANOVA: A Framework Understand the basic principles
More informationStatistiek II. John Nerbonne. March 17, Dept of Information Science incl. important reworkings by Harmut Fitz
Dept of Information Science j.nerbonne@rug.nl incl. important reworkings by Harmut Fitz March 17, 2015 Review: regression compares result on two distinct tests, e.g., geographic and phonetic distance of
More informationANOVA approach. Investigates interaction terms. Disadvantages: Requires careful sampling design with replication
ANOVA approach Advantages: Ideal for evaluating hypotheses Ideal to quantify effect size (e.g., differences between groups) Address multiple factors at once Investigates interaction terms Disadvantages:
More information2 Hand-out 2. Dr. M. P. M. M. M c Loughlin Revised 2018
Math 403 - P. & S. III - Dr. McLoughlin - 1 2018 2 Hand-out 2 Dr. M. P. M. M. M c Loughlin Revised 2018 3. Fundamentals 3.1. Preliminaries. Suppose we can produce a random sample of weights of 10 year-olds
More informationMultiple t Tests. Introduction to Analysis of Variance. Experiments with More than 2 Conditions
Introduction to Analysis of Variance 1 Experiments with More than 2 Conditions Often the research that psychologists perform has more conditions than just the control and experimental conditions You might
More informationSection 9.4. Notation. Requirements. Definition. Inferences About Two Means (Matched Pairs) Examples
Objective Section 9.4 Inferences About Two Means (Matched Pairs) Compare of two matched-paired means using two samples from each population. Hypothesis Tests and Confidence Intervals of two dependent means
More informationAn inferential procedure to use sample data to understand a population Procedures
Hypothesis Test An inferential procedure to use sample data to understand a population Procedures Hypotheses, the alpha value, the critical region (z-scores), statistics, conclusion Two types of errors
More information(Where does Ch. 7 on comparing 2 means or 2 proportions fit into this?)
12. Comparing Groups: Analysis of Variance (ANOVA) Methods Response y Explanatory x var s Method Categorical Categorical Contingency tables (Ch. 8) (chi-squared, etc.) Quantitative Quantitative Regression
More informationBattery Life. Factory
Statistics 354 (Fall 2018) Analysis of Variance: Comparing Several Means Remark. These notes are from an elementary statistics class and introduce the Analysis of Variance technique for comparing several
More informationAnalysis of variance (ANOVA) Comparing the means of more than two groups
Analysis of variance (ANOVA) Comparing the means of more than two groups Example: Cost of mating in male fruit flies Drosophila Treatments: place males with and without unmated (virgin) females Five treatments
More informationSTAT 5200 Handout #7a Contrasts & Post hoc Means Comparisons (Ch. 4-5)
STAT 5200 Handout #7a Contrasts & Post hoc Means Comparisons Ch. 4-5) Recall CRD means and effects models: Y ij = µ i + ϵ ij = µ + α i + ϵ ij i = 1,..., g ; j = 1,..., n ; ϵ ij s iid N0, σ 2 ) If we reject
More informationPSY 216. Assignment 9 Answers. Under what circumstances is a t statistic used instead of a z-score for a hypothesis test
PSY 216 Assignment 9 Answers 1. Problem 1 from the text Under what circumstances is a t statistic used instead of a z-score for a hypothesis test The t statistic should be used when the population standard
More informationSTAT Chapter 10: Analysis of Variance
STAT 515 -- Chapter 10: Analysis of Variance Designed Experiment A study in which the researcher controls the levels of one or more variables to determine their effect on the variable of interest (called
More informationStatistics and Quantitative Analysis U4320
Statistics and Quantitative Analysis U3 Lecture 13: Explaining Variation Prof. Sharyn O Halloran Explaining Variation: Adjusted R (cont) Definition of Adjusted R So we'd like a measure like R, but one
More informationMATH ASSIGNMENT 2: SOLUTIONS
MATH 204 - ASSIGNMENT 2: SOLUTIONS (a) Fitting the simple linear regression model to each of the variables in turn yields the following results: we look at t-tests for the individual coefficients, and
More informationCOMPARING SEVERAL MEANS: ANOVA
LAST UPDATED: November 15, 2012 COMPARING SEVERAL MEANS: ANOVA Objectives 2 Basic principles of ANOVA Equations underlying one-way ANOVA Doing a one-way ANOVA in R Following up an ANOVA: Planned contrasts/comparisons
More informationCIVL /8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8
CIVL - 7904/8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8 Chi-square Test How to determine the interval from a continuous distribution I = Range 1 + 3.322(logN) I-> Range of the class interval
More informationTable of z values and probabilities for the standard normal distribution. z is the first column plus the top row. Each cell shows P(X z).
Table of z values and probabilities for the standard normal distribution. z is the first column plus the top row. Each cell shows P(X z). For example P(X 1.04) =.8508. For z < 0 subtract the value from
More informationThe independent-means t-test:
The independent-means t-test: Answers the question: is there a "real" difference between the two conditions in my experiment? Or is the difference due to chance? Previous lecture: (a) Dependent-means t-test:
More information16.3 One-Way ANOVA: The Procedure
16.3 One-Way ANOVA: The Procedure Tom Lewis Fall Term 2009 Tom Lewis () 16.3 One-Way ANOVA: The Procedure Fall Term 2009 1 / 10 Outline 1 The background 2 Computing formulas 3 The ANOVA Identity 4 Tom
More informationSTAT 115:Experimental Designs
STAT 115:Experimental Designs Josefina V. Almeda 2013 Multisample inference: Analysis of Variance 1 Learning Objectives 1. Describe Analysis of Variance (ANOVA) 2. Explain the Rationale of ANOVA 3. Compare
More informationTukey Complete Pairwise Post-Hoc Comparison
Tukey Complete Pairwise Post-Hoc Comparison Engineering Statistics II Section 10.2 Josh Engwer TTU 2018 Josh Engwer (TTU) Tukey Complete Pairwise Post-Hoc Comparison 2018 1 / 23 PART I PART I: Gosset s
More informationExam Empirical Methods VU University Amsterdam, Faculty of Exact Sciences h, February 12, 2015
Exam Empirical Methods VU University Amsterdam, Faculty of Exact Sciences 18.30 21.15h, February 12, 2015 Question 1 is on this page. Always motivate your answers. Write your answers in English. Only the
More informationFinalExamReview. Sta Fall Provided: Z, t and χ 2 tables
Final Exam FinalExamReview Sta 101 - Fall 2017 Duke University, Department of Statistical Science When: Wednesday, December 13 from 9:00am-12:00pm What to bring: Scientific calculator (graphing calculator
More informationSTATS Analysis of variance: ANOVA
STATS 1060 Analysis of variance: ANOVA READINGS: Chapters 28 of your text book (DeVeaux, Vellman and Bock); on-line notes for ANOVA; on-line practice problems for ANOVA NOTICE: You should print a copy
More informationBIOL Biometry LAB 6 - SINGLE FACTOR ANOVA and MULTIPLE COMPARISON PROCEDURES
BIOL 458 - Biometry LAB 6 - SINGLE FACTOR ANOVA and MULTIPLE COMPARISON PROCEDURES PART 1: INTRODUCTION TO ANOVA Purpose of ANOVA Analysis of Variance (ANOVA) is an extremely useful statistical method
More informationChapter 11 - Lecture 1 Single Factor ANOVA
Chapter 11 - Lecture 1 Single Factor ANOVA April 7th, 2010 Means Variance Sum of Squares Review In Chapter 9 we have seen how to make hypothesis testing for one population mean. In Chapter 10 we have seen
More informationPSYC 331 STATISTICS FOR PSYCHOLOGISTS
PSYC 331 STATISTICS FOR PSYCHOLOGISTS Session 4 A PARAMETRIC STATISTICAL TEST FOR MORE THAN TWO POPULATIONS Lecturer: Dr. Paul Narh Doku, Dept of Psychology, UG Contact Information: pndoku@ug.edu.gh College
More informationWeek 7.1--IES 612-STA STA doc
Week 7.1--IES 612-STA 4-573-STA 4-576.doc IES 612/STA 4-576 Winter 2009 ANOVA MODELS model adequacy aka RESIDUAL ANALYSIS Numeric data samples from t populations obtained Assume Y ij ~ independent N(μ
More informationIntroduction to Statistical Inference Lecture 10: ANOVA, Kruskal-Wallis Test
Introduction to Statistical Inference Lecture 10: ANOVA, Kruskal-Wallis Test la Contents The two sample t-test generalizes into Analysis of Variance. In analysis of variance ANOVA the population consists
More informationUnit 27 One-Way Analysis of Variance
Unit 27 One-Way Analysis of Variance Objectives: To perform the hypothesis test in a one-way analysis of variance for comparing more than two population means Recall that a two sample t test is applied
More informationH0: Tested by k-grp ANOVA
Pairwise Comparisons ANOVA for multiple condition designs Pairwise comparisons and RH Testing Alpha inflation & Correction LSD & HSD procedures Alpha estimation reconsidered H0: Tested by k-grp ANOVA Regardless
More informationSEVERAL μs AND MEDIANS: MORE ISSUES. Business Statistics
SEVERAL μs AND MEDIANS: MORE ISSUES Business Statistics CONTENTS Post-hoc analysis ANOVA for 2 groups The equal variances assumption The Kruskal-Wallis test Old exam question Further study POST-HOC ANALYSIS
More information1 DV is normally distributed in the population for each level of the within-subjects factor 2 The population variances of the difference scores
One-way Prepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Putra Malaysia Serdang The purpose is to test the
More information4.1. Introduction: Comparing Means
4. Analysis of Variance (ANOVA) 4.1. Introduction: Comparing Means Consider the problem of testing H 0 : µ 1 = µ 2 against H 1 : µ 1 µ 2 in two independent samples of two different populations of possibly
More informationRegression: Main Ideas Setting: Quantitative outcome with a quantitative explanatory variable. Example, cont.
TCELL 9/4/205 36-309/749 Experimental Design for Behavioral and Social Sciences Simple Regression Example Male black wheatear birds carry stones to the nest as a form of sexual display. Soler et al. wanted
More informationIndependent Samples ANOVA
Independent Samples ANOVA In this example students were randomly assigned to one of three mnemonics (techniques for improving memory) rehearsal (the control group; simply repeat the words), visual imagery
More informationData Analysis and Statistical Methods Statistics 651
Data Analysis and Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasini/teaching.html Suhasini Subba Rao Motivations for the ANOVA We defined the F-distribution, this is mainly used in
More information1 Introduction to One-way ANOVA
Review Source: Chapter 10 - Analysis of Variance (ANOVA). Example Data Source: Example problem 10.1 (dataset: exp10-1.mtw) Link to Data: http://www.auburn.edu/~carpedm/courses/stat3610/textbookdata/minitab/
More informationH0: Tested by k-grp ANOVA
Analyses of K-Group Designs : Omnibus F, Pairwise Comparisons & Trend Analyses ANOVA for multiple condition designs Pairwise comparisons and RH Testing Alpha inflation & Correction LSD & HSD procedures
More informationCh. 1: Data and Distributions
Ch. 1: Data and Distributions Populations vs. Samples How to graphically display data Histograms, dot plots, stem plots, etc Helps to show how samples are distributed Distributions of both continuous and
More informationSampling Distributions: Central Limit Theorem
Review for Exam 2 Sampling Distributions: Central Limit Theorem Conceptually, we can break up the theorem into three parts: 1. The mean (µ M ) of a population of sample means (M) is equal to the mean (µ)
More information