ScienceDirect. Who s afraid of the effect size?
|
|
- Marjory Richardson
- 5 years ago
- Views:
Transcription
1 Available online at ScienceDirect Procedia Economics and Finance 0 ( 015 ) th International Conference on Globalization of Higher Education in Economics and Business Administration, GEBA 013 Who s afraid of the effect size? Ciprian Turturean* Alexandru Ioan Cuza University of Iasi,, Carol 1 Ave., no., , Iasi, Romania Abstract The effect size (no more than 35 years) is new topic discussion especially in psychological field. He is quantified by a class of descriptive statistical indicators which based on d Cohen s coefficient. The effect size bring us an additional information to inferential decision to accept or to reject the Null Hypothesis, reason that we find an wide discussion under name Null Hypothesis Significance Testing (NHTS). Therefore the American Psychological Association (APA) recommended in chapter 1.01 Designing and Reporting Research; all published statistical reports also include effect size (APA 5th edition manual section (00)) The The Authors. Authors. Published Published by by Elsevier Elsevier B.V. B.V. This is an open access article under the CC BY-NC-ND license ( Selection and peer-review under responsibility of the Faculty of Economics and Business Administration, Alexandru Ioan Cuza Peer-review University of under Iasi. responsibility of the Faculty of Economics and Business Administration, Alexandru Ioan Cuza University of Iasi. Keywords: effect size, indicators, comparing means, effect size association indexes, effect size coefficients 1. Introduction - What s the effect size? Statistical tests comparing the central level between two statistical distributions give us the answer to the question: Are there significant differences between the two different treatments? but they fail to give us information on the magnitude of the difference. What is more, if we work with two different pair of samples, the estimated variances and central levels, most probably, will differ even if the samples volume and the populations of origin are the same. The new questions that arise are: How big is the magnitude of differences between two different treatments?, How can we quantify the magnitude of differences between two different treatments so that we offer comparability from one test to the other?, Therefore, what is the effect size? * Corresponding author. Tel.: address: ciprian.turturean@uaic.ro The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license ( Peer-review under responsibility of the Faculty of Economics and Business Administration, Alexandru Ioan Cuza University of Iasi. doi: /s1-5671(15)0011-5
2 666 Ciprian Turturean / Procedia Economics and Finance 0 ( 015 ) Effect Size (ES) is a name given to a family of indices that measure the magnitude of treatment effect. Unlike significance tests, these indices are independent of sample size. ES measures are common currency of metaanalysis studies that summarize the findings from a specific area of research. (Lee A. Becker, [1]). or Effect size is a quantitative reflection of the magnitude of some phenomenon that is used for the purpose of addressing a question of interest. (Kelly & Preacher []). Definitions of effect size abound in literature but many of them cannot capture the complexity of effect size dimensions. Therefore the effect size formulas take many forms according to the nature of the analyzed phenomena. In essence the effect size discussions started from the more detailed analysis of the t statistics for two independent samples from two populations with same variance: 1 t (1) 1 1 s1 n1 n in which the start-up problem is the square root of sum of samples dimension (n 1 and n ). If n 1 and n is sufficiently large, the calculated t value will be, most probably, larger than theoretical t, which lead to rejecting the null hypothesis in most cases. Therefore it is necessary to calculate a descriptive value which doesn t depend on n 1 and n values, but which reflects the magnitude of differences between two compared means. The corresponding effect size for mean differences tested by the t statistic from the formulas (1) is: n1n 1 ES t () nn s. Effect size indicators 1 1 There is a wide diversity of indicators used to measure the effect size. Effect size (ES) indicators enable comparisons between the sizes of the effects. The most common form of expression of effect size indicators is: correlation coefficients or standardized mean differences. ES indicators can be classified: 1. by number of compared groups: the difference between two groups; the difference between more than two groups.. by the measure used to quantify the ES: as a standardized difference between two means; as the correlation between the independent variable classification and the individual scores on the dependent variable named ES correlation (Rosnow & Rosenthal [3]). A. The most common ES coefficients used in practice for two mean comparisons are (t test): 1. Cohen s d original coefficient (Cohen [4]) x1 x d (3) 1/ where x 1 and x are the means of two populations compared and is the standard deviation of one of them when the hypothesis of homoskedasticity is satisfied and the large sizes of the samples.. Cohen s d practical coefficient (Rosnow & Rosenthal [3]) x1 x d (4) pooled Initially (Cohen [4]) the pooled was calculated as a mean of two variances corresponding to the two compared groups when the hypothesis of homoskedasticity is satisfied and for large sizes of the samples:
3 Ciprian Turturean / Procedia Economics and Finance 0 ( 015 ) pooled (5) There is some differences between Cohen s d and Hedge s g coefficient: Firstly Cohen s d coefficient is a descriptive measure while Hedge s g coefficient is an inferential measure. Secondly Cohan used the parameter to express his coefficient while the Hedge used the unbiased estimators of this, s. In practice Hedge s g coefficient is more importance that the Cohen s d coefficient. The relation between Cohen s d and Hedge s g ES coefficient is given by the formula d g (6) N where N is the size of the aggregate size of the observed groups (ex: n 1 +n ) and is the degree of freedom of pooled variances ( ex: n 1 + n -). Hedge s g coefficient proposes to use instead of parameter pooled to use its estimation spooled (Hartung, Knapp & Sinha [5]) or more better the unbiased estimation s pooled : ' (n11)s 1(n 1)s s pooled (7) n1n Where n 1 and n are the sizes and the s 1 and s are the unbiased standard deviation of the compared samples when the hypothesis of homoskedasticity is satisfied. 3. Cohen s d and Hedge s g coefficient expressed by t The formula of Cohen s d coefficient in t is () (Rosenthal & Rosnow [6]): 1 d t( n1 n) (8) ( n1n) The formula of Hedge s g coefficient in t was presented in formula () (Rosenthal & Rosnow [6]): n1 n g t (9) nn 1 4. Cohen s d and Hedge s g coefficient expressed by r, the ES correlation r d (10) 1 r r nn 1 g (11) (1 r ) ( n1 n) 5. The ES correlation, r is the point biserial correlation between a dichotomous variable and, at least, an interval variable. cov(indep,dichot) r (1) n indepdichot r can be expressed by t t r (13) t In fact the sample correlation coefficient is a biased statistics (Fisher [7]). The unbiased estimate of population correlation is given by adjusted r (McGrath & Meyer [8]):
4 668 Ciprian Turturean / Procedia Economics and Finance 0 ( 015 ) r adj. 1 (1 r )( n1) n where n is the volume of sample. B. The classes of measures used for the multiple comparisons (ANOVA) are named association indexes. Some common formulas of effect size from this class are: 1. Eta squared ( ) and its corrections Epsilon-squared ( ) and Omega-squared ( ). The sample Eta-squared, R-square (R ) (Pearson [8]), is a biased estimator of proportion of explicative variation (Explicative Sum Square) in total variation (Total Sum Square). ESS ESS (14) R TSS ESS RSS (15) From relation (13), based on relation of F: SSE MSE E SSE R F (16) MSR SSR SSR E it is possible to obtain an expression of eta square in F: F E F F E R F R For multiple comparisons, as the sample correlation coefficient, the R square, the estimator of Eta-square, is a biased statistics (Fisher [7]). Two correction of eta-square have been suggested in literature: Epsilon-square and Omega-square (Olenjik & Algina [10]): Epsilon-squared (Kelley [11]) corrects the numerator of eta-squared by subtracting the error mean from the explicative sum of square: ESS RME 1 R (1 R ) (18) TSS R where R is the degree freedom of residuals and RME is the residual/ error mean square and ESS and TSS is the explicative and total sum squares. Omega-squared (Hays [1]) corrects the epsilon-squared by adding to the denominator of the epsilon-squared the residual/error mean square ESS RME (19) TSS RME The interpretations for this class of measures are presented in table 1. Table 1: Interpretation of d, r and r/ R / ˆ (Cohen [4]; Kotrlik & Williams [13], Kirk [14]): Cohen s standard d r r / R / ˆ R E (17) Large ES 0.5 < d 0.43 < r < r / R / ˆ Medium ES 0. < d < r < r / R / ˆ Small ES d 0. r 0.1 r / R / ˆ In conclusion, Who is afraid of Effect Size? The effect size measures and the Null Hypotheses Significance Testing (NHST) have aimed at different goals. The link between effect size and decision of NHST are relatively and are given by the sample volume. No matter how larger the effect size is, with a sufficiently large or small sample volume, we determine the values of the
5 Ciprian Turturean / Procedia Economics and Finance 0 ( 015 ) statistics of the tests, to become sufficiently big or small so as to obtain the desired result for the test. The sample volume relativizes the NHST. In conclusion, the Effect Size added a new dimension to the hypotheses testing one. What to do now? The solution is to limit/ standardized the volume sample so that the NHST and Effect Size to would not become relative. Choosing the sample size is an important aspect of any statistical research. Cohen & Cohen [15]; Kraemer & Thiemann [16], Cohen [4]; Green [17] and many more have been concerned with this issue. We conclude this paper with a brief enunciation of a set of rules for choosing the sample size depending on the type of comparisons made (Popa M.[18]): A. Testing the differences between means 1. The volume of sampling groups for testing the differences between means is 30 for each group. For example if we have a between subjects (BS) experimental design with 3X3 treatments. For this experiment we must use a sample of size at least 3x3x30 = 70 subjects. In case of the Within Subjects (WS) with 3x3 treatments the sample size will be at least 30!!. The minimum recommended volume, for the situation of comparing a small number of groups, is greater than in case when the comparison is made between several groups. B. Testing the level of association between variable 1. The volume of the sample for the study of a multiple correlation between k independent variable must be at least N=50+8k. For example, when we study the correlation between 5 independent variables we must work at least with a sample of size N=50+8x5=10 subjects.. The volume of the sample to study a multiple regression with k independent variable it must be at least N=104+k. Even more, if we have to study a regression with more than 5 predictors we must ensure that there are at least 10 subjects per each predictor or, even better, at least 30 subjects per each predictor. 3. For the Chi-square test the influences of the increases in the sample volume does not have a negative impact on NHST, but still is recommended that the volume of sampling should be at least 0 subjects and the volume of each groups should be at least 5 subjects. Referencies [1] Becker, A. L., Effect size (ES), 000, [] Kelly, K. & Preacher, J. K. On Effect Size, Psychological Methods, 01, Vol. 17 (), [3] Rosnow, R. L. & Rosenthal, R. Computing contrasts, effect sizes, and counter nulls on the people s published data: General procedures for research consumers, Psychological Methods, 1996, Vol. 1 (4), [4] Cohen, J. Statistical power analysis for the behavioral sciences, 1988 (nd Ed.). Hillsdale, NJ: Lawrence Erlbaum Associates. [5] Hartung, J. Knapp, G., & Sinha, B. K. Statistical meta-analysis with applications, 008, Hoboken, NJ: Wiley. [6] Rosenthal, R. & Rosnow, R. L. Essentials of behavioral research: Methods and data analysis 1991 (nd Ed.). New York: McGraw Hill. [7] Fisher, R. A. Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population, Biometrika, 1915, Vol. 10 (4), [8] McGrath, E. R. & Meyer, J. G. Ehen the effect Sizes Disagree: The case of r and d, Psychological Methods, 006, Vol. 11 (4), [9] Pearson, K. On the general theory of skew correlations and nonlinear regression, Mathematical contributions to the theory of evolution: XIV, Draper s Company Research Memoires, Biometric series II, London: Dulau [10] Olenjik S. & Algina J. Measures of Effect Size for comparative Studies: Applications, Interpretations, and Limitations, Contemporary Educational Psychology, 000, Vol. 5 (3), [11] Kelley, T. L. An unbiased correlation ratio measure. Proceedings of the National Academy of Sciences, Vol. 1, [1] Hays, W. L. Statistics for psychologists, New York: Holt, Reinehart & Winston, [13] Kotrlik & Williams, The Incorporation of Effect Size, Information Technology, Learning, and Performance Research, 003, Vol. 1 (1) [14] Kirk, R. E. Practical significance: A concept whose time has come. Educational and Psychological Measurement, 1996, Vol. 56 (5), [15] Cohen, J. & Cohen, P. Applied multiple regression/ correlation analysis for the behavioral sciences, 1975, Hillsdale, NJ: Erlbaum. [16] Kraemer, H. C. & Thiemann, S., How many subjects? Statistical power analysis in research, 1987, Newbury Park CA: Sage. [17] Green, S.B, How many subjects does it take to do a regression analysis?, Multivariate Behavioral research,1991, Vol. 6 (3), [18] Popa, M. Statistica pentru psihologie, 008, Ed. Polirom, Iasi.
Psychology 282 Lecture #4 Outline Inferences in SLR
Psychology 282 Lecture #4 Outline Inferences in SLR Assumptions To this point we have not had to make any distributional assumptions. Principle of least squares requires no assumptions. Can use correlations
More informationCHAPTER 2. Types of Effect size indices: An Overview of the Literature
CHAPTER Types of Effect size indices: An Overview of the Literature There are different types of effect size indices as a result of their different interpretations. Huberty (00) names three different types:
More informationDETAILED CONTENTS PART I INTRODUCTION AND DESCRIPTIVE STATISTICS. 1. Introduction to Statistics
DETAILED CONTENTS About the Author Preface to the Instructor To the Student How to Use SPSS With This Book PART I INTRODUCTION AND DESCRIPTIVE STATISTICS 1. Introduction to Statistics 1.1 Descriptive and
More informationr(equivalent): A Simple Effect Size Indicator
r(equivalent): A Simple Effect Size Indicator The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters Citation Rosenthal, Robert, and
More informationIn a one-way ANOVA, the total sums of squares among observations is partitioned into two components: Sums of squares represent:
Activity #10: AxS ANOVA (Repeated subjects design) Resources: optimism.sav So far in MATH 300 and 301, we have studied the following hypothesis testing procedures: 1) Binomial test, sign-test, Fisher s
More informationChapter 4. Regression Models. Learning Objectives
Chapter 4 Regression Models To accompany Quantitative Analysis for Management, Eleventh Edition, by Render, Stair, and Hanna Power Point slides created by Brian Peterson Learning Objectives After completing
More informationWhat p values really mean (and why I should care) Francis C. Dane, PhD
What p values really mean (and why I should care) Francis C. Dane, PhD Session Objectives Understand the statistical decision process Appreciate the limitations of interpreting p values Value the use of
More informationCorrelation Interpretation on Diabetes Mellitus Patients
Annals of the University of Craiova, Mathematics and Computer Science Series Volume 37(3), 2010, Pages 101 109 ISSN: 1223-6934 Correlation Interpretation on Diabetes Mellitus Patients Dana Dănciulescu
More information10/31/2012. One-Way ANOVA F-test
PSY 511: Advanced Statistics for Psychological and Behavioral Research 1 1. Situation/hypotheses 2. Test statistic 3.Distribution 4. Assumptions One-Way ANOVA F-test One factor J>2 independent samples
More informationEstimating σ 2. We can do simple prediction of Y and estimation of the mean of Y at any value of X.
Estimating σ 2 We can do simple prediction of Y and estimation of the mean of Y at any value of X. To perform inferences about our regression line, we must estimate σ 2, the variance of the error term.
More informationThe Multiple Regression Model
Multiple Regression The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & or more independent variables (X i ) Multiple Regression Model with k Independent Variables:
More informationRegression Analysis. BUS 735: Business Decision Making and Research. Learn how to detect relationships between ordinal and categorical variables.
Regression Analysis BUS 735: Business Decision Making and Research 1 Goals of this section Specific goals Learn how to detect relationships between ordinal and categorical variables. Learn how to estimate
More informationIJESMR International Journal OF Engineering Sciences & Management Research
METHOD OF IMPLEMENTING ANALYSIS OF VARIANCE (ANOVA) IN RESEARCH STUDIES Asha Singh * & Balkeshwar Singh *Department of Business Management, Mewar University, Chittorghar, Rajasthan, India Mechanical Engineering
More informationLecture 15 Multiple regression I Chapter 6 Set 2 Least Square Estimation The quadratic form to be minimized is
Lecture 15 Multiple regression I Chapter 6 Set 2 Least Square Estimation The quadratic form to be minimized is Q = (Y i β 0 β 1 X i1 β 2 X i2 β p 1 X i.p 1 ) 2, which in matrix notation is Q = (Y Xβ) (Y
More informationProcedia - Social and Behavioral Sciences 109 ( 2014 )
Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 09 ( 04 ) 730 736 nd World Conference On Business, Economics And Management - WCBEM 03 Categorical Principal
More informationIntroduction to Business Statistics QM 220 Chapter 12
Department of Quantitative Methods & Information Systems Introduction to Business Statistics QM 220 Chapter 12 Dr. Mohammad Zainal 12.1 The F distribution We already covered this topic in Ch. 10 QM-220,
More informationFormal Statement of Simple Linear Regression Model
Formal Statement of Simple Linear Regression Model Y i = β 0 + β 1 X i + ɛ i Y i value of the response variable in the i th trial β 0 and β 1 are parameters X i is a known constant, the value of the predictor
More informationMethodology Review: Applications of Distribution Theory in Studies of. Population Validity and Cross Validity. James Algina. University of Florida
Distribution Theory 1 Methodology eview: Applications of Distribution Theory in Studies of Population Validity and Cross Validity by James Algina University of Florida and H. J. Keselman University of
More informationContrasts and Correlations in Effect-size Estimation
Contrasts and Correlations in Effect-size Estimation The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters. Citation Published Version
More informationFinding Relationships Among Variables
Finding Relationships Among Variables BUS 230: Business and Economic Research and Communication 1 Goals Specific goals: Re-familiarize ourselves with basic statistics ideas: sampling distributions, hypothesis
More informationSimple Linear Regression: One Qualitative IV
Simple Linear Regression: One Qualitative IV 1. Purpose As noted before regression is used both to explain and predict variation in DVs, and adding to the equation categorical variables extends regression
More informationSOME ASPECTS OF MULTIVARIATE BEHRENS-FISHER PROBLEM
SOME ASPECTS OF MULTIVARIATE BEHRENS-FISHER PROBLEM Junyong Park Bimal Sinha Department of Mathematics/Statistics University of Maryland, Baltimore Abstract In this paper we discuss the well known multivariate
More informationThe Binomial Effect Size Display (BESD)
Technical Whitepaper Paul Barrett Chief Research Scientist q April, 2013 The Binomial Effect Size Display (BESD) Is this always an accurate index of effect? I provide the definition, some warnings of the
More information8/23/2018. One-Way ANOVA F-test. 1. Situation/hypotheses. 2. Test statistic. 3.Distribution. 4. Assumptions
PSY 5101: Advanced Statistics for Psychological and Behavioral Research 1 1. Situation/hypotheses 2. Test statistic One-Way ANOVA F-test One factor J>2 independent samples H o :µ 1 µ 2 µ J F 3.Distribution
More informationMULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS
MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS Page 1 MSR = Mean Regression Sum of Squares MSE = Mean Squared Error RSS = Regression Sum of Squares SSE = Sum of Squared Errors/Residuals α = Level
More informationOne-Way Analysis of Variance: A Guide to Testing Differences Between Multiple Groups
One-Way Analysis of Variance: A Guide to Testing Differences Between Multiple Groups In analysis of variance, the main research question is whether the sample means are from different populations. The
More informationInferences for Regression
Inferences for Regression An Example: Body Fat and Waist Size Looking at the relationship between % body fat and waist size (in inches). Here is a scatterplot of our data set: Remembering Regression In
More informationDISCRIMINANT ANALYSIS IN THE STUDY OF ROMANIAN REGIONAL ECONOMIC DEVELOPMENT
ANALELE ŞTIINŢIFICE ALE UNIVERSITĂŢII ALEXANDRU IOAN CUZA DIN IAŞI Tomul LIV Ştiinţe Economice 007 DISCRIMINANT ANALYSIS IN THE STUDY OF ROMANIAN REGIONAL ECONOMIC DEVELOPMENT ELISABETA JABA * DĂNUŢ VASILE
More informationResearch Design - - Topic 19 Multiple regression: Applications 2009 R.C. Gardner, Ph.D.
Research Design - - Topic 19 Multiple regression: Applications 2009 R.C. Gardner, Ph.D. Curve Fitting Mediation analysis Moderation Analysis 1 Curve Fitting The investigation of non-linear functions using
More information1 Overview. Coefficients of. Correlation, Alienation and Determination. Hervé Abdi Lynne J. Williams
In Neil Salkind (Ed.), Encyclopedia of Research Design. Thousand Oaks, CA: Sage. 2010 Coefficients of Correlation, Alienation and Determination Hervé Abdi Lynne J. Williams 1 Overview The coefficient of
More informationThe t-test: A z-score for a sample mean tells us where in the distribution the particular mean lies
The t-test: So Far: Sampling distribution benefit is that even if the original population is not normal, a sampling distribution based on this population will be normal (for sample size > 30). Benefit
More informationReview of Statistics 101
Review of Statistics 101 We review some important themes from the course 1. Introduction Statistics- Set of methods for collecting/analyzing data (the art and science of learning from data). Provides methods
More informationStatistics for Managers using Microsoft Excel 6 th Edition
Statistics for Managers using Microsoft Excel 6 th Edition Chapter 13 Simple Linear Regression 13-1 Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value of
More information10/4/2013. Hypothesis Testing & z-test. Hypothesis Testing. Hypothesis Testing
& z-test Lecture Set 11 We have a coin and are trying to determine if it is biased or unbiased What should we assume? Why? Flip coin n = 100 times E(Heads) = 50 Why? Assume we count 53 Heads... What could
More informationy ˆ i = ˆ " T u i ( i th fitted value or i th fit)
1 2 INFERENCE FOR MULTIPLE LINEAR REGRESSION Recall Terminology: p predictors x 1, x 2,, x p Some might be indicator variables for categorical variables) k-1 non-constant terms u 1, u 2,, u k-1 Each u
More informationTwo-Mean Inference. Two-Group Research. Research Designs. The Correlated Samples t Test
Two-Mean Inference 6430 Two-Group Research. We wish to know whether two groups (samples) of scores (on some continuous OV, outcome variable) are different enough from one another to indicate that the two
More informationChapter 14 Student Lecture Notes Department of Quantitative Methods & Information Systems. Business Statistics. Chapter 14 Multiple Regression
Chapter 14 Student Lecture Notes 14-1 Department of Quantitative Methods & Information Systems Business Statistics Chapter 14 Multiple Regression QMIS 0 Dr. Mohammad Zainal Chapter Goals After completing
More informationCorrelation and Regression
Correlation and Regression October 25, 2017 STAT 151 Class 9 Slide 1 Outline of Topics 1 Associations 2 Scatter plot 3 Correlation 4 Regression 5 Testing and estimation 6 Goodness-of-fit STAT 151 Class
More informationTwo-Sample Inferential Statistics
The t Test for Two Independent Samples 1 Two-Sample Inferential Statistics In an experiment there are two or more conditions One condition is often called the control condition in which the treatment is
More informationOutline. Remedial Measures) Extra Sums of Squares Standardized Version of the Multiple Regression Model
Outline 1 Multiple Linear Regression (Estimation, Inference, Diagnostics and Remedial Measures) 2 Special Topics for Multiple Regression Extra Sums of Squares Standardized Version of the Multiple Regression
More informationSimple Linear Regression: One Quantitative IV
Simple Linear Regression: One Quantitative IV Linear regression is frequently used to explain variation observed in a dependent variable (DV) with theoretically linked independent variables (IV). For example,
More informationParameter Estimation, Sampling Distributions & Hypothesis Testing
Parameter Estimation, Sampling Distributions & Hypothesis Testing Parameter Estimation & Hypothesis Testing In doing research, we are usually interested in some feature of a population distribution (which
More informationUnit 27 One-Way Analysis of Variance
Unit 27 One-Way Analysis of Variance Objectives: To perform the hypothesis test in a one-way analysis of variance for comparing more than two population means Recall that a two sample t test is applied
More informationThis gives us an upper and lower bound that capture our population mean.
Confidence Intervals Critical Values Practice Problems 1 Estimation 1.1 Confidence Intervals Definition 1.1 Margin of error. The margin of error of a distribution is the amount of error we predict when
More informationModel Estimation Example
Ronald H. Heck 1 EDEP 606: Multivariate Methods (S2013) April 7, 2013 Model Estimation Example As we have moved through the course this semester, we have encountered the concept of model estimation. Discussions
More informationJournal of Educational and Behavioral Statistics
Journal of Educational and Behavioral Statistics http://jebs.aera.net Theory of Estimation and Testing of Effect Sizes: Use in Meta-Analysis Helena Chmura Kraemer JOURNAL OF EDUCATIONAL AND BEHAVIORAL
More informationAMS7: WEEK 7. CLASS 1. More on Hypothesis Testing Monday May 11th, 2015
AMS7: WEEK 7. CLASS 1 More on Hypothesis Testing Monday May 11th, 2015 Testing a Claim about a Standard Deviation or a Variance We want to test claims about or 2 Example: Newborn babies from mothers taking
More informationPrepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti
Prepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Putra Malaysia Serdang Use in experiment, quasi-experiment
More informationTypes of Statistical Tests DR. MIKE MARRAPODI
Types of Statistical Tests DR. MIKE MARRAPODI Tests t tests ANOVA Correlation Regression Multivariate Techniques Non-parametric t tests One sample t test Independent t test Paired sample t test One sample
More informationRegression Models. Chapter 4. Introduction. Introduction. Introduction
Chapter 4 Regression Models Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna 008 Prentice-Hall, Inc. Introduction Regression analysis is a very valuable tool for a manager
More informationTransition Passage to Descriptive Statistics 28
viii Preface xiv chapter 1 Introduction 1 Disciplines That Use Quantitative Data 5 What Do You Mean, Statistics? 6 Statistics: A Dynamic Discipline 8 Some Terminology 9 Problems and Answers 12 Scales of
More informationCh 2: Simple Linear Regression
Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component
More informationAnalysis of Variance
Analysis of Variance Chapter 12 McGraw-Hill/Irwin Copyright 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Learning Objectives LO 12-1 List the characteristics of the F distribution and locate
More informationLECTURE 6. Introduction to Econometrics. Hypothesis testing & Goodness of fit
LECTURE 6 Introduction to Econometrics Hypothesis testing & Goodness of fit October 25, 2016 1 / 23 ON TODAY S LECTURE We will explain how multiple hypotheses are tested in a regression model We will define
More informationRecommended effect size statistics for repeated measures designs
Behavior Research Methods 005, 37 (3, 379-384 Recommended size statistics for repeated measures designs ROGER BAKEMAN Georgia State University, Atlanta, Georgia Investigators, who are increasingly implored
More informationHomoskedasticity. Var (u X) = σ 2. (23)
Homoskedasticity How big is the difference between the OLS estimator and the true parameter? To answer this question, we make an additional assumption called homoskedasticity: Var (u X) = σ 2. (23) This
More informationConfidence Intervals, Testing and ANOVA Summary
Confidence Intervals, Testing and ANOVA Summary 1 One Sample Tests 1.1 One Sample z test: Mean (σ known) Let X 1,, X n a r.s. from N(µ, σ) or n > 30. Let The test statistic is H 0 : µ = µ 0. z = x µ 0
More informationy response variable x 1, x 2,, x k -- a set of explanatory variables
11. Multiple Regression and Correlation y response variable x 1, x 2,, x k -- a set of explanatory variables In this chapter, all variables are assumed to be quantitative. Chapters 12-14 show how to incorporate
More informationHypothesis testing. 1 Principle of hypothesis testing 2
Hypothesis testing Contents 1 Principle of hypothesis testing One sample tests 3.1 Tests on Mean of a Normal distribution..................... 3. Tests on Variance of a Normal distribution....................
More informationFRANKLIN UNIVERSITY PROFICIENCY EXAM (FUPE) STUDY GUIDE
FRANKLIN UNIVERSITY PROFICIENCY EXAM (FUPE) STUDY GUIDE Course Title: Probability and Statistics (MATH 80) Recommended Textbook(s): Number & Type of Questions: Probability and Statistics for Engineers
More informationPrepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti
Prepared by: Prof Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Putra Malaysia Serdang M L Regression is an extension to
More informationOne-Way ANOVA Cohen Chapter 12 EDUC/PSY 6600
One-Way ANOVA Cohen Chapter 1 EDUC/PSY 6600 1 It is easy to lie with statistics. It is hard to tell the truth without statistics. -Andrejs Dunkels Motivating examples Dr. Vito randomly assigns 30 individuals
More informationChapter 4: Regression Models
Sales volume of company 1 Textbook: pp. 129-164 Chapter 4: Regression Models Money spent on advertising 2 Learning Objectives After completing this chapter, students will be able to: Identify variables,
More informationCh 3: Multiple Linear Regression
Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery
More informationSTA121: Applied Regression Analysis
STA121: Applied Regression Analysis Linear Regression Analysis - Chapters 3 and 4 in Dielman Artin Department of Statistical Science September 15, 2009 Outline 1 Simple Linear Regression Analysis 2 Using
More informationThe One-Way Repeated-Measures ANOVA. (For Within-Subjects Designs)
The One-Way Repeated-Measures ANOVA (For Within-Subjects Designs) Logic of the Repeated-Measures ANOVA The repeated-measures ANOVA extends the analysis of variance to research situations using repeated-measures
More informationCorrelation Analysis
Simple Regression Correlation Analysis Correlation analysis is used to measure strength of the association (linear relationship) between two variables Correlation is only concerned with strength of the
More informationWe like to capture and represent the relationship between a set of possible causes and their response, by using a statistical predictive model.
Statistical Methods in Business Lecture 5. Linear Regression We like to capture and represent the relationship between a set of possible causes and their response, by using a statistical predictive model.
More informationKeller: Stats for Mgmt & Econ, 7th Ed July 17, 2006
Chapter 17 Simple Linear Regression and Correlation 17.1 Regression Analysis Our problem objective is to analyze the relationship between interval variables; regression analysis is the first tool we will
More informationInequality constrained hypotheses for ANOVA
Inequality constrained hypotheses for ANOVA Maaike van Rossum, Rens van de Schoot, Herbert Hoijtink Department of Methods and Statistics, Utrecht University Abstract In this paper a novel approach for
More informationDraft Proof - Do not copy, post, or distribute. Chapter Learning Objectives REGRESSION AND CORRELATION THE SCATTER DIAGRAM
1 REGRESSION AND CORRELATION As we learned in Chapter 9 ( Bivariate Tables ), the differential access to the Internet is real and persistent. Celeste Campos-Castillo s (015) research confirmed the impact
More informationCorrelation. A statistics method to measure the relationship between two variables. Three characteristics
Correlation Correlation A statistics method to measure the relationship between two variables Three characteristics Direction of the relationship Form of the relationship Strength/Consistency Direction
More informationLinear Regression with 1 Regressor. Introduction to Econometrics Spring 2012 Ken Simons
Linear Regression with 1 Regressor Introduction to Econometrics Spring 2012 Ken Simons Linear Regression with 1 Regressor 1. The regression equation 2. Estimating the equation 3. Assumptions required for
More informationECON3150/4150 Spring 2016
ECON3150/4150 Spring 2016 Lecture 4 - The linear regression model Siv-Elisabeth Skjelbred University of Oslo Last updated: January 26, 2016 1 / 49 Overview These lecture slides covers: The linear regression
More informationStatistical. Psychology
SEVENTH у *i km m it* & П SB Й EDITION Statistical M e t h o d s for Psychology D a v i d C. Howell University of Vermont ; \ WADSWORTH f% CENGAGE Learning* Australia Biaall apan Korea Меяко Singapore
More informationEconometrics Midterm Examination Answers
Econometrics Midterm Examination Answers March 4, 204. Question (35 points) Answer the following short questions. (i) De ne what is an unbiased estimator. Show that X is an unbiased estimator for E(X i
More informationComparison between Models With and Without Intercept
Gen. Math. Notes, Vol. 2, No., March 24, pp. -27 ISSN 229-74; Copyright ICSRS Publication, 24 www.i-csrs.org Available free online at http://www.geman.in Comparison between Models With and Without Intercept
More informationEcon 3790: Business and Economic Statistics. Instructor: Yogesh Uppal
Econ 3790: Business and Economic Statistics Instructor: Yogesh Uppal Email: yuppal@ysu.edu Chapter 13, Part A: Analysis of Variance and Experimental Design Introduction to Analysis of Variance Analysis
More informationIS OMEGA SQUARED LESS BIASED? A COMPARISON OF THREE MAJOR EFFECT SIZE INDICES IN ONE-WAY ANOVA
Behaviormetrika Vol.40, No.2, 2013, 129 147 IS OMEGA SQUARED LESS BIASED? A COMPARISON OF THREE MAJOR EFFECT SIZE INDICES IN ONE-WAY ANOVA Kensuke Okada The purpose of this study is to find less biased
More informationLecture 10 Multiple Linear Regression
Lecture 10 Multiple Linear Regression STAT 512 Spring 2011 Background Reading KNNL: 6.1-6.5 10-1 Topic Overview Multiple Linear Regression Model 10-2 Data for Multiple Regression Y i is the response variable
More informationTHE EFFECTS OF NONNORMAL DISTRIBUTIONS ON CONFIDENCE INTERVALS AROUND THE STANDARDIZED MEAN DIFFERENCE: BOOTSTRAP AND PARAMETRIC CONFIDENCE INTERVALS
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 10.1177/0013164404264850 KELLEY THE EFFECTS OF NONNORMAL DISTRIBUTIONS ON CONFIDENCE INTERVALS AROUND THE STANDARDIZED MEAN DIFFERENCE: BOOTSTRAP AND PARAMETRIC
More informationHypothesis Testing hypothesis testing approach
Hypothesis Testing In this case, we d be trying to form an inference about that neighborhood: Do people there shop more often those people who are members of the larger population To ascertain this, we
More informationDESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective
DESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective Second Edition Scott E. Maxwell Uniuersity of Notre Dame Harold D. Delaney Uniuersity of New Mexico J,t{,.?; LAWRENCE ERLBAUM ASSOCIATES,
More informationChapter 2. Continued. Proofs For ANOVA Proof of ANOVA Identity. the product term in the above equation can be simplified as n
Chapter 2. Continued Proofs For ANOVA Proof of ANOVA Identity We are going to prove that Writing SST SSR + SSE. Y i Ȳ (Y i Ŷ i ) + (Ŷ i Ȳ ) Squaring both sides summing over all i 1,...n, we get (Y i Ȳ
More informationPSYC 331 STATISTICS FOR PSYCHOLOGISTS
PSYC 331 STATISTICS FOR PSYCHOLOGISTS Session 4 A PARAMETRIC STATISTICAL TEST FOR MORE THAN TWO POPULATIONS Lecturer: Dr. Paul Narh Doku, Dept of Psychology, UG Contact Information: pndoku@ug.edu.gh College
More informationChapter 14 Simple Linear Regression (A)
Chapter 14 Simple Linear Regression (A) 1. Characteristics Managerial decisions often are based on the relationship between two or more variables. can be used to develop an equation showing how the variables
More informationSampling distribution of t. 2. Sampling distribution of t. 3. Example: Gas mileage investigation. II. Inferential Statistics (8) t =
2. The distribution of t values that would be obtained if a value of t were calculated for each sample mean for all possible random of a given size from a population _ t ratio: (X - µ hyp ) t s x The result
More informationEvaluation. Andrea Passerini Machine Learning. Evaluation
Andrea Passerini passerini@disi.unitn.it Machine Learning Basic concepts requires to define performance measures to be optimized Performance of learning algorithms cannot be evaluated on entire domain
More informationCIVL /8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8
CIVL - 7904/8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8 Chi-square Test How to determine the interval from a continuous distribution I = Range 1 + 3.322(logN) I-> Range of the class interval
More informationHypothesis Testing for Var-Cov Components
Hypothesis Testing for Var-Cov Components When the specification of coefficients as fixed, random or non-randomly varying is considered, a null hypothesis of the form is considered, where Additional output
More informationPaper Robust Effect Size Estimates and Meta-Analytic Tests of Homogeneity
Paper 27-25 Robust Effect Size Estimates and Meta-Analytic Tests of Homogeneity Kristine Y. Hogarty and Jeffrey D. Kromrey Department of Educational Measurement and Research, University of South Florida
More informationVariance Decomposition and Goodness of Fit
Variance Decomposition and Goodness of Fit 1. Example: Monthly Earnings and Years of Education In this tutorial, we will focus on an example that explores the relationship between total monthly earnings
More informationSample Size to Detect a Planned Contrast and a One Degree-of-Freedom Interaction Effect
Sample Size to Detect a Planned Contrast and a One Degree-of-Freedom Interaction Effect By: Douglas Wahlsten Wahlsten, D. Sample size to detect a planned contrast and a one degree-of-freedom interaction
More informationTEST POWER IN COMPARISON DIFFERENCE BETWEEN TWO INDEPENDENT PROPORTIONS
TEST POWER IN COMPARISON DIFFERENCE BETWEEN TWO INDEPENDENT PROPORTIONS Mehmet MENDES PhD, Associate Professor, Canakkale Onsekiz Mart University, Agriculture Faculty, Animal Science Department, Biometry
More informationStatistics II Exercises Chapter 5
Statistics II Exercises Chapter 5 1. Consider the four datasets provided in the transparencies for Chapter 5 (section 5.1) (a) Check that all four datasets generate exactly the same LS linear regression
More informationSTATISTICS FOR ECONOMISTS: A BEGINNING. John E. Floyd University of Toronto
STATISTICS FOR ECONOMISTS: A BEGINNING John E. Floyd University of Toronto July 2, 2010 PREFACE The pages that follow contain the material presented in my introductory quantitative methods in economics
More informationMultiple t Tests. Introduction to Analysis of Variance. Experiments with More than 2 Conditions
Introduction to Analysis of Variance 1 Experiments with More than 2 Conditions Often the research that psychologists perform has more conditions than just the control and experimental conditions You might
More informationSensitiveness analysis: Sample sizes for t-tests for paired samples
Sensitiveness analysis: Sample sizes for t-tests for paired samples (J.D.Perezgonzalez, 2016, Massey University, New Zealand, doi: 10.13140/RG.2.2.32249.47203) Table 1 shows the sample sizes required for
More informationEvaluation requires to define performance measures to be optimized
Evaluation Basic concepts Evaluation requires to define performance measures to be optimized Performance of learning algorithms cannot be evaluated on entire domain (generalization error) approximation
More informationEcon 3790: Business and Economics Statistics. Instructor: Yogesh Uppal
Econ 3790: Business and Economics Statistics Instructor: Yogesh Uppal yuppal@ysu.edu Sampling Distribution of b 1 Expected value of b 1 : Variance of b 1 : E(b 1 ) = 1 Var(b 1 ) = σ 2 /SS x Estimate of
More information