ScienceDirect. Who s afraid of the effect size?

Size: px
Start display at page:

Download "ScienceDirect. Who s afraid of the effect size?"

Transcription

1 Available online at ScienceDirect Procedia Economics and Finance 0 ( 015 ) th International Conference on Globalization of Higher Education in Economics and Business Administration, GEBA 013 Who s afraid of the effect size? Ciprian Turturean* Alexandru Ioan Cuza University of Iasi,, Carol 1 Ave., no., , Iasi, Romania Abstract The effect size (no more than 35 years) is new topic discussion especially in psychological field. He is quantified by a class of descriptive statistical indicators which based on d Cohen s coefficient. The effect size bring us an additional information to inferential decision to accept or to reject the Null Hypothesis, reason that we find an wide discussion under name Null Hypothesis Significance Testing (NHTS). Therefore the American Psychological Association (APA) recommended in chapter 1.01 Designing and Reporting Research; all published statistical reports also include effect size (APA 5th edition manual section (00)) The The Authors. Authors. Published Published by by Elsevier Elsevier B.V. B.V. This is an open access article under the CC BY-NC-ND license ( Selection and peer-review under responsibility of the Faculty of Economics and Business Administration, Alexandru Ioan Cuza Peer-review University of under Iasi. responsibility of the Faculty of Economics and Business Administration, Alexandru Ioan Cuza University of Iasi. Keywords: effect size, indicators, comparing means, effect size association indexes, effect size coefficients 1. Introduction - What s the effect size? Statistical tests comparing the central level between two statistical distributions give us the answer to the question: Are there significant differences between the two different treatments? but they fail to give us information on the magnitude of the difference. What is more, if we work with two different pair of samples, the estimated variances and central levels, most probably, will differ even if the samples volume and the populations of origin are the same. The new questions that arise are: How big is the magnitude of differences between two different treatments?, How can we quantify the magnitude of differences between two different treatments so that we offer comparability from one test to the other?, Therefore, what is the effect size? * Corresponding author. Tel.: address: ciprian.turturean@uaic.ro The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license ( Peer-review under responsibility of the Faculty of Economics and Business Administration, Alexandru Ioan Cuza University of Iasi. doi: /s1-5671(15)0011-5

2 666 Ciprian Turturean / Procedia Economics and Finance 0 ( 015 ) Effect Size (ES) is a name given to a family of indices that measure the magnitude of treatment effect. Unlike significance tests, these indices are independent of sample size. ES measures are common currency of metaanalysis studies that summarize the findings from a specific area of research. (Lee A. Becker, [1]). or Effect size is a quantitative reflection of the magnitude of some phenomenon that is used for the purpose of addressing a question of interest. (Kelly & Preacher []). Definitions of effect size abound in literature but many of them cannot capture the complexity of effect size dimensions. Therefore the effect size formulas take many forms according to the nature of the analyzed phenomena. In essence the effect size discussions started from the more detailed analysis of the t statistics for two independent samples from two populations with same variance: 1 t (1) 1 1 s1 n1 n in which the start-up problem is the square root of sum of samples dimension (n 1 and n ). If n 1 and n is sufficiently large, the calculated t value will be, most probably, larger than theoretical t, which lead to rejecting the null hypothesis in most cases. Therefore it is necessary to calculate a descriptive value which doesn t depend on n 1 and n values, but which reflects the magnitude of differences between two compared means. The corresponding effect size for mean differences tested by the t statistic from the formulas (1) is: n1n 1 ES t () nn s. Effect size indicators 1 1 There is a wide diversity of indicators used to measure the effect size. Effect size (ES) indicators enable comparisons between the sizes of the effects. The most common form of expression of effect size indicators is: correlation coefficients or standardized mean differences. ES indicators can be classified: 1. by number of compared groups: the difference between two groups; the difference between more than two groups.. by the measure used to quantify the ES: as a standardized difference between two means; as the correlation between the independent variable classification and the individual scores on the dependent variable named ES correlation (Rosnow & Rosenthal [3]). A. The most common ES coefficients used in practice for two mean comparisons are (t test): 1. Cohen s d original coefficient (Cohen [4]) x1 x d (3) 1/ where x 1 and x are the means of two populations compared and is the standard deviation of one of them when the hypothesis of homoskedasticity is satisfied and the large sizes of the samples.. Cohen s d practical coefficient (Rosnow & Rosenthal [3]) x1 x d (4) pooled Initially (Cohen [4]) the pooled was calculated as a mean of two variances corresponding to the two compared groups when the hypothesis of homoskedasticity is satisfied and for large sizes of the samples:

3 Ciprian Turturean / Procedia Economics and Finance 0 ( 015 ) pooled (5) There is some differences between Cohen s d and Hedge s g coefficient: Firstly Cohen s d coefficient is a descriptive measure while Hedge s g coefficient is an inferential measure. Secondly Cohan used the parameter to express his coefficient while the Hedge used the unbiased estimators of this, s. In practice Hedge s g coefficient is more importance that the Cohen s d coefficient. The relation between Cohen s d and Hedge s g ES coefficient is given by the formula d g (6) N where N is the size of the aggregate size of the observed groups (ex: n 1 +n ) and is the degree of freedom of pooled variances ( ex: n 1 + n -). Hedge s g coefficient proposes to use instead of parameter pooled to use its estimation spooled (Hartung, Knapp & Sinha [5]) or more better the unbiased estimation s pooled : ' (n11)s 1(n 1)s s pooled (7) n1n Where n 1 and n are the sizes and the s 1 and s are the unbiased standard deviation of the compared samples when the hypothesis of homoskedasticity is satisfied. 3. Cohen s d and Hedge s g coefficient expressed by t The formula of Cohen s d coefficient in t is () (Rosenthal & Rosnow [6]): 1 d t( n1 n) (8) ( n1n) The formula of Hedge s g coefficient in t was presented in formula () (Rosenthal & Rosnow [6]): n1 n g t (9) nn 1 4. Cohen s d and Hedge s g coefficient expressed by r, the ES correlation r d (10) 1 r r nn 1 g (11) (1 r ) ( n1 n) 5. The ES correlation, r is the point biserial correlation between a dichotomous variable and, at least, an interval variable. cov(indep,dichot) r (1) n indepdichot r can be expressed by t t r (13) t In fact the sample correlation coefficient is a biased statistics (Fisher [7]). The unbiased estimate of population correlation is given by adjusted r (McGrath & Meyer [8]):

4 668 Ciprian Turturean / Procedia Economics and Finance 0 ( 015 ) r adj. 1 (1 r )( n1) n where n is the volume of sample. B. The classes of measures used for the multiple comparisons (ANOVA) are named association indexes. Some common formulas of effect size from this class are: 1. Eta squared ( ) and its corrections Epsilon-squared ( ) and Omega-squared ( ). The sample Eta-squared, R-square (R ) (Pearson [8]), is a biased estimator of proportion of explicative variation (Explicative Sum Square) in total variation (Total Sum Square). ESS ESS (14) R TSS ESS RSS (15) From relation (13), based on relation of F: SSE MSE E SSE R F (16) MSR SSR SSR E it is possible to obtain an expression of eta square in F: F E F F E R F R For multiple comparisons, as the sample correlation coefficient, the R square, the estimator of Eta-square, is a biased statistics (Fisher [7]). Two correction of eta-square have been suggested in literature: Epsilon-square and Omega-square (Olenjik & Algina [10]): Epsilon-squared (Kelley [11]) corrects the numerator of eta-squared by subtracting the error mean from the explicative sum of square: ESS RME 1 R (1 R ) (18) TSS R where R is the degree freedom of residuals and RME is the residual/ error mean square and ESS and TSS is the explicative and total sum squares. Omega-squared (Hays [1]) corrects the epsilon-squared by adding to the denominator of the epsilon-squared the residual/error mean square ESS RME (19) TSS RME The interpretations for this class of measures are presented in table 1. Table 1: Interpretation of d, r and r/ R / ˆ (Cohen [4]; Kotrlik & Williams [13], Kirk [14]): Cohen s standard d r r / R / ˆ R E (17) Large ES 0.5 < d 0.43 < r < r / R / ˆ Medium ES 0. < d < r < r / R / ˆ Small ES d 0. r 0.1 r / R / ˆ In conclusion, Who is afraid of Effect Size? The effect size measures and the Null Hypotheses Significance Testing (NHST) have aimed at different goals. The link between effect size and decision of NHST are relatively and are given by the sample volume. No matter how larger the effect size is, with a sufficiently large or small sample volume, we determine the values of the

5 Ciprian Turturean / Procedia Economics and Finance 0 ( 015 ) statistics of the tests, to become sufficiently big or small so as to obtain the desired result for the test. The sample volume relativizes the NHST. In conclusion, the Effect Size added a new dimension to the hypotheses testing one. What to do now? The solution is to limit/ standardized the volume sample so that the NHST and Effect Size to would not become relative. Choosing the sample size is an important aspect of any statistical research. Cohen & Cohen [15]; Kraemer & Thiemann [16], Cohen [4]; Green [17] and many more have been concerned with this issue. We conclude this paper with a brief enunciation of a set of rules for choosing the sample size depending on the type of comparisons made (Popa M.[18]): A. Testing the differences between means 1. The volume of sampling groups for testing the differences between means is 30 for each group. For example if we have a between subjects (BS) experimental design with 3X3 treatments. For this experiment we must use a sample of size at least 3x3x30 = 70 subjects. In case of the Within Subjects (WS) with 3x3 treatments the sample size will be at least 30!!. The minimum recommended volume, for the situation of comparing a small number of groups, is greater than in case when the comparison is made between several groups. B. Testing the level of association between variable 1. The volume of the sample for the study of a multiple correlation between k independent variable must be at least N=50+8k. For example, when we study the correlation between 5 independent variables we must work at least with a sample of size N=50+8x5=10 subjects.. The volume of the sample to study a multiple regression with k independent variable it must be at least N=104+k. Even more, if we have to study a regression with more than 5 predictors we must ensure that there are at least 10 subjects per each predictor or, even better, at least 30 subjects per each predictor. 3. For the Chi-square test the influences of the increases in the sample volume does not have a negative impact on NHST, but still is recommended that the volume of sampling should be at least 0 subjects and the volume of each groups should be at least 5 subjects. Referencies [1] Becker, A. L., Effect size (ES), 000, [] Kelly, K. & Preacher, J. K. On Effect Size, Psychological Methods, 01, Vol. 17 (), [3] Rosnow, R. L. & Rosenthal, R. Computing contrasts, effect sizes, and counter nulls on the people s published data: General procedures for research consumers, Psychological Methods, 1996, Vol. 1 (4), [4] Cohen, J. Statistical power analysis for the behavioral sciences, 1988 (nd Ed.). Hillsdale, NJ: Lawrence Erlbaum Associates. [5] Hartung, J. Knapp, G., & Sinha, B. K. Statistical meta-analysis with applications, 008, Hoboken, NJ: Wiley. [6] Rosenthal, R. & Rosnow, R. L. Essentials of behavioral research: Methods and data analysis 1991 (nd Ed.). New York: McGraw Hill. [7] Fisher, R. A. Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population, Biometrika, 1915, Vol. 10 (4), [8] McGrath, E. R. & Meyer, J. G. Ehen the effect Sizes Disagree: The case of r and d, Psychological Methods, 006, Vol. 11 (4), [9] Pearson, K. On the general theory of skew correlations and nonlinear regression, Mathematical contributions to the theory of evolution: XIV, Draper s Company Research Memoires, Biometric series II, London: Dulau [10] Olenjik S. & Algina J. Measures of Effect Size for comparative Studies: Applications, Interpretations, and Limitations, Contemporary Educational Psychology, 000, Vol. 5 (3), [11] Kelley, T. L. An unbiased correlation ratio measure. Proceedings of the National Academy of Sciences, Vol. 1, [1] Hays, W. L. Statistics for psychologists, New York: Holt, Reinehart & Winston, [13] Kotrlik & Williams, The Incorporation of Effect Size, Information Technology, Learning, and Performance Research, 003, Vol. 1 (1) [14] Kirk, R. E. Practical significance: A concept whose time has come. Educational and Psychological Measurement, 1996, Vol. 56 (5), [15] Cohen, J. & Cohen, P. Applied multiple regression/ correlation analysis for the behavioral sciences, 1975, Hillsdale, NJ: Erlbaum. [16] Kraemer, H. C. & Thiemann, S., How many subjects? Statistical power analysis in research, 1987, Newbury Park CA: Sage. [17] Green, S.B, How many subjects does it take to do a regression analysis?, Multivariate Behavioral research,1991, Vol. 6 (3), [18] Popa, M. Statistica pentru psihologie, 008, Ed. Polirom, Iasi.

Psychology 282 Lecture #4 Outline Inferences in SLR

Psychology 282 Lecture #4 Outline Inferences in SLR Psychology 282 Lecture #4 Outline Inferences in SLR Assumptions To this point we have not had to make any distributional assumptions. Principle of least squares requires no assumptions. Can use correlations

More information

CHAPTER 2. Types of Effect size indices: An Overview of the Literature

CHAPTER 2. Types of Effect size indices: An Overview of the Literature CHAPTER Types of Effect size indices: An Overview of the Literature There are different types of effect size indices as a result of their different interpretations. Huberty (00) names three different types:

More information

DETAILED CONTENTS PART I INTRODUCTION AND DESCRIPTIVE STATISTICS. 1. Introduction to Statistics

DETAILED CONTENTS PART I INTRODUCTION AND DESCRIPTIVE STATISTICS. 1. Introduction to Statistics DETAILED CONTENTS About the Author Preface to the Instructor To the Student How to Use SPSS With This Book PART I INTRODUCTION AND DESCRIPTIVE STATISTICS 1. Introduction to Statistics 1.1 Descriptive and

More information

r(equivalent): A Simple Effect Size Indicator

r(equivalent): A Simple Effect Size Indicator r(equivalent): A Simple Effect Size Indicator The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters Citation Rosenthal, Robert, and

More information

In a one-way ANOVA, the total sums of squares among observations is partitioned into two components: Sums of squares represent:

In a one-way ANOVA, the total sums of squares among observations is partitioned into two components: Sums of squares represent: Activity #10: AxS ANOVA (Repeated subjects design) Resources: optimism.sav So far in MATH 300 and 301, we have studied the following hypothesis testing procedures: 1) Binomial test, sign-test, Fisher s

More information

Chapter 4. Regression Models. Learning Objectives

Chapter 4. Regression Models. Learning Objectives Chapter 4 Regression Models To accompany Quantitative Analysis for Management, Eleventh Edition, by Render, Stair, and Hanna Power Point slides created by Brian Peterson Learning Objectives After completing

More information

What p values really mean (and why I should care) Francis C. Dane, PhD

What p values really mean (and why I should care) Francis C. Dane, PhD What p values really mean (and why I should care) Francis C. Dane, PhD Session Objectives Understand the statistical decision process Appreciate the limitations of interpreting p values Value the use of

More information

Correlation Interpretation on Diabetes Mellitus Patients

Correlation Interpretation on Diabetes Mellitus Patients Annals of the University of Craiova, Mathematics and Computer Science Series Volume 37(3), 2010, Pages 101 109 ISSN: 1223-6934 Correlation Interpretation on Diabetes Mellitus Patients Dana Dănciulescu

More information

10/31/2012. One-Way ANOVA F-test

10/31/2012. One-Way ANOVA F-test PSY 511: Advanced Statistics for Psychological and Behavioral Research 1 1. Situation/hypotheses 2. Test statistic 3.Distribution 4. Assumptions One-Way ANOVA F-test One factor J>2 independent samples

More information

Estimating σ 2. We can do simple prediction of Y and estimation of the mean of Y at any value of X.

Estimating σ 2. We can do simple prediction of Y and estimation of the mean of Y at any value of X. Estimating σ 2 We can do simple prediction of Y and estimation of the mean of Y at any value of X. To perform inferences about our regression line, we must estimate σ 2, the variance of the error term.

More information

The Multiple Regression Model

The Multiple Regression Model Multiple Regression The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & or more independent variables (X i ) Multiple Regression Model with k Independent Variables:

More information

Regression Analysis. BUS 735: Business Decision Making and Research. Learn how to detect relationships between ordinal and categorical variables.

Regression Analysis. BUS 735: Business Decision Making and Research. Learn how to detect relationships between ordinal and categorical variables. Regression Analysis BUS 735: Business Decision Making and Research 1 Goals of this section Specific goals Learn how to detect relationships between ordinal and categorical variables. Learn how to estimate

More information

IJESMR International Journal OF Engineering Sciences & Management Research

IJESMR International Journal OF Engineering Sciences & Management Research METHOD OF IMPLEMENTING ANALYSIS OF VARIANCE (ANOVA) IN RESEARCH STUDIES Asha Singh * & Balkeshwar Singh *Department of Business Management, Mewar University, Chittorghar, Rajasthan, India Mechanical Engineering

More information

Lecture 15 Multiple regression I Chapter 6 Set 2 Least Square Estimation The quadratic form to be minimized is

Lecture 15 Multiple regression I Chapter 6 Set 2 Least Square Estimation The quadratic form to be minimized is Lecture 15 Multiple regression I Chapter 6 Set 2 Least Square Estimation The quadratic form to be minimized is Q = (Y i β 0 β 1 X i1 β 2 X i2 β p 1 X i.p 1 ) 2, which in matrix notation is Q = (Y Xβ) (Y

More information

Procedia - Social and Behavioral Sciences 109 ( 2014 )

Procedia - Social and Behavioral Sciences 109 ( 2014 ) Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 09 ( 04 ) 730 736 nd World Conference On Business, Economics And Management - WCBEM 03 Categorical Principal

More information

Introduction to Business Statistics QM 220 Chapter 12

Introduction to Business Statistics QM 220 Chapter 12 Department of Quantitative Methods & Information Systems Introduction to Business Statistics QM 220 Chapter 12 Dr. Mohammad Zainal 12.1 The F distribution We already covered this topic in Ch. 10 QM-220,

More information

Formal Statement of Simple Linear Regression Model

Formal Statement of Simple Linear Regression Model Formal Statement of Simple Linear Regression Model Y i = β 0 + β 1 X i + ɛ i Y i value of the response variable in the i th trial β 0 and β 1 are parameters X i is a known constant, the value of the predictor

More information

Methodology Review: Applications of Distribution Theory in Studies of. Population Validity and Cross Validity. James Algina. University of Florida

Methodology Review: Applications of Distribution Theory in Studies of. Population Validity and Cross Validity. James Algina. University of Florida Distribution Theory 1 Methodology eview: Applications of Distribution Theory in Studies of Population Validity and Cross Validity by James Algina University of Florida and H. J. Keselman University of

More information

Contrasts and Correlations in Effect-size Estimation

Contrasts and Correlations in Effect-size Estimation Contrasts and Correlations in Effect-size Estimation The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters. Citation Published Version

More information

Finding Relationships Among Variables

Finding Relationships Among Variables Finding Relationships Among Variables BUS 230: Business and Economic Research and Communication 1 Goals Specific goals: Re-familiarize ourselves with basic statistics ideas: sampling distributions, hypothesis

More information

Simple Linear Regression: One Qualitative IV

Simple Linear Regression: One Qualitative IV Simple Linear Regression: One Qualitative IV 1. Purpose As noted before regression is used both to explain and predict variation in DVs, and adding to the equation categorical variables extends regression

More information

SOME ASPECTS OF MULTIVARIATE BEHRENS-FISHER PROBLEM

SOME ASPECTS OF MULTIVARIATE BEHRENS-FISHER PROBLEM SOME ASPECTS OF MULTIVARIATE BEHRENS-FISHER PROBLEM Junyong Park Bimal Sinha Department of Mathematics/Statistics University of Maryland, Baltimore Abstract In this paper we discuss the well known multivariate

More information

The Binomial Effect Size Display (BESD)

The Binomial Effect Size Display (BESD) Technical Whitepaper Paul Barrett Chief Research Scientist q April, 2013 The Binomial Effect Size Display (BESD) Is this always an accurate index of effect? I provide the definition, some warnings of the

More information

8/23/2018. One-Way ANOVA F-test. 1. Situation/hypotheses. 2. Test statistic. 3.Distribution. 4. Assumptions

8/23/2018. One-Way ANOVA F-test. 1. Situation/hypotheses. 2. Test statistic. 3.Distribution. 4. Assumptions PSY 5101: Advanced Statistics for Psychological and Behavioral Research 1 1. Situation/hypotheses 2. Test statistic One-Way ANOVA F-test One factor J>2 independent samples H o :µ 1 µ 2 µ J F 3.Distribution

More information

MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS

MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS Page 1 MSR = Mean Regression Sum of Squares MSE = Mean Squared Error RSS = Regression Sum of Squares SSE = Sum of Squared Errors/Residuals α = Level

More information

One-Way Analysis of Variance: A Guide to Testing Differences Between Multiple Groups

One-Way Analysis of Variance: A Guide to Testing Differences Between Multiple Groups One-Way Analysis of Variance: A Guide to Testing Differences Between Multiple Groups In analysis of variance, the main research question is whether the sample means are from different populations. The

More information

Inferences for Regression

Inferences for Regression Inferences for Regression An Example: Body Fat and Waist Size Looking at the relationship between % body fat and waist size (in inches). Here is a scatterplot of our data set: Remembering Regression In

More information

DISCRIMINANT ANALYSIS IN THE STUDY OF ROMANIAN REGIONAL ECONOMIC DEVELOPMENT

DISCRIMINANT ANALYSIS IN THE STUDY OF ROMANIAN REGIONAL ECONOMIC DEVELOPMENT ANALELE ŞTIINŢIFICE ALE UNIVERSITĂŢII ALEXANDRU IOAN CUZA DIN IAŞI Tomul LIV Ştiinţe Economice 007 DISCRIMINANT ANALYSIS IN THE STUDY OF ROMANIAN REGIONAL ECONOMIC DEVELOPMENT ELISABETA JABA * DĂNUŢ VASILE

More information

Research Design - - Topic 19 Multiple regression: Applications 2009 R.C. Gardner, Ph.D.

Research Design - - Topic 19 Multiple regression: Applications 2009 R.C. Gardner, Ph.D. Research Design - - Topic 19 Multiple regression: Applications 2009 R.C. Gardner, Ph.D. Curve Fitting Mediation analysis Moderation Analysis 1 Curve Fitting The investigation of non-linear functions using

More information

1 Overview. Coefficients of. Correlation, Alienation and Determination. Hervé Abdi Lynne J. Williams

1 Overview. Coefficients of. Correlation, Alienation and Determination. Hervé Abdi Lynne J. Williams In Neil Salkind (Ed.), Encyclopedia of Research Design. Thousand Oaks, CA: Sage. 2010 Coefficients of Correlation, Alienation and Determination Hervé Abdi Lynne J. Williams 1 Overview The coefficient of

More information

The t-test: A z-score for a sample mean tells us where in the distribution the particular mean lies

The t-test: A z-score for a sample mean tells us where in the distribution the particular mean lies The t-test: So Far: Sampling distribution benefit is that even if the original population is not normal, a sampling distribution based on this population will be normal (for sample size > 30). Benefit

More information

Review of Statistics 101

Review of Statistics 101 Review of Statistics 101 We review some important themes from the course 1. Introduction Statistics- Set of methods for collecting/analyzing data (the art and science of learning from data). Provides methods

More information

Statistics for Managers using Microsoft Excel 6 th Edition

Statistics for Managers using Microsoft Excel 6 th Edition Statistics for Managers using Microsoft Excel 6 th Edition Chapter 13 Simple Linear Regression 13-1 Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value of

More information

10/4/2013. Hypothesis Testing & z-test. Hypothesis Testing. Hypothesis Testing

10/4/2013. Hypothesis Testing & z-test. Hypothesis Testing. Hypothesis Testing & z-test Lecture Set 11 We have a coin and are trying to determine if it is biased or unbiased What should we assume? Why? Flip coin n = 100 times E(Heads) = 50 Why? Assume we count 53 Heads... What could

More information

y ˆ i = ˆ " T u i ( i th fitted value or i th fit)

y ˆ i = ˆ  T u i ( i th fitted value or i th fit) 1 2 INFERENCE FOR MULTIPLE LINEAR REGRESSION Recall Terminology: p predictors x 1, x 2,, x p Some might be indicator variables for categorical variables) k-1 non-constant terms u 1, u 2,, u k-1 Each u

More information

Two-Mean Inference. Two-Group Research. Research Designs. The Correlated Samples t Test

Two-Mean Inference. Two-Group Research. Research Designs. The Correlated Samples t Test Two-Mean Inference 6430 Two-Group Research. We wish to know whether two groups (samples) of scores (on some continuous OV, outcome variable) are different enough from one another to indicate that the two

More information

Chapter 14 Student Lecture Notes Department of Quantitative Methods & Information Systems. Business Statistics. Chapter 14 Multiple Regression

Chapter 14 Student Lecture Notes Department of Quantitative Methods & Information Systems. Business Statistics. Chapter 14 Multiple Regression Chapter 14 Student Lecture Notes 14-1 Department of Quantitative Methods & Information Systems Business Statistics Chapter 14 Multiple Regression QMIS 0 Dr. Mohammad Zainal Chapter Goals After completing

More information

Correlation and Regression

Correlation and Regression Correlation and Regression October 25, 2017 STAT 151 Class 9 Slide 1 Outline of Topics 1 Associations 2 Scatter plot 3 Correlation 4 Regression 5 Testing and estimation 6 Goodness-of-fit STAT 151 Class

More information

Two-Sample Inferential Statistics

Two-Sample Inferential Statistics The t Test for Two Independent Samples 1 Two-Sample Inferential Statistics In an experiment there are two or more conditions One condition is often called the control condition in which the treatment is

More information

Outline. Remedial Measures) Extra Sums of Squares Standardized Version of the Multiple Regression Model

Outline. Remedial Measures) Extra Sums of Squares Standardized Version of the Multiple Regression Model Outline 1 Multiple Linear Regression (Estimation, Inference, Diagnostics and Remedial Measures) 2 Special Topics for Multiple Regression Extra Sums of Squares Standardized Version of the Multiple Regression

More information

Simple Linear Regression: One Quantitative IV

Simple Linear Regression: One Quantitative IV Simple Linear Regression: One Quantitative IV Linear regression is frequently used to explain variation observed in a dependent variable (DV) with theoretically linked independent variables (IV). For example,

More information

Parameter Estimation, Sampling Distributions & Hypothesis Testing

Parameter Estimation, Sampling Distributions & Hypothesis Testing Parameter Estimation, Sampling Distributions & Hypothesis Testing Parameter Estimation & Hypothesis Testing In doing research, we are usually interested in some feature of a population distribution (which

More information

Unit 27 One-Way Analysis of Variance

Unit 27 One-Way Analysis of Variance Unit 27 One-Way Analysis of Variance Objectives: To perform the hypothesis test in a one-way analysis of variance for comparing more than two population means Recall that a two sample t test is applied

More information

This gives us an upper and lower bound that capture our population mean.

This gives us an upper and lower bound that capture our population mean. Confidence Intervals Critical Values Practice Problems 1 Estimation 1.1 Confidence Intervals Definition 1.1 Margin of error. The margin of error of a distribution is the amount of error we predict when

More information

Model Estimation Example

Model Estimation Example Ronald H. Heck 1 EDEP 606: Multivariate Methods (S2013) April 7, 2013 Model Estimation Example As we have moved through the course this semester, we have encountered the concept of model estimation. Discussions

More information

Journal of Educational and Behavioral Statistics

Journal of Educational and Behavioral Statistics Journal of Educational and Behavioral Statistics http://jebs.aera.net Theory of Estimation and Testing of Effect Sizes: Use in Meta-Analysis Helena Chmura Kraemer JOURNAL OF EDUCATIONAL AND BEHAVIORAL

More information

AMS7: WEEK 7. CLASS 1. More on Hypothesis Testing Monday May 11th, 2015

AMS7: WEEK 7. CLASS 1. More on Hypothesis Testing Monday May 11th, 2015 AMS7: WEEK 7. CLASS 1 More on Hypothesis Testing Monday May 11th, 2015 Testing a Claim about a Standard Deviation or a Variance We want to test claims about or 2 Example: Newborn babies from mothers taking

More information

Prepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti

Prepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Prepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Putra Malaysia Serdang Use in experiment, quasi-experiment

More information

Types of Statistical Tests DR. MIKE MARRAPODI

Types of Statistical Tests DR. MIKE MARRAPODI Types of Statistical Tests DR. MIKE MARRAPODI Tests t tests ANOVA Correlation Regression Multivariate Techniques Non-parametric t tests One sample t test Independent t test Paired sample t test One sample

More information

Regression Models. Chapter 4. Introduction. Introduction. Introduction

Regression Models. Chapter 4. Introduction. Introduction. Introduction Chapter 4 Regression Models Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna 008 Prentice-Hall, Inc. Introduction Regression analysis is a very valuable tool for a manager

More information

Transition Passage to Descriptive Statistics 28

Transition Passage to Descriptive Statistics 28 viii Preface xiv chapter 1 Introduction 1 Disciplines That Use Quantitative Data 5 What Do You Mean, Statistics? 6 Statistics: A Dynamic Discipline 8 Some Terminology 9 Problems and Answers 12 Scales of

More information

Ch 2: Simple Linear Regression

Ch 2: Simple Linear Regression Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component

More information

Analysis of Variance

Analysis of Variance Analysis of Variance Chapter 12 McGraw-Hill/Irwin Copyright 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Learning Objectives LO 12-1 List the characteristics of the F distribution and locate

More information

LECTURE 6. Introduction to Econometrics. Hypothesis testing & Goodness of fit

LECTURE 6. Introduction to Econometrics. Hypothesis testing & Goodness of fit LECTURE 6 Introduction to Econometrics Hypothesis testing & Goodness of fit October 25, 2016 1 / 23 ON TODAY S LECTURE We will explain how multiple hypotheses are tested in a regression model We will define

More information

Recommended effect size statistics for repeated measures designs

Recommended effect size statistics for repeated measures designs Behavior Research Methods 005, 37 (3, 379-384 Recommended size statistics for repeated measures designs ROGER BAKEMAN Georgia State University, Atlanta, Georgia Investigators, who are increasingly implored

More information

Homoskedasticity. Var (u X) = σ 2. (23)

Homoskedasticity. Var (u X) = σ 2. (23) Homoskedasticity How big is the difference between the OLS estimator and the true parameter? To answer this question, we make an additional assumption called homoskedasticity: Var (u X) = σ 2. (23) This

More information

Confidence Intervals, Testing and ANOVA Summary

Confidence Intervals, Testing and ANOVA Summary Confidence Intervals, Testing and ANOVA Summary 1 One Sample Tests 1.1 One Sample z test: Mean (σ known) Let X 1,, X n a r.s. from N(µ, σ) or n > 30. Let The test statistic is H 0 : µ = µ 0. z = x µ 0

More information

y response variable x 1, x 2,, x k -- a set of explanatory variables

y response variable x 1, x 2,, x k -- a set of explanatory variables 11. Multiple Regression and Correlation y response variable x 1, x 2,, x k -- a set of explanatory variables In this chapter, all variables are assumed to be quantitative. Chapters 12-14 show how to incorporate

More information

Hypothesis testing. 1 Principle of hypothesis testing 2

Hypothesis testing. 1 Principle of hypothesis testing 2 Hypothesis testing Contents 1 Principle of hypothesis testing One sample tests 3.1 Tests on Mean of a Normal distribution..................... 3. Tests on Variance of a Normal distribution....................

More information

FRANKLIN UNIVERSITY PROFICIENCY EXAM (FUPE) STUDY GUIDE

FRANKLIN UNIVERSITY PROFICIENCY EXAM (FUPE) STUDY GUIDE FRANKLIN UNIVERSITY PROFICIENCY EXAM (FUPE) STUDY GUIDE Course Title: Probability and Statistics (MATH 80) Recommended Textbook(s): Number & Type of Questions: Probability and Statistics for Engineers

More information

Prepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti

Prepared by: Prof. Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Prepared by: Prof Dr Bahaman Abu Samah Department of Professional Development and Continuing Education Faculty of Educational Studies Universiti Putra Malaysia Serdang M L Regression is an extension to

More information

One-Way ANOVA Cohen Chapter 12 EDUC/PSY 6600

One-Way ANOVA Cohen Chapter 12 EDUC/PSY 6600 One-Way ANOVA Cohen Chapter 1 EDUC/PSY 6600 1 It is easy to lie with statistics. It is hard to tell the truth without statistics. -Andrejs Dunkels Motivating examples Dr. Vito randomly assigns 30 individuals

More information

Chapter 4: Regression Models

Chapter 4: Regression Models Sales volume of company 1 Textbook: pp. 129-164 Chapter 4: Regression Models Money spent on advertising 2 Learning Objectives After completing this chapter, students will be able to: Identify variables,

More information

Ch 3: Multiple Linear Regression

Ch 3: Multiple Linear Regression Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery

More information

STA121: Applied Regression Analysis

STA121: Applied Regression Analysis STA121: Applied Regression Analysis Linear Regression Analysis - Chapters 3 and 4 in Dielman Artin Department of Statistical Science September 15, 2009 Outline 1 Simple Linear Regression Analysis 2 Using

More information

The One-Way Repeated-Measures ANOVA. (For Within-Subjects Designs)

The One-Way Repeated-Measures ANOVA. (For Within-Subjects Designs) The One-Way Repeated-Measures ANOVA (For Within-Subjects Designs) Logic of the Repeated-Measures ANOVA The repeated-measures ANOVA extends the analysis of variance to research situations using repeated-measures

More information

Correlation Analysis

Correlation Analysis Simple Regression Correlation Analysis Correlation analysis is used to measure strength of the association (linear relationship) between two variables Correlation is only concerned with strength of the

More information

We like to capture and represent the relationship between a set of possible causes and their response, by using a statistical predictive model.

We like to capture and represent the relationship between a set of possible causes and their response, by using a statistical predictive model. Statistical Methods in Business Lecture 5. Linear Regression We like to capture and represent the relationship between a set of possible causes and their response, by using a statistical predictive model.

More information

Keller: Stats for Mgmt & Econ, 7th Ed July 17, 2006

Keller: Stats for Mgmt & Econ, 7th Ed July 17, 2006 Chapter 17 Simple Linear Regression and Correlation 17.1 Regression Analysis Our problem objective is to analyze the relationship between interval variables; regression analysis is the first tool we will

More information

Inequality constrained hypotheses for ANOVA

Inequality constrained hypotheses for ANOVA Inequality constrained hypotheses for ANOVA Maaike van Rossum, Rens van de Schoot, Herbert Hoijtink Department of Methods and Statistics, Utrecht University Abstract In this paper a novel approach for

More information

Draft Proof - Do not copy, post, or distribute. Chapter Learning Objectives REGRESSION AND CORRELATION THE SCATTER DIAGRAM

Draft Proof - Do not copy, post, or distribute. Chapter Learning Objectives REGRESSION AND CORRELATION THE SCATTER DIAGRAM 1 REGRESSION AND CORRELATION As we learned in Chapter 9 ( Bivariate Tables ), the differential access to the Internet is real and persistent. Celeste Campos-Castillo s (015) research confirmed the impact

More information

Correlation. A statistics method to measure the relationship between two variables. Three characteristics

Correlation. A statistics method to measure the relationship between two variables. Three characteristics Correlation Correlation A statistics method to measure the relationship between two variables Three characteristics Direction of the relationship Form of the relationship Strength/Consistency Direction

More information

Linear Regression with 1 Regressor. Introduction to Econometrics Spring 2012 Ken Simons

Linear Regression with 1 Regressor. Introduction to Econometrics Spring 2012 Ken Simons Linear Regression with 1 Regressor Introduction to Econometrics Spring 2012 Ken Simons Linear Regression with 1 Regressor 1. The regression equation 2. Estimating the equation 3. Assumptions required for

More information

ECON3150/4150 Spring 2016

ECON3150/4150 Spring 2016 ECON3150/4150 Spring 2016 Lecture 4 - The linear regression model Siv-Elisabeth Skjelbred University of Oslo Last updated: January 26, 2016 1 / 49 Overview These lecture slides covers: The linear regression

More information

Statistical. Psychology

Statistical. Psychology SEVENTH у *i km m it* & П SB Й EDITION Statistical M e t h o d s for Psychology D a v i d C. Howell University of Vermont ; \ WADSWORTH f% CENGAGE Learning* Australia Biaall apan Korea Меяко Singapore

More information

Econometrics Midterm Examination Answers

Econometrics Midterm Examination Answers Econometrics Midterm Examination Answers March 4, 204. Question (35 points) Answer the following short questions. (i) De ne what is an unbiased estimator. Show that X is an unbiased estimator for E(X i

More information

Comparison between Models With and Without Intercept

Comparison between Models With and Without Intercept Gen. Math. Notes, Vol. 2, No., March 24, pp. -27 ISSN 229-74; Copyright ICSRS Publication, 24 www.i-csrs.org Available free online at http://www.geman.in Comparison between Models With and Without Intercept

More information

Econ 3790: Business and Economic Statistics. Instructor: Yogesh Uppal

Econ 3790: Business and Economic Statistics. Instructor: Yogesh Uppal Econ 3790: Business and Economic Statistics Instructor: Yogesh Uppal Email: yuppal@ysu.edu Chapter 13, Part A: Analysis of Variance and Experimental Design Introduction to Analysis of Variance Analysis

More information

IS OMEGA SQUARED LESS BIASED? A COMPARISON OF THREE MAJOR EFFECT SIZE INDICES IN ONE-WAY ANOVA

IS OMEGA SQUARED LESS BIASED? A COMPARISON OF THREE MAJOR EFFECT SIZE INDICES IN ONE-WAY ANOVA Behaviormetrika Vol.40, No.2, 2013, 129 147 IS OMEGA SQUARED LESS BIASED? A COMPARISON OF THREE MAJOR EFFECT SIZE INDICES IN ONE-WAY ANOVA Kensuke Okada The purpose of this study is to find less biased

More information

Lecture 10 Multiple Linear Regression

Lecture 10 Multiple Linear Regression Lecture 10 Multiple Linear Regression STAT 512 Spring 2011 Background Reading KNNL: 6.1-6.5 10-1 Topic Overview Multiple Linear Regression Model 10-2 Data for Multiple Regression Y i is the response variable

More information

THE EFFECTS OF NONNORMAL DISTRIBUTIONS ON CONFIDENCE INTERVALS AROUND THE STANDARDIZED MEAN DIFFERENCE: BOOTSTRAP AND PARAMETRIC CONFIDENCE INTERVALS

THE EFFECTS OF NONNORMAL DISTRIBUTIONS ON CONFIDENCE INTERVALS AROUND THE STANDARDIZED MEAN DIFFERENCE: BOOTSTRAP AND PARAMETRIC CONFIDENCE INTERVALS EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 10.1177/0013164404264850 KELLEY THE EFFECTS OF NONNORMAL DISTRIBUTIONS ON CONFIDENCE INTERVALS AROUND THE STANDARDIZED MEAN DIFFERENCE: BOOTSTRAP AND PARAMETRIC

More information

Hypothesis Testing hypothesis testing approach

Hypothesis Testing hypothesis testing approach Hypothesis Testing In this case, we d be trying to form an inference about that neighborhood: Do people there shop more often those people who are members of the larger population To ascertain this, we

More information

DESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective

DESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective DESIGNING EXPERIMENTS AND ANALYZING DATA A Model Comparison Perspective Second Edition Scott E. Maxwell Uniuersity of Notre Dame Harold D. Delaney Uniuersity of New Mexico J,t{,.?; LAWRENCE ERLBAUM ASSOCIATES,

More information

Chapter 2. Continued. Proofs For ANOVA Proof of ANOVA Identity. the product term in the above equation can be simplified as n

Chapter 2. Continued. Proofs For ANOVA Proof of ANOVA Identity. the product term in the above equation can be simplified as n Chapter 2. Continued Proofs For ANOVA Proof of ANOVA Identity We are going to prove that Writing SST SSR + SSE. Y i Ȳ (Y i Ŷ i ) + (Ŷ i Ȳ ) Squaring both sides summing over all i 1,...n, we get (Y i Ȳ

More information

PSYC 331 STATISTICS FOR PSYCHOLOGISTS

PSYC 331 STATISTICS FOR PSYCHOLOGISTS PSYC 331 STATISTICS FOR PSYCHOLOGISTS Session 4 A PARAMETRIC STATISTICAL TEST FOR MORE THAN TWO POPULATIONS Lecturer: Dr. Paul Narh Doku, Dept of Psychology, UG Contact Information: pndoku@ug.edu.gh College

More information

Chapter 14 Simple Linear Regression (A)

Chapter 14 Simple Linear Regression (A) Chapter 14 Simple Linear Regression (A) 1. Characteristics Managerial decisions often are based on the relationship between two or more variables. can be used to develop an equation showing how the variables

More information

Sampling distribution of t. 2. Sampling distribution of t. 3. Example: Gas mileage investigation. II. Inferential Statistics (8) t =

Sampling distribution of t. 2. Sampling distribution of t. 3. Example: Gas mileage investigation. II. Inferential Statistics (8) t = 2. The distribution of t values that would be obtained if a value of t were calculated for each sample mean for all possible random of a given size from a population _ t ratio: (X - µ hyp ) t s x The result

More information

Evaluation. Andrea Passerini Machine Learning. Evaluation

Evaluation. Andrea Passerini Machine Learning. Evaluation Andrea Passerini passerini@disi.unitn.it Machine Learning Basic concepts requires to define performance measures to be optimized Performance of learning algorithms cannot be evaluated on entire domain

More information

CIVL /8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8

CIVL /8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8 CIVL - 7904/8904 T R A F F I C F L O W T H E O R Y L E C T U R E - 8 Chi-square Test How to determine the interval from a continuous distribution I = Range 1 + 3.322(logN) I-> Range of the class interval

More information

Hypothesis Testing for Var-Cov Components

Hypothesis Testing for Var-Cov Components Hypothesis Testing for Var-Cov Components When the specification of coefficients as fixed, random or non-randomly varying is considered, a null hypothesis of the form is considered, where Additional output

More information

Paper Robust Effect Size Estimates and Meta-Analytic Tests of Homogeneity

Paper Robust Effect Size Estimates and Meta-Analytic Tests of Homogeneity Paper 27-25 Robust Effect Size Estimates and Meta-Analytic Tests of Homogeneity Kristine Y. Hogarty and Jeffrey D. Kromrey Department of Educational Measurement and Research, University of South Florida

More information

Variance Decomposition and Goodness of Fit

Variance Decomposition and Goodness of Fit Variance Decomposition and Goodness of Fit 1. Example: Monthly Earnings and Years of Education In this tutorial, we will focus on an example that explores the relationship between total monthly earnings

More information

Sample Size to Detect a Planned Contrast and a One Degree-of-Freedom Interaction Effect

Sample Size to Detect a Planned Contrast and a One Degree-of-Freedom Interaction Effect Sample Size to Detect a Planned Contrast and a One Degree-of-Freedom Interaction Effect By: Douglas Wahlsten Wahlsten, D. Sample size to detect a planned contrast and a one degree-of-freedom interaction

More information

TEST POWER IN COMPARISON DIFFERENCE BETWEEN TWO INDEPENDENT PROPORTIONS

TEST POWER IN COMPARISON DIFFERENCE BETWEEN TWO INDEPENDENT PROPORTIONS TEST POWER IN COMPARISON DIFFERENCE BETWEEN TWO INDEPENDENT PROPORTIONS Mehmet MENDES PhD, Associate Professor, Canakkale Onsekiz Mart University, Agriculture Faculty, Animal Science Department, Biometry

More information

Statistics II Exercises Chapter 5

Statistics II Exercises Chapter 5 Statistics II Exercises Chapter 5 1. Consider the four datasets provided in the transparencies for Chapter 5 (section 5.1) (a) Check that all four datasets generate exactly the same LS linear regression

More information

STATISTICS FOR ECONOMISTS: A BEGINNING. John E. Floyd University of Toronto

STATISTICS FOR ECONOMISTS: A BEGINNING. John E. Floyd University of Toronto STATISTICS FOR ECONOMISTS: A BEGINNING John E. Floyd University of Toronto July 2, 2010 PREFACE The pages that follow contain the material presented in my introductory quantitative methods in economics

More information

Multiple t Tests. Introduction to Analysis of Variance. Experiments with More than 2 Conditions

Multiple t Tests. Introduction to Analysis of Variance. Experiments with More than 2 Conditions Introduction to Analysis of Variance 1 Experiments with More than 2 Conditions Often the research that psychologists perform has more conditions than just the control and experimental conditions You might

More information

Sensitiveness analysis: Sample sizes for t-tests for paired samples

Sensitiveness analysis: Sample sizes for t-tests for paired samples Sensitiveness analysis: Sample sizes for t-tests for paired samples (J.D.Perezgonzalez, 2016, Massey University, New Zealand, doi: 10.13140/RG.2.2.32249.47203) Table 1 shows the sample sizes required for

More information

Evaluation requires to define performance measures to be optimized

Evaluation requires to define performance measures to be optimized Evaluation Basic concepts Evaluation requires to define performance measures to be optimized Performance of learning algorithms cannot be evaluated on entire domain (generalization error) approximation

More information

Econ 3790: Business and Economics Statistics. Instructor: Yogesh Uppal

Econ 3790: Business and Economics Statistics. Instructor: Yogesh Uppal Econ 3790: Business and Economics Statistics Instructor: Yogesh Uppal yuppal@ysu.edu Sampling Distribution of b 1 Expected value of b 1 : Variance of b 1 : E(b 1 ) = 1 Var(b 1 ) = σ 2 /SS x Estimate of

More information