Business Statistics. Chapter 14 Introduction to Linear Regression and Correlation Analysis QMIS 220. Dr. Mohammad Zainal
|
|
- Avis Owen
- 5 years ago
- Views:
Transcription
1 Department of Quantitative Methods & Information Systems Business Statistics Chapter 14 Introduction to Linear Regression and Correlation Analysis QMIS 220 Dr. Mohammad Zainal
2 Chapter Goals After completing this chapter, you should be able to: Calculate and interpret the simple correlation between two variables Determine whether the correlation is significant Calculate and interpret the simple linear regression equation for a set of data Understand the assumptions behind regression analysis Determine whether a regression model is significant QMIS 220, by Dr. M. Zainal Chap 13-2
3 Chapter Goals After completing this chapter, you should be able to: Calculate and interpret confidence intervals for the regression coefficients Recognize regression analysis applications for purposes of prediction and description Recognize some potential problems if regression analysis is used incorrectly Recognize nonlinear relationships between two variables (continued) QMIS 220, by Dr. M. Zainal Chap 13-3
4 Scatter Plots and Correlation A scatter plot (or scatter diagram) is used to show the relationship between two variables Correlation analysis is used to measure strength of the association (linear relationship) between two variables Only concerned with strength of the relationship No causal effect is implied QMIS 220, by Dr. M. Zainal Chap 13-4
5 Scatter Plot Examples Linear relationships Curvilinear relationships y y x x y y x QMIS 220, by Dr. M. Zainal Chap 13-5 x
6 Scatter Plot Examples Strong relationships (continued) Weak relationships y y x x y y x QMIS 220, by Dr. M. Zainal Chap 13-6 x
7 Scatter Plot Examples No relationship (continued) y x y QMIS 220, by Dr. M. Zainal Chap 13-7 x
8 Correlation Coefficient Correlation measures the strength of the linear association between two variables The sample correlation coefficient r is a measure of the strength of the linear relationship between two variables, based on sample observations (continued) QMIS 220, by Dr. M. Zainal Chap 13-8
9 Features of r Unit free Range between -1 and 1 The closer to -1, the stronger the negative linear relationship The closer to 1, the stronger the positive linear relationship The closer to 0, the weaker the linear relationship QMIS 220, by Dr. M. Zainal Chap 13-9
10 Examples of Approximate r Values y y y x r = -1 r = -.6 r = 0 y y x x r = +.3 r = +1 x QMIS 220, by Dr. M. Zainal Chap x
11 Calculating the Correlation Coefficient Sample correlation coefficient: r [ (x (x x)(y y) x) 2 ][ (y y) 2 ] or the algebraic equivalent: ) ( n xy x y r [n( x ) ( x) ][n( y where: r = Sample correlation coefficient n = Sample size x = Value of the independent variable y = Value of the dependent variable QMIS 220, by Dr. M. Zainal Chap y) 2 ]
12 Calculation Example Tree Height Trunk Diameter y x xy y 2 x =321 =73 =3142 =14111 =713 QMIS 220, by Dr. M. Zainal Chap 13-12
13 Calculation Example (continued) Tree Height, y 70 r n xy x y [n( x ) ( x) ][n( y ) ( y) 2 ] (3142) (73)(321) [8(713) (73) 2 ][8(14111) (321) 2 ] Trunk Diameter, x QMIS 220, by Dr. M. Zainal Chap 13-13
14 Excel Output Excel Correlation Output Tools / data analysis / correlation Tree Height Trunk Diameter Tree Height 1 Trunk Diameter QMIS 220, by Dr. M. Zainal Chap 13-14
15 Significance Test for Correlation Hypotheses H 0 : ρ = 0 H A : ρ 0 (no correlation) (correlation exists) Test statistic t r 2 1 r n 2 The Greek letter ρ (rho) represents the population correlation coefficient (with n 2 degrees of freedom) QMIS 220, by Dr. M. Zainal Chap 13-15
16 Example: Produce Stores Is there evidence of a linear relationship between tree height and trunk diameter at the.05 level of significance? H 0 : ρ = 0 H 1 : ρ 0 (No correlation) (correlation exists) =.05, df = 8-2 = 6 t r 2 1 r n QMIS 220, by Dr. M. Zainal Chap 13-16
17 Example: Test Solution r t 2 1 r n 2 d.f. = 8-2 = 6 /2= /2=.025 Decision: Reject H 0 Conclusion: There is sufficient evidence of a linear relationship at the 5% level of significance Reject H 0 -t α/2 Do not reject H 0 0 Reject H t 0 α/ QMIS 220, by Dr. M. Zainal Chap 13-17
18 Introduction to Regression Analysis Regression analysis is used to: Predict the value of a dependent variable based on the value of at least one independent variable Explain the impact of changes in an independent variable on the dependent variable Dependent variable: the variable we wish to explain Independent variable: the variable used to explain the dependent variable QMIS 220, by Dr. M. Zainal Chap 13-18
19 Simple Linear Regression Model Only one independent variable, x Relationship between x and y is described by a linear function Changes in y are assumed to be caused by changes in x QMIS 220, by Dr. M. Zainal Chap 13-19
20 Types of Regression Models Positive Linear Relationship Relationship NOT Linear Negative Linear Relationship No Relationship QMIS 220, by Dr. M. Zainal Chap 13-20
21 Population Linear Regression The population regression model: Dependent Variable Population y intercept Population Slope Coefficient y 1 Independent Variable β β x 0 ε Random Error term, or residual Linear component Random Error component QMIS 220, by Dr. M. Zainal Chap 13-21
22 Linear Regression Assumptions Error values (ε) are statistically independent Error values are normally distributed for any given value of x The probability distribution of the errors is normal The distributions of possible ε values have equal variances for all values of x The underlying relationship between the x variable and the y variable is linear QMIS 220, by Dr. M. Zainal Chap 13-22
23 Population Linear Regression (continued) y Observed Value of y for x i y 1 β β x 0 ε Predicted Value of y for x i ε i Random Error for this x value Slope = β 1 Intercept = β 0 x i x QMIS 220, by Dr. M. Zainal Chap 13-23
24 Estimated Regression Model The sample regression line provides an estimate of the population regression line Estimated (or predicted) y value Estimate of the regression intercept Estimate of the regression slope ŷ b b x i 0 1 Independent variable The individual random error terms e i have a mean of zero QMIS 220, by Dr. M. Zainal Chap 13-24
25 Least Squares Criterion b 0 and b 1 are obtained by finding the values of b 0 and b 1 that minimize the sum of the squared residuals e 2 (y ŷ) 2 (y (b 0 b 1 x)) 2 QMIS 220, by Dr. M. Zainal Chap 13-25
26 The Least Squares Equation The formulas for b 1 and b 0 are: b 1 and (x 2 (x b0 y b1x x)(y x) y) algebraic equivalent for b 1 : x y xy b n 1 ( 2 x) 2 x n QMIS 220, by Dr. M. Zainal Chap 13-26
27 Interpretation of the Slope and the Intercept b 0 is the estimated average value of y when the value of x is zero b 1 is the estimated change in the average value of y as a result of a one-unit change in x QMIS 220, by Dr. M. Zainal Chap 13-27
28 Finding the Least Squares Equation The coefficients b 0 and b 1 will usually be found using computer software, such as Excel or Minitab Other regression measures will also be computed as part of computer-based regression analysis QMIS 220, by Dr. M. Zainal Chap 13-28
29 Simple Linear Regression Example A real estate agent wishes to examine the relationship between the selling price of a home and its size (measured in square feet) A random sample of 10 houses is selected Dependent variable (y) = house price in $1000s Independent variable (x) = square feet QMIS 220, by Dr. M. Zainal Chap 13-29
30 Sample Data for House Price Model House Price in $1000s (y) Square Feet (x) QMIS 220, by Dr. M. Zainal Chap 13-30
31 Regression Using Excel Data / Data Analysis / Regression QMIS 220, by Dr. M. Zainal Chap 13-31
32 Excel Output Regression Statistics Multiple R R Square Adjusted R Square Standard Error Observations 10 The regression equation is: ANOVA df SS MS F Significance F Regression Residual Total Coefficients Standard Error t Stat P-value Lower 95% Upper 95% Intercept Square Feet QMIS 220, by Dr. M. Zainal Chap 13-32
33 House Price ($1000s) Graphical Presentation House price model: scatter plot and regression line Square Feet houseprice (squarefeet) QMIS 220, by Dr. M. Zainal Chap 13-33
34 Interpretation of the Intercept, b 0 houseprice (squarefeet) b 0 is the estimated average value of Y when the value of X is zero (if x = 0 is in the range of observed x values) Here, no houses had 0 square feet, so b 0 = just indicates that, for houses within the range of sizes observed, $98, is the portion of the house price not explained by square feet QMIS 220, by Dr. M. Zainal Chap 13-34
35 Interpretation of the Slope Coefficient, b 1 houseprice (squarefeet) b 1 measures the estimated change in the average value of Y as a result of a oneunit change in X Here, b 1 = tells us that the average value of a house increases by.10977($1000) = $109.77, on average, for each additional one square foot of size QMIS 220, by Dr. M. Zainal Chap 13-35
36 Least Squares Regression Properties The sum of the residuals from the least squares regression line is 0 ( (y y) ˆ 0 ) The sum of the squared residuals is a minimum 2 (minimized ) (y y) ˆ The simple regression line always passes through the mean of the y variable and the mean of the x variable The least squares coefficients are unbiased estimates of β 0 and β 1 QMIS 220, by Dr. M. Zainal Chap 13-36
37 Explained and Unexplained Variation Total variation is made up of two parts: SST SSE SSR Total sum of Squares Sum of Squares Error Sum of Squares Regression SST where: y (y 2 y) SSE 2 (y ŷ) SSR = Average value of the dependent variable y = Observed values of the dependent variable ŷ = Estimated value of y for the given x value 2 (ŷ y) Chap 13-37
38 Explained and Unexplained Variation SST = total sum of squares Measures the variation of the y i values around their mean y SSE = error sum of squares Variation attributable to factors other than the relationship between x and y SSR = regression sum of squares Explained variation attributable to the relationship between x and y (continued) QMIS 220, by Dr. M. Zainal Chap 13-38
39 Explained and Unexplained Variation y (continued) y i y _ y _ SST = (y i - y) 2 SSE = (y i - y i ) 2 _ SSR = (y i - y) 2 y _ y X i QMIS 220, by Dr. M. Zainal Chap x
40 Coefficient of Determination, R 2 The coefficient of determination is the portion of the total variation in the dependent variable that is explained by variation in the independent variable The coefficient of determination is also called R-squared and is denoted as R 2 R 2 SSR where 0 R 2 1 SST QMIS 220, by Dr. M. Zainal Chap 13-40
41 Coefficient of Determination, R 2 Coefficient of determination (continued) R 2 SSR SST sumof squaresexplainedby regression total sumof squares Note: In the single independent variable case, the coefficient of determination is 2 R r 2 where: R 2 = Coefficient of determination r = Simple correlation coefficient QMIS 220, by Dr. M. Zainal Chap 13-41
42 Examples of Approximate R 2 Values y R 2 = 1 y R 2 = 1 x Perfect linear relationship between x and y: 100% of the variation in y is explained by variation in x R 2 = +1 x QMIS 220, by Dr. M. Zainal Chap 13-42
43 Examples of Approximate R 2 Values (continued) y y x 0 < R 2 < 1 Weaker linear relationship between x and y: Some but not all of the variation in y is explained by variation in x x QMIS 220, by Dr. M. Zainal Chap 13-43
44 Examples of Approximate R 2 Values (continued) y R 2 = 0 No linear relationship between x and y: R 2 = 0 x The value of Y does not depend on x. (None of the variation in y is explained by variation in x) QMIS 220, by Dr. M. Zainal Chap 13-44
45 Excel Output Regression Statistics Multiple R R Square Adjusted R Square Standard Error Observations 10 ANOVA df SS MS F Significance F Regression Residual Total Coefficients Standard Error t Stat P-value Lower 95% Upper 95% Intercept Square Feet QMIS 220, by Dr. M. Zainal Chap 13-45
46 Test for Significance of Coefficient of Determination Hypotheses H 0 : ρ 2 = 0 H A : ρ 2 0 H 0 : The independent variable does not explain a significant portion of the variation in the dependent variable H A : The independent variable does explain a significant portion of the variation in the dependent variable Test statistic F SSR/1 SSE/(n 2) (with D 1 = 1 and D 2 = n 2 degrees of freedom) QMIS 220, by Dr. M. Zainal Chap 13-46
47 Excel Output Regression Statistics Multiple R R Square Adjusted R Square Standard Error Observations 10 ANOVA df SS MS F Significance F Regression Residual Total Coefficients Standard Error t Stat P-value Lower 95% Upper 95% Intercept Square Feet QMIS 220, by Dr. M. Zainal Chap 13-47
48 Standard Error of Estimate The standard deviation of the variation of observations around the simple regression line is estimated by s ε SSE n 2 Where SSE = Sum of squares error n = Sample size QMIS 220, by Dr. M. Zainal Chap 13-48
49 The Standard Deviation of the Regression Slope The standard error of the regression slope coefficient (b 1 ) is estimated by s where: s b1 s ε b 1 s (x ε x) 2 x 2 s ε ( = Estimate of the standard error of the least squares slope SSE n 2 = Sample standard error of the estimate QMIS 220, by Dr. M. Zainal Chap n x) 2
50 Excel Output Regression Statistics Multiple R R Square Adjusted R Square Standard Error Observations 10 ANOVA df SS MS F Significance F Regression Residual Total Coefficients Standard Error t Stat P-value Lower 95% Upper 95% Intercept Square Feet QMIS 220, by Dr. M. Zainal Chap 13-50
51 Comparing Standard Errors y Variation of observed y values from the regression line y Variation in the slope of regression lines from different possible samples smalls x smalls b1 x y y larges x large s b1 QMIS 220, by Dr. M. Zainal Chap x
52 Inference about the Slope: t Test t test for a population slope Is there a linear relationship between x and y? Null and alternative hypotheses H 0 : β 1 = 0 H A : β 1 0 Test statistic t b1 β s b 1 1 (no linear relationship) (linear relationship does exist) where: b 1 = Sample regression slope coefficient β 1 = Hypothesized slope s b1 = Estimator of the standard error of the slope d.f. n 2 QMIS 220, by Dr. M. Zainal Chap 13-52
53 Inference about the Slope: t Test (continued) House Price in $1000s (y) Square Feet (x) Estimated Regression Equation: houseprice (sq.ft.) The slope of this model is Does square footage of the house affect its sales price? QMIS 220, by Dr. M. Zainal Chap 13-53
54 Inferences about the Slope: t Test Example H 0 : β 1 = 0 H A : β 1 0 d.f. = 10-2 = 8 From Excel output: Coefficients Standard Error t Stat P-value Intercept Square Feet Decision: /2=.025 /2=.025 Conclusion: Reject H 0 Do not reject H Reject H -t 0 0 α/2 t α/ QMIS 220, by Dr. M. Zainal Chap 13-54
55 Regression Analysis for Description Confidence Interval Estimate of the Slope: b t s 1 /2 b 1 d.f. = n - 2 Excel Printout for House Prices: Coefficients Standard Error t Stat P-value Lower 95% Upper 95% Intercept Square Feet QMIS 220, by Dr. M. Zainal Chap 13-55
56 Regression Analysis for Description Coefficients Standard Error t Stat P-value Lower 95% Upper 95% Intercept Square Feet Since the units of the house price variable is $1000s, we are 95% confident that the average impact on sales price is between $33.70 and $ per square foot of house size This 95% confidence interval does not include 0. Conclusion: There is a significant relationship between house price and square feet at the.05 level of significance QMIS 220, by Dr. M. Zainal Chap 13-56
57 Confidence Interval for the Average y, Given x Confidence interval estimate for the mean of y given a particular x p Size of interval varies according to distance away from mean, x ŷ 2 1 (xp x) t /2sε 2 n (x x) QMIS 220, by Dr. M. Zainal Chap 13-57
58 Confidence Interval for an Individual y, Given x Confidence interval estimate for an Individual value of y given a particular x p ŷ 1 (x x) t s 1 p /2 ε n (x x) 2 2 QMIS 220, by Dr. M. Zainal Chap 13-58
59 Example: House Prices House Price in $1000s (y) Square Feet (x) Estimated Regression Equation: houseprice (sq.ft.) Predict the price for a house with 2000 square feet QMIS 220, by Dr. M. Zainal Chap 13-59
60 Example: House Prices Predict the price for a house with 2000 square feet: (continued) houseprice (sq.ft.) (2000) The predicted price for a house with 2000 square feet is ($1,000s) = $317,850 QMIS 220, by Dr. M. Zainal Chap 13-60
61 Residual Analysis Purposes Examine for linearity assumption Examine for constant variance for all levels of x Evaluate normal distribution assumption Graphical Analysis of Residuals Can plot residuals vs. x Can create histogram of residuals to check for normality QMIS 220, by Dr. M. Zainal Chap 13-61
62 residuals residuals Residual Analysis for Linearity y y x x x x Not Linear Linear QMIS 220, by Dr. M. Zainal Chap 13-62
63 residuals residuals Residual Analysis for Constant Variance y y x x x x Non-constant variance Constant variance QMIS 220, by Dr. M. Zainal Chap 13-63
64 Residuals Excel Output RESIDUAL OUTPUT Predicted House Price Residuals House Price Model Residual Plot Square Feet QMIS 220, by Dr. M. Zainal Chap 13-64
65 Chapter Summary Introduced correlation analysis Discussed correlation to measure the strength of a linear association Introduced simple linear regression analysis Calculated the coefficients for the simple linear regression equation Described measures of variation (R 2 and s ε ) Addressed assumptions of regression and correlation QMIS 220, by Dr. M. Zainal Chap 13-65
66 Chapter Summary (continued) Described inference about the slope Addressed estimation of mean values and prediction of individual values Discussed residual analysis QMIS 220, by Dr. M. Zainal Chap 13-66
67 Problems A random sample of eight drivers insured with a company and having similar auto insurance policies was selected. The following table lists their driving experiences (in years) and monthly auto insurance premiums. Driving Experience (years) Monthly Auto Insurance Premium QMIS 220, by Dr. M. Zainal Chap 13-67
68 Problems a. Does the insurance premium depend on the driving experience or does the driving experience depend on the insurance premium? Do you expect a positive or a negative relationship between these two variables? QMIS 220, by Dr. M. Zainal Chap 13-68
69 Problems b. Compute SS xx, SS yy, and SS xy. QMIS 220, by Dr. M. Zainal Chap 13-69
70 Problems c. Find the least squares regression line by choosing appropriate dependent and independent variables based on your answer in part a. QMIS 220, by Dr. M. Zainal Chap 13-70
71 Problems d. Interpret the meaning of the values of a and b calculated in part c QMIS 220, by Dr. M. Zainal Chap 13-71
72 Problems e. Plot the scatter diagram and the regression line QMIS 220, by Dr. M. Zainal Chap 13-72
73 Problems f. Calculate r and r 2 and explain what they mean QMIS 220, by Dr. M. Zainal Chap 13-73
74 Problems g. Predict the monthly auto insurance premium for a driver with 10 years of driving experience QMIS 220, by Dr. M. Zainal Chap 13-74
75 Problems h. Compute the standard deviation of errors QMIS 220, by Dr. M. Zainal Chap 13-75
76 Problems i. Construct a 90% confidence interval for B. QMIS 220, by Dr. M. Zainal Chap 13-76
77 Problems j. Test at the 5% significance level whether B is negative. QMIS 220, by Dr. M. Zainal Chap 13-77
78 Problems k. Using α =.05, test whether ρ is different from zero. QMIS 220, by Dr. M. Zainal Chap 13-78
79 Copyright The materials of this presentation were mostly taken from the PowerPoint files accompanied Business Statistics: A Decision-Making Approach, 7e 2008 Prentice-Hall, Inc. QMIS 220, by Dr. M. Zainal Chap 10-79
Chapter 13 Student Lecture Notes Department of Quantitative Methods & Information Systems. Business Statistics
Chapter 13 Student Lecture Notes 13-1 Department of Quantitative Methods & Information Sstems Business Statistics Chapter 14 Introduction to Linear Regression and Correlation Analsis QMIS 0 Dr. Mohammad
More informationCorrelation Analysis
Simple Regression Correlation Analysis Correlation analysis is used to measure strength of the association (linear relationship) between two variables Correlation is only concerned with strength of the
More informationBasic Business Statistics 6 th Edition
Basic Business Statistics 6 th Edition Chapter 12 Simple Linear Regression Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value of a dependent variable based
More informationChapter Learning Objectives. Regression Analysis. Correlation. Simple Linear Regression. Chapter 12. Simple Linear Regression
Chapter 12 12-1 North Seattle Community College BUS21 Business Statistics Chapter 12 Learning Objectives In this chapter, you learn:! How to use regression analysis to predict the value of a dependent
More informationStatistics for Managers using Microsoft Excel 6 th Edition
Statistics for Managers using Microsoft Excel 6 th Edition Chapter 13 Simple Linear Regression 13-1 Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value of
More informationChapter 14 Student Lecture Notes Department of Quantitative Methods & Information Systems. Business Statistics. Chapter 14 Multiple Regression
Chapter 14 Student Lecture Notes 14-1 Department of Quantitative Methods & Information Systems Business Statistics Chapter 14 Multiple Regression QMIS 0 Dr. Mohammad Zainal Chapter Goals After completing
More informationBusiness Statistics. Lecture 10: Correlation and Linear Regression
Business Statistics Lecture 10: Correlation and Linear Regression Scatterplot A scatterplot shows the relationship between two quantitative variables measured on the same individuals. It displays the Form
More informationChapter 4. Regression Models. Learning Objectives
Chapter 4 Regression Models To accompany Quantitative Analysis for Management, Eleventh Edition, by Render, Stair, and Hanna Power Point slides created by Brian Peterson Learning Objectives After completing
More informationCh 13 & 14 - Regression Analysis
Ch 3 & 4 - Regression Analysis Simple Regression Model I. Multiple Choice:. A simple regression is a regression model that contains a. only one independent variable b. only one dependent variable c. more
More informationWhat is a Hypothesis?
What is a Hypothesis? A hypothesis is a claim (assumption) about a population parameter: population mean Example: The mean monthly cell phone bill in this city is μ = $42 population proportion Example:
More informationThe simple linear regression model discussed in Chapter 13 was written as
1519T_c14 03/27/2006 07:28 AM Page 614 Chapter Jose Luis Pelaez Inc/Blend Images/Getty Images, Inc./Getty Images, Inc. 14 Multiple Regression 14.1 Multiple Regression Analysis 14.2 Assumptions of the Multiple
More informationRegression Models. Chapter 4. Introduction. Introduction. Introduction
Chapter 4 Regression Models Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna 008 Prentice-Hall, Inc. Introduction Regression analysis is a very valuable tool for a manager
More informationChapter 16. Simple Linear Regression and dcorrelation
Chapter 16 Simple Linear Regression and dcorrelation 16.1 Regression Analysis Our problem objective is to analyze the relationship between interval variables; regression analysis is the first tool we will
More informationBasic Business Statistics, 10/e
Chapter 4 4- Basic Business Statistics th Edition Chapter 4 Introduction to Multiple Regression Basic Business Statistics, e 9 Prentice-Hall, Inc. Chap 4- Learning Objectives In this chapter, you learn:
More informationChapter 7 Student Lecture Notes 7-1
Chapter 7 Student Lecture Notes 7- Chapter Goals QM353: Business Statistics Chapter 7 Multiple Regression Analysis and Model Building After completing this chapter, you should be able to: Explain model
More informationChapter 16. Simple Linear Regression and Correlation
Chapter 16 Simple Linear Regression and Correlation 16.1 Regression Analysis Our problem objective is to analyze the relationship between interval variables; regression analysis is the first tool we will
More informationChapter 3 Multiple Regression Complete Example
Department of Quantitative Methods & Information Systems ECON 504 Chapter 3 Multiple Regression Complete Example Spring 2013 Dr. Mohammad Zainal Review Goals After completing this lecture, you should be
More informationThe Multiple Regression Model
Multiple Regression The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & or more independent variables (X i ) Multiple Regression Model with k Independent Variables:
More informationCh 2: Simple Linear Regression
Ch 2: Simple Linear Regression 1. Simple Linear Regression Model A simple regression model with a single regressor x is y = β 0 + β 1 x + ɛ, where we assume that the error ɛ is independent random component
More informationEstimating σ 2. We can do simple prediction of Y and estimation of the mean of Y at any value of X.
Estimating σ 2 We can do simple prediction of Y and estimation of the mean of Y at any value of X. To perform inferences about our regression line, we must estimate σ 2, the variance of the error term.
More informationChapter 14 Student Lecture Notes 14-1
Chapter 14 Student Lecture Notes 14-1 Business Statistics: A Decision-Making Approach 6 th Edition Chapter 14 Multiple Regression Analysis and Model Building Chap 14-1 Chapter Goals After completing this
More informationRegression Models. Chapter 4
Chapter 4 Regression Models To accompany Quantitative Analysis for Management, Eleventh Edition, by Render, Stair, and Hanna Power Point slides created by Brian Peterson Introduction Regression analysis
More informationChapte The McGraw-Hill Companies, Inc. All rights reserved.
12er12 Chapte Bivariate i Regression (Part 1) Bivariate Regression Visual Displays Begin the analysis of bivariate data (i.e., two variables) with a scatter plot. A scatter plot - displays each observed
More information(ii) Scan your answer sheets INTO ONE FILE only, and submit it in the drop-box.
FINAL EXAM ** Two different ways to submit your answer sheet (i) Use MS-Word and place it in a drop-box. (ii) Scan your answer sheets INTO ONE FILE only, and submit it in the drop-box. Deadline: December
More informationChapter 14 Simple Linear Regression (A)
Chapter 14 Simple Linear Regression (A) 1. Characteristics Managerial decisions often are based on the relationship between two or more variables. can be used to develop an equation showing how the variables
More informationInferences for Regression
Inferences for Regression An Example: Body Fat and Waist Size Looking at the relationship between % body fat and waist size (in inches). Here is a scatterplot of our data set: Remembering Regression In
More informationKeller: Stats for Mgmt & Econ, 7th Ed July 17, 2006
Chapter 17 Simple Linear Regression and Correlation 17.1 Regression Analysis Our problem objective is to analyze the relationship between interval variables; regression analysis is the first tool we will
More informationTopic 10 - Linear Regression
Topic 10 - Linear Regression Least squares principle Hypothesis tests/confidence intervals/prediction intervals for regression 1 Linear Regression How much should you pay for a house? Would you consider
More informationChapter 4: Regression Models
Sales volume of company 1 Textbook: pp. 129-164 Chapter 4: Regression Models Money spent on advertising 2 Learning Objectives After completing this chapter, students will be able to: Identify variables,
More informationChapter 12 - Lecture 2 Inferences about regression coefficient
Chapter 12 - Lecture 2 Inferences about regression coefficient April 19th, 2010 Facts about slope Test Statistic Confidence interval Hypothesis testing Test using ANOVA Table Facts about slope In previous
More informationMathematics for Economics MA course
Mathematics for Economics MA course Simple Linear Regression Dr. Seetha Bandara Simple Regression Simple linear regression is a statistical method that allows us to summarize and study relationships between
More informationECON 450 Development Economics
ECON 450 Development Economics Statistics Background University of Illinois at Urbana-Champaign Summer 2017 Outline 1 Introduction 2 3 4 5 Introduction Regression analysis is one of the most important
More informationInference for the Regression Coefficient
Inference for the Regression Coefficient Recall, b 0 and b 1 are the estimates of the slope β 1 and intercept β 0 of population regression line. We can shows that b 0 and b 1 are the unbiased estimates
More informationInference for Regression Simple Linear Regression
Inference for Regression Simple Linear Regression IPS Chapter 10.1 2009 W.H. Freeman and Company Objectives (IPS Chapter 10.1) Simple linear regression p Statistical model for linear regression p Estimating
More informationSection 3: Simple Linear Regression
Section 3: Simple Linear Regression Carlos M. Carvalho The University of Texas at Austin McCombs School of Business http://faculty.mccombs.utexas.edu/carlos.carvalho/teaching/ 1 Regression: General Introduction
More informationEcon 3790: Business and Economics Statistics. Instructor: Yogesh Uppal
Econ 3790: Business and Economics Statistics Instructor: Yogesh Uppal yuppal@ysu.edu Sampling Distribution of b 1 Expected value of b 1 : Variance of b 1 : E(b 1 ) = 1 Var(b 1 ) = σ 2 /SS x Estimate of
More informationCh 3: Multiple Linear Regression
Ch 3: Multiple Linear Regression 1. Multiple Linear Regression Model Multiple regression model has more than one regressor. For example, we have one response variable and two regressor variables: 1. delivery
More informationEcon 3790: Statistics Business and Economics. Instructor: Yogesh Uppal
Econ 3790: Statistics Business and Economics Instructor: Yogesh Uppal Email: yuppal@ysu.edu Chapter 14 Covariance and Simple Correlation Coefficient Simple Linear Regression Covariance Covariance between
More informationMeasuring the fit of the model - SSR
Measuring the fit of the model - SSR Once we ve determined our estimated regression line, we d like to know how well the model fits. How far/close are the observations to the fitted line? One way to do
More informationA discussion on multiple regression models
A discussion on multiple regression models In our previous discussion of simple linear regression, we focused on a model in which one independent or explanatory variable X was used to predict the value
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More informationSix Sigma Black Belt Study Guides
Six Sigma Black Belt Study Guides 1 www.pmtutor.org Powered by POeT Solvers Limited. Analyze Correlation and Regression Analysis 2 www.pmtutor.org Powered by POeT Solvers Limited. Variables and relationships
More informationInference for Regression Inference about the Regression Model and Using the Regression Line
Inference for Regression Inference about the Regression Model and Using the Regression Line PBS Chapter 10.1 and 10.2 2009 W.H. Freeman and Company Objectives (PBS Chapter 10.1 and 10.2) Inference about
More informationInteractions. Interactions. Lectures 1 & 2. Linear Relationships. y = a + bx. Slope. Intercept
Interactions Lectures 1 & Regression Sometimes two variables appear related: > smoking and lung cancers > height and weight > years of education and income > engine size and gas mileage > GMAT scores and
More informationRegression Analysis II
Regression Analysis II Measures of Goodness of fit Two measures of Goodness of fit Measure of the absolute fit of the sample points to the sample regression line Standard error of the estimate An index
More informationSimple Linear Regression
Simple Linear Regression In simple linear regression we are concerned about the relationship between two variables, X and Y. There are two components to such a relationship. 1. The strength of the relationship.
More informationFinding Relationships Among Variables
Finding Relationships Among Variables BUS 230: Business and Economic Research and Communication 1 Goals Specific goals: Re-familiarize ourselves with basic statistics ideas: sampling distributions, hypothesis
More informationInference for Regression
Inference for Regression Section 9.4 Cathy Poliak, Ph.D. cathy@math.uh.edu Office in Fleming 11c Department of Mathematics University of Houston Lecture 13b - 3339 Cathy Poliak, Ph.D. cathy@math.uh.edu
More informationMultiple Regression. Inference for Multiple Regression and A Case Study. IPS Chapters 11.1 and W.H. Freeman and Company
Multiple Regression Inference for Multiple Regression and A Case Study IPS Chapters 11.1 and 11.2 2009 W.H. Freeman and Company Objectives (IPS Chapters 11.1 and 11.2) Multiple regression Data for multiple
More informationRegression Analysis. BUS 735: Business Decision Making and Research. Learn how to detect relationships between ordinal and categorical variables.
Regression Analysis BUS 735: Business Decision Making and Research 1 Goals of this section Specific goals Learn how to detect relationships between ordinal and categorical variables. Learn how to estimate
More informationChapter 4 Describing the Relation between Two Variables
Chapter 4 Describing the Relation between Two Variables 4.1 Scatter Diagrams and Correlation The is the variable whose value can be explained by the value of the or. A is a graph that shows the relationship
More informationregression analysis is a type of inferential statistics which tells us whether relationships between two or more variables exist
regression analysis is a type of inferential statistics which tells us whether relationships between two or more variables exist sales $ (y - dependent variable) advertising $ (x - independent variable)
More information: The model hypothesizes a relationship between the variables. The simplest probabilistic model: or.
Chapter Simple Linear Regression : comparing means across groups : presenting relationships among numeric variables. Probabilistic Model : The model hypothesizes an relationship between the variables.
More informationSTA121: Applied Regression Analysis
STA121: Applied Regression Analysis Linear Regression Analysis - Chapters 3 and 4 in Dielman Artin Department of Statistical Science September 15, 2009 Outline 1 Simple Linear Regression Analysis 2 Using
More informationRegression Analysis. BUS 735: Business Decision Making and Research
Regression Analysis BUS 735: Business Decision Making and Research 1 Goals and Agenda Goals of this section Specific goals Learn how to detect relationships between ordinal and categorical variables. Learn
More informationSIMPLE REGRESSION ANALYSIS. Business Statistics
SIMPLE REGRESSION ANALYSIS Business Statistics CONTENTS Ordinary least squares (recap for some) Statistical formulation of the regression model Assessing the regression model Testing the regression coefficients
More informationChapter 10. Regression. Understandable Statistics Ninth Edition By Brase and Brase Prepared by Yixun Shi Bloomsburg University of Pennsylvania
Chapter 10 Regression Understandable Statistics Ninth Edition By Brase and Brase Prepared by Yixun Shi Bloomsburg University of Pennsylvania Scatter Diagrams A graph in which pairs of points, (x, y), are
More informationChapter 8 Student Lecture Notes 8-1. Department of Economics. Business Statistics. Chapter 12 Chi-square test of independence & Analysis of Variance
Chapter 8 Student Lecture Notes 8-1 Department of Economics Business Statistics Chapter 1 Chi-square test of independence & Analysis of Variance ECON 509 Dr. Mohammad Zainal Chapter Goals After completing
More informationChapter 13. Multiple Regression and Model Building
Chapter 13 Multiple Regression and Model Building Multiple Regression Models The General Multiple Regression Model y x x x 0 1 1 2 2... k k y is the dependent variable x, x,..., x 1 2 k the model are the
More informationdf=degrees of freedom = n - 1
One sample t-test test of the mean Assumptions: Independent, random samples Approximately normal distribution (from intro class: σ is unknown, need to calculate and use s (sample standard deviation)) Hypotheses:
More informationCan you tell the relationship between students SAT scores and their college grades?
Correlation One Challenge Can you tell the relationship between students SAT scores and their college grades? A: The higher SAT scores are, the better GPA may be. B: The higher SAT scores are, the lower
More informationCorrelation and the Analysis of Variance Approach to Simple Linear Regression
Correlation and the Analysis of Variance Approach to Simple Linear Regression Biometry 755 Spring 2009 Correlation and the Analysis of Variance Approach to Simple Linear Regression p. 1/35 Correlation
More informationCorrelation. A statistics method to measure the relationship between two variables. Three characteristics
Correlation Correlation A statistics method to measure the relationship between two variables Three characteristics Direction of the relationship Form of the relationship Strength/Consistency Direction
More informationAMS 315/576 Lecture Notes. Chapter 11. Simple Linear Regression
AMS 315/576 Lecture Notes Chapter 11. Simple Linear Regression 11.1 Motivation A restaurant opening on a reservations-only basis would like to use the number of advance reservations x to predict the number
More informationBNAD 276 Lecture 10 Simple Linear Regression Model
1 / 27 BNAD 276 Lecture 10 Simple Linear Regression Model Phuong Ho May 30, 2017 2 / 27 Outline 1 Introduction 2 3 / 27 Outline 1 Introduction 2 4 / 27 Simple Linear Regression Model Managerial decisions
More informationBayesian Analysis LEARNING OBJECTIVES. Calculating Revised Probabilities. Calculating Revised Probabilities. Calculating Revised Probabilities
Valua%on and pricing (November 5, 2013) LEARNING OBJECTIVES Lecture 7 Decision making (part 3) Regression theory Olivier J. de Jong, LL.M., MM., MBA, CFD, CFFA, AA www.olivierdejong.com 1. List the steps
More informationSimple Linear Regression. Material from Devore s book (Ed 8), and Cengagebrain.com
12 Simple Linear Regression Material from Devore s book (Ed 8), and Cengagebrain.com The Simple Linear Regression Model The simplest deterministic mathematical relationship between two variables x and
More informationLECTURE 6. Introduction to Econometrics. Hypothesis testing & Goodness of fit
LECTURE 6 Introduction to Econometrics Hypothesis testing & Goodness of fit October 25, 2016 1 / 23 ON TODAY S LECTURE We will explain how multiple hypotheses are tested in a regression model We will define
More informationSimple Linear Regression
Simple Linear Regression ST 430/514 Recall: A regression model describes how a dependent variable (or response) Y is affected, on average, by one or more independent variables (or factors, or covariates)
More informationLectures on Simple Linear Regression Stat 431, Summer 2012
Lectures on Simple Linear Regression Stat 43, Summer 0 Hyunseung Kang July 6-8, 0 Last Updated: July 8, 0 :59PM Introduction Previously, we have been investigating various properties of the population
More informationChapter 12 - Part I: Correlation Analysis
ST coursework due Friday, April - Chapter - Part I: Correlation Analysis Textbook Assignment Page - # Page - #, Page - # Lab Assignment # (available on ST webpage) GOALS When you have completed this lecture,
More informationLI EAR REGRESSIO A D CORRELATIO
CHAPTER 6 LI EAR REGRESSIO A D CORRELATIO Page Contents 6.1 Introduction 10 6. Curve Fitting 10 6.3 Fitting a Simple Linear Regression Line 103 6.4 Linear Correlation Analysis 107 6.5 Spearman s Rank Correlation
More informationCorrelation and Regression Analysis. Linear Regression and Correlation. Correlation and Linear Regression. Three Questions.
10/8/18 Correlation and Regression Analysis Correlation Analysis is the study of the relationship between variables. It is also defined as group of techniques to measure the association between two variables.
More informationLinear Regression. Simple linear regression model determines the relationship between one dependent variable (y) and one independent variable (x).
Linear Regression Simple linear regression model determines the relationship between one dependent variable (y) and one independent variable (x). A dependent variable is a random variable whose variation
More information9. Linear Regression and Correlation
9. Linear Regression and Correlation Data: y a quantitative response variable x a quantitative explanatory variable (Chap. 8: Recall that both variables were categorical) For example, y = annual income,
More informationRegression Models REVISED TEACHING SUGGESTIONS ALTERNATIVE EXAMPLES
M04_REND6289_10_IM_C04.QXD 5/7/08 2:49 PM Page 46 4 C H A P T E R Regression Models TEACHING SUGGESTIONS Teaching Suggestion 4.1: Which Is the Independent Variable? We find that students are often confused
More informationStatistics and Quantitative Analysis U4320
Statistics and Quantitative Analysis U3 Lecture 13: Explaining Variation Prof. Sharyn O Halloran Explaining Variation: Adjusted R (cont) Definition of Adjusted R So we'd like a measure like R, but one
More informationDepartment of Economics. Business Statistics. Chapter 12 Chi-square test of independence & Analysis of Variance ECON 509. Dr.
Department of Economics Business Statistics Chapter 1 Chi-square test of independence & Analysis of Variance ECON 509 Dr. Mohammad Zainal Chapter Goals After completing this chapter, you should be able
More informationLecture 15 Multiple regression I Chapter 6 Set 2 Least Square Estimation The quadratic form to be minimized is
Lecture 15 Multiple regression I Chapter 6 Set 2 Least Square Estimation The quadratic form to be minimized is Q = (Y i β 0 β 1 X i1 β 2 X i2 β p 1 X i.p 1 ) 2, which in matrix notation is Q = (Y Xβ) (Y
More informationSimple Linear Regression Using Ordinary Least Squares
Simple Linear Regression Using Ordinary Least Squares Purpose: To approximate a linear relationship with a line. Reason: We want to be able to predict Y using X. Definition: The Least Squares Regression
More informationTrendlines Simple Linear Regression Multiple Linear Regression Systematic Model Building Practical Issues
Trendlines Simple Linear Regression Multiple Linear Regression Systematic Model Building Practical Issues Overfitting Categorical Variables Interaction Terms Non-linear Terms Linear Logarithmic y = a +
More informationSimple Linear Regression
9-1 l Chapter 9 l Simple Linear Regression 9.1 Simple Linear Regression 9.2 Scatter Diagram 9.3 Graphical Method for Determining Regression 9.4 Least Square Method 9.5 Correlation Coefficient and Coefficient
More informationSociology 6Z03 Review II
Sociology 6Z03 Review II John Fox McMaster University Fall 2016 John Fox (McMaster University) Sociology 6Z03 Review II Fall 2016 1 / 35 Outline: Review II Probability Part I Sampling Distributions Probability
More informationTMA4255 Applied Statistics V2016 (5)
TMA4255 Applied Statistics V2016 (5) Part 2: Regression Simple linear regression [11.1-11.4] Sum of squares [11.5] Anna Marie Holand To be lectured: January 26, 2016 wiki.math.ntnu.no/tma4255/2016v/start
More informationFormal Statement of Simple Linear Regression Model
Formal Statement of Simple Linear Regression Model Y i = β 0 + β 1 X i + ɛ i Y i value of the response variable in the i th trial β 0 and β 1 are parameters X i is a known constant, the value of the predictor
More informationLinear Regression and Correlation
Linear Regression and Correlation Chapter 13 McGraw-Hill/Irwin Copyright 2010 by The McGraw-Hill Companies, Inc. All rights reserved. GOALS 1. Understand and interpret the terms dependent and independent
More informationLecture 10 Multiple Linear Regression
Lecture 10 Multiple Linear Regression STAT 512 Spring 2011 Background Reading KNNL: 6.1-6.5 10-1 Topic Overview Multiple Linear Regression Model 10-2 Data for Multiple Regression Y i is the response variable
More informationBusiness Statistics:
Department of Quantitative Methods & Information Systems Business Statistics: Chapter 7 Introduction to Sampling Distributions QMIS 220 Dr. Mohammad Zainal Chapter Goals After completing this chapter,
More informationSTAT 350 Final (new Material) Review Problems Key Spring 2016
1. The editor of a statistics textbook would like to plan for the next edition. A key variable is the number of pages that will be in the final version. Text files are prepared by the authors using LaTeX,
More informationStatistical Techniques II EXST7015 Simple Linear Regression
Statistical Techniques II EXST7015 Simple Linear Regression 03a_SLR 1 Y - the dependent variable 35 30 25 The objective Given points plotted on two coordinates, Y and X, find the best line to fit the data.
More informationCh14. Multiple Regression Analysis
Ch14. Multiple Regression Analysis 1 Goals : multiple regression analysis Model Building and Estimating More than 1 independent variables Quantitative( 量 ) independent variables Qualitative( ) independent
More informationCHAPTER EIGHT Linear Regression
7 CHAPTER EIGHT Linear Regression 8. Scatter Diagram Example 8. A chemical engineer is investigating the effect of process operating temperature ( x ) on product yield ( y ). The study results in the following
More informationREVIEW 8/2/2017 陈芳华东师大英语系
REVIEW Hypothesis testing starts with a null hypothesis and a null distribution. We compare what we have to the null distribution, if the result is too extreme to belong to the null distribution (p
More informationCHAPTER 5 LINEAR REGRESSION AND CORRELATION
CHAPTER 5 LINEAR REGRESSION AND CORRELATION Expected Outcomes Able to use simple and multiple linear regression analysis, and correlation. Able to conduct hypothesis testing for simple and multiple linear
More informationChapter 12 : Linear Correlation and Linear Regression
Chapter 1 : Linear Correlation and Linear Regression Determining whether a linear relationship exists between two quantitative variables, and modeling the relationship with a line, if the linear relationship
More informationLecture 2 Simple Linear Regression STAT 512 Spring 2011 Background Reading KNNL: Chapter 1
Lecture Simple Linear Regression STAT 51 Spring 011 Background Reading KNNL: Chapter 1-1 Topic Overview This topic we will cover: Regression Terminology Simple Linear Regression with a single predictor
More informationSTAT Chapter 11: Regression
STAT 515 -- Chapter 11: Regression Mostly we have studied the behavior of a single random variable. Often, however, we gather data on two random variables. We wish to determine: Is there a relationship
More informationReview of Statistics 101
Review of Statistics 101 We review some important themes from the course 1. Introduction Statistics- Set of methods for collecting/analyzing data (the art and science of learning from data). Provides methods
More informationSTATISTICAL DATA ANALYSIS IN EXCEL
Microarra Center STATISTICAL DATA ANALYSIS IN EXCEL Lecture 5 Linear Regression dr. Petr Nazarov 14-1-213 petr.nazarov@crp-sante.lu Statistical data analsis in Ecel. 5. Linear regression OUTLINE Lecture
More informationSTAT5044: Regression and Anova. Inyoung Kim
STAT5044: Regression and Anova Inyoung Kim 2 / 47 Outline 1 Regression 2 Simple Linear regression 3 Basic concepts in regression 4 How to estimate unknown parameters 5 Properties of Least Squares Estimators:
More information